2024-09-11T23:00:29.967 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:00:29.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:00:30.084 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/strays} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901460' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKqsyR+RDGm+X1Cv7XPXRo4f0jElpaqEkLirAjZB+hgILUYsjGn4bz38bjzDg6c66dBYe9Kia/hXbtKUa2Rrbp0= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO2vG77ta0iMdg3ONRgXNbJYld4v21MB+rp7mBCmvKJE/5wlBgLTIXnWKvi9jREkuvFwGJmNKfNJZDGdLGJn1Vo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_strays teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:00:30.085 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T23:00:30.085 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T23:00:30.085 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:00:30.088 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:00:30.113 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T23:00:30.113 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:00:30.113 INFO:teuthology.packaging:ref: None 2024-09-11T23:00:30.113 INFO:teuthology.packaging:tag: None 2024-09-11T23:00:30.113 INFO:teuthology.packaging:branch: squid 2024-09-11T23:00:30.113 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:00:30.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-11T23:00:30.321 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:00:30.323 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:00:30.329 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:00:30.329 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:00:30.336 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:00:30.352 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:00:30.358 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:00:30.384 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:54:45.095227', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGGw/L6aKRt7tR73cJs7CfR6lm1vR8xWGtNeK2sVNyoZ'} 2024-09-11T23:00:30.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:54:45.093307', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMkbYPUmZUSVpqKQ4uWI4GOlZgslLwnJTMWrYpuRmTbB'} 2024-09-11T23:00:30.410 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:00:30.416 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-11T23:00:30.416 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-11T23:00:30.416 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:00:30.490 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe8d141f130>, signals=[15]) 2024-09-11T23:00:30.490 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:00:30.496 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:00:30.496 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:00:30.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:00:30.589 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:00:30.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:00:30.677 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:00:30.686 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-09-11T23:00:30.692 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-09-11T23:00:30.692 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-09-11T23:00:30.737 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:00:30.737 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2024-09-11T23:00:30.737 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="22.04" 2024-09-11T23:00:30.737 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:00:30.738 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=jammy 2024-09-11T23:00:30.738 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2024-09-11T23:00:30.738 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2024-09-11T23:00:30.738 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:00:30.738 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:00:30.738 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:00:30.739 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:00:30.739 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:00:30.739 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-09-11T23:00:30.774 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-09-11T23:00:30.779 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-09-11T23:00:30.780 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-09-11T23:00:30.824 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:00:30.825 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:00:30.826 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-09-11T23:00:30.857 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:00:30.866 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:00:30.871 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:00:30.871 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:00:30.874 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:00:30.878 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:00:30.882 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:00:30.883 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:00:30.923 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:00:30.944 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:00:31.012 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:00:31.026 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:00:31.026 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:00:31.027 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:00:31.027 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:00:31.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:00:31.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:00:31.032 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-11T23:00:31.033 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-11T23:00:31.077 INFO:teuthology.orchestra.run.smithi094.stdout:5.15.0-56-generic 2024-09-11T23:00:31.078 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.15.0-56-generic 2024-09-11T23:00:31.078 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-09-11T23:00:31.080 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-56-generic 2024-09-11T23:00:31.081 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.15.0-56-generic 2024-09-11T23:00:31.081 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2024-09-11T23:00:31.185 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-09-11T23:00:31.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-09-11T23:00:31.328 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:00:31.359 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:00:31.433 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:00:31.468 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:00:31.514 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:00:31.541 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:00:31.551 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:00:31.569 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:00:31.634 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:00:31.671 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:00:31.673 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:00:31.675 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:00:31.678 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:00:31.679 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:00:31.679 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:00:31.679 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:00:31.681 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:00:31.699 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:00:31.699 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:00:31.703 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:00:31.703 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:00:31.711 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:00:31.712 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:00:31.716 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:00:31.717 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:00:31.717 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:00:31.718 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:00:31.718 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:00:31.718 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:00:31.725 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:00:31.730 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:00:31.730 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:00:31.732 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:00:31.732 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:00:31.732 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:00:31.750 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:00:31.755 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:00:31.756 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:00:31.870 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:00:31.907 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:00:32.009 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:00:32.046 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:00:32.240 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:00:32.324 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:00:32.361 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:00:32.376 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:00:32.376 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:00:32.377 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:00:32.398 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:00:32.412 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:00:32.413 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:00:32.446 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:00:32.461 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:00:32.461 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:00:32.480 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:00:32.482 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:00:32.483 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:00:32.499 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:00:32.499 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:00:32.513 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:00:32.519 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:00:32.520 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:00:32.521 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:00:32.521 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:00:32.531 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:00:32.550 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:00:32.556 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:00:32.563 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:00:32.564 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:00:32.565 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:00:32.572 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:00:32.572 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:00:32.574 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:00:32.575 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:00:32.638 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:00:32.639 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:00:32.640 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:00:32.642 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:00:32.642 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:00:32.644 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:00:32.645 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:00:32.653 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:00:32.654 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:00:32.654 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:00:32.655 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:00:32.655 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:00:32.726 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:00:32.727 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:00:37.972 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 15.8 MB in 2s (7,344 kB/s) 2024-09-11T23:00:38.046 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 15.8 MB in 2s (7,476 kB/s) 2024-09-11T23:00:39.301 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-11T23:00:39.319 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:00:39.371 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-11T23:00:39.525 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-11T23:00:39.542 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:00:39.555 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-11T23:00:39.556 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-11T23:00:39.605 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-11T23:00:39.720 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:00:39.720 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:00:39.720 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:00:39.721 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:00:39.721 INFO:teuthology.orchestra.run.smithi094.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:00:39.721 INFO:teuthology.orchestra.run.smithi094.stdout: python2.7-minimal 2024-09-11T23:00:39.721 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:00:39.722 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-09-11T23:00:39.722 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:00:39.722 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:00:39.723 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:00:39.724 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-09-11T23:00:39.724 INFO:teuthology.orchestra.run.smithi094.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:00:39.724 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-09-11T23:00:39.724 INFO:teuthology.orchestra.run.smithi094.stdout: thermald 2024-09-11T23:00:39.770 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-09-11T23:00:39.770 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:00:39.770 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:00:39.770 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:00:39.771 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-09-11T23:00:39.772 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:00:39.812 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-09-11T23:00:39.813 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-09-11T23:00:39.822 INFO:teuthology.orchestra.run.smithi094.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:00:39.822 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 113 MB of archives. 2024-09-11T23:00:39.822 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:00:39.822 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:00:39.998 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:00:39.998 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:00:39.998 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:00:39.999 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:00:39.999 INFO:teuthology.orchestra.run.smithi155.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:00:39.999 INFO:teuthology.orchestra.run.smithi155.stdout: python2.7-minimal 2024-09-11T23:00:39.999 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:00:40.000 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-09-11T23:00:40.000 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:00:40.000 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:00:40.000 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:00:40.002 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-09-11T23:00:40.002 INFO:teuthology.orchestra.run.smithi155.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:00:40.002 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2024-09-11T23:00:40.002 INFO:teuthology.orchestra.run.smithi155.stdout: thermald 2024-09-11T23:00:40.057 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-09-11T23:00:40.057 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:00:40.057 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:00:40.058 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:00:40.059 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-09-11T23:00:40.059 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:00:40.113 INFO:teuthology.orchestra.run.smithi155.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:00:40.113 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 113 MB of archives. 2024-09-11T23:00:40.113 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:00:40.113 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:00:40.218 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:00:40.307 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:00:40.549 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:00:40.654 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:00:41.113 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:00:41.114 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:00:41.114 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:00:41.241 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:00:41.262 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:00:41.492 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:00:41.492 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:00:41.492 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:00:41.616 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:00:41.639 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:00:41.736 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 113 MB in 2s (73.1 MB/s) 2024-09-11T23:00:41.919 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:00:42.094 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 113 MB in 2s (69.0 MB/s) 2024-09-11T23:00:42.251 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:00:43.938 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:00:43.943 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:00:44.007 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:00:44.202 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:00:44.206 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:00:44.291 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:00:46.123 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:00:46.144 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:00:46.226 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:00:46.527 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:00:46.548 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:00:46.641 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:00:46.729 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:00:46.828 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:00:46.828 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:00:47.122 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:00:47.143 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:00:47.180 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:00:53.692 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:00:53.809 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:00:54.142 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:00:54.247 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:00:54.345 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:00:54.470 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:00:54.558 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:00:54.569 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:00:54.608 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:00:54.819 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:00:54.932 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:00:55.218 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:00:55.241 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:00:55.285 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:01:00.564 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:01:00.601 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:01:00.630 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:01:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:01:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:03.447 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:01:03.573 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:01:03.898 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:01:04.021 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:04.147 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:01:04.234 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:01:04.259 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:04.356 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:01:04.715 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:01:04.853 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:04.979 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:01:05.091 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:05.645 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:01:05.645 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:01:05.645 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:01:05.645 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:05.797 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:06.423 INFO:teuthology.orchestra.run.smithi155.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:01:06.423 INFO:teuthology.orchestra.run.smithi155.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:01:06.423 INFO:teuthology.orchestra.run.smithi155.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:01:06.423 INFO:teuthology.orchestra.run.smithi155.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:06.585 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:07.723 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:08.237 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:09.092 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:01:09.209 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:01:09.319 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:09.381 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:01:09.381 INFO:teuthology.orchestra.run.smithi094.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:09.689 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:01:09.840 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:01:09.966 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:01:10.027 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:01:10.028 INFO:teuthology.orchestra.run.smithi155.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:24.227 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:01:24.227 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:01:24.249 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:01:24.262 INFO:teuthology.orchestra.run.smithi155.stdout:Generating grub configuration file ... 2024-09-11T23:01:24.545 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:01:24.580 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:24.770 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:01:24.770 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:01:24.786 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:01:24.810 INFO:teuthology.orchestra.run.smithi094.stdout:Generating grub configuration file ... 2024-09-11T23:01:24.899 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:01:24.904 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:01:24.972 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:01:24.977 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:01:25.091 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:01:25.107 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:25.137 INFO:teuthology.orchestra.run.smithi155.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:01:25.137 INFO:teuthology.orchestra.run.smithi155.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:01:25.137 INFO:teuthology.orchestra.run.smithi155.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:01:25.192 INFO:teuthology.orchestra.run.smithi155.stdout:done 2024-09-11T23:01:25.419 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:01:25.427 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:01:25.490 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:01:25.495 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:01:25.692 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2024-09-11T23:01:25.705 INFO:teuthology.orchestra.run.smithi094.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:01:25.705 INFO:teuthology.orchestra.run.smithi094.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:01:25.705 INFO:teuthology.orchestra.run.smithi094.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:01:25.712 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 21 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.15.0.119.119 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2024-09-11T23:01:25.713 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2024-09-11T23:01:25.714 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:01:25.714 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2024-09-11T23:01:25.714 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:01:25.715 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:01:25.715 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:01:25.715 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:01:25.715 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:01:25.715 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2024-09-11T23:01:25.749 INFO:teuthology.orchestra.run.smithi094.stdout:done 2024-09-11T23:01:25.921 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-09-11T23:01:26.039 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:01:26.040 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:01:26.050 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:01:26.067 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:01:26.207 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 21 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-09-11T23:01:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.15.0.119.119 2024-09-11T23:01:26.272 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:01:26.272 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:01:26.272 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-09-11T23:01:26.272 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-09-11T23:01:26.272 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:01:26.272 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-09-11T23:01:26.272 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:01:26.272 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:01:26.272 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:01:26.272 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:01:26.272 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:01:26.273 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-09-11T23:01:26.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-09-11T23:01:26.518 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:01:26.641 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:01:26.725 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:01:26.803 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:01:27.412 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-11T23:01:27.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:01:27.491 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-11T23:01:27.712 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-09-11T23:01:27.712 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-09-11T23:01:27.895 INFO:teuthology.orchestra.run.smithi155.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:01:27.895 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:01:27.896 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:01:27.896 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:01:27.896 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:01:27.896 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:01:27.896 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:01:27.896 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:01:27.938 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:01:27.939 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2024-09-11T23:01:27.954 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2024-09-11T23:01:27.954 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2024-09-11T23:01:27.954 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 21 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.15.0.119.119 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:01:27.955 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2024-09-11T23:01:27.956 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-11T23:01:27.980 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-11T23:01:27.999 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:01:28.000 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.IPKJmaRxHU 2024-09-11T23:01:28.000 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub/grub.cfg /tmp/tmp.IPKJmaRxHU 2024-09-11T23:01:28.053 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-11T23:01:28.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.IPKJmaRxHU 2024-09-11T23:01:28.168 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.IPKJmaRxHU is 10KB 2024-09-11T23:01:28.181 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.IPKJmaRxHU 2024-09-11T23:01:28.186 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:01:28.239 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-11T23:01:28.239 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-11T23:01:28.240 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:01:28.241 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:01:28.241 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:01:28.333 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:01:28.333 DEBUG:teuthology.orchestra.run.smithi155:> sudo update-grub 2024-09-11T23:01:28.405 INFO:teuthology.orchestra.run.smithi094.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:01:28.406 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:01:28.406 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:01:28.406 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:01:28.406 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:01:28.407 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:01:28.407 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:01:28.407 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:01:28.447 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:01:28.448 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-09-11T23:01:28.512 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-09-11T23:01:28.512 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-09-11T23:01:28.513 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-09-11T23:01:28.513 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-09-11T23:01:28.513 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 21 2024-09-11T23:01:28.513 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.15.0.119.119 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:01:28.514 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-09-11T23:01:28.515 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-11T23:01:28.557 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.KOLuOCB3Z9 2024-09-11T23:01:28.557 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KOLuOCB3Z9 2024-09-11T23:01:28.613 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.KOLuOCB3Z9 2024-09-11T23:01:28.733 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.KOLuOCB3Z9 is 10KB 2024-09-11T23:01:28.745 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.KOLuOCB3Z9 2024-09-11T23:01:28.751 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:01:28.804 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:01:28.804 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:01:28.805 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:01:28.872 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:01:28.872 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-grub 2024-09-11T23:01:29.654 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:01:29.655 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:01:29.660 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-09-11T23:01:29.851 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:01:29.858 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:30.130 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:01:30.135 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:01:30.164 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:01:30.166 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:01:30.168 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-09-11T23:01:30.176 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:01:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:01:30.336 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:01:30.336 INFO:teuthology.orchestra.run.smithi155.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:01:30.336 INFO:teuthology.orchestra.run.smithi155.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:01:30.355 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:01:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-09-11T23:01:30.360 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:01:30.361 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2024-09-11T23:01:30.606 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:01:30.612 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:01:30.655 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:01:30.660 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:01:30.779 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:01:30.779 INFO:teuthology.orchestra.run.smithi094.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:01:30.779 INFO:teuthology.orchestra.run.smithi094.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:01:30.816 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-09-11T23:01:30.824 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-09-11T23:02:00.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:02:00.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-11T23:02:00.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:02:00.827 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:02:00.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-11T23:02:00.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:02:18.945 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-11T23:02:19.201 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-09-11T23:02:27.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-11T23:02:27.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:02:28.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-11T23:02:28.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:02:31.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-11T23:02:31.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-09-11T23:02:43.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-11T23:02:43.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:02:43.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-11T23:02:43.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:03:15.021 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-11T23:03:15.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-11T23:03:15.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-11T23:03:15.672 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-11T23:03:15.718 INFO:teuthology.orchestra.run.smithi094.stdout:5.15.0-119-generic 2024-09-11T23:03:15.718 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T23:03:15.718 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:03:15.718 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T23:03:16.719 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:03:16.720 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:03:16.793 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-09-11T23:03:16.819 DEBUG:teuthology.parallel:result is None 2024-09-11T23:03:43.060 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:03:58.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-11T23:03:58.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:03:58.302 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-11T23:03:58.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-11T23:03:58.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-11T23:03:58.902 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-11T23:03:58.949 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-119-generic 2024-09-11T23:03:58.949 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T23:03:58.949 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:03:58.949 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T23:03:59.951 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T23:03:59.951 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:04:00.318 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2024-09-11T23:04:00.347 DEBUG:teuthology.parallel:result is None 2024-09-11T23:04:00.348 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:04:00.356 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:04:00.357 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:04:00.359 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:04:00.365 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:04:00.468 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:04:00.478 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:04:00.479 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:04:00.481 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:04:00.577 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:04:00.583 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:04:00.583 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:04:00.586 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:04:00.605 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:04:00.605 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:04:00.613 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:04:00.613 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:04:00.615 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:04:00.621 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:04:00.622 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:04:00.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:04:00.673 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:04:00.685 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:04:00.685 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:04:00.715 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:04:00.721 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:04:00.766 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:04:00.814 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:04:00.814 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:04:00.884 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:04:00.890 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:04:00.937 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:04:00.937 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:04:01.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-09-11T23:04:01.009 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-09-11T23:04:01.080 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:04:01.088 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:04:01.088 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:04:01.104 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:04:01.113 DEBUG:teuthology.task.selinux:Excluding smithi094: OS 'ubuntu' does not support SELinux 2024-09-11T23:04:01.114 DEBUG:teuthology.task.selinux:Excluding smithi155: OS 'ubuntu' does not support SELinux 2024-09-11T23:04:01.114 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:04:01.114 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-11T23:04:01.114 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:04:01.114 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:04:01.122 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T23:04:01.126 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T23:04:01.274 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:04:01.285 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:04:01.286 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:11:31.016 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-09-11T23:11:31.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-11T23:11:31.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:31.106 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-11T23:11:31.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-11T23:11:31.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-11T23:11:31.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:31.271 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-11T23:11:31.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-11T23:11:31.345 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:11:31.355 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:11:31.355 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:11:31.355 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:11:31.358 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:11:31.358 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:11:31.384 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-11T23:11:31.385 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Command line: ntpd -gq 2024-09-11T23:11:31.385 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: ---------------------------------------------------- 2024-09-11T23:11:31.385 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: ntp-4 is maintained by Network Time Foundation, 2024-09-11T23:11:31.385 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-11T23:11:31.385 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: corporation. Support and training for ntp-4 are 2024-09-11T23:11:31.385 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: available at https://www.nwtime.org/support 2024-09-11T23:11:31.385 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: ---------------------------------------------------- 2024-09-11T23:11:31.386 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: proto: precision = 0.068 usec (-24) 2024-09-11T23:11:31.386 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: basedate set to 2022-02-04 2024-09-11T23:11:31.386 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: gps base set to 2022-02-06 (week 2196) 2024-09-11T23:11:31.386 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T23:11:31.386 INFO:teuthology.orchestra.run.smithi094.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T23:11:31.387 INFO:teuthology.orchestra.run.smithi094.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: restrict ::: KOD does nothing without LIMITED. 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Listen and drop on 0 v6wildcard [::]:123 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Listen normally on 2 lo 127.0.0.1:123 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Listen normally on 3 enp3s0f1 172.21.15.94:123 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Listen normally on 4 lo [::1]:123 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d763%5]:123 2024-09-11T23:11:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:31 ntpd[18473]: Listening on routing socket on fd #22 for interface updates 2024-09-11T23:11:31.418 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-11T23:11:31.419 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Command line: ntpd -gq 2024-09-11T23:11:31.419 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: ---------------------------------------------------- 2024-09-11T23:11:31.419 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: ntp-4 is maintained by Network Time Foundation, 2024-09-11T23:11:31.419 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-11T23:11:31.419 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: corporation. Support and training for ntp-4 are 2024-09-11T23:11:31.419 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: available at https://www.nwtime.org/support 2024-09-11T23:11:31.419 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: ---------------------------------------------------- 2024-09-11T23:11:31.420 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: proto: precision = 0.044 usec (-24) 2024-09-11T23:11:31.420 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: basedate set to 2022-02-04 2024-09-11T23:11:31.420 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: gps base set to 2022-02-06 (week 2196) 2024-09-11T23:11:31.420 INFO:teuthology.orchestra.run.smithi155.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T23:11:31.421 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T23:11:31.421 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: restrict ::: KOD does nothing without LIMITED. 2024-09-11T23:11:31.421 INFO:teuthology.orchestra.run.smithi155.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-11T23:11:31.422 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Listen and drop on 0 v6wildcard [::]:123 2024-09-11T23:11:31.422 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-11T23:11:31.422 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Listen normally on 2 lo 127.0.0.1:123 2024-09-11T23:11:31.422 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Listen normally on 3 enp3s0f1 172.21.15.155:123 2024-09-11T23:11:31.422 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Listen normally on 4 lo [::1]:123 2024-09-11T23:11:31.422 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6ded%5]:123 2024-09-11T23:11:31.422 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:31 ntpd[18471]: Listening on routing socket on fd #22 for interface updates 2024-09-11T23:11:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:32 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:32.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:32.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:32.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:32.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:32.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:32.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:32.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:32 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:33.385 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:33 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:33.385 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:33 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:34.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:34.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:34.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:34.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:34.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:34.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:34.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:34.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:34.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:34.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:34.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:34.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:34 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:34 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:34 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:34.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:34 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:34.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:34 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:34.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:34 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:34.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:34 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:35.385 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:35 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:35.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:35 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:35.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:35 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:35.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:35 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:35.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:35 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:35.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:35 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:35.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:35.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:35.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:35.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:35.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:35 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:36.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:36.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:36.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:36.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:36.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:36 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:36.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:36 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:36.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:36 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:36.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:36 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:36.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:36 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:36 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:36 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:37.385 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:37 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:37 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:37 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:37 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:37 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:37 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:37.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:37.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:37.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:37.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:37.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:37.423 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:37.423 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:37 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:38.386 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:38.387 INFO:teuthology.orchestra.run.smithi094.stdout:11 Sep 23:11:38 ntpd[18473]: ntpd: time slew +0.001316 s 2024-09-11T23:11:38.387 INFO:teuthology.orchestra.run.smithi094.stdout:ntpd: time slew +0.001316s 2024-09-11T23:11:38.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-11T23:11:38.387 INFO:teuthology.orchestra.run.smithi094.stderr:11 Sep 23:11:38 ntpd[18473]: can't open /var/log/ntpstats/loopstats.20240911: Permission denied 2024-09-11T23:11:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:11:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:11:38.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:11:38.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:11:38.420 INFO:teuthology.orchestra.run.smithi155.stdout:11 Sep 23:11:38 ntpd[18471]: ntpd: time slew +0.001058 s 2024-09-11T23:11:38.420 INFO:teuthology.orchestra.run.smithi155.stdout:ntpd: time slew +0.001058s 2024-09-11T23:11:38.420 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-11T23:11:38.421 INFO:teuthology.orchestra.run.smithi155.stderr:11 Sep 23:11:38 ntpd[18471]: can't open /var/log/ntpstats/loopstats.20240911: Permission denied 2024-09-11T23:11:38.441 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T23:11:38.441 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-09-11T23:11:38.441 INFO:teuthology.orchestra.run.smithi094.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.441 INFO:teuthology.orchestra.run.smithi094.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.441 INFO:teuthology.orchestra.run.smithi094.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.441 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.472 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T23:11:38.472 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-09-11T23:11:38.472 INFO:teuthology.orchestra.run.smithi155.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.472 INFO:teuthology.orchestra.run.smithi155.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.472 INFO:teuthology.orchestra.run.smithi155.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.472 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:11:38.473 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:11:38.482 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:11:38.482 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T23:11:38.482 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T23:11:38.482 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:11:38.487 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:11:38.487 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T23:11:38.488 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-key list | grep Ceph 2024-09-11T23:11:38.488 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-key list | grep Ceph 2024-09-11T23:11:38.544 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-11T23:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-11T23:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph.com (release key) 2024-09-11T23:11:38.574 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-11T23:11:38.574 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-11T23:11:38.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:11:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-11T23:11:38.600 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-11T23:11:38.601 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph.com (release key) 2024-09-11T23:11:38.601 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-11T23:11:38.601 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-11T23:11:38.601 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:11:38.725 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-11T23:11:38.726 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:11:38.753 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-11T23:11:38.753 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:11:38.855 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:11:38.855 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-11T23:11:38.870 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:11:38.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-11T23:11:38.871 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-09-11T23:11:38.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-09-11T23:11:39.058 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:11:39.093 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-11T23:11:39.107 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-11T23:11:39.114 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-11T23:11:39.129 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-11T23:11:39.136 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-11T23:11:39.153 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-11T23:11:39.157 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-11T23:11:39.164 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:11:39.183 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:11:39.184 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:11:39.184 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-11T23:11:39.186 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-11T23:11:39.214 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-11T23:11:39.245 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:11:39.255 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:11:39.323 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:11:39.336 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:11:39.476 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 29.0 kB in 0s (69.9 kB/s) 2024-09-11T23:11:39.543 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 29.0 kB in 0s (60.4 kB/s) 2024-09-11T23:11:40.514 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-11T23:11:40.530 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:11:40.574 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-11T23:11:40.585 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-11T23:11:40.590 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:11:40.654 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-11T23:11:40.779 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-11T23:11:40.780 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-11T23:11:40.862 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-09-11T23:11:40.863 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-09-11T23:11:40.963 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:11:40.963 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:11:40.963 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:11:40.963 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:11:40.964 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:11:40.964 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:11:40.964 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:11:40.965 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-09-11T23:11:40.965 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-11T23:11:40.965 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-11T23:11:40.965 INFO:teuthology.orchestra.run.smithi094.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T23:11:40.965 INFO:teuthology.orchestra.run.smithi094.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-11T23:11:40.966 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-11T23:11:40.966 INFO:teuthology.orchestra.run.smithi094.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-11T23:11:40.966 INFO:teuthology.orchestra.run.smithi094.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-11T23:11:40.967 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-11T23:11:40.967 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-11T23:11:40.967 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-11T23:11:40.967 INFO:teuthology.orchestra.run.smithi094.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-11T23:11:40.967 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-11T23:11:40.968 INFO:teuthology.orchestra.run.smithi094.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-11T23:11:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-11T23:11:40.970 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-09-11T23:11:40.970 INFO:teuthology.orchestra.run.smithi094.stdout: btrfs-tools 2024-09-11T23:11:41.071 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:11:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:11:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:11:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:11:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:11:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:11:41.072 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:11:41.073 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-09-11T23:11:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-11T23:11:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-11T23:11:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T23:11:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-11T23:11:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-11T23:11:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-11T23:11:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-11T23:11:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-11T23:11:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-11T23:11:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-11T23:11:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-11T23:11:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-11T23:11:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-11T23:11:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-11T23:11:41.077 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2024-09-11T23:11:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: btrfs-tools 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-11T23:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-11T23:11:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-11T23:11:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-11T23:11:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-11T23:11:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-11T23:11:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-11T23:11:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-11T23:11:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-11T23:11:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-11T23:11:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-11T23:11:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: socat unzip xmlstarlet zip 2024-09-11T23:11:41.185 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-09-11T23:11:41.185 INFO:teuthology.orchestra.run.smithi155.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-11T23:11:41.185 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-11T23:11:41.186 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-11T23:11:41.186 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-11T23:11:41.187 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T23:11:41.187 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-11T23:11:41.187 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-11T23:11:41.187 INFO:teuthology.orchestra.run.smithi155.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-11T23:11:41.187 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-11T23:11:41.187 INFO:teuthology.orchestra.run.smithi155.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-11T23:11:41.187 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-11T23:11:41.188 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-11T23:11:41.189 INFO:teuthology.orchestra.run.smithi155.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-11T23:11:41.189 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-11T23:11:41.189 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-11T23:11:41.189 INFO:teuthology.orchestra.run.smithi155.stdout: socat unzip xmlstarlet zip 2024-09-11T23:11:41.220 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-11T23:11:41.220 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 181 MB of archives. 2024-09-11T23:11:41.221 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-11T23:11:41.221 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-11T23:11:41.266 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-11T23:11:41.332 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-11T23:11:41.332 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 181 MB of archives. 2024-09-11T23:11:41.332 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-11T23:11:41.332 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-11T23:11:41.348 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-11T23:11:41.376 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-11T23:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-11T23:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-11T23:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-11T23:11:41.458 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-11T23:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-11T23:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-11T23:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-11T23:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-11T23:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-11T23:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-11T23:11:41.504 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-11T23:11:41.589 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-11T23:11:41.601 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-11T23:11:41.603 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-11T23:11:41.609 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-11T23:11:41.682 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-11T23:11:41.694 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-11T23:11:41.699 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-11T23:11:41.744 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-11T23:11:41.791 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-11T23:11:41.804 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-11T23:11:41.853 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-11T23:11:41.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-11T23:11:41.926 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-11T23:11:41.952 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-11T23:11:41.961 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-11T23:11:41.962 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-11T23:11:41.981 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-11T23:11:41.984 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-11T23:11:41.989 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-11T23:11:41.991 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-11T23:11:41.999 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-11T23:11:42.026 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-11T23:11:42.035 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-11T23:11:42.062 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-11T23:11:42.070 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-11T23:11:42.071 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-11T23:11:42.073 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-11T23:11:42.090 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-11T23:11:42.095 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-11T23:11:42.099 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-11T23:11:42.102 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-11T23:11:42.109 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-11T23:11:42.130 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-11T23:11:42.166 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-11T23:11:42.184 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-11T23:11:42.186 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-11T23:11:42.187 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-11T23:11:42.188 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-11T23:11:42.188 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-11T23:11:42.189 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-11T23:11:42.191 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-11T23:11:42.191 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-11T23:11:42.192 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-11T23:11:42.192 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-11T23:11:42.193 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-11T23:11:42.193 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-11T23:11:42.194 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-11T23:11:42.194 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-11T23:11:42.196 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-11T23:11:42.196 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-11T23:11:42.197 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-11T23:11:42.198 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-11T23:11:42.252 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-11T23:11:42.254 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-11T23:11:42.255 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-11T23:11:42.269 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-11T23:11:42.269 INFO:teuthology.orchestra.run.smithi094.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-11T23:11:42.271 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-11T23:11:42.276 INFO:teuthology.orchestra.run.smithi094.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-11T23:11:42.281 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-11T23:11:42.281 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-11T23:11:42.282 INFO:teuthology.orchestra.run.smithi094.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-11T23:11:42.282 INFO:teuthology.orchestra.run.smithi094.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-11T23:11:42.283 INFO:teuthology.orchestra.run.smithi094.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-11T23:11:42.284 INFO:teuthology.orchestra.run.smithi094.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-11T23:11:42.286 INFO:teuthology.orchestra.run.smithi094.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-11T23:11:42.287 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-11T23:11:42.287 INFO:teuthology.orchestra.run.smithi094.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-11T23:11:42.287 INFO:teuthology.orchestra.run.smithi094.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-11T23:11:42.288 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-11T23:11:42.288 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-11T23:11:42.289 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-11T23:11:42.291 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-11T23:11:42.291 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-11T23:11:42.353 INFO:teuthology.orchestra.run.smithi094.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-11T23:11:42.353 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-11T23:11:42.374 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-11T23:11:42.375 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-11T23:11:42.376 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-11T23:11:42.381 INFO:teuthology.orchestra.run.smithi094.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-11T23:11:42.387 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-11T23:11:42.387 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-11T23:11:42.388 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-11T23:11:42.389 INFO:teuthology.orchestra.run.smithi155.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-11T23:11:42.432 INFO:teuthology.orchestra.run.smithi094.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-11T23:11:42.433 INFO:teuthology.orchestra.run.smithi094.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-11T23:11:42.436 INFO:teuthology.orchestra.run.smithi155.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-11T23:11:42.440 INFO:teuthology.orchestra.run.smithi155.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-11T23:11:42.444 INFO:teuthology.orchestra.run.smithi094.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-11T23:11:42.445 INFO:teuthology.orchestra.run.smithi094.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-11T23:11:42.446 INFO:teuthology.orchestra.run.smithi094.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-11T23:11:42.447 INFO:teuthology.orchestra.run.smithi094.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-11T23:11:42.450 INFO:teuthology.orchestra.run.smithi094.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-11T23:11:42.454 INFO:teuthology.orchestra.run.smithi094.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-11T23:11:42.513 INFO:teuthology.orchestra.run.smithi094.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-11T23:11:42.515 INFO:teuthology.orchestra.run.smithi155.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-11T23:11:42.516 INFO:teuthology.orchestra.run.smithi094.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-11T23:11:42.518 INFO:teuthology.orchestra.run.smithi155.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-11T23:11:42.520 INFO:teuthology.orchestra.run.smithi155.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-11T23:11:42.525 INFO:teuthology.orchestra.run.smithi155.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-11T23:11:42.525 INFO:teuthology.orchestra.run.smithi155.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-11T23:11:42.527 INFO:teuthology.orchestra.run.smithi155.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-11T23:11:42.531 INFO:teuthology.orchestra.run.smithi155.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-11T23:11:42.532 INFO:teuthology.orchestra.run.smithi155.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-11T23:11:42.537 INFO:teuthology.orchestra.run.smithi094.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-11T23:11:42.542 INFO:teuthology.orchestra.run.smithi094.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-11T23:11:42.543 INFO:teuthology.orchestra.run.smithi094.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-11T23:11:42.595 INFO:teuthology.orchestra.run.smithi094.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-11T23:11:42.600 INFO:teuthology.orchestra.run.smithi094.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-11T23:11:42.635 INFO:teuthology.orchestra.run.smithi155.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-11T23:11:42.660 INFO:teuthology.orchestra.run.smithi155.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-11T23:11:42.688 INFO:teuthology.orchestra.run.smithi155.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-11T23:11:42.691 INFO:teuthology.orchestra.run.smithi155.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-11T23:11:42.692 INFO:teuthology.orchestra.run.smithi155.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-11T23:11:42.695 INFO:teuthology.orchestra.run.smithi155.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-11T23:11:42.695 INFO:teuthology.orchestra.run.smithi155.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-11T23:11:42.696 INFO:teuthology.orchestra.run.smithi155.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-11T23:11:42.697 INFO:teuthology.orchestra.run.smithi155.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-11T23:11:42.702 INFO:teuthology.orchestra.run.smithi155.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-11T23:11:42.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-11T23:11:42.764 INFO:teuthology.orchestra.run.smithi155.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-11T23:11:42.767 INFO:teuthology.orchestra.run.smithi155.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-11T23:11:42.767 INFO:teuthology.orchestra.run.smithi155.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-11T23:11:42.768 INFO:teuthology.orchestra.run.smithi094.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-11T23:11:42.769 INFO:teuthology.orchestra.run.smithi094.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-11T23:11:42.772 INFO:teuthology.orchestra.run.smithi094.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-11T23:11:42.773 INFO:teuthology.orchestra.run.smithi094.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-11T23:11:42.776 INFO:teuthology.orchestra.run.smithi094.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-11T23:11:42.793 INFO:teuthology.orchestra.run.smithi155.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-11T23:11:42.793 INFO:teuthology.orchestra.run.smithi155.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-11T23:11:42.857 INFO:teuthology.orchestra.run.smithi155.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi155.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi155.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi155.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi155.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-11T23:11:42.862 INFO:teuthology.orchestra.run.smithi155.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-11T23:11:42.867 INFO:teuthology.orchestra.run.smithi155.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-11T23:11:42.893 INFO:teuthology.orchestra.run.smithi094.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-11T23:11:42.893 INFO:teuthology.orchestra.run.smithi094.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-11T23:11:42.893 INFO:teuthology.orchestra.run.smithi094.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-11T23:11:42.894 INFO:teuthology.orchestra.run.smithi094.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-11T23:11:42.895 INFO:teuthology.orchestra.run.smithi094.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-11T23:11:42.904 INFO:teuthology.orchestra.run.smithi094.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-11T23:11:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-11T23:11:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-11T23:11:42.939 INFO:teuthology.orchestra.run.smithi155.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-11T23:11:42.941 INFO:teuthology.orchestra.run.smithi155.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-11T23:11:42.943 INFO:teuthology.orchestra.run.smithi155.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-11T23:11:42.983 INFO:teuthology.orchestra.run.smithi094.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-11T23:11:42.983 INFO:teuthology.orchestra.run.smithi094.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-11T23:11:42.983 INFO:teuthology.orchestra.run.smithi094.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-11T23:11:42.984 INFO:teuthology.orchestra.run.smithi094.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-11T23:11:42.985 INFO:teuthology.orchestra.run.smithi094.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-11T23:11:42.992 INFO:teuthology.orchestra.run.smithi094.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-11T23:11:42.994 INFO:teuthology.orchestra.run.smithi094.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-11T23:11:43.015 INFO:teuthology.orchestra.run.smithi094.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-11T23:11:43.016 INFO:teuthology.orchestra.run.smithi094.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-11T23:11:43.020 INFO:teuthology.orchestra.run.smithi155.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-11T23:11:43.021 INFO:teuthology.orchestra.run.smithi094.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-11T23:11:43.023 INFO:teuthology.orchestra.run.smithi094.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-11T23:11:43.026 INFO:teuthology.orchestra.run.smithi094.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-11T23:11:43.026 INFO:teuthology.orchestra.run.smithi155.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-11T23:11:43.027 INFO:teuthology.orchestra.run.smithi155.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-11T23:11:43.028 INFO:teuthology.orchestra.run.smithi094.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-11T23:11:43.030 INFO:teuthology.orchestra.run.smithi155.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-11T23:11:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-11T23:11:43.042 INFO:teuthology.orchestra.run.smithi155.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-11T23:11:43.043 INFO:teuthology.orchestra.run.smithi155.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-11T23:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-11T23:11:43.101 INFO:teuthology.orchestra.run.smithi155.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-11T23:11:43.102 INFO:teuthology.orchestra.run.smithi155.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-11T23:11:43.104 INFO:teuthology.orchestra.run.smithi155.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-11T23:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-11T23:11:43.110 INFO:teuthology.orchestra.run.smithi155.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-11T23:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-11T23:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-11T23:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-11T23:11:43.128 INFO:teuthology.orchestra.run.smithi155.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-11T23:11:43.166 INFO:teuthology.orchestra.run.smithi155.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-11T23:11:43.179 INFO:teuthology.orchestra.run.smithi094.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-11T23:11:43.179 INFO:teuthology.orchestra.run.smithi094.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-11T23:11:43.180 INFO:teuthology.orchestra.run.smithi094.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-11T23:11:43.183 INFO:teuthology.orchestra.run.smithi155.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-11T23:11:43.187 INFO:teuthology.orchestra.run.smithi155.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-11T23:11:43.189 INFO:teuthology.orchestra.run.smithi155.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-11T23:11:43.189 INFO:teuthology.orchestra.run.smithi094.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-11T23:11:43.191 INFO:teuthology.orchestra.run.smithi094.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-11T23:11:43.198 INFO:teuthology.orchestra.run.smithi094.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-11T23:11:43.199 INFO:teuthology.orchestra.run.smithi094.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-11T23:11:43.206 INFO:teuthology.orchestra.run.smithi155.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-11T23:11:43.207 INFO:teuthology.orchestra.run.smithi155.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-11T23:11:43.207 INFO:teuthology.orchestra.run.smithi155.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-11T23:11:43.212 INFO:teuthology.orchestra.run.smithi155.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-11T23:11:43.260 INFO:teuthology.orchestra.run.smithi094.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-11T23:11:43.260 INFO:teuthology.orchestra.run.smithi094.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-11T23:11:43.264 INFO:teuthology.orchestra.run.smithi155.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-11T23:11:43.264 INFO:teuthology.orchestra.run.smithi094.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-11T23:11:43.266 INFO:teuthology.orchestra.run.smithi094.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-11T23:11:43.283 INFO:teuthology.orchestra.run.smithi094.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-11T23:11:43.341 INFO:teuthology.orchestra.run.smithi094.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-11T23:11:43.342 INFO:teuthology.orchestra.run.smithi094.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-11T23:11:43.347 INFO:teuthology.orchestra.run.smithi094.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-11T23:11:43.349 INFO:teuthology.orchestra.run.smithi094.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-11T23:11:44.550 INFO:teuthology.orchestra.run.smithi155.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-11T23:11:44.625 INFO:teuthology.orchestra.run.smithi155.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-11T23:11:44.627 INFO:teuthology.orchestra.run.smithi155.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-11T23:11:44.629 INFO:teuthology.orchestra.run.smithi155.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-11T23:11:44.642 INFO:teuthology.orchestra.run.smithi155.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-11T23:11:44.657 INFO:teuthology.orchestra.run.smithi094.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-11T23:11:44.659 INFO:teuthology.orchestra.run.smithi094.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-11T23:11:44.663 INFO:teuthology.orchestra.run.smithi094.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-11T23:11:44.664 INFO:teuthology.orchestra.run.smithi094.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-11T23:11:44.665 INFO:teuthology.orchestra.run.smithi094.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-11T23:11:44.666 INFO:teuthology.orchestra.run.smithi094.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-11T23:11:44.816 INFO:teuthology.orchestra.run.smithi155.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-11T23:11:44.981 INFO:teuthology.orchestra.run.smithi094.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-11T23:11:45.379 INFO:teuthology.orchestra.run.smithi155.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-11T23:11:45.380 INFO:teuthology.orchestra.run.smithi155.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-11T23:11:45.391 INFO:teuthology.orchestra.run.smithi155.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-11T23:11:45.424 INFO:teuthology.orchestra.run.smithi155.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-11T23:11:45.433 INFO:teuthology.orchestra.run.smithi155.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-11T23:11:45.435 INFO:teuthology.orchestra.run.smithi155.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-11T23:11:45.456 INFO:teuthology.orchestra.run.smithi155.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-11T23:11:45.598 INFO:teuthology.orchestra.run.smithi155.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-11T23:11:45.598 INFO:teuthology.orchestra.run.smithi155.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-11T23:11:45.613 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 181 MB in 4s (46.6 MB/s) 2024-09-11T23:11:45.753 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-11T23:11:45.849 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-11T23:11:45.854 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-11T23:11:45.893 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-11T23:11:46.179 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-11T23:11:46.205 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-11T23:11:46.255 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T23:11:46.574 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cmd2. 2024-09-11T23:11:46.600 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-11T23:11:46.641 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-11T23:11:46.693 INFO:teuthology.orchestra.run.smithi155.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-11T23:11:46.696 INFO:teuthology.orchestra.run.smithi155.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-11T23:11:46.701 INFO:teuthology.orchestra.run.smithi155.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-11T23:11:46.702 INFO:teuthology.orchestra.run.smithi155.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-11T23:11:46.702 INFO:teuthology.orchestra.run.smithi155.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-11T23:11:46.704 INFO:teuthology.orchestra.run.smithi155.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-11T23:11:46.937 INFO:teuthology.orchestra.run.smithi155.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-11T23:11:46.977 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-11T23:11:47.004 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-11T23:11:47.086 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T23:11:47.398 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-11T23:11:47.425 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-11T23:11:47.456 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T23:11:47.575 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 181 MB in 6s (31.6 MB/s) 2024-09-11T23:11:47.718 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-11T23:11:47.805 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-11T23:11:47.811 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-11T23:11:47.851 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-11T23:11:47.934 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-11T23:11:47.961 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-11T23:11:48.001 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T23:11:48.170 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-11T23:11:48.196 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-11T23:11:48.237 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T23:11:48.471 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-11T23:11:48.498 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:11:48.547 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cmd2. 2024-09-11T23:11:48.555 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:11:48.574 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-11T23:11:48.606 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-11T23:11:48.933 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-11T23:11:48.942 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-11T23:11:48.959 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:11:48.968 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-11T23:11:48.991 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:11:49.034 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T23:11:49.344 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-11T23:11:49.371 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:11:49.387 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-11T23:11:49.411 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:11:49.413 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-11T23:11:49.454 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T23:11:49.764 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-11T23:11:49.791 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-11T23:11:49.831 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T23:11:49.998 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-11T23:11:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-11T23:11:50.065 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T23:11:50.130 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librados2. 2024-09-11T23:11:50.144 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:50.176 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:50.510 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-11T23:11:50.536 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:11:50.586 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:11:50.645 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librbd1. 2024-09-11T23:11:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:50.712 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:50.963 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-11T23:11:50.989 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:11:51.029 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:11:51.165 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs2. 2024-09-11T23:11:51.191 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:51.257 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:51.374 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-11T23:11:51.400 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:11:51.440 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:11:51.526 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rados. 2024-09-11T23:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:51.576 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:51.793 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-11T23:11:51.819 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-11T23:11:51.860 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T23:11:51.870 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-11T23:11:51.897 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:11:51.937 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:52.171 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librados2. 2024-09-11T23:11:52.197 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:52.198 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cephfs. 2024-09-11T23:11:52.213 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:52.229 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:52.256 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:52.576 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-11T23:11:52.602 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:11:52.642 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:52.673 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librbd1. 2024-09-11T23:11:52.699 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:52.740 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:53.195 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-prettytable. 2024-09-11T23:11:53.201 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs2. 2024-09-11T23:11:53.210 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-11T23:11:53.227 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:53.245 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-11T23:11:53.276 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:53.490 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rbd. 2024-09-11T23:11:53.516 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:53.557 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:53.561 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rados. 2024-09-11T23:11:53.576 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:53.620 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:53.893 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-11T23:11:53.919 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-11T23:11:53.922 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-11T23:11:53.937 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:11:53.959 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T23:11:53.972 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:54.183 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cephfs. 2024-09-11T23:11:54.198 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:54.237 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-11T23:11:54.241 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:54.263 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-11T23:11:54.304 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T23:11:54.569 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-11T23:11:54.582 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-11T23:11:54.595 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:11:54.597 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-11T23:11:54.632 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T23:11:54.635 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua5.1. 2024-09-11T23:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-11T23:11:55.034 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-prettytable. 2024-09-11T23:11:55.043 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-11T23:11:55.061 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-11T23:11:55.096 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-11T23:11:55.340 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rbd. 2024-09-11T23:11:55.364 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua-any. 2024-09-11T23:11:55.366 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:55.390 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-11T23:11:55.407 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:55.439 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-11T23:11:55.649 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package zip. 2024-09-11T23:11:55.665 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-11T23:11:55.700 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking zip (3.0-12build2) ... 2024-09-11T23:11:55.727 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-11T23:11:55.753 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-11T23:11:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T23:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package unzip. 2024-09-11T23:11:56.037 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-11T23:11:56.045 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-11T23:11:56.072 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-11T23:11:56.078 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-11T23:11:56.129 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T23:11:56.414 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-11T23:11:56.430 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-11T23:11:56.473 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T23:11:56.490 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package luarocks. 2024-09-11T23:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-11T23:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-11T23:11:56.810 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua5.1. 2024-09-11T23:11:56.836 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-11T23:11:56.876 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-11T23:11:56.915 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librgw2. 2024-09-11T23:11:56.942 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:56.973 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:57.221 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-any. 2024-09-11T23:11:57.247 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-11T23:11:57.287 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-11T23:11:57.531 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package zip. 2024-09-11T23:11:57.534 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rgw. 2024-09-11T23:11:57.546 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-11T23:11:57.561 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:57.581 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking zip (3.0-12build2) ... 2024-09-11T23:11:57.601 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:57.843 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package unzip. 2024-09-11T23:11:57.869 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-11T23:11:57.901 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-11T23:11:57.963 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-11T23:11:57.989 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-11T23:11:58.029 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T23:11:58.296 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package luarocks. 2024-09-11T23:11:58.323 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-11T23:11:58.349 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libradosstriper1. 2024-09-11T23:11:58.362 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-11T23:11:58.375 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:58.432 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:58.737 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librgw2. 2024-09-11T23:11:58.764 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:58.803 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:58.827 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-common. 2024-09-11T23:11:58.854 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:58.894 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:11:59.364 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rgw. 2024-09-11T23:11:59.379 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:11:59.414 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:00.000 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-11T23:12:00.027 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-11T23:12:00.066 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T23:12:00.267 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-base. 2024-09-11T23:12:00.293 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:00.343 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:00.394 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libradosstriper1. 2024-09-11T23:12:00.421 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:00.461 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:00.831 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-common. 2024-09-11T23:12:00.857 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:00.889 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-11T23:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-11T23:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-11T23:12:01.266 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cheroot. 2024-09-11T23:12:01.292 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-11T23:12:01.332 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T23:12:01.644 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-11T23:12:01.670 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-11T23:12:01.710 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-11T23:12:02.030 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-11T23:12:02.056 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-11T23:12:02.097 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-11T23:12:02.202 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-base. 2024-09-11T23:12:02.229 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:02.270 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:02.391 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-11T23:12:02.418 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-11T23:12:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-11T23:12:02.728 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempora. 2024-09-11T23:12:02.755 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-11T23:12:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-11T23:12:02.794 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-11T23:12:02.815 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-11T23:12:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-11T23:12:03.098 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-portend. 2024-09-11T23:12:03.124 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-11T23:12:03.125 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cheroot. 2024-09-11T23:12:03.151 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-11T23:12:03.164 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-11T23:12:03.191 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T23:12:03.522 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-11T23:12:03.548 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-11T23:12:03.588 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-11T23:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-11T23:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-11T23:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-11T23:12:03.866 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-11T23:12:03.892 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-11T23:12:03.932 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-11T23:12:04.129 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-11T23:12:04.151 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-11T23:12:04.155 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-11T23:12:04.167 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-11T23:12:04.195 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-11T23:12:04.201 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-11T23:12:04.512 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempora. 2024-09-11T23:12:04.539 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-11T23:12:04.557 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-natsort. 2024-09-11T23:12:04.581 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-11T23:12:04.584 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-11T23:12:04.624 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-11T23:12:04.957 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-portend. 2024-09-11T23:12:04.983 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-11T23:12:04.985 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-logutils. 2024-09-11T23:12:05.013 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-11T23:12:05.023 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-11T23:12:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-11T23:12:05.292 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-11T23:12:05.319 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-11T23:12:05.351 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-11T23:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-11T23:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-11T23:12:05.500 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-11T23:12:05.604 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-11T23:12:05.652 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-11T23:12:05.674 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-11T23:12:05.825 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-mako. 2024-09-11T23:12:05.853 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-11T23:12:05.892 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T23:12:06.023 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-natsort. 2024-09-11T23:12:06.050 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-11T23:12:06.090 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-11T23:12:06.195 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-11T23:12:06.222 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-11T23:12:06.262 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-11T23:12:06.384 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-logutils. 2024-09-11T23:12:06.411 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-11T23:12:06.451 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-11T23:12:06.564 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-11T23:12:06.591 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-11T23:12:06.631 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-11T23:12:06.712 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-11T23:12:06.739 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-11T23:12:06.779 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-11T23:12:06.918 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webob. 2024-09-11T23:12:06.944 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-11T23:12:06.984 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T23:12:07.081 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-mako. 2024-09-11T23:12:07.108 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-11T23:12:07.148 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T23:12:07.313 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-waitress. 2024-09-11T23:12:07.339 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-11T23:12:07.382 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T23:12:07.476 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-11T23:12:07.502 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-11T23:12:07.543 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-11T23:12:07.666 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempita. 2024-09-11T23:12:07.692 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-11T23:12:07.732 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T23:12:07.845 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-11T23:12:07.871 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-11T23:12:07.920 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-11T23:12:08.035 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-paste. 2024-09-11T23:12:08.062 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-11T23:12:08.102 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T23:12:08.189 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webob. 2024-09-11T23:12:08.216 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-11T23:12:08.247 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T23:12:08.397 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-11T23:12:08.420 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-11T23:12:08.455 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T23:12:08.600 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-waitress. 2024-09-11T23:12:08.627 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-11T23:12:08.670 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T23:12:08.758 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-11T23:12:08.785 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-11T23:12:08.825 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-11T23:12:08.970 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempita. 2024-09-11T23:12:08.996 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-11T23:12:09.036 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T23:12:09.128 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webtest. 2024-09-11T23:12:09.154 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-11T23:12:09.203 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-11T23:12:09.364 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-paste. 2024-09-11T23:12:09.391 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-11T23:12:09.431 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T23:12:09.497 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pecan. 2024-09-11T23:12:09.513 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-11T23:12:09.547 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T23:12:09.742 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-11T23:12:09.769 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-11T23:12:09.808 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T23:12:09.886 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-certifi. 2024-09-11T23:12:09.902 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-11T23:12:09.936 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-11T23:12:10.239 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-idna. 2024-09-11T23:12:10.266 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-11T23:12:10.305 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T23:12:10.336 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-11T23:12:10.363 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-11T23:12:10.403 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-11T23:12:10.634 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-urllib3. 2024-09-11T23:12:10.662 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-11T23:12:10.673 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webtest. 2024-09-11T23:12:10.700 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-11T23:12:10.701 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T23:12:10.731 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-11T23:12:11.009 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pecan. 2024-09-11T23:12:11.012 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests. 2024-09-11T23:12:11.035 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-11T23:12:11.039 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-11T23:12:11.075 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T23:12:11.079 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T23:12:11.390 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-11T23:12:11.413 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-certifi. 2024-09-11T23:12:11.417 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-11T23:12:11.440 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-11T23:12:11.457 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T23:12:11.480 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-11T23:12:11.751 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-11T23:12:11.767 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:11.807 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-idna. 2024-09-11T23:12:11.813 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:11.834 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-11T23:12:11.873 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T23:12:12.143 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-urllib3. 2024-09-11T23:12:12.158 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-11T23:12:12.173 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-11T23:12:12.200 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:12.201 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T23:12:12.239 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:12.538 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests. 2024-09-11T23:12:12.564 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-11T23:12:12.576 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-11T23:12:12.603 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-11T23:12:12.621 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T23:12:12.642 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-11T23:12:12.932 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-11T23:12:12.937 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-openssl. 2024-09-11T23:12:12.959 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-11T23:12:12.964 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-11T23:12:12.998 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T23:12:13.004 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-11T23:12:13.268 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-11T23:12:13.283 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:13.318 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:13.332 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr. 2024-09-11T23:12:13.359 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:13.399 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:13.681 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-11T23:12:13.707 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:13.747 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:13.971 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mon. 2024-09-11T23:12:13.998 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:14.025 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-11T23:12:14.037 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:14.052 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-11T23:12:14.083 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-11T23:12:14.394 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-openssl. 2024-09-11T23:12:14.421 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-11T23:12:14.819 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-11T23:12:15.533 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-osd. 2024-09-11T23:12:15.560 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:15.600 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:15.706 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr. 2024-09-11T23:12:15.733 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:15.772 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:16.192 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mon. 2024-09-11T23:12:16.219 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:16.258 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:16.637 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph. 2024-09-11T23:12:16.663 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:16.703 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:16.828 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-osd. 2024-09-11T23:12:16.855 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:16.895 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:17.014 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-fuse. 2024-09-11T23:12:17.041 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:17.081 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:17.451 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mds. 2024-09-11T23:12:17.478 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:17.517 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:17.929 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephadm. 2024-09-11T23:12:17.956 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:17.956 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph. 2024-09-11T23:12:17.972 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:17.996 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:18.015 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:18.249 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-11T23:12:18.275 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-11T23:12:18.315 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-11T23:12:18.334 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-fuse. 2024-09-11T23:12:18.360 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:18.400 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:18.643 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-11T23:12:18.670 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T23:12:18.710 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T23:12:18.770 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mds. 2024-09-11T23:12:18.796 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:18.836 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:19.197 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephadm. 2024-09-11T23:12:19.213 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:19.256 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:19.583 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-11T23:12:19.609 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-11T23:12:19.649 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-11T23:12:19.673 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-babel. 2024-09-11T23:12:19.701 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T23:12:19.740 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T23:12:19.943 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-11T23:12:19.959 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T23:12:20.027 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T23:12:20.076 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jinja2. 2024-09-11T23:12:20.103 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-11T23:12:20.143 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T23:12:20.505 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-11T23:12:20.531 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:20.571 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:20.900 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-11T23:12:20.927 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-11T23:12:20.966 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-11T23:12:21.032 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-babel. 2024-09-11T23:12:21.059 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T23:12:21.098 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T23:12:21.278 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-routes. 2024-09-11T23:12:21.305 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-11T23:12:21.345 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T23:12:21.401 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jinja2. 2024-09-11T23:12:21.428 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-11T23:12:21.467 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T23:12:21.681 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-11T23:12:21.708 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:21.747 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:21.820 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-11T23:12:21.842 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:21.886 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:22.248 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-11T23:12:22.275 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-11T23:12:22.315 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-11T23:12:22.617 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-routes. 2024-09-11T23:12:22.633 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-11T23:12:22.675 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T23:12:23.011 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-11T23:12:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-11T23:12:23.026 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-11T23:12:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:23.069 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T23:12:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:23.590 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-joblib. 2024-09-11T23:12:23.617 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-11T23:12:23.656 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T23:12:23.993 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-11T23:12:24.020 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-11T23:12:24.138 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-11T23:12:24.366 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-11T23:12:24.382 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-11T23:12:24.424 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T23:12:24.449 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn. 2024-09-11T23:12:24.476 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-11T23:12:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T23:12:24.936 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-joblib. 2024-09-11T23:12:24.963 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-11T23:12:25.003 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T23:12:25.208 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-11T23:12:25.224 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:25.258 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:25.356 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-11T23:12:25.383 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-11T23:12:25.499 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-11T23:12:25.810 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn. 2024-09-11T23:12:25.837 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-11T23:12:25.881 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T23:12:26.254 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cachetools. 2024-09-11T23:12:26.281 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-11T23:12:26.320 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-11T23:12:26.623 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-11T23:12:26.650 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-11T23:12:26.689 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-11T23:12:26.819 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-11T23:12:26.847 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:26.885 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:27.035 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-11T23:12:27.062 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-11T23:12:27.118 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T23:12:27.438 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rsa. 2024-09-11T23:12:27.465 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-11T23:12:27.504 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-11T23:12:27.775 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-google-auth. 2024-09-11T23:12:27.802 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-11T23:12:27.833 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-11T23:12:27.872 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cachetools. 2024-09-11T23:12:27.899 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-11T23:12:27.955 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-11T23:12:28.154 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-11T23:12:28.181 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-11T23:12:28.220 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T23:12:28.249 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-11T23:12:28.276 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-11T23:12:28.315 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-11T23:12:28.532 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-websocket. 2024-09-11T23:12:28.559 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-11T23:12:28.598 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-11T23:12:28.619 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-11T23:12:28.634 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-11T23:12:28.668 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T23:12:28.910 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-11T23:12:28.921 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rsa. 2024-09-11T23:12:28.937 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-11T23:12:28.937 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-11T23:12:28.971 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-11T23:12:28.976 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T23:12:29.291 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-google-auth. 2024-09-11T23:12:29.318 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-11T23:12:29.358 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-11T23:12:29.636 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-11T23:12:29.651 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-11T23:12:29.685 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T23:12:29.932 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-11T23:12:29.960 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:29.989 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-websocket. 2024-09-11T23:12:29.999 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:30.016 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-11T23:12:30.055 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-11T23:12:30.327 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-11T23:12:30.354 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-11T23:12:30.383 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-11T23:12:30.393 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T23:12:30.410 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-11T23:12:30.450 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T23:12:30.714 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-11T23:12:30.741 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T23:12:30.772 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T23:12:31.041 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package jq. 2024-09-11T23:12:31.057 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T23:12:31.100 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-11T23:12:31.147 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-11T23:12:31.163 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:31.197 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:31.335 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package socat. 2024-09-11T23:12:31.351 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-11T23:12:31.393 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-11T23:12:31.533 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-11T23:12:31.560 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-11T23:12:31.599 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T23:12:31.697 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package xmlstarlet. 2024-09-11T23:12:31.724 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-11T23:12:31.764 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-11T23:12:31.969 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-11T23:12:31.996 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T23:12:32.035 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T23:12:32.135 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-test. 2024-09-11T23:12:32.159 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:32.201 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:32.287 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package jq. 2024-09-11T23:12:32.312 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T23:12:32.362 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-11T23:12:32.573 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package socat. 2024-09-11T23:12:32.589 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-11T23:12:32.623 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-11T23:12:32.910 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package xmlstarlet. 2024-09-11T23:12:32.937 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-11T23:12:32.976 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-11T23:12:33.339 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-test. 2024-09-11T23:12:33.355 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:33.397 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:34.481 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-volume. 2024-09-11T23:12:34.509 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:34.547 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:34.936 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-11T23:12:34.963 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:35.002 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:35.297 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-colorama. 2024-09-11T23:12:35.325 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-11T23:12:35.363 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-11T23:12:35.583 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-shell. 2024-09-11T23:12:35.599 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:35.632 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:35.659 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-volume. 2024-09-11T23:12:35.687 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:35.725 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:36.002 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-top. 2024-09-11T23:12:36.030 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:36.068 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:36.238 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-11T23:12:36.265 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:36.313 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:36.330 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-11T23:12:36.346 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:36.388 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:36.632 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-colorama. 2024-09-11T23:12:36.659 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-11T23:12:36.699 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-11T23:12:36.785 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-11T23:12:36.785 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-11T23:12:36.785 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T23:12:36.943 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-shell. 2024-09-11T23:12:36.959 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:37.001 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:37.062 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-11T23:12:37.079 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-11T23:12:37.121 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-11T23:12:37.245 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-top. 2024-09-11T23:12:37.261 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:12:37.295 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:37.483 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package nvme-cli. 2024-09-11T23:12:37.511 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-11T23:12:37.522 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-11T23:12:37.550 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T23:12:37.550 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:37.588 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:37.883 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-11T23:12:37.910 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-11T23:12:37.949 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T23:12:38.005 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package pkg-config. 2024-09-11T23:12:38.033 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-11T23:12:38.071 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T23:12:38.278 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-11T23:12:38.306 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-11T23:12:38.307 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-11T23:12:38.324 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-11T23:12:38.345 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-11T23:12:38.358 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-11T23:12:38.657 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package nvme-cli. 2024-09-11T23:12:38.685 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-11T23:12:38.715 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T23:12:38.744 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-11T23:12:38.760 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-11T23:12:38.795 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-11T23:12:39.064 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastescript. 2024-09-11T23:12:39.078 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pkg-config. 2024-09-11T23:12:39.091 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-11T23:12:39.106 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-11T23:12:39.130 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-11T23:12:39.136 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T23:12:39.406 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-11T23:12:39.422 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-11T23:12:39.434 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pluggy. 2024-09-11T23:12:39.461 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-11T23:12:39.489 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-11T23:12:39.500 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-11T23:12:39.812 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-psutil. 2024-09-11T23:12:39.839 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-11T23:12:39.887 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-11T23:12:39.942 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-11T23:12:39.970 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-11T23:12:40.008 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-11T23:12:40.240 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-py. 2024-09-11T23:12:40.269 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-11T23:12:40.311 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastescript. 2024-09-11T23:12:40.314 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-11T23:12:40.339 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-11T23:12:40.377 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-11T23:12:40.635 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pygments. 2024-09-11T23:12:40.663 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-11T23:12:40.701 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T23:12:40.706 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pluggy. 2024-09-11T23:12:40.734 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-11T23:12:40.772 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-11T23:12:41.058 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-psutil. 2024-09-11T23:12:41.074 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-11T23:12:41.116 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-11T23:12:41.181 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-11T23:12:41.209 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-11T23:12:41.247 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-11T23:12:41.575 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-toml. 2024-09-11T23:12:41.603 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-11T23:12:41.641 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-11T23:12:41.719 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-py. 2024-09-11T23:12:41.747 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-11T23:12:41.785 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-11T23:12:41.944 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pytest. 2024-09-11T23:12:41.973 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-11T23:12:42.011 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T23:12:42.114 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pygments. 2024-09-11T23:12:42.142 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-11T23:12:42.180 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T23:12:42.365 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplejson. 2024-09-11T23:12:42.393 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-11T23:12:42.431 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-11T23:12:42.626 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-11T23:12:42.654 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-11T23:12:42.692 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-11T23:12:42.701 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-11T23:12:42.717 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-11T23:12:42.751 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-11T23:12:43.012 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-toml. 2024-09-11T23:12:43.039 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-11T23:12:43.078 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-11T23:12:43.383 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pytest. 2024-09-11T23:12:43.411 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-11T23:12:43.441 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T23:12:43.514 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package radosgw. 2024-09-11T23:12:43.542 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:43.580 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:43.786 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplejson. 2024-09-11T23:12:43.814 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-11T23:12:43.852 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-11T23:12:44.130 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-11T23:12:44.146 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-11T23:12:44.188 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-11T23:12:44.383 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-fuse. 2024-09-11T23:12:44.399 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:44.441 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:44.738 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-11T23:12:44.901 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package radosgw. 2024-09-11T23:12:44.929 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:44.967 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:45.165 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T23:12:45.423 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T23:12:45.683 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-11T23:12:45.779 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package rbd-fuse. 2024-09-11T23:12:45.806 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:12:45.845 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:45.995 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-11T23:12:46.158 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-11T23:12:46.417 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T23:12:46.431 INFO:teuthology.orchestra.run.smithi094.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-11T23:12:46.492 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:46.543 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T23:12:46.991 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user cephadm....done 2024-09-11T23:12:46.992 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-11T23:12:47.140 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T23:12:47.316 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-11T23:12:47.408 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-11T23:12:47.659 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-11T23:12:47.739 INFO:teuthology.orchestra.run.smithi155.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-11T23:12:47.786 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-11T23:12:47.820 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:48.045 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-11T23:12:48.313 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T23:12:48.337 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user cephadm....done 2024-09-11T23:12:48.439 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-11T23:12:48.492 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T23:12:48.766 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T23:12:48.768 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-11T23:12:49.020 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-11T23:12:49.110 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-11T23:12:49.146 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-11T23:12:49.361 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-11T23:12:49.389 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-11T23:12:49.629 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-11T23:12:49.632 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T23:12:49.758 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-11T23:12:49.905 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-11T23:12:50.051 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T23:12:50.132 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-11T23:12:50.376 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-11T23:12:50.411 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-11T23:12:50.626 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-11T23:12:50.687 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-11T23:12:50.922 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-11T23:12:50.940 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:51.232 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-11T23:12:51.237 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T23:12:51.371 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T23:12:51.475 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-11T23:12:51.497 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-11T23:12:51.726 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-11T23:12:51.740 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T23:12:51.866 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-11T23:12:51.977 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-11T23:12:52.125 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-11T23:12:52.228 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:52.559 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-11T23:12:52.590 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-11T23:12:52.629 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T23:12:52.654 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T23:12:52.747 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T23:12:52.780 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-11T23:12:52.847 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-11T23:12:53.107 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T23:12:53.140 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T23:12:53.233 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-11T23:12:53.266 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-11T23:12:53.492 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-11T23:12:53.559 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T23:12:53.818 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-11T23:12:53.907 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-11T23:12:53.940 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-11T23:12:54.004 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T23:12:54.121 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-11T23:12:54.128 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up zip (3.0-12build2) ... 2024-09-11T23:12:54.237 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T23:12:54.473 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T23:12:54.590 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-11T23:12:54.858 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T23:12:54.889 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T23:12:55.118 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-11T23:12:55.134 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T23:12:55.258 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-11T23:12:55.384 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T23:12:55.427 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up zip (3.0-12build2) ... 2024-09-11T23:12:55.553 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T23:12:55.677 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-11T23:12:56.053 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-11T23:12:56.222 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T23:12:56.296 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T23:12:56.464 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T23:12:56.590 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-11T23:12:56.700 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T23:12:56.706 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T23:12:56.984 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-11T23:12:56.991 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-11T23:12:57.301 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T23:12:57.369 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-11T23:12:57.620 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T23:12:57.660 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-11T23:12:57.895 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-11T23:12:57.988 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T23:12:58.023 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:58.264 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-11T23:12:58.308 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T23:12:58.574 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T23:12:58.633 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T23:12:58.941 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-11T23:12:59.176 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-11T23:12:59.302 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:12:59.595 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T23:12:59.833 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T23:12:59.920 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T23:13:00.093 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:13:00.219 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-11T23:13:00.469 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T23:13:00.570 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-11T23:13:00.963 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T23:13:01.093 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T23:13:01.265 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-11T23:13:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:13:01.445 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-11T23:13:01.515 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-11T23:13:01.713 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T23:13:01.775 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:13:01.831 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-11T23:13:01.901 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-11T23:13:01.965 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T23:13:02.205 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-11T23:13:02.267 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-11T23:13:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-11T23:13:02.534 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-11T23:13:02.704 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-11T23:13:02.794 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:13:02.922 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-11T23:13:02.964 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-11T23:13:03.205 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-11T23:13:03.215 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-11T23:13:03.439 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-11T23:13:03.458 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T23:13:03.583 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-11T23:13:03.707 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-11T23:13:03.876 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T23:13:03.950 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-11T23:13:04.002 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T23:13:04.201 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-11T23:13:04.311 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T23:13:04.468 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T23:13:04.594 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-11T23:13:04.612 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-11T23:13:04.880 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T23:13:04.904 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T23:13:04.989 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-11T23:13:05.021 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T23:13:05.090 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T23:13:05.170 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-11T23:13:05.297 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T23:13:05.417 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T23:13:05.543 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T23:13:05.607 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-11T23:13:05.858 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T23:13:05.953 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-11T23:13:05.984 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-11T23:13:06.110 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T23:13:06.199 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-11T23:13:06.203 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-11T23:13:06.321 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-11T23:13:06.445 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T23:13:06.562 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T23:13:06.589 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:13:06.707 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T23:13:06.947 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-11T23:13:07.033 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T23:13:07.215 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-11T23:13:07.334 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T23:13:07.341 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-11T23:13:07.610 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-11T23:13:07.625 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:13:07.752 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T23:13:07.821 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-11T23:13:08.069 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T23:13:08.089 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-11T23:13:08.349 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T23:13:08.387 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T23:13:08.608 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-11T23:13:08.646 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-11T23:13:08.841 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-11T23:13:09.010 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-11T23:13:09.101 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-11T23:13:09.294 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T23:13:09.377 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T23:13:09.622 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T23:13:09.637 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-11T23:13:09.739 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:09.849 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:09.966 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-11T23:13:10.013 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-11T23:13:10.290 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T23:13:10.303 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:10.445 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:10.571 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-11T23:13:10.617 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T23:13:10.743 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:10.848 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:10.869 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:10.974 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:10.987 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-11T23:13:11.116 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:11.281 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:11.326 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T23:13:11.326 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T23:13:11.408 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:11.534 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-11T23:13:11.793 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:11.818 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:11.919 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:11.944 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:12.045 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:12.070 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:12.171 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:12.265 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T23:13:12.265 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T23:13:12.297 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T23:13:12.722 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:12.822 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:12.957 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:13.083 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:13.209 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T23:13:13.543 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:13.668 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:13.778 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:13.878 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:13.987 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:14.113 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:14.421 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:14.521 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:14.640 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:14.756 INFO:teuthology.orchestra.run.smithi094.stdout:Adding group ceph....done 2024-09-11T23:13:14.774 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:14.900 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:15.026 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:15.124 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user ceph....done 2024-09-11T23:13:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:Setting system user ceph properties....done 2024-09-11T23:13:15.282 INFO:teuthology.orchestra.run.smithi094.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-11T23:13:15.420 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-11T23:13:15.535 INFO:teuthology.orchestra.run.smithi155.stdout:Adding group ceph....done 2024-09-11T23:13:15.768 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-11T23:13:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user ceph....done 2024-09-11T23:13:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:Setting system user ceph properties....done 2024-09-11T23:13:16.074 INFO:teuthology.orchestra.run.smithi155.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-11T23:13:16.207 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-11T23:13:16.247 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:16.477 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:13:16.477 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:13:16.504 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-11T23:13:16.941 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:16.985 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:17.066 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:17.195 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:13:17.195 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:13:17.532 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:13:17.532 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:13:17.985 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:17.985 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:18.121 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:18.310 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-11T23:13:18.560 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:13:18.560 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:13:18.761 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:18.981 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T23:13:18.981 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T23:13:19.005 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:19.369 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-11T23:13:19.446 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:19.659 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T23:13:19.659 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T23:13:19.841 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:20.076 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T23:13:20.076 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T23:13:20.139 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:20.426 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T23:13:20.427 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T23:13:20.576 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:20.789 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T23:13:20.789 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T23:13:20.916 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:21.042 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:21.193 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:21.252 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:21.412 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T23:13:21.412 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T23:13:21.525 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T23:13:21.525 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T23:13:21.898 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:21.995 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:22.025 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:22.096 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:22.239 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:22.301 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:22.460 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T23:13:22.460 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T23:13:22.662 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T23:13:22.771 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T23:13:22.915 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:22.932 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T23:13:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:23.218 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:23.386 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:13:23.739 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T23:13:23.831 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T23:13:23.967 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T23:13:24.041 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T23:13:24.695 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T23:13:24.700 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-11T23:13:24.810 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-11T23:13:25.021 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-11T23:13:25.022 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-11T23:13:25.093 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T23:13:25.225 INFO:teuthology.orchestra.run.smithi094.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-11T23:13:25.225 INFO:teuthology.orchestra.run.smithi094.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-11T23:13:25.226 INFO:teuthology.orchestra.run.smithi094.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-11T23:13:25.226 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:13:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:13:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:13:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:13:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:13:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:13:25.227 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:13:25.227 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-09-11T23:13:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-11T23:13:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-11T23:13:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-11T23:13:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-11T23:13:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-11T23:13:25.229 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-09-11T23:13:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-11T23:13:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-11T23:13:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-11T23:13:25.273 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-09-11T23:13:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-11T23:13:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-11T23:13:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-11T23:13:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-11T23:13:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-11T23:13:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-11T23:13:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-11T23:13:25.275 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-09-11T23:13:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-11T23:13:25.366 INFO:teuthology.orchestra.run.smithi094.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-11T23:13:25.366 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 55.8 MB of archives. 2024-09-11T23:13:25.366 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-11T23:13:25.366 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-11T23:13:25.501 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-11T23:13:25.508 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-11T23:13:25.549 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-11T23:13:25.550 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-11T23:13:25.551 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-11T23:13:25.561 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-11T23:13:25.562 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-11T23:13:25.564 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-11T23:13:25.565 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-11T23:13:25.566 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-11T23:13:25.567 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-11T23:13:25.568 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-11T23:13:25.585 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-11T23:13:25.585 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-11T23:13:25.586 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-11T23:13:25.761 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T23:13:25.764 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-11T23:13:25.820 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-11T23:13:25.930 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-11T23:13:25.932 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-11T23:13:25.932 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-11T23:13:25.934 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-11T23:13:25.934 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-11T23:13:25.939 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-11T23:13:25.940 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-11T23:13:25.948 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-11T23:13:25.948 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-11T23:13:25.970 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-11T23:13:25.970 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-11T23:13:25.977 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-11T23:13:25.999 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-11T23:13:26.001 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-11T23:13:26.001 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-11T23:13:26.002 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-11T23:13:26.002 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-11T23:13:26.013 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-11T23:13:26.015 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-11T23:13:26.028 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-09-11T23:13:26.029 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-09-11T23:13:26.223 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-11T23:13:26.224 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-11T23:13:26.224 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-11T23:13:26.224 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-11T23:13:26.224 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-11T23:13:26.224 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-11T23:13:26.225 INFO:teuthology.orchestra.run.smithi155.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-11T23:13:26.225 INFO:teuthology.orchestra.run.smithi155.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-11T23:13:26.225 INFO:teuthology.orchestra.run.smithi155.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-11T23:13:26.225 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:13:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:13:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:13:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:13:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:13:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:13:26.226 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:13:26.227 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-09-11T23:13:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-11T23:13:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-11T23:13:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-11T23:13:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-11T23:13:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-11T23:13:26.228 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-09-11T23:13:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-11T23:13:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-11T23:13:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-11T23:13:26.235 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-11T23:13:26.235 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-11T23:13:26.269 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-09-11T23:13:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-11T23:13:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-11T23:13:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-11T23:13:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-11T23:13:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-11T23:13:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-11T23:13:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-11T23:13:26.271 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-09-11T23:13:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-11T23:13:26.324 INFO:teuthology.orchestra.run.smithi155.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-11T23:13:26.324 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 55.8 MB of archives. 2024-09-11T23:13:26.324 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-11T23:13:26.325 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-11T23:13:26.458 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-11T23:13:26.465 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-11T23:13:26.504 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-11T23:13:26.504 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-11T23:13:26.505 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-11T23:13:26.516 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-11T23:13:26.517 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-11T23:13:26.519 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-11T23:13:26.520 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-11T23:13:26.521 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-11T23:13:26.523 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-11T23:13:26.523 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-11T23:13:26.539 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-11T23:13:26.540 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-11T23:13:26.541 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-11T23:13:26.643 INFO:teuthology.orchestra.run.smithi094.stdout:Preconfiguring packages ... 2024-09-11T23:13:26.818 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 55.8 MB in 1s (58.6 MB/s) 2024-09-11T23:13:26.850 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-11T23:13:26.852 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-11T23:13:26.852 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-11T23:13:26.855 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-11T23:13:26.855 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-11T23:13:26.860 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-11T23:13:26.862 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-11T23:13:26.869 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-11T23:13:26.869 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-11T23:13:26.891 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-11T23:13:26.891 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-11T23:13:26.901 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-11T23:13:26.919 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-11T23:13:26.924 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-11T23:13:26.924 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-11T23:13:26.924 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-11T23:13:26.924 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-11T23:13:26.933 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-11T23:13:26.935 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-11T23:13:27.136 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-11T23:13:27.142 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:13:27.145 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-11T23:13:27.145 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-11T23:13:27.145 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-11T23:13:27.145 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-11T23:13:27.145 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-11T23:13:27.145 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-11T23:13:27.157 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-11T23:13:27.157 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-11T23:13:27.289 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:13:27.567 INFO:teuthology.orchestra.run.smithi155.stdout:Preconfiguring packages ... 2024-09-11T23:13:27.862 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 55.8 MB in 1s (63.5 MB/s) 2024-09-11T23:13:27.925 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-11T23:13:28.179 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-11T23:13:28.185 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:13:28.332 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:13:28.868 INFO:teuthology.orchestra.run.smithi094.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-11T23:13:29.062 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-11T23:13:29.142 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package flex. 2024-09-11T23:13:29.236 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-11T23:13:29.241 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-11T23:13:29.282 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-11T23:13:29.740 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-11T23:13:29.896 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-11T23:13:30.049 INFO:teuthology.orchestra.run.smithi155.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-11T23:13:30.320 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package flex. 2024-09-11T23:13:30.392 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:13:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-11T23:13:30.427 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-11T23:13:30.468 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-11T23:13:30.917 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-11T23:13:30.922 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:13:30.943 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-11T23:13:31.053 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:13:31.107 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-11T23:13:31.495 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:13:31.514 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:13:31.651 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:13:32.045 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-11T23:13:32.045 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-11T23:13:32.050 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:13:32.181 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:13:32.453 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package bison. 2024-09-11T23:13:32.557 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-11T23:13:32.562 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-11T23:13:32.581 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:13:32.613 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-11T23:13:32.713 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:13:33.013 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-11T23:13:33.041 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-11T23:13:33.048 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-11T23:13:33.079 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-11T23:13:33.439 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package bison. 2024-09-11T23:13:33.466 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package dump. 2024-09-11T23:13:33.493 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-11T23:13:33.540 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking dump (0.4b47-3) ... 2024-09-11T23:13:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-11T23:13:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-11T23:13:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-11T23:13:33.844 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package indent. 2024-09-11T23:13:33.872 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:33.911 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-11T23:13:34.003 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-11T23:13:34.031 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-11T23:13:34.062 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-11T23:13:34.156 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-11T23:13:34.171 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-11T23:13:34.214 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-11T23:13:34.373 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package dump. 2024-09-11T23:13:34.401 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-11T23:13:34.440 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking dump (0.4b47-3) ... 2024-09-11T23:13:34.592 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-11T23:13:34.621 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-11T23:13:34.667 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-11T23:13:34.735 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package indent. 2024-09-11T23:13:34.751 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:34.794 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-11T23:13:34.978 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-11T23:13:35.006 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-11T23:13:35.053 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-11T23:13:35.080 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-11T23:13:35.108 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-11T23:13:35.154 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-11T23:13:35.448 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-11T23:13:35.476 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-11T23:13:35.514 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-11T23:13:35.575 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-11T23:13:35.603 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-11T23:13:35.650 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-11T23:13:35.776 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-11T23:13:35.792 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-11T23:13:35.834 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-11T23:13:35.920 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-11T23:13:35.948 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-11T23:13:35.987 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-11T23:13:36.103 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjson-perl. 2024-09-11T23:13:36.130 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-11T23:13:36.178 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-11T23:13:36.390 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-11T23:13:36.418 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-11T23:13:36.465 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-11T23:13:36.548 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-11T23:13:36.573 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-11T23:13:36.622 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-11T23:13:36.769 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-11T23:13:36.796 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-11T23:13:36.835 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-11T23:13:37.088 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjson-perl. 2024-09-11T23:13:37.104 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-11T23:13:37.149 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-11T23:13:37.524 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-11T23:13:37.552 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-11T23:13:37.599 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-11T23:13:38.409 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-11T23:13:38.437 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-11T23:13:38.476 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:13:38.737 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-11T23:13:38.764 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-11T23:13:38.803 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:13:39.114 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-11T23:13:39.141 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-11T23:13:39.180 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:13:39.312 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-11T23:13:39.340 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-11T23:13:39.378 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:13:39.568 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-11T23:13:39.673 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-11T23:13:39.673 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-11T23:13:39.673 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-11T23:13:39.674 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-11T23:13:39.689 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:13:40.018 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-11T23:13:40.028 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-11T23:13:40.045 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-11T23:13:40.056 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-11T23:13:40.084 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:13:40.103 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-11T23:13:40.437 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-11T23:13:40.456 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-11T23:13:40.465 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-11T23:13:40.483 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:40.503 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-11T23:13:40.522 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:40.782 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-11T23:13:40.809 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-11T23:13:40.840 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-11T23:13:40.858 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-11T23:13:40.886 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:40.933 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:13:41.202 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-11T23:13:41.229 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:41.261 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-11T23:13:41.268 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:41.277 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:41.328 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:13:41.630 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-11T23:13:41.638 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-11T23:13:41.658 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-11T23:13:41.666 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:41.696 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:13:41.704 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:13:42.124 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-11T23:13:42.141 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:42.175 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:13:42.209 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-11T23:13:42.237 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-11T23:13:42.267 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-11T23:13:42.419 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-11T23:13:42.435 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-11T23:13:42.494 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:13:42.603 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package modemmanager. 2024-09-11T23:13:42.631 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-11T23:13:42.670 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:13:42.981 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-11T23:13:43.009 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-11T23:13:43.048 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-11T23:13:43.243 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager. 2024-09-11T23:13:43.271 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-11T23:13:43.318 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-11T23:13:43.393 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package modemmanager. 2024-09-11T23:13:43.421 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-11T23:13:43.459 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:13:43.908 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ppp. 2024-09-11T23:13:43.936 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-11T23:13:44.206 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-11T23:13:44.244 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager. 2024-09-11T23:13:44.272 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-11T23:13:44.319 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-11T23:13:44.546 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package pptp-linux. 2024-09-11T23:13:44.574 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-11T23:13:44.613 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-11T23:13:44.840 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-11T23:13:44.868 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-11T23:13:44.898 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-11T23:13:44.969 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ppp. 2024-09-11T23:13:44.996 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-11T23:13:45.187 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-11T23:13:45.215 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-11T23:13:45.254 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-common (238) ... 2024-09-11T23:13:45.314 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-11T23:13:45.533 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-11T23:13:45.561 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:45.591 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:45.624 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pptp-linux. 2024-09-11T23:13:45.641 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-11T23:13:45.682 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-11T23:13:45.960 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-11T23:13:45.988 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-11T23:13:46.035 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-11T23:13:46.164 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-common. 2024-09-11T23:13:46.192 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-11T23:13:46.249 INFO:teuthology.orchestra.run.smithi094.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-11T23:13:46.279 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-common (238) ... 2024-09-11T23:13:46.405 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-11T23:13:46.434 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-11T23:13:46.480 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-common (238) ... 2024-09-11T23:13:46.731 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-14. 2024-09-11T23:13:46.758 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:46.801 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:46.801 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-11T23:13:46.829 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:46.867 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:47.389 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-common. 2024-09-11T23:13:47.418 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-11T23:13:47.466 INFO:teuthology.orchestra.run.smithi155.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-11T23:13:47.495 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-common (238) ... 2024-09-11T23:13:47.955 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-14. 2024-09-11T23:13:47.983 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:13:48.025 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:48.186 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql. 2024-09-11T23:13:48.214 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-11T23:13:48.252 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql (14+238) ... 2024-09-11T23:13:48.505 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client. 2024-09-11T23:13:48.533 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-11T23:13:48.571 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client (14+238) ... 2024-09-11T23:13:48.824 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-11T23:13:48.840 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-11T23:13:48.882 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-11T23:13:49.177 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package tcl8.6. 2024-09-11T23:13:49.205 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-11T23:13:49.243 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-11T23:13:49.530 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package tcl. 2024-09-11T23:13:49.547 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-11T23:13:49.593 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-11T23:13:49.908 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package wpasupplicant. 2024-09-11T23:13:49.927 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql. 2024-09-11T23:13:49.936 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-11T23:13:49.944 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-11T23:13:49.975 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-11T23:13:49.985 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql (14+238) ... 2024-09-11T23:13:50.238 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client. 2024-09-11T23:13:50.266 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-11T23:13:50.304 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client (14+238) ... 2024-09-11T23:13:50.330 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-11T23:13:50.358 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-11T23:13:50.397 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-11T23:13:50.548 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-11T23:13:50.565 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-11T23:13:50.606 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-11T23:13:50.800 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-11T23:13:50.828 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-11T23:13:50.867 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl8.6. 2024-09-11T23:13:50.884 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-11T23:13:50.884 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-11T23:13:50.917 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-11T23:13:51.173 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-common (238) ... 2024-09-11T23:13:51.211 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl. 2024-09-11T23:13:51.228 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-11T23:13:51.274 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-11T23:13:51.382 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-11T23:13:51.509 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-11T23:13:51.623 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package wpasupplicant. 2024-09-11T23:13:51.635 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:51.651 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-11T23:13:51.689 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-11T23:13:51.761 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-11T23:13:51.871 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-11T23:13:51.980 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:52.119 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-11T23:13:52.148 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-11T23:13:52.194 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-11T23:13:52.469 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-11T23:13:52.664 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-11T23:13:52.693 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-11T23:13:52.739 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-11T23:13:52.754 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-11T23:13:53.027 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-common (238) ... 2024-09-11T23:13:53.122 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-11T23:13:53.122 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-11T23:13:53.229 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-11T23:13:53.355 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-11T23:13:53.481 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:53.608 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-11T23:13:53.641 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-11T23:13:53.733 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-11T23:13:53.775 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-11T23:13:53.860 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:13:53.918 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:13:54.045 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-11T23:13:54.179 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-11T23:13:54.297 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-11T23:13:54.305 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-11T23:13:54.382 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-11T23:13:54.415 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-11T23:13:54.516 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-11T23:13:54.775 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-11T23:13:54.775 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-11T23:13:55.265 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-11T23:13:55.269 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-11T23:13:55.366 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up dump (0.4b47-3) ... 2024-09-11T23:13:55.370 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-11T23:13:55.443 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-11T23:13:55.488 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:13:55.509 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:13:55.614 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-11T23:13:55.636 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-11T23:13:55.740 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-11T23:13:55.762 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-11T23:13:55.866 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-11T23:13:55.888 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-11T23:13:55.992 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-11T23:13:56.014 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-11T23:13:56.097 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-11T23:13:56.118 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-11T23:13:56.158 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-11T23:13:56.268 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-11T23:13:56.444 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-11T23:13:56.579 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:13:56.705 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-11T23:13:56.732 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-11T23:13:56.858 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up dump (0.4b47-3) ... 2024-09-11T23:13:56.874 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client (14+238) ... 2024-09-11T23:13:56.952 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-11T23:13:56.975 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-11T23:13:57.010 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:13:57.153 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-11T23:13:57.262 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-11T23:13:57.372 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-11T23:13:57.442 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:13:57.442 INFO:teuthology.orchestra.run.smithi094.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-11T23:13:57.442 INFO:teuthology.orchestra.run.smithi094.stdout:which means they are currently configured by ifupdown: 2024-09-11T23:13:57.442 INFO:teuthology.orchestra.run.smithi094.stdout:- enp3s0f1 2024-09-11T23:13:57.442 INFO:teuthology.orchestra.run.smithi094.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-11T23:13:57.442 INFO:teuthology.orchestra.run.smithi094.stdout:remove their configuration from /etc/network/interfaces. 2024-09-11T23:13:57.443 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:13:57.498 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-11T23:13:57.558 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-11T23:13:57.588 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-11T23:13:57.658 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-11T23:13:57.784 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-11T23:13:57.905 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-11T23:13:57.960 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-11T23:13:58.095 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:13:58.213 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-11T23:13:58.222 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-11T23:13:58.355 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client (14+238) ... 2024-09-11T23:13:58.481 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-11T23:13:58.737 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:13:58.864 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-11T23:13:58.954 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:13:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-11T23:13:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:which means they are currently configured by ifupdown: 2024-09-11T23:13:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:- enp3s0f1 2024-09-11T23:13:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-11T23:13:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:remove their configuration from /etc/network/interfaces. 2024-09-11T23:13:58.955 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:13:58.990 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-11T23:13:59.071 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-11T23:13:59.108 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-common (238) ... 2024-09-11T23:13:59.374 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-11T23:13:59.695 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-11T23:13:59.936 INFO:teuthology.orchestra.run.smithi094.stdout:Adding user postgres to group ssl-cert 2024-09-11T23:14:00.172 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:00.172 INFO:teuthology.orchestra.run.smithi094.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-11T23:14:00.201 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:14:00.363 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-11T23:14:00.367 INFO:teuthology.orchestra.run.smithi094.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-11T23:14:00.367 INFO:teuthology.orchestra.run.smithi094.stdout:Removing obsolete dictionary files: 2024-09-11T23:14:00.713 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-11T23:14:00.838 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-common (238) ... 2024-09-11T23:14:00.901 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-11T23:14:01.261 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:14:01.581 INFO:teuthology.orchestra.run.smithi094.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-11T23:14:01.600 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-11T23:14:01.645 INFO:teuthology.orchestra.run.smithi094.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-11T23:14:01.645 INFO:teuthology.orchestra.run.smithi094.stdout:This user must also own the server process. 2024-09-11T23:14:01.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:01.645 INFO:teuthology.orchestra.run.smithi094.stdout:The database cluster will be initialized with locale "en_US". 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout:The default text search configuration will be set to "english". 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout:Data page checksums are disabled. 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout:creating subdirectories ... ok 2024-09-11T23:14:01.646 INFO:teuthology.orchestra.run.smithi094.stdout:selecting dynamic shared memory implementation ... posix 2024-09-11T23:14:01.661 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default max_connections ... 100 2024-09-11T23:14:01.678 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default shared_buffers ... 128MB 2024-09-11T23:14:01.688 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default time zone ... Etc/UTC 2024-09-11T23:14:01.689 INFO:teuthology.orchestra.run.smithi094.stdout:creating configuration files ... ok 2024-09-11T23:14:01.743 INFO:teuthology.orchestra.run.smithi155.stdout:Adding user postgres to group ssl-cert 2024-09-11T23:14:01.806 INFO:teuthology.orchestra.run.smithi094.stdout:running bootstrap script ... ok 2024-09-11T23:14:01.982 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:01.983 INFO:teuthology.orchestra.run.smithi155.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-11T23:14:02.161 INFO:teuthology.orchestra.run.smithi155.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-11T23:14:02.161 INFO:teuthology.orchestra.run.smithi155.stdout:Removing obsolete dictionary files: 2024-09-11T23:14:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:performing post-bootstrap initialization ... ok 2024-09-11T23:14:02.683 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-11T23:14:03.032 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:14:03.098 INFO:teuthology.orchestra.run.smithi094.stdout:syncing data to disk ... ok 2024-09-11T23:14:03.350 INFO:teuthology.orchestra.run.smithi155.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-11T23:14:03.385 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout:This user must also own the server process. 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout:The database cluster will be initialized with locale "en_US". 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout:The default text search configuration will be set to "english". 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout:Data page checksums are disabled. 2024-09-11T23:14:03.426 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:03.427 INFO:teuthology.orchestra.run.smithi155.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-11T23:14:03.427 INFO:teuthology.orchestra.run.smithi155.stdout:creating subdirectories ... ok 2024-09-11T23:14:03.427 INFO:teuthology.orchestra.run.smithi155.stdout:selecting dynamic shared memory implementation ... posix 2024-09-11T23:14:03.441 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default max_connections ... 100 2024-09-11T23:14:03.461 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default shared_buffers ... 128MB 2024-09-11T23:14:03.470 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default time zone ... Etc/UTC 2024-09-11T23:14:03.471 INFO:teuthology.orchestra.run.smithi155.stdout:creating configuration files ... ok 2024-09-11T23:14:03.476 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-11T23:14:03.587 INFO:teuthology.orchestra.run.smithi155.stdout:running bootstrap script ... ok 2024-09-11T23:14:04.217 INFO:teuthology.orchestra.run.smithi155.stdout:performing post-bootstrap initialization ... ok 2024-09-11T23:14:05.078 INFO:teuthology.orchestra.run.smithi155.stdout:syncing data to disk ... ok 2024-09-11T23:14:05.486 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-11T23:14:06.236 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:14:06.337 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-11T23:14:06.447 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql (14+238) ... 2024-09-11T23:14:06.573 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:14:06.699 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:14:06.952 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-11T23:14:06.952 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-11T23:14:07.485 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T23:14:07.577 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-11T23:14:07.897 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T23:14:08.041 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T23:14:08.240 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:14:08.366 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-11T23:14:08.492 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql (14+238) ... 2024-09-11T23:14:08.618 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:14:08.744 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:14:09.003 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-11T23:14:09.003 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-11T23:14:09.321 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-11T23:14:09.421 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T23:14:09.539 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T23:14:09.639 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-11T23:14:09.927 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T23:14:09.933 DEBUG:teuthology.parallel:result is None 2024-09-11T23:14:09.950 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T23:14:10.102 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T23:14:11.423 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-11T23:14:11.522 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T23:14:12.041 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T23:14:12.046 DEBUG:teuthology.parallel:result is None 2024-09-11T23:14:12.047 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:14:12.200 DEBUG:teuthology.orchestra.run.smithi094:> dpkg-query -W -f '${Version}' ceph 2024-09-11T23:14:12.220 INFO:teuthology.orchestra.run.smithi094.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:14:12.220 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:14:12.221 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-11T23:14:12.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:14:12.370 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-query -W -f '${Version}' ceph 2024-09-11T23:14:12.389 INFO:teuthology.orchestra.run.smithi155.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:14:12.389 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:14:12.389 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-11T23:14:12.391 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T23:14:12.391 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:12.391 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:14:12.405 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:12.405 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:14:12.447 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T23:14:12.447 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:12.447 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:14:12.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:14:12.515 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:12.515 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:14:12.528 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:14:12.585 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T23:14:12.585 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:12.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:14:12.599 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:14:12.655 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:12.655 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:14:12.668 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:14:12.720 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T23:14:12.720 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:12.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:14:12.734 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:14:12.787 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:12.787 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:14:12.801 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:14:12.857 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T23:14:12.940 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T23:14:12.940 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-09-11T23:14:12.942 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-09-11T23:14:12.955 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T23:14:12.955 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T23:14:12.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T23:14:13.009 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T23:14:13.009 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T23:14:13.053 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T23:14:13.071 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T23:14:13.071 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T23:14:13.071 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T23:14:13.072 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:13.072 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T23:14:13.111 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T23:14:13.188 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:13.188 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T23:14:13.193 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T23:14:13.276 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T23:14:13.276 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T23:14:13.276 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/strays}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901460', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKqsyR+RDGm+X1Cv7XPXRo4f0jElpaqEkLirAjZB+hgILUYsjGn4bz38bjzDg6c66dBYe9Kia/hXbtKUa2Rrbp0=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO2vG77ta0iMdg3ONRgXNbJYld4v21MB+rp7mBCmvKJE/5wlBgLTIXnWKvi9jREkuvFwGJmNKfNJZDGdLGJn1Vo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_strays']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T23:14:13.277 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T23:14:13.279 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T23:14:13.318 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T23:14:13.328 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T23:14:13.373 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:13.373 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:14:13.387 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:14:13.388 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-09-11T23:14:13.437 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:14:13.437 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:13.437 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-11T23:14:13.437 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:13.437 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-11 23:08:01.384907264 +0000 2024-09-11T23:14:13.438 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-11 23:08:01.144909407 +0000 2024-09-11T23:14:13.438 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-11 23:08:01.144909407 +0000 2024-09-11T23:14:13.438 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-11T23:14:13.438 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:14:13.490 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-11T23:14:13.490 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-11T23:14:13.491 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000268473 s, 1.9 MB/s 2024-09-11T23:14:13.492 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:14:13.541 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-09-11T23:14:13.587 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:14:13.587 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:13.587 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-11T23:14:13.587 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:13.588 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-11 23:08:01.900902655 +0000 2024-09-11T23:14:13.588 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-11 23:08:01.636905013 +0000 2024-09-11T23:14:13.588 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-11 23:08:01.636905013 +0000 2024-09-11T23:14:13.588 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-11T23:14:13.588 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:14:13.641 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-11T23:14:13.641 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-11T23:14:13.641 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000197674 s, 2.6 MB/s 2024-09-11T23:14:13.642 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:14:13.693 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-09-11T23:14:13.739 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:14:13.739 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:13.739 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-11T23:14:13.740 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:13.740 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-11 23:08:02.396898225 +0000 2024-09-11T23:14:13.740 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-11 23:08:02.120900690 +0000 2024-09-11T23:14:13.740 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-11 23:08:02.120900690 +0000 2024-09-11T23:14:13.740 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-11T23:14:13.740 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:14:13.798 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-11T23:14:13.798 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-11T23:14:13.798 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.00030888 s, 1.7 MB/s 2024-09-11T23:14:13.799 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:14:13.853 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-11 23:08:02.848894188 +0000 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-11 23:08:02.604896367 +0000 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-11 23:08:02.604896367 +0000 2024-09-11T23:14:13.900 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-11T23:14:13.900 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:14:13.954 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-11T23:14:13.954 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-11T23:14:13.954 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000314 s, 1.6 MB/s 2024-09-11T23:14:13.955 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:14:14.005 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:14.005 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:14.005 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:14:14.011 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:14:14.011 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-09-11T23:14:14.058 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:14:14.058 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:14.058 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-11T23:14:14.059 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:14.059 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-11 23:08:00.857530065 +0000 2024-09-11T23:14:14.059 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-11 23:08:00.621532172 +0000 2024-09-11T23:14:14.059 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-11 23:08:00.621532172 +0000 2024-09-11T23:14:14.059 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-09-11T23:14:14.059 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:14:14.112 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-11T23:14:14.112 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-11T23:14:14.113 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000435074 s, 1.2 MB/s 2024-09-11T23:14:14.114 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:14:14.163 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-09-11T23:14:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:14:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:14.210 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-11T23:14:14.210 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:14.210 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-11 23:08:01.081528064 +0000 2024-09-11T23:14:14.210 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-11 23:08:01.077528100 +0000 2024-09-11T23:14:14.210 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-11 23:08:01.077528100 +0000 2024-09-11T23:14:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-09-11T23:14:14.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:14:14.265 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-11T23:14:14.266 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-11T23:14:14.266 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000375323 s, 1.4 MB/s 2024-09-11T23:14:14.267 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:14:14.315 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-11 23:08:01.829521383 +0000 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-11 23:08:01.573523668 +0000 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-11 23:08:01.573523668 +0000 2024-09-11T23:14:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-09-11T23:14:14.363 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:14:14.416 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-11T23:14:14.416 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-11T23:14:14.416 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000427986 s, 1.2 MB/s 2024-09-11T23:14:14.417 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:14:14.468 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-11 23:08:02.333516882 +0000 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-11 23:08:02.073519204 +0000 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-11 23:08:02.073519204 +0000 2024-09-11T23:14:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-09-11T23:14:14.515 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:14:14.568 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-11T23:14:14.569 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-11T23:14:14.569 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000306615 s, 1.7 MB/s 2024-09-11T23:14:14.570 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:14:14.619 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:14.619 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T23:14:14.619 INFO:tasks.ceph:Generating config... 2024-09-11T23:14:14.620 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-11T23:14:14.621 INFO:tasks.ceph:[client] debug client = 20 2024-09-11T23:14:14.621 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T23:14:14.621 INFO:tasks.ceph:[client] pid file = 2024-09-11T23:14:14.621 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-11T23:14:14.621 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-11T23:14:14.621 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-11T23:14:14.622 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T23:14:14.622 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T23:14:14.622 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T23:14:14.622 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-11T23:14:14.622 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T23:14:14.623 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-11T23:14:14.623 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T23:14:14.623 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T23:14:14.656 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T23:14:14.663 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T23:14:14.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:14:14.801 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2024-09-11T23:14:14.802 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-11T23:14:14.802 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:14.803 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T23:14:14.848 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = quincy 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:fsid eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2024-09-11T23:14:14.936178+0000 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:created 2024-09-11T23:14:14.936178+0000 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 17 (quincy) 2024-09-11T23:14:14.933 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2024-09-11T23:14:14.934 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-11T23:14:14.934 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-11T23:14:14.934 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2024-09-11T23:14:14.934 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T23:14:14.935 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T23:14:14.984 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6... 2024-09-11T23:14:14.985 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:14:15.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:14:15.056 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-11T23:14:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-11T23:14:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-11T23:14:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-11T23:14:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-11T23:14:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:14:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-11T23:14:15.063 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.064 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-11T23:14:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:14:15.066 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-11T23:14:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-11T23:14:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:14:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:14:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:14:15.068 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-11T23:14:15.068 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-11T23:14:15.068 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:14:15.068 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.069 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-11T23:14:15.070 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-11T23:14:15.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-11T23:14:15.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.073 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-11T23:14:15.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:14:15.075 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.076 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-11T23:14:15.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:14:15.078 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-11T23:14:15.079 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-11T23:14:15.080 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-11T23:14:15.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:14:15.080 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:14:15.080 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:14:15.081 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T23:14:15.081 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T23:14:15.176 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T23:14:15.176 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:15.176 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T23:14:15.182 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:15.182 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T23:14:15.227 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:14:15.228 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:15.228 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T23:14:15.228 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:14:15.293 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:15.293 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:15.339 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:14:15.340 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:15.340 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T23:14:15.340 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:14:15.362 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:15.362 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:15.409 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T23:14:15.410 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T23:14:15.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T23:14:15.454 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T23:14:15.457 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T23:14:15.502 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T23:14:15.516 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T23:14:15.516 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T23:14:15.556 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T23:14:15.559 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T23:14:15.616 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T23:14:15.697 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T23:14:15.700 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-11T23:14:15.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T23:14:15.800 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T23:14:15.803 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T23:14:15.857 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T23:14:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T23:14:15.945 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-11T23:14:16.001 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T23:14:16.002 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T23:14:16.036 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T23:14:16.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-11T23:14:16.119 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-11T23:14:16.129 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T23:14:16.166 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T23:14:16.177 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-11T23:14:16.255 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-11T23:14:16.265 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T23:14:16.265 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T23:14:16.266 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T23:14:16.280 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:16.280 INFO:tasks.ceph:role: osd.0 2024-09-11T23:14:16.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:14:16.280 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:16.335 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:16.336 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:16.336 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:16.361 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-11T23:14:16.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-11T23:14:16.363 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T23:14:16.424 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T23:14:16.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:16.476 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:16.477 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T23:14:16.529 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:16.529 INFO:tasks.ceph:role: osd.1 2024-09-11T23:14:16.529 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:14:16.529 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T23:14:16.584 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:16.585 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:16.609 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-11T23:14:16.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-11T23:14:16.611 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T23:14:16.675 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T23:14:16.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:16.728 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:16.729 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T23:14:16.781 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:16.781 INFO:tasks.ceph:role: osd.2 2024-09-11T23:14:16.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:14:16.781 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T23:14:16.834 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:16.834 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:16.835 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:16.860 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-11T23:14:16.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-11T23:14:16.862 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T23:14:16.921 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T23:14:16.973 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:16.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:16.974 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T23:14:17.025 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:17.026 INFO:tasks.ceph:role: osd.3 2024-09-11T23:14:17.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:14:17.026 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T23:14:17.078 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:17.078 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:17.079 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:17.103 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-11T23:14:17.105 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-11T23:14:17.105 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T23:14:17.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T23:14:17.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:17.212 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:17.212 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:17.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:17.319+0000 7f50b8c817c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T23:14:17.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:17.319+0000 7f50b8c817c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T23:14:17.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:17.319+0000 7f50b8c817c0 -1 bdev(0x5636f779b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:17.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:17.319+0000 7f50b8c817c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T23:14:20.452 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T23:14:20.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:20.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:20.551+0000 7fbdcf17a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T23:14:20.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:20.551+0000 7fbdcf17a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T23:14:20.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:20.551+0000 7fbdcf17a7c0 -1 bdev(0x55d3f0863800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:20.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:20.551+0000 7fbdcf17a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T23:14:23.686 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T23:14:23.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:23.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:23.823+0000 7f11e18dc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T23:14:23.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:23.823+0000 7f11e18dc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T23:14:23.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:23.823+0000 7f11e18dc7c0 -1 bdev(0x55f3508fb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:23.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:23.823+0000 7f11e18dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T23:14:26.946 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T23:14:27.001 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:27.083+0000 7f10f29e87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T23:14:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:27.083+0000 7f10f29e87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T23:14:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:27.083+0000 7f10f29e87c0 -1 bdev(0x55e938277800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:27.083+0000 7f10f29e87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T23:14:30.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T23:14:30.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T23:14:30.282 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:30.282 INFO:tasks.ceph:role: osd.4 2024-09-11T23:14:30.282 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:14:30.282 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T23:14:30.345 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:30.345 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:30.345 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:30.345 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:30.345 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:30.345 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:30.345 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:30.346 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:30.346 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:30.346 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:30.802 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-11T23:14:30.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-11T23:14:30.804 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T23:14:30.906 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T23:14:30.915 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:30.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:30.916 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T23:14:30.967 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:30.967 INFO:tasks.ceph:role: osd.5 2024-09-11T23:14:30.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:14:30.967 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T23:14:31.029 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:31.029 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:31.029 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:31.030 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:31.030 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:31.030 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:31.030 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:31.030 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:31.030 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:31.030 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:31.504 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-11T23:14:31.506 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-11T23:14:31.506 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T23:14:31.646 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T23:14:31.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:31.658 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:31.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T23:14:31.713 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:31.714 INFO:tasks.ceph:role: osd.6 2024-09-11T23:14:31.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:14:31.714 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T23:14:31.777 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:31.777 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:31.777 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:31.780 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:31.780 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:31.780 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:31.780 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:31.780 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:31.780 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:31.780 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:32.263 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-11T23:14:32.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-11T23:14:32.265 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T23:14:32.413 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T23:14:32.424 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:32.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:32.426 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T23:14:32.485 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:14:32.485 INFO:tasks.ceph:role: osd.7 2024-09-11T23:14:32.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:14:32.486 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T23:14:32.550 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:14:32.550 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:14:32.551 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:14:32.974 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-11T23:14:32.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-11T23:14:32.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T23:14:33.078 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T23:14:33.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:33.089 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:14:33.090 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:33.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:33.202+0000 7f8b239f57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T23:14:33.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:33.206+0000 7f8b239f57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T23:14:33.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:33.206+0000 7f8b239f57c0 -1 bdev(0x5613d3fb9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:33.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:33.206+0000 7f8b239f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T23:14:36.334 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T23:14:36.348 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:36.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:36.426+0000 7ff4de8567c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T23:14:36.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:36.426+0000 7ff4de8567c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T23:14:36.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:36.426+0000 7ff4de8567c0 -1 bdev(0x557a75aa3800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:36.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:36.426+0000 7ff4de8567c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T23:14:39.562 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T23:14:39.617 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:39.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:39.698+0000 7fcc13b7e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T23:14:39.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:39.698+0000 7fcc13b7e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T23:14:39.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:39.698+0000 7fcc13b7e7c0 -1 bdev(0x5561aa87d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:39.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:39.698+0000 7fcc13b7e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T23:14:42.820 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T23:14:42.874 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:42.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:42.954+0000 7ff27847d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T23:14:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:42.958+0000 7ff27847d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T23:14:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:42.958+0000 7ff27847d7c0 -1 bdev(0x55aa4eb67800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T23:14:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:42.958+0000 7ff27847d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T23:14:43.279 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:14:43.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:14:46.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T23:14:46.118 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T23:14:46.118 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.118 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T23:14:46.132 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.132 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T23:14:46.187 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.187 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-11T23:14:46.242 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.242 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T23:14:46.294 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.294 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T23:14:46.347 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.347 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T23:14:46.402 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T23:14:46.458 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.458 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T23:14:46.472 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.472 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T23:14:46.529 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.529 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-11T23:14:46.584 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.584 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T23:14:46.636 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.636 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T23:14:46.697 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.697 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T23:14:46.752 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.752 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T23:14:46.805 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.805 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T23:14:46.812 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:46.812 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-11T23:14:46.859 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.860 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T23:14:46.865 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:46.865 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-11T23:14:46.913 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T23:14:46.914 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T23:14:46.916 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T23:14:46.959 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg== 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg== 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ== 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ== 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g== 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow== 2024-09-11T23:14:46.960 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA== 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA== 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ== 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg== 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw== 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g== 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA== 2024-09-11T23:14:46.961 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA== 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout:[client.2] 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ== 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw== 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout:[client.3] 2024-09-11T23:14:46.962 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw== 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg== 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg== 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ== 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ== 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g== 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-09-11T23:14:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow== 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA== 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA== 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ== 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg== 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw== 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g== 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-09-11T23:14:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA== 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA== 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ== 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw== 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2024-09-11T23:14:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw== 2024-09-11T23:14:46.971 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:14:47.008 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:14:47.056 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.144 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.146 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.227 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.232 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.312 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.316 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.395 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.404 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.476 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.488 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.561 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:14:47.576 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:14:47.648 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.660 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.731 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:14:47.820 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.822 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.899 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.984 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:47.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:48.073 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:48.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:14:48.119 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.164 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.209 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.252 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.294 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.336 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.385 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.387 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:14:48.467 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T23:14:48.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T23:14:48.478 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T23:14:48.573 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T23:14:48.584 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T23:14:48.598 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T23:14:48.689 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T23:14:48.699 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T23:14:48.750 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T23:14:48.836 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T23:14:48.890 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:48.893 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:14:48.937 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T23:14:48.937 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T23:14:48.937 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T23:14:48.940 INFO:tasks.ceph.mon.a:Started 2024-09-11T23:14:48.940 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T23:14:48.940 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T23:14:48.982 INFO:tasks.ceph.mon.b:Started 2024-09-11T23:14:48.983 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T23:14:48.983 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T23:14:48.985 INFO:tasks.ceph.mon.c:Started 2024-09-11T23:14:48.985 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T23:14:48.985 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T23:14:48.985 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T23:14:48.988 INFO:tasks.ceph.mgr.y:Started 2024-09-11T23:14:48.988 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T23:14:48.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T23:14:48.990 INFO:tasks.ceph.mgr.x:Started 2024-09-11T23:14:48.990 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T23:14:48.991 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T23:14:49.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 Processor -- start 2024-09-11T23:14:49.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 -- start start 2024-09-11T23:14:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f315c0b04a0 con 0x7f315c15e3e0 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f315c0b0770 con 0x7f315c0b3300 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f31613a6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0b0a50 con 0x7f315c072dd0 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f3153fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:46034/0 (socket says 172.21.15.94:46034) 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315b7fe640 1 -- 172.21.15.94:0/3794790460 learned_addr learned my addr 172.21.15.94:0/3794790460 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315b7fe640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 msgr2=0x7f315c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315b7fe640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 msgr2=0x7f315c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f3153fff640 1 -- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 msgr2=0x7f315c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f3153fff640 1 -- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 msgr2=0x7f315c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f3153fff640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f3153fff640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315affd640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 msgr2=0x7f315c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315affd640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 msgr2=0x7f315c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:14:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.107+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:14:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f3153fff640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f3153fff640 1 -- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 msgr2=0x7f315c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T23:14:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f3153fff640 1 -- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 msgr2=0x7f315c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:14:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315b7fe640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 msgr2=0x7f315c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:14:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315b7fe640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 msgr2=0x7f315c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f3153fff640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f3153fff640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315affd640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 msgr2=0x7f315c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315affd640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 msgr2=0x7f315c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:14:49.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.311+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:14:49.547 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:49.546+0000 7ffa23603180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:14:49.569 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:49.567+0000 7f4479e21180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.94:3300/0 conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f3153fff640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f315affd640 1 -- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 msgr2=0x7f315c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f315affd640 1 -- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 msgr2=0x7f315c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f315affd640 1 -- 172.21.15.94:0/3794790460 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c15eb10 con 0x7f315c15e3e0 2024-09-11T23:14:49.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.715+0000 7f3153fff640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:14:49.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.719+0000 7f315affd640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c15f310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f315c162eb0 tx=0x7f314c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff799bbb13f6fda server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:49.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.719+0000 7f315a7fc640 1 -- 172.21.15.94:0/3794790460 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c0ab070 con 0x7f315c15e3e0 2024-09-11T23:14:49.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.719+0000 7f315a7fc640 1 -- 172.21.15.94:0/3794790460 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314c0a5830 con 0x7f315c15e3e0 2024-09-11T23:14:49.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.719+0000 7f315a7fc640 1 -- 172.21.15.94:0/3794790460 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c00f040 con 0x7f315c15e3e0 2024-09-11T23:14:49.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- 172.21.15.94:0/3794790460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 msgr2=0x7f315c15f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:49.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c15f310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f315c162eb0 tx=0x7f314c01c9a0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- 172.21.15.94:0/3794790460 shutdown_connections 2024-09-11T23:14:49.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 --2- 172.21.15.94:0/3794790460 >> v2:172.21.15.155:3300/0 conn(0x7f315c0b3300 0x7f315c0b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 --2- 172.21.15.94:0/3794790460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c15f310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- 172.21.15.94:0/3794790460 >> 172.21.15.94:0/3794790460 conn(0x7f315c0b6870 msgr2=0x7f315c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:49.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- 172.21.15.94:0/3794790460 shutdown_connections 2024-09-11T23:14:49.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- 172.21.15.94:0/3794790460 wait complete. 2024-09-11T23:14:49.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 Processor -- start 2024-09-11T23:14:49.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- start start 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b3300 0x7f315c164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f315c1629c0 con 0x7f315c15e3e0 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f315c162840 con 0x7f315c0b3300 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.723+0000 7f31613a6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0b5360 con 0x7f315c072dd0 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f3153fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b3300 0x7f315c164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c1571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37070/0 (socket says 172.21.15.94:37070) 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 -- 172.21.15.94:0/4083872018 learned_addr learned my addr 172.21.15.94:0/4083872018 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 -- 172.21.15.94:0/4083872018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 msgr2=0x7f315c0b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 --2- 172.21.15.94:0/4083872018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 -- 172.21.15.94:0/4083872018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b3300 msgr2=0x7f315c164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 --2- 172.21.15.94:0/4083872018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b3300 0x7f315c164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 -- 172.21.15.94:0/4083872018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c06cad0 con 0x7f315c15e3e0 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f315b7fe640 1 --2- 172.21.15.94:0/4083872018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c1571c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3154007d50 tx=0x7f31540115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31537fe640 1 -- 172.21.15.94:0/4083872018 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154019020 con 0x7f315c15e3e0 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31537fe640 1 -- 172.21.15.94:0/4083872018 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3154009e10 con 0x7f315c15e3e0 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c0b4750 con 0x7f315c15e3e0 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31537fe640 1 -- 172.21.15.94:0/4083872018 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154003be0 con 0x7f315c15e3e0 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c0b4d10 con 0x7f315c15e3e0 2024-09-11T23:14:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31537fe640 1 -- 172.21.15.94:0/4083872018 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f315401c020 con 0x7f315c15e3e0 2024-09-11T23:14:49.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31537fe640 1 -- 172.21.15.94:0/4083872018 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f315401e850 con 0x7f315c15e3e0 2024-09-11T23:14:49.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.727+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c15f4b0 con 0x7f315c15e3e0 2024-09-11T23:14:49.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.731+0000 7f31537fe640 1 -- 172.21.15.94:0/4083872018 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3154023030 con 0x7f315c15e3e0 2024-09-11T23:14:49.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.791+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f315c0aff60 con 0x7f315c15e3e0 2024-09-11T23:14:49.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31537fe640 1 -- 172.21.15.94:0/4083872018 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f315401ea50 con 0x7f315c15e3e0 2024-09-11T23:14:49.796 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2024-09-11T23:14:49.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 msgr2=0x7f315c1571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:49.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 --2- 172.21.15.94:0/4083872018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c1571c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3154007d50 tx=0x7f31540115a0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 shutdown_connections 2024-09-11T23:14:49.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 --2- 172.21.15.94:0/4083872018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c15e3e0 0x7f315c1571c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 --2- 172.21.15.94:0/4083872018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b3300 0x7f315c164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 --2- 172.21.15.94:0/4083872018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c072dd0 0x7f315c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:49.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 >> 172.21.15.94:0/4083872018 conn(0x7f315c0b6870 msgr2=0x7f315c0b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:49.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 shutdown_connections 2024-09-11T23:14:49.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:49.795+0000 7f31613a6640 1 -- 172.21.15.94:0/4083872018 wait complete. 2024-09-11T23:14:49.814 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T23:14:49.814 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T23:14:49.814 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:49.814 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T23:14:49.826 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:49.826 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T23:14:49.882 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:49.882 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T23:14:49.933 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:14:49.934 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T23:14:49.986 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:49.987 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T23:14:50.001 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:50.001 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T23:14:50.019 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:50.019+0000 7f4479e21180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:14:50.045 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:50.046+0000 7ffa23603180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:14:50.057 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:50.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T23:14:50.113 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:14:50.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T23:14:50.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 72d0091b-4437-4a06-8dcc-98096e07761e 0 2024-09-11T23:14:50.236 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:50.235+0000 7f4479e21180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:14:50.270 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:50.270+0000 7ffa23603180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:14:50.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e7704640 1 Processor -- start 2024-09-11T23:14:50.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e7704640 1 -- start start 2024-09-11T23:14:50.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e7704640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f31e01625b0 0x7f31e0169000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e7704640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e00afbb0 con 0x7f31e0067e30 2024-09-11T23:14:50.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e7704640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e00af310 con 0x7f31e015e260 2024-09-11T23:14:50.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e7704640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f31e00b0700 con 0x7f31e01625b0 2024-09-11T23:14:50.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e54a0640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f31e015e260 0x7f31e00afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46434/0 (socket says 172.21.15.155:46434) 2024-09-11T23:14:50.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e54a0640 1 -- 172.21.15.155:0/1553160905 learned_addr learned my addr 172.21.15.155:0/1553160905 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-09-11T23:14:50.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.334+0000 7f31e5ca1640 1 --2- 172.21.15.155:0/1553160905 >> v2:172.21.15.155:3300/0 conn(0x7f31e01625b0 0x7f31e0169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.338+0000 7f31e5ca1640 1 -- 172.21.15.155:0/1553160905 >> v1:172.21.15.155:6789/0 conn(0x7f31e015e260 legacy=0x7f31e00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.338+0000 7f31e5ca1640 1 -- 172.21.15.155:0/1553160905 >> v1:172.21.15.94:6789/0 conn(0x7f31e0067e30 legacy=0x7f31e0161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.338+0000 7f31e5ca1640 1 -- 172.21.15.155:0/1553160905 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e00af5f0 con 0x7f31e01625b0 2024-09-11T23:14:50.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.338+0000 7f31e5ca1640 1 --2- 172.21.15.155:0/1553160905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e0169000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0097c0 tx=0x7f31dc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=948f0b4924220207 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:50.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.338+0000 7f31d7fff640 1 -- 172.21.15.155:0/1553160905 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0aa620 con 0x7f31e01625b0 2024-09-11T23:14:50.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.338+0000 7f31d7fff640 1 -- 172.21.15.155:0/1553160905 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0af070 con 0x7f31e01625b0 2024-09-11T23:14:50.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.338+0000 7f31d7fff640 1 -- 172.21.15.155:0/1553160905 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0aa9e0 con 0x7f31e01625b0 2024-09-11T23:14:50.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- 172.21.15.155:0/1553160905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 msgr2=0x7f31e0169000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 --2- 172.21.15.155:0/1553160905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e0169000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0097c0 tx=0x7f31dc01c4a0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- 172.21.15.155:0/1553160905 shutdown_connections 2024-09-11T23:14:50.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 --2- 172.21.15.155:0/1553160905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e0169000 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- 172.21.15.155:0/1553160905 >> 172.21.15.155:0/1553160905 conn(0x7f31e0073580 msgr2=0x7f31e006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:50.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- 172.21.15.155:0/1553160905 shutdown_connections 2024-09-11T23:14:50.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- 172.21.15.155:0/1553160905 wait complete. 2024-09-11T23:14:50.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 Processor -- start 2024-09-11T23:14:50.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- start start 2024-09-11T23:14:50.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0067e30 0x7f31e014e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31e015e260 0x7f31e014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e01fa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f31e016c0f0 con 0x7f31e0067e30 2024-09-11T23:14:50.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31e016bf70 con 0x7f31e01625b0 2024-09-11T23:14:50.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e7704640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f31e016c270 con 0x7f31e015e260 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e4c9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31e015e260 0x7f31e014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e5ca1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e01fa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e4c9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31e015e260 0x7f31e014e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59600/0 (socket says 172.21.15.155:59600) 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e4c9f640 1 -- 172.21.15.155:0/332201301 learned_addr learned my addr 172.21.15.155:0/332201301 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e54a0640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0067e30 0x7f31e014e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e5ca1640 1 -- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31e015e260 msgr2=0x7f31e014e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e5ca1640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31e015e260 0x7f31e014e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e5ca1640 1 -- 172.21.15.155:0/332201301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0067e30 msgr2=0x7f31e014e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e5ca1640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0067e30 0x7f31e014e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e5ca1640 1 -- 172.21.15.155:0/332201301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e0158080 con 0x7f31e01625b0 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e4c9f640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31e015e260 0x7f31e014e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:50.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.342+0000 7f31e5ca1640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e01fa8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f31e0073a70 tx=0x7f31dc01ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:50.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31d5ffb640 1 -- 172.21.15.155:0/332201301 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0aadc0 con 0x7f31e01625b0 2024-09-11T23:14:50.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31d5ffb640 1 -- 172.21.15.155:0/332201301 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0be410 con 0x7f31e01625b0 2024-09-11T23:14:50.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31d5ffb640 1 -- 172.21.15.155:0/332201301 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0be800 con 0x7f31e01625b0 2024-09-11T23:14:50.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e0158360 con 0x7f31e01625b0 2024-09-11T23:14:50.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e0158640 con 0x7f31e01625b0 2024-09-11T23:14:50.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31d5ffb640 1 -- 172.21.15.155:0/332201301 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f31dc0bc020 con 0x7f31e01625b0 2024-09-11T23:14:50.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31d5ffb640 1 -- 172.21.15.155:0/332201301 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f31dc0b4b20 con 0x7f31e01625b0 2024-09-11T23:14:50.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.346+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e0161ea0 con 0x7f31e01625b0 2024-09-11T23:14:50.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.358+0000 7f31d5ffb640 1 -- 172.21.15.155:0/332201301 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f31dc0c5070 con 0x7f31e01625b0 2024-09-11T23:14:50.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.426+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72d0091b-4437-4a06-8dcc-98096e07761e", "id": 0} v 0) -- 0x7f31e0156130 con 0x7f31e01625b0 2024-09-11T23:14:50.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31d5ffb640 1 -- 172.21.15.155:0/332201301 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72d0091b-4437-4a06-8dcc-98096e07761e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f31dc016090 con 0x7f31e01625b0 2024-09-11T23:14:50.439 INFO:teuthology.orchestra.run.smithi155.stdout:0 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 msgr2=0x7f31e01fa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e01fa8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f31e0073a70 tx=0x7f31dc01ace0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 shutdown_connections 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e01625b0 0x7f31e01fa8c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31e015e260 0x7f31e014e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 --2- 172.21.15.155:0/332201301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0067e30 0x7f31e014e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 >> 172.21.15.155:0/332201301 conn(0x7f31e0073580 msgr2=0x7f31e006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 shutdown_connections 2024-09-11T23:14:50.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.438+0000 7f31e7704640 1 -- 172.21.15.155:0/332201301 wait complete. 2024-09-11T23:14:50.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 54556a89-7209-459d-8060-70cbfc67cbc0 1 2024-09-11T23:14:50.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.566+0000 7f966cdae640 1 Processor -- start 2024-09-11T23:14:50.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.566+0000 7f966cdae640 1 -- start start 2024-09-11T23:14:50.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.566+0000 7f966cdae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f966815c0c0 0x7f966815c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96680cd520 con 0x7f966815c9e0 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96680cd800 con 0x7f966806d3e0 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f96680cdae0 con 0x7f966815c0c0 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966659c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f966815c0c0 0x7f966815c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966659c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f966815c0c0 0x7f966815c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56128/0 (socket says 172.21.15.155:56128) 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966659c640 1 -- 172.21.15.155:0/1198597320 learned_addr learned my addr 172.21.15.155:0/1198597320 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966659c640 1 -- 172.21.15.155:0/1198597320 >> v1:172.21.15.155:6789/0 conn(0x7f966806d3e0 legacy=0x7f96680ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966659c640 1 -- 172.21.15.155:0/1198597320 >> v1:172.21.15.94:6789/0 conn(0x7f966815c9e0 legacy=0x7f966806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:50.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966659c640 1 -- 172.21.15.155:0/1198597320 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96680cddc0 con 0x7f966815c0c0 2024-09-11T23:14:50.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966659c640 1 --2- 172.21.15.155:0/1198597320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c0c0 0x7f966815c4a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9658009870 tx=0x7f965801c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9481c151d3713b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:50.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f9665d9b640 1 -- 172.21.15.155:0/1198597320 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96580aa670 con 0x7f966815c0c0 2024-09-11T23:14:50.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f9665d9b640 1 -- 172.21.15.155:0/1198597320 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96580af070 con 0x7f966815c0c0 2024-09-11T23:14:50.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f9665d9b640 1 -- 172.21.15.155:0/1198597320 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96580aaa30 con 0x7f966815c0c0 2024-09-11T23:14:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- 172.21.15.155:0/1198597320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c0c0 msgr2=0x7f966815c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 --2- 172.21.15.155:0/1198597320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c0c0 0x7f966815c4a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9658009870 tx=0x7f965801c4f0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- 172.21.15.155:0/1198597320 shutdown_connections 2024-09-11T23:14:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 --2- 172.21.15.155:0/1198597320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c0c0 0x7f966815c4a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- 172.21.15.155:0/1198597320 >> 172.21.15.155:0/1198597320 conn(0x7f9668072670 msgr2=0x7f9668072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- 172.21.15.155:0/1198597320 shutdown_connections 2024-09-11T23:14:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.570+0000 7f966cdae640 1 -- 172.21.15.155:0/1198597320 wait complete. 2024-09-11T23:14:50.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 Processor -- start 2024-09-11T23:14:50.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 -- start start 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f966806d3e0 0x7f96681502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f966815c0c0 0x7f9668159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c9e0 0x7f96680b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f96680cf060 con 0x7f966806d3e0 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96680ceee0 con 0x7f966815c9e0 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f966816a610 con 0x7f966815c0c0 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965dd9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f966815c0c0 0x7f9668159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f9666d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c9e0 0x7f96680b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965dd9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f966815c0c0 0x7f9668159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59606/0 (socket says 172.21.15.155:59606) 2024-09-11T23:14:50.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965dd9b640 1 -- 172.21.15.155:0/3542258612 learned_addr learned my addr 172.21.15.155:0/3542258612 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966659c640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f966806d3e0 0x7f96681502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f9666d9d640 1 -- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f966815c0c0 msgr2=0x7f9668159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f9666d9d640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f966815c0c0 0x7f9668159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f9666d9d640 1 -- 172.21.15.155:0/3542258612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f966806d3e0 msgr2=0x7f96681502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f9666d9d640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f966806d3e0 0x7f96681502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f9666d9d640 1 -- 172.21.15.155:0/3542258612 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9668158890 con 0x7f966815c9e0 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965dd9b640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f966815c0c0 0x7f9668159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f9666d9d640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c9e0 0x7f96680b1b40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f966000c700 tx=0x7f966000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965f7fe640 1 -- 172.21.15.155:0/3542258612 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660003b80 con 0x7f966815c9e0 2024-09-11T23:14:50.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965f7fe640 1 -- 172.21.15.155:0/3542258612 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660003d20 con 0x7f966815c9e0 2024-09-11T23:14:50.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965f7fe640 1 -- 172.21.15.155:0/3542258612 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966000aa30 con 0x7f966815c9e0 2024-09-11T23:14:50.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9668158b70 con 0x7f966815c9e0 2024-09-11T23:14:50.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9668159130 con 0x7f966815c9e0 2024-09-11T23:14:50.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965f7fe640 1 -- 172.21.15.155:0/3542258612 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f966000abd0 con 0x7f966815c9e0 2024-09-11T23:14:50.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.574+0000 7f965f7fe640 1 -- 172.21.15.155:0/3542258612 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9660012500 con 0x7f966815c9e0 2024-09-11T23:14:50.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.578+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f966815c4a0 con 0x7f966815c9e0 2024-09-11T23:14:50.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.582+0000 7f965f7fe640 1 -- 172.21.15.155:0/3542258612 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f96600050d0 con 0x7f966815c9e0 2024-09-11T23:14:50.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.646+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "54556a89-7209-459d-8060-70cbfc67cbc0", "id": 1} v 0) -- 0x7f966806d7c0 con 0x7f966815c9e0 2024-09-11T23:14:50.650 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f965f7fe640 1 -- 172.21.15.155:0/3542258612 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54556a89-7209-459d-8060-70cbfc67cbc0", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f96600052b0 con 0x7f966815c9e0 2024-09-11T23:14:50.650 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c9e0 msgr2=0x7f96680b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c9e0 0x7f96680b1b40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f966000c700 tx=0x7f966000cbc0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 shutdown_connections 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f966815c9e0 0x7f96680b1b40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f966815c0c0 0x7f9668159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 --2- 172.21.15.155:0/3542258612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f966806d3e0 0x7f96681502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 >> 172.21.15.155:0/3542258612 conn(0x7f9668072670 msgr2=0x7f96680ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 shutdown_connections 2024-09-11T23:14:50.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.650+0000 7f966cdae640 1 -- 172.21.15.155:0/3542258612 wait complete. 2024-09-11T23:14:50.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 50e261e3-5cd2-400f-bcda-9adda215413d 2 2024-09-11T23:14:50.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd5545e4640 1 Processor -- start 2024-09-11T23:14:50.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd5545e4640 1 -- start start 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd5545e4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd54c06bcc0 0x7fd54c06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd5545e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c0d1050 0x7fd54c0d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd5545e4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c0d1d80 con 0x7fd54c145d90 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd5545e4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c06c670 con 0x7fd54c06bcc0 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd5545e4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c0afa20 con 0x7fd54c0d1050 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd552380640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd54c145d90 0x7fd54c0b0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46448/0 (socket says 172.21.15.155:46448) 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd552380640 1 -- 172.21.15.155:0/2281917151 learned_addr learned my addr 172.21.15.155:0/2281917151 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-09-11T23:14:50.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.778+0000 7fd552b81640 1 --2- 172.21.15.155:0/2281917151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c0d1050 0x7fd54c0d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd551b7f640 1 --2- 172.21.15.155:0/2281917151 >> v2:172.21.15.94:3300/0 conn(0x7fd54c06bcc0 0x7fd54c06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd55137e640 1 -- 172.21.15.155:0/2281917151 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868867030 0 0) 0x7fd54c0d1d80 con 0x7fd54c145d90 2024-09-11T23:14:50.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd55137e640 1 -- 172.21.15.155:0/2281917151 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd538003530 con 0x7fd54c145d90 2024-09-11T23:14:50.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd552b81640 1 -- 172.21.15.155:0/2281917151 >> v2:172.21.15.94:3300/0 conn(0x7fd54c06bcc0 msgr2=0x7fd54c06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:50.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd552b81640 1 --2- 172.21.15.155:0/2281917151 >> v2:172.21.15.94:3300/0 conn(0x7fd54c06bcc0 0x7fd54c06c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd552b81640 1 -- 172.21.15.155:0/2281917151 >> v1:172.21.15.155:6789/0 conn(0x7fd54c145d90 legacy=0x7fd54c0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd552b81640 1 -- 172.21.15.155:0/2281917151 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0afd00 con 0x7fd54c0d1050 2024-09-11T23:14:50.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd552b81640 1 --2- 172.21.15.155:0/2281917151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c0d1050 0x7fd54c0d14e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd544009d90 tx=0x7fd54401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0e9adbf57784c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:50.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd55137e640 1 -- 172.21.15.155:0/2281917151 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440b2070 con 0x7fd54c0d1050 2024-09-11T23:14:50.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd55137e640 1 -- 172.21.15.155:0/2281917151 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5440a58e0 con 0x7fd54c0d1050 2024-09-11T23:14:50.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd55137e640 1 -- 172.21.15.155:0/2281917151 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440a5c90 con 0x7fd54c0d1050 2024-09-11T23:14:50.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 -- 172.21.15.155:0/2281917151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c0d1050 msgr2=0x7fd54c0d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 --2- 172.21.15.155:0/2281917151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c0d1050 0x7fd54c0d14e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd544009d90 tx=0x7fd54401c970 comp rx=0 tx=0).stop 2024-09-11T23:14:50.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 -- 172.21.15.155:0/2281917151 shutdown_connections 2024-09-11T23:14:50.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 --2- 172.21.15.155:0/2281917151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c0d1050 0x7fd54c0d14e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 --2- 172.21.15.155:0/2281917151 >> v2:172.21.15.94:3300/0 conn(0x7fd54c06bcc0 0x7fd54c06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 -- 172.21.15.155:0/2281917151 >> 172.21.15.155:0/2281917151 conn(0x7fd54c09aa00 msgr2=0x7fd54c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:50.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 -- 172.21.15.155:0/2281917151 shutdown_connections 2024-09-11T23:14:50.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.782+0000 7fd5545e4640 1 -- 172.21.15.155:0/2281917151 wait complete. 2024-09-11T23:14:50.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 Processor -- start 2024-09-11T23:14:50.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 -- start start 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd54c06bcc0 0x7fd54c161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd54c0d1050 0x7fd54c1416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c145d90 0x7fd54c1604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0b4a20 con 0x7fd54c06bcc0 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0b48a0 con 0x7fd54c0d1050 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c0b4ba0 con 0x7fd54c145d90 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd54c0d1050 0x7fd54c1416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd552b81640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c145d90 0x7fd54c1604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd54c0d1050 0x7fd54c1416a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56146/0 (socket says 172.21.15.155:56146) 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd552b81640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c145d90 0x7fd54c1604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59624/0 (socket says 172.21.15.155:59624) 2024-09-11T23:14:50.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 -- 172.21.15.155:0/1700954685 learned_addr learned my addr 172.21.15.155:0/1700954685 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd552380640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd54c06bcc0 0x7fd54c161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 -- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c145d90 msgr2=0x7fd54c1604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c145d90 0x7fd54c1604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 -- 172.21.15.155:0/1700954685 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd54c06bcc0 msgr2=0x7fd54c161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd54c06bcc0 0x7fd54c161f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 -- 172.21.15.155:0/1700954685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0ae600 con 0x7fd54c0d1050 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd552b81640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c145d90 0x7fd54c1604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd551b7f640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd54c0d1050 0x7fd54c1416a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00d5f0 tx=0x7fd53c00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd542ffd640 1 -- 172.21.15.155:0/1700954685 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0125f0 con 0x7fd54c0d1050 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd542ffd640 1 -- 172.21.15.155:0/1700954685 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53c019070 con 0x7fd54c0d1050 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c142f00 con 0x7fd54c0d1050 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd542ffd640 1 -- 172.21.15.155:0/1700954685 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0129b0 con 0x7fd54c0d1050 2024-09-11T23:14:50.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c160a30 con 0x7fd54c0d1050 2024-09-11T23:14:50.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd542ffd640 1 -- 172.21.15.155:0/1700954685 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd53c012b50 con 0x7fd54c0d1050 2024-09-11T23:14:50.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd542ffd640 1 -- 172.21.15.155:0/1700954685 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fd53c014850 con 0x7fd54c0d1050 2024-09-11T23:14:50.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.786+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c0d1d80 con 0x7fd54c0d1050 2024-09-11T23:14:50.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.790+0000 7fd542ffd640 1 -- 172.21.15.155:0/1700954685 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd54c142f00 con 0x7fd54c0d1050 2024-09-11T23:14:50.793 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:50.790+0000 7f4479e21180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:14:50.847 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:50.842+0000 7f4479e21180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:14:50.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.854+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50e261e3-5cd2-400f-bcda-9adda215413d", "id": 2} v 0) -- 0x7fd54c1453b0 con 0x7fd54c0d1050 2024-09-11T23:14:50.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd542ffd640 1 -- 172.21.15.155:0/1700954685 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50e261e3-5cd2-400f-bcda-9adda215413d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fd53c014500 con 0x7fd54c0d1050 2024-09-11T23:14:50.861 INFO:teuthology.orchestra.run.smithi155.stdout:2 2024-09-11T23:14:50.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd54c0d1050 msgr2=0x7fd54c1416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd54c0d1050 0x7fd54c1416a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00d5f0 tx=0x7fd53c00dab0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 shutdown_connections 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd54c145d90 0x7fd54c1604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd54c0d1050 0x7fd54c1416a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 --2- 172.21.15.155:0/1700954685 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd54c06bcc0 0x7fd54c161f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 >> 172.21.15.155:0/1700954685 conn(0x7fd54c09aa00 msgr2=0x7fd54c140660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 shutdown_connections 2024-09-11T23:14:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.862+0000 7fd5545e4640 1 -- 172.21.15.155:0/1700954685 wait complete. 2024-09-11T23:14:50.866 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:50.866+0000 7ffa23603180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:14:50.883 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 46dbd42d-19c6-4f0b-8d22-70e71a32c9a9 3 2024-09-11T23:14:50.898 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:50.894+0000 7f4479e21180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:14:50.928 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:50.926+0000 7ffa23603180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:14:50.974 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:50.970+0000 7f4479e21180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:14:50.982 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:50.982+0000 7ffa23603180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:14:50.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dec08640 1 Processor -- start 2024-09-11T23:14:50.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dec08640 1 -- start start 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dec08640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d8145d90 0x7f46d80b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dec08640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46d806bcc0 0x7f46d806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dec08640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d80d1d80 con 0x7f46d80d1050 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dec08640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f46d806c640 con 0x7f46d806bcc0 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dec08640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46d80afa20 con 0x7f46d8145d90 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46d7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46d806bcc0 0x7f46d806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dc9a4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d8145d90 0x7f46d80b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46d7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46d806bcc0 0x7f46d806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56154/0 (socket says 172.21.15.155:56154) 2024-09-11T23:14:51.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46d7fff640 1 -- 172.21.15.155:0/3512389657 learned_addr learned my addr 172.21.15.155:0/3512389657 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:50.998+0000 7f46dc9a4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d8145d90 0x7f46d80b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59640/0 (socket says 172.21.15.155:59640) 2024-09-11T23:14:51.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d7fff640 1 -- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d8145d90 msgr2=0x7f46d80b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d7fff640 1 --2- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d8145d90 0x7f46d80b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d7fff640 1 -- 172.21.15.155:0/3512389657 >> v1:172.21.15.94:6789/0 conn(0x7f46d80d1050 legacy=0x7f46d80d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d7fff640 1 -- 172.21.15.155:0/3512389657 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d80afd00 con 0x7f46d806bcc0 2024-09-11T23:14:51.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dc9a4640 1 --2- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d8145d90 0x7f46d80b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:51.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d7fff640 1 --2- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d806bcc0 0x7f46d806c100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c001c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58785e34ab01bbab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d77fe640 1 -- 172.21.15.155:0/3512389657 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c00b2070 con 0x7f46d806bcc0 2024-09-11T23:14:51.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d77fe640 1 -- 172.21.15.155:0/3512389657 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c00ad640 con 0x7f46d806bcc0 2024-09-11T23:14:51.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46d77fe640 1 -- 172.21.15.155:0/3512389657 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c00ada10 con 0x7f46d806bcc0 2024-09-11T23:14:51.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 -- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d806bcc0 msgr2=0x7f46d806c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 --2- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d806bcc0 0x7f46d806c100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c001c520 comp rx=0 tx=0).stop 2024-09-11T23:14:51.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 -- 172.21.15.155:0/3512389657 shutdown_connections 2024-09-11T23:14:51.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 --2- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d806bcc0 0x7f46d806c100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 --2- 172.21.15.155:0/3512389657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d8145d90 0x7f46d80b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 -- 172.21.15.155:0/3512389657 >> 172.21.15.155:0/3512389657 conn(0x7f46d809aa00 msgr2=0x7f46d80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 -- 172.21.15.155:0/3512389657 shutdown_connections 2024-09-11T23:14:51.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.002+0000 7f46dec08640 1 -- 172.21.15.155:0/3512389657 wait complete. 2024-09-11T23:14:51.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 Processor -- start 2024-09-11T23:14:51.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 -- start start 2024-09-11T23:14:51.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46d806bcc0 0x7f46d8157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d80d1050 0x7f46d80cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d8145d90 0x7f46d80d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f46d80b4a20 con 0x7f46d806bcc0 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46d80b48a0 con 0x7f46d8145d90 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46d80b4ba0 con 0x7f46d80d1050 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d80d1050 0x7f46d80cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dd1a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d8145d90 0x7f46d80d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d80d1050 0x7f46d80cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59646/0 (socket says 172.21.15.155:59646) 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 -- 172.21.15.155:0/1972153023 learned_addr learned my addr 172.21.15.155:0/1972153023 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dd1a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d8145d90 0x7f46d80d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56168/0 (socket says 172.21.15.155:56168) 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dc9a4640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46d806bcc0 0x7f46d8157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 -- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d8145d90 msgr2=0x7f46d80d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d8145d90 0x7f46d80d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 -- 172.21.15.155:0/1972153023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46d806bcc0 msgr2=0x7f46d8157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46d806bcc0 0x7f46d8157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 -- 172.21.15.155:0/1972153023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d813c860 con 0x7f46d80d1050 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dd1a5640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d8145d90 0x7f46d80d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dc9a4640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46d806bcc0 0x7f46d8157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d7fff640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d80d1050 0x7f46d80cfb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f46c001abd0 tx=0x7f46c00192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d57fa640 1 -- 172.21.15.155:0/1972153023 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c00b2040 con 0x7f46d80d1050 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d57fa640 1 -- 172.21.15.155:0/1972153023 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c00bb070 con 0x7f46d80d1050 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d815c320 con 0x7f46d80d1050 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d57fa640 1 -- 172.21.15.155:0/1972153023 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c00b6680 con 0x7f46d80d1050 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d813cad0 con 0x7f46d80d1050 2024-09-11T23:14:51.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d57fa640 1 -- 172.21.15.155:0/1972153023 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f46c00b6820 con 0x7f46d80d1050 2024-09-11T23:14:51.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46d57fa640 1 -- 172.21.15.155:0/1972153023 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f46c00c0d00 con 0x7f46d80d1050 2024-09-11T23:14:51.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.006+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d806c100 con 0x7f46d80d1050 2024-09-11T23:14:51.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.010+0000 7f46d57fa640 1 -- 172.21.15.155:0/1972153023 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f46c0016110 con 0x7f46d80d1050 2024-09-11T23:14:51.028 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:51.022+0000 7f4479e21180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:14:51.063 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:51.062+0000 7ffa23603180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:14:51.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.074+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46dbd42d-19c6-4f0b-8d22-70e71a32c9a9", "id": 3} v 0) -- 0x7f46d80b0670 con 0x7f46d80d1050 2024-09-11T23:14:51.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.078+0000 7f46d57fa640 1 -- 172.21.15.155:0/1972153023 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46dbd42d-19c6-4f0b-8d22-70e71a32c9a9", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f46c00c0460 con 0x7f46d80d1050 2024-09-11T23:14:51.080 INFO:teuthology.orchestra.run.smithi155.stdout:3 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d80d1050 msgr2=0x7f46d80cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d80d1050 0x7f46d80cfb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f46c001abd0 tx=0x7f46c00192c0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 shutdown_connections 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d8145d90 0x7f46d80d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d80d1050 0x7f46d80cfb70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 --2- 172.21.15.155:0/1972153023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46d806bcc0 0x7f46d8157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 >> 172.21.15.155:0/1972153023 conn(0x7f46d809aa00 msgr2=0x7f46d80b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 shutdown_connections 2024-09-11T23:14:51.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.082+0000 7f46dec08640 1 -- 172.21.15.155:0/1972153023 wait complete. 2024-09-11T23:14:51.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 7eb655e3-c114-4a23-9b90-818729bc19f7 4 2024-09-11T23:14:51.102 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:51.098+0000 7f4479e21180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:14:51.117 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:51.118+0000 7ffa23603180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:14:51.154 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:51.150+0000 7f4479e21180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:14:51.197 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:51.198+0000 7ffa23603180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:14:51.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.222+0000 7f16fb2ab640 1 Processor -- start 2024-09-11T23:14:51.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.222+0000 7f16fb2ab640 1 -- start start 2024-09-11T23:14:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16fb2ab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16f4071ef0 0x7f16f4141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16fb2ab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141b50 0x7f16f40d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16fb2ab640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f4142300 con 0x7f16f4141230 2024-09-11T23:14:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16fb2ab640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f16f41425e0 con 0x7f16f4071ef0 2024-09-11T23:14:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16fb2ab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f16f40d1160 con 0x7f16f4141b50 2024-09-11T23:14:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16f4071ef0 0x7f16f4141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f9848640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141b50 0x7f16f40d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16f4071ef0 0x7f16f4141610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56178/0 (socket says 172.21.15.155:56178) 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f9848640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141b50 0x7f16f40d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59650/0 (socket says 172.21.15.155:59650) 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 -- 172.21.15.155:0/2895779121 learned_addr learned my addr 172.21.15.155:0/2895779121 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 -- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141b50 msgr2=0x7f16f40d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 --2- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141b50 0x7f16f40d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 -- 172.21.15.155:0/2895779121 >> v1:172.21.15.94:6789/0 conn(0x7f16f4141230 legacy=0x7f16f40717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 -- 172.21.15.155:0/2895779121 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f40d1440 con 0x7f16f4071ef0 2024-09-11T23:14:51.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f9848640 1 --2- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141b50 0x7f16f40d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:51.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16f8846640 1 --2- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 0x7f16f4141610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009870 tx=0x7f16e401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e16ca6dbc54dd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16ebfff640 1 -- 172.21.15.155:0/2895779121 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40b0070 con 0x7f16f4071ef0 2024-09-11T23:14:51.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16ebfff640 1 -- 172.21.15.155:0/2895779121 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e40ab600 con 0x7f16f4071ef0 2024-09-11T23:14:51.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.226+0000 7f16ebfff640 1 -- 172.21.15.155:0/2895779121 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40ab9d0 con 0x7f16f4071ef0 2024-09-11T23:14:51.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 msgr2=0x7f16f4141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 --2- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 0x7f16f4141610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009870 tx=0x7f16e401c520 comp rx=0 tx=0).stop 2024-09-11T23:14:51.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/2895779121 shutdown_connections 2024-09-11T23:14:51.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 --2- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141b50 0x7f16f40d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 --2- 172.21.15.155:0/2895779121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 0x7f16f4141610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/2895779121 >> 172.21.15.155:0/2895779121 conn(0x7f16f406c0c0 msgr2=0x7f16f406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/2895779121 shutdown_connections 2024-09-11T23:14:51.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/2895779121 wait complete. 2024-09-11T23:14:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 Processor -- start 2024-09-11T23:14:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- start start 2024-09-11T23:14:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 0x7f16f4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141230 0x7f16f4157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f4141b50 0x7f16f413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f16f40d2830 con 0x7f16f4141b50 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16f40d26b0 con 0x7f16f4071ef0 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f16f40d29b0 con 0x7f16f4141230 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141230 0x7f16f4157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f9047640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 0x7f16f4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141230 0x7f16f4157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59662/0 (socket says 172.21.15.155:59662) 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 -- 172.21.15.155:0/419238583 learned_addr learned my addr 172.21.15.155:0/419238583 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f9848640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f4141b50 0x7f16f413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 -- 172.21.15.155:0/419238583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 msgr2=0x7f16f4155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 0x7f16f4155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 -- 172.21.15.155:0/419238583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f4141b50 msgr2=0x7f16f413fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f4141b50 0x7f16f413fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 -- 172.21.15.155:0/419238583 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f4158500 con 0x7f16f4141230 2024-09-11T23:14:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f9848640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f4141b50 0x7f16f413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16f8846640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141230 0x7f16f4157fc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f16e40ae040 tx=0x7f16e40192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16e9ffb640 1 -- 172.21.15.155:0/419238583 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40ba070 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16e9ffb640 1 -- 172.21.15.155:0/419238583 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e40b4420 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f4156f20 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16e9ffb640 1 -- 172.21.15.155:0/419238583 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40b0040 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f41574e0 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16e9ffb640 1 -- 172.21.15.155:0/419238583 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f16e40bd070 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16e9ffb640 1 -- 172.21.15.155:0/419238583 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f16e40b38d0 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.230+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f4156270 con 0x7f16f4141230 2024-09-11T23:14:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.234+0000 7f16e9ffb640 1 -- 172.21.15.155:0/419238583 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f16e40d72d0 con 0x7f16f4141230 2024-09-11T23:14:51.252 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:51.250+0000 7ffa23603180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:14:51.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.298+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7eb655e3-c114-4a23-9b90-818729bc19f7", "id": 4} v 0) -- 0x7f16f4156690 con 0x7f16f4141230 2024-09-11T23:14:51.304 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:51.302+0000 7f4479e21180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:14:51.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16e9ffb640 1 -- 172.21.15.155:0/419238583 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7eb655e3-c114-4a23-9b90-818729bc19f7", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f16e40c5030 con 0x7f16f4141230 2024-09-11T23:14:51.305 INFO:teuthology.orchestra.run.smithi155.stdout:4 2024-09-11T23:14:51.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141230 msgr2=0x7f16f4157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141230 0x7f16f4157fc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f16e40ae040 tx=0x7f16e40192c0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 shutdown_connections 2024-09-11T23:14:51.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f4141b50 0x7f16f413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f4141230 0x7f16f4157fc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 --2- 172.21.15.155:0/419238583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f4071ef0 0x7f16f4155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 >> 172.21.15.155:0/419238583 conn(0x7f16f406c0c0 msgr2=0x7f16f406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 shutdown_connections 2024-09-11T23:14:51.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.306+0000 7f16fb2ab640 1 -- 172.21.15.155:0/419238583 wait complete. 2024-09-11T23:14:51.321 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new caa06254-1451-40cc-9657-e16d78ffbfb9 5 2024-09-11T23:14:51.366 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:51.362+0000 7f4479e21180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:14:51.411 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:51.410+0000 7ffa23603180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:14:51.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.438+0000 7fd5d83eb640 1 Processor -- start 2024-09-11T23:14:51.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.438+0000 7fd5d83eb640 1 -- start start 2024-09-11T23:14:51.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.438+0000 7fd5d83eb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd5d0144d60 0x7fd5d0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.438+0000 7fd5d83eb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4090 0x7fd5d00b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.438+0000 7fd5d83eb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d0071030 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.438+0000 7fd5d83eb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d0070660 con 0x7fd5d0144d60 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.438+0000 7fd5d83eb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d006fa50 con 0x7fd5d00b4090 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4090 0x7fd5d00b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4090 0x7fd5d00b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59666/0 (socket says 172.21.15.155:59666) 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 -- 172.21.15.155:0/3545009796 learned_addr learned my addr 172.21.15.155:0/3545009796 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d6187640 1 --2- 172.21.15.155:0/3545009796 >> v2:172.21.15.94:3300/0 conn(0x7fd5d0144d60 0x7fd5d0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 -- 172.21.15.155:0/3545009796 >> v2:172.21.15.94:3300/0 conn(0x7fd5d0144d60 msgr2=0x7fd5d0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 --2- 172.21.15.155:0/3545009796 >> v2:172.21.15.94:3300/0 conn(0x7fd5d0144d60 0x7fd5d0070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 -- 172.21.15.155:0/3545009796 >> v1:172.21.15.94:6789/0 conn(0x7fd5d00b4ba0 legacy=0x7fd5d00ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 -- 172.21.15.155:0/3545009796 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d006fd30 con 0x7fd5d00b4090 2024-09-11T23:14:51.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5986640 1 --2- 172.21.15.155:0/3545009796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4090 0x7fd5d00b44d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009870 tx=0x7fd5c001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb54a9f059a537b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5185640 1 -- 172.21.15.155:0/3545009796 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00ab650 con 0x7fd5d00b4090 2024-09-11T23:14:51.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5185640 1 -- 172.21.15.155:0/3545009796 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c00b0070 con 0x7fd5d00b4090 2024-09-11T23:14:51.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.442+0000 7fd5d5185640 1 -- 172.21.15.155:0/3545009796 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00aba10 con 0x7fd5d00b4090 2024-09-11T23:14:51.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- 172.21.15.155:0/3545009796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4090 msgr2=0x7fd5d00b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 --2- 172.21.15.155:0/3545009796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4090 0x7fd5d00b44d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009870 tx=0x7fd5c001c560 comp rx=0 tx=0).stop 2024-09-11T23:14:51.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- 172.21.15.155:0/3545009796 shutdown_connections 2024-09-11T23:14:51.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 --2- 172.21.15.155:0/3545009796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4090 0x7fd5d00b44d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 --2- 172.21.15.155:0/3545009796 >> v2:172.21.15.94:3300/0 conn(0x7fd5d0144d60 0x7fd5d0070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- 172.21.15.155:0/3545009796 >> 172.21.15.155:0/3545009796 conn(0x7fd5d009aa00 msgr2=0x7fd5d00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- 172.21.15.155:0/3545009796 shutdown_connections 2024-09-11T23:14:51.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- 172.21.15.155:0/3545009796 wait complete. 2024-09-11T23:14:51.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 Processor -- start 2024-09-11T23:14:51.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- start start 2024-09-11T23:14:51.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d00b4090 0x7fd5d013c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4ba0 0x7fd5d009bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d0144d60 0x7fd5d015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00b6fd0 con 0x7fd5d0144d60 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00b6e50 con 0x7fd5d00b4090 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d00af130 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4ba0 0x7fd5d009bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4ba0 0x7fd5d009bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59674/0 (socket says 172.21.15.155:59674) 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 -- 172.21.15.155:0/1770198789 learned_addr learned my addr 172.21.15.155:0/1770198789 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d6187640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d00b4090 0x7fd5d013c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d6988640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d0144d60 0x7fd5d015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 -- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d00b4090 msgr2=0x7fd5d013c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d00b4090 0x7fd5d013c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 -- 172.21.15.155:0/1770198789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d0144d60 msgr2=0x7fd5d015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d0144d60 0x7fd5d015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 -- 172.21.15.155:0/1770198789 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d009c8c0 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d6187640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d00b4090 0x7fd5d013c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d5986640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4ba0 0x7fd5d009bf50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5c001a190 tx=0x7fd5c001ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5c6ffd640 1 -- 172.21.15.155:0/1770198789 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00be5f0 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5c6ffd640 1 -- 172.21.15.155:0/1770198789 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c00be790 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5c6ffd640 1 -- 172.21.15.155:0/1770198789 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00beb80 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d009e2d0 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d013cc60 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5c6ffd640 1 -- 172.21.15.155:0/1770198789 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd5c00c7780 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.446+0000 7fd5c6ffd640 1 -- 172.21.15.155:0/1770198789 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd5c00b3380 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.450+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d00b44d0 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.450+0000 7fd5c6ffd640 1 -- 172.21.15.155:0/1770198789 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd5c0016150 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.484 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:51.482+0000 7ffa23603180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:14:51.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.526+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "caa06254-1451-40cc-9657-e16d78ffbfb9", "id": 5} v 0) -- 0x7fd5d009e9e0 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5c6ffd640 1 -- 172.21.15.155:0/1770198789 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "caa06254-1451-40cc-9657-e16d78ffbfb9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd5c00cd020 con 0x7fd5d00b4ba0 2024-09-11T23:14:51.531 INFO:teuthology.orchestra.run.smithi155.stdout:5 2024-09-11T23:14:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4ba0 msgr2=0x7fd5d009bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4ba0 0x7fd5d009bf50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5c001a190 tx=0x7fd5c001ada0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 shutdown_connections 2024-09-11T23:14:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d0144d60 0x7fd5d015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d00b4ba0 0x7fd5d009bf50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 --2- 172.21.15.155:0/1770198789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d00b4090 0x7fd5d013c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 >> 172.21.15.155:0/1770198789 conn(0x7fd5d009aa00 msgr2=0x7fd5d015b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 shutdown_connections 2024-09-11T23:14:51.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.530+0000 7fd5d83eb640 1 -- 172.21.15.155:0/1770198789 wait complete. 2024-09-11T23:14:51.548 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 87ee6c3d-c409-4458-9243-16c4ad202641 6 2024-09-11T23:14:51.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3967784640 1 Processor -- start 2024-09-11T23:14:51.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3967784640 1 -- start start 2024-09-11T23:14:51.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3967784640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f39600cf620 0x7f3960168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3967784640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39600d0300 con 0x7f3960161a60 2024-09-11T23:14:51.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3967784640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f396006e6c0 con 0x7f39600d3060 2024-09-11T23:14:51.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3967784640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f39600cfa90 con 0x7f39600cf620 2024-09-11T23:14:51.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3964d1f640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f39600d3060 0x7f39600cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46456/0 (socket says 172.21.15.155:46456) 2024-09-11T23:14:51.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3964d1f640 1 -- 172.21.15.155:0/4172543601 learned_addr learned my addr 172.21.15.155:0/4172543601 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f3965d21640 1 --2- 172.21.15.155:0/4172543601 >> v2:172.21.15.94:3300/0 conn(0x7f39600cf620 0x7f3960168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961592378 0 0) 0x7f396006e6c0 con 0x7f39600d3060 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3948003530 con 0x7f39600d3060 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3639063900 0 0) 0x7f3948003530 con 0x7f39600d3060 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 >> v2:172.21.15.94:3300/0 conn(0x7f39600cf620 msgr2=0x7f3960168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f395ffff640 1 --2- 172.21.15.155:0/4172543601 >> v2:172.21.15.94:3300/0 conn(0x7f39600cf620 0x7f3960168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 >> v1:172.21.15.94:6789/0 conn(0x7f3960161a60 legacy=0x7f39600d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.650+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39600b0f60 con 0x7f39600d3060 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f3954001680 con 0x7f39600d3060 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 >> v1:172.21.15.155:6789/0 conn(0x7f39600d3060 legacy=0x7f39600cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39480039c0 0x7f3948003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3948004810 0x7f3948004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39480051d0 0x7f394800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39600cfa90 con 0x7f39480039c0 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f394800c170 con 0x7f39480051d0 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f394800c370 con 0x7f3948004810 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39480051d0 0x7f394800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3964d1f640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3948004810 0x7f3948004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965520640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39480039c0 0x7f3948003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 -- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3948004810 msgr2=0x7f3948004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3948004810 0x7f3948004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 -- 172.21.15.155:0/4172543601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39480039c0 msgr2=0x7f3948003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39480039c0 0x7f3948003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 -- 172.21.15.155:0/4172543601 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3948003530 con 0x7f39480051d0 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 -- 172.21.15.155:0/4172543601 reap_dead start 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3965d21640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39480051d0 0x7f394800b9d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3958009fc0 tx=0x7f395801cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bbe98700d19be7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958009c10 con 0x7f39480051d0 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39580a5cc0 con 0x7f39480051d0 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f395ffff640 1 -- 172.21.15.155:0/4172543601 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958003be0 con 0x7f39480051d0 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3967784640 1 -- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39480051d0 msgr2=0x7f394800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3967784640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39480051d0 0x7f394800b9d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3958009fc0 tx=0x7f395801cc90 comp rx=0 tx=0).stop 2024-09-11T23:14:51.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3967784640 1 -- 172.21.15.155:0/4172543601 shutdown_connections 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3967784640 1 --2- 172.21.15.155:0/4172543601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39480051d0 0x7f394800b9d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3967784640 1 -- 172.21.15.155:0/4172543601 >> 172.21.15.155:0/4172543601 conn(0x7f396008bf90 msgr2=0x7f396009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3967784640 1 -- 172.21.15.155:0/4172543601 shutdown_connections 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.654+0000 7f3967784640 1 -- 172.21.15.155:0/4172543601 wait complete. 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 Processor -- start 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 -- start start 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39480051d0 0x7f396015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3960160f90 0x7f39601f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39600cbdc0 0x7f396015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39600cef10 con 0x7f3960160f90 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f396006d190 con 0x7f39600cbdc0 2024-09-11T23:14:51.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39600cf090 con 0x7f39480051d0 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965520640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39480051d0 0x7f396015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39600cbdc0 0x7f396015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965520640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39480051d0 0x7f396015a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59692/0 (socket says 172.21.15.155:59692) 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965520640 1 -- 172.21.15.155:0/1492008560 learned_addr learned my addr 172.21.15.155:0/1492008560 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39600cbdc0 0x7f396015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56204/0 (socket says 172.21.15.155:56204) 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3964d1f640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3960160f90 0x7f39601f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 -- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39480051d0 msgr2=0x7f396015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39480051d0 0x7f396015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 -- 172.21.15.155:0/1492008560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3960160f90 msgr2=0x7f39601f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3960160f90 0x7f39601f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 -- 172.21.15.155:0/1492008560 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39600d3e50 con 0x7f39600cbdc0 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965520640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39480051d0 0x7f396015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:14:51.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3965d21640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39600cbdc0 0x7f396015d3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f39600d5140 tx=0x7f3958009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f395dffb640 1 -- 172.21.15.155:0/1492008560 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958009c10 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f395dffb640 1 -- 172.21.15.155:0/1492008560 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39580bd070 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396015f190 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f395dffb640 1 -- 172.21.15.155:0/1492008560 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958003ba0 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396015f430 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f395dffb640 1 -- 172.21.15.155:0/1492008560 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39580ae920 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f395dffb640 1 -- 172.21.15.155:0/1492008560 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3958004580 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.658+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39600c7c40 con 0x7f39600cbdc0 2024-09-11T23:14:51.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.662+0000 7f395dffb640 1 -- 172.21.15.155:0/1492008560 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f39580169d0 con 0x7f39600cbdc0 2024-09-11T23:14:51.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.726+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "87ee6c3d-c409-4458-9243-16c4ad202641", "id": 6} v 0) -- 0x7f39600b1ee0 con 0x7f39600cbdc0 2024-09-11T23:14:51.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f395dffb640 1 -- 172.21.15.155:0/1492008560 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87ee6c3d-c409-4458-9243-16c4ad202641", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f39580047d0 con 0x7f39600cbdc0 2024-09-11T23:14:51.731 INFO:teuthology.orchestra.run.smithi155.stdout:6 2024-09-11T23:14:51.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39600cbdc0 msgr2=0x7f396015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39600cbdc0 0x7f396015d3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f39600d5140 tx=0x7f3958009750 comp rx=0 tx=0).stop 2024-09-11T23:14:51.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 shutdown_connections 2024-09-11T23:14:51.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39600cbdc0 0x7f396015d3b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3960160f90 0x7f39601f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 --2- 172.21.15.155:0/1492008560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39480051d0 0x7f396015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 >> 172.21.15.155:0/1492008560 conn(0x7f396008bf90 msgr2=0x7f39600b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 shutdown_connections 2024-09-11T23:14:51.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.730+0000 7f3967784640 1 -- 172.21.15.155:0/1492008560 wait complete. 2024-09-11T23:14:51.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new a69a4c99-90b4-40be-a860-49154adf0e51 7 2024-09-11T23:14:51.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.886+0000 7fb5c3a2d640 1 Processor -- start 2024-09-11T23:14:51.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.886+0000 7fb5c3a2d640 1 -- start start 2024-09-11T23:14:51.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c3a2d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb5bc15b170 0x7fb5bc09aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c3a2d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc0ae8b0 con 0x7fb5bc0af950 2024-09-11T23:14:51.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c3a2d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc0aeb90 con 0x7fb5bc0b0f00 2024-09-11T23:14:51.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c3a2d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb5bc0aee70 con 0x7fb5bc15b170 2024-09-11T23:14:51.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c1fca640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb5bc0b0f00 0x7fb5bc15ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46462/0 (socket says 172.21.15.155:46462) 2024-09-11T23:14:51.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c1fca640 1 -- 172.21.15.155:0/506091002 learned_addr learned my addr 172.21.15.155:0/506091002 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-09-11T23:14:51.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694817678 0 0) 0x7fb5bc0aeb90 con 0x7fb5bc0b0f00 2024-09-11T23:14:51.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c17c9640 1 --2- 172.21.15.155:0/506091002 >> v2:172.21.15.94:3300/0 conn(0x7fb5bc15b170 0x7fb5bc09aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5a8003530 con 0x7fb5bc0b0f00 2024-09-11T23:14:51.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3841931112 0 0) 0x7fb5a8003530 con 0x7fb5bc0b0f00 2024-09-11T23:14:51.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 >> v2:172.21.15.94:3300/0 conn(0x7fb5bc15b170 msgr2=0x7fb5bc09aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 --2- 172.21.15.155:0/506091002 >> v2:172.21.15.94:3300/0 conn(0x7fb5bc15b170 0x7fb5bc09aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 >> v1:172.21.15.94:6789/0 conn(0x7fb5bc0af950 legacy=0x7fb5bc0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc0af150 con 0x7fb5bc0b0f00 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fb5b4001680 con 0x7fb5bc0b0f00 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 >> v1:172.21.15.155:6789/0 conn(0x7fb5bc0b0f00 legacy=0x7fb5bc15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5a80039c0 0x7fb5a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5a8004810 0x7fb5a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a80051d0 0x7fb5a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0aee70 con 0x7fb5a80039c0 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a800c070 con 0x7fb5a80051d0 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a800c270 con 0x7fb5a8004810 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c0fc8640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5a8004810 0x7fb5a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c1fca640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a80051d0 0x7fb5a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c17c9640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5a80039c0 0x7fb5a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c0fc8640 1 -- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a80051d0 msgr2=0x7fb5a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c0fc8640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a80051d0 0x7fb5a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c0fc8640 1 -- 172.21.15.155:0/506091002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5a80039c0 msgr2=0x7fb5a8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c0fc8640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5a80039c0 0x7fb5a8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c0fc8640 1 -- 172.21.15.155:0/506091002 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a8003530 con 0x7fb5a8004810 2024-09-11T23:14:51.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c1fca640 1 -- 172.21.15.155:0/506091002 reap_dead start 2024-09-11T23:14:51.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5c0fc8640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5a8004810 0x7fb5a8004c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac001780 tx=0x7fb5ac01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fcd737c93a51f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0013a0 con 0x7fb5a8004810 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0052f0 con 0x7fb5a8004810 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.890+0000 7fb5b3fff640 1 -- 172.21.15.155:0/506091002 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0a4e60 con 0x7fb5a8004810 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5a8004810 msgr2=0x7fb5a8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5a8004810 0x7fb5a8004c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac001780 tx=0x7fb5ac01c3d0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/506091002 shutdown_connections 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 --2- 172.21.15.155:0/506091002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5a8004810 0x7fb5a8004c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/506091002 >> 172.21.15.155:0/506091002 conn(0x7fb5bc0b6800 msgr2=0x7fb5bc0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/506091002 shutdown_connections 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/506091002 wait complete. 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 Processor -- start 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- start start 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a8004810 0x7fb5bc1f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5bc1f1620 0x7fb5bc153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5bc153a50 0x7fb5bc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b07f0 con 0x7fb5bc1f1620 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc15b760 con 0x7fb5a8004810 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b0970 con 0x7fb5bc153a50 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a8004810 0x7fb5bc1f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a8004810 0x7fb5bc1f81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56220/0 (socket says 172.21.15.155:56220) 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 -- 172.21.15.155:0/3195989478 learned_addr learned my addr 172.21.15.155:0/3195989478 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c1fca640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5bc153a50 0x7fb5bc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c0fc8640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5bc1f1620 0x7fb5bc153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 -- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5bc153a50 msgr2=0x7fb5bc0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5bc153a50 0x7fb5bc0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 -- 172.21.15.155:0/3195989478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5bc1f1620 msgr2=0x7fb5bc153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5bc1f1620 0x7fb5bc153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 -- 172.21.15.155:0/3195989478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc1f76f0 con 0x7fb5a8004810 2024-09-11T23:14:51.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c17c9640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a8004810 0x7fb5bc1f81b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009fb0 tx=0x7fb5b80115a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5b1ffb640 1 -- 172.21.15.155:0/3195989478 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b801a020 con 0x7fb5a8004810 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5b1ffb640 1 -- 172.21.15.155:0/3195989478 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8016470 con 0x7fb5a8004810 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc153f80 con 0x7fb5a8004810 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5b1ffb640 1 -- 172.21.15.155:0/3195989478 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8016860 con 0x7fb5a8004810 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc1f79b0 con 0x7fb5a8004810 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5b1ffb640 1 -- 172.21.15.155:0/3195989478 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb5b801d020 con 0x7fb5a8004810 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5b1ffb640 1 -- 172.21.15.155:0/3195989478 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fb5b801fa60 con 0x7fb5a8004810 2024-09-11T23:14:51.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.894+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc0b0ca0 con 0x7fb5a8004810 2024-09-11T23:14:51.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.898+0000 7fb5b1ffb640 1 -- 172.21.15.155:0/3195989478 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb5b8024030 con 0x7fb5a8004810 2024-09-11T23:14:51.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.962+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a69a4c99-90b4-40be-a860-49154adf0e51", "id": 7} v 0) -- 0x7fb5bc06e7c0 con 0x7fb5a8004810 2024-09-11T23:14:51.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.970+0000 7fb5b1ffb640 1 -- 172.21.15.155:0/3195989478 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a69a4c99-90b4-40be-a860-49154adf0e51", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fb5b801f400 con 0x7fb5a8004810 2024-09-11T23:14:51.972 INFO:teuthology.orchestra.run.smithi155.stdout:7 2024-09-11T23:14:51.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a8004810 msgr2=0x7fb5bc1f81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a8004810 0x7fb5bc1f81b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009fb0 tx=0x7fb5b80115a0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 shutdown_connections 2024-09-11T23:14:51.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5bc153a50 0x7fb5bc0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5bc1f1620 0x7fb5bc153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 --2- 172.21.15.155:0/3195989478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a8004810 0x7fb5bc1f81b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 >> 172.21.15.155:0/3195989478 conn(0x7fb5bc0b6800 msgr2=0x7fb5bc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 shutdown_connections 2024-09-11T23:14:51.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:14:51.974+0000 7fb5c3a2d640 1 -- 172.21.15.155:0/3195989478 wait complete. 2024-09-11T23:14:51.988 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T23:14:51.989 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T23:14:51.991 INFO:tasks.ceph.osd.0:Started 2024-09-11T23:14:51.991 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T23:14:51.991 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T23:14:51.993 INFO:tasks.ceph.osd.1:Started 2024-09-11T23:14:51.994 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T23:14:51.994 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T23:14:51.996 INFO:tasks.ceph.osd.2:Started 2024-09-11T23:14:51.996 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T23:14:51.996 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T23:14:51.998 INFO:tasks.ceph.osd.3:Started 2024-09-11T23:14:51.999 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T23:14:51.999 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T23:14:52.001 INFO:tasks.ceph.osd.4:Started 2024-09-11T23:14:52.001 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T23:14:52.001 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T23:14:52.003 INFO:tasks.ceph.osd.5:Started 2024-09-11T23:14:52.003 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T23:14:52.003 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T23:14:52.005 INFO:tasks.ceph.osd.6:Started 2024-09-11T23:14:52.005 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T23:14:52.005 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T23:14:52.007 INFO:tasks.ceph.osd.7:Started 2024-09-11T23:14:52.007 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:14:52.050 INFO:tasks.ceph.mgr.y.smithi094.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:14:52.050 INFO:tasks.ceph.mgr.y.smithi094.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:14:52.050 INFO:tasks.ceph.mgr.y.smithi094.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:14:52.092 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:52.090+0000 7f4479e21180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:14:52.102 INFO:tasks.ceph.mgr.x.smithi155.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:14:52.102 INFO:tasks.ceph.mgr.x.smithi155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:14:52.103 INFO:tasks.ceph.mgr.x.smithi155.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:14:52.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.134+0000 7f9766893640 1 Processor -- start 2024-09-11T23:14:52.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.134+0000 7f9766893640 1 -- start start 2024-09-11T23:14:52.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9766893640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9760162a80 0x7f97600b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9766893640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f976015f400 0x7f97600b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9766893640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97600b5e20 con 0x7f976015e010 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9766893640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f97600b6100 con 0x7f976015f400 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9766893640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f976006d340 con 0x7f9760162a80 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f975ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f976015e010 0x7f976006de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:57400/0 (socket says 172.21.15.94:57400) 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f975ffff640 1 -- 172.21.15.94:0/481128395 learned_addr learned my addr 172.21.15.94:0/481128395 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9764e30640 1 --2- 172.21.15.94:0/481128395 >> v2:172.21.15.94:3300/0 conn(0x7f976015f400 0x7f97600b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:52.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f975f7fe640 1 --2- 172.21.15.94:0/481128395 >> v2:172.21.15.155:3300/0 conn(0x7f9760162a80 0x7f97600b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:52.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9764e30640 1 -- 172.21.15.94:0/481128395 >> v2:172.21.15.155:3300/0 conn(0x7f9760162a80 msgr2=0x7f97600b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:52.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9764e30640 1 --2- 172.21.15.94:0/481128395 >> v2:172.21.15.155:3300/0 conn(0x7f9760162a80 0x7f97600b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9764e30640 1 -- 172.21.15.94:0/481128395 >> v1:172.21.15.94:6789/0 conn(0x7f976015e010 legacy=0x7f976006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:52.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9764e30640 1 -- 172.21.15.94:0/481128395 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976006d620 con 0x7f976015f400 2024-09-11T23:14:52.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f9764e30640 1 --2- 172.21.15.94:0/481128395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f976015f400 0x7f97600b4330 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97600b71f0 tx=0x7f975801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8e3cde3e43e539 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:52.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f975effd640 1 -- 172.21.15.94:0/481128395 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97580b2070 con 0x7f976015f400 2024-09-11T23:14:52.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f975effd640 1 -- 172.21.15.94:0/481128395 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97580a5760 con 0x7f976015f400 2024-09-11T23:14:52.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.138+0000 7f975effd640 1 -- 172.21.15.94:0/481128395 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97580a5b30 con 0x7f976015f400 2024-09-11T23:14:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- 172.21.15.94:0/481128395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f976015f400 msgr2=0x7f97600b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 --2- 172.21.15.94:0/481128395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f976015f400 0x7f97600b4330 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97600b71f0 tx=0x7f975801c8a0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- 172.21.15.94:0/481128395 shutdown_connections 2024-09-11T23:14:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 --2- 172.21.15.94:0/481128395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f976015f400 0x7f97600b4330 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 --2- 172.21.15.94:0/481128395 >> v2:172.21.15.155:3300/0 conn(0x7f9760162a80 0x7f97600b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- 172.21.15.94:0/481128395 >> 172.21.15.94:0/481128395 conn(0x7f976006c0c0 msgr2=0x7f976006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- 172.21.15.94:0/481128395 shutdown_connections 2024-09-11T23:14:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- 172.21.15.94:0/481128395 wait complete. 2024-09-11T23:14:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 Processor -- start 2024-09-11T23:14:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- start start 2024-09-11T23:14:52.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f976015e010 0x7f976015abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976015f400 0x7f97601452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9760162a80 0x7f97600cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9760160530 con 0x7f9760162a80 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97601603b0 con 0x7f976015f400 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f976016afe0 con 0x7f976015e010 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9760162a80 0x7f97600cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9760162a80 0x7f97600cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58924/0 (socket says 172.21.15.94:58924) 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 -- 172.21.15.94:0/2358549138 learned_addr learned my addr 172.21.15.94:0/2358549138 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975ffff640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f976015e010 0x7f976015abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975f7fe640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976015f400 0x7f97601452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 -- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f976015e010 msgr2=0x7f976015abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:52.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f976015e010 0x7f976015abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 -- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976015f400 msgr2=0x7f97601452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976015f400 0x7f97601452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 -- 172.21.15.94:0/2358549138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9760159e00 con 0x7f9760162a80 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975f7fe640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976015f400 0x7f97601452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9764e30640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9760162a80 0x7f97600cde70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f97580194b0 tx=0x7f9758019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975cff9640 1 -- 172.21.15.94:0/2358549138 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97580b2050 con 0x7f9760162a80 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975cff9640 1 -- 172.21.15.94:0/2358549138 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97580be070 con 0x7f9760162a80 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976015a0e0 con 0x7f9760162a80 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975cff9640 1 -- 172.21.15.94:0/2358549138 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758009450 con 0x7f9760162a80 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9760148ad0 con 0x7f9760162a80 2024-09-11T23:14:52.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975cff9640 1 -- 172.21.15.94:0/2358549138 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f97580adc40 con 0x7f9760162a80 2024-09-11T23:14:52.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.142+0000 7f975cff9640 1 -- 172.21.15.94:0/2358549138 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f97580c3d20 con 0x7f9760162a80 2024-09-11T23:14:52.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.146+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976015eb50 con 0x7f9760162a80 2024-09-11T23:14:52.149 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:52.146+0000 7ffa23603180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:14:52.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.146+0000 7f975cff9640 1 -- 172.21.15.94:0/2358549138 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9758016520 con 0x7f9760162a80 2024-09-11T23:14:52.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f976015e870 con 0x7f9760162a80 2024-09-11T23:14:52.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f975cff9640 1 -- 172.21.15.94:0/2358549138 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f97580c3460 con 0x7f9760162a80 2024-09-11T23:14:52.208 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:14:52.208 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:14:51.967732+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9760162a80 msgr2=0x7f97600cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9760162a80 0x7f97600cde70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f97580194b0 tx=0x7f9758019640 comp rx=0 tx=0).stop 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 shutdown_connections 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9760162a80 0x7f97600cde70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976015f400 0x7f97601452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 --2- 172.21.15.94:0/2358549138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f976015e010 0x7f976015abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 >> 172.21.15.94:0/2358549138 conn(0x7f976006c0c0 msgr2=0x7f97601606b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 shutdown_connections 2024-09-11T23:14:52.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:14:52.206+0000 7f9766893640 1 -- 172.21.15.94:0/2358549138 wait complete. 2024-09-11T23:14:52.226 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T23:14:52.226 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T23:14:52.240 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:52.238+0000 7f4479e21180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:14:52.277 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:52.278+0000 7ffa23603180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:14:52.416 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:52.414+0000 7f4479e21180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:14:52.430 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:52.430+0000 7ffa23603180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:14:52.483 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:52.482+0000 7f4479e21180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:14:52.494 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:52.494+0000 7ffa23603180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:14:52.618 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:52.614+0000 7f4479e21180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:14:52.627 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:52.626+0000 7ffa23603180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:14:53.032 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:14:53.145 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 Processor -- start 2024-09-11T23:14:53.145 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 -- start start 2024-09-11T23:14:53.146 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7015e900 0x7ffa7015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:53.146 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa7015f220 0x7ffa7006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:53.146 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa7006c250 0x7ffa700b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:53.146 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ffa7006ca80 con 0x7ffa7006c250 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffa7006cd60 con 0x7ffa7015f220 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa76dc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7006d040 con 0x7ffa7015e900 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa7006c250 0x7ffa700b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa7006c250 0x7ffa700b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58932/0 (socket says 172.21.15.94:58932) 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 -- 172.21.15.94:0/1123501460 learned_addr learned my addr 172.21.15.94:0/1123501460 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa6ffff640 1 --2- 172.21.15.94:0/1123501460 >> v2:172.21.15.155:3300/0 conn(0x7ffa7015f220 0x7ffa7006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa74b61640 1 --2- 172.21.15.94:0/1123501460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7015e900 0x7ffa7015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 -- 172.21.15.94:0/1123501460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7015e900 msgr2=0x7ffa7015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 --2- 172.21.15.94:0/1123501460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7015e900 0x7ffa7015ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 -- 172.21.15.94:0/1123501460 >> v2:172.21.15.155:3300/0 conn(0x7ffa7015f220 msgr2=0x7ffa7006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 --2- 172.21.15.94:0/1123501460 >> v2:172.21.15.155:3300/0 conn(0x7ffa7015f220 0x7ffa7006bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa75362640 1 -- 172.21.15.94:0/1123501460 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7006d320 con 0x7ffa7006c250 2024-09-11T23:14:53.147 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.142+0000 7ffa6ffff640 1 --2- 172.21.15.94:0/1123501460 >> v2:172.21.15.155:3300/0 conn(0x7ffa7015f220 0x7ffa7006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:14:53.148 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa75362640 1 --2- 172.21.15.94:0/1123501460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7006c250 0x7ffa700b4340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa70067ce0 tx=0x7ffa6001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f00cf9d609111e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:53.148 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa6f7fe640 1 -- 172.21.15.94:0/1123501460 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa600a5810 con 0x7ffa7006c250 2024-09-11T23:14:53.149 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa6f7fe640 1 -- 172.21.15.94:0/1123501460 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa600a59b0 con 0x7ffa7006c250 2024-09-11T23:14:53.149 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa6f7fe640 1 -- 172.21.15.94:0/1123501460 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa600a5d80 con 0x7ffa7006c250 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 -- 172.21.15.94:0/1123501460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7006c250 msgr2=0x7ffa700b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/1123501460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7006c250 0x7ffa700b4340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa70067ce0 tx=0x7ffa6001c9f0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 -- 172.21.15.94:0/1123501460 shutdown_connections 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/1123501460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7006c250 0x7ffa700b4340 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/1123501460 >> v2:172.21.15.155:3300/0 conn(0x7ffa7015f220 0x7ffa7006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/1123501460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7015e900 0x7ffa7015ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 -- 172.21.15.94:0/1123501460 >> 172.21.15.94:0/1123501460 conn(0x7ffa700d0c60 msgr2=0x7ffa700d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 -- 172.21.15.94:0/1123501460 shutdown_connections 2024-09-11T23:14:53.150 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.146+0000 7ffa76dc5640 1 -- 172.21.15.94:0/1123501460 wait complete. 2024-09-11T23:14:53.151 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 Processor -- start 2024-09-11T23:14:53.152 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 -- start start 2024-09-11T23:14:53.154 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7006c250 0x7ffa7014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:53.154 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7015e900 0x7ffa70158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:53.154 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa7015f220 0x7ffa70156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffa700b5460 con 0x7ffa7015e900 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa700b52e0 con 0x7ffa7015f220 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa700b55e0 con 0x7ffa7006c250 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7015e900 0x7ffa70158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7015e900 0x7ffa70158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58942/0 (socket says 172.21.15.94:58942) 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 -- 172.21.15.94:0/3166329414 learned_addr learned my addr 172.21.15.94:0/3166329414 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa75362640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa7015f220 0x7ffa70156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa74b61640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7006c250 0x7ffa7014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 -- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7006c250 msgr2=0x7ffa7014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7006c250 0x7ffa7014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 -- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa7015f220 msgr2=0x7ffa70156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa7015f220 0x7ffa70156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.155 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 -- 172.21.15.94:0/3166329414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa700cd0a0 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6ffff640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7015e900 0x7ffa70158250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800d830 tx=0x7ffa5800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6d7fa640 1 -- 172.21.15.94:0/3166329414 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58018020 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6d7fa640 1 -- 172.21.15.94:0/3166329414 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa580096c0 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6d7fa640 1 -- 172.21.15.94:0/3166329414 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58009ab0 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa700cd380 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa70156750 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6d7fa640 1 -- 172.21.15.94:0/3166329414 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa5801b020 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa6d7fa640 1 -- 172.21.15.94:0/3166329414 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ffa580123e0 con 0x7ffa7015e900 2024-09-11T23:14:53.156 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.150+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7015ece0 con 0x7ffa7015e900 2024-09-11T23:14:53.157 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.154+0000 7ffa6d7fa640 1 -- 172.21.15.94:0/3166329414 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ffa58022020 con 0x7ffa7015e900 2024-09-11T23:14:53.175 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-11T23:14:53.174+0000 7fa4aa5d37c0 -1 Falling back to public interface 2024-09-11T23:14:53.214 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa700b5b90 con 0x7ffa7015e900 2024-09-11T23:14:53.215 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa6d7fa640 1 -- 172.21.15.94:0/3166329414 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ffa580149d0 con 0x7ffa7015e900 2024-09-11T23:14:53.216 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-11T23:14:53.216 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:14:51.967732+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7015e900 msgr2=0x7ffa70158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7015e900 0x7ffa70158250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800d830 tx=0x7ffa5800dcf0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 shutdown_connections 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa7015f220 0x7ffa70156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa7015e900 0x7ffa70158250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 --2- 172.21.15.94:0/3166329414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa7006c250 0x7ffa7014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 >> 172.21.15.94:0/3166329414 conn(0x7ffa700d0c60 msgr2=0x7ffa70151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 shutdown_connections 2024-09-11T23:14:53.217 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:14:53.214+0000 7ffa76dc5640 1 -- 172.21.15.94:0/3166329414 wait complete. 2024-09-11T23:14:53.231 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T23:14:53.234 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:53.234+0000 7ffa23603180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:14:53.238 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:53.234+0000 7f4479e21180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:14:53.309 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:53.310+0000 7ffa23603180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:14:53.314 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:53.310+0000 7f4479e21180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:14:53.343 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-11T23:14:53.342+0000 7f5ddcd3a7c0 -1 Falling back to public interface 2024-09-11T23:14:53.357 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-11T23:14:53.358+0000 7fd46f1917c0 -1 Falling back to public interface 2024-09-11T23:14:53.369 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-11T23:14:53.370+0000 7f669f3627c0 -1 Falling back to public interface 2024-09-11T23:14:53.370 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-11T23:14:53.370+0000 7f36b1ba27c0 -1 Falling back to public interface 2024-09-11T23:14:53.397 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-11T23:14:53.394+0000 7f08fc0ff7c0 -1 Falling back to public interface 2024-09-11T23:14:53.427 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-11T23:14:53.426+0000 7f028f0927c0 -1 Falling back to public interface 2024-09-11T23:14:53.496 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:53.494+0000 7ffa23603180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:14:53.498 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:53.494+0000 7f4479e21180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:14:53.569 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:53.570+0000 7ffa23603180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:14:53.571 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:53.570+0000 7f4479e21180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:14:53.680 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-11T23:14:53.678+0000 7f7569bd47c0 -1 Falling back to public interface 2024-09-11T23:14:53.861 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:53.862+0000 7ffa23603180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:14:53.861 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:53.858+0000 7f4479e21180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:14:53.922 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:53.922+0000 7ffa23603180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:14:53.922 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-11T23:14:53.918+0000 7f4479e21180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:14:54.975 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:54.974+0000 7ff9ca238640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T23:14:54.976 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-11T23:14:54.974+0000 7ff9ca238640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T23:14:57.243 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-11T23:14:57.242+0000 7fa4aa5d37c0 -1 osd.3 0 log_to_monitors true 2024-09-11T23:14:57.427 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-11T23:14:57.426+0000 7fd46f1917c0 -1 osd.6 0 log_to_monitors true 2024-09-11T23:14:57.428 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-11T23:14:57.426+0000 7f08fc0ff7c0 -1 osd.2 0 log_to_monitors true 2024-09-11T23:14:57.438 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-11T23:14:57.438+0000 7f36b1ba27c0 -1 osd.4 0 log_to_monitors true 2024-09-11T23:14:57.454 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-11T23:14:57.454+0000 7f669f3627c0 -1 osd.7 0 log_to_monitors true 2024-09-11T23:14:57.569 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-11T23:14:57.566+0000 7f028f0927c0 -1 osd.0 0 log_to_monitors true 2024-09-11T23:14:57.595 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-11T23:14:57.594+0000 7f5ddcd3a7c0 -1 osd.5 0 log_to_monitors true 2024-09-11T23:14:57.705 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-11T23:14:57.702+0000 7f7569bd47c0 -1 osd.1 0 log_to_monitors true 2024-09-11T23:15:00.039 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:00.181 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.178+0000 7f5cfa50e640 1 Processor -- start 2024-09-11T23:15:00.181 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.178+0000 7f5cfa50e640 1 -- start start 2024-09-11T23:15:00.200 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cfa50e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5cf414b2e0 0x7f5cf40b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:00.201 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cfa50e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5cf4166050 0x7f5cf41664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:00.201 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cfa50e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf406e490 0x7f5cf406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:00.201 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cfa50e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf40b5a60 con 0x7f5cf4166050 2024-09-11T23:15:00.201 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cfa50e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf40ccf90 con 0x7f5cf414b2e0 2024-09-11T23:15:00.201 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cfa50e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf406ede0 con 0x7f5cf406e490 2024-09-11T23:15:00.201 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5cf4166050 0x7f5cf41664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:00.202 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5cf4166050 0x7f5cf41664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53142/0 (socket says 172.21.15.94:53142) 2024-09-11T23:15:00.202 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 -- 172.21.15.94:0/160829583 learned_addr learned my addr 172.21.15.94:0/160829583 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:00.202 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf950c640 1 --2- 172.21.15.94:0/160829583 >> v2:172.21.15.155:3300/0 conn(0x7f5cf414b2e0 0x7f5cf40b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:00.202 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf9d0d640 1 --2- 172.21.15.94:0/160829583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf406e490 0x7f5cf406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:00.202 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 -- 172.21.15.94:0/160829583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf406e490 msgr2=0x7f5cf406e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:00.203 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 --2- 172.21.15.94:0/160829583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf406e490 0x7f5cf406e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.203 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 -- 172.21.15.94:0/160829583 >> v2:172.21.15.155:3300/0 conn(0x7f5cf414b2e0 msgr2=0x7f5cf40b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:00.203 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 --2- 172.21.15.94:0/160829583 >> v2:172.21.15.155:3300/0 conn(0x7f5cf414b2e0 0x7f5cf40b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.203 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.198+0000 7f5cf8d0b640 1 -- 172.21.15.94:0/160829583 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf4166bf0 con 0x7f5cf4166050 2024-09-11T23:15:00.204 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cf8d0b640 1 --2- 172.21.15.94:0/160829583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf4166050 0x7f5cf41664c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5cf406ef90 tx=0x7f5ce401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f53ce6970dc15f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:00.204 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cf3fff640 1 -- 172.21.15.94:0/160829583 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40a5740 con 0x7f5cf4166050 2024-09-11T23:15:00.204 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cf3fff640 1 -- 172.21.15.94:0/160829583 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce40a58e0 con 0x7f5cf4166050 2024-09-11T23:15:00.205 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 -- 172.21.15.94:0/160829583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf4166050 msgr2=0x7f5cf41664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:00.205 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/160829583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf4166050 0x7f5cf41664c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5cf406ef90 tx=0x7f5ce401c9d0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.205 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 -- 172.21.15.94:0/160829583 shutdown_connections 2024-09-11T23:15:00.205 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/160829583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf406e490 0x7f5cf406e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.205 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/160829583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf4166050 0x7f5cf41664c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.206 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/160829583 >> v2:172.21.15.155:3300/0 conn(0x7f5cf414b2e0 0x7f5cf40b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.206 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 -- 172.21.15.94:0/160829583 >> 172.21.15.94:0/160829583 conn(0x7f5cf4067b50 msgr2=0x7f5cf4067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:00.206 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 -- 172.21.15.94:0/160829583 shutdown_connections 2024-09-11T23:15:00.207 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.202+0000 7f5cfa50e640 1 -- 172.21.15.94:0/160829583 wait complete. 2024-09-11T23:15:00.207 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 Processor -- start 2024-09-11T23:15:00.209 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 -- start start 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf406e490 0x7f5cf4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf414b2e0 0x7f5cf415d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf4166050 0x7f5cf415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf414b840 con 0x7f5cf406e490 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf414b6c0 con 0x7f5cf414b2e0 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf40b4060 con 0x7f5cf4166050 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf406e490 0x7f5cf4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf406e490 0x7f5cf4140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53150/0 (socket says 172.21.15.94:53150) 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 -- 172.21.15.94:0/269729364 learned_addr learned my addr 172.21.15.94:0/269729364 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:00.210 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf8d0b640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf414b2e0 0x7f5cf415d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf9d0d640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf4166050 0x7f5cf415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 -- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf4166050 msgr2=0x7f5cf415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf4166050 0x7f5cf415d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 -- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf414b2e0 msgr2=0x7f5cf415d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf414b2e0 0x7f5cf415d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 -- 172.21.15.94:0/269729364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf4141330 con 0x7f5cf406e490 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf950c640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf406e490 0x7f5cf4140df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800e8a0 tx=0x7f5ce800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:00.211 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cf1ffb640 1 -- 172.21.15.94:0/269729364 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8017070 con 0x7f5cf406e490 2024-09-11T23:15:00.212 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf414a0c0 con 0x7f5cf406e490 2024-09-11T23:15:00.212 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf4146ad0 con 0x7f5cf406e490 2024-09-11T23:15:00.212 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.206+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf40b3b20 con 0x7f5cf406e490 2024-09-11T23:15:00.212 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.210+0000 7f5cf1ffb640 1 -- 172.21.15.94:0/269729364 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce800c940 con 0x7f5cf406e490 2024-09-11T23:15:00.212 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.210+0000 7f5cf1ffb640 1 -- 172.21.15.94:0/269729364 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800ccf0 con 0x7f5cf406e490 2024-09-11T23:15:00.214 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.210+0000 7f5cf1ffb640 1 -- 172.21.15.94:0/269729364 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f5ce801a070 con 0x7f5cf406e490 2024-09-11T23:15:00.214 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.210+0000 7f5cf1ffb640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5ce0067830 0x7f5ce0069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:00.215 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.214+0000 7f5cf1ffb640 1 -- 172.21.15.94:0/269729364 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f5ce8084fe0 con 0x7f5cf406e490 2024-09-11T23:15:00.215 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.214+0000 7f5cf8d0b640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5ce0067830 0x7f5ce0069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:00.215 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.214+0000 7f5cf8d0b640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5ce0067830 0x7f5ce0069cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40ae000 tx=0x7f5ce40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:00.222 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.218+0000 7f5cf1ffb640 1 -- 172.21.15.94:0/269729364 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5ce8056980 con 0x7f5cf406e490 2024-09-11T23:15:00.515 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-11T23:15:00.514+0000 7f08f80a8640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T23:15:00.528 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.526+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cf40b1db0 con 0x7f5cf406e490 2024-09-11T23:15:00.529 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.526+0000 7f5cf1ffb640 1 -- 172.21.15.94:0/269729364 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f5ce8056280 con 0x7f5cf406e490 2024-09-11T23:15:00.529 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-11T23:15:00.529 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":12,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:14:58.968385+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:00.532 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5ce0067830 msgr2=0x7f5ce0069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:00.532 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5ce0067830 0x7f5ce0069cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40ae000 tx=0x7f5ce40a7070 comp rx=0 tx=0).stop 2024-09-11T23:15:00.532 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf406e490 msgr2=0x7f5cf4140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:00.532 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf406e490 0x7f5cf4140df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800e8a0 tx=0x7f5ce800eca0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 shutdown_connections 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf4166050 0x7f5cf415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf414b2e0 0x7f5cf415d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5ce0067830 0x7f5ce0069cf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 --2- 172.21.15.94:0/269729364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf406e490 0x7f5cf4140df0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 >> 172.21.15.94:0/269729364 conn(0x7f5cf4067b50 msgr2=0x7f5cf41480a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 shutdown_connections 2024-09-11T23:15:00.533 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:00.530+0000 7f5cfa50e640 1 -- 172.21.15.94:0/269729364 wait complete. 2024-09-11T23:15:00.543 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-11T23:15:00.542+0000 7f028b84d640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T23:15:00.555 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T23:15:00.555 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-11T23:15:00.554+0000 7f08efedd640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:00.587 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-11T23:15:00.586+0000 7f0282e70640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:00.649 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-11T23:15:00.646+0000 7fa4a657c640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T23:15:00.667 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-11T23:15:00.666+0000 7fa49e3b1640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:00.706 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-11T23:15:00.702+0000 7f756638f640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T23:15:00.732 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-11T23:15:00.730+0000 7f755d9b2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:01.167 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-11T23:15:01.166+0000 7f669b30b640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T23:15:01.171 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-11T23:15:01.170+0000 7f5dd8ce3640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T23:15:01.198 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-11T23:15:01.198+0000 7f6693140640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:01.209 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-11T23:15:01.206+0000 7fd46b13a640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T23:15:01.214 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-11T23:15:01.214+0000 7f5dd0b18640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:01.236 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-11T23:15:01.234+0000 7f36adb4b640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T23:15:01.237 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-11T23:15:01.238+0000 7fd462f6f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:01.269 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-11T23:15:01.270+0000 7f36a5980640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:07.362 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:07.485 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c30386640 1 Processor -- start 2024-09-11T23:15:07.485 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c30386640 1 -- start start 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c30386640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6c2815c010 0x7f6c280ad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c30386640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2815c3f0 0x7f6c280b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c30386640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c28074070 con 0x7f6c280b4770 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c30386640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6c280cf9a0 con 0x7f6c2815c010 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c30386640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280ced90 con 0x7f6c2815c3f0 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2e122640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6c2815c010 0x7f6c280ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2e122640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6c2815c010 0x7f6c280ad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53158/0 (socket says 172.21.15.94:53158) 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2e122640 1 -- 172.21.15.94:0/4125953416 learned_addr learned my addr 172.21.15.94:0/4125953416 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2d921640 1 --2- 172.21.15.94:0/4125953416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2815c3f0 0x7f6c280b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2e122640 1 -- 172.21.15.94:0/4125953416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2815c3f0 msgr2=0x7f6c280b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2e122640 1 --2- 172.21.15.94:0/4125953416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2815c3f0 0x7f6c280b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.487 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2e122640 1 -- 172.21.15.94:0/4125953416 >> v1:172.21.15.155:6789/0 conn(0x7f6c280b4770 legacy=0x7f6c2815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:07.488 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.486+0000 7f6c2e122640 1 -- 172.21.15.94:0/4125953416 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c280cf070 con 0x7f6c2815c010 2024-09-11T23:15:07.490 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c2e122640 1 --2- 172.21.15.94:0/4125953416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c010 0x7f6c280ad030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009870 tx=0x7f6c2401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5c9895dedb4a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:07.490 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c2d120640 1 -- 172.21.15.94:0/4125953416 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240aa660 con 0x7f6c2815c010 2024-09-11T23:15:07.490 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c2d120640 1 -- 172.21.15.94:0/4125953416 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c240af070 con 0x7f6c2815c010 2024-09-11T23:15:07.490 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c2d120640 1 -- 172.21.15.94:0/4125953416 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240aaa20 con 0x7f6c2815c010 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 -- 172.21.15.94:0/4125953416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c010 msgr2=0x7f6c280ad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 --2- 172.21.15.94:0/4125953416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c010 0x7f6c280ad030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009870 tx=0x7f6c2401c520 comp rx=0 tx=0).stop 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 -- 172.21.15.94:0/4125953416 shutdown_connections 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 --2- 172.21.15.94:0/4125953416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2815c3f0 0x7f6c280b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 --2- 172.21.15.94:0/4125953416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c010 0x7f6c280ad030 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 -- 172.21.15.94:0/4125953416 >> 172.21.15.94:0/4125953416 conn(0x7f6c2806bbc0 msgr2=0x7f6c2806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 -- 172.21.15.94:0/4125953416 shutdown_connections 2024-09-11T23:15:07.491 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.490+0000 7f6c30386640 1 -- 172.21.15.94:0/4125953416 wait complete. 2024-09-11T23:15:07.492 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 Processor -- start 2024-09-11T23:15:07.492 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 -- start start 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c280b4770 0x7f6c28154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2815c010 0x7f6c281557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c3f0 0x7f6c2809a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280d0640 con 0x7f6c2815c3f0 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c281606d0 con 0x7f6c2815c010 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280d07c0 con 0x7f6c280b4770 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c3f0 0x7f6c2809a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c3f0 0x7f6c2809a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53166/0 (socket says 172.21.15.94:53166) 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 -- 172.21.15.94:0/1604529598 learned_addr learned my addr 172.21.15.94:0/1604529598 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2d921640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2815c010 0x7f6c281557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.494 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e122640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c280b4770 0x7f6c28154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 -- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c280b4770 msgr2=0x7f6c28154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c280b4770 0x7f6c28154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 -- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2815c010 msgr2=0x7f6c281557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2815c010 0x7f6c281557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 -- 172.21.15.94:0/1604529598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28155e40 con 0x7f6c2815c3f0 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2d921640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2815c010 0x7f6c281557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c2e923640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c3f0 0x7f6c2809a140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000c780 tx=0x7f6c2000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c1effd640 1 -- 172.21.15.94:0/1604529598 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20004b70 con 0x7f6c2815c3f0 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c1effd640 1 -- 172.21.15.94:0/1604529598 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20004d10 con 0x7f6c2815c3f0 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c28153fd0 con 0x7f6c2815c3f0 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c1effd640 1 -- 172.21.15.94:0/1604529598 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000aa90 con 0x7f6c2815c3f0 2024-09-11T23:15:07.495 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c28154590 con 0x7f6c2815c3f0 2024-09-11T23:15:07.496 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c280ad030 con 0x7f6c2815c3f0 2024-09-11T23:15:07.496 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.494+0000 7f6c1effd640 1 -- 172.21.15.94:0/1604529598 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c2000ac30 con 0x7f6c2815c3f0 2024-09-11T23:15:07.496 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.498+0000 7f6c1effd640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c0c0678c0 0x7f6c0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.496 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.498+0000 7f6c1effd640 1 -- 172.21.15.94:0/1604529598 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6c20085b50 con 0x7f6c2815c3f0 2024-09-11T23:15:07.497 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.498+0000 7f6c2e122640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c0c0678c0 0x7f6c0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.497 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.498+0000 7f6c2e122640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c0c0678c0 0x7f6c0c069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c240ae000 tx=0x7f6c24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:07.500 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.502+0000 7f6c1effd640 1 -- 172.21.15.94:0/1604529598 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c20020070 con 0x7f6c2815c3f0 2024-09-11T23:15:07.666 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.666+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c280ad9d0 con 0x7f6c2815c3f0 2024-09-11T23:15:07.666 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.666+0000 7f6c1effd640 1 -- 172.21.15.94:0/1604529598 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f6c20056a70 con 0x7f6c2815c3f0 2024-09-11T23:15:07.667 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-11T23:15:07.667 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":16,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:04.558961+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:07.669 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c0c0678c0 msgr2=0x7f6c0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c0c0678c0 0x7f6c0c069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c240ae000 tx=0x7f6c24008040 comp rx=0 tx=0).stop 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c3f0 msgr2=0x7f6c2809a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c3f0 0x7f6c2809a140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000c780 tx=0x7f6c2000cc40 comp rx=0 tx=0).stop 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 shutdown_connections 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c0c0678c0 0x7f6c0c069d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2815c3f0 0x7f6c2809a140 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2815c010 0x7f6c281557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 --2- 172.21.15.94:0/1604529598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c280b4770 0x7f6c28154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 >> 172.21.15.94:0/1604529598 conn(0x7f6c2806bbc0 msgr2=0x7f6c2815dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 shutdown_connections 2024-09-11T23:15:07.670 INFO:teuthology.misc.health.smithi094.stderr:2024-09-11T23:15:07.670+0000 7f6c30386640 1 -- 172.21.15.94:0/1604529598 wait complete. 2024-09-11T23:15:07.685 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T23:15:07.685 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T23:15:07.685 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:15:07.685 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:15:07.687 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:15:07.687 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:15:07.688 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:15:07.689 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:15:07.689 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:15:07.690 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:15:07.692 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:15:07.692 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:15:07.693 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:15:07.695 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:15:07.695 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T23:15:07.696 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:07.773 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:15:07.774 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:15:07.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.810+0000 7f90ab8e9640 1 Processor -- start 2024-09-11T23:15:07.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.810+0000 7f90ab8e9640 1 -- start start 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.810+0000 7f90ab8e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a409aa00 0x7f90a40b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90ab8e9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90a40b0d30 0x7f90a415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90ab8e9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90a409ae60 con 0x7f90a415b170 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90ab8e9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f90a40b11e0 con 0x7f90a40b0d30 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90ab8e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f90a40ae8b0 con 0x7f90a409aa00 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a9e86640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90a40b0d30 0x7f90a415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a8e84640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a409aa00 0x7f90a40b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a9685640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f90a415b170 0x7f90a40af950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:49604/0 (socket says 172.21.15.94:49604) 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a9685640 1 -- 172.21.15.94:0/1123376768 learned_addr learned my addr 172.21.15.94:0/1123376768 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:07.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f909bfff640 1 -- 172.21.15.94:0/1123376768 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400657873 0 0) 0x7f90a409ae60 con 0x7f90a415b170 2024-09-11T23:15:07.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a8e84640 1 -- 172.21.15.94:0/1123376768 >> v2:172.21.15.155:3300/0 conn(0x7f90a40b0d30 msgr2=0x7f90a415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:07.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a8e84640 1 --2- 172.21.15.94:0/1123376768 >> v2:172.21.15.155:3300/0 conn(0x7f90a40b0d30 0x7f90a415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a8e84640 1 -- 172.21.15.94:0/1123376768 >> v1:172.21.15.155:6789/0 conn(0x7f90a415b170 legacy=0x7f90a40af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a8e84640 1 -- 172.21.15.94:0/1123376768 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a40aeb90 con 0x7f90a409aa00 2024-09-11T23:15:07.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f90a8e84640 1 --2- 172.21.15.94:0/1123376768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a409aa00 0x7f90a40b07f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f90940097c0 tx=0x7f909401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637059a33c5a005c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:07.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f909bfff640 1 -- 172.21.15.94:0/1123376768 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90940a7070 con 0x7f90a409aa00 2024-09-11T23:15:07.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f909bfff640 1 -- 172.21.15.94:0/1123376768 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90940b0070 con 0x7f90a409aa00 2024-09-11T23:15:07.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.814+0000 7f909bfff640 1 -- 172.21.15.94:0/1123376768 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90940ab890 con 0x7f90a409aa00 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- 172.21.15.94:0/1123376768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a409aa00 msgr2=0x7f90a40b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/1123376768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a409aa00 0x7f90a40b07f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f90940097c0 tx=0x7f909401c470 comp rx=0 tx=0).stop 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- 172.21.15.94:0/1123376768 shutdown_connections 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/1123376768 >> v2:172.21.15.155:3300/0 conn(0x7f90a40b0d30 0x7f90a415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/1123376768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a409aa00 0x7f90a40b07f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- 172.21.15.94:0/1123376768 >> 172.21.15.94:0/1123376768 conn(0x7f90a40b6800 msgr2=0x7f90a40b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- 172.21.15.94:0/1123376768 shutdown_connections 2024-09-11T23:15:07.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- 172.21.15.94:0/1123376768 wait complete. 2024-09-11T23:15:07.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 Processor -- start 2024-09-11T23:15:07.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- start start 2024-09-11T23:15:07.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a409aa00 0x7f90a4145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a40b0d30 0x7f90a41f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a415b170 0x7f90a41f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f90a415b550 con 0x7f90a409aa00 2024-09-11T23:15:07.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f90a40b0060 con 0x7f90a415b170 2024-09-11T23:15:07.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90ab8e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f90a415b6d0 con 0x7f90a40b0d30 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a409aa00 0x7f90a4145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a409aa00 0x7f90a4145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53178/0 (socket says 172.21.15.94:53178) 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a8e84640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a40b0d30 0x7f90a41f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 -- 172.21.15.94:0/375813661 learned_addr learned my addr 172.21.15.94:0/375813661 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9e86640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a415b170 0x7f90a41f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 -- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a40b0d30 msgr2=0x7f90a41f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a40b0d30 0x7f90a41f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 -- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a415b170 msgr2=0x7f90a41f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a415b170 0x7f90a41f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 -- 172.21.15.94:0/375813661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a415e7e0 con 0x7f90a409aa00 2024-09-11T23:15:07.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.818+0000 7f90a9685640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a409aa00 0x7f90a4145bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90a000e800 tx=0x7f90a000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:07.841 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:15:07.843 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:15:07.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.882+0000 7f9099ffb640 1 -- 172.21.15.94:0/375813661 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a001a070 con 0x7f90a409aa00 2024-09-11T23:15:07.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.882+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a414e570 con 0x7f90a409aa00 2024-09-11T23:15:07.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.882+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a414eb30 con 0x7f90a409aa00 2024-09-11T23:15:07.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.882+0000 7f9099ffb640 1 -- 172.21.15.94:0/375813661 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a0006c90 con 0x7f90a409aa00 2024-09-11T23:15:07.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.882+0000 7f9099ffb640 1 -- 172.21.15.94:0/375813661 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a000c840 con 0x7f90a409aa00 2024-09-11T23:15:07.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.886+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90840052a0 con 0x7f90a409aa00 2024-09-11T23:15:07.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.886+0000 7f9099ffb640 1 -- 172.21.15.94:0/375813661 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90a001d070 con 0x7f90a409aa00 2024-09-11T23:15:07.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.886+0000 7f9099ffb640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f90880678c0 0x7f9088069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:07.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.886+0000 7f9099ffb640 1 -- 172.21.15.94:0/375813661 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f90a0086e90 con 0x7f90a409aa00 2024-09-11T23:15:07.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.886+0000 7f90a8e84640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f90880678c0 0x7f9088069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:07.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.886+0000 7f90a8e84640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f90880678c0 0x7f9088069d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90940af000 tx=0x7f90940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:07.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:07.890+0000 7f9099ffb640 1 -- 172.21.15.94:0/375813661 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f90a00576d0 con 0x7f90a409aa00 2024-09-11T23:15:08.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.090+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9084005860 con 0x7f90a409aa00 2024-09-11T23:15:08.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.090+0000 7f9099ffb640 1 -- 172.21.15.94:0/375813661 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f90a005b9d0 con 0x7f90a409aa00 2024-09-11T23:15:08.089 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:08.090 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":2,"btime":"2024-09-11T23:15:07:884359+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:15:08.090 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 2 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f90880678c0 msgr2=0x7f9088069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f90880678c0 0x7f9088069d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90940af000 tx=0x7f90940a7000 comp rx=0 tx=0).stop 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a409aa00 msgr2=0x7f90a4145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a409aa00 0x7f90a4145bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90a000e800 tx=0x7f90a000ecc0 comp rx=0 tx=0).stop 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 shutdown_connections 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a415b170 0x7f90a41f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90a40b0d30 0x7f90a41f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f90880678c0 0x7f9088069d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 --2- 172.21.15.94:0/375813661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a409aa00 0x7f90a4145bf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 >> 172.21.15.94:0/375813661 conn(0x7f90a40b6800 msgr2=0x7f90a40b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 shutdown_connections 2024-09-11T23:15:08.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:08.094+0000 7f90ab8e9640 1 -- 172.21.15.94:0/375813661 wait complete. 2024-09-11T23:15:10.108 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:10.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.237+0000 7f6fb9bc7640 1 Processor -- start 2024-09-11T23:15:10.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.237+0000 7f6fb9bc7640 1 -- start start 2024-09-11T23:15:10.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb9bc7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 0x7f6fb40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb9bc7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb40d32b0 con 0x7f6fb40cf620 2024-09-11T23:15:10.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb9bc7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb40cfad0 con 0x7f6fb40d2e90 2024-09-11T23:15:10.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb9bc7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb40d0300 con 0x7f6fb4161a60 2024-09-11T23:15:10.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb3fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6fb40cf620 0x7f6fb406d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52054/0 (socket says 172.21.15.94:52054) 2024-09-11T23:15:10.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb3fff640 1 -- 172.21.15.94:0/2752792199 learned_addr learned my addr 172.21.15.94:0/2752792199 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:10.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb37fe640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 0x7f6fb40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088000907 0 0) 0x7f6fb40d32b0 con 0x7f6fb40cf620 2024-09-11T23:15:10.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9c003530 con 0x7f6fb40cf620 2024-09-11T23:15:10.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4051908149 0 0) 0x7f6f9c003530 con 0x7f6fb40cf620 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 msgr2=0x7f6fb40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 0x7f6fb40d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 >> v1:172.21.15.155:6789/0 conn(0x7f6fb40d2e90 legacy=0x7f6fb40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb40b0f60 con 0x7f6fb40cf620 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f6fac001a00 con 0x7f6fb40cf620 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 >> v1:172.21.15.94:6789/0 conn(0x7f6fb40cf620 legacy=0x7f6fb406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 0x7f6f9c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f9c003f70 0x7f6f9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c004d50 0x7f6f9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb40d0300 con 0x7f6f9c003f70 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c00bb60 con 0x7f6f9c004d50 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c00bd60 con 0x7f6fb4161a60 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb2ffd640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f9c003f70 0x7f6f9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb37fe640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 0x7f6f9c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb2ffd640 1 -- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 msgr2=0x7f6f9c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb2ffd640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb4161a60 0x7f6f9c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb2ffd640 1 -- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c004d50 msgr2=0x7f6f9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb2ffd640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c004d50 0x7f6f9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.241+0000 7f6fb2ffd640 1 -- 172.21.15.94:0/2752792199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c003530 con 0x7f6f9c003f70 2024-09-11T23:15:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f9c003f70 0x7f6f9c004810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8001750 tx=0x7f6fa801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54de0e1c2996e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80013a0 con 0x7f6f9c003f70 2024-09-11T23:15:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa80052f0 con 0x7f6f9c003f70 2024-09-11T23:15:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb27fc640 1 -- 172.21.15.94:0/2752792199 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8003840 con 0x7f6f9c003f70 2024-09-11T23:15:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/2752792199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f9c003f70 msgr2=0x7f6f9c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 --2- 172.21.15.94:0/2752792199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f9c003f70 0x7f6f9c004810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8001750 tx=0x7f6fa801c3b0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb3fff640 1 -- 172.21.15.94:0/2752792199 reap_dead start 2024-09-11T23:15:10.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/2752792199 shutdown_connections 2024-09-11T23:15:10.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/2752792199 >> 172.21.15.94:0/2752792199 conn(0x7f6fb408bf90 msgr2=0x7f6fb409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:10.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/2752792199 shutdown_connections 2024-09-11T23:15:10.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/2752792199 wait complete. 2024-09-11T23:15:10.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 Processor -- start 2024-09-11T23:15:10.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- start start 2024-09-11T23:15:10.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c003f70 0x7f6fb40b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fb4154740 0x7f6fb40b9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb415b0c0 0x7f6fb415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb4169f20 con 0x7f6fb4154740 2024-09-11T23:15:10.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb406d190 con 0x7f6f9c003f70 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb9bc7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb416a0a0 con 0x7f6fb415b0c0 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fb4154740 0x7f6fb40b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fb4154740 0x7f6fb40b9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38562/0 (socket says 172.21.15.94:38562) 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 -- 172.21.15.94:0/321500822 learned_addr learned my addr 172.21.15.94:0/321500822 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb37fe640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c003f70 0x7f6fb40b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb3fff640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb415b0c0 0x7f6fb415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 -- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb415b0c0 msgr2=0x7f6fb415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb415b0c0 0x7f6fb415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 -- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c003f70 msgr2=0x7f6fb40b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c003f70 0x7f6fb40b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 -- 172.21.15.94:0/321500822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb40b7da0 con 0x7f6fb4154740 2024-09-11T23:15:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb3fff640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb415b0c0 0x7f6fb415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb37fe640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c003f70 0x7f6fb40b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6fb2ffd640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fb4154740 0x7f6fb40b9240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80ad040 tx=0x7f6f9c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.245+0000 7f6f9bfff640 1 -- 172.21.15.94:0/321500822 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80ba070 con 0x7f6fb4154740 2024-09-11T23:15:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6f9bfff640 1 -- 172.21.15.94:0/321500822 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8000ee0 con 0x7f6fb4154740 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb40b9ab0 con 0x7f6fb4154740 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6f9bfff640 1 -- 172.21.15.94:0/321500822 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8007a40 con 0x7f6fb4154740 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb40ba070 con 0x7f6fb4154740 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb406d6b0 con 0x7f6fb4154740 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6f9bfff640 1 -- 172.21.15.94:0/321500822 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fa80bd070 con 0x7f6fb4154740 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6f9bfff640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6fa00678c0 0x7f6fa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6f9bfff640 1 -- 172.21.15.94:0/321500822 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6fa811ff50 con 0x7f6fb4154740 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6fb37fe640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6fa00678c0 0x7f6fa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.249+0000 7f6fb37fe640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6fa00678c0 0x7f6fa0069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009a20 tx=0x7f6fa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.253+0000 7f6f9bfff640 1 -- 172.21.15.94:0/321500822 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6fa80160f0 con 0x7f6fb4154740 2024-09-11T23:15:10.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.449+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fb415f860 con 0x7f6fb4154740 2024-09-11T23:15:10.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.449+0000 7f6f9bfff640 1 -- 172.21.15.94:0/321500822 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7f6fa80f0e70 con 0x7f6fb4154740 2024-09-11T23:15:10.450 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:10.450 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":3,"btime":"2024-09-11T23:15:08:886498+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T23:15:10.451 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 3 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6fa00678c0 msgr2=0x7f6fa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6fa00678c0 0x7f6fa0069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009a20 tx=0x7f6fa4008040 comp rx=0 tx=0).stop 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fb4154740 msgr2=0x7f6fb40b9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fb4154740 0x7f6fb40b9240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80ad040 tx=0x7f6f9c005840 comp rx=0 tx=0).stop 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 shutdown_connections 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fb415b0c0 0x7f6fb415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6fa00678c0 0x7f6fa0069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fb4154740 0x7f6fb40b9240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 --2- 172.21.15.94:0/321500822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c003f70 0x7f6fb40b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 >> 172.21.15.94:0/321500822 conn(0x7f6fb408bf90 msgr2=0x7f6fb40d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:10.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 shutdown_connections 2024-09-11T23:15:10.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.453+0000 7f6fb9bc7640 1 -- 172.21.15.94:0/321500822 wait complete. 2024-09-11T23:15:10.472 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:15:10.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d9a09640 1 Processor -- start 2024-09-11T23:15:10.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d9a09640 1 -- start start 2024-09-11T23:15:10.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d9a09640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 0x7f92d415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d9a09640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f92d415d290 0x7f92d415e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d9a09640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d415fc10 con 0x7f92d415f830 2024-09-11T23:15:10.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d9a09640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f92d415da40 con 0x7f92d415d290 2024-09-11T23:15:10.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d9a09640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92d415d800 con 0x7f92d406c3d0 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d2ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f92d415f830 0x7f92d406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52056/0 (socket says 172.21.15.94:52056) 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d2ffd640 1 -- 172.21.15.94:0/3366449888 learned_addr learned my addr 172.21.15.94:0/3366449888 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d37fe640 1 --2- 172.21.15.94:0/3366449888 >> v2:172.21.15.155:3300/0 conn(0x7f92d415d290 0x7f92d415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d27fc640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 0x7f92d415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594846055 0 0) 0x7f92d415fc10 con 0x7f92d415f830 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92bc003530 con 0x7f92d415f830 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2549681788 0 0) 0x7f92bc003530 con 0x7f92d415f830 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 msgr2=0x7f92d415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 0x7f92d415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 >> v2:172.21.15.155:3300/0 conn(0x7f92d415d290 msgr2=0x7f92d415e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 --2- 172.21.15.94:0/3366449888 >> v2:172.21.15.155:3300/0 conn(0x7f92d415d290 0x7f92d415e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d40b3570 con 0x7f92d415f830 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f92c8001680 con 0x7f92d415f830 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 >> v1:172.21.15.94:6789/0 conn(0x7f92d415f830 legacy=0x7f92d406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 0x7f92bc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc004d50 0x7f92bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f92d415da40 con 0x7f92bc003f40 2024-09-11T23:15:10.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92d415d800 con 0x7f92bc004d50 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc00b9d0 con 0x7f92d406c3d0 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d27fc640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d37fe640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc004d50 0x7f92bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d2ffd640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 0x7f92bc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d27fc640 1 -- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 msgr2=0x7f92bc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d27fc640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d406c3d0 0x7f92bc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d27fc640 1 -- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc004d50 msgr2=0x7f92bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d27fc640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc004d50 0x7f92bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.589+0000 7f92d27fc640 1 -- 172.21.15.94:0/3366449888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc003530 con 0x7f92bc003f40 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d27fc640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009ab0 tx=0x7f92c401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92b8426cb36f367 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c40b2070 con 0x7f92bc003f40 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c40a5530 con 0x7f92bc003f40 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d1ffb640 1 -- 172.21.15.94:0/3366449888 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c40096b0 con 0x7f92bc003f40 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 -- 172.21.15.94:0/3366449888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92bc003f40 msgr2=0x7f92bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 --2- 172.21.15.94:0/3366449888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009ab0 tx=0x7f92c401c9f0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d37fe640 1 -- 172.21.15.94:0/3366449888 reap_dead start 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 -- 172.21.15.94:0/3366449888 shutdown_connections 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 -- 172.21.15.94:0/3366449888 >> 172.21.15.94:0/3366449888 conn(0x7f92d40b6800 msgr2=0x7f92d40b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:10.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 -- 172.21.15.94:0/3366449888 shutdown_connections 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 -- 172.21.15.94:0/3366449888 wait complete. 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 Processor -- start 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.593+0000 7f92d9a09640 1 -- start start 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc003f40 0x7f92d409cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92d4146b70 0x7f92d409dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d409e1e0 0x7f92d409b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f92d4073460 con 0x7f92d4146b70 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92d40b3b30 con 0x7f92bc003f40 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92d40735e0 con 0x7f92d409e1e0 2024-09-11T23:15:10.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92d4146b70 0x7f92d409dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92d4146b70 0x7f92d409dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38584/0 (socket says 172.21.15.94:38584) 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 -- 172.21.15.94:0/19021460 learned_addr learned my addr 172.21.15.94:0/19021460 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d2ffd640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc003f40 0x7f92d409cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d37fe640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d409e1e0 0x7f92d409b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 -- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d409e1e0 msgr2=0x7f92d409b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d409e1e0 0x7f92d409b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 -- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc003f40 msgr2=0x7f92d409cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc003f40 0x7f92d409cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 -- 172.21.15.94:0/19021460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d409d500 con 0x7f92d4146b70 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d37fe640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d409e1e0 0x7f92d409b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d27fc640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92d4146b70 0x7f92d409dca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92c401d290 tx=0x7f92bc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92bbfff640 1 -- 172.21.15.94:0/19021460 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c40bc030 con 0x7f92d4146b70 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92bbfff640 1 -- 172.21.15.94:0/19021460 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c400f000 con 0x7f92d4146b70 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92bbfff640 1 -- 172.21.15.94:0/19021460 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c40b2040 con 0x7f92d4146b70 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d4153190 con 0x7f92d4146b70 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d409c200 con 0x7f92d4146b70 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d409aa00 con 0x7f92d4146b70 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92bbfff640 1 -- 172.21.15.94:0/19021460 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92c40bf070 con 0x7f92d4146b70 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92bbfff640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92c00678f0 0x7f92c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92bbfff640 1 -- 172.21.15.94:0/19021460 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f92c411f960 con 0x7f92d4146b70 2024-09-11T23:15:10.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.597+0000 7f92d2ffd640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92c00678f0 0x7f92c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.601+0000 7f92d2ffd640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92c00678f0 0x7f92c0069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92c8000c10 tx=0x7f92c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.601+0000 7f92bbfff640 1 -- 172.21.15.94:0/19021460 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f92d409d500 con 0x7f92d4146b70 2024-09-11T23:15:10.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.753+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f92d409e5c0 con 0x7f92d4146b70 2024-09-11T23:15:10.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.753+0000 7f92bbfff640 1 -- 172.21.15.94:0/19021460 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f92c4016760 con 0x7f92d4146b70 2024-09-11T23:15:10.755 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:10.755 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:15:10.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:15:10.756 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:15:10.756 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:15:10.756 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:15:10.756 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:15:10.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92c00678f0 msgr2=0x7f92c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92c00678f0 0x7f92c0069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92c8000c10 tx=0x7f92c8009040 comp rx=0 tx=0).stop 2024-09-11T23:15:10.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92d4146b70 msgr2=0x7f92d409dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92d4146b70 0x7f92d409dca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92c401d290 tx=0x7f92bc005840 comp rx=0 tx=0).stop 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 shutdown_connections 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92d409e1e0 0x7f92d409b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92c00678f0 0x7f92c0069db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92d4146b70 0x7f92d409dca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 --2- 172.21.15.94:0/19021460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92bc003f40 0x7f92d409cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 >> 172.21.15.94:0/19021460 conn(0x7f92d40b6800 msgr2=0x7f92d40ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 shutdown_connections 2024-09-11T23:15:10.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.757+0000 7f92d9a09640 1 -- 172.21.15.94:0/19021460 wait complete. 2024-09-11T23:15:10.773 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:15:10.773 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:15:10.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d6959640 1 Processor -- start 2024-09-11T23:15:10.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d6959640 1 -- start start 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d6959640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d6959640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6d015c2a0 0x7fe6d00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d6959640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d00b3290 con 0x7fe6d00af2a0 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d6959640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d00b3570 con 0x7fe6d015c2a0 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d6959640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d00b3850 con 0x7fe6d015bec0 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6cf7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6d015c2a0 0x7fe6d00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:40860/0 (socket says 172.21.15.94:40860) 2024-09-11T23:15:10.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6d4ef6640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe6d00af2a0 0x7fe6d015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:56760/0 (socket says 172.21.15.94:56760) 2024-09-11T23:15:10.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.893+0000 7fe6cffff640 1 -- 172.21.15.94:0/2165416873 learned_addr learned my addr 172.21.15.94:0/2165416873 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:10.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.897+0000 7fe6cffff640 1 -- 172.21.15.94:0/2165416873 >> v2:172.21.15.155:3300/0 conn(0x7fe6d015c2a0 msgr2=0x7fe6d00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:10.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.897+0000 7fe6cffff640 1 --2- 172.21.15.94:0/2165416873 >> v2:172.21.15.155:3300/0 conn(0x7fe6d015c2a0 0x7fe6d00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.897+0000 7fe6cffff640 1 -- 172.21.15.94:0/2165416873 >> v1:172.21.15.155:6789/0 conn(0x7fe6d00af2a0 legacy=0x7fe6d015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.897+0000 7fe6cffff640 1 -- 172.21.15.94:0/2165416873 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d00b3b30 con 0x7fe6d015bec0 2024-09-11T23:15:10.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.897+0000 7fe6cffff640 1 --2- 172.21.15.94:0/2165416873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d00ad200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66a9af4201bd20a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6ceffd640 1 -- 172.21.15.94:0/2165416873 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00a95f0 con 0x7fe6d015bec0 2024-09-11T23:15:10.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6ceffd640 1 -- 172.21.15.94:0/2165416873 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c00a9790 con 0x7fe6d015bec0 2024-09-11T23:15:10.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6ceffd640 1 -- 172.21.15.94:0/2165416873 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00a9b60 con 0x7fe6d015bec0 2024-09-11T23:15:10.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 -- 172.21.15.94:0/2165416873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 msgr2=0x7fe6d00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 --2- 172.21.15.94:0/2165416873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d00ad200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c001c530 comp rx=0 tx=0).stop 2024-09-11T23:15:10.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 -- 172.21.15.94:0/2165416873 shutdown_connections 2024-09-11T23:15:10.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 --2- 172.21.15.94:0/2165416873 >> v2:172.21.15.155:3300/0 conn(0x7fe6d015c2a0 0x7fe6d00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 --2- 172.21.15.94:0/2165416873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d00ad200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 -- 172.21.15.94:0/2165416873 >> 172.21.15.94:0/2165416873 conn(0x7fe6d00b1f90 msgr2=0x7fe6d00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:10.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 -- 172.21.15.94:0/2165416873 shutdown_connections 2024-09-11T23:15:10.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.901+0000 7fe6d6959640 1 -- 172.21.15.94:0/2165416873 wait complete. 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 Processor -- start 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 -- start start 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00af2a0 0x7fe6d014e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d0155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d015c2a0 0x7fe6d01521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00af6b0 con 0x7fe6d015c2a0 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00ad740 con 0x7fe6d00af2a0 2024-09-11T23:15:10.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d0071f10 con 0x7fe6d015bec0 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d015c2a0 0x7fe6d01521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d015c2a0 0x7fe6d01521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38600/0 (socket says 172.21.15.94:38600) 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 -- 172.21.15.94:0/926106280 learned_addr learned my addr 172.21.15.94:0/926106280 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6cf7fe640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d0155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6cffff640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00af2a0 0x7fe6d014e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 -- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 msgr2=0x7fe6d0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d0155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 -- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00af2a0 msgr2=0x7fe6d014e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00af2a0 0x7fe6d014e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 -- 172.21.15.94:0/926106280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d0151140 con 0x7fe6d015c2a0 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d4ef6640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d015c2a0 0x7fe6d01521e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c7d0 tx=0x7fe6c800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6ccff9640 1 -- 172.21.15.94:0/926106280 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8017070 con 0x7fe6d015c2a0 2024-09-11T23:15:10.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6ccff9640 1 -- 172.21.15.94:0/926106280 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c800a640 con 0x7fe6d015c2a0 2024-09-11T23:15:10.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d0151420 con 0x7fe6d015c2a0 2024-09-11T23:15:10.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6ccff9640 1 -- 172.21.15.94:0/926106280 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800a9f0 con 0x7fe6d015c2a0 2024-09-11T23:15:10.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d01519e0 con 0x7fe6d015c2a0 2024-09-11T23:15:10.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d00ad200 con 0x7fe6d015c2a0 2024-09-11T23:15:10.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6ccff9640 1 -- 172.21.15.94:0/926106280 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6c801a070 con 0x7fe6d015c2a0 2024-09-11T23:15:10.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6ccff9640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6bc0678c0 0x7fe6bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:10.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.905+0000 7fe6ccff9640 1 -- 172.21.15.94:0/926106280 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe6c8084f10 con 0x7fe6d015c2a0 2024-09-11T23:15:10.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.909+0000 7fe6cffff640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6bc0678c0 0x7fe6bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:10.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.909+0000 7fe6cffff640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6bc0678c0 0x7fe6bc069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ae000 tx=0x7fe6c00b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:10.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:10.909+0000 7fe6ccff9640 1 -- 172.21.15.94:0/926106280 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe6c8055750 con 0x7fe6d015c2a0 2024-09-11T23:15:11.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.061+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe6d00b29a0 con 0x7fe6d015c2a0 2024-09-11T23:15:11.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.913+0000 7fe6ccff9640 1 -- 172.21.15.94:0/926106280 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fe6c8059a50 con 0x7fe6d015c2a0 2024-09-11T23:15:11.912 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6bc0678c0 msgr2=0x7fe6bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6bc0678c0 0x7fe6bc069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ae000 tx=0x7fe6c00b3040 comp rx=0 tx=0).stop 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d015c2a0 msgr2=0x7fe6d01521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d015c2a0 0x7fe6d01521e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c7d0 tx=0x7fe6c800cc90 comp rx=0 tx=0).stop 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 shutdown_connections 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6bc0678c0 0x7fe6bc069d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6d015c2a0 0x7fe6d01521e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015bec0 0x7fe6d0155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 --2- 172.21.15.94:0/926106280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00af2a0 0x7fe6d014e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 >> 172.21.15.94:0/926106280 conn(0x7fe6d00b1f90 msgr2=0x7fe6d00751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:11.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 shutdown_connections 2024-09-11T23:15:11.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:11.917+0000 7fe6d6959640 1 -- 172.21.15.94:0/926106280 wait complete. 2024-09-11T23:15:11.943 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T23:15:12.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 Processor -- start 2024-09-11T23:15:12.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 -- start start 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc5000cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc500073100 0x7fc5000ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc5000cdfd0 0x7fc50006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc5000cd190 con 0x7fc5000cdfd0 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc5000ce8d0 con 0x7fc500073100 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc5064c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5000cebb0 con 0x7fc5000cc870 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc5000cdfd0 0x7fc50006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc5000cdfd0 0x7fc50006de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38608/0 (socket says 172.21.15.94:38608) 2024-09-11T23:15:12.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 -- 172.21.15.94:0/1048629889 learned_addr learned my addr 172.21.15.94:0/1048629889 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc4fffff640 1 --2- 172.21.15.94:0/1048629889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc5000cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc4ff7fe640 1 --2- 172.21.15.94:0/1048629889 >> v2:172.21.15.155:3300/0 conn(0x7fc500073100 0x7fc5000ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 -- 172.21.15.94:0/1048629889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 msgr2=0x7fc5000cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 --2- 172.21.15.94:0/1048629889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc5000cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 -- 172.21.15.94:0/1048629889 >> v2:172.21.15.155:3300/0 conn(0x7fc500073100 msgr2=0x7fc5000ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 --2- 172.21.15.94:0/1048629889 >> v2:172.21.15.155:3300/0 conn(0x7fc500073100 0x7fc5000ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.073+0000 7fc504a61640 1 -- 172.21.15.94:0/1048629889 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5000cee90 con 0x7fc5000cdfd0 2024-09-11T23:15:12.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc504a61640 1 --2- 172.21.15.94:0/1048629889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc50006de00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5000b61d0 tx=0x7fc4f801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b967e55bc3e9d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:12.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc4feffd640 1 -- 172.21.15.94:0/1048629889 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80a5840 con 0x7fc5000cdfd0 2024-09-11T23:15:12.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc4feffd640 1 -- 172.21.15.94:0/1048629889 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f80a59e0 con 0x7fc5000cdfd0 2024-09-11T23:15:12.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc4feffd640 1 -- 172.21.15.94:0/1048629889 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80a5db0 con 0x7fc5000cdfd0 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 -- 172.21.15.94:0/1048629889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 msgr2=0x7fc50006de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 --2- 172.21.15.94:0/1048629889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc50006de00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5000b61d0 tx=0x7fc4f801c9c0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 -- 172.21.15.94:0/1048629889 shutdown_connections 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 --2- 172.21.15.94:0/1048629889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc50006de00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 --2- 172.21.15.94:0/1048629889 >> v2:172.21.15.155:3300/0 conn(0x7fc500073100 0x7fc5000ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 --2- 172.21.15.94:0/1048629889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc5000cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 -- 172.21.15.94:0/1048629889 >> 172.21.15.94:0/1048629889 conn(0x7fc5000b1c80 msgr2=0x7fc5000b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 -- 172.21.15.94:0/1048629889 shutdown_connections 2024-09-11T23:15:12.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 -- 172.21.15.94:0/1048629889 wait complete. 2024-09-11T23:15:12.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 Processor -- start 2024-09-11T23:15:12.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.077+0000 7fc5064c4640 1 -- start start 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc500073100 0x7fc50009d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc50015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc500144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc5000ce600 con 0x7fc5000cdfd0 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc5000ce480 con 0x7fc500073100 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc50015fe50 con 0x7fc5000cc870 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc500144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc500144320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38624/0 (socket says 172.21.15.94:38624) 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 -- 172.21.15.94:0/3216055235 learned_addr learned my addr 172.21.15.94:0/3216055235 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4ff7fe640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc50015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 -- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 msgr2=0x7fc50015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc50015dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fffff640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc500073100 0x7fc50009d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 -- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc500073100 msgr2=0x7fc50009d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc500073100 0x7fc50009d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 -- 172.21.15.94:0/3216055235 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50015e650 con 0x7fc5000cdfd0 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc504a61640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc500144320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80af040 tx=0x7fc4f8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fcff9640 1 -- 172.21.15.94:0/3216055235 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80bc020 con 0x7fc5000cdfd0 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fcff9640 1 -- 172.21.15.94:0/3216055235 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f80b86d0 con 0x7fc5000cdfd0 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50009cad0 con 0x7fc5000cdfd0 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fcff9640 1 -- 172.21.15.94:0/3216055235 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80b8ac0 con 0x7fc5000cdfd0 2024-09-11T23:15:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50015e220 con 0x7fc5000cdfd0 2024-09-11T23:15:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5000ccc50 con 0x7fc5000cdfd0 2024-09-11T23:15:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fcff9640 1 -- 172.21.15.94:0/3216055235 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4f80bf020 con 0x7fc5000cdfd0 2024-09-11T23:15:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fcff9640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc4ec0678c0 0x7fc4ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fcff9640 1 -- 172.21.15.94:0/3216055235 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fc4f81214c0 con 0x7fc5000cdfd0 2024-09-11T23:15:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.081+0000 7fc4fffff640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc4ec0678c0 0x7fc4ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:12.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.085+0000 7fc4fffff640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc4ec0678c0 0x7fc4ec069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009790 tx=0x7fc4f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:12.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.085+0000 7fc4fcff9640 1 -- 172.21.15.94:0/3216055235 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4f80165e0 con 0x7fc5000cdfd0 2024-09-11T23:15:12.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.241+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fc5000cd830 con 0x7fc5000cdfd0 2024-09-11T23:15:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.921+0000 7fc4fcff9640 1 -- 172.21.15.94:0/3216055235 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fc4f80f2270 con 0x7fc5000cdfd0 2024-09-11T23:15:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:15:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc4ec0678c0 msgr2=0x7fc4ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc4ec0678c0 0x7fc4ec069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009790 tx=0x7fc4f0008040 comp rx=0 tx=0).stop 2024-09-11T23:15:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 msgr2=0x7fc500144320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc500144320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80af040 tx=0x7fc4f8019760 comp rx=0 tx=0).stop 2024-09-11T23:15:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 shutdown_connections 2024-09-11T23:15:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc4ec0678c0 0x7fc4ec069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5000cdfd0 0x7fc500144320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5000cc870 0x7fc50015dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 --2- 172.21.15.94:0/3216055235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc500073100 0x7fc50009d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 >> 172.21.15.94:0/3216055235 conn(0x7fc5000b1c80 msgr2=0x7fc5000b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 shutdown_connections 2024-09-11T23:15:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:12.925+0000 7fc5064c4640 1 -- 172.21.15.94:0/3216055235 wait complete. 2024-09-11T23:15:12.960 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:15:13.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd56671f640 1 Processor -- start 2024-09-11T23:15:13.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd56671f640 1 -- start start 2024-09-11T23:15:13.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd56671f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd56015bec0 0x7fd5600ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd56671f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd56015c2a0 0x7fd5600aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd56671f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5600b3290 con 0x7fd5600af2a0 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd56671f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd5600b3570 con 0x7fd56015c2a0 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd56671f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd5600b3850 con 0x7fd56015bec0 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd56015c2a0 0x7fd5600aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd56015c2a0 0x7fd5600aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38628/0 (socket says 172.21.15.94:38628) 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55f7fe640 1 -- 172.21.15.94:0/3584186714 learned_addr learned my addr 172.21.15.94:0/3584186714 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55ffff640 1 --2- 172.21.15.94:0/3584186714 >> v2:172.21.15.155:3300/0 conn(0x7fd56015bec0 0x7fd5600ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55f7fe640 1 -- 172.21.15.94:0/3584186714 >> v2:172.21.15.155:3300/0 conn(0x7fd56015bec0 msgr2=0x7fd5600ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55f7fe640 1 --2- 172.21.15.94:0/3584186714 >> v2:172.21.15.155:3300/0 conn(0x7fd56015bec0 0x7fd5600ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55f7fe640 1 -- 172.21.15.94:0/3584186714 >> v1:172.21.15.94:6789/0 conn(0x7fd5600af2a0 legacy=0x7fd56015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55effd640 1 -- 172.21.15.94:0/3584186714 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325885285 0 0) 0x7fd5600b3290 con 0x7fd5600af2a0 2024-09-11T23:15:13.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.085+0000 7fd55f7fe640 1 -- 172.21.15.94:0/3584186714 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5600b3b30 con 0x7fd56015c2a0 2024-09-11T23:15:13.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55f7fe640 1 --2- 172.21.15.94:0/3584186714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5600aed60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd560071710 tx=0x7fd55401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699d4184fffdb406 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55effd640 1 -- 172.21.15.94:0/3584186714 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540aa650 con 0x7fd56015c2a0 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55effd640 1 -- 172.21.15.94:0/3584186714 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5540af070 con 0x7fd56015c2a0 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55effd640 1 -- 172.21.15.94:0/3584186714 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540aaa10 con 0x7fd56015c2a0 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- 172.21.15.94:0/3584186714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 msgr2=0x7fd5600aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 --2- 172.21.15.94:0/3584186714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5600aed60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd560071710 tx=0x7fd55401c4f0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- 172.21.15.94:0/3584186714 shutdown_connections 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 --2- 172.21.15.94:0/3584186714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5600aed60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 --2- 172.21.15.94:0/3584186714 >> v2:172.21.15.155:3300/0 conn(0x7fd56015bec0 0x7fd5600ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- 172.21.15.94:0/3584186714 >> 172.21.15.94:0/3584186714 conn(0x7fd5600b1f90 msgr2=0x7fd5600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- 172.21.15.94:0/3584186714 shutdown_connections 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- 172.21.15.94:0/3584186714 wait complete. 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 Processor -- start 2024-09-11T23:15:13.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- start start 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5600af2a0 0x7fd56014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56015bec0 0x7fd560166250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5601f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600af6d0 con 0x7fd56015c2a0 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600ad740 con 0x7fd5600af2a0 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd560169000 con 0x7fd56015bec0 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5601f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5601f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38636/0 (socket says 172.21.15.94:38636) 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 -- 172.21.15.94:0/3328363765 learned_addr learned my addr 172.21.15.94:0/3328363765 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55ffff640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5600af2a0 0x7fd56014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55f7fe640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56015bec0 0x7fd560166250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 -- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56015bec0 msgr2=0x7fd560166250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56015bec0 0x7fd560166250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 -- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5600af2a0 msgr2=0x7fd56014f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5600af2a0 0x7fd56014f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 -- 172.21.15.94:0/3328363765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5601651b0 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55ffff640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5600af2a0 0x7fd56014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd564cbc640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5601f72c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c7b0 tx=0x7fd55800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55cff9640 1 -- 172.21.15.94:0/3328363765 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558003db0 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55cff9640 1 -- 172.21.15.94:0/3328363765 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd558005070 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd55cff9640 1 -- 172.21.15.94:0/3328363765 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558005460 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd560165490 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.089+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd560165a50 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.093+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5600ad200 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.093+0000 7fd55cff9640 1 -- 172.21.15.94:0/3328363765 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd558005600 con 0x7fd56015c2a0 2024-09-11T23:15:13.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.093+0000 7fd55cff9640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd54c0678c0 0x7fd54c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.093+0000 7fd55cff9640 1 -- 172.21.15.94:0/3328363765 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fd558085b60 con 0x7fd56015c2a0 2024-09-11T23:15:13.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.093+0000 7fd55ffff640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd54c0678c0 0x7fd54c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.093+0000 7fd55ffff640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd54c0678c0 0x7fd54c069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd550009840 tx=0x7fd550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:13.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.097+0000 7fd55cff9640 1 -- 172.21.15.94:0/3328363765 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd558056790 con 0x7fd56015c2a0 2024-09-11T23:15:13.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.297+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd56006fcd0 con 0x7fd56015c2a0 2024-09-11T23:15:13.376 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:15:13.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:15:13.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.925+0000 7fd55cff9640 1 -- 172.21.15.94:0/3328363765 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd558056090 con 0x7fd56015c2a0 2024-09-11T23:15:13.926 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T23:15:13.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.929+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd54c0678c0 msgr2=0x7fd54c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.929+0000 7fd56671f640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd54c0678c0 0x7fd54c069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd550009840 tx=0x7fd550008040 comp rx=0 tx=0).stop 2024-09-11T23:15:13.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.929+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 msgr2=0x7fd5601f72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.929+0000 7fd56671f640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5601f72c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c7b0 tx=0x7fd55800cc70 comp rx=0 tx=0).stop 2024-09-11T23:15:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.933+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 shutdown_connections 2024-09-11T23:15:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.933+0000 7fd56671f640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd54c0678c0 0x7fd54c069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.933+0000 7fd56671f640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd56015c2a0 0x7fd5601f72c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.933+0000 7fd56671f640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56015bec0 0x7fd560166250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.933+0000 7fd56671f640 1 --2- 172.21.15.94:0/3328363765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5600af2a0 0x7fd56014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.933+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 >> 172.21.15.94:0/3328363765 conn(0x7fd5600b1f90 msgr2=0x7fd560074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:13.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.933+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 shutdown_connections 2024-09-11T23:15:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:13.937+0000 7fd56671f640 1 -- 172.21.15.94:0/3328363765 wait complete. 2024-09-11T23:15:13.968 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T23:15:13.969 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T23:15:14.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb559c48640 1 Processor -- start 2024-09-11T23:15:14.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb559c48640 1 -- start start 2024-09-11T23:15:14.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb559c48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb559c48640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb55415f1d0 0x7fb5540adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb559c48640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5540aede0 con 0x7fb5541520a0 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb559c48640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb554152480 con 0x7fb55415f1d0 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb559c48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb55415fa10 con 0x7fb554070020 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb553fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb55415f1d0 0x7fb5540adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb553fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb55415f1d0 0x7fb5540adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38652/0 (socket says 172.21.15.94:38652) 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb553fff640 1 -- 172.21.15.94:0/578095155 learned_addr learned my addr 172.21.15.94:0/578095155 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb552ffd640 1 --2- 172.21.15.94:0/578095155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb553fff640 1 -- 172.21.15.94:0/578095155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 msgr2=0x7fb55415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.093+0000 7fb553fff640 1 --2- 172.21.15.94:0/578095155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb553fff640 1 -- 172.21.15.94:0/578095155 >> v1:172.21.15.155:6789/0 conn(0x7fb5541520a0 legacy=0x7fb55406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:14.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb553fff640 1 -- 172.21.15.94:0/578095155 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb554074250 con 0x7fb55415f1d0 2024-09-11T23:15:14.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb553fff640 1 --2- 172.21.15.94:0/578095155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb5540adc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009e80 tx=0x7fb54c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9394cd79ce62dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb5527fc640 1 -- 172.21.15.94:0/578095155 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0a5820 con 0x7fb55415f1d0 2024-09-11T23:15:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb5527fc640 1 -- 172.21.15.94:0/578095155 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c0a59c0 con 0x7fb55415f1d0 2024-09-11T23:15:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb5527fc640 1 -- 172.21.15.94:0/578095155 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0a5d90 con 0x7fb55415f1d0 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 -- 172.21.15.94:0/578095155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 msgr2=0x7fb5540adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 --2- 172.21.15.94:0/578095155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb5540adc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009e80 tx=0x7fb54c01c9a0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 -- 172.21.15.94:0/578095155 shutdown_connections 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 --2- 172.21.15.94:0/578095155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb5540adc80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 --2- 172.21.15.94:0/578095155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 -- 172.21.15.94:0/578095155 >> 172.21.15.94:0/578095155 conn(0x7fb5540b1f90 msgr2=0x7fb5540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 -- 172.21.15.94:0/578095155 shutdown_connections 2024-09-11T23:15:14.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.097+0000 7fb559c48640 1 -- 172.21.15.94:0/578095155 wait complete. 2024-09-11T23:15:14.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 Processor -- start 2024-09-11T23:15:14.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 -- start start 2024-09-11T23:15:14.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:14.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5541520a0 0x7fb55414ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:14.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb55414f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:14.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb55415f680 con 0x7fb55415f1d0 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb554073d30 con 0x7fb5541520a0 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb554167f10 con 0x7fb554070020 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb55414f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb55414f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38668/0 (socket says 172.21.15.94:38668) 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 -- 172.21.15.94:0/2308837116 learned_addr learned my addr 172.21.15.94:0/2308837116 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb5537fe640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb552ffd640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5541520a0 0x7fb55414ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 -- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 msgr2=0x7fb55414d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55414d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 -- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5541520a0 msgr2=0x7fb55414ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5541520a0 0x7fb55414ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 -- 172.21.15.94:0/2308837116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5540cecb0 con 0x7fb55415f1d0 2024-09-11T23:15:14.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb553fff640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb55414f2a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0af040 tx=0x7fb54c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:14.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb53bfff640 1 -- 172.21.15.94:0/2308837116 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0bc070 con 0x7fb55415f1d0 2024-09-11T23:15:14.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb53bfff640 1 -- 172.21.15.94:0/2308837116 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c0b8640 con 0x7fb55415f1d0 2024-09-11T23:15:14.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55414f970 con 0x7fb55415f1d0 2024-09-11T23:15:14.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb53bfff640 1 -- 172.21.15.94:0/2308837116 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0b8a30 con 0x7fb55415f1d0 2024-09-11T23:15:14.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5540ccf90 con 0x7fb55415f1d0 2024-09-11T23:15:14.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55415ec90 con 0x7fb55415f1d0 2024-09-11T23:15:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb53bfff640 1 -- 172.21.15.94:0/2308837116 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb54c0bf070 con 0x7fb55415f1d0 2024-09-11T23:15:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb53bfff640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5400678f0 0x7fb540069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.101+0000 7fb53bfff640 1 -- 172.21.15.94:0/2308837116 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fb54c120990 con 0x7fb55415f1d0 2024-09-11T23:15:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.105+0000 7fb5537fe640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5400678f0 0x7fb540069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.105+0000 7fb5537fe640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5400678f0 0x7fb540069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb544004e30 tx=0x7fb544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.109+0000 7fb53bfff640 1 -- 172.21.15.94:0/2308837116 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb54c0165c0 con 0x7fb55415f1d0 2024-09-11T23:15:14.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.269+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fb55406e540 con 0x7fb55415f1d0 2024-09-11T23:15:14.899 INFO:tasks.ceph.mds.c.smithi094.stderr:2024-09-11T23:15:14.897+0000 7f6f7d472640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:15:14.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.929+0000 7fb53bfff640 1 -- 172.21.15.94:0/2308837116 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fb54c0f1560 con 0x7fb55415f1d0 2024-09-11T23:15:14.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5400678f0 msgr2=0x7fb540069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:14.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5400678f0 0x7fb540069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb544004e30 tx=0x7fb544009040 comp rx=0 tx=0).stop 2024-09-11T23:15:14.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 msgr2=0x7fb55414f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:14.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb55414f2a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0af040 tx=0x7fb54c019740 comp rx=0 tx=0).stop 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 shutdown_connections 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5400678f0 0x7fb540069db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb55415f1d0 0x7fb55414f2a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5541520a0 0x7fb55414ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 --2- 172.21.15.94:0/2308837116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb554070020 0x7fb55414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 >> 172.21.15.94:0/2308837116 conn(0x7fb5540b1f90 msgr2=0x7fb55406ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 shutdown_connections 2024-09-11T23:15:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:14.933+0000 7fb559c48640 1 -- 172.21.15.94:0/2308837116 wait complete. 2024-09-11T23:15:14.954 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:15:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.089+0000 7fa3dddd9640 1 Processor -- start 2024-09-11T23:15:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.089+0000 7fa3dddd9640 1 -- start start 2024-09-11T23:15:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.089+0000 7fa3dddd9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa3d815be70 0x7fa3d815e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.089+0000 7fa3dddd9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d815f020 con 0x7fa3d8071cd0 2024-09-11T23:15:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.089+0000 7fa3dddd9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d815f300 con 0x7fa3d80b38b0 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.089+0000 7fa3dddd9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d815f8c0 con 0x7fa3d815be70 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d7fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa3d8071cd0 0x7fa3d806f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52074/0 (socket says 172.21.15.94:52074) 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d7fff640 1 -- 172.21.15.94:0/4220118446 learned_addr learned my addr 172.21.15.94:0/4220118446 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4220118446 >> v2:172.21.15.155:3300/0 conn(0x7fa3d815be70 0x7fa3d815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861358312 0 0) 0x7fa3d815f020 con 0x7fa3d8071cd0 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3c4003530 con 0x7fa3d8071cd0 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1694003461 0 0) 0x7fa3c4003530 con 0x7fa3d8071cd0 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 >> v2:172.21.15.155:3300/0 conn(0x7fa3d815be70 msgr2=0x7fa3d815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 --2- 172.21.15.94:0/4220118446 >> v2:172.21.15.155:3300/0 conn(0x7fa3d815be70 0x7fa3d815e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 >> v1:172.21.15.155:6789/0 conn(0x7fa3d80b38b0 legacy=0x7fa3d81625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d815f5e0 con 0x7fa3d8071cd0 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fa3c8001680 con 0x7fa3d8071cd0 2024-09-11T23:15:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 >> v1:172.21.15.94:6789/0 conn(0x7fa3d8071cd0 legacy=0x7fa3d806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3c4004810 0x7fa3c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3c40051d0 0x7fa3c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d815f8c0 con 0x7fa3c40039c0 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c400c070 con 0x7fa3c40051d0 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c400c270 con 0x7fa3c4004810 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d6ffd640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3c4004810 0x7fa3c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d7fff640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3c40051d0 0x7fa3c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d77fe640 1 -- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3c4004810 msgr2=0x7fa3c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3c4004810 0x7fa3c4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d77fe640 1 -- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3c40051d0 msgr2=0x7fa3c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3c40051d0 0x7fa3c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d7fff640 1 -- 172.21.15.94:0/4220118446 reap_dead start 2024-09-11T23:15:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.093+0000 7fa3d77fe640 1 -- 172.21.15.94:0/4220118446 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c4003530 con 0x7fa3c40039c0 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3c4003de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009fa0 tx=0x7fa3d001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9531076cb6fb5116 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00b2070 con 0x7fa3c40039c0 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d00a5c60 con 0x7fa3c40039c0 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d67fc640 1 -- 172.21.15.94:0/4220118446 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0009bf0 con 0x7fa3c40039c0 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4220118446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 msgr2=0x7fa3c4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3c4003de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009fa0 tx=0x7fa3d001cc10 comp rx=0 tx=0).stop 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4220118446 shutdown_connections 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4220118446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3c4003de0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4220118446 >> 172.21.15.94:0/4220118446 conn(0x7fa3d806c380 msgr2=0x7fa3d80b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:15.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4220118446 shutdown_connections 2024-09-11T23:15:15.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4220118446 wait complete. 2024-09-11T23:15:15.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 Processor -- start 2024-09-11T23:15:15.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- start start 2024-09-11T23:15:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3d814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3d8157a50 0x7fa3d809cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d8157420 0x7fa3d809d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d80b3cc0 con 0x7fa3c40039c0 2024-09-11T23:15:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8162e00 con 0x7fa3d8157420 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3dddd9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d80724c0 con 0x7fa3d8157a50 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3d814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3d814ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38692/0 (socket says 172.21.15.94:38692) 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 -- 172.21.15.94:0/4072676297 learned_addr learned my addr 172.21.15.94:0/4072676297 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d6ffd640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3d8157a50 0x7fa3d809cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 -- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3d8157a50 msgr2=0x7fa3d809cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3d8157a50 0x7fa3d809cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 -- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d8157420 msgr2=0x7fa3d809d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d8157420 0x7fa3d809d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 -- 172.21.15.94:0/4072676297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d8158430 con 0x7fa3c40039c0 2024-09-11T23:15:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.097+0000 7fa3d77fe640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3d814ea10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3d001ca40 tx=0x7fa3c4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3cffff640 1 -- 172.21.15.94:0/4072676297 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00b2050 con 0x7fa3c40039c0 2024-09-11T23:15:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3cffff640 1 -- 172.21.15.94:0/4072676297 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d00be070 con 0x7fa3c40039c0 2024-09-11T23:15:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d8158710 con 0x7fa3c40039c0 2024-09-11T23:15:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3cffff640 1 -- 172.21.15.94:0/4072676297 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0009bf0 con 0x7fa3c40039c0 2024-09-11T23:15:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d8158cd0 con 0x7fa3c40039c0 2024-09-11T23:15:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d806f570 con 0x7fa3c40039c0 2024-09-11T23:15:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3cffff640 1 -- 172.21.15.94:0/4072676297 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3d00c3460 con 0x7fa3c40039c0 2024-09-11T23:15:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3cffff640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3b80678c0 0x7fa3b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3cffff640 1 -- 172.21.15.94:0/4072676297 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fa3d0121330 con 0x7fa3c40039c0 2024-09-11T23:15:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3d6ffd640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3b80678c0 0x7fa3b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:15.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.101+0000 7fa3d6ffd640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3b80678c0 0x7fa3b8069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80aed40 tx=0x7fa3c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:15.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.117+0000 7fa3cffff640 1 -- 172.21.15.94:0/4072676297 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3d0016950 con 0x7fa3c40039c0 2024-09-11T23:15:15.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:15.281+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa3d809dde0 con 0x7fa3c40039c0 2024-09-11T23:15:16.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.989+0000 7fa3cffff640 1 -- 172.21.15.94:0/4072676297 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fa3d00f1dd0 con 0x7fa3c40039c0 2024-09-11T23:15:16.991 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data_ec' created 2024-09-11T23:15:16.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3b80678c0 msgr2=0x7fa3b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:16.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3b80678c0 0x7fa3b8069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80aed40 tx=0x7fa3c0009040 comp rx=0 tx=0).stop 2024-09-11T23:15:16.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 msgr2=0x7fa3d814ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:16.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3d814ea10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3d001ca40 tx=0x7fa3c4005840 comp rx=0 tx=0).stop 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 shutdown_connections 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d8157420 0x7fa3d809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3d8157a50 0x7fa3d809cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3b80678c0 0x7fa3b8069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 --2- 172.21.15.94:0/4072676297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c40039c0 0x7fa3d814ea10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 >> 172.21.15.94:0/4072676297 conn(0x7fa3d806c380 msgr2=0x7fa3d80b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 shutdown_connections 2024-09-11T23:15:16.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:16.993+0000 7fa3dddd9640 1 -- 172.21.15.94:0/4072676297 wait complete. 2024-09-11T23:15:17.025 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T23:15:17.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f658ce04640 1 Processor -- start 2024-09-11T23:15:17.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f658ce04640 1 -- start start 2024-09-11T23:15:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f658ce04640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 0x7f658815f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f658ce04640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6588071ba0 0x7f65880cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f658ce04640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65880cfc30 con 0x7f6588073540 2024-09-11T23:15:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f658ce04640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f65880cf260 con 0x7f6588071ba0 2024-09-11T23:15:17.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f658ce04640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6588072140 con 0x7f658813de60 2024-09-11T23:15:17.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f6587fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6588073540 0x7f658813e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52080/0 (socket says 172.21.15.94:52080) 2024-09-11T23:15:17.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f6587fff640 1 -- 172.21.15.94:0/1655343142 learned_addr learned my addr 172.21.15.94:0/1655343142 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f6586ffd640 1 --2- 172.21.15.94:0/1655343142 >> v2:172.21.15.155:3300/0 conn(0x7f6588071ba0 0x7f65880cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65877fe640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 0x7f658815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771373385 0 0) 0x7f65880cfc30 con 0x7f6588073540 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6570003530 con 0x7f6588073540 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1026391964 0 0) 0x7f6570003530 con 0x7f6588073540 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 msgr2=0x7f658815f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 0x7f658815f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 >> v2:172.21.15.155:3300/0 conn(0x7f6588071ba0 msgr2=0x7f65880cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 --2- 172.21.15.94:0/1655343142 >> v2:172.21.15.155:3300/0 conn(0x7f6588071ba0 0x7f65880cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65880cec10 con 0x7f6588073540 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f6580001a00 con 0x7f6588073540 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 >> v1:172.21.15.94:6789/0 conn(0x7f6588073540 legacy=0x7f658813e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700039c0 0x7f6570003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6570004810 0x7f6570004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 0x7f65700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65880cf260 con 0x7f65700039c0 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6588072140 con 0x7f6570004810 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.149+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f657000b9d0 con 0x7f658813de60 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f65877fe640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700039c0 0x7f6570003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f6587fff640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 0x7f65700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f6586ffd640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6570004810 0x7f6570004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f65877fe640 1 -- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 msgr2=0x7f65700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f65877fe640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658813de60 0x7f65700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f65877fe640 1 -- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6570004810 msgr2=0x7f6570004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f65877fe640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6570004810 0x7f6570004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f65877fe640 1 -- 172.21.15.94:0/1655343142 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6570003530 con 0x7f65700039c0 2024-09-11T23:15:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.153+0000 7f6586ffd640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6570004810 0x7f6570004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:17.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f65877fe640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700039c0 0x7f6570003de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6578009ac0 tx=0x7f657801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff57192161190c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:17.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780b2070 con 0x7f65700039c0 2024-09-11T23:15:17.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780a5530 con 0x7f65700039c0 2024-09-11T23:15:17.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f65867fc640 1 -- 172.21.15.94:0/1655343142 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578009690 con 0x7f65700039c0 2024-09-11T23:15:17.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f658ce04640 1 -- 172.21.15.94:0/1655343142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700039c0 msgr2=0x7f6570003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:17.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f658ce04640 1 --2- 172.21.15.94:0/1655343142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700039c0 0x7f6570003de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6578009ac0 tx=0x7f657801ca20 comp rx=0 tx=0).stop 2024-09-11T23:15:17.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f6587fff640 1 -- 172.21.15.94:0/1655343142 reap_dead start 2024-09-11T23:15:17.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f658ce04640 1 -- 172.21.15.94:0/1655343142 shutdown_connections 2024-09-11T23:15:17.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f658ce04640 1 -- 172.21.15.94:0/1655343142 >> 172.21.15.94:0/1655343142 conn(0x7f65880b1bf0 msgr2=0x7f65880b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:17.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f658ce04640 1 -- 172.21.15.94:0/1655343142 shutdown_connections 2024-09-11T23:15:17.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.157+0000 7f658ce04640 1 -- 172.21.15.94:0/1655343142 wait complete. 2024-09-11T23:15:17.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 Processor -- start 2024-09-11T23:15:17.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 -- start start 2024-09-11T23:15:17.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6588162bc0 0x7f658815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6588162fa0 0x7f6588163420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6588163960 0x7f65880b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65880ce830 con 0x7f6588162bc0 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f658813e240 con 0x7f6588162fa0 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65880ce9b0 con 0x7f6588163960 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6588162bc0 0x7f658815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6588162bc0 0x7f658815bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38716/0 (socket says 172.21.15.94:38716) 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 -- 172.21.15.94:0/587935547 learned_addr learned my addr 172.21.15.94:0/587935547 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f6587fff640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6588163960 0x7f65880b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 -- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6588163960 msgr2=0x7f65880b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6588163960 0x7f65880b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 -- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6588162fa0 msgr2=0x7f6588163420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6588162fa0 0x7f6588163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 -- 172.21.15.94:0/587935547 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658815c450 con 0x7f6588162bc0 2024-09-11T23:15:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f65877fe640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6588162bc0 0x7f658815bd90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f65780b0040 tx=0x7f65780197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f656ffff640 1 -- 172.21.15.94:0/587935547 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780b2040 con 0x7f6588162bc0 2024-09-11T23:15:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f656ffff640 1 -- 172.21.15.94:0/587935547 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780a5d60 con 0x7f6588162bc0 2024-09-11T23:15:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658815c730 con 0x7f6588162bc0 2024-09-11T23:15:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65880b3020 con 0x7f6588162bc0 2024-09-11T23:15:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f656ffff640 1 -- 172.21.15.94:0/587935547 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578009690 con 0x7f6588162bc0 2024-09-11T23:15:17.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65680052a0 con 0x7f6588162bc0 2024-09-11T23:15:17.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.161+0000 7f656ffff640 1 -- 172.21.15.94:0/587935547 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65780ad640 con 0x7f6588162bc0 2024-09-11T23:15:17.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.165+0000 7f656ffff640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65740678f0 0x7f6574069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:17.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.165+0000 7f656ffff640 1 -- 172.21.15.94:0/587935547 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f65781202b0 con 0x7f6588162bc0 2024-09-11T23:15:17.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.165+0000 7f6586ffd640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65740678f0 0x7f6574069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:17.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.165+0000 7f6586ffd640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65740678f0 0x7f6574069db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f657c006e90 tx=0x7f657c006e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:17.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.169+0000 7f656ffff640 1 -- 172.21.15.94:0/587935547 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6578016760 con 0x7f6588162bc0 2024-09-11T23:15:17.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.329+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f6568005590 con 0x7f6588162bc0 2024-09-11T23:15:17.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:17.997+0000 7f656ffff640 1 -- 172.21.15.94:0/587935547 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f65780f0b60 con 0x7f6588162bc0 2024-09-11T23:15:17.999 INFO:teuthology.orchestra.run.smithi094.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T23:15:18.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65740678f0 msgr2=0x7f6574069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:18.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65740678f0 0x7f6574069db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f657c006e90 tx=0x7f657c006e20 comp rx=0 tx=0).stop 2024-09-11T23:15:18.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6588162bc0 msgr2=0x7f658815bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:18.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6588162bc0 0x7f658815bd90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f65780b0040 tx=0x7f65780197c0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 shutdown_connections 2024-09-11T23:15:18.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6588163960 0x7f65880b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6588162fa0 0x7f6588163420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65740678f0 0x7f6574069db0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 --2- 172.21.15.94:0/587935547 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6588162bc0 0x7f658815bd90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.001+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 >> 172.21.15.94:0/587935547 conn(0x7f65880b1bf0 msgr2=0x7f6588164f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:18.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.033+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 shutdown_connections 2024-09-11T23:15:18.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.033+0000 7f658ce04640 1 -- 172.21.15.94:0/587935547 wait complete. 2024-09-11T23:15:18.058 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T23:15:18.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.173+0000 7f72f36b7640 1 Processor -- start 2024-09-11T23:15:18.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.173+0000 7f72f36b7640 1 -- start start 2024-09-11T23:15:18.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f72ec15bec0 0x7f72ec0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:18.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72ec0af470 0x7f72ec06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:18.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72ec0b3290 con 0x7f72ec15c2a0 2024-09-11T23:15:18.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f72ec0b3570 con 0x7f72ec15bec0 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f72ec0b3850 con 0x7f72ec0af470 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f72ec15bec0 0x7f72ec0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f72ec15bec0 0x7f72ec0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38720/0 (socket says 172.21.15.94:38720) 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 -- 172.21.15.94:0/545184990 learned_addr learned my addr 172.21.15.94:0/545184990 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 -- 172.21.15.94:0/545184990 >> v2:172.21.15.155:3300/0 conn(0x7f72ec0af470 msgr2=0x7f72ec06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 --2- 172.21.15.94:0/545184990 >> v2:172.21.15.155:3300/0 conn(0x7f72ec0af470 0x7f72ec06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 -- 172.21.15.94:0/545184990 >> v1:172.21.15.155:6789/0 conn(0x7f72ec15c2a0 legacy=0x7f72ec0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:18.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 -- 172.21.15.94:0/545184990 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec0b3b30 con 0x7f72ec15bec0 2024-09-11T23:15:18.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f1453640 1 --2- 172.21.15.94:0/545184990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec15bec0 0x7f72ec0ad200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0b2fb0 tx=0x7f72e801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45eb1625824ae5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:18.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72e3fff640 1 -- 172.21.15.94:0/545184990 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80aa610 con 0x7f72ec15bec0 2024-09-11T23:15:18.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72e3fff640 1 -- 172.21.15.94:0/545184990 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e80af070 con 0x7f72ec15bec0 2024-09-11T23:15:18.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72e3fff640 1 -- 172.21.15.94:0/545184990 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80aa9d0 con 0x7f72ec15bec0 2024-09-11T23:15:18.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- 172.21.15.94:0/545184990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec15bec0 msgr2=0x7f72ec0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:18.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 --2- 172.21.15.94:0/545184990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec15bec0 0x7f72ec0ad200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0b2fb0 tx=0x7f72e801c4b0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- 172.21.15.94:0/545184990 shutdown_connections 2024-09-11T23:15:18.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 --2- 172.21.15.94:0/545184990 >> v2:172.21.15.155:3300/0 conn(0x7f72ec0af470 0x7f72ec06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 --2- 172.21.15.94:0/545184990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec15bec0 0x7f72ec0ad200 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- 172.21.15.94:0/545184990 >> 172.21.15.94:0/545184990 conn(0x7f72ec0b1f90 msgr2=0x7f72ec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:18.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- 172.21.15.94:0/545184990 shutdown_connections 2024-09-11T23:15:18.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.177+0000 7f72f36b7640 1 -- 172.21.15.94:0/545184990 wait complete. 2024-09-11T23:15:18.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 Processor -- start 2024-09-11T23:15:18.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 -- start start 2024-09-11T23:15:18.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec0af470 0x7f72ec14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:18.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ec15bec0 0x7f72ec149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ec15c2a0 0x7f72ec0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec06ed50 con 0x7f72ec0af470 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec0ad740 con 0x7f72ec15c2a0 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f72ec06eed0 con 0x7f72ec15bec0 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec0af470 0x7f72ec14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec0af470 0x7f72ec14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38726/0 (socket says 172.21.15.94:38726) 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 -- 172.21.15.94:0/2677524192 learned_addr learned my addr 172.21.15.94:0/2677524192 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f0c52640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ec15bec0 0x7f72ec149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1c54640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ec15c2a0 0x7f72ec0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 -- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ec15bec0 msgr2=0x7f72ec149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ec15bec0 0x7f72ec149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 -- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ec15c2a0 msgr2=0x7f72ec0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ec15c2a0 0x7f72ec0aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 -- 172.21.15.94:0/2677524192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec151300 con 0x7f72ec0af470 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1c54640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ec15c2a0 0x7f72ec0aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f1453640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec0af470 0x7f72ec14e4b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72e80ac040 tx=0x7f72e801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72e1ffb640 1 -- 172.21.15.94:0/2677524192 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80b3800 con 0x7f72ec0af470 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72e1ffb640 1 -- 172.21.15.94:0/2677524192 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e80b39c0 con 0x7f72ec0af470 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72e1ffb640 1 -- 172.21.15.94:0/2677524192 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80b3db0 con 0x7f72ec0af470 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ec14f620 con 0x7f72ec0af470 2024-09-11T23:15:18.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ec14fbe0 con 0x7f72ec0af470 2024-09-11T23:15:18.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.181+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec06f210 con 0x7f72ec0af470 2024-09-11T23:15:18.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.185+0000 7f72e1ffb640 1 -- 172.21.15.94:0/2677524192 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72e80c6390 con 0x7f72ec0af470 2024-09-11T23:15:18.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.185+0000 7f72e1ffb640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d00678c0 0x7f72d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:18.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.185+0000 7f72e1ffb640 1 -- 172.21.15.94:0/2677524192 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f72e8120760 con 0x7f72ec0af470 2024-09-11T23:15:18.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.185+0000 7f72f0c52640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d00678c0 0x7f72d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:18.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.185+0000 7f72f0c52640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d00678c0 0x7f72d0069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72ec14d2d0 tx=0x7f72dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:18.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.189+0000 7f72e1ffb640 1 -- 172.21.15.94:0/2677524192 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f72e80c3060 con 0x7f72ec0af470 2024-09-11T23:15:18.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:18.385+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f72ec06fcd0 con 0x7f72ec0af470 2024-09-11T23:15:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.005+0000 7f72e1ffb640 1 -- 172.21.15.94:0/2677524192 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f72e80a7070 con 0x7f72ec0af470 2024-09-11T23:15:19.008 INFO:teuthology.orchestra.run.smithi094.stderr:added data pool 4 to fsmap 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d00678c0 msgr2=0x7f72d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d00678c0 0x7f72d0069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72ec14d2d0 tx=0x7f72dc008040 comp rx=0 tx=0).stop 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec0af470 msgr2=0x7f72ec14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec0af470 0x7f72ec14e4b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72e80ac040 tx=0x7f72e801acf0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 shutdown_connections 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ec15c2a0 0x7f72ec0aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ec15bec0 0x7f72ec149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d00678c0 0x7f72d0069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 --2- 172.21.15.94:0/2677524192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec0af470 0x7f72ec14e4b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 >> 172.21.15.94:0/2677524192 conn(0x7f72ec0b1f90 msgr2=0x7f72ec159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 shutdown_connections 2024-09-11T23:15:19.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.009+0000 7f72f36b7640 1 -- 172.21.15.94:0/2677524192 wait complete. 2024-09-11T23:15:19.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:19.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f89270b8640 1 Processor -- start 2024-09-11T23:15:19.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f89270b8640 1 -- start start 2024-09-11T23:15:19.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f89270b8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 0x7f8920141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f89270b8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892013fb30 con 0x7f8920156720 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f89270b8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892013fe10 con 0x7f8920140bd0 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f89270b8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8920141570 con 0x7f89200b4b20 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f8924e54640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8920156720 0x7f89200b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52094/0 (socket says 172.21.15.94:52094) 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f8924e54640 1 -- 172.21.15.94:0/778519657 learned_addr learned my addr 172.21.15.94:0/778519657 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f8925655640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 0x7f8920141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128025764 0 0) 0x7f892013fb30 con 0x7f8920156720 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8908003530 con 0x7f8920156720 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3819240954 0 0) 0x7f8908003530 con 0x7f8920156720 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 msgr2=0x7f8920141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f891f7fe640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 0x7f8920141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.157+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 >> v1:172.21.15.155:6789/0 conn(0x7f8920140bd0 legacy=0x7f89200b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89201400f0 con 0x7f8920156720 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f8910001680 con 0x7f8920156720 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 >> v1:172.21.15.94:6789/0 conn(0x7f8920156720 legacy=0x7f89200b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 0x7f89080039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8908004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8908004d50 0x7f89080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f890800ba80 con 0x7f8908003f70 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f890800bc30 con 0x7f8908004d50 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f890800be30 con 0x7f89200b4b20 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891ffff640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8908004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f8924e54640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 0x7f89080039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f8925655640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8908004d50 0x7f89080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891ffff640 1 -- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 msgr2=0x7f89080039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891ffff640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89200b4b20 0x7f89080039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891ffff640 1 -- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8908004d50 msgr2=0x7f89080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891ffff640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8908004d50 0x7f89080051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891ffff640 1 -- 172.21.15.94:0/778519657 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8908003530 con 0x7f8908003f70 2024-09-11T23:15:19.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891ffff640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8908004810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8914001780 tx=0x7f891401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e5fb5fc61e35cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89140013a0 con 0x7f8908003f70 2024-09-11T23:15:19.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140052f0 con 0x7f8908003f70 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f891f7fe640 1 -- 172.21.15.94:0/778519657 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914003840 con 0x7f8908003f70 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f89270b8640 1 -- 172.21.15.94:0/778519657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 msgr2=0x7f8908004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f89270b8640 1 --2- 172.21.15.94:0/778519657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8908004810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8914001780 tx=0x7f891401c420 comp rx=0 tx=0).stop 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f8925655640 1 -- 172.21.15.94:0/778519657 reap_dead start 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f89270b8640 1 -- 172.21.15.94:0/778519657 shutdown_connections 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f89270b8640 1 -- 172.21.15.94:0/778519657 >> 172.21.15.94:0/778519657 conn(0x7f892006c0c0 msgr2=0x7f892006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f89270b8640 1 -- 172.21.15.94:0/778519657 shutdown_connections 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.161+0000 7f89270b8640 1 -- 172.21.15.94:0/778519657 wait complete. 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 Processor -- start 2024-09-11T23:15:19.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 -- start start 2024-09-11T23:15:19.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8920153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f892015a6e0 0x7f892015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f892013e6a0 0x7f892013eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f89200728d0 con 0x7f8908003f70 2024-09-11T23:15:19.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8920140740 con 0x7f892015a6e0 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89200b5d20 con 0x7f892013e6a0 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8920153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8920153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38752/0 (socket says 172.21.15.94:38752) 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 -- 172.21.15.94:0/1565558149 learned_addr learned my addr 172.21.15.94:0/1565558149 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8925655640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f892013e6a0 0x7f892013eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f891ffff640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f892015a6e0 0x7f892015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 -- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f892013e6a0 msgr2=0x7f892013eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f892013e6a0 0x7f892013eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 -- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f892015a6e0 msgr2=0x7f892015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f892015a6e0 0x7f892015ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 -- 172.21.15.94:0/1565558149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892013f060 con 0x7f8908003f70 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8925655640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f892013e6a0 0x7f892013eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:15:19.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f8924e54640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8920153d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8910011810 tx=0x7f8910011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f891d7fa640 1 -- 172.21.15.94:0/1565558149 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910010040 con 0x7f8908003f70 2024-09-11T23:15:19.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f891d7fa640 1 -- 172.21.15.94:0/1565558149 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891001a070 con 0x7f8908003f70 2024-09-11T23:15:19.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892015c8c0 con 0x7f8908003f70 2024-09-11T23:15:19.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f891d7fa640 1 -- 172.21.15.94:0/1565558149 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891000fd80 con 0x7f8908003f70 2024-09-11T23:15:19.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892015ce80 con 0x7f8908003f70 2024-09-11T23:15:19.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892013f6e0 con 0x7f8908003f70 2024-09-11T23:15:19.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.165+0000 7f891d7fa640 1 -- 172.21.15.94:0/1565558149 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f891001f460 con 0x7f8908003f70 2024-09-11T23:15:19.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.169+0000 7f891d7fa640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f890c0678c0 0x7f890c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.169+0000 7f891d7fa640 1 -- 172.21.15.94:0/1565558149 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8910089120 con 0x7f8908003f70 2024-09-11T23:15:19.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.169+0000 7f891ffff640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f890c0678c0 0x7f890c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.169+0000 7f891ffff640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f890c0678c0 0x7f890c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8914001750 tx=0x7f89140011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.173+0000 7f891d7fa640 1 -- 172.21.15.94:0/1565558149 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f892013f060 con 0x7f8908003f70 2024-09-11T23:15:19.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.369+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89200d2830 con 0x7f8908003f70 2024-09-11T23:15:19.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.369+0000 7f891d7fa640 1 -- 172.21.15.94:0/1565558149 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5219 (secure 0 0 0) 0x7f8910059920 con 0x7f8908003f70 2024-09-11T23:15:19.370 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:19.370 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"btime":"2024-09-11T23:15:19:003767+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:18.390620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:15:19.371 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-09-11T23:15:19.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f890c0678c0 msgr2=0x7f890c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f890c0678c0 0x7f890c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8914001750 tx=0x7f89140011a0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 msgr2=0x7f8920153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8920153d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8910011810 tx=0x7f8910011cd0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 shutdown_connections 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f892013e6a0 0x7f892013eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f892015a6e0 0x7f892015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f890c0678c0 0x7f890c069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 --2- 172.21.15.94:0/1565558149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8908003f70 0x7f8920153d90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 >> 172.21.15.94:0/1565558149 conn(0x7f892006c0c0 msgr2=0x7f89200b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 shutdown_connections 2024-09-11T23:15:19.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.373+0000 7f89270b8640 1 -- 172.21.15.94:0/1565558149 wait complete. 2024-09-11T23:15:19.389 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:19.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4c16a640 1 Processor -- start 2024-09-11T23:15:19.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4c16a640 1 -- start start 2024-09-11T23:15:19.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4c16a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed441520a0 0x7fed4406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4c16a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed44070250 con 0x7fed4415f3a0 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4c16a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed440aede0 con 0x7fed4406fe50 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4c16a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fed44152480 con 0x7fed441520a0 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed49f06640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed441520a0 0x7fed4406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4a707640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fed4415f3a0 0x7fed440adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52104/0 (socket says 172.21.15.94:52104) 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed49f06640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed441520a0 0x7fed4406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38762/0 (socket says 172.21.15.94:38762) 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed4a707640 1 -- 172.21.15.94:0/796036436 learned_addr learned my addr 172.21.15.94:0/796036436 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed49f06640 1 -- 172.21.15.94:0/796036436 >> v1:172.21.15.155:6789/0 conn(0x7fed4406fe50 legacy=0x7fed4415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed49f06640 1 -- 172.21.15.94:0/796036436 >> v1:172.21.15.94:6789/0 conn(0x7fed4415f3a0 legacy=0x7fed440adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.501+0000 7fed49f06640 1 -- 172.21.15.94:0/796036436 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4415fa10 con 0x7fed441520a0 2024-09-11T23:15:19.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed49f06640 1 --2- 172.21.15.94:0/796036436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed4406f910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed400097c0 tx=0x7fed4001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd7627e63abf186 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed48f04640 1 -- 172.21.15.94:0/796036436 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed400b0070 con 0x7fed441520a0 2024-09-11T23:15:19.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed48f04640 1 -- 172.21.15.94:0/796036436 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40004230 con 0x7fed441520a0 2024-09-11T23:15:19.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed48f04640 1 -- 172.21.15.94:0/796036436 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed440aeba0 con 0x7fed441520a0 2024-09-11T23:15:19.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 -- 172.21.15.94:0/796036436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 msgr2=0x7fed4406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 --2- 172.21.15.94:0/796036436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed4406f910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed400097c0 tx=0x7fed4001c460 comp rx=0 tx=0).stop 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 -- 172.21.15.94:0/796036436 shutdown_connections 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 --2- 172.21.15.94:0/796036436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed4406f910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 -- 172.21.15.94:0/796036436 >> 172.21.15.94:0/796036436 conn(0x7fed440b1f90 msgr2=0x7fed440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 -- 172.21.15.94:0/796036436 shutdown_connections 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 -- 172.21.15.94:0/796036436 wait complete. 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 Processor -- start 2024-09-11T23:15:19.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.505+0000 7fed4c16a640 1 -- start start 2024-09-11T23:15:19.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4406fe50 0x7fed4414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed440cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4415f3a0 0x7fed44150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fed44073d30 con 0x7fed441520a0 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fed44073a50 con 0x7fed4415f3a0 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fed44168f20 con 0x7fed4406fe50 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed440cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed440cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38770/0 (socket says 172.21.15.94:38770) 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 -- 172.21.15.94:0/2939231058 learned_addr learned my addr 172.21.15.94:0/2939231058 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 -- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4406fe50 msgr2=0x7fed4414b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4a707640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4415f3a0 0x7fed44150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4406fe50 0x7fed4414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 -- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4415f3a0 msgr2=0x7fed44150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4415f3a0 0x7fed44150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 -- 172.21.15.94:0/2939231058 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4414fe10 con 0x7fed441520a0 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49705640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed440cd690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed3400b410 tx=0x7fed3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed3a7fc640 1 -- 172.21.15.94:0/2939231058 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34015030 con 0x7fed441520a0 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed3a7fc640 1 -- 172.21.15.94:0/2939231058 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed34004020 con 0x7fed441520a0 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed3a7fc640 1 -- 172.21.15.94:0/2939231058 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34004450 con 0x7fed441520a0 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed441500f0 con 0x7fed441520a0 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed44099820 con 0x7fed441520a0 2024-09-11T23:15:19.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4406f910 con 0x7fed441520a0 2024-09-11T23:15:19.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed3a7fc640 1 -- 172.21.15.94:0/2939231058 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed34018070 con 0x7fed441520a0 2024-09-11T23:15:19.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed3a7fc640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed280678c0 0x7fed28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed3a7fc640 1 -- 172.21.15.94:0/2939231058 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fed34085c00 con 0x7fed441520a0 2024-09-11T23:15:19.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.509+0000 7fed49f06640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed280678c0 0x7fed28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.513+0000 7fed49f06640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed280678c0 0x7fed28069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed400ad000 tx=0x7fed40004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.513+0000 7fed3a7fc640 1 -- 172.21.15.94:0/2939231058 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed3408c080 con 0x7fed441520a0 2024-09-11T23:15:19.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.665+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed44150880 con 0x7fed441520a0 2024-09-11T23:15:19.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.665+0000 7fed3a7fc640 1 -- 172.21.15.94:0/2939231058 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18635 (secure 0 0 0) 0x7fed34056400 con 0x7fed441520a0 2024-09-11T23:15:19.667 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:19.667 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:18.390359+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed280678c0 msgr2=0x7fed28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed280678c0 0x7fed28069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed400ad000 tx=0x7fed40004740 comp rx=0 tx=0).stop 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 msgr2=0x7fed440cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed440cd690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed3400b410 tx=0x7fed3400b8d0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 shutdown_connections 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4415f3a0 0x7fed44150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed280678c0 0x7fed28069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed441520a0 0x7fed440cd690 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 --2- 172.21.15.94:0/2939231058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4406fe50 0x7fed4414b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 >> 172.21.15.94:0/2939231058 conn(0x7fed440b1f90 msgr2=0x7fed440b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 shutdown_connections 2024-09-11T23:15:19.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.669+0000 7fed4c16a640 1 -- 172.21.15.94:0/2939231058 wait complete. 2024-09-11T23:15:19.686 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:19.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f0914350640 1 Processor -- start 2024-09-11T23:15:19.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f0914350640 1 -- start start 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f0914350640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f090c160900 0x7f090c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f0914350640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c0d0d70 con 0x7f090c160520 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f0914350640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c15d390 con 0x7f090c071e60 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f0914350640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f090c0d1640 con 0x7f090c160900 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f090c160520 0x7f090c071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52118/0 (socket says 172.21.15.94:52118) 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 -- 172.21.15.94:0/1651380513 learned_addr learned my addr 172.21.15.94:0/1651380513 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001058161 0 0) 0x7f0908001120 con 0x7f090c160520 2024-09-11T23:15:19.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f8003530 con 0x7f090c160520 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09118eb640 1 --2- 172.21.15.94:0/1651380513 >> v2:172.21.15.155:3300/0 conn(0x7f090c160900 0x7f090c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2072903521 0 0) 0x7f08f8003530 con 0x7f090c160520 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 >> v2:172.21.15.155:3300/0 conn(0x7f090c160900 msgr2=0x7f090c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 --2- 172.21.15.94:0/1651380513 >> v2:172.21.15.155:3300/0 conn(0x7f090c160900 0x7f090c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 >> v1:172.21.15.155:6789/0 conn(0x7f090c071e60 legacy=0x7f090c15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c0d0ff0 con 0x7f090c160520 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f0908001850 con 0x7f090c160520 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 >> v1:172.21.15.94:6789/0 conn(0x7f090c160520 legacy=0x7f090c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08f80039c0 0x7f08f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08f8004810 0x7f08f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08f80052f0 0x7f08f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f090c0d1640 con 0x7f08f80039c0 2024-09-11T23:15:19.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f08f800c1a0 con 0x7f08f8004810 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f08f800c3a0 con 0x7f08f80052f0 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08f80039c0 0x7f08f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 -- 172.21.15.94:0/1651380513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08f80052f0 msgr2=0x7f08f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09118eb640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08f8004810 0x7f08f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08f80052f0 0x7f08f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 -- 172.21.15.94:0/1651380513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08f8004810 msgr2=0x7f08f8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08f8004810 0x7f08f8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09120ec640 1 -- 172.21.15.94:0/1651380513 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f8003530 con 0x7f08f80039c0 2024-09-11T23:15:19.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.797+0000 7f09128ed640 1 -- 172.21.15.94:0/1651380513 reap_dead start 2024-09-11T23:15:19.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f09120ec640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08f80039c0 0x7f08f8003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f090800c490 tx=0x7f090801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d9efe422c45d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090800c0e0 con 0x7f08f80039c0 2024-09-11T23:15:19.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09080a9020 con 0x7f08f80039c0 2024-09-11T23:15:19.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f09110ea640 1 -- 172.21.15.94:0/1651380513 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908005ae0 con 0x7f08f80039c0 2024-09-11T23:15:19.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 -- 172.21.15.94:0/1651380513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08f80039c0 msgr2=0x7f08f8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08f80039c0 0x7f08f8003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f090800c490 tx=0x7f090801cc40 comp rx=0 tx=0).stop 2024-09-11T23:15:19.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 -- 172.21.15.94:0/1651380513 shutdown_connections 2024-09-11T23:15:19.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 --2- 172.21.15.94:0/1651380513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08f80039c0 0x7f08f8003dc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 -- 172.21.15.94:0/1651380513 >> 172.21.15.94:0/1651380513 conn(0x7f090c06c0c0 msgr2=0x7f090c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 -- 172.21.15.94:0/1651380513 shutdown_connections 2024-09-11T23:15:19.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 -- 172.21.15.94:0/1651380513 wait complete. 2024-09-11T23:15:19.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 Processor -- start 2024-09-11T23:15:19.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.801+0000 7f0914350640 1 -- start start 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08f80039c0 0x7f090c13c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090c15dd50 0x7f090c1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090c154a00 0x7f090c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f090c15ce00 con 0x7f090c154a00 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f090c06ede0 con 0x7f090c15dd50 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f090c15cf80 con 0x7f08f80039c0 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090c154a00 0x7f090c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090c154a00 0x7f090c154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38792/0 (socket says 172.21.15.94:38792) 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 -- 172.21.15.94:0/2701286245 learned_addr learned my addr 172.21.15.94:0/2701286245 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09118eb640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090c15dd50 0x7f090c1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 -- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08f80039c0 msgr2=0x7f090c13c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08f80039c0 0x7f090c13c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 -- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090c15dd50 msgr2=0x7f090c1590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090c15dd50 0x7f090c1590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 -- 172.21.15.94:0/2701286245 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c139220 con 0x7f090c154a00 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09128ed640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090c154a00 0x7f090c154e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f090c0cff60 tx=0x7f090400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0902ffd640 1 -- 172.21.15.94:0/2701286245 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904017070 con 0x7f090c154a00 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0902ffd640 1 -- 172.21.15.94:0/2701286245 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904005d50 con 0x7f090c154a00 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090c13b1b0 con 0x7f090c154a00 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0902ffd640 1 -- 172.21.15.94:0/2701286245 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090400a850 con 0x7f090c154a00 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090c139490 con 0x7f090c154a00 2024-09-11T23:15:19.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090c0d1ab0 con 0x7f090c154a00 2024-09-11T23:15:19.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0902ffd640 1 -- 172.21.15.94:0/2701286245 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f090401a070 con 0x7f090c154a00 2024-09-11T23:15:19.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0902ffd640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08f00678f0 0x7f08f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f0902ffd640 1 -- 172.21.15.94:0/2701286245 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0904085210 con 0x7f090c154a00 2024-09-11T23:15:19.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.805+0000 7f09120ec640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08f00678f0 0x7f08f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.809+0000 7f09120ec640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08f00678f0 0x7f08f0069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09080aa000 tx=0x7f090c0d11c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.809+0000 7f0902ffd640 1 -- 172.21.15.94:0/2701286245 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0904055a10 con 0x7f090c154a00 2024-09-11T23:15:19.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.969+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f090c15b5a0 con 0x7f090c154a00 2024-09-11T23:15:19.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0902ffd640 1 -- 172.21.15.94:0/2701286245 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18635 (secure 0 0 0) 0x7f0904055310 con 0x7f090c154a00 2024-09-11T23:15:19.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:19.973 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:18.390359+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08f00678f0 msgr2=0x7f08f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08f00678f0 0x7f08f0069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09080aa000 tx=0x7f090c0d11c0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090c154a00 msgr2=0x7f090c154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090c154a00 0x7f090c154e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f090c0cff60 tx=0x7f090400cb90 comp rx=0 tx=0).stop 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 shutdown_connections 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08f00678f0 0x7f08f0069db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090c154a00 0x7f090c154e80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090c15dd50 0x7f090c1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 --2- 172.21.15.94:0/2701286245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08f80039c0 0x7f090c13c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 >> 172.21.15.94:0/2701286245 conn(0x7f090c06c0c0 msgr2=0x7f090c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 shutdown_connections 2024-09-11T23:15:19.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:19.973+0000 7f0914350640 1 -- 172.21.15.94:0/2701286245 wait complete. 2024-09-11T23:15:20.019 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:20.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.129+0000 7fa4f869c640 1 Processor -- start 2024-09-11T23:15:20.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f869c640 1 -- start start 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f869c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f00d24a0 0x7fa4f00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f869c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4f00d2880 0x7fa4f00d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f869c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f00cf4f0 con 0x7fa4f00d4300 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f869c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f00d0100 con 0x7fa4f00d2880 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f869c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f00cf7d0 con 0x7fa4f00d24a0 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5c37640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa4f00d4300 0x7fa4f00d4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44182/0 (socket says 172.21.15.94:44182) 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5c37640 1 -- 172.21.15.94:0/1325256261 learned_addr learned my addr 172.21.15.94:0/1325256261 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6c39640 1 --2- 172.21.15.94:0/1325256261 >> v2:172.21.15.155:3300/0 conn(0x7fa4f00d2880 0x7fa4f00d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f00d24a0 0x7fa4f00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743049429 0 0) 0x7fa4f00cf4f0 con 0x7fa4f00d4300 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4d8003530 con 0x7fa4f00d4300 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1372783161 0 0) 0x7fa4d8003530 con 0x7fa4f00d4300 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f00d24a0 msgr2=0x7fa4f00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f00d24a0 0x7fa4f00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 >> v2:172.21.15.155:3300/0 conn(0x7fa4f00d2880 msgr2=0x7fa4f00d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 --2- 172.21.15.94:0/1325256261 >> v2:172.21.15.155:3300/0 conn(0x7fa4f00d2880 0x7fa4f00d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f00cfab0 con 0x7fa4f00d4300 2024-09-11T23:15:20.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fa4e8001a00 con 0x7fa4f00d4300 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 >> v1:172.21.15.94:6789/0 conn(0x7fa4f00d4300 legacy=0x7fa4f00d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4d80039c0 0x7fa4d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8004810 0x7fa4d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d80051d0 0x7fa4d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f00d0100 con 0x7fa4d80039c0 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f00cf7d0 con 0x7fa4d80051d0 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d800bf40 con 0x7fa4d8004810 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f00d24a0 0x7fa4f00cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4d80039c0 0x7fa4d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6c39640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d80051d0 0x7fa4d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5c37640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8004810 0x7fa4d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 -- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8004810 msgr2=0x7fa4d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8004810 0x7fa4d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 -- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d80051d0 msgr2=0x7fa4d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:20.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d80051d0 0x7fa4d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f6438640 1 -- 172.21.15.94:0/1325256261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d8003530 con 0x7fa4d80039c0 2024-09-11T23:15:20.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.133+0000 7fa4f5c37640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8004810 0x7fa4d8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:20.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f6438640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4d80039c0 0x7fa4d8003de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00d5320 tx=0x7fa4e401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d483b13ad1e1889 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:20.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40b0070 con 0x7fa4d80039c0 2024-09-11T23:15:20.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e40ab600 con 0x7fa4d80039c0 2024-09-11T23:15:20.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f5436640 1 -- 172.21.15.94:0/1325256261 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400f040 con 0x7fa4d80039c0 2024-09-11T23:15:20.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- 172.21.15.94:0/1325256261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4d80039c0 msgr2=0x7fa4d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 --2- 172.21.15.94:0/1325256261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4d80039c0 0x7fa4d8003de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00d5320 tx=0x7fa4e401c3e0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f6c39640 1 -- 172.21.15.94:0/1325256261 reap_dead start 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- 172.21.15.94:0/1325256261 shutdown_connections 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- 172.21.15.94:0/1325256261 >> 172.21.15.94:0/1325256261 conn(0x7fa4f008bf90 msgr2=0x7fa4f009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- 172.21.15.94:0/1325256261 shutdown_connections 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- 172.21.15.94:0/1325256261 wait complete. 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 Processor -- start 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- start start 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f015fa30 0x7fa4f00b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4f015c230 0x7fa4f0160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4f0160690 0x7fa4f0162020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f006d920 con 0x7fa4f015c230 2024-09-11T23:15:20.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f006d7a0 con 0x7fa4f0160690 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f869c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f006daa0 con 0x7fa4f015fa30 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f5c37640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4f015c230 0x7fa4f0160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f5c37640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4f015c230 0x7fa4f0160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36174/0 (socket says 172.21.15.94:36174) 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.137+0000 7fa4f5c37640 1 -- 172.21.15.94:0/658805115 learned_addr learned my addr 172.21.15.94:0/658805115 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f6438640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f015fa30 0x7fa4f00b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f6c39640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4f0160690 0x7fa4f0162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f5c37640 1 -- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f015fa30 msgr2=0x7fa4f00b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f5c37640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f015fa30 0x7fa4f00b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f5c37640 1 -- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4f0160690 msgr2=0x7fa4f0162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f5c37640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4f0160690 0x7fa4f0162020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f5c37640 1 -- 172.21.15.94:0/658805115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f00b9450 con 0x7fa4f015c230 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f6c39640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4f0160690 0x7fa4f0162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f5c37640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4f015c230 0x7fa4f0160150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8001ba0 tx=0x7fa4e800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4eeffd640 1 -- 172.21.15.94:0/658805115 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8019070 con 0x7fa4f015c230 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4eeffd640 1 -- 172.21.15.94:0/658805115 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e80072d0 con 0x7fa4f015c230 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f00b9730 con 0x7fa4f015c230 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4eeffd640 1 -- 172.21.15.94:0/658805115 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8007680 con 0x7fa4f015c230 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f00b9140 con 0x7fa4f015c230 2024-09-11T23:15:20.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f006deb0 con 0x7fa4f015c230 2024-09-11T23:15:20.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4eeffd640 1 -- 172.21.15.94:0/658805115 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4e801c070 con 0x7fa4f015c230 2024-09-11T23:15:20.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4eeffd640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4dc0678c0 0x7fa4dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4eeffd640 1 -- 172.21.15.94:0/658805115 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa4e8086580 con 0x7fa4f015c230 2024-09-11T23:15:20.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f6438640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4dc0678c0 0x7fa4dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.141+0000 7fa4f6438640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4dc0678c0 0x7fa4dc069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00d5320 tx=0x7fa4e40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:20.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.145+0000 7fa4eeffd640 1 -- 172.21.15.94:0/658805115 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4e800be20 con 0x7fa4f015c230 2024-09-11T23:15:20.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.333+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4f00b9c50 con 0x7fa4f015c230 2024-09-11T23:15:20.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.333+0000 7fa4eeffd640 1 -- 172.21.15.94:0/658805115 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5219 (secure 0 0 0) 0x7fa4e8056cf0 con 0x7fa4f015c230 2024-09-11T23:15:20.334 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:20.334 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"btime":"2024-09-11T23:15:19:003767+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:18.390620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:15:20.334 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-09-11T23:15:20.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4dc0678c0 msgr2=0x7fa4dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4dc0678c0 0x7fa4dc069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00d5320 tx=0x7fa4e40046d0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4f015c230 msgr2=0x7fa4f0160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4f015c230 0x7fa4f0160150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8001ba0 tx=0x7fa4e800b4a0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 shutdown_connections 2024-09-11T23:15:20.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4f0160690 0x7fa4f0162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4dc0678c0 0x7fa4dc069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4f015c230 0x7fa4f0160150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 --2- 172.21.15.94:0/658805115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4f015fa30 0x7fa4f00b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 >> 172.21.15.94:0/658805115 conn(0x7fa4f008bf90 msgr2=0x7fa4f00b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:20.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 shutdown_connections 2024-09-11T23:15:20.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.337+0000 7fa4f869c640 1 -- 172.21.15.94:0/658805115 wait complete. 2024-09-11T23:15:20.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:20.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.469+0000 7f390b35d640 1 Processor -- start 2024-09-11T23:15:20.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.469+0000 7f390b35d640 1 -- start start 2024-09-11T23:15:20.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f390b35d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39040d3060 0x7f39040cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f390b35d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39040cf450 0x7f390406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f390b35d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39040d0300 con 0x7f3904161a60 2024-09-11T23:15:20.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f390b35d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f39040b0f60 con 0x7f39040cf450 2024-09-11T23:15:20.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f390b35d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39040cfd40 con 0x7f39040d3060 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39098fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39040cf450 0x7f390406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39088f8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39040d3060 0x7f39040cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39090f9640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f3904161a60 0x7f39040d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:39800/0 (socket says 172.21.15.94:39800) 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39090f9640 1 -- 172.21.15.94:0/384241417 learned_addr learned my addr 172.21.15.94:0/384241417 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f3903fff640 1 -- 172.21.15.94:0/384241417 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792039293 0 0) 0x7f38f40014a0 con 0x7f3904161a60 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f3903fff640 1 -- 172.21.15.94:0/384241417 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38ec003530 con 0x7f3904161a60 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39088f8640 1 -- 172.21.15.94:0/384241417 >> v2:172.21.15.155:3300/0 conn(0x7f39040cf450 msgr2=0x7f390406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39088f8640 1 --2- 172.21.15.94:0/384241417 >> v2:172.21.15.155:3300/0 conn(0x7f39040cf450 0x7f390406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39088f8640 1 -- 172.21.15.94:0/384241417 >> v1:172.21.15.155:6789/0 conn(0x7f3904161a60 legacy=0x7f39040d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.473+0000 7f39088f8640 1 -- 172.21.15.94:0/384241417 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39040d0020 con 0x7f39040d3060 2024-09-11T23:15:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 --2- 172.21.15.94:0/384241417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39040d3060 0x7f39040cef10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38f80097c0 tx=0x7f38f801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254f613be7b43744 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f3903fff640 1 -- 172.21.15.94:0/384241417 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80b1070 con 0x7f39040d3060 2024-09-11T23:15:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f3903fff640 1 -- 172.21.15.94:0/384241417 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f80a8050 con 0x7f39040d3060 2024-09-11T23:15:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f3903fff640 1 -- 172.21.15.94:0/384241417 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80ac840 con 0x7f39040d3060 2024-09-11T23:15:20.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- 172.21.15.94:0/384241417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39040d3060 msgr2=0x7f39040cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 --2- 172.21.15.94:0/384241417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39040d3060 0x7f39040cef10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38f80097c0 tx=0x7f38f801c3e0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- 172.21.15.94:0/384241417 shutdown_connections 2024-09-11T23:15:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 --2- 172.21.15.94:0/384241417 >> v2:172.21.15.155:3300/0 conn(0x7f39040cf450 0x7f390406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 --2- 172.21.15.94:0/384241417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39040d3060 0x7f39040cef10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- 172.21.15.94:0/384241417 >> 172.21.15.94:0/384241417 conn(0x7f390408bf90 msgr2=0x7f390409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- 172.21.15.94:0/384241417 shutdown_connections 2024-09-11T23:15:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- 172.21.15.94:0/384241417 wait complete. 2024-09-11T23:15:20.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 Processor -- start 2024-09-11T23:15:20.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- start start 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39040cf450 0x7f3904156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39040d3060 0x7f39040b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3904161a60 0x7f390415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f390416af20 con 0x7f39040d3060 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f390406e610 con 0x7f39040cf450 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f390b35d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f390416b0a0 con 0x7f3904161a60 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39040d3060 0x7f39040b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39040d3060 0x7f39040b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36184/0 (socket says 172.21.15.94:36184) 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 -- 172.21.15.94:0/4160439901 learned_addr learned my addr 172.21.15.94:0/4160439901 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39098fa640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3904161a60 0x7f390415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39090f9640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39040cf450 0x7f3904156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 -- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3904161a60 msgr2=0x7f390415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3904161a60 0x7f390415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 -- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39040cf450 msgr2=0x7f3904156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39040cf450 0x7f3904156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.477+0000 7f39088f8640 1 -- 172.21.15.94:0/4160439901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39040b26a0 con 0x7f39040d3060 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f39088f8640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39040d3060 0x7f39040b3260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38f8000c10 tx=0x7f38f8019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f3901ffb640 1 -- 172.21.15.94:0/4160439901 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80bb070 con 0x7f39040d3060 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f3901ffb640 1 -- 172.21.15.94:0/4160439901 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f80038a0 con 0x7f39040d3060 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39040b1600 con 0x7f39040d3060 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f3901ffb640 1 -- 172.21.15.94:0/4160439901 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80b1040 con 0x7f39040d3060 2024-09-11T23:15:20.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39040b1bc0 con 0x7f39040d3060 2024-09-11T23:15:20.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390406d6b0 con 0x7f39040d3060 2024-09-11T23:15:20.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f3901ffb640 1 -- 172.21.15.94:0/4160439901 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38f80be070 con 0x7f39040d3060 2024-09-11T23:15:20.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f3901ffb640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38f00678c0 0x7f38f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:20.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f3901ffb640 1 -- 172.21.15.94:0/4160439901 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f38f811f250 con 0x7f39040d3060 2024-09-11T23:15:20.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f39090f9640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38f00678c0 0x7f38f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:20.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.481+0000 7f39090f9640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38f00678c0 0x7f38f0069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38f4001640 tx=0x7f38f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:20.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.485+0000 7f3901ffb640 1 -- 172.21.15.94:0/4160439901 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f38f8016090 con 0x7f39040d3060 2024-09-11T23:15:20.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.649+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f390415a650 con 0x7f39040d3060 2024-09-11T23:15:20.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.649+0000 7f3901ffb640 1 -- 172.21.15.94:0/4160439901 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f38f80ef9b0 con 0x7f39040d3060 2024-09-11T23:15:20.651 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:20.651 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":25,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:19.997149+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38f00678c0 msgr2=0x7f38f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38f00678c0 0x7f38f0069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38f4001640 tx=0x7f38f4009040 comp rx=0 tx=0).stop 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39040d3060 msgr2=0x7f39040b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39040d3060 0x7f39040b3260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38f8000c10 tx=0x7f38f8019180 comp rx=0 tx=0).stop 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 shutdown_connections 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3904161a60 0x7f390415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38f00678c0 0x7f38f0069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39040d3060 0x7f39040b3260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 --2- 172.21.15.94:0/4160439901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39040cf450 0x7f3904156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 >> 172.21.15.94:0/4160439901 conn(0x7f390408bf90 msgr2=0x7f39040ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 shutdown_connections 2024-09-11T23:15:20.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:20.653+0000 7f390b35d640 1 -- 172.21.15.94:0/4160439901 wait complete. 2024-09-11T23:15:21.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:15:13.299318+0000', 'modified': '2024-09-11T23:15:18.390620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6835/2765753940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 2765753940}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 2765753940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4263, 'qdb_cluster': [4263]} 2024-09-11T23:15:21.073 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:15:21.073 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:15:21.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb43f4e640 1 Processor -- start 2024-09-11T23:15:21.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb43f4e640 1 -- start start 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb43f4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c161a60 0x7feb3c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb43f4e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb3c0d2e90 0x7feb3c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb43f4e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3c0d32b0 con 0x7feb3c0cf450 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb43f4e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7feb3c0d0300 con 0x7feb3c0d2e90 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb43f4e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb3c06e6c0 con 0x7feb3c161a60 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb414e9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb3c0d2e90 0x7feb3c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb414e9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb3c0d2e90 0x7feb3c0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36198/0 (socket says 172.21.15.94:36198) 2024-09-11T23:15:21.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb414e9640 1 -- 172.21.15.94:0/3796247759 learned_addr learned my addr 172.21.15.94:0/3796247759 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb41cea640 1 --2- 172.21.15.94:0/3796247759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c161a60 0x7feb3c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb414e9640 1 -- 172.21.15.94:0/3796247759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c161a60 msgr2=0x7feb3c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb414e9640 1 --2- 172.21.15.94:0/3796247759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c161a60 0x7feb3c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb414e9640 1 -- 172.21.15.94:0/3796247759 >> v1:172.21.15.155:6789/0 conn(0x7feb3c0cf450 legacy=0x7feb3c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb414e9640 1 -- 172.21.15.94:0/3796247759 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c0b0f60 con 0x7feb3c0d2e90 2024-09-11T23:15:21.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.205+0000 7feb41cea640 1 --2- 172.21.15.94:0/3796247759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c161a60 0x7feb3c0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:21.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb414e9640 1 --2- 172.21.15.94:0/3796247759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c0d2e90 0x7feb3c0cef10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb38009e50 tx=0x7feb3801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f728bfdb4e6090 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb40ce8640 1 -- 172.21.15.94:0/3796247759 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0d1930 con 0x7feb3c0d2e90 2024-09-11T23:15:21.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb40ce8640 1 -- 172.21.15.94:0/3796247759 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb380a57b0 con 0x7feb3c0d2e90 2024-09-11T23:15:21.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb40ce8640 1 -- 172.21.15.94:0/3796247759 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb380a5b80 con 0x7feb3c0d2e90 2024-09-11T23:15:21.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 -- 172.21.15.94:0/3796247759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c0d2e90 msgr2=0x7feb3c0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3796247759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c0d2e90 0x7feb3c0cef10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb38009e50 tx=0x7feb3801c930 comp rx=0 tx=0).stop 2024-09-11T23:15:21.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 -- 172.21.15.94:0/3796247759 shutdown_connections 2024-09-11T23:15:21.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3796247759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c0d2e90 0x7feb3c0cef10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3796247759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c161a60 0x7feb3c0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 -- 172.21.15.94:0/3796247759 >> 172.21.15.94:0/3796247759 conn(0x7feb3c08bf90 msgr2=0x7feb3c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 -- 172.21.15.94:0/3796247759 shutdown_connections 2024-09-11T23:15:21.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.209+0000 7feb43f4e640 1 -- 172.21.15.94:0/3796247759 wait complete. 2024-09-11T23:15:21.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 Processor -- start 2024-09-11T23:15:21.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 -- start start 2024-09-11T23:15:21.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c0cf450 0x7feb3c158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb3c0d2e90 0x7feb3c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c161a60 0x7feb3c0b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c0cf900 con 0x7feb3c161a60 2024-09-11T23:15:21.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c06d190 con 0x7feb3c0d2e90 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb3c0cfa80 con 0x7feb3c0cf450 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c161a60 0x7feb3c0b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c161a60 0x7feb3c0b8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36202/0 (socket says 172.21.15.94:36202) 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 -- 172.21.15.94:0/3827096312 learned_addr learned my addr 172.21.15.94:0/3827096312 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb414e9640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb3c0d2e90 0x7feb3c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb41cea640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c0cf450 0x7feb3c158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 -- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c0cf450 msgr2=0x7feb3c158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c0cf450 0x7feb3c158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 -- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb3c0d2e90 msgr2=0x7feb3c15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb3c0d2e90 0x7feb3c15d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 -- 172.21.15.94:0/3827096312 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c0b71a0 con 0x7feb3c161a60 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb414e9640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb3c0d2e90 0x7feb3c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:21.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb424eb640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c161a60 0x7feb3c0b8200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b410 tx=0x7feb2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb327fc640 1 -- 172.21.15.94:0/3827096312 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c015020 con 0x7feb3c161a60 2024-09-11T23:15:21.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb327fc640 1 -- 172.21.15.94:0/3827096312 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c011870 con 0x7feb3c161a60 2024-09-11T23:15:21.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c0b7440 con 0x7feb3c161a60 2024-09-11T23:15:21.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb327fc640 1 -- 172.21.15.94:0/3827096312 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c011c60 con 0x7feb3c161a60 2024-09-11T23:15:21.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c0b7a00 con 0x7feb3c161a60 2024-09-11T23:15:21.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.213+0000 7feb327fc640 1 -- 172.21.15.94:0/3827096312 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb2c018020 con 0x7feb3c161a60 2024-09-11T23:15:21.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb327fc640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb280678f0 0x7feb28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb327fc640 1 -- 172.21.15.94:0/3827096312 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb2c085aa0 con 0x7feb3c161a60 2024-09-11T23:15:21.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb280678f0 0x7feb28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 Processor -- start 2024-09-11T23:15:21.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- start start 2024-09-11T23:15:21.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb280678f0 0x7feb28069db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb34006fd0 tx=0x7feb34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d224b20 0x557e0d224f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d225440 0x557e0d1dad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1db290 0x557e0d1db670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e0d0c2b60 con 0x557e0d224b20 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557e0d029c70 con 0x557e0d1db290 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557e0cfcfed0 con 0x557e0d225440 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d224b20 0x557e0d224f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d224b20 0x557e0d224f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36210/0 (socket says 172.21.15.94:36210) 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 -- 172.21.15.94:0/261452957 learned_addr learned my addr 172.21.15.94:0/261452957 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 -- 172.21.15.94:0/261452957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d225440 msgr2=0x557e0d1dad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d225440 0x557e0d1dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 -- 172.21.15.94:0/261452957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1db290 msgr2=0x557e0d1db670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb424eb640 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1db290 0x557e0d1db670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1db290 0x557e0d1db670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 -- 172.21.15.94:0/261452957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e0cfe1e50 con 0x557e0d224b20 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb41cea640 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d224b20 0x557e0d224f00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb3400dab0 tx=0x7feb34010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495d3808689fddcf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb237fe640 1 -- 172.21.15.94:0/261452957 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34019050 con 0x557e0d224b20 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb237fe640 1 -- 172.21.15.94:0/261452957 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb34023070 con 0x557e0d224b20 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb237fe640 1 -- 172.21.15.94:0/261452957 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34012c30 con 0x557e0d224b20 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- 172.21.15.94:0/261452957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d224b20 msgr2=0x557e0d224f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d224b20 0x557e0d224f00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb3400dab0 tx=0x7feb34010000 comp rx=0 tx=0).stop 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- 172.21.15.94:0/261452957 shutdown_connections 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1db290 0x557e0d1db670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d225440 0x557e0d1dad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 --2- 172.21.15.94:0/261452957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d224b20 0x557e0d224f00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- 172.21.15.94:0/261452957 >> 172.21.15.94:0/261452957 conn(0x557e0d1e1600 msgr2=0x557e0d1d9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- 172.21.15.94:0/261452957 shutdown_connections 2024-09-11T23:15:21.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- 172.21.15.94:0/261452957 wait complete. 2024-09-11T23:15:21.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 -- start start 2024-09-11T23:15:21.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.217+0000 7feb4700a000 1 Processor -- start 2024-09-11T23:15:21.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d1dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d225440 0x557e0d1e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d1e0390 0x557e0d1e6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e0d08bb00 con 0x557e0d1e0390 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557e0d004360 con 0x557e0d225440 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557e0d0012d0 con 0x557e0d224b20 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 10 client.0 _ll_register_callbacks cb 0x557e0d1c6820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d1e0390 0x557e0d1e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d1e0390 0x557e0d1e6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36218/0 (socket says 172.21.15.94:36218) 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 -- 172.21.15.94:0/2698905795 learned_addr learned my addr 172.21.15.94:0/2698905795 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb41cea640 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d1dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 -- 172.21.15.94:0/2698905795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 msgr2=0x557e0d1dfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d1dfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 -- 172.21.15.94:0/2698905795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d225440 msgr2=0x557e0d1e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d225440 0x557e0d1e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 -- 172.21.15.94:0/2698905795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e0cfd0120 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb424eb640 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d1e0390 0x557e0d1e6230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b3e0 tx=0x7feb2c059fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b019a2e405c683bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 1 -- 172.21.15.94:0/2698905795 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c082060 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 1 -- 172.21.15.94:0/2698905795 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb2c017da0 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb34023070 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 1 -- 172.21.15.94:0/2698905795 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7feb2c072050 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 10 client.4359 fetch_fsmap learned FSMap version 6 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557e0cfc9450 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 1 -- 172.21.15.94:0/2698905795 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb34023070 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 1 -- 172.21.15.94:0/2698905795 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7feb2c0522a0 con 0x557e0d1e0390 2024-09-11T23:15:21.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 10 client.4359 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 10 client.4359 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 20 client.4359 populate_metadata read hostname 'smithi094' 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d233280 0x557e0d235670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 4 client.4359 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 --> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e0cfc3c00 con 0x557e0d233280 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb41cea640 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d233280 0x557e0d235670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb41cea640 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d233280 0x557e0d235670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e7b77b3be2896 server_cookie=974821d7242d7584 in_seq=0 out_seq=0 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 10 client.4359 ms_handle_connect on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 1 -- 172.21.15.94:0/2698905795 <== mds.0 v2:172.21.15.94:6834/2765753940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e0cfc3c00 con 0x557e0d233280 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 10 client.4359 handle_command_reply: tid=0 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 client.4359 shutdown 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d1e0390 msgr2=0x557e0d1e6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d1e0390 0x557e0d1e6230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b3e0 tx=0x7feb2c059fe0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 shutdown_connections 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d233280 0x557e0d235670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d1e0390 0x557e0d1e6230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb20ff9640 0 client.4359 ms_handle_reset on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d225440 0x557e0d1e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 --2- 172.21.15.94:0/2698905795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d1dfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 >> 172.21.15.94:0/2698905795 conn(0x557e0d1db290 msgr2=0x557e0d1d9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 shutdown_connections 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 1 -- 172.21.15.94:0/2698905795 wait complete. 2024-09-11T23:15:21.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.221+0000 7feb4700a000 20 client.4359 trim_cache size 0 max 16384 2024-09-11T23:15:21.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 Processor -- start 2024-09-11T23:15:21.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 -- start start 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d223cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d224200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d235670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c203c60 con 0x557e0d225440 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1fb390 con 0x557e0d1e0390 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb3c203610 con 0x557e0d224b20 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d235670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d235670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36224/0 (socket says 172.21.15.94:36224) 2024-09-11T23:15:21.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 -- 172.21.15.94:0/1155778558 learned_addr learned my addr 172.21.15.94:0/1155778558 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb41cea640 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d223cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 -- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 msgr2=0x557e0d224200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb414e9640 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d224200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d224200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 -- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 msgr2=0x557e0d223cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d223cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 -- 172.21.15.94:0/1155778558 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e0cfb0fd0 con 0x557e0d225440 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb41cea640 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d223cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb424eb640 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d235670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb2c05e2e0 tx=0x7feb2c057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bfdf0f669e7d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb22ffd640 1 -- 172.21.15.94:0/1155778558 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c05c040 con 0x557e0d225440 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb22ffd640 1 -- 172.21.15.94:0/1155778558 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c017da0 con 0x557e0d225440 2024-09-11T23:15:21.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb22ffd640 1 -- 172.21.15.94:0/1155778558 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c055770 con 0x557e0d225440 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 -- 172.21.15.94:0/1155778558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 msgr2=0x557e0d235670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.241+0000 7feb4700a000 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d235670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb2c05e2e0 tx=0x7feb2c057000 comp rx=0 tx=0).stop 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/1155778558 shutdown_connections 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d235670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d224200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/1155778558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d223cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/1155778558 >> 172.21.15.94:0/1155778558 conn(0x557e0d1db290 msgr2=0x557e0d1df8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/1155778558 shutdown_connections 2024-09-11T23:15:21.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/1155778558 wait complete. 2024-09-11T23:15:21.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- start start 2024-09-11T23:15:21.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 Processor -- start 2024-09-11T23:15:21.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d2388c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d238e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d29c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e0d028f80 con 0x557e0d225440 2024-09-11T23:15:21.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557e0cfe1ca0 con 0x557e0d1e0390 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557e0d02e2a0 con 0x557e0d224b20 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 10 client.0 _ll_register_callbacks cb 0x7feb2c055a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d29c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d29c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36232/0 (socket says 172.21.15.94:36232) 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 -- 172.21.15.94:0/2560853333 learned_addr learned my addr 172.21.15.94:0/2560853333 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 -- 172.21.15.94:0/2560853333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 msgr2=0x557e0d238e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d238e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 -- 172.21.15.94:0/2560853333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 msgr2=0x557e0d2388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d2388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 -- 172.21.15.94:0/2560853333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e0d0ac750 con 0x557e0d225440 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb424eb640 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d29c6a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0550a0 tx=0x7feb2c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f4da053a5aeef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:15:21.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 1 -- 172.21.15.94:0/2560853333 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c082070 con 0x557e0d225440 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 1 -- 172.21.15.94:0/2560853333 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb2c05c1e0 con 0x557e0d225440 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb2c017da0 con 0x557e0d225440 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 1 -- 172.21.15.94:0/2560853333 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7feb2c05c040 con 0x557e0d225440 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 10 client.4365 fetch_fsmap learned FSMap version 6 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557e0cfb7a30 con 0x557e0d225440 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 1 -- 172.21.15.94:0/2560853333 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c017da0 con 0x557e0d225440 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 1 -- 172.21.15.94:0/2560853333 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7feb2c07d020 con 0x557e0d225440 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 10 client.4365 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 10 client.4365 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 20 client.4365 populate_metadata read hostname 'smithi094' 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d29d030 0x557e0d29d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 4 client.4365 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:15:21.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 --> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] -- command(tid 0: {"prefix": "status"}) -- 0x557e0d0373a0 con 0x557e0d29d030 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb41cea640 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d29d030 0x557e0d29d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb41cea640 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d29d030 0x557e0d29d410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7547574168477dfa server_cookie=78c0056e2a4ae18c in_seq=0 out_seq=0 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 10 client.4365 ms_handle_connect on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 1 -- 172.21.15.94:0/2560853333 <== mds.0 v2:172.21.15.94:6834/2765753940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x557e0d0373a0 con 0x557e0d29d030 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 10 client.4365 handle_command_reply: tid=0 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 client.4365 shutdown 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 msgr2=0x557e0d29c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d29c6a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0550a0 tx=0x7feb2c004690 comp rx=0 tx=0).stop 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 shutdown_connections 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557e0d29d030 0x557e0d29d410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e0d225440 0x557e0d29c6a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e0d224b20 0x557e0d238e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb20ff9640 0 client.4365 ms_handle_reset on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:21.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 --2- 172.21.15.94:0/2560853333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e0d1e0390 0x557e0d2388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 >> 172.21.15.94:0/2560853333 conn(0x557e0d1db290 msgr2=0x557e0d222cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 shutdown_connections 2024-09-11T23:15:21.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 1 -- 172.21.15.94:0/2560853333 wait complete. 2024-09-11T23:15:21.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.245+0000 7feb4700a000 20 client.4365 trim_cache size 0 max 16384 2024-09-11T23:15:21.254 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4263, 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 7.3197263100000001, 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 6, 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 25, 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 24, 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 13.401975949000001 2024-09-11T23:15:21.255 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:15:21.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb280678f0 msgr2=0x7feb28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb280678f0 0x7feb28069db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb34006fd0 tx=0x7feb34008040 comp rx=0 tx=0).stop 2024-09-11T23:15:21.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c161a60 msgr2=0x7feb3c0b8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c161a60 0x7feb3c0b8200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b410 tx=0x7feb2c00b8d0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 shutdown_connections 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb280678f0 0x7feb28069db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb3c161a60 0x7feb3c0b8200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb3c0d2e90 0x7feb3c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 --2- 172.21.15.94:0/3827096312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb3c0cf450 0x7feb3c158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 >> 172.21.15.94:0/3827096312 conn(0x7feb3c08bf90 msgr2=0x7feb3c0b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 shutdown_connections 2024-09-11T23:15:21.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.249+0000 7feb43f4e640 1 -- 172.21.15.94:0/3827096312 wait complete. 2024-09-11T23:15:21.264 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:15:21.264 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:21.265 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:15:21.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa2790ec640 1 Processor -- start 2024-09-11T23:15:21.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa2790ec640 1 -- start start 2024-09-11T23:15:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa2790ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415c2a0 0x7fa2740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa2790ec640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa2740af2a0 0x7fa27406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa2790ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2740b3290 con 0x7fa27415bec0 2024-09-11T23:15:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa2790ec640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa2740b3570 con 0x7fa2740af2a0 2024-09-11T23:15:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa2790ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2740b3850 con 0x7fa27415c2a0 2024-09-11T23:15:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa27359e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa2740af2a0 0x7fa27406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa27359e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa2740af2a0 0x7fa27406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36240/0 (socket says 172.21.15.94:36240) 2024-09-11T23:15:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa27359e640 1 -- 172.21.15.94:0/400310988 learned_addr learned my addr 172.21.15.94:0/400310988 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa26bfff640 1 --2- 172.21.15.94:0/400310988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415c2a0 0x7fa2740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa27359e640 1 -- 172.21.15.94:0/400310988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415c2a0 msgr2=0x7fa2740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa27359e640 1 --2- 172.21.15.94:0/400310988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415c2a0 0x7fa2740aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa27359e640 1 -- 172.21.15.94:0/400310988 >> v1:172.21.15.155:6789/0 conn(0x7fa27415bec0 legacy=0x7fa2740ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.377+0000 7fa27359e640 1 -- 172.21.15.94:0/400310988 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2740b3b30 con 0x7fa2740af2a0 2024-09-11T23:15:21.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa27359e640 1 --2- 172.21.15.94:0/400310988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa27406e000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009e50 tx=0x7fa26c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aead204a1593f3c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa27259c640 1 -- 172.21.15.94:0/400310988 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0a58d0 con 0x7fa2740af2a0 2024-09-11T23:15:21.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa27259c640 1 -- 172.21.15.94:0/400310988 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26c0a5a70 con 0x7fa2740af2a0 2024-09-11T23:15:21.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa27259c640 1 -- 172.21.15.94:0/400310988 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0a5e40 con 0x7fa2740af2a0 2024-09-11T23:15:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- 172.21.15.94:0/400310988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 msgr2=0x7fa27406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 --2- 172.21.15.94:0/400310988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa27406e000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009e50 tx=0x7fa26c01ca00 comp rx=0 tx=0).stop 2024-09-11T23:15:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- 172.21.15.94:0/400310988 shutdown_connections 2024-09-11T23:15:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 --2- 172.21.15.94:0/400310988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa27406e000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 --2- 172.21.15.94:0/400310988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415c2a0 0x7fa2740aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- 172.21.15.94:0/400310988 >> 172.21.15.94:0/400310988 conn(0x7fa2740b1f90 msgr2=0x7fa2740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- 172.21.15.94:0/400310988 shutdown_connections 2024-09-11T23:15:21.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- 172.21.15.94:0/400310988 wait complete. 2024-09-11T23:15:21.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 Processor -- start 2024-09-11T23:15:21.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- start start 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa274157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415bec0 0x7fa274147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa27415c2a0 0x7fa27415a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa27406ed50 con 0x7fa2740af2a0 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2740afc90 con 0x7fa27415c2a0 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa27406eed0 con 0x7fa27415bec0 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa274157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa274157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36246/0 (socket says 172.21.15.94:36246) 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 -- 172.21.15.94:0/1046850114 learned_addr learned my addr 172.21.15.94:0/1046850114 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 -- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415bec0 msgr2=0x7fa274147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415bec0 0x7fa274147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 -- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa27415c2a0 msgr2=0x7fa27415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa27415c2a0 0x7fa27415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 -- 172.21.15.94:0/1046850114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa274158150 con 0x7fa2740af2a0 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa272d9d640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa274157c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa26400c450 tx=0x7fa26400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa26b7fe640 1 -- 172.21.15.94:0/1046850114 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264016020 con 0x7fa2740af2a0 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa26b7fe640 1 -- 172.21.15.94:0/1046850114 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2640052d0 con 0x7fa2740af2a0 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27414ec90 con 0x7fa2740af2a0 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa26b7fe640 1 -- 172.21.15.94:0/1046850114 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264007260 con 0x7fa2740af2a0 2024-09-11T23:15:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.381+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27414f250 con 0x7fa2740af2a0 2024-09-11T23:15:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.385+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27406e000 con 0x7fa2740af2a0 2024-09-11T23:15:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.385+0000 7fa26b7fe640 1 -- 172.21.15.94:0/1046850114 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa264007400 con 0x7fa2740af2a0 2024-09-11T23:15:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.385+0000 7fa26b7fe640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2540678c0 0x7fa254069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.385+0000 7fa26b7fe640 1 -- 172.21.15.94:0/1046850114 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa264085900 con 0x7fa2740af2a0 2024-09-11T23:15:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.385+0000 7fa26bfff640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2540678c0 0x7fa254069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.385+0000 7fa26bfff640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2540678c0 0x7fa254069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2740cf5a0 tx=0x7fa25c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.389+0000 7fa26b7fe640 1 -- 172.21.15.94:0/1046850114 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa264020020 con 0x7fa2740af2a0 2024-09-11T23:15:21.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa27406fcd0 con 0x7fa2740af2a0 2024-09-11T23:15:21.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa26b7fe640 1 -- 172.21.15.94:0/1046850114 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fa264005480 con 0x7fa2740af2a0 2024-09-11T23:15:21.585 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:15:21.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2540678c0 msgr2=0x7fa254069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2540678c0 0x7fa254069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2740cf5a0 tx=0x7fa25c008040 comp rx=0 tx=0).stop 2024-09-11T23:15:21.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 msgr2=0x7fa274157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa274157c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa26400c450 tx=0x7fa26400c910 comp rx=0 tx=0).stop 2024-09-11T23:15:21.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 shutdown_connections 2024-09-11T23:15:21.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa27415c2a0 0x7fa27415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27415bec0 0x7fa274147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2540678c0 0x7fa254069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 --2- 172.21.15.94:0/1046850114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2740af2a0 0x7fa274157c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 >> 172.21.15.94:0/1046850114 conn(0x7fa2740b1f90 msgr2=0x7fa2740cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 shutdown_connections 2024-09-11T23:15:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21.585+0000 7fa2790ec640 1 -- 172.21.15.94:0/1046850114 wait complete. 2024-09-11T23:15:21.602 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:15:21.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:15:21.603 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:15:21.603 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T23:15:21.603 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:21.603 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:15:21.603 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:15:21.603 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:15:21.603 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:15:21.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:21.603 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:15:21.609 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:21.609 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:21.609 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:21.609 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:21.609 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42467sec preferred_lft 42467sec 2024-09-11T23:15:21.610 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:15:21.611 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:21.611 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:15:21.611 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:21.611 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:15:21.611 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:21.611 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:15:21.612 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:21.612 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:21.612 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:15:21.612 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2024-09-11T23:15:21.612 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2024-09-11T23:15:21.612 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:15:21.612 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:21.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:21.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:21.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:21.731 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:15:21.781 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:15:21.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:21.782 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:21.858 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:15:21.858 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:21.858 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:21.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:15:21.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:15:21.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:15:21.858 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:21.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:21.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:21.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:21.976 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:15:21.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:21.982 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-09-11T23:15:22.033 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:22.033 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:22.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:22.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T23:15:22.033 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:22.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:22.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:22.149 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T23:15:22.149 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:22.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:22.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:22.312 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:22.312 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:22.312 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:15:22.312 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:15:22.312 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:22.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:22.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:22.369 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T23:15:22.369 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:22.370 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:22.426 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:15:22.426 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:22.426 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:22.471 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:22.530 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:22.577 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:22.578 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:22.578 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:22.578 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:22.578 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:22.578 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:22.578 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:22.579 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:22.579 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:22.579 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:22.579 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:22.579 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:22.579 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:22.579 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:22.580 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:22.581 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:22.581 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:22.581 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:22.581 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:22.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:22.582 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:22.629 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:15:22.629 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T23:15:22.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:22.687 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:22.733 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:22.734 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:22.735 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:22.735 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:22.735 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:22.735 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:22.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:22.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:22.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:22.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:22.736 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:22.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:2024-09-11T23:15:22.753+0000 7fc91a169580 -1 init, newargv = 0x56095e99d470 newargc=15 2024-09-11T23:15:22.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[34948]: starting ceph client 2024-09-11T23:15:22.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[34948]: starting fuse 2024-09-11T23:15:23.862 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:23.878 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:23.927 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:23.927 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:23.927 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:23.929 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:23.930 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:23.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:23.931 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:23.977 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:15:23.977 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:15:23.977 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:15:23.977 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:15:23.978 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:23.979 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.admin")) 2024-09-11T23:15:23.980 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:15:24.096 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.admin.34948.asok 2024-09-11T23:15:24.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:24.107 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34948.asok 2024-09-11T23:15:24.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:24.107 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34948.asok status 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "admin", 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "34948", 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:24.259 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4377, 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4377 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1998041197 2024-09-11T23:15:24.260 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1998041197 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4377 192.168.0.1:0/1998041197", 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/1998041197", 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 6, 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 25, 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:15:24.261 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:15:24.262 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:15:24.262 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:15:24.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:24.273 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:15:24.273 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:24.278 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:15:24.278 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:24.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:24.279 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:24.331 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T23:15:24.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:15:24.461 INFO:teuthology.orchestra.run.smithi094.stdout:# file: . 2024-09-11T23:15:24.461 INFO:teuthology.orchestra.run.smithi094.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T23:15:24.461 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:24.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:24.469 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:24.469 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:24.476 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f434193e640 1 Processor -- start 2024-09-11T23:15:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f434193e640 1 -- start start 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f434193e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f433c15e5f0 0x7f433c06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f434193e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c0cfaf0 0x7f433c0d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f434193e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f433c06d9c0 con 0x7f433c0ce9d0 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f434193e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f433c06dca0 con 0x7f433c15e5f0 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f434193e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f433c06df80 con 0x7f433c0cfaf0 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f433c15e5f0 0x7f433c06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f433c15e5f0 0x7f433c06d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36258/0 (socket says 172.21.15.94:36258) 2024-09-11T23:15:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433a7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f433c0ce9d0 0x7f433c0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44188/0 (socket says 172.21.15.94:44188) 2024-09-11T23:15:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433affd640 1 -- 172.21.15.94:0/3471437089 learned_addr learned my addr 172.21.15.94:0/3471437089 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433b7fe640 1 --2- 172.21.15.94:0/3471437089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c0cfaf0 0x7f433c0d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433affd640 1 -- 172.21.15.94:0/3471437089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c0cfaf0 msgr2=0x7f433c0d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433affd640 1 --2- 172.21.15.94:0/3471437089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c0cfaf0 0x7f433c0d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433affd640 1 -- 172.21.15.94:0/3471437089 >> v1:172.21.15.94:6789/0 conn(0x7f433c0ce9d0 legacy=0x7f433c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f4339ffb640 1 -- 172.21.15.94:0/3471437089 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617107944 0 0) 0x7f433c06d9c0 con 0x7f433c0ce9d0 2024-09-11T23:15:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.649+0000 7f433affd640 1 -- 172.21.15.94:0/3471437089 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433c06e260 con 0x7f433c15e5f0 2024-09-11T23:15:24.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f433affd640 1 --2- 172.21.15.94:0/3471437089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c15e5f0 0x7f433c06d090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f432c009e50 tx=0x7f432c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9234807f20f08339 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:24.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f4339ffb640 1 -- 172.21.15.94:0/3471437089 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0a5810 con 0x7f433c15e5f0 2024-09-11T23:15:24.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f4339ffb640 1 -- 172.21.15.94:0/3471437089 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c0a59b0 con 0x7f433c15e5f0 2024-09-11T23:15:24.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f4339ffb640 1 -- 172.21.15.94:0/3471437089 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0a5d80 con 0x7f433c15e5f0 2024-09-11T23:15:24.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 -- 172.21.15.94:0/3471437089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c15e5f0 msgr2=0x7f433c06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:24.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 --2- 172.21.15.94:0/3471437089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c15e5f0 0x7f433c06d090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f432c009e50 tx=0x7f432c01ca30 comp rx=0 tx=0).stop 2024-09-11T23:15:24.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 -- 172.21.15.94:0/3471437089 shutdown_connections 2024-09-11T23:15:24.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 --2- 172.21.15.94:0/3471437089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c0cfaf0 0x7f433c0d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 --2- 172.21.15.94:0/3471437089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c15e5f0 0x7f433c06d090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 -- 172.21.15.94:0/3471437089 >> 172.21.15.94:0/3471437089 conn(0x7f433c074030 msgr2=0x7f433c09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:24.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 -- 172.21.15.94:0/3471437089 shutdown_connections 2024-09-11T23:15:24.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 -- 172.21.15.94:0/3471437089 wait complete. 2024-09-11T23:15:24.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 Processor -- start 2024-09-11T23:15:24.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.653+0000 7f434193e640 1 -- start start 2024-09-11T23:15:24.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f433c0cfaf0 0x7f433c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:24.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c1544f0 0x7f433c0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:24.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c15db80 0x7f433c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:24.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f433c0d3c40 con 0x7f433c1544f0 2024-09-11T23:15:24.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f433c0d3ac0 con 0x7f433c0cfaf0 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f433c16afa0 con 0x7f433c15db80 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c1544f0 0x7f433c0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c1544f0 0x7f433c0b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36262/0 (socket says 172.21.15.94:36262) 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 -- 172.21.15.94:0/195876171 learned_addr learned my addr 172.21.15.94:0/195876171 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 -- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c15db80 msgr2=0x7f433c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c15db80 0x7f433c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 -- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f433c0cfaf0 msgr2=0x7f433c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433affd640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f433c0cfaf0 0x7f433c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f433c0cfaf0 0x7f433c15cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 -- 172.21.15.94:0/195876171 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433c1541f0 con 0x7f433c1544f0 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433a7fc640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c1544f0 0x7f433c0b71d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43240011f0 tx=0x7f432400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f4333fff640 1 -- 172.21.15.94:0/195876171 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324018070 con 0x7f433c1544f0 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f4333fff640 1 -- 172.21.15.94:0/195876171 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43240074e0 con 0x7f433c1544f0 2024-09-11T23:15:24.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f4333fff640 1 -- 172.21.15.94:0/195876171 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324004a10 con 0x7f433c1544f0 2024-09-11T23:15:24.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433c0b9c70 con 0x7f433c1544f0 2024-09-11T23:15:24.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f433c153ec0 con 0x7f433c1544f0 2024-09-11T23:15:24.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f433c0d2b60 con 0x7f433c1544f0 2024-09-11T23:15:24.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f4333fff640 1 -- 172.21.15.94:0/195876171 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f432401b070 con 0x7f433c1544f0 2024-09-11T23:15:24.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f4333fff640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43200678c0 0x7f4320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:24.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f4333fff640 1 -- 172.21.15.94:0/195876171 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4324085330 con 0x7f433c1544f0 2024-09-11T23:15:24.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.657+0000 7f433affd640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43200678c0 0x7f4320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:24.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.661+0000 7f433affd640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43200678c0 0x7f4320069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f432c0ae000 tx=0x7f432c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:24.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.661+0000 7f4333fff640 1 -- 172.21.15.94:0/195876171 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4324055b30 con 0x7f433c1544f0 2024-09-11T23:15:24.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f433c0cf720 con 0x7f433c1544f0 2024-09-11T23:15:24.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f4333fff640 1 -- 172.21.15.94:0/195876171 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f4324055430 con 0x7f433c1544f0 2024-09-11T23:15:24.837 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43200678c0 msgr2=0x7f4320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43200678c0 0x7f4320069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f432c0ae000 tx=0x7f432c0a7070 comp rx=0 tx=0).stop 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c1544f0 msgr2=0x7f433c0b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c1544f0 0x7f433c0b71d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43240011f0 tx=0x7f432400c9b0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 shutdown_connections 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f433c15db80 0x7f433c0b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43200678c0 0x7f4320069d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f433c1544f0 0x7f433c0b71d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 --2- 172.21.15.94:0/195876171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f433c0cfaf0 0x7f433c15cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 >> 172.21.15.94:0/195876171 conn(0x7f433c0ce9d0 msgr2=0x7f433c0d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:24.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 shutdown_connections 2024-09-11T23:15:24.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:24.837+0000 7f434193e640 1 -- 172.21.15.94:0/195876171 wait complete. 2024-09-11T23:15:24.855 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:24.855 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:24.861 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35edeb5640 1 Processor -- start 2024-09-11T23:15:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35edeb5640 1 -- start start 2024-09-11T23:15:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35edeb5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35edeb5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e80b3290 con 0x7f35e815c2a0 2024-09-11T23:15:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35edeb5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e80b3570 con 0x7f35e815bec0 2024-09-11T23:15:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35edeb5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80b3850 con 0x7f35e806f010 2024-09-11T23:15:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35dffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f35e815c2a0 0x7f35e80aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44202/0 (socket says 172.21.15.94:44202) 2024-09-11T23:15:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35dffff640 1 -- 172.21.15.94:0/564841189 learned_addr learned my addr 172.21.15.94:0/564841189 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e7fff640 1 --2- 172.21.15.94:0/564841189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907690168 0 0) 0x7f35e80b3290 con 0x7f35e815c2a0 2024-09-11T23:15:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35d4003530 con 0x7f35e815c2a0 2024-09-11T23:15:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571126051 0 0) 0x7f35e80b3570 con 0x7f35e815bec0 2024-09-11T23:15:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e80b3290 con 0x7f35e815bec0 2024-09-11T23:15:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3847832793 0 0) 0x7f35d4003530 con 0x7f35e815c2a0 2024-09-11T23:15:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e7fff640 1 -- 172.21.15.94:0/564841189 >> v1:172.21.15.155:6789/0 conn(0x7f35e815bec0 legacy=0x7f35e80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e7fff640 1 -- 172.21.15.94:0/564841189 >> v1:172.21.15.94:6789/0 conn(0x7f35e815c2a0 legacy=0x7f35e80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.013+0000 7f35e7fff640 1 -- 172.21.15.94:0/564841189 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80b3b30 con 0x7f35e806f010 2024-09-11T23:15:25.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35e7fff640 1 --2- 172.21.15.94:0/564841189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8166ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009dc0 tx=0x7f35e001c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=309c58538e64f7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b2070 con 0x7f35e806f010 2024-09-11T23:15:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e00a55d0 con 0x7f35e806f010 2024-09-11T23:15:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35e6ffd640 1 -- 172.21.15.94:0/564841189 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0001680 con 0x7f35e806f010 2024-09-11T23:15:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- 172.21.15.94:0/564841189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 msgr2=0x7f35e8166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 --2- 172.21.15.94:0/564841189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8166ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009dc0 tx=0x7f35e001c880 comp rx=0 tx=0).stop 2024-09-11T23:15:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- 172.21.15.94:0/564841189 shutdown_connections 2024-09-11T23:15:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 --2- 172.21.15.94:0/564841189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8166ff0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- 172.21.15.94:0/564841189 >> 172.21.15.94:0/564841189 conn(0x7f35e80b1f90 msgr2=0x7f35e80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- 172.21.15.94:0/564841189 shutdown_connections 2024-09-11T23:15:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- 172.21.15.94:0/564841189 wait complete. 2024-09-11T23:15:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 Processor -- start 2024-09-11T23:15:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- start start 2024-09-11T23:15:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35e815bec0 0x7f35e8166980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e815c2a0 0x7f35e81571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8169ed0 con 0x7f35e815bec0 2024-09-11T23:15:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8169d50 con 0x7f35e815c2a0 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35edeb5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f35e816a050 con 0x7f35e806f010 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35e815bec0 0x7f35e8166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35e815bec0 0x7f35e8166980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36272/0 (socket says 172.21.15.94:36272) 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 -- 172.21.15.94:0/1772412850 learned_addr learned my addr 172.21.15.94:0/1772412850 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35e77fe640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35e7fff640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e815c2a0 0x7f35e81571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 -- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 msgr2=0x7f35e8141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 -- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e815c2a0 msgr2=0x7f35e81571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e815c2a0 0x7f35e81571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 -- 172.21.15.94:0/1772412850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e81569f0 con 0x7f35e815bec0 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35e7fff640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e815c2a0 0x7f35e81571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.017+0000 7f35dffff640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35e815bec0 0x7f35e8166980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c750 tx=0x7f35d000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e4ff9640 1 -- 172.21.15.94:0/1772412850 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0005ae0 con 0x7f35e815bec0 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e4ff9640 1 -- 172.21.15.94:0/1772412850 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d0005c80 con 0x7f35e815bec0 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e8166ec0 con 0x7f35e815bec0 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e4ff9640 1 -- 172.21.15.94:0/1772412850 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d00072b0 con 0x7f35e815bec0 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e815cb40 con 0x7f35e815bec0 2024-09-11T23:15:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e80ad200 con 0x7f35e815bec0 2024-09-11T23:15:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e4ff9640 1 -- 172.21.15.94:0/1772412850 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35d0007450 con 0x7f35e815bec0 2024-09-11T23:15:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e4ff9640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f35c80678c0 0x7f35c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e4ff9640 1 -- 172.21.15.94:0/1772412850 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f35d0086770 con 0x7f35e815bec0 2024-09-11T23:15:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e77fe640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f35c80678c0 0x7f35c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.021+0000 7f35e77fe640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f35c80678c0 0x7f35c8069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35d80011f0 tx=0x7f35d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.025+0000 7f35e4ff9640 1 -- 172.21.15.94:0/1772412850 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35d0010300 con 0x7f35e815bec0 2024-09-11T23:15:25.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.192+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f35e806fcd0 con 0x7f35e815bec0 2024-09-11T23:15:25.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.192+0000 7f35e4ff9640 1 -- 172.21.15.94:0/1772412850 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f35d00570e0 con 0x7f35e815bec0 2024-09-11T23:15:25.196 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:15:25.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f35c80678c0 msgr2=0x7f35c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f35c80678c0 0x7f35c8069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35d80011f0 tx=0x7f35d8009040 comp rx=0 tx=0).stop 2024-09-11T23:15:25.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35e815bec0 msgr2=0x7f35e8166980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35e815bec0 0x7f35e8166980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c750 tx=0x7f35d000cc10 comp rx=0 tx=0).stop 2024-09-11T23:15:25.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 shutdown_connections 2024-09-11T23:15:25.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e815c2a0 0x7f35e81571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f35c80678c0 0x7f35c8069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35e815bec0 0x7f35e8166980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 --2- 172.21.15.94:0/1772412850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35e806f010 0x7f35e8141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 >> 172.21.15.94:0/1772412850 conn(0x7f35e80b1f90 msgr2=0x7f35e80b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:25.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 shutdown_connections 2024-09-11T23:15:25.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:25.196+0000 7f35edeb5640 1 -- 172.21.15.94:0/1772412850 wait complete. 2024-09-11T23:15:25.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:15:25.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:25.214 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:15:25.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[34948]: fuse finished with error 0 and tester_r 0 2024-09-11T23:15:25.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:15:31.345 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:15:31.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:31.346 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T23:15:31.369 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:31.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c78d45640 1 Processor -- start 2024-09-11T23:15:31.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c78d45640 1 -- start start 2024-09-11T23:15:31.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c78d45640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c7415c2a0 0x7f4c740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c78d45640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c740af2a0 0x7f4c7406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c78d45640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c740b3290 con 0x7f4c7415bec0 2024-09-11T23:15:31.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c78d45640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4c740b3570 con 0x7f4c7415c2a0 2024-09-11T23:15:31.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c78d45640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4c740b3850 con 0x7f4c740af2a0 2024-09-11T23:15:31.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c7259c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4c7415bec0 0x7f4c740ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36302/0 (socket says 172.21.15.94:36302) 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c7259c640 1 -- 172.21.15.94:0/84937883 learned_addr learned my addr 172.21.15.94:0/84937883 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c69d9b640 1 --2- 172.21.15.94:0/84937883 >> v2:172.21.15.94:3300/0 conn(0x7f4c7415c2a0 0x7f4c740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c72d9d640 1 --2- 172.21.15.94:0/84937883 >> v2:172.21.15.155:3300/0 conn(0x7f4c740af2a0 0x7f4c7406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c69d9b640 1 -- 172.21.15.94:0/84937883 >> v2:172.21.15.155:3300/0 conn(0x7f4c740af2a0 msgr2=0x7f4c7406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c69d9b640 1 --2- 172.21.15.94:0/84937883 >> v2:172.21.15.155:3300/0 conn(0x7f4c740af2a0 0x7f4c7406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c69d9b640 1 -- 172.21.15.94:0/84937883 >> v1:172.21.15.94:6789/0 conn(0x7f4c7415bec0 legacy=0x7f4c740ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c69d9b640 1 -- 172.21.15.94:0/84937883 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c740b3b30 con 0x7f4c7415c2a0 2024-09-11T23:15:31.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.536+0000 7f4c71d9b640 1 -- 172.21.15.94:0/84937883 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086978549 0 0) 0x7f4c740b3290 con 0x7f4c7415bec0 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 --2- 172.21.15.94:0/84937883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415c2a0 0x7f4c740aed60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c740b2fb0 tx=0x7f4c5c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8ff3eaab6f8af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c71d9b640 1 -- 172.21.15.94:0/84937883 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0ab650 con 0x7f4c7415c2a0 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c71d9b640 1 -- 172.21.15.94:0/84937883 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c0b0070 con 0x7f4c7415c2a0 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c71d9b640 1 -- 172.21.15.94:0/84937883 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0aba10 con 0x7f4c7415c2a0 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- 172.21.15.94:0/84937883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415c2a0 msgr2=0x7f4c740aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 --2- 172.21.15.94:0/84937883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415c2a0 0x7f4c740aed60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c740b2fb0 tx=0x7f4c5c01c450 comp rx=0 tx=0).stop 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- 172.21.15.94:0/84937883 shutdown_connections 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 --2- 172.21.15.94:0/84937883 >> v2:172.21.15.155:3300/0 conn(0x7f4c740af2a0 0x7f4c7406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 --2- 172.21.15.94:0/84937883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415c2a0 0x7f4c740aed60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- 172.21.15.94:0/84937883 >> 172.21.15.94:0/84937883 conn(0x7f4c740b1f90 msgr2=0x7f4c740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- 172.21.15.94:0/84937883 shutdown_connections 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- 172.21.15.94:0/84937883 wait complete. 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 Processor -- start 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- start start 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c740af2a0 0x7f4c74154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415bec0 0x7f4c74148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7415c2a0 0x7f4c74149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7406ed50 con 0x7f4c7415bec0 2024-09-11T23:15:31.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740af6b0 con 0x7f4c7415c2a0 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c78d45640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7406eed0 con 0x7f4c740af2a0 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415bec0 0x7f4c74148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415bec0 0x7f4c74148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40306/0 (socket says 172.21.15.94:40306) 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 -- 172.21.15.94:0/3495909791 learned_addr learned my addr 172.21.15.94:0/3495909791 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c7259c640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c740af2a0 0x7f4c74154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c72d9d640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7415c2a0 0x7f4c74149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 -- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c740af2a0 msgr2=0x7f4c74154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c740af2a0 0x7f4c74154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 -- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7415c2a0 msgr2=0x7f4c74149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7415c2a0 0x7f4c74149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 -- 172.21.15.94:0/3495909791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c74071fb0 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c72d9d640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7415c2a0 0x7f4c74149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c69d9b640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415bec0 0x7f4c74148de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c01a080 tx=0x7f4c5c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.540+0000 7f4c6b7fe640 1 -- 172.21.15.94:0/3495909791 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0abde0 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c6b7fe640 1 -- 172.21.15.94:0/3495909791 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c0bf450 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c74072290 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c6b7fe640 1 -- 172.21.15.94:0/3495909791 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0bf840 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c74072850 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7406f1d0 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c6b7fe640 1 -- 172.21.15.94:0/3495909791 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c5c0c83f0 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c6b7fe640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c540678f0 0x7f4c54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c6b7fe640 1 -- 172.21.15.94:0/3495909791 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4c5c120a00 con 0x7f4c7415bec0 2024-09-11T23:15:31.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c7259c640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c540678f0 0x7f4c54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.544+0000 7f4c7259c640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c540678f0 0x7f4c54069db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c64000f70 tx=0x7f4c64007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.548+0000 7f4c6b7fe640 1 -- 172.21.15.94:0/3495909791 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c5c016070 con 0x7f4c7415bec0 2024-09-11T23:15:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.704+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c7406fcd0 con 0x7f4c7415bec0 2024-09-11T23:15:31.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c6b7fe640 1 -- 172.21.15.94:0/3495909791 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f4c5c0f13b0 con 0x7f4c7415bec0 2024-09-11T23:15:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:31.709 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":25,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:19.997149+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c540678f0 msgr2=0x7f4c54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c540678f0 0x7f4c54069db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c64000f70 tx=0x7f4c64007b60 comp rx=0 tx=0).stop 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415bec0 msgr2=0x7f4c74148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415bec0 0x7f4c74148de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c01a080 tx=0x7f4c5c0191f0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 shutdown_connections 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7415c2a0 0x7f4c74149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c540678f0 0x7f4c54069db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7415bec0 0x7f4c74148de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 --2- 172.21.15.94:0/3495909791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c740af2a0 0x7f4c74154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 >> 172.21.15.94:0/3495909791 conn(0x7f4c740b1f90 msgr2=0x7f4c741597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 shutdown_connections 2024-09-11T23:15:31.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.708+0000 7f4c78d45640 1 -- 172.21.15.94:0/3495909791 wait complete. 2024-09-11T23:15:31.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:31.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0772f53640 1 Processor -- start 2024-09-11T23:15:31.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0772f53640 1 -- start start 2024-09-11T23:15:31.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0772f53640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f076c161a60 0x7f076c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0772f53640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0772f53640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076c0d32b0 con 0x7f076c0cf450 2024-09-11T23:15:31.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0772f53640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f076c0d0300 con 0x7f076c161a60 2024-09-11T23:15:31.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0772f53640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f076c06e6c0 con 0x7f076c0d2e90 2024-09-11T23:15:31.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f076c161a60 0x7f076c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f076c161a60 0x7f076c0d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40322/0 (socket says 172.21.15.94:40322) 2024-09-11T23:15:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 -- 172.21.15.94:0/2374614668 learned_addr learned my addr 172.21.15.94:0/2374614668 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0763fff640 1 --2- 172.21.15.94:0/2374614668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 -- 172.21.15.94:0/2374614668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 msgr2=0x7f076c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 --2- 172.21.15.94:0/2374614668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 -- 172.21.15.94:0/2374614668 >> v1:172.21.15.155:6789/0 conn(0x7f076c0cf450 legacy=0x7f076c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 -- 172.21.15.94:0/2374614668 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076c0b0f60 con 0x7f076c161a60 2024-09-11T23:15:31.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.844+0000 7f0770cef640 1 --2- 172.21.15.94:0/2374614668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c0d2950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f076801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c332ab95da76726d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07637fe640 1 -- 172.21.15.94:0/2374614668 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c0d1930 con 0x7f076c161a60 2024-09-11T23:15:31.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07637fe640 1 -- 172.21.15.94:0/2374614668 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07680b0070 con 0x7f076c161a60 2024-09-11T23:15:31.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07637fe640 1 -- 172.21.15.94:0/2374614668 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07680ab840 con 0x7f076c161a60 2024-09-11T23:15:31.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- 172.21.15.94:0/2374614668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 msgr2=0x7f076c0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 --2- 172.21.15.94:0/2374614668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c0d2950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f076801c460 comp rx=0 tx=0).stop 2024-09-11T23:15:31.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- 172.21.15.94:0/2374614668 shutdown_connections 2024-09-11T23:15:31.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 --2- 172.21.15.94:0/2374614668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 --2- 172.21.15.94:0/2374614668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c0d2950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- 172.21.15.94:0/2374614668 >> 172.21.15.94:0/2374614668 conn(0x7f076c08bf90 msgr2=0x7f076c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:31.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- 172.21.15.94:0/2374614668 shutdown_connections 2024-09-11T23:15:31.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- 172.21.15.94:0/2374614668 wait complete. 2024-09-11T23:15:31.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 Processor -- start 2024-09-11T23:15:31.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- start start 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076c0cf450 0x7f076c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f076c0cf8e0 con 0x7f076c161a60 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f076c06d190 con 0x7f076c0cf450 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f076c0cfa60 con 0x7f076c0d2e90 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c14f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40332/0 (socket says 172.21.15.94:40332) 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 -- 172.21.15.94:0/3751951662 learned_addr learned my addr 172.21.15.94:0/3751951662 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:31.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0770cef640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076c0cf450 0x7f076c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0763fff640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 -- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 msgr2=0x7f076c0b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 -- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076c0cf450 msgr2=0x7f076c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076c0cf450 0x7f076c159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 -- 172.21.15.94:0/3751951662 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076c151790 con 0x7f076c161a60 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0763fff640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07714f0640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c14f420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f076400c780 tx=0x7f076400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07617fa640 1 -- 172.21.15.94:0/3751951662 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764017070 con 0x7f076c161a60 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07617fa640 1 -- 172.21.15.94:0/3751951662 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0764003db0 con 0x7f076c161a60 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076c151220 con 0x7f076c161a60 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f07617fa640 1 -- 172.21.15.94:0/3751951662 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07640052b0 con 0x7f076c161a60 2024-09-11T23:15:31.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.848+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f076c150460 con 0x7f076c161a60 2024-09-11T23:15:31.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.852+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076c0cef10 con 0x7f076c161a60 2024-09-11T23:15:31.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.852+0000 7f07617fa640 1 -- 172.21.15.94:0/3751951662 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f076401a070 con 0x7f076c161a60 2024-09-11T23:15:31.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.852+0000 7f07617fa640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07580678f0 0x7f0758069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.852+0000 7f07617fa640 1 -- 172.21.15.94:0/3751951662 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f07640855e0 con 0x7f076c161a60 2024-09-11T23:15:31.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.852+0000 7f0770cef640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07580678f0 0x7f0758069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.852+0000 7f0770cef640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07580678f0 0x7f0758069db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07680af000 tx=0x7f07680a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:31.856+0000 7f07617fa640 1 -- 172.21.15.94:0/3751951662 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0764055de0 con 0x7f076c161a60 2024-09-11T23:15:32.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.016+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f076c06bcc0 con 0x7f076c161a60 2024-09-11T23:15:32.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.016+0000 7f07617fa640 1 -- 172.21.15.94:0/3751951662 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f07640556e0 con 0x7f076c161a60 2024-09-11T23:15:32.020 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:32.020 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":25,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:19.997149+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07580678f0 msgr2=0x7f0758069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07580678f0 0x7f0758069db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07680af000 tx=0x7f07680a7000 comp rx=0 tx=0).stop 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 msgr2=0x7f076c14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c14f420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f076400c780 tx=0x7f076400cc40 comp rx=0 tx=0).stop 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 shutdown_connections 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07580678f0 0x7f0758069db0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f076c161a60 0x7f076c14f420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076c0d2e90 0x7f076c0b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 --2- 172.21.15.94:0/3751951662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076c0cf450 0x7f076c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 >> 172.21.15.94:0/3751951662 conn(0x7f076c08bf90 msgr2=0x7f076c0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 shutdown_connections 2024-09-11T23:15:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.020+0000 7f0772f53640 1 -- 172.21.15.94:0/3751951662 wait complete. 2024-09-11T23:15:32.037 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:15:32.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c47f2640 1 Processor -- start 2024-09-11T23:15:32.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c47f2640 1 -- start start 2024-09-11T23:15:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c47f2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f80bc06f010 0x7f80bc166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c47f2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80bc0b3290 con 0x7f80bc15bec0 2024-09-11T23:15:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c47f2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80bc0b3570 con 0x7f80bc15c2a0 2024-09-11T23:15:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c47f2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f80bc0b3850 con 0x7f80bc06f010 2024-09-11T23:15:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c258e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f80bc15bec0 0x7f80bc0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36304/0 (socket says 172.21.15.94:36304) 2024-09-11T23:15:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c258e640 1 -- 172.21.15.94:0/3360935204 learned_addr learned my addr 172.21.15.94:0/3360935204 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c2d8f640 1 --2- 172.21.15.94:0/3360935204 >> v2:172.21.15.94:3300/0 conn(0x7f80bc06f010 0x7f80bc166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c2d8f640 1 -- 172.21.15.94:0/3360935204 >> v1:172.21.15.155:6789/0 conn(0x7f80bc15c2a0 legacy=0x7f80bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c2d8f640 1 -- 172.21.15.94:0/3360935204 >> v1:172.21.15.94:6789/0 conn(0x7f80bc15bec0 legacy=0x7f80bc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.156+0000 7f80c2d8f640 1 -- 172.21.15.94:0/3360935204 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc0b3b30 con 0x7f80bc06f010 2024-09-11T23:15:32.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c2d8f640 1 --2- 172.21.15.94:0/3360935204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc166ff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009d90 tx=0x7f80b401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0657f778d9c480 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:32.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c158c640 1 -- 172.21.15.94:0/3360935204 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b40b2070 con 0x7f80bc06f010 2024-09-11T23:15:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c158c640 1 -- 172.21.15.94:0/3360935204 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b40a58d0 con 0x7f80bc06f010 2024-09-11T23:15:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c158c640 1 -- 172.21.15.94:0/3360935204 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b40a5ca0 con 0x7f80bc06f010 2024-09-11T23:15:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- 172.21.15.94:0/3360935204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 msgr2=0x7f80bc166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3360935204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc166ff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009d90 tx=0x7f80b401c900 comp rx=0 tx=0).stop 2024-09-11T23:15:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- 172.21.15.94:0/3360935204 shutdown_connections 2024-09-11T23:15:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3360935204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc166ff0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- 172.21.15.94:0/3360935204 >> 172.21.15.94:0/3360935204 conn(0x7f80bc0b1f90 msgr2=0x7f80bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- 172.21.15.94:0/3360935204 shutdown_connections 2024-09-11T23:15:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- 172.21.15.94:0/3360935204 wait complete. 2024-09-11T23:15:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 Processor -- start 2024-09-11T23:15:32.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- start start 2024-09-11T23:15:32.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:32.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80bc15bec0 0x7f80bc150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80bc15c2a0 0x7f80bc150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc169ed0 con 0x7f80bc06f010 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc169d50 con 0x7f80bc15bec0 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc16a050 con 0x7f80bc15c2a0 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc1543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40354/0 (socket says 172.21.15.94:40354) 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 -- 172.21.15.94:0/3447494173 learned_addr learned my addr 172.21.15.94:0/3447494173 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 -- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80bc15c2a0 msgr2=0x7f80bc150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c1d8d640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80bc15bec0 0x7f80bc150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80bc15c2a0 0x7f80bc150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 -- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80bc15bec0 msgr2=0x7f80bc150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80bc15bec0 0x7f80bc150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 -- 172.21.15.94:0/3447494173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc14e810 con 0x7f80bc06f010 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c258e640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc1543e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c420 tx=0x7f80ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80b2ffd640 1 -- 172.21.15.94:0/3447494173 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac017070 con 0x7f80bc06f010 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80b2ffd640 1 -- 172.21.15.94:0/3447494173 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac005cf0 con 0x7f80bc06f010 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80b2ffd640 1 -- 172.21.15.94:0/3447494173 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0072f0 con 0x7f80bc06f010 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc14eaf0 con 0x7f80bc06f010 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.160+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc14f0b0 con 0x7f80bc06f010 2024-09-11T23:15:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.164+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc0ad200 con 0x7f80bc06f010 2024-09-11T23:15:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.164+0000 7f80b2ffd640 1 -- 172.21.15.94:0/3447494173 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80ac01a070 con 0x7f80bc06f010 2024-09-11T23:15:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.164+0000 7f80b2ffd640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f80a00678c0 0x7f80a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.164+0000 7f80b2ffd640 1 -- 172.21.15.94:0/3447494173 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f80ac085310 con 0x7f80bc06f010 2024-09-11T23:15:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.164+0000 7f80c1d8d640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f80a00678c0 0x7f80a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.164+0000 7f80c1d8d640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f80a00678c0 0x7f80a0069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80bc15f330 tx=0x7f80b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:32.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.168+0000 7f80b2ffd640 1 -- 172.21.15.94:0/3447494173 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80ac055ba0 con 0x7f80bc06f010 2024-09-11T23:15:32.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:32.360+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f80bc06ced0 con 0x7f80bc06f010 2024-09-11T23:15:33.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.064+0000 7f80b2ffd640 1 -- 172.21.15.94:0/3447494173 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f80ac0554a0 con 0x7f80bc06f010 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f80a00678c0 msgr2=0x7f80a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f80a00678c0 0x7f80a0069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80bc15f330 tx=0x7f80b8008040 comp rx=0 tx=0).stop 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 msgr2=0x7f80bc1543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc1543e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c420 tx=0x7f80ac00c8e0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 shutdown_connections 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80bc15c2a0 0x7f80bc150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80bc15bec0 0x7f80bc150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f80a00678c0 0x7f80a0069d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 --2- 172.21.15.94:0/3447494173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80bc06f010 0x7f80bc1543e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 >> 172.21.15.94:0/3447494173 conn(0x7f80bc0b1f90 msgr2=0x7f80bc0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:33.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 shutdown_connections 2024-09-11T23:15:33.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.068+0000 7f80c47f2640 1 -- 172.21.15.94:0/3447494173 wait complete. 2024-09-11T23:15:33.088 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-11T23:15:33.088 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:15:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.212+0000 7f69486bd640 1 Processor -- start 2024-09-11T23:15:33.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.212+0000 7f69486bd640 1 -- start start 2024-09-11T23:15:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f69486bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 0x7f6940165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f69486bd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69400aede0 con 0x7f6940070020 2024-09-11T23:15:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f69486bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694015fa10 con 0x7f69401520a0 2024-09-11T23:15:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f69486bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6940152480 con 0x7f694015f3a0 2024-09-11T23:15:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6940070020 0x7f694015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36316/0 (socket says 172.21.15.94:36316) 2024-09-11T23:15:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 -- 172.21.15.94:0/3573697199 learned_addr learned my addr 172.21.15.94:0/3573697199 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6946c5a640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 0x7f6940165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862254127 0 0) 0x7f69400aede0 con 0x7f6940070020 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f692c003530 con 0x7f6940070020 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3415361980 0 0) 0x7f692c003530 con 0x7f6940070020 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 msgr2=0x7f6940165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 0x7f6940165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 >> v1:172.21.15.155:6789/0 conn(0x7f69401520a0 legacy=0x7f694006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6940074250 con 0x7f6940070020 2024-09-11T23:15:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f6930001680 con 0x7f6940070020 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 >> v1:172.21.15.94:6789/0 conn(0x7f6940070020 legacy=0x7f694015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 0x7f692c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f692c003f70 0x7f692c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c004d50 0x7f692c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00dc90 con 0x7f692c003f70 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00de40 con 0x7f692c004d50 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f692c00e040 con 0x7f694015f3a0 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f692c003f70 0x7f692c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6946459640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 0x7f692c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6946c5a640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c004d50 0x7f692c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 -- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 msgr2=0x7f692c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:33.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f694015f3a0 0x7f692c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 -- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c004d50 msgr2=0x7f692c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:33.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c004d50 0x7f692c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.216+0000 7f6945c58640 1 -- 172.21.15.94:0/3573697199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c003530 con 0x7f692c003f70 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f692c003f70 0x7f692c004810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f693000c210 tx=0x7f693001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f169c66cea93fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930007d20 con 0x7f692c003f70 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6930005ae0 con 0x7f692c003f70 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945457640 1 -- 172.21.15.94:0/3573697199 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930007070 con 0x7f692c003f70 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- 172.21.15.94:0/3573697199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f692c003f70 msgr2=0x7f692c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 --2- 172.21.15.94:0/3573697199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f692c003f70 0x7f692c004810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f693000c210 tx=0x7f693001f3b0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6946c5a640 1 -- 172.21.15.94:0/3573697199 reap_dead start 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- 172.21.15.94:0/3573697199 shutdown_connections 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- 172.21.15.94:0/3573697199 >> 172.21.15.94:0/3573697199 conn(0x7f69400b1f90 msgr2=0x7f69400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- 172.21.15.94:0/3573697199 shutdown_connections 2024-09-11T23:15:33.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- 172.21.15.94:0/3573697199 wait complete. 2024-09-11T23:15:33.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 Processor -- start 2024-09-11T23:15:33.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- start start 2024-09-11T23:15:33.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c003f70 0x7f69400b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6940149330 0x7f69401497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69400ccd40 0x7f69400cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6940073a50 con 0x7f6940149330 2024-09-11T23:15:33.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6940073770 con 0x7f692c003f70 2024-09-11T23:15:33.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f69486bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6940073d30 con 0x7f69400ccd40 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6940149330 0x7f69401497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6940149330 0x7f69401497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40374/0 (socket says 172.21.15.94:40374) 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 -- 172.21.15.94:0/4003825947 learned_addr learned my addr 172.21.15.94:0/4003825947 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6946c5a640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69400ccd40 0x7f69400cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6946459640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c003f70 0x7f69400b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 -- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69400ccd40 msgr2=0x7f69400cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69400ccd40 0x7f69400cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 -- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c003f70 msgr2=0x7f69400b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c003f70 0x7f69400b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.220+0000 7f6945c58640 1 -- 172.21.15.94:0/4003825947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401f77f0 con 0x7f6940149330 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6945c58640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6940149330 0x7f69401497b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f693001f1e0 tx=0x7f692c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6936ffd640 1 -- 172.21.15.94:0/4003825947 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930007d20 con 0x7f6940149330 2024-09-11T23:15:33.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6936ffd640 1 -- 172.21.15.94:0/4003825947 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69300047f0 con 0x7f6940149330 2024-09-11T23:15:33.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69401f7ad0 con 0x7f6940149330 2024-09-11T23:15:33.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6936ffd640 1 -- 172.21.15.94:0/4003825947 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930004bc0 con 0x7f6940149330 2024-09-11T23:15:33.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69401f8090 con 0x7f6940149330 2024-09-11T23:15:33.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694015ec90 con 0x7f6940149330 2024-09-11T23:15:33.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6936ffd640 1 -- 172.21.15.94:0/4003825947 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6930007070 con 0x7f6940149330 2024-09-11T23:15:33.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6936ffd640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69240678f0 0x7f6924069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:33.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6936ffd640 1 -- 172.21.15.94:0/4003825947 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6930123640 con 0x7f6940149330 2024-09-11T23:15:33.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6946459640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69240678f0 0x7f6924069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:33.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.224+0000 7f6946459640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69240678f0 0x7f6924069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f693c005430 tx=0x7f693c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:33.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.228+0000 7f6936ffd640 1 -- 172.21.15.94:0/4003825947 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f69300b7070 con 0x7f6940149330 2024-09-11T23:15:33.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:33.412+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f694006e540 con 0x7f6940149330 2024-09-11T23:15:34.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.064+0000 7f6936ffd640 1 -- 172.21.15.94:0/4003825947 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f69300190c0 con 0x7f6940149330 2024-09-11T23:15:34.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69240678f0 msgr2=0x7f6924069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69240678f0 0x7f6924069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f693c005430 tx=0x7f693c009040 comp rx=0 tx=0).stop 2024-09-11T23:15:34.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6940149330 msgr2=0x7f69401497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6940149330 0x7f69401497b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f693001f1e0 tx=0x7f692c005840 comp rx=0 tx=0).stop 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 shutdown_connections 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69400ccd40 0x7f69400cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69240678f0 0x7f6924069db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6940149330 0x7f69401497b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 --2- 172.21.15.94:0/4003825947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f692c003f70 0x7f69400b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 >> 172.21.15.94:0/4003825947 conn(0x7f69400b1f90 msgr2=0x7f694006ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 shutdown_connections 2024-09-11T23:15:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.072+0000 7f69486bd640 1 -- 172.21.15.94:0/4003825947 wait complete. 2024-09-11T23:15:34.098 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:15:34.098 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:34.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba91638640 1 Processor -- start 2024-09-11T23:15:34.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba91638640 1 -- start start 2024-09-11T23:15:34.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba91638640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba8c161a60 0x7fba8c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba91638640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba8c0cf620 0x7fba8c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba91638640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8c0d32b0 con 0x7fba8c0d2e90 2024-09-11T23:15:34.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba91638640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fba8c0d0300 con 0x7fba8c161a60 2024-09-11T23:15:34.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba91638640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fba8c0cfa90 con 0x7fba8c0cf620 2024-09-11T23:15:34.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba8c161a60 0x7fba8c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba8c161a60 0x7fba8c0d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40376/0 (socket says 172.21.15.94:40376) 2024-09-11T23:15:34.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 -- 172.21.15.94:0/272721705 learned_addr learned my addr 172.21.15.94:0/272721705 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:34.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 -- 172.21.15.94:0/272721705 >> v2:172.21.15.155:3300/0 conn(0x7fba8c0cf620 msgr2=0x7fba8c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:34.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 --2- 172.21.15.94:0/272721705 >> v2:172.21.15.155:3300/0 conn(0x7fba8c0cf620 0x7fba8c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 -- 172.21.15.94:0/272721705 >> v1:172.21.15.94:6789/0 conn(0x7fba8c0d2e90 legacy=0x7fba8c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 -- 172.21.15.94:0/272721705 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c0b0f60 con 0x7fba8c161a60 2024-09-11T23:15:34.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.224+0000 7fba8affd640 1 --2- 172.21.15.94:0/272721705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c0d2950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0ce950 tx=0x7fba7c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef359cb394de862 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba89ffb640 1 -- 172.21.15.94:0/272721705 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0ab660 con 0x7fba8c161a60 2024-09-11T23:15:34.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba89ffb640 1 -- 172.21.15.94:0/272721705 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c0b0070 con 0x7fba8c161a60 2024-09-11T23:15:34.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba89ffb640 1 -- 172.21.15.94:0/272721705 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0aba20 con 0x7fba8c161a60 2024-09-11T23:15:34.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- 172.21.15.94:0/272721705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 msgr2=0x7fba8c0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 --2- 172.21.15.94:0/272721705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c0d2950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0ce950 tx=0x7fba7c01c460 comp rx=0 tx=0).stop 2024-09-11T23:15:34.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- 172.21.15.94:0/272721705 shutdown_connections 2024-09-11T23:15:34.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 --2- 172.21.15.94:0/272721705 >> v2:172.21.15.155:3300/0 conn(0x7fba8c0cf620 0x7fba8c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 --2- 172.21.15.94:0/272721705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c0d2950 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- 172.21.15.94:0/272721705 >> 172.21.15.94:0/272721705 conn(0x7fba8c08bf90 msgr2=0x7fba8c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:34.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- 172.21.15.94:0/272721705 shutdown_connections 2024-09-11T23:15:34.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- 172.21.15.94:0/272721705 wait complete. 2024-09-11T23:15:34.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 Processor -- start 2024-09-11T23:15:34.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- start start 2024-09-11T23:15:34.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba8c0cf620 0x7fba8c15f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba8c0d2e90 0x7fba8c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c06e400 con 0x7fba8c161a60 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c06d190 con 0x7fba8c0d2e90 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba8c06e580 con 0x7fba8c0cf620 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c15bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40388/0 (socket says 172.21.15.94:40388) 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 -- 172.21.15.94:0/2620038677 learned_addr learned my addr 172.21.15.94:0/2620038677 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 -- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba8c0cf620 msgr2=0x7fba8c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba8c0cf620 0x7fba8c15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 -- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba8c0d2e90 msgr2=0x7fba8c15b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8a7fc640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba8c0d2e90 0x7fba8c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba8c0d2e90 0x7fba8c15b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 -- 172.21.15.94:0/2620038677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c15c0c0 con 0x7fba8c161a60 2024-09-11T23:15:34.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba8b7fe640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c15bb80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b970 tx=0x7fba8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba737fe640 1 -- 172.21.15.94:0/2620038677 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84019070 con 0x7fba8c161a60 2024-09-11T23:15:34.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba737fe640 1 -- 172.21.15.94:0/2620038677 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8400cb60 con 0x7fba8c161a60 2024-09-11T23:15:34.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8c0ca710 con 0x7fba8c161a60 2024-09-11T23:15:34.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba737fe640 1 -- 172.21.15.94:0/2620038677 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84014440 con 0x7fba8c161a60 2024-09-11T23:15:34.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.228+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8c0b71a0 con 0x7fba8c161a60 2024-09-11T23:15:34.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.232+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8c06d6b0 con 0x7fba8c161a60 2024-09-11T23:15:34.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.232+0000 7fba737fe640 1 -- 172.21.15.94:0/2620038677 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba8401c070 con 0x7fba8c161a60 2024-09-11T23:15:34.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.232+0000 7fba737fe640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba780678c0 0x7fba78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.232+0000 7fba737fe640 1 -- 172.21.15.94:0/2620038677 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fba84085cd0 con 0x7fba8c161a60 2024-09-11T23:15:34.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.232+0000 7fba8affd640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba780678c0 0x7fba78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.232+0000 7fba8affd640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba780678c0 0x7fba78069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0af000 tx=0x7fba7c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.236+0000 7fba737fe640 1 -- 172.21.15.94:0/2620038677 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba8c15c0c0 con 0x7fba8c161a60 2024-09-11T23:15:34.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.432+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba8c09dba0 con 0x7fba8c161a60 2024-09-11T23:15:34.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.432+0000 7fba737fe640 1 -- 172.21.15.94:0/2620038677 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7fba84056560 con 0x7fba8c161a60 2024-09-11T23:15:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:34.436 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:15:34.436 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:15:34.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba780678c0 msgr2=0x7fba78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba780678c0 0x7fba78069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0af000 tx=0x7fba7c004740 comp rx=0 tx=0).stop 2024-09-11T23:15:34.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 msgr2=0x7fba8c15bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c15bb80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b970 tx=0x7fba8400be30 comp rx=0 tx=0).stop 2024-09-11T23:15:34.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 shutdown_connections 2024-09-11T23:15:34.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba780678c0 0x7fba78069d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba8c161a60 0x7fba8c15bb80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba8c0d2e90 0x7fba8c15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 --2- 172.21.15.94:0/2620038677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba8c0cf620 0x7fba8c15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 >> 172.21.15.94:0/2620038677 conn(0x7fba8c08bf90 msgr2=0x7fba8c15ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:34.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 shutdown_connections 2024-09-11T23:15:34.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.436+0000 7fba91638640 1 -- 172.21.15.94:0/2620038677 wait complete. 2024-09-11T23:15:34.457 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc481032640 1 Processor -- start 2024-09-11T23:15:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc481032640 1 -- start start 2024-09-11T23:15:34.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc481032640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc47c15bec0 0x7fc47c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc481032640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15c2a0 0x7fc47c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc481032640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47c0b3290 con 0x7fc47c0af2a0 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc481032640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc47c0b3570 con 0x7fc47c15bec0 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc481032640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c0b3850 con 0x7fc47c15c2a0 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc47ad9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc47c15bec0 0x7fc47c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc47ad9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc47c15bec0 0x7fc47c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40392/0 (socket says 172.21.15.94:40392) 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc47ad9d640 1 -- 172.21.15.94:0/39899092 learned_addr learned my addr 172.21.15.94:0/39899092 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc47ad9d640 1 -- 172.21.15.94:0/39899092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15c2a0 msgr2=0x7fc47c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc47ad9d640 1 --2- 172.21.15.94:0/39899092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15c2a0 0x7fc47c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc47ad9d640 1 -- 172.21.15.94:0/39899092 >> v1:172.21.15.94:6789/0 conn(0x7fc47c0af2a0 legacy=0x7fc47c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.564+0000 7fc47ad9d640 1 -- 172.21.15.94:0/39899092 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c0b3b30 con 0x7fc47c15bec0 2024-09-11T23:15:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc47ad9d640 1 --2- 172.21.15.94:0/39899092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15bec0 0x7fc47c0ad200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc464009870 tx=0x7fc46401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37181bf84348fb25 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc479d9b640 1 -- 172.21.15.94:0/39899092 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4640a95f0 con 0x7fc47c15bec0 2024-09-11T23:15:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc479d9b640 1 -- 172.21.15.94:0/39899092 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4640a9790 con 0x7fc47c15bec0 2024-09-11T23:15:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc479d9b640 1 -- 172.21.15.94:0/39899092 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4640a9b60 con 0x7fc47c15bec0 2024-09-11T23:15:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 -- 172.21.15.94:0/39899092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15bec0 msgr2=0x7fc47c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 --2- 172.21.15.94:0/39899092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15bec0 0x7fc47c0ad200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc464009870 tx=0x7fc46401c530 comp rx=0 tx=0).stop 2024-09-11T23:15:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 -- 172.21.15.94:0/39899092 shutdown_connections 2024-09-11T23:15:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 --2- 172.21.15.94:0/39899092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15c2a0 0x7fc47c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 --2- 172.21.15.94:0/39899092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15bec0 0x7fc47c0ad200 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 -- 172.21.15.94:0/39899092 >> 172.21.15.94:0/39899092 conn(0x7fc47c0b1f90 msgr2=0x7fc47c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 -- 172.21.15.94:0/39899092 shutdown_connections 2024-09-11T23:15:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 -- 172.21.15.94:0/39899092 wait complete. 2024-09-11T23:15:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 Processor -- start 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.568+0000 7fc481032640 1 -- start start 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c0af2a0 0x7fc47c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15bec0 0x7fc47c09aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15c2a0 0x7fc47c09dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c0af6b0 con 0x7fc47c15c2a0 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c0ad740 con 0x7fc47c0af2a0 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c169000 con 0x7fc47c15bec0 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15c2a0 0x7fc47c09dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15c2a0 0x7fc47c09dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40402/0 (socket says 172.21.15.94:40402) 2024-09-11T23:15:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 -- 172.21.15.94:0/2912541441 learned_addr learned my addr 172.21.15.94:0/2912541441 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 -- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15bec0 msgr2=0x7fc47c09aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47a59c640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15bec0 0x7fc47c09aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15bec0 0x7fc47c09aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47ad9d640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c0af2a0 0x7fc47c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 -- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c0af2a0 msgr2=0x7fc47c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c0af2a0 0x7fc47c152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 -- 172.21.15.94:0/2912541441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c09cf20 con 0x7fc47c15c2a0 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47b59e640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15c2a0 0x7fc47c09dca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c430 tx=0x7fc47400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc4737fe640 1 -- 172.21.15.94:0/2912541441 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474005220 con 0x7fc47c15c2a0 2024-09-11T23:15:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc4737fe640 1 -- 172.21.15.94:0/2912541441 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4740053c0 con 0x7fc47c15c2a0 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c09b780 con 0x7fc47c15c2a0 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc4737fe640 1 -- 172.21.15.94:0/2912541441 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474007270 con 0x7fc47c15c2a0 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c09d4a0 con 0x7fc47c15c2a0 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47c0ad200 con 0x7fc47c15c2a0 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc4737fe640 1 -- 172.21.15.94:0/2912541441 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc474019020 con 0x7fc47c15c2a0 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc4737fe640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc45c0678c0 0x7fc45c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc4737fe640 1 -- 172.21.15.94:0/2912541441 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc474085390 con 0x7fc47c15c2a0 2024-09-11T23:15:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.572+0000 7fc47ad9d640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc45c0678c0 0x7fc45c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.576+0000 7fc47ad9d640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc45c0678c0 0x7fc45c069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4640ae000 tx=0x7fc4640b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.576+0000 7fc4737fe640 1 -- 172.21.15.94:0/2912541441 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc474055b90 con 0x7fc47c15c2a0 2024-09-11T23:15:34.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.728+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc47c06fcd0 con 0x7fc47c15c2a0 2024-09-11T23:15:34.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc4737fe640 1 -- 172.21.15.94:0/2912541441 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fc474055490 con 0x7fc47c15c2a0 2024-09-11T23:15:34.733 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:34.733 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":25,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:19.997149+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc45c0678c0 msgr2=0x7fc45c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc45c0678c0 0x7fc45c069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4640ae000 tx=0x7fc4640b3040 comp rx=0 tx=0).stop 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15c2a0 msgr2=0x7fc47c09dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15c2a0 0x7fc47c09dca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c430 tx=0x7fc47400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 shutdown_connections 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc45c0678c0 0x7fc45c069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc47c15c2a0 0x7fc47c09dca0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc47c15bec0 0x7fc47c09aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 --2- 172.21.15.94:0/2912541441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c0af2a0 0x7fc47c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 >> 172.21.15.94:0/2912541441 conn(0x7fc47c0b1f90 msgr2=0x7fc47c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 shutdown_connections 2024-09-11T23:15:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.732+0000 7fc481032640 1 -- 172.21.15.94:0/2912541441 wait complete. 2024-09-11T23:15:34.750 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:15:34.750 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:15:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.864+0000 7f593026a640 1 Processor -- start 2024-09-11T23:15:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.864+0000 7f593026a640 1 -- start start 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f593026a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f592815c2a0 0x7f59280aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f593026a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f59280af2a0 0x7f592806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f593026a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59280b3290 con 0x7f592815bec0 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f593026a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f59280b3570 con 0x7f592815c2a0 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f593026a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f59280b3850 con 0x7f59280af2a0 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f592815c2a0 0x7f59280aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f592815c2a0 0x7f59280aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40406/0 (socket says 172.21.15.94:40406) 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 -- 172.21.15.94:0/1018043264 learned_addr learned my addr 172.21.15.94:0/1018043264 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592e807640 1 --2- 172.21.15.94:0/1018043264 >> v2:172.21.15.155:3300/0 conn(0x7f59280af2a0 0x7f592806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 -- 172.21.15.94:0/1018043264 >> v2:172.21.15.155:3300/0 conn(0x7f59280af2a0 msgr2=0x7f592806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 --2- 172.21.15.94:0/1018043264 >> v2:172.21.15.155:3300/0 conn(0x7f59280af2a0 0x7f592806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 -- 172.21.15.94:0/1018043264 >> v1:172.21.15.155:6789/0 conn(0x7f592815bec0 legacy=0x7f59280ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:34.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 -- 172.21.15.94:0/1018043264 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59280b3b30 con 0x7f592815c2a0 2024-09-11T23:15:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.868+0000 7f592d805640 1 --2- 172.21.15.94:0/1018043264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815c2a0 0x7f59280aed60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59280b2fb0 tx=0x7f591801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676ac34206c8e967 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d004640 1 -- 172.21.15.94:0/1018043264 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59180aa610 con 0x7f592815c2a0 2024-09-11T23:15:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d004640 1 -- 172.21.15.94:0/1018043264 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59180af070 con 0x7f592815c2a0 2024-09-11T23:15:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d004640 1 -- 172.21.15.94:0/1018043264 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59180aa9d0 con 0x7f592815c2a0 2024-09-11T23:15:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- 172.21.15.94:0/1018043264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815c2a0 msgr2=0x7f59280aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 --2- 172.21.15.94:0/1018043264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815c2a0 0x7f59280aed60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59280b2fb0 tx=0x7f591801c4b0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- 172.21.15.94:0/1018043264 shutdown_connections 2024-09-11T23:15:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 --2- 172.21.15.94:0/1018043264 >> v2:172.21.15.155:3300/0 conn(0x7f59280af2a0 0x7f592806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 --2- 172.21.15.94:0/1018043264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815c2a0 0x7f59280aed60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- 172.21.15.94:0/1018043264 >> 172.21.15.94:0/1018043264 conn(0x7f59280b1f90 msgr2=0x7f59280b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- 172.21.15.94:0/1018043264 shutdown_connections 2024-09-11T23:15:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- 172.21.15.94:0/1018043264 wait complete. 2024-09-11T23:15:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 Processor -- start 2024-09-11T23:15:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- start start 2024-09-11T23:15:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59280af2a0 0x7f592814c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815bec0 0x7f592815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f592815c2a0 0x7f592814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f592806ed50 con 0x7f592815bec0 2024-09-11T23:15:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f59280af6b0 con 0x7f592815c2a0 2024-09-11T23:15:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f593026a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f592806eed0 con 0x7f59280af2a0 2024-09-11T23:15:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815bec0 0x7f592815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815bec0 0x7f592815ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40418/0 (socket says 172.21.15.94:40418) 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 -- 172.21.15.94:0/1461006332 learned_addr learned my addr 172.21.15.94:0/1461006332 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592e006640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59280af2a0 0x7f592814c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592e807640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f592815c2a0 0x7f592814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 -- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59280af2a0 msgr2=0x7f592814c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59280af2a0 0x7f592814c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 -- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f592815c2a0 msgr2=0x7f592814a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f592815c2a0 0x7f592814a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.872+0000 7f592d805640 1 -- 172.21.15.94:0/1461006332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592815c750 con 0x7f592815bec0 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f592d805640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815bec0 0x7f592815ee70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59180ac040 tx=0x7f5918019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f591effd640 1 -- 172.21.15.94:0/1461006332 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59180b4810 con 0x7f592815bec0 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f591effd640 1 -- 172.21.15.94:0/1461006332 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59180b49d0 con 0x7f592815bec0 2024-09-11T23:15:34.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f591effd640 1 -- 172.21.15.94:0/1461006332 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59180b4dc0 con 0x7f592815bec0 2024-09-11T23:15:34.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592815ca30 con 0x7f592815bec0 2024-09-11T23:15:34.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592814c860 con 0x7f592815bec0 2024-09-11T23:15:34.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592806f1d0 con 0x7f592815bec0 2024-09-11T23:15:34.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f591effd640 1 -- 172.21.15.94:0/1461006332 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59180bc020 con 0x7f592815bec0 2024-09-11T23:15:34.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f591effd640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f590c0678c0 0x7f590c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:34.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f591effd640 1 -- 172.21.15.94:0/1461006332 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f591811feb0 con 0x7f592815bec0 2024-09-11T23:15:34.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f592e006640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f590c0678c0 0x7f590c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:34.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.876+0000 7f592e006640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f590c0678c0 0x7f590c069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5924004e30 tx=0x7f5924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:34.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:34.880+0000 7f591effd640 1 -- 172.21.15.94:0/1461006332 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59180c5070 con 0x7f592815bec0 2024-09-11T23:15:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.040+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f592806fcd0 con 0x7f590c0678c0 2024-09-11T23:15:35.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.064+0000 7f591effd640 1 -- 172.21.15.94:0/1461006332 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f592806fcd0 con 0x7f590c0678c0 2024-09-11T23:15:35.068 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:35.072 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:15:35.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f590c0678c0 msgr2=0x7f590c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f590c0678c0 0x7f590c069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5924004e30 tx=0x7f5924009040 comp rx=0 tx=0).stop 2024-09-11T23:15:35.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815bec0 msgr2=0x7f592815ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815bec0 0x7f592815ee70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59180ac040 tx=0x7f5918019250 comp rx=0 tx=0).stop 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 shutdown_connections 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f592815c2a0 0x7f592814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f590c0678c0 0x7f590c069d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f592815bec0 0x7f592815ee70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 --2- 172.21.15.94:0/1461006332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59280af2a0 0x7f592814c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 >> 172.21.15.94:0/1461006332 conn(0x7f59280b1f90 msgr2=0x7f592814f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 shutdown_connections 2024-09-11T23:15:35.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.068+0000 7f593026a640 1 -- 172.21.15.94:0/1461006332 wait complete. 2024-09-11T23:15:35.089 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-11T23:15:33.973338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236204,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738516,"statfs":{"total":773094113280,"available":772852240384,"internally_reserved":0,"allocated":3383296,"data_stored":2049164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004772"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256938+0000","last_change":"2024-09-11T23:15:12.971939+0000","last_active":"2024-09-11T23:15:20.256938+0000","last_peered":"2024-09-11T23:15:20.256938+0000","last_clean":"2024-09-11T23:15:20.256938+0000","last_became_active":"2024-09-11T23:15:12.971664+0000","last_became_peered":"2024-09-11T23:15:12.971664+0000","last_unstale":"2024-09-11T23:15:20.256938+0000","last_undegraded":"2024-09-11T23:15:20.256938+0000","last_fullsized":"2024-09-11T23:15:20.256938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:21.586294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003953+0000","last_change":"2024-09-11T23:15:13.990297+0000","last_active":"2024-09-11T23:15:20.003953+0000","last_peered":"2024-09-11T23:15:20.003953+0000","last_clean":"2024-09-11T23:15:20.003953+0000","last_became_active":"2024-09-11T23:15:13.989971+0000","last_became_peered":"2024-09-11T23:15:13.989971+0000","last_unstale":"2024-09-11T23:15:20.003953+0000","last_undegraded":"2024-09-11T23:15:20.003953+0000","last_fullsized":"2024-09-11T23:15:20.003953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002406+0000","last_change":"2024-09-11T23:15:18.458647+0000","last_active":"2024-09-11T23:15:20.002406+0000","last_peered":"2024-09-11T23:15:20.002406+0000","last_clean":"2024-09-11T23:15:20.002406+0000","last_became_active":"2024-09-11T23:15:18.457571+0000","last_became_peered":"2024-09-11T23:15:18.457571+0000","last_unstale":"2024-09-11T23:15:20.002406+0000","last_undegraded":"2024-09-11T23:15:20.002406+0000","last_fullsized":"2024-09-11T23:15:20.002406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:45.970652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004208+0000","last_change":"2024-09-11T23:15:12.963138+0000","last_active":"2024-09-11T23:15:20.004208+0000","last_peered":"2024-09-11T23:15:20.004208+0000","last_clean":"2024-09-11T23:15:20.004208+0000","last_became_active":"2024-09-11T23:15:12.962545+0000","last_became_peered":"2024-09-11T23:15:12.962545+0000","last_unstale":"2024-09-11T23:15:20.004208+0000","last_undegraded":"2024-09-11T23:15:20.004208+0000","last_fullsized":"2024-09-11T23:15:20.004208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256716+0000","last_change":"2024-09-11T23:15:13.979850+0000","last_active":"2024-09-11T23:15:20.256716+0000","last_peered":"2024-09-11T23:15:20.256716+0000","last_clean":"2024-09-11T23:15:20.256716+0000","last_became_active":"2024-09-11T23:15:13.979530+0000","last_became_peered":"2024-09-11T23:15:13.979530+0000","last_unstale":"2024-09-11T23:15:20.256716+0000","last_undegraded":"2024-09-11T23:15:20.256716+0000","last_fullsized":"2024-09-11T23:15:20.256716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009823+0000","last_change":"2024-09-11T23:15:18.048713+0000","last_active":"2024-09-11T23:15:20.009823+0000","last_peered":"2024-09-11T23:15:20.009823+0000","last_clean":"2024-09-11T23:15:20.009823+0000","last_became_active":"2024-09-11T23:15:18.047487+0000","last_became_peered":"2024-09-11T23:15:18.047487+0000","last_unstale":"2024-09-11T23:15:20.009823+0000","last_undegraded":"2024-09-11T23:15:20.009823+0000","last_fullsized":"2024-09-11T23:15:20.009823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256782+0000","last_change":"2024-09-11T23:15:12.973574+0000","last_active":"2024-09-11T23:15:20.256782+0000","last_peered":"2024-09-11T23:15:20.256782+0000","last_clean":"2024-09-11T23:15:20.256782+0000","last_became_active":"2024-09-11T23:15:12.972945+0000","last_became_peered":"2024-09-11T23:15:12.972945+0000","last_unstale":"2024-09-11T23:15:20.256782+0000","last_undegraded":"2024-09-11T23:15:20.256782+0000","last_fullsized":"2024-09-11T23:15:20.256782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.523986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005274+0000","last_change":"2024-09-11T23:15:13.955300+0000","last_active":"2024-09-11T23:15:20.005274+0000","last_peered":"2024-09-11T23:15:20.005274+0000","last_clean":"2024-09-11T23:15:20.005274+0000","last_became_active":"2024-09-11T23:15:13.952807+0000","last_became_peered":"2024-09-11T23:15:13.952807+0000","last_unstale":"2024-09-11T23:15:20.005274+0000","last_undegraded":"2024-09-11T23:15:20.005274+0000","last_fullsized":"2024-09-11T23:15:20.005274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010459+0000","last_change":"2024-09-11T23:15:18.046772+0000","last_active":"2024-09-11T23:15:20.010459+0000","last_peered":"2024-09-11T23:15:20.010459+0000","last_clean":"2024-09-11T23:15:20.010459+0000","last_became_active":"2024-09-11T23:15:18.044361+0000","last_became_peered":"2024-09-11T23:15:18.044361+0000","last_unstale":"2024-09-11T23:15:20.010459+0000","last_undegraded":"2024-09-11T23:15:20.010459+0000","last_fullsized":"2024-09-11T23:15:20.010459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254970+0000","last_change":"2024-09-11T23:15:12.973316+0000","last_active":"2024-09-11T23:15:20.254970+0000","last_peered":"2024-09-11T23:15:20.254970+0000","last_clean":"2024-09-11T23:15:20.254970+0000","last_became_active":"2024-09-11T23:15:12.972758+0000","last_became_peered":"2024-09-11T23:15:12.972758+0000","last_unstale":"2024-09-11T23:15:20.254970+0000","last_undegraded":"2024-09-11T23:15:20.254970+0000","last_fullsized":"2024-09-11T23:15:20.254970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:56.819101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006154+0000","last_change":"2024-09-11T23:15:13.974148+0000","last_active":"2024-09-11T23:15:20.006154+0000","last_peered":"2024-09-11T23:15:20.006154+0000","last_clean":"2024-09-11T23:15:20.006154+0000","last_became_active":"2024-09-11T23:15:13.973423+0000","last_became_peered":"2024-09-11T23:15:13.973423+0000","last_unstale":"2024-09-11T23:15:20.006154+0000","last_undegraded":"2024-09-11T23:15:20.006154+0000","last_fullsized":"2024-09-11T23:15:20.006154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009681+0000","last_change":"2024-09-11T23:15:18.039529+0000","last_active":"2024-09-11T23:15:20.009681+0000","last_peered":"2024-09-11T23:15:20.009681+0000","last_clean":"2024-09-11T23:15:20.009681+0000","last_became_active":"2024-09-11T23:15:18.035361+0000","last_became_peered":"2024-09-11T23:15:18.035361+0000","last_unstale":"2024-09-11T23:15:20.009681+0000","last_undegraded":"2024-09-11T23:15:20.009681+0000","last_fullsized":"2024-09-11T23:15:20.009681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252965+0000","last_change":"2024-09-11T23:15:13.987303+0000","last_active":"2024-09-11T23:15:20.252965+0000","last_peered":"2024-09-11T23:15:20.252965+0000","last_clean":"2024-09-11T23:15:20.252965+0000","last_became_active":"2024-09-11T23:15:13.986026+0000","last_became_peered":"2024-09-11T23:15:13.986026+0000","last_unstale":"2024-09-11T23:15:20.252965+0000","last_undegraded":"2024-09-11T23:15:20.252965+0000","last_fullsized":"2024-09-11T23:15:20.252965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255344+0000","last_change":"2024-09-11T23:15:12.978008+0000","last_active":"2024-09-11T23:15:20.255344+0000","last_peered":"2024-09-11T23:15:20.255344+0000","last_clean":"2024-09-11T23:15:20.255344+0000","last_became_active":"2024-09-11T23:15:12.977577+0000","last_became_peered":"2024-09-11T23:15:12.977577+0000","last_unstale":"2024-09-11T23:15:20.255344+0000","last_undegraded":"2024-09-11T23:15:20.255344+0000","last_fullsized":"2024-09-11T23:15:20.255344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:04.986111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011696+0000","last_change":"2024-09-11T23:15:18.040717+0000","last_active":"2024-09-11T23:15:20.011696+0000","last_peered":"2024-09-11T23:15:20.011696+0000","last_clean":"2024-09-11T23:15:20.011696+0000","last_became_active":"2024-09-11T23:15:18.039316+0000","last_became_peered":"2024-09-11T23:15:18.039316+0000","last_unstale":"2024-09-11T23:15:20.011696+0000","last_undegraded":"2024-09-11T23:15:20.011696+0000","last_fullsized":"2024-09-11T23:15:20.011696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002755+0000","last_change":"2024-09-11T23:15:13.951501+0000","last_active":"2024-09-11T23:15:20.002755+0000","last_peered":"2024-09-11T23:15:20.002755+0000","last_clean":"2024-09-11T23:15:20.002755+0000","last_became_active":"2024-09-11T23:15:13.951199+0000","last_became_peered":"2024-09-11T23:15:13.951199+0000","last_unstale":"2024-09-11T23:15:20.002755+0000","last_undegraded":"2024-09-11T23:15:20.002755+0000","last_fullsized":"2024-09-11T23:15:20.002755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253117+0000","last_change":"2024-09-11T23:15:12.963618+0000","last_active":"2024-09-11T23:15:20.253117+0000","last_peered":"2024-09-11T23:15:20.253117+0000","last_clean":"2024-09-11T23:15:20.253117+0000","last_became_active":"2024-09-11T23:15:12.963221+0000","last_became_peered":"2024-09-11T23:15:12.963221+0000","last_unstale":"2024-09-11T23:15:20.253117+0000","last_undegraded":"2024-09-11T23:15:20.253117+0000","last_fullsized":"2024-09-11T23:15:20.253117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011380+0000","last_change":"2024-09-11T23:15:18.037481+0000","last_active":"2024-09-11T23:15:20.011380+0000","last_peered":"2024-09-11T23:15:20.011380+0000","last_clean":"2024-09-11T23:15:20.011380+0000","last_became_active":"2024-09-11T23:15:18.036406+0000","last_became_peered":"2024-09-11T23:15:18.036406+0000","last_unstale":"2024-09-11T23:15:20.011380+0000","last_undegraded":"2024-09-11T23:15:20.011380+0000","last_fullsized":"2024-09-11T23:15:20.011380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002601+0000","last_change":"2024-09-11T23:15:13.946573+0000","last_active":"2024-09-11T23:15:20.002601+0000","last_peered":"2024-09-11T23:15:20.002601+0000","last_clean":"2024-09-11T23:15:20.002601+0000","last_became_active":"2024-09-11T23:15:13.946197+0000","last_became_peered":"2024-09-11T23:15:13.946197+0000","last_unstale":"2024-09-11T23:15:20.002601+0000","last_undegraded":"2024-09-11T23:15:20.002601+0000","last_fullsized":"2024-09-11T23:15:20.002601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251927+0000","last_change":"2024-09-11T23:15:12.973005+0000","last_active":"2024-09-11T23:15:20.251927+0000","last_peered":"2024-09-11T23:15:20.251927+0000","last_clean":"2024-09-11T23:15:20.251927+0000","last_became_active":"2024-09-11T23:15:12.972755+0000","last_became_peered":"2024-09-11T23:15:12.972755+0000","last_unstale":"2024-09-11T23:15:20.251927+0000","last_undegraded":"2024-09-11T23:15:20.251927+0000","last_fullsized":"2024-09-11T23:15:20.251927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254128+0000","last_change":"2024-09-11T23:15:18.458359+0000","last_active":"2024-09-11T23:15:20.254128+0000","last_peered":"2024-09-11T23:15:20.254128+0000","last_clean":"2024-09-11T23:15:20.254128+0000","last_became_active":"2024-09-11T23:15:18.457312+0000","last_became_peered":"2024-09-11T23:15:18.457312+0000","last_unstale":"2024-09-11T23:15:20.254128+0000","last_undegraded":"2024-09-11T23:15:20.254128+0000","last_fullsized":"2024-09-11T23:15:20.254128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010080+0000","last_change":"2024-09-11T23:15:13.949978+0000","last_active":"2024-09-11T23:15:20.010080+0000","last_peered":"2024-09-11T23:15:20.010080+0000","last_clean":"2024-09-11T23:15:20.010080+0000","last_became_active":"2024-09-11T23:15:13.948572+0000","last_became_peered":"2024-09-11T23:15:13.948572+0000","last_unstale":"2024-09-11T23:15:20.010080+0000","last_undegraded":"2024-09-11T23:15:20.010080+0000","last_fullsized":"2024-09-11T23:15:20.010080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:18.647972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253258+0000","last_change":"2024-09-11T23:15:12.967038+0000","last_active":"2024-09-11T23:15:20.253258+0000","last_peered":"2024-09-11T23:15:20.253258+0000","last_clean":"2024-09-11T23:15:20.253258+0000","last_became_active":"2024-09-11T23:15:12.965415+0000","last_became_peered":"2024-09-11T23:15:12.965415+0000","last_unstale":"2024-09-11T23:15:20.253258+0000","last_undegraded":"2024-09-11T23:15:20.253258+0000","last_fullsized":"2024-09-11T23:15:20.253258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011695+0000","last_change":"2024-09-11T23:15:18.046520+0000","last_active":"2024-09-11T23:15:20.011695+0000","last_peered":"2024-09-11T23:15:20.011695+0000","last_clean":"2024-09-11T23:15:20.011695+0000","last_became_active":"2024-09-11T23:15:18.045457+0000","last_became_peered":"2024-09-11T23:15:18.045457+0000","last_unstale":"2024-09-11T23:15:20.011695+0000","last_undegraded":"2024-09-11T23:15:20.011695+0000","last_fullsized":"2024-09-11T23:15:20.011695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256732+0000","last_change":"2024-09-11T23:15:13.941941+0000","last_active":"2024-09-11T23:15:20.256732+0000","last_peered":"2024-09-11T23:15:20.256732+0000","last_clean":"2024-09-11T23:15:20.256732+0000","last_became_active":"2024-09-11T23:15:13.941593+0000","last_became_peered":"2024-09-11T23:15:13.941593+0000","last_unstale":"2024-09-11T23:15:20.256732+0000","last_undegraded":"2024-09-11T23:15:20.256732+0000","last_fullsized":"2024-09-11T23:15:20.256732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:33.314997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255566+0000","last_change":"2024-09-11T23:15:12.980259+0000","last_active":"2024-09-11T23:15:20.255566+0000","last_peered":"2024-09-11T23:15:20.255566+0000","last_clean":"2024-09-11T23:15:20.255566+0000","last_became_active":"2024-09-11T23:15:12.979084+0000","last_became_peered":"2024-09-11T23:15:12.979084+0000","last_unstale":"2024-09-11T23:15:20.255566+0000","last_undegraded":"2024-09-11T23:15:20.255566+0000","last_fullsized":"2024-09-11T23:15:20.255566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010030+0000","last_change":"2024-09-11T23:15:18.450939+0000","last_active":"2024-09-11T23:15:20.010030+0000","last_peered":"2024-09-11T23:15:20.010030+0000","last_clean":"2024-09-11T23:15:20.010030+0000","last_became_active":"2024-09-11T23:15:18.449905+0000","last_became_peered":"2024-09-11T23:15:18.449905+0000","last_unstale":"2024-09-11T23:15:20.010030+0000","last_undegraded":"2024-09-11T23:15:20.010030+0000","last_fullsized":"2024-09-11T23:15:20.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004150+0000","last_change":"2024-09-11T23:15:13.998809+0000","last_active":"2024-09-11T23:15:20.004150+0000","last_peered":"2024-09-11T23:15:20.004150+0000","last_clean":"2024-09-11T23:15:20.004150+0000","last_became_active":"2024-09-11T23:15:13.998546+0000","last_became_peered":"2024-09-11T23:15:13.998546+0000","last_unstale":"2024-09-11T23:15:20.004150+0000","last_undegraded":"2024-09-11T23:15:20.004150+0000","last_fullsized":"2024-09-11T23:15:20.004150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253620+0000","last_change":"2024-09-11T23:15:12.962583+0000","last_active":"2024-09-11T23:15:20.253620+0000","last_peered":"2024-09-11T23:15:20.253620+0000","last_clean":"2024-09-11T23:15:20.253620+0000","last_became_active":"2024-09-11T23:15:12.962238+0000","last_became_peered":"2024-09-11T23:15:12.962238+0000","last_unstale":"2024-09-11T23:15:20.253620+0000","last_undegraded":"2024-09-11T23:15:20.253620+0000","last_fullsized":"2024-09-11T23:15:20.253620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002270+0000","last_change":"2024-09-11T23:15:18.450216+0000","last_active":"2024-09-11T23:15:20.002270+0000","last_peered":"2024-09-11T23:15:20.002270+0000","last_clean":"2024-09-11T23:15:20.002270+0000","last_became_active":"2024-09-11T23:15:18.449301+0000","last_became_peered":"2024-09-11T23:15:18.449301+0000","last_unstale":"2024-09-11T23:15:20.002270+0000","last_undegraded":"2024-09-11T23:15:20.002270+0000","last_fullsized":"2024-09-11T23:15:20.002270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251732+0000","last_change":"2024-09-11T23:15:13.945641+0000","last_active":"2024-09-11T23:15:20.251732+0000","last_peered":"2024-09-11T23:15:20.251732+0000","last_clean":"2024-09-11T23:15:20.251732+0000","last_became_active":"2024-09-11T23:15:13.945333+0000","last_became_peered":"2024-09-11T23:15:13.945333+0000","last_unstale":"2024-09-11T23:15:20.251732+0000","last_undegraded":"2024-09-11T23:15:20.251732+0000","last_fullsized":"2024-09-11T23:15:20.251732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257048+0000","last_change":"2024-09-11T23:15:12.974878+0000","last_active":"2024-09-11T23:15:20.257048+0000","last_peered":"2024-09-11T23:15:20.257048+0000","last_clean":"2024-09-11T23:15:20.257048+0000","last_became_active":"2024-09-11T23:15:12.973946+0000","last_became_peered":"2024-09-11T23:15:12.973946+0000","last_unstale":"2024-09-11T23:15:20.257048+0000","last_undegraded":"2024-09-11T23:15:20.257048+0000","last_fullsized":"2024-09-11T23:15:20.257048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255824+0000","last_change":"2024-09-11T23:15:18.452665+0000","last_active":"2024-09-11T23:15:20.255824+0000","last_peered":"2024-09-11T23:15:20.255824+0000","last_clean":"2024-09-11T23:15:20.255824+0000","last_became_active":"2024-09-11T23:15:18.450946+0000","last_became_peered":"2024-09-11T23:15:18.450946+0000","last_unstale":"2024-09-11T23:15:20.255824+0000","last_undegraded":"2024-09-11T23:15:20.255824+0000","last_fullsized":"2024-09-11T23:15:20.255824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006334+0000","last_change":"2024-09-11T23:15:13.951679+0000","last_active":"2024-09-11T23:15:20.006334+0000","last_peered":"2024-09-11T23:15:20.006334+0000","last_clean":"2024-09-11T23:15:20.006334+0000","last_became_active":"2024-09-11T23:15:13.947656+0000","last_became_peered":"2024-09-11T23:15:13.947656+0000","last_unstale":"2024-09-11T23:15:20.006334+0000","last_undegraded":"2024-09-11T23:15:20.006334+0000","last_fullsized":"2024-09-11T23:15:20.006334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251827+0000","last_change":"2024-09-11T23:15:12.945808+0000","last_active":"2024-09-11T23:15:20.251827+0000","last_peered":"2024-09-11T23:15:20.251827+0000","last_clean":"2024-09-11T23:15:20.251827+0000","last_became_active":"2024-09-11T23:15:12.945339+0000","last_became_peered":"2024-09-11T23:15:12.945339+0000","last_unstale":"2024-09-11T23:15:20.251827+0000","last_undegraded":"2024-09-11T23:15:20.251827+0000","last_fullsized":"2024-09-11T23:15:20.251827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252167+0000","last_change":"2024-09-11T23:15:18.042569+0000","last_active":"2024-09-11T23:15:20.252167+0000","last_peered":"2024-09-11T23:15:20.252167+0000","last_clean":"2024-09-11T23:15:20.252167+0000","last_became_active":"2024-09-11T23:15:18.042221+0000","last_became_peered":"2024-09-11T23:15:18.042221+0000","last_unstale":"2024-09-11T23:15:20.252167+0000","last_undegraded":"2024-09-11T23:15:20.252167+0000","last_fullsized":"2024-09-11T23:15:20.252167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011131+0000","last_change":"2024-09-11T23:15:13.959260+0000","last_active":"2024-09-11T23:15:20.011131+0000","last_peered":"2024-09-11T23:15:20.011131+0000","last_clean":"2024-09-11T23:15:20.011131+0000","last_became_active":"2024-09-11T23:15:13.958012+0000","last_became_peered":"2024-09-11T23:15:13.958012+0000","last_unstale":"2024-09-11T23:15:20.011131+0000","last_undegraded":"2024-09-11T23:15:20.011131+0000","last_fullsized":"2024-09-11T23:15:20.011131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:00.528239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005527+0000","last_change":"2024-09-11T23:15:12.956721+0000","last_active":"2024-09-11T23:15:20.005527+0000","last_peered":"2024-09-11T23:15:20.005527+0000","last_clean":"2024-09-11T23:15:20.005527+0000","last_became_active":"2024-09-11T23:15:12.956051+0000","last_became_peered":"2024-09-11T23:15:12.956051+0000","last_unstale":"2024-09-11T23:15:20.005527+0000","last_undegraded":"2024-09-11T23:15:20.005527+0000","last_fullsized":"2024-09-11T23:15:20.005527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251677+0000","last_change":"2024-09-11T23:15:18.038561+0000","last_active":"2024-09-11T23:15:20.251677+0000","last_peered":"2024-09-11T23:15:20.251677+0000","last_clean":"2024-09-11T23:15:20.251677+0000","last_became_active":"2024-09-11T23:15:18.038087+0000","last_became_peered":"2024-09-11T23:15:18.038087+0000","last_unstale":"2024-09-11T23:15:20.251677+0000","last_undegraded":"2024-09-11T23:15:20.251677+0000","last_fullsized":"2024-09-11T23:15:20.251677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251360+0000","last_change":"2024-09-11T23:15:13.945048+0000","last_active":"2024-09-11T23:15:20.251360+0000","last_peered":"2024-09-11T23:15:20.251360+0000","last_clean":"2024-09-11T23:15:20.251360+0000","last_became_active":"2024-09-11T23:15:13.944724+0000","last_became_peered":"2024-09-11T23:15:13.944724+0000","last_unstale":"2024-09-11T23:15:20.251360+0000","last_undegraded":"2024-09-11T23:15:20.251360+0000","last_fullsized":"2024-09-11T23:15:20.251360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252961+0000","last_change":"2024-09-11T23:15:12.960646+0000","last_active":"2024-09-11T23:15:20.252961+0000","last_peered":"2024-09-11T23:15:20.252961+0000","last_clean":"2024-09-11T23:15:20.252961+0000","last_became_active":"2024-09-11T23:15:12.959926+0000","last_became_peered":"2024-09-11T23:15:12.959926+0000","last_unstale":"2024-09-11T23:15:20.252961+0000","last_undegraded":"2024-09-11T23:15:20.252961+0000","last_fullsized":"2024-09-11T23:15:20.252961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254350+0000","last_change":"2024-09-11T23:15:18.038883+0000","last_active":"2024-09-11T23:15:20.254350+0000","last_peered":"2024-09-11T23:15:20.254350+0000","last_clean":"2024-09-11T23:15:20.254350+0000","last_became_active":"2024-09-11T23:15:18.038060+0000","last_became_peered":"2024-09-11T23:15:18.038060+0000","last_unstale":"2024-09-11T23:15:20.254350+0000","last_undegraded":"2024-09-11T23:15:20.254350+0000","last_fullsized":"2024-09-11T23:15:20.254350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255170+0000","last_change":"2024-09-11T23:15:13.951852+0000","last_active":"2024-09-11T23:15:20.255170+0000","last_peered":"2024-09-11T23:15:20.255170+0000","last_clean":"2024-09-11T23:15:20.255170+0000","last_became_active":"2024-09-11T23:15:13.951463+0000","last_became_peered":"2024-09-11T23:15:13.951463+0000","last_unstale":"2024-09-11T23:15:20.255170+0000","last_undegraded":"2024-09-11T23:15:20.255170+0000","last_fullsized":"2024-09-11T23:15:20.255170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:07.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253562+0000","last_change":"2024-09-11T23:15:12.967704+0000","last_active":"2024-09-11T23:15:20.253562+0000","last_peered":"2024-09-11T23:15:20.253562+0000","last_clean":"2024-09-11T23:15:20.253562+0000","last_became_active":"2024-09-11T23:15:12.966314+0000","last_became_peered":"2024-09-11T23:15:12.966314+0000","last_unstale":"2024-09-11T23:15:20.253562+0000","last_undegraded":"2024-09-11T23:15:20.253562+0000","last_fullsized":"2024-09-11T23:15:20.253562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256718+0000","last_change":"2024-09-11T23:15:18.451095+0000","last_active":"2024-09-11T23:15:20.256718+0000","last_peered":"2024-09-11T23:15:20.256718+0000","last_clean":"2024-09-11T23:15:20.256718+0000","last_became_active":"2024-09-11T23:15:18.449565+0000","last_became_peered":"2024-09-11T23:15:18.449565+0000","last_unstale":"2024-09-11T23:15:20.256718+0000","last_undegraded":"2024-09-11T23:15:20.256718+0000","last_fullsized":"2024-09-11T23:15:20.256718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003000+0000","last_change":"2024-09-11T23:15:13.980670+0000","last_active":"2024-09-11T23:15:20.003000+0000","last_peered":"2024-09-11T23:15:20.003000+0000","last_clean":"2024-09-11T23:15:20.003000+0000","last_became_active":"2024-09-11T23:15:13.980357+0000","last_became_peered":"2024-09-11T23:15:13.980357+0000","last_unstale":"2024-09-11T23:15:20.003000+0000","last_undegraded":"2024-09-11T23:15:20.003000+0000","last_fullsized":"2024-09-11T23:15:20.003000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005545+0000","last_change":"2024-09-11T23:15:12.959799+0000","last_active":"2024-09-11T23:15:20.005545+0000","last_peered":"2024-09-11T23:15:20.005545+0000","last_clean":"2024-09-11T23:15:20.005545+0000","last_became_active":"2024-09-11T23:15:12.959033+0000","last_became_peered":"2024-09-11T23:15:12.959033+0000","last_unstale":"2024-09-11T23:15:20.005545+0000","last_undegraded":"2024-09-11T23:15:20.005545+0000","last_fullsized":"2024-09-11T23:15:20.005545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253840+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:15:20.253840+0000","last_peered":"2024-09-11T23:15:20.253840+0000","last_clean":"2024-09-11T23:15:20.253840+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:15:20.253840+0000","last_undegraded":"2024-09-11T23:15:20.253840+0000","last_fullsized":"2024-09-11T23:15:20.253840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252619+0000","last_change":"2024-09-11T23:15:18.458819+0000","last_active":"2024-09-11T23:15:20.252619+0000","last_peered":"2024-09-11T23:15:20.252619+0000","last_clean":"2024-09-11T23:15:20.252619+0000","last_became_active":"2024-09-11T23:15:18.457747+0000","last_became_peered":"2024-09-11T23:15:18.457747+0000","last_unstale":"2024-09-11T23:15:20.252619+0000","last_undegraded":"2024-09-11T23:15:20.252619+0000","last_fullsized":"2024-09-11T23:15:20.252619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256534+0000","last_change":"2024-09-11T23:15:14.002907+0000","last_active":"2024-09-11T23:15:20.256534+0000","last_peered":"2024-09-11T23:15:20.256534+0000","last_clean":"2024-09-11T23:15:20.256534+0000","last_became_active":"2024-09-11T23:15:13.996895+0000","last_became_peered":"2024-09-11T23:15:13.996895+0000","last_unstale":"2024-09-11T23:15:20.256534+0000","last_undegraded":"2024-09-11T23:15:20.256534+0000","last_fullsized":"2024-09-11T23:15:20.256534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252892+0000","last_change":"2024-09-11T23:15:12.957780+0000","last_active":"2024-09-11T23:15:20.252892+0000","last_peered":"2024-09-11T23:15:20.252892+0000","last_clean":"2024-09-11T23:15:20.252892+0000","last_became_active":"2024-09-11T23:15:12.957375+0000","last_became_peered":"2024-09-11T23:15:12.957375+0000","last_unstale":"2024-09-11T23:15:20.252892+0000","last_undegraded":"2024-09-11T23:15:20.252892+0000","last_fullsized":"2024-09-11T23:15:20.252892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252849+0000","last_change":"2024-09-11T23:15:18.451410+0000","last_active":"2024-09-11T23:15:20.252849+0000","last_peered":"2024-09-11T23:15:20.252849+0000","last_clean":"2024-09-11T23:15:20.252849+0000","last_became_active":"2024-09-11T23:15:18.450381+0000","last_became_peered":"2024-09-11T23:15:18.450381+0000","last_unstale":"2024-09-11T23:15:20.252849+0000","last_undegraded":"2024-09-11T23:15:20.252849+0000","last_fullsized":"2024-09-11T23:15:20.252849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005415+0000","last_change":"2024-09-11T23:15:13.951881+0000","last_active":"2024-09-11T23:15:20.005415+0000","last_peered":"2024-09-11T23:15:20.005415+0000","last_clean":"2024-09-11T23:15:20.005415+0000","last_became_active":"2024-09-11T23:15:13.951002+0000","last_became_peered":"2024-09-11T23:15:13.951002+0000","last_unstale":"2024-09-11T23:15:20.005415+0000","last_undegraded":"2024-09-11T23:15:20.005415+0000","last_fullsized":"2024-09-11T23:15:20.005415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252772+0000","last_change":"2024-09-11T23:15:12.949969+0000","last_active":"2024-09-11T23:15:20.252772+0000","last_peered":"2024-09-11T23:15:20.252772+0000","last_clean":"2024-09-11T23:15:20.252772+0000","last_became_active":"2024-09-11T23:15:12.949624+0000","last_became_peered":"2024-09-11T23:15:12.949624+0000","last_unstale":"2024-09-11T23:15:20.252772+0000","last_undegraded":"2024-09-11T23:15:20.252772+0000","last_fullsized":"2024-09-11T23:15:20.252772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256235+0000","last_change":"2024-09-11T23:15:18.048455+0000","last_active":"2024-09-11T23:15:20.256235+0000","last_peered":"2024-09-11T23:15:20.256235+0000","last_clean":"2024-09-11T23:15:20.256235+0000","last_became_active":"2024-09-11T23:15:18.047979+0000","last_became_peered":"2024-09-11T23:15:18.047979+0000","last_unstale":"2024-09-11T23:15:20.256235+0000","last_undegraded":"2024-09-11T23:15:20.256235+0000","last_fullsized":"2024-09-11T23:15:20.256235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257597+0000","last_change":"2024-09-11T23:15:14.004585+0000","last_active":"2024-09-11T23:15:20.257597+0000","last_peered":"2024-09-11T23:15:20.257597+0000","last_clean":"2024-09-11T23:15:20.257597+0000","last_became_active":"2024-09-11T23:15:14.000088+0000","last_became_peered":"2024-09-11T23:15:14.000088+0000","last_unstale":"2024-09-11T23:15:20.257597+0000","last_undegraded":"2024-09-11T23:15:20.257597+0000","last_fullsized":"2024-09-11T23:15:20.257597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:53.838643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253011+0000","last_change":"2024-09-11T23:15:12.960122+0000","last_active":"2024-09-11T23:15:20.253011+0000","last_peered":"2024-09-11T23:15:20.253011+0000","last_clean":"2024-09-11T23:15:20.253011+0000","last_became_active":"2024-09-11T23:15:12.959575+0000","last_became_peered":"2024-09-11T23:15:12.959575+0000","last_unstale":"2024-09-11T23:15:20.253011+0000","last_undegraded":"2024-09-11T23:15:20.253011+0000","last_fullsized":"2024-09-11T23:15:20.253011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004271+0000","last_change":"2024-09-11T23:15:18.451425+0000","last_active":"2024-09-11T23:15:20.004271+0000","last_peered":"2024-09-11T23:15:20.004271+0000","last_clean":"2024-09-11T23:15:20.004271+0000","last_became_active":"2024-09-11T23:15:18.450141+0000","last_became_peered":"2024-09-11T23:15:18.450141+0000","last_unstale":"2024-09-11T23:15:20.004271+0000","last_undegraded":"2024-09-11T23:15:20.004271+0000","last_fullsized":"2024-09-11T23:15:20.004271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:52.139583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255998+0000","last_change":"2024-09-11T23:15:13.992622+0000","last_active":"2024-09-11T23:15:20.255998+0000","last_peered":"2024-09-11T23:15:20.255998+0000","last_clean":"2024-09-11T23:15:20.255998+0000","last_became_active":"2024-09-11T23:15:13.992126+0000","last_became_peered":"2024-09-11T23:15:13.992126+0000","last_unstale":"2024-09-11T23:15:20.255998+0000","last_undegraded":"2024-09-11T23:15:20.255998+0000","last_fullsized":"2024-09-11T23:15:20.255998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011556+0000","last_change":"2024-09-11T23:15:12.956823+0000","last_active":"2024-09-11T23:15:20.011556+0000","last_peered":"2024-09-11T23:15:20.011556+0000","last_clean":"2024-09-11T23:15:20.011556+0000","last_became_active":"2024-09-11T23:15:12.956008+0000","last_became_peered":"2024-09-11T23:15:12.956008+0000","last_unstale":"2024-09-11T23:15:20.011556+0000","last_undegraded":"2024-09-11T23:15:20.011556+0000","last_fullsized":"2024-09-11T23:15:20.011556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:07.503232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009464+0000","last_change":"2024-09-11T23:15:18.038980+0000","last_active":"2024-09-11T23:15:20.009464+0000","last_peered":"2024-09-11T23:15:20.009464+0000","last_clean":"2024-09-11T23:15:20.009464+0000","last_became_active":"2024-09-11T23:15:18.037945+0000","last_became_peered":"2024-09-11T23:15:18.037945+0000","last_unstale":"2024-09-11T23:15:20.009464+0000","last_undegraded":"2024-09-11T23:15:20.009464+0000","last_fullsized":"2024-09-11T23:15:20.009464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254843+0000","last_change":"2024-09-11T23:15:13.993165+0000","last_active":"2024-09-11T23:15:20.254843+0000","last_peered":"2024-09-11T23:15:20.254843+0000","last_clean":"2024-09-11T23:15:20.254843+0000","last_became_active":"2024-09-11T23:15:13.992504+0000","last_became_peered":"2024-09-11T23:15:13.992504+0000","last_unstale":"2024-09-11T23:15:20.254843+0000","last_undegraded":"2024-09-11T23:15:20.254843+0000","last_fullsized":"2024-09-11T23:15:20.254843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252247+0000","last_change":"2024-09-11T23:15:12.947477+0000","last_active":"2024-09-11T23:15:20.252247+0000","last_peered":"2024-09-11T23:15:20.252247+0000","last_clean":"2024-09-11T23:15:20.252247+0000","last_became_active":"2024-09-11T23:15:12.947007+0000","last_became_peered":"2024-09-11T23:15:12.947007+0000","last_unstale":"2024-09-11T23:15:20.252247+0000","last_undegraded":"2024-09-11T23:15:20.252247+0000","last_fullsized":"2024-09-11T23:15:20.252247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:04.981883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256142+0000","last_change":"2024-09-11T23:15:18.033305+0000","last_active":"2024-09-11T23:15:20.256142+0000","last_peered":"2024-09-11T23:15:20.256142+0000","last_clean":"2024-09-11T23:15:20.256142+0000","last_became_active":"2024-09-11T23:15:18.032851+0000","last_became_peered":"2024-09-11T23:15:18.032851+0000","last_unstale":"2024-09-11T23:15:20.256142+0000","last_undegraded":"2024-09-11T23:15:20.256142+0000","last_fullsized":"2024-09-11T23:15:20.256142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252194+0000","last_change":"2024-09-11T23:15:13.957074+0000","last_active":"2024-09-11T23:15:20.252194+0000","last_peered":"2024-09-11T23:15:20.252194+0000","last_clean":"2024-09-11T23:15:20.252194+0000","last_became_active":"2024-09-11T23:15:13.956301+0000","last_became_peered":"2024-09-11T23:15:13.956301+0000","last_unstale":"2024-09-11T23:15:20.252194+0000","last_undegraded":"2024-09-11T23:15:20.252194+0000","last_fullsized":"2024-09-11T23:15:20.252194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252337+0000","last_change":"2024-09-11T23:15:12.971136+0000","last_active":"2024-09-11T23:15:20.252337+0000","last_peered":"2024-09-11T23:15:20.252337+0000","last_clean":"2024-09-11T23:15:20.252337+0000","last_became_active":"2024-09-11T23:15:12.970142+0000","last_became_peered":"2024-09-11T23:15:12.970142+0000","last_unstale":"2024-09-11T23:15:20.252337+0000","last_undegraded":"2024-09-11T23:15:20.252337+0000","last_fullsized":"2024-09-11T23:15:20.252337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004049+0000","last_change":"2024-09-11T23:15:18.460304+0000","last_active":"2024-09-11T23:15:20.004049+0000","last_peered":"2024-09-11T23:15:20.004049+0000","last_clean":"2024-09-11T23:15:20.004049+0000","last_became_active":"2024-09-11T23:15:18.459166+0000","last_became_peered":"2024-09-11T23:15:18.459166+0000","last_unstale":"2024-09-11T23:15:20.004049+0000","last_undegraded":"2024-09-11T23:15:20.004049+0000","last_fullsized":"2024-09-11T23:15:20.004049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:18.063967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254916+0000","last_change":"2024-09-11T23:15:14.003618+0000","last_active":"2024-09-11T23:15:20.254916+0000","last_peered":"2024-09-11T23:15:20.254916+0000","last_clean":"2024-09-11T23:15:20.254916+0000","last_became_active":"2024-09-11T23:15:14.002919+0000","last_became_peered":"2024-09-11T23:15:14.002919+0000","last_unstale":"2024-09-11T23:15:20.254916+0000","last_undegraded":"2024-09-11T23:15:20.254916+0000","last_fullsized":"2024-09-11T23:15:20.254916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005255+0000","last_change":"2024-09-11T23:15:12.964766+0000","last_active":"2024-09-11T23:15:20.005255+0000","last_peered":"2024-09-11T23:15:20.005255+0000","last_clean":"2024-09-11T23:15:20.005255+0000","last_became_active":"2024-09-11T23:15:12.964115+0000","last_became_peered":"2024-09-11T23:15:12.964115+0000","last_unstale":"2024-09-11T23:15:20.005255+0000","last_undegraded":"2024-09-11T23:15:20.005255+0000","last_fullsized":"2024-09-11T23:15:20.005255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003676+0000","last_change":"2024-09-11T23:15:18.450475+0000","last_active":"2024-09-11T23:15:20.003676+0000","last_peered":"2024-09-11T23:15:20.003676+0000","last_clean":"2024-09-11T23:15:20.003676+0000","last_became_active":"2024-09-11T23:15:18.449418+0000","last_became_peered":"2024-09-11T23:15:18.449418+0000","last_unstale":"2024-09-11T23:15:20.003676+0000","last_undegraded":"2024-09-11T23:15:20.003676+0000","last_fullsized":"2024-09-11T23:15:20.003676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:22.686451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255570+0000","last_change":"2024-09-11T23:15:13.985601+0000","last_active":"2024-09-11T23:15:20.255570+0000","last_peered":"2024-09-11T23:15:20.255570+0000","last_clean":"2024-09-11T23:15:20.255570+0000","last_became_active":"2024-09-11T23:15:13.985289+0000","last_became_peered":"2024-09-11T23:15:13.985289+0000","last_unstale":"2024-09-11T23:15:20.255570+0000","last_undegraded":"2024-09-11T23:15:20.255570+0000","last_fullsized":"2024-09-11T23:15:20.255570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256225+0000","last_change":"2024-09-11T23:15:12.970791+0000","last_active":"2024-09-11T23:15:20.256225+0000","last_peered":"2024-09-11T23:15:20.256225+0000","last_clean":"2024-09-11T23:15:20.256225+0000","last_became_active":"2024-09-11T23:15:12.970526+0000","last_became_peered":"2024-09-11T23:15:12.970526+0000","last_unstale":"2024-09-11T23:15:20.256225+0000","last_undegraded":"2024-09-11T23:15:20.256225+0000","last_fullsized":"2024-09-11T23:15:20.256225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:38.061268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006186+0000","last_change":"2024-09-11T23:15:18.451679+0000","last_active":"2024-09-11T23:15:20.006186+0000","last_peered":"2024-09-11T23:15:20.006186+0000","last_clean":"2024-09-11T23:15:20.006186+0000","last_became_active":"2024-09-11T23:15:18.450530+0000","last_became_peered":"2024-09-11T23:15:18.450530+0000","last_unstale":"2024-09-11T23:15:20.006186+0000","last_undegraded":"2024-09-11T23:15:20.006186+0000","last_fullsized":"2024-09-11T23:15:20.006186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:31.718045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256402+0000","last_change":"2024-09-11T23:15:13.992617+0000","last_active":"2024-09-11T23:15:20.256402+0000","last_peered":"2024-09-11T23:15:20.256402+0000","last_clean":"2024-09-11T23:15:20.256402+0000","last_became_active":"2024-09-11T23:15:13.990843+0000","last_became_peered":"2024-09-11T23:15:13.990843+0000","last_unstale":"2024-09-11T23:15:20.256402+0000","last_undegraded":"2024-09-11T23:15:20.256402+0000","last_fullsized":"2024-09-11T23:15:20.256402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:24.450253+0000","last_change":"2024-09-11T23:15:12.963148+0000","last_active":"2024-09-11T23:15:24.450253+0000","last_peered":"2024-09-11T23:15:24.450253+0000","last_clean":"2024-09-11T23:15:24.450253+0000","last_became_active":"2024-09-11T23:15:12.961283+0000","last_became_peered":"2024-09-11T23:15:12.961283+0000","last_unstale":"2024-09-11T23:15:24.450253+0000","last_undegraded":"2024-09-11T23:15:24.450253+0000","last_fullsized":"2024-09-11T23:15:24.450253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252586+0000","last_change":"2024-09-11T23:15:18.030168+0000","last_active":"2024-09-11T23:15:20.252586+0000","last_peered":"2024-09-11T23:15:20.252586+0000","last_clean":"2024-09-11T23:15:20.252586+0000","last_became_active":"2024-09-11T23:15:18.029815+0000","last_became_peered":"2024-09-11T23:15:18.029815+0000","last_unstale":"2024-09-11T23:15:20.252586+0000","last_undegraded":"2024-09-11T23:15:20.252586+0000","last_fullsized":"2024-09-11T23:15:20.252586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011213+0000","last_change":"2024-09-11T23:15:14.000924+0000","last_active":"2024-09-11T23:15:20.011213+0000","last_peered":"2024-09-11T23:15:20.011213+0000","last_clean":"2024-09-11T23:15:20.011213+0000","last_became_active":"2024-09-11T23:15:14.000344+0000","last_became_peered":"2024-09-11T23:15:14.000344+0000","last_unstale":"2024-09-11T23:15:20.011213+0000","last_undegraded":"2024-09-11T23:15:20.011213+0000","last_fullsized":"2024-09-11T23:15:20.011213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252480+0000","last_change":"2024-09-11T23:15:12.964173+0000","last_active":"2024-09-11T23:15:20.252480+0000","last_peered":"2024-09-11T23:15:20.252480+0000","last_clean":"2024-09-11T23:15:20.252480+0000","last_became_active":"2024-09-11T23:15:12.963819+0000","last_became_peered":"2024-09-11T23:15:12.963819+0000","last_unstale":"2024-09-11T23:15:20.252480+0000","last_undegraded":"2024-09-11T23:15:20.252480+0000","last_fullsized":"2024-09-11T23:15:20.252480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010857+0000","last_change":"2024-09-11T23:15:18.045442+0000","last_active":"2024-09-11T23:15:20.010857+0000","last_peered":"2024-09-11T23:15:20.010857+0000","last_clean":"2024-09-11T23:15:20.010857+0000","last_became_active":"2024-09-11T23:15:18.042533+0000","last_became_peered":"2024-09-11T23:15:18.042533+0000","last_unstale":"2024-09-11T23:15:20.010857+0000","last_undegraded":"2024-09-11T23:15:20.010857+0000","last_fullsized":"2024-09-11T23:15:20.010857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256883+0000","last_change":"2024-09-11T23:15:13.979875+0000","last_active":"2024-09-11T23:15:20.256883+0000","last_peered":"2024-09-11T23:15:20.256883+0000","last_clean":"2024-09-11T23:15:20.256883+0000","last_became_active":"2024-09-11T23:15:13.979554+0000","last_became_peered":"2024-09-11T23:15:13.979554+0000","last_unstale":"2024-09-11T23:15:20.256883+0000","last_undegraded":"2024-09-11T23:15:20.256883+0000","last_fullsized":"2024-09-11T23:15:20.256883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005805+0000","last_change":"2024-09-11T23:15:12.970938+0000","last_active":"2024-09-11T23:15:20.005805+0000","last_peered":"2024-09-11T23:15:20.005805+0000","last_clean":"2024-09-11T23:15:20.005805+0000","last_became_active":"2024-09-11T23:15:12.970457+0000","last_became_peered":"2024-09-11T23:15:12.970457+0000","last_unstale":"2024-09-11T23:15:20.005805+0000","last_undegraded":"2024-09-11T23:15:20.005805+0000","last_fullsized":"2024-09-11T23:15:20.005805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002558+0000","last_change":"2024-09-11T23:15:18.044223+0000","last_active":"2024-09-11T23:15:20.002558+0000","last_peered":"2024-09-11T23:15:20.002558+0000","last_clean":"2024-09-11T23:15:20.002558+0000","last_became_active":"2024-09-11T23:15:18.043622+0000","last_became_peered":"2024-09-11T23:15:18.043622+0000","last_unstale":"2024-09-11T23:15:20.002558+0000","last_undegraded":"2024-09-11T23:15:20.002558+0000","last_fullsized":"2024-09-11T23:15:20.002558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:12.311044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005749+0000","last_change":"2024-09-11T23:15:13.994053+0000","last_active":"2024-09-11T23:15:20.005749+0000","last_peered":"2024-09-11T23:15:20.005749+0000","last_clean":"2024-09-11T23:15:20.005749+0000","last_became_active":"2024-09-11T23:15:13.993527+0000","last_became_peered":"2024-09-11T23:15:13.993527+0000","last_unstale":"2024-09-11T23:15:20.005749+0000","last_undegraded":"2024-09-11T23:15:20.005749+0000","last_fullsized":"2024-09-11T23:15:20.005749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255118+0000","last_change":"2024-09-11T23:15:12.971189+0000","last_active":"2024-09-11T23:15:20.255118+0000","last_peered":"2024-09-11T23:15:20.255118+0000","last_clean":"2024-09-11T23:15:20.255118+0000","last_became_active":"2024-09-11T23:15:12.970367+0000","last_became_peered":"2024-09-11T23:15:12.970367+0000","last_unstale":"2024-09-11T23:15:20.255118+0000","last_undegraded":"2024-09-11T23:15:20.255118+0000","last_fullsized":"2024-09-11T23:15:20.255118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002529+0000","last_change":"2024-09-11T23:15:18.458404+0000","last_active":"2024-09-11T23:15:20.002529+0000","last_peered":"2024-09-11T23:15:20.002529+0000","last_clean":"2024-09-11T23:15:20.002529+0000","last_became_active":"2024-09-11T23:15:18.457383+0000","last_became_peered":"2024-09-11T23:15:18.457383+0000","last_unstale":"2024-09-11T23:15:20.002529+0000","last_undegraded":"2024-09-11T23:15:20.002529+0000","last_fullsized":"2024-09-11T23:15:20.002529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:20.119273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255910+0000","last_change":"2024-09-11T23:15:18.458254+0000","last_active":"2024-09-11T23:15:20.255910+0000","last_peered":"2024-09-11T23:15:20.255910+0000","last_clean":"2024-09-11T23:15:20.255910+0000","last_became_active":"2024-09-11T23:15:18.457195+0000","last_became_peered":"2024-09-11T23:15:18.457195+0000","last_unstale":"2024-09-11T23:15:20.255910+0000","last_undegraded":"2024-09-11T23:15:20.255910+0000","last_fullsized":"2024-09-11T23:15:20.255910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251033+0000","last_change":"2024-09-11T23:15:13.947663+0000","last_active":"2024-09-11T23:15:20.251033+0000","last_peered":"2024-09-11T23:15:20.251033+0000","last_clean":"2024-09-11T23:15:20.251033+0000","last_became_active":"2024-09-11T23:15:13.947339+0000","last_became_peered":"2024-09-11T23:15:13.947339+0000","last_unstale":"2024-09-11T23:15:20.251033+0000","last_undegraded":"2024-09-11T23:15:20.251033+0000","last_fullsized":"2024-09-11T23:15:20.251033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004578+0000","last_change":"2024-09-11T23:15:12.977797+0000","last_active":"2024-09-11T23:15:20.004578+0000","last_peered":"2024-09-11T23:15:20.004578+0000","last_clean":"2024-09-11T23:15:20.004578+0000","last_became_active":"2024-09-11T23:15:12.977335+0000","last_became_peered":"2024-09-11T23:15:12.977335+0000","last_unstale":"2024-09-11T23:15:20.004578+0000","last_undegraded":"2024-09-11T23:15:20.004578+0000","last_fullsized":"2024-09-11T23:15:20.004578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254361+0000","last_change":"2024-09-11T23:15:18.037810+0000","last_active":"2024-09-11T23:15:20.254361+0000","last_peered":"2024-09-11T23:15:20.254361+0000","last_clean":"2024-09-11T23:15:20.254361+0000","last_became_active":"2024-09-11T23:15:18.036750+0000","last_became_peered":"2024-09-11T23:15:18.036750+0000","last_unstale":"2024-09-11T23:15:20.254361+0000","last_undegraded":"2024-09-11T23:15:20.254361+0000","last_fullsized":"2024-09-11T23:15:20.254361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002485+0000","last_change":"2024-09-11T23:15:13.952215+0000","last_active":"2024-09-11T23:15:20.002485+0000","last_peered":"2024-09-11T23:15:20.002485+0000","last_clean":"2024-09-11T23:15:20.002485+0000","last_became_active":"2024-09-11T23:15:13.951888+0000","last_became_peered":"2024-09-11T23:15:13.951888+0000","last_unstale":"2024-09-11T23:15:20.002485+0000","last_undegraded":"2024-09-11T23:15:20.002485+0000","last_fullsized":"2024-09-11T23:15:20.002485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003198+0000","last_change":"2024-09-11T23:15:12.963413+0000","last_active":"2024-09-11T23:15:20.003198+0000","last_peered":"2024-09-11T23:15:20.003198+0000","last_clean":"2024-09-11T23:15:20.003198+0000","last_became_active":"2024-09-11T23:15:12.962997+0000","last_became_peered":"2024-09-11T23:15:12.962997+0000","last_unstale":"2024-09-11T23:15:20.003198+0000","last_undegraded":"2024-09-11T23:15:20.003198+0000","last_fullsized":"2024-09-11T23:15:20.003198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253434+0000","last_change":"2024-09-11T23:15:12.970601+0000","last_active":"2024-09-11T23:15:20.253434+0000","last_peered":"2024-09-11T23:15:20.253434+0000","last_clean":"2024-09-11T23:15:20.253434+0000","last_became_active":"2024-09-11T23:15:12.970093+0000","last_became_peered":"2024-09-11T23:15:12.970093+0000","last_unstale":"2024-09-11T23:15:20.253434+0000","last_undegraded":"2024-09-11T23:15:20.253434+0000","last_fullsized":"2024-09-11T23:15:20.253434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256098+0000","last_change":"2024-09-11T23:15:13.951762+0000","last_active":"2024-09-11T23:15:20.256098+0000","last_peered":"2024-09-11T23:15:20.256098+0000","last_clean":"2024-09-11T23:15:20.256098+0000","last_became_active":"2024-09-11T23:15:13.951454+0000","last_became_peered":"2024-09-11T23:15:13.951454+0000","last_unstale":"2024-09-11T23:15:20.256098+0000","last_undegraded":"2024-09-11T23:15:20.256098+0000","last_fullsized":"2024-09-11T23:15:20.256098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252828+0000","last_change":"2024-09-11T23:15:18.032028+0000","last_active":"2024-09-11T23:15:20.252828+0000","last_peered":"2024-09-11T23:15:20.252828+0000","last_clean":"2024-09-11T23:15:20.252828+0000","last_became_active":"2024-09-11T23:15:18.031566+0000","last_became_peered":"2024-09-11T23:15:18.031566+0000","last_unstale":"2024-09-11T23:15:20.252828+0000","last_undegraded":"2024-09-11T23:15:20.252828+0000","last_fullsized":"2024-09-11T23:15:20.252828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:11.167279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002816+0000","last_change":"2024-09-11T23:15:12.955762+0000","last_active":"2024-09-11T23:15:20.002816+0000","last_peered":"2024-09-11T23:15:20.002816+0000","last_clean":"2024-09-11T23:15:20.002816+0000","last_became_active":"2024-09-11T23:15:12.955387+0000","last_became_peered":"2024-09-11T23:15:12.955387+0000","last_unstale":"2024-09-11T23:15:20.002816+0000","last_undegraded":"2024-09-11T23:15:20.002816+0000","last_fullsized":"2024-09-11T23:15:20.002816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010063+0000","last_change":"2024-09-11T23:15:13.956520+0000","last_active":"2024-09-11T23:15:20.010063+0000","last_peered":"2024-09-11T23:15:20.010063+0000","last_clean":"2024-09-11T23:15:20.010063+0000","last_became_active":"2024-09-11T23:15:13.952595+0000","last_became_peered":"2024-09-11T23:15:13.952595+0000","last_unstale":"2024-09-11T23:15:20.010063+0000","last_undegraded":"2024-09-11T23:15:20.010063+0000","last_fullsized":"2024-09-11T23:15:20.010063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:39.357892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003889+0000","last_change":"2024-09-11T23:15:18.044131+0000","last_active":"2024-09-11T23:15:20.003889+0000","last_peered":"2024-09-11T23:15:20.003889+0000","last_clean":"2024-09-11T23:15:20.003889+0000","last_became_active":"2024-09-11T23:15:18.043680+0000","last_became_peered":"2024-09-11T23:15:18.043680+0000","last_unstale":"2024-09-11T23:15:20.003889+0000","last_undegraded":"2024-09-11T23:15:20.003889+0000","last_fullsized":"2024-09-11T23:15:20.003889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:52.853399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251955+0000","last_change":"2024-09-11T23:15:13.957122+0000","last_active":"2024-09-11T23:15:20.251955+0000","last_peered":"2024-09-11T23:15:20.251955+0000","last_clean":"2024-09-11T23:15:20.251955+0000","last_became_active":"2024-09-11T23:15:13.956367+0000","last_became_peered":"2024-09-11T23:15:13.956367+0000","last_unstale":"2024-09-11T23:15:20.251955+0000","last_undegraded":"2024-09-11T23:15:20.251955+0000","last_fullsized":"2024-09-11T23:15:20.251955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252707+0000","last_change":"2024-09-11T23:15:13.945108+0000","last_active":"2024-09-11T23:15:20.252707+0000","last_peered":"2024-09-11T23:15:20.252707+0000","last_clean":"2024-09-11T23:15:20.252707+0000","last_became_active":"2024-09-11T23:15:13.944837+0000","last_became_peered":"2024-09-11T23:15:13.944837+0000","last_unstale":"2024-09-11T23:15:20.252707+0000","last_undegraded":"2024-09-11T23:15:20.252707+0000","last_fullsized":"2024-09-11T23:15:20.252707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005293+0000","last_change":"2024-09-11T23:15:13.954634+0000","last_active":"2024-09-11T23:15:20.005293+0000","last_peered":"2024-09-11T23:15:20.005293+0000","last_clean":"2024-09-11T23:15:20.005293+0000","last_became_active":"2024-09-11T23:15:13.953799+0000","last_became_peered":"2024-09-11T23:15:13.953799+0000","last_unstale":"2024-09-11T23:15:20.005293+0000","last_undegraded":"2024-09-11T23:15:20.005293+0000","last_fullsized":"2024-09-11T23:15:20.005293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255948+0000","last_change":"2024-09-11T23:15:13.949400+0000","last_active":"2024-09-11T23:15:20.255948+0000","last_peered":"2024-09-11T23:15:20.255948+0000","last_clean":"2024-09-11T23:15:20.255948+0000","last_became_active":"2024-09-11T23:15:13.949032+0000","last_became_peered":"2024-09-11T23:15:13.949032+0000","last_unstale":"2024-09-11T23:15:20.255948+0000","last_undegraded":"2024-09-11T23:15:20.255948+0000","last_fullsized":"2024-09-11T23:15:20.255948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003638+0000","last_change":"2024-09-11T23:15:13.960418+0000","last_active":"2024-09-11T23:15:20.003638+0000","last_peered":"2024-09-11T23:15:20.003638+0000","last_clean":"2024-09-11T23:15:20.003638+0000","last_became_active":"2024-09-11T23:15:13.960081+0000","last_became_peered":"2024-09-11T23:15:13.960081+0000","last_unstale":"2024-09-11T23:15:20.003638+0000","last_undegraded":"2024-09-11T23:15:20.003638+0000","last_fullsized":"2024-09-11T23:15:20.003638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252017+0000","last_change":"2024-09-11T23:15:13.947369+0000","last_active":"2024-09-11T23:15:20.252017+0000","last_peered":"2024-09-11T23:15:20.252017+0000","last_clean":"2024-09-11T23:15:20.252017+0000","last_became_active":"2024-09-11T23:15:13.947074+0000","last_became_peered":"2024-09-11T23:15:13.947074+0000","last_unstale":"2024-09-11T23:15:20.252017+0000","last_undegraded":"2024-09-11T23:15:20.252017+0000","last_fullsized":"2024-09-11T23:15:20.252017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254606+0000","last_change":"2024-09-11T23:15:13.995057+0000","last_active":"2024-09-11T23:15:20.254606+0000","last_peered":"2024-09-11T23:15:20.254606+0000","last_clean":"2024-09-11T23:15:20.254606+0000","last_became_active":"2024-09-11T23:15:13.994547+0000","last_became_peered":"2024-09-11T23:15:13.994547+0000","last_unstale":"2024-09-11T23:15:20.254606+0000","last_undegraded":"2024-09-11T23:15:20.254606+0000","last_fullsized":"2024-09-11T23:15:20.254606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004077+0000","last_change":"2024-09-11T23:15:13.960489+0000","last_active":"2024-09-11T23:15:20.004077+0000","last_peered":"2024-09-11T23:15:20.004077+0000","last_clean":"2024-09-11T23:15:20.004077+0000","last_became_active":"2024-09-11T23:15:13.960138+0000","last_became_peered":"2024-09-11T23:15:13.960138+0000","last_unstale":"2024-09-11T23:15:20.004077+0000","last_undegraded":"2024-09-11T23:15:20.004077+0000","last_fullsized":"2024-09-11T23:15:20.004077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004434+0000","last_change":"2024-09-11T23:15:13.963538+0000","last_active":"2024-09-11T23:15:20.004434+0000","last_peered":"2024-09-11T23:15:20.004434+0000","last_clean":"2024-09-11T23:15:20.004434+0000","last_became_active":"2024-09-11T23:15:13.947789+0000","last_became_peered":"2024-09-11T23:15:13.947789+0000","last_unstale":"2024-09-11T23:15:20.004434+0000","last_undegraded":"2024-09-11T23:15:20.004434+0000","last_fullsized":"2024-09-11T23:15:20.004434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003189+0000","last_change":"2024-09-11T23:15:13.960470+0000","last_active":"2024-09-11T23:15:20.003189+0000","last_peered":"2024-09-11T23:15:20.003189+0000","last_clean":"2024-09-11T23:15:20.003189+0000","last_became_active":"2024-09-11T23:15:13.960148+0000","last_became_peered":"2024-09-11T23:15:13.960148+0000","last_unstale":"2024-09-11T23:15:20.003189+0000","last_undegraded":"2024-09-11T23:15:20.003189+0000","last_fullsized":"2024-09-11T23:15:20.003189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004861+0000","last_change":"2024-09-11T23:15:13.992697+0000","last_active":"2024-09-11T23:15:20.004861+0000","last_peered":"2024-09-11T23:15:20.004861+0000","last_clean":"2024-09-11T23:15:20.004861+0000","last_became_active":"2024-09-11T23:15:13.992059+0000","last_became_peered":"2024-09-11T23:15:13.992059+0000","last_unstale":"2024-09-11T23:15:20.004861+0000","last_undegraded":"2024-09-11T23:15:20.004861+0000","last_fullsized":"2024-09-11T23:15:20.004861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255674+0000","last_change":"2024-09-11T23:15:13.985798+0000","last_active":"2024-09-11T23:15:20.255674+0000","last_peered":"2024-09-11T23:15:20.255674+0000","last_clean":"2024-09-11T23:15:20.255674+0000","last_became_active":"2024-09-11T23:15:13.985274+0000","last_became_peered":"2024-09-11T23:15:13.985274+0000","last_unstale":"2024-09-11T23:15:20.255674+0000","last_undegraded":"2024-09-11T23:15:20.255674+0000","last_fullsized":"2024-09-11T23:15:20.255674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253287+0000","last_change":"2024-09-11T23:15:13.973105+0000","last_active":"2024-09-11T23:15:20.253287+0000","last_peered":"2024-09-11T23:15:20.253287+0000","last_clean":"2024-09-11T23:15:20.253287+0000","last_became_active":"2024-09-11T23:15:13.971617+0000","last_became_peered":"2024-09-11T23:15:13.971617+0000","last_unstale":"2024-09-11T23:15:20.253287+0000","last_undegraded":"2024-09-11T23:15:20.253287+0000","last_fullsized":"2024-09-11T23:15:20.253287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256925+0000","last_change":"2024-09-11T23:15:14.002728+0000","last_active":"2024-09-11T23:15:20.256925+0000","last_peered":"2024-09-11T23:15:20.256925+0000","last_clean":"2024-09-11T23:15:20.256925+0000","last_became_active":"2024-09-11T23:15:13.996868+0000","last_became_peered":"2024-09-11T23:15:13.996868+0000","last_unstale":"2024-09-11T23:15:20.256925+0000","last_undegraded":"2024-09-11T23:15:20.256925+0000","last_fullsized":"2024-09-11T23:15:20.256925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252733+0000","last_change":"2024-09-11T23:15:13.973567+0000","last_active":"2024-09-11T23:15:20.252733+0000","last_peered":"2024-09-11T23:15:20.252733+0000","last_clean":"2024-09-11T23:15:20.252733+0000","last_became_active":"2024-09-11T23:15:13.973278+0000","last_became_peered":"2024-09-11T23:15:13.973278+0000","last_unstale":"2024-09-11T23:15:20.252733+0000","last_undegraded":"2024-09-11T23:15:20.252733+0000","last_fullsized":"2024-09-11T23:15:20.252733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:57.828596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006578+0000","last_change":"2024-09-11T23:15:13.999226+0000","last_active":"2024-09-11T23:15:20.006578+0000","last_peered":"2024-09-11T23:15:20.006578+0000","last_clean":"2024-09-11T23:15:20.006578+0000","last_became_active":"2024-09-11T23:15:13.998747+0000","last_became_peered":"2024-09-11T23:15:13.998747+0000","last_unstale":"2024-09-11T23:15:20.006578+0000","last_undegraded":"2024-09-11T23:15:20.006578+0000","last_fullsized":"2024-09-11T23:15:20.006578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004397+0000","last_change":"2024-09-11T23:15:13.945820+0000","last_active":"2024-09-11T23:15:20.004397+0000","last_peered":"2024-09-11T23:15:20.004397+0000","last_clean":"2024-09-11T23:15:20.004397+0000","last_became_active":"2024-09-11T23:15:13.945048+0000","last_became_peered":"2024-09-11T23:15:13.945048+0000","last_unstale":"2024-09-11T23:15:20.004397+0000","last_undegraded":"2024-09-11T23:15:20.004397+0000","last_fullsized":"2024-09-11T23:15:20.004397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251134+0000","last_change":"2024-09-11T23:15:13.950766+0000","last_active":"2024-09-11T23:15:20.251134+0000","last_peered":"2024-09-11T23:15:20.251134+0000","last_clean":"2024-09-11T23:15:20.251134+0000","last_became_active":"2024-09-11T23:15:13.950395+0000","last_became_peered":"2024-09-11T23:15:13.950395+0000","last_unstale":"2024-09-11T23:15:20.251134+0000","last_undegraded":"2024-09-11T23:15:20.251134+0000","last_fullsized":"2024-09-11T23:15:20.251134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255485+0000","last_change":"2024-09-11T23:15:13.942113+0000","last_active":"2024-09-11T23:15:20.255485+0000","last_peered":"2024-09-11T23:15:20.255485+0000","last_clean":"2024-09-11T23:15:20.255485+0000","last_became_active":"2024-09-11T23:15:13.941820+0000","last_became_peered":"2024-09-11T23:15:13.941820+0000","last_unstale":"2024-09-11T23:15:20.255485+0000","last_undegraded":"2024-09-11T23:15:20.255485+0000","last_fullsized":"2024-09-11T23:15:20.255485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:47.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002696+0000","last_change":"2024-09-11T23:15:13.990426+0000","last_active":"2024-09-11T23:15:20.002696+0000","last_peered":"2024-09-11T23:15:20.002696+0000","last_clean":"2024-09-11T23:15:20.002696+0000","last_became_active":"2024-09-11T23:15:13.990122+0000","last_became_peered":"2024-09-11T23:15:13.990122+0000","last_unstale":"2024-09-11T23:15:20.002696+0000","last_undegraded":"2024-09-11T23:15:20.002696+0000","last_fullsized":"2024-09-11T23:15:20.002696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011130+0000","last_change":"2024-09-11T23:15:13.976923+0000","last_active":"2024-09-11T23:15:20.011130+0000","last_peered":"2024-09-11T23:15:20.011130+0000","last_clean":"2024-09-11T23:15:20.011130+0000","last_became_active":"2024-09-11T23:15:13.976002+0000","last_became_peered":"2024-09-11T23:15:13.976002+0000","last_unstale":"2024-09-11T23:15:20.011130+0000","last_undegraded":"2024-09-11T23:15:20.011130+0000","last_fullsized":"2024-09-11T23:15:20.011130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.533481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253836+0000","last_change":"2024-09-11T23:15:13.988201+0000","last_active":"2024-09-11T23:15:20.253836+0000","last_peered":"2024-09-11T23:15:20.253836+0000","last_clean":"2024-09-11T23:15:20.253836+0000","last_became_active":"2024-09-11T23:15:13.987512+0000","last_became_peered":"2024-09-11T23:15:13.987512+0000","last_unstale":"2024-09-11T23:15:20.253836+0000","last_undegraded":"2024-09-11T23:15:20.253836+0000","last_fullsized":"2024-09-11T23:15:20.253836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254368+0000","last_change":"2024-09-11T23:15:13.988153+0000","last_active":"2024-09-11T23:15:20.254368+0000","last_peered":"2024-09-11T23:15:20.254368+0000","last_clean":"2024-09-11T23:15:20.254368+0000","last_became_active":"2024-09-11T23:15:13.987443+0000","last_became_peered":"2024-09-11T23:15:13.987443+0000","last_unstale":"2024-09-11T23:15:20.254368+0000","last_undegraded":"2024-09-11T23:15:20.254368+0000","last_fullsized":"2024-09-11T23:15:20.254368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257588+0000","last_change":"2024-09-11T23:15:14.002600+0000","last_active":"2024-09-11T23:15:20.257588+0000","last_peered":"2024-09-11T23:15:20.257588+0000","last_clean":"2024-09-11T23:15:20.257588+0000","last_became_active":"2024-09-11T23:15:13.997780+0000","last_became_peered":"2024-09-11T23:15:13.997780+0000","last_unstale":"2024-09-11T23:15:20.257588+0000","last_undegraded":"2024-09-11T23:15:20.257588+0000","last_fullsized":"2024-09-11T23:15:20.257588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002356+0000","last_change":"2024-09-11T23:15:13.978838+0000","last_active":"2024-09-11T23:15:20.002356+0000","last_peered":"2024-09-11T23:15:20.002356+0000","last_clean":"2024-09-11T23:15:20.002356+0000","last_became_active":"2024-09-11T23:15:13.978620+0000","last_became_peered":"2024-09-11T23:15:13.978620+0000","last_unstale":"2024-09-11T23:15:20.002356+0000","last_undegraded":"2024-09-11T23:15:20.002356+0000","last_fullsized":"2024-09-11T23:15:20.002356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254587+0000","last_change":"2024-09-11T23:15:13.993756+0000","last_active":"2024-09-11T23:15:20.254587+0000","last_peered":"2024-09-11T23:15:20.254587+0000","last_clean":"2024-09-11T23:15:20.254587+0000","last_became_active":"2024-09-11T23:15:13.991750+0000","last_became_peered":"2024-09-11T23:15:13.991750+0000","last_unstale":"2024-09-11T23:15:20.254587+0000","last_undegraded":"2024-09-11T23:15:20.254587+0000","last_fullsized":"2024-09-11T23:15:20.254587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004833+0000","last_change":"2024-09-11T23:15:13.980773+0000","last_active":"2024-09-11T23:15:20.004833+0000","last_peered":"2024-09-11T23:15:20.004833+0000","last_clean":"2024-09-11T23:15:20.004833+0000","last_became_active":"2024-09-11T23:15:13.980059+0000","last_became_peered":"2024-09-11T23:15:13.980059+0000","last_unstale":"2024-09-11T23:15:20.004833+0000","last_undegraded":"2024-09-11T23:15:20.004833+0000","last_fullsized":"2024-09-11T23:15:20.004833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254373+0000","last_change":"2024-09-11T23:15:14.002575+0000","last_active":"2024-09-11T23:15:20.254373+0000","last_peered":"2024-09-11T23:15:20.254373+0000","last_clean":"2024-09-11T23:15:20.254373+0000","last_became_active":"2024-09-11T23:15:13.997366+0000","last_became_peered":"2024-09-11T23:15:13.997366+0000","last_unstale":"2024-09-11T23:15:20.254373+0000","last_undegraded":"2024-09-11T23:15:20.254373+0000","last_fullsized":"2024-09-11T23:15:20.254373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004969+0000","last_change":"2024-09-11T23:15:13.964938+0000","last_active":"2024-09-11T23:15:20.004969+0000","last_peered":"2024-09-11T23:15:20.004969+0000","last_clean":"2024-09-11T23:15:20.004969+0000","last_became_active":"2024-09-11T23:15:13.952177+0000","last_became_peered":"2024-09-11T23:15:13.952177+0000","last_unstale":"2024-09-11T23:15:20.004969+0000","last_undegraded":"2024-09-11T23:15:20.004969+0000","last_fullsized":"2024-09-11T23:15:20.004969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256139+0000","last_change":"2024-09-11T23:15:13.944554+0000","last_active":"2024-09-11T23:15:20.256139+0000","last_peered":"2024-09-11T23:15:20.256139+0000","last_clean":"2024-09-11T23:15:20.256139+0000","last_became_active":"2024-09-11T23:15:13.944174+0000","last_became_peered":"2024-09-11T23:15:13.944174+0000","last_unstale":"2024-09-11T23:15:20.256139+0000","last_undegraded":"2024-09-11T23:15:20.256139+0000","last_fullsized":"2024-09-11T23:15:20.256139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253250+0000","last_change":"2024-09-11T23:15:13.941668+0000","last_active":"2024-09-11T23:15:20.253250+0000","last_peered":"2024-09-11T23:15:20.253250+0000","last_clean":"2024-09-11T23:15:20.253250+0000","last_became_active":"2024-09-11T23:15:13.941362+0000","last_became_peered":"2024-09-11T23:15:13.941362+0000","last_unstale":"2024-09-11T23:15:20.253250+0000","last_undegraded":"2024-09-11T23:15:20.253250+0000","last_fullsized":"2024-09-11T23:15:20.253250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257415+0000","last_change":"2024-09-11T23:15:14.003307+0000","last_active":"2024-09-11T23:15:20.257415+0000","last_peered":"2024-09-11T23:15:20.257415+0000","last_clean":"2024-09-11T23:15:20.257415+0000","last_became_active":"2024-09-11T23:15:13.998994+0000","last_became_peered":"2024-09-11T23:15:13.998994+0000","last_unstale":"2024-09-11T23:15:20.257415+0000","last_undegraded":"2024-09-11T23:15:20.257415+0000","last_fullsized":"2024-09-11T23:15:20.257415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:15:35.095 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:15:35.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc0a5d64640 1 Processor -- start 2024-09-11T23:15:35.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc0a5d64640 1 -- start start 2024-09-11T23:15:35.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc0a5d64640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 0x7fc0a015d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc0a5d64640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0a0072dd0 0x7fc0a00731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc0a5d64640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a01533f0 con 0x7fc0a00b3280 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc0a5d64640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc0a0073850 con 0x7fc0a0072dd0 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc0a5d64640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a0073b30 con 0x7fc0a0153010 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc0a00b3280 0x7fc0a015fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36340/0 (socket says 172.21.15.94:36340) 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 -- 172.21.15.94:0/3733452770 learned_addr learned my addr 172.21.15.94:0/3733452770 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09f7fe640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 0x7fc0a015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09effd640 1 --2- 172.21.15.94:0/3733452770 >> v2:172.21.15.155:3300/0 conn(0x7fc0a0072dd0 0x7fc0a00731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018174213 0 0) 0x7fc0980014a0 con 0x7fc0a00b3280 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc088003530 con 0x7fc0a00b3280 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3207619129 0 0) 0x7fc088003530 con 0x7fc0a00b3280 2024-09-11T23:15:35.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 msgr2=0x7fc0a015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 0x7fc0a015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 >> v2:172.21.15.155:3300/0 conn(0x7fc0a0072dd0 msgr2=0x7fc0a00731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 --2- 172.21.15.94:0/3733452770 >> v2:172.21.15.155:3300/0 conn(0x7fc0a0072dd0 0x7fc0a00731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a015c890 con 0x7fc0a00b3280 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fc098001bd0 con 0x7fc0a00b3280 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 >> v1:172.21.15.94:6789/0 conn(0x7fc0a00b3280 legacy=0x7fc0a015fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 0x7fc0880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc088003f40 0x7fc088004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a0073850 con 0x7fc088004d50 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a0073b30 con 0x7fc088003f40 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc08800b9d0 con 0x7fc0a0153010 2024-09-11T23:15:35.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09effd640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc088003f40 0x7fc088004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09f7fe640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 0x7fc0880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 -- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 msgr2=0x7fc0880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0153010 0x7fc0880039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 -- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc088003f40 msgr2=0x7fc088004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc088003f40 0x7fc088004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.248+0000 7fc09ffff640 1 -- 172.21.15.94:0/3733452770 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc088003530 con 0x7fc088004d50 2024-09-11T23:15:35.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09ffff640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0880051d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc09800aa40 tx=0x7fc09801d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04933712a7f17cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09800a690 con 0x7fc088004d50 2024-09-11T23:15:35.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0980072d0 con 0x7fc088004d50 2024-09-11T23:15:35.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09e7fc640 1 -- 172.21.15.94:0/3733452770 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0980076c0 con 0x7fc088004d50 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- 172.21.15.94:0/3733452770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 msgr2=0x7fc0880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 --2- 172.21.15.94:0/3733452770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0880051d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc09800aa40 tx=0x7fc09801d320 comp rx=0 tx=0).stop 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09ffff640 1 -- 172.21.15.94:0/3733452770 reap_dead start 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- 172.21.15.94:0/3733452770 shutdown_connections 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- 172.21.15.94:0/3733452770 >> 172.21.15.94:0/3733452770 conn(0x7fc0a00b6870 msgr2=0x7fc0a00b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- 172.21.15.94:0/3733452770 shutdown_connections 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- 172.21.15.94:0/3733452770 wait complete. 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 Processor -- start 2024-09-11T23:15:35.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- start start 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0a00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0145d80 0x7fc0a01471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0a014a920 0x7fc0a014ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a006fe00 con 0x7fc088004d50 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a015c540 con 0x7fc0a014a920 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc0a5d64640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a015d090 con 0x7fc0a0145d80 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0a00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0a00cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40436/0 (socket says 172.21.15.94:40436) 2024-09-11T23:15:35.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09f7fe640 1 -- 172.21.15.94:0/1952005333 learned_addr learned my addr 172.21.15.94:0/1952005333 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.252+0000 7fc09effd640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0145d80 0x7fc0a01471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09ffff640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0a014a920 0x7fc0a014ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09f7fe640 1 -- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0145d80 msgr2=0x7fc0a01471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09f7fe640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0145d80 0x7fc0a01471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09f7fe640 1 -- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0a014a920 msgr2=0x7fc0a014ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09f7fe640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0a014a920 0x7fc0a014ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09f7fe640 1 -- 172.21.15.94:0/1952005333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a0147700 con 0x7fc088004d50 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09f7fe640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0a00cc850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc0900108f0 tx=0x7fc090010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc087fff640 1 -- 172.21.15.94:0/1952005333 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09000f040 con 0x7fc088004d50 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc087fff640 1 -- 172.21.15.94:0/1952005333 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09000eb60 con 0x7fc088004d50 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a0146200 con 0x7fc088004d50 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc087fff640 1 -- 172.21.15.94:0/1952005333 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09001c400 con 0x7fc088004d50 2024-09-11T23:15:35.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a0147c60 con 0x7fc088004d50 2024-09-11T23:15:35.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a00731f0 con 0x7fc088004d50 2024-09-11T23:15:35.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc087fff640 1 -- 172.21.15.94:0/1952005333 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc09001c5a0 con 0x7fc088004d50 2024-09-11T23:15:35.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc087fff640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc08c0678f0 0x7fc08c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc087fff640 1 -- 172.21.15.94:0/1952005333 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc090086650 con 0x7fc088004d50 2024-09-11T23:15:35.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09effd640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc08c0678f0 0x7fc08c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.256+0000 7fc09effd640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc08c0678f0 0x7fc08c069db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00b7180 tx=0x7fc094008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.260+0000 7fc087fff640 1 -- 172.21.15.94:0/1952005333 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc0a0147700 con 0x7fc088004d50 2024-09-11T23:15:35.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.408+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0a0160780 con 0x7fc08c0678f0 2024-09-11T23:15:35.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.432+0000 7fc087fff640 1 -- 172.21.15.94:0/1952005333 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fc0a0160780 con 0x7fc08c0678f0 2024-09-11T23:15:35.437 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:35.440 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:15:35.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc08c0678f0 msgr2=0x7fc08c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc08c0678f0 0x7fc08c069db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00b7180 tx=0x7fc094008040 comp rx=0 tx=0).stop 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 msgr2=0x7fc0a00cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0a00cc850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc0900108f0 tx=0x7fc090010db0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 shutdown_connections 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0a014a920 0x7fc0a014ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0a0145d80 0x7fc0a01471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc08c0678f0 0x7fc08c069db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 --2- 172.21.15.94:0/1952005333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc088004d50 0x7fc0a00cc850 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 >> 172.21.15.94:0/1952005333 conn(0x7fc0a00b6870 msgr2=0x7fc0a00cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:35.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 shutdown_connections 2024-09-11T23:15:35.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.436+0000 7fc0a5d64640 1 -- 172.21.15.94:0/1952005333 wait complete. 2024-09-11T23:15:35.452 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-11T23:15:33.973338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236204,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738516,"statfs":{"total":773094113280,"available":772852240384,"internally_reserved":0,"allocated":3383296,"data_stored":2049164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004772"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256938+0000","last_change":"2024-09-11T23:15:12.971939+0000","last_active":"2024-09-11T23:15:20.256938+0000","last_peered":"2024-09-11T23:15:20.256938+0000","last_clean":"2024-09-11T23:15:20.256938+0000","last_became_active":"2024-09-11T23:15:12.971664+0000","last_became_peered":"2024-09-11T23:15:12.971664+0000","last_unstale":"2024-09-11T23:15:20.256938+0000","last_undegraded":"2024-09-11T23:15:20.256938+0000","last_fullsized":"2024-09-11T23:15:20.256938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:21.586294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003953+0000","last_change":"2024-09-11T23:15:13.990297+0000","last_active":"2024-09-11T23:15:20.003953+0000","last_peered":"2024-09-11T23:15:20.003953+0000","last_clean":"2024-09-11T23:15:20.003953+0000","last_became_active":"2024-09-11T23:15:13.989971+0000","last_became_peered":"2024-09-11T23:15:13.989971+0000","last_unstale":"2024-09-11T23:15:20.003953+0000","last_undegraded":"2024-09-11T23:15:20.003953+0000","last_fullsized":"2024-09-11T23:15:20.003953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002406+0000","last_change":"2024-09-11T23:15:18.458647+0000","last_active":"2024-09-11T23:15:20.002406+0000","last_peered":"2024-09-11T23:15:20.002406+0000","last_clean":"2024-09-11T23:15:20.002406+0000","last_became_active":"2024-09-11T23:15:18.457571+0000","last_became_peered":"2024-09-11T23:15:18.457571+0000","last_unstale":"2024-09-11T23:15:20.002406+0000","last_undegraded":"2024-09-11T23:15:20.002406+0000","last_fullsized":"2024-09-11T23:15:20.002406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:45.970652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004208+0000","last_change":"2024-09-11T23:15:12.963138+0000","last_active":"2024-09-11T23:15:20.004208+0000","last_peered":"2024-09-11T23:15:20.004208+0000","last_clean":"2024-09-11T23:15:20.004208+0000","last_became_active":"2024-09-11T23:15:12.962545+0000","last_became_peered":"2024-09-11T23:15:12.962545+0000","last_unstale":"2024-09-11T23:15:20.004208+0000","last_undegraded":"2024-09-11T23:15:20.004208+0000","last_fullsized":"2024-09-11T23:15:20.004208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256716+0000","last_change":"2024-09-11T23:15:13.979850+0000","last_active":"2024-09-11T23:15:20.256716+0000","last_peered":"2024-09-11T23:15:20.256716+0000","last_clean":"2024-09-11T23:15:20.256716+0000","last_became_active":"2024-09-11T23:15:13.979530+0000","last_became_peered":"2024-09-11T23:15:13.979530+0000","last_unstale":"2024-09-11T23:15:20.256716+0000","last_undegraded":"2024-09-11T23:15:20.256716+0000","last_fullsized":"2024-09-11T23:15:20.256716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009823+0000","last_change":"2024-09-11T23:15:18.048713+0000","last_active":"2024-09-11T23:15:20.009823+0000","last_peered":"2024-09-11T23:15:20.009823+0000","last_clean":"2024-09-11T23:15:20.009823+0000","last_became_active":"2024-09-11T23:15:18.047487+0000","last_became_peered":"2024-09-11T23:15:18.047487+0000","last_unstale":"2024-09-11T23:15:20.009823+0000","last_undegraded":"2024-09-11T23:15:20.009823+0000","last_fullsized":"2024-09-11T23:15:20.009823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256782+0000","last_change":"2024-09-11T23:15:12.973574+0000","last_active":"2024-09-11T23:15:20.256782+0000","last_peered":"2024-09-11T23:15:20.256782+0000","last_clean":"2024-09-11T23:15:20.256782+0000","last_became_active":"2024-09-11T23:15:12.972945+0000","last_became_peered":"2024-09-11T23:15:12.972945+0000","last_unstale":"2024-09-11T23:15:20.256782+0000","last_undegraded":"2024-09-11T23:15:20.256782+0000","last_fullsized":"2024-09-11T23:15:20.256782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.523986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005274+0000","last_change":"2024-09-11T23:15:13.955300+0000","last_active":"2024-09-11T23:15:20.005274+0000","last_peered":"2024-09-11T23:15:20.005274+0000","last_clean":"2024-09-11T23:15:20.005274+0000","last_became_active":"2024-09-11T23:15:13.952807+0000","last_became_peered":"2024-09-11T23:15:13.952807+0000","last_unstale":"2024-09-11T23:15:20.005274+0000","last_undegraded":"2024-09-11T23:15:20.005274+0000","last_fullsized":"2024-09-11T23:15:20.005274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010459+0000","last_change":"2024-09-11T23:15:18.046772+0000","last_active":"2024-09-11T23:15:20.010459+0000","last_peered":"2024-09-11T23:15:20.010459+0000","last_clean":"2024-09-11T23:15:20.010459+0000","last_became_active":"2024-09-11T23:15:18.044361+0000","last_became_peered":"2024-09-11T23:15:18.044361+0000","last_unstale":"2024-09-11T23:15:20.010459+0000","last_undegraded":"2024-09-11T23:15:20.010459+0000","last_fullsized":"2024-09-11T23:15:20.010459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254970+0000","last_change":"2024-09-11T23:15:12.973316+0000","last_active":"2024-09-11T23:15:20.254970+0000","last_peered":"2024-09-11T23:15:20.254970+0000","last_clean":"2024-09-11T23:15:20.254970+0000","last_became_active":"2024-09-11T23:15:12.972758+0000","last_became_peered":"2024-09-11T23:15:12.972758+0000","last_unstale":"2024-09-11T23:15:20.254970+0000","last_undegraded":"2024-09-11T23:15:20.254970+0000","last_fullsized":"2024-09-11T23:15:20.254970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:56.819101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006154+0000","last_change":"2024-09-11T23:15:13.974148+0000","last_active":"2024-09-11T23:15:20.006154+0000","last_peered":"2024-09-11T23:15:20.006154+0000","last_clean":"2024-09-11T23:15:20.006154+0000","last_became_active":"2024-09-11T23:15:13.973423+0000","last_became_peered":"2024-09-11T23:15:13.973423+0000","last_unstale":"2024-09-11T23:15:20.006154+0000","last_undegraded":"2024-09-11T23:15:20.006154+0000","last_fullsized":"2024-09-11T23:15:20.006154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009681+0000","last_change":"2024-09-11T23:15:18.039529+0000","last_active":"2024-09-11T23:15:20.009681+0000","last_peered":"2024-09-11T23:15:20.009681+0000","last_clean":"2024-09-11T23:15:20.009681+0000","last_became_active":"2024-09-11T23:15:18.035361+0000","last_became_peered":"2024-09-11T23:15:18.035361+0000","last_unstale":"2024-09-11T23:15:20.009681+0000","last_undegraded":"2024-09-11T23:15:20.009681+0000","last_fullsized":"2024-09-11T23:15:20.009681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252965+0000","last_change":"2024-09-11T23:15:13.987303+0000","last_active":"2024-09-11T23:15:20.252965+0000","last_peered":"2024-09-11T23:15:20.252965+0000","last_clean":"2024-09-11T23:15:20.252965+0000","last_became_active":"2024-09-11T23:15:13.986026+0000","last_became_peered":"2024-09-11T23:15:13.986026+0000","last_unstale":"2024-09-11T23:15:20.252965+0000","last_undegraded":"2024-09-11T23:15:20.252965+0000","last_fullsized":"2024-09-11T23:15:20.252965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255344+0000","last_change":"2024-09-11T23:15:12.978008+0000","last_active":"2024-09-11T23:15:20.255344+0000","last_peered":"2024-09-11T23:15:20.255344+0000","last_clean":"2024-09-11T23:15:20.255344+0000","last_became_active":"2024-09-11T23:15:12.977577+0000","last_became_peered":"2024-09-11T23:15:12.977577+0000","last_unstale":"2024-09-11T23:15:20.255344+0000","last_undegraded":"2024-09-11T23:15:20.255344+0000","last_fullsized":"2024-09-11T23:15:20.255344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:04.986111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011696+0000","last_change":"2024-09-11T23:15:18.040717+0000","last_active":"2024-09-11T23:15:20.011696+0000","last_peered":"2024-09-11T23:15:20.011696+0000","last_clean":"2024-09-11T23:15:20.011696+0000","last_became_active":"2024-09-11T23:15:18.039316+0000","last_became_peered":"2024-09-11T23:15:18.039316+0000","last_unstale":"2024-09-11T23:15:20.011696+0000","last_undegraded":"2024-09-11T23:15:20.011696+0000","last_fullsized":"2024-09-11T23:15:20.011696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002755+0000","last_change":"2024-09-11T23:15:13.951501+0000","last_active":"2024-09-11T23:15:20.002755+0000","last_peered":"2024-09-11T23:15:20.002755+0000","last_clean":"2024-09-11T23:15:20.002755+0000","last_became_active":"2024-09-11T23:15:13.951199+0000","last_became_peered":"2024-09-11T23:15:13.951199+0000","last_unstale":"2024-09-11T23:15:20.002755+0000","last_undegraded":"2024-09-11T23:15:20.002755+0000","last_fullsized":"2024-09-11T23:15:20.002755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253117+0000","last_change":"2024-09-11T23:15:12.963618+0000","last_active":"2024-09-11T23:15:20.253117+0000","last_peered":"2024-09-11T23:15:20.253117+0000","last_clean":"2024-09-11T23:15:20.253117+0000","last_became_active":"2024-09-11T23:15:12.963221+0000","last_became_peered":"2024-09-11T23:15:12.963221+0000","last_unstale":"2024-09-11T23:15:20.253117+0000","last_undegraded":"2024-09-11T23:15:20.253117+0000","last_fullsized":"2024-09-11T23:15:20.253117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011380+0000","last_change":"2024-09-11T23:15:18.037481+0000","last_active":"2024-09-11T23:15:20.011380+0000","last_peered":"2024-09-11T23:15:20.011380+0000","last_clean":"2024-09-11T23:15:20.011380+0000","last_became_active":"2024-09-11T23:15:18.036406+0000","last_became_peered":"2024-09-11T23:15:18.036406+0000","last_unstale":"2024-09-11T23:15:20.011380+0000","last_undegraded":"2024-09-11T23:15:20.011380+0000","last_fullsized":"2024-09-11T23:15:20.011380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002601+0000","last_change":"2024-09-11T23:15:13.946573+0000","last_active":"2024-09-11T23:15:20.002601+0000","last_peered":"2024-09-11T23:15:20.002601+0000","last_clean":"2024-09-11T23:15:20.002601+0000","last_became_active":"2024-09-11T23:15:13.946197+0000","last_became_peered":"2024-09-11T23:15:13.946197+0000","last_unstale":"2024-09-11T23:15:20.002601+0000","last_undegraded":"2024-09-11T23:15:20.002601+0000","last_fullsized":"2024-09-11T23:15:20.002601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251927+0000","last_change":"2024-09-11T23:15:12.973005+0000","last_active":"2024-09-11T23:15:20.251927+0000","last_peered":"2024-09-11T23:15:20.251927+0000","last_clean":"2024-09-11T23:15:20.251927+0000","last_became_active":"2024-09-11T23:15:12.972755+0000","last_became_peered":"2024-09-11T23:15:12.972755+0000","last_unstale":"2024-09-11T23:15:20.251927+0000","last_undegraded":"2024-09-11T23:15:20.251927+0000","last_fullsized":"2024-09-11T23:15:20.251927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254128+0000","last_change":"2024-09-11T23:15:18.458359+0000","last_active":"2024-09-11T23:15:20.254128+0000","last_peered":"2024-09-11T23:15:20.254128+0000","last_clean":"2024-09-11T23:15:20.254128+0000","last_became_active":"2024-09-11T23:15:18.457312+0000","last_became_peered":"2024-09-11T23:15:18.457312+0000","last_unstale":"2024-09-11T23:15:20.254128+0000","last_undegraded":"2024-09-11T23:15:20.254128+0000","last_fullsized":"2024-09-11T23:15:20.254128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010080+0000","last_change":"2024-09-11T23:15:13.949978+0000","last_active":"2024-09-11T23:15:20.010080+0000","last_peered":"2024-09-11T23:15:20.010080+0000","last_clean":"2024-09-11T23:15:20.010080+0000","last_became_active":"2024-09-11T23:15:13.948572+0000","last_became_peered":"2024-09-11T23:15:13.948572+0000","last_unstale":"2024-09-11T23:15:20.010080+0000","last_undegraded":"2024-09-11T23:15:20.010080+0000","last_fullsized":"2024-09-11T23:15:20.010080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:18.647972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253258+0000","last_change":"2024-09-11T23:15:12.967038+0000","last_active":"2024-09-11T23:15:20.253258+0000","last_peered":"2024-09-11T23:15:20.253258+0000","last_clean":"2024-09-11T23:15:20.253258+0000","last_became_active":"2024-09-11T23:15:12.965415+0000","last_became_peered":"2024-09-11T23:15:12.965415+0000","last_unstale":"2024-09-11T23:15:20.253258+0000","last_undegraded":"2024-09-11T23:15:20.253258+0000","last_fullsized":"2024-09-11T23:15:20.253258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011695+0000","last_change":"2024-09-11T23:15:18.046520+0000","last_active":"2024-09-11T23:15:20.011695+0000","last_peered":"2024-09-11T23:15:20.011695+0000","last_clean":"2024-09-11T23:15:20.011695+0000","last_became_active":"2024-09-11T23:15:18.045457+0000","last_became_peered":"2024-09-11T23:15:18.045457+0000","last_unstale":"2024-09-11T23:15:20.011695+0000","last_undegraded":"2024-09-11T23:15:20.011695+0000","last_fullsized":"2024-09-11T23:15:20.011695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256732+0000","last_change":"2024-09-11T23:15:13.941941+0000","last_active":"2024-09-11T23:15:20.256732+0000","last_peered":"2024-09-11T23:15:20.256732+0000","last_clean":"2024-09-11T23:15:20.256732+0000","last_became_active":"2024-09-11T23:15:13.941593+0000","last_became_peered":"2024-09-11T23:15:13.941593+0000","last_unstale":"2024-09-11T23:15:20.256732+0000","last_undegraded":"2024-09-11T23:15:20.256732+0000","last_fullsized":"2024-09-11T23:15:20.256732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:33.314997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255566+0000","last_change":"2024-09-11T23:15:12.980259+0000","last_active":"2024-09-11T23:15:20.255566+0000","last_peered":"2024-09-11T23:15:20.255566+0000","last_clean":"2024-09-11T23:15:20.255566+0000","last_became_active":"2024-09-11T23:15:12.979084+0000","last_became_peered":"2024-09-11T23:15:12.979084+0000","last_unstale":"2024-09-11T23:15:20.255566+0000","last_undegraded":"2024-09-11T23:15:20.255566+0000","last_fullsized":"2024-09-11T23:15:20.255566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010030+0000","last_change":"2024-09-11T23:15:18.450939+0000","last_active":"2024-09-11T23:15:20.010030+0000","last_peered":"2024-09-11T23:15:20.010030+0000","last_clean":"2024-09-11T23:15:20.010030+0000","last_became_active":"2024-09-11T23:15:18.449905+0000","last_became_peered":"2024-09-11T23:15:18.449905+0000","last_unstale":"2024-09-11T23:15:20.010030+0000","last_undegraded":"2024-09-11T23:15:20.010030+0000","last_fullsized":"2024-09-11T23:15:20.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004150+0000","last_change":"2024-09-11T23:15:13.998809+0000","last_active":"2024-09-11T23:15:20.004150+0000","last_peered":"2024-09-11T23:15:20.004150+0000","last_clean":"2024-09-11T23:15:20.004150+0000","last_became_active":"2024-09-11T23:15:13.998546+0000","last_became_peered":"2024-09-11T23:15:13.998546+0000","last_unstale":"2024-09-11T23:15:20.004150+0000","last_undegraded":"2024-09-11T23:15:20.004150+0000","last_fullsized":"2024-09-11T23:15:20.004150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253620+0000","last_change":"2024-09-11T23:15:12.962583+0000","last_active":"2024-09-11T23:15:20.253620+0000","last_peered":"2024-09-11T23:15:20.253620+0000","last_clean":"2024-09-11T23:15:20.253620+0000","last_became_active":"2024-09-11T23:15:12.962238+0000","last_became_peered":"2024-09-11T23:15:12.962238+0000","last_unstale":"2024-09-11T23:15:20.253620+0000","last_undegraded":"2024-09-11T23:15:20.253620+0000","last_fullsized":"2024-09-11T23:15:20.253620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002270+0000","last_change":"2024-09-11T23:15:18.450216+0000","last_active":"2024-09-11T23:15:20.002270+0000","last_peered":"2024-09-11T23:15:20.002270+0000","last_clean":"2024-09-11T23:15:20.002270+0000","last_became_active":"2024-09-11T23:15:18.449301+0000","last_became_peered":"2024-09-11T23:15:18.449301+0000","last_unstale":"2024-09-11T23:15:20.002270+0000","last_undegraded":"2024-09-11T23:15:20.002270+0000","last_fullsized":"2024-09-11T23:15:20.002270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251732+0000","last_change":"2024-09-11T23:15:13.945641+0000","last_active":"2024-09-11T23:15:20.251732+0000","last_peered":"2024-09-11T23:15:20.251732+0000","last_clean":"2024-09-11T23:15:20.251732+0000","last_became_active":"2024-09-11T23:15:13.945333+0000","last_became_peered":"2024-09-11T23:15:13.945333+0000","last_unstale":"2024-09-11T23:15:20.251732+0000","last_undegraded":"2024-09-11T23:15:20.251732+0000","last_fullsized":"2024-09-11T23:15:20.251732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257048+0000","last_change":"2024-09-11T23:15:12.974878+0000","last_active":"2024-09-11T23:15:20.257048+0000","last_peered":"2024-09-11T23:15:20.257048+0000","last_clean":"2024-09-11T23:15:20.257048+0000","last_became_active":"2024-09-11T23:15:12.973946+0000","last_became_peered":"2024-09-11T23:15:12.973946+0000","last_unstale":"2024-09-11T23:15:20.257048+0000","last_undegraded":"2024-09-11T23:15:20.257048+0000","last_fullsized":"2024-09-11T23:15:20.257048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255824+0000","last_change":"2024-09-11T23:15:18.452665+0000","last_active":"2024-09-11T23:15:20.255824+0000","last_peered":"2024-09-11T23:15:20.255824+0000","last_clean":"2024-09-11T23:15:20.255824+0000","last_became_active":"2024-09-11T23:15:18.450946+0000","last_became_peered":"2024-09-11T23:15:18.450946+0000","last_unstale":"2024-09-11T23:15:20.255824+0000","last_undegraded":"2024-09-11T23:15:20.255824+0000","last_fullsized":"2024-09-11T23:15:20.255824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006334+0000","last_change":"2024-09-11T23:15:13.951679+0000","last_active":"2024-09-11T23:15:20.006334+0000","last_peered":"2024-09-11T23:15:20.006334+0000","last_clean":"2024-09-11T23:15:20.006334+0000","last_became_active":"2024-09-11T23:15:13.947656+0000","last_became_peered":"2024-09-11T23:15:13.947656+0000","last_unstale":"2024-09-11T23:15:20.006334+0000","last_undegraded":"2024-09-11T23:15:20.006334+0000","last_fullsized":"2024-09-11T23:15:20.006334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251827+0000","last_change":"2024-09-11T23:15:12.945808+0000","last_active":"2024-09-11T23:15:20.251827+0000","last_peered":"2024-09-11T23:15:20.251827+0000","last_clean":"2024-09-11T23:15:20.251827+0000","last_became_active":"2024-09-11T23:15:12.945339+0000","last_became_peered":"2024-09-11T23:15:12.945339+0000","last_unstale":"2024-09-11T23:15:20.251827+0000","last_undegraded":"2024-09-11T23:15:20.251827+0000","last_fullsized":"2024-09-11T23:15:20.251827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252167+0000","last_change":"2024-09-11T23:15:18.042569+0000","last_active":"2024-09-11T23:15:20.252167+0000","last_peered":"2024-09-11T23:15:20.252167+0000","last_clean":"2024-09-11T23:15:20.252167+0000","last_became_active":"2024-09-11T23:15:18.042221+0000","last_became_peered":"2024-09-11T23:15:18.042221+0000","last_unstale":"2024-09-11T23:15:20.252167+0000","last_undegraded":"2024-09-11T23:15:20.252167+0000","last_fullsized":"2024-09-11T23:15:20.252167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011131+0000","last_change":"2024-09-11T23:15:13.959260+0000","last_active":"2024-09-11T23:15:20.011131+0000","last_peered":"2024-09-11T23:15:20.011131+0000","last_clean":"2024-09-11T23:15:20.011131+0000","last_became_active":"2024-09-11T23:15:13.958012+0000","last_became_peered":"2024-09-11T23:15:13.958012+0000","last_unstale":"2024-09-11T23:15:20.011131+0000","last_undegraded":"2024-09-11T23:15:20.011131+0000","last_fullsized":"2024-09-11T23:15:20.011131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:00.528239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005527+0000","last_change":"2024-09-11T23:15:12.956721+0000","last_active":"2024-09-11T23:15:20.005527+0000","last_peered":"2024-09-11T23:15:20.005527+0000","last_clean":"2024-09-11T23:15:20.005527+0000","last_became_active":"2024-09-11T23:15:12.956051+0000","last_became_peered":"2024-09-11T23:15:12.956051+0000","last_unstale":"2024-09-11T23:15:20.005527+0000","last_undegraded":"2024-09-11T23:15:20.005527+0000","last_fullsized":"2024-09-11T23:15:20.005527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251677+0000","last_change":"2024-09-11T23:15:18.038561+0000","last_active":"2024-09-11T23:15:20.251677+0000","last_peered":"2024-09-11T23:15:20.251677+0000","last_clean":"2024-09-11T23:15:20.251677+0000","last_became_active":"2024-09-11T23:15:18.038087+0000","last_became_peered":"2024-09-11T23:15:18.038087+0000","last_unstale":"2024-09-11T23:15:20.251677+0000","last_undegraded":"2024-09-11T23:15:20.251677+0000","last_fullsized":"2024-09-11T23:15:20.251677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251360+0000","last_change":"2024-09-11T23:15:13.945048+0000","last_active":"2024-09-11T23:15:20.251360+0000","last_peered":"2024-09-11T23:15:20.251360+0000","last_clean":"2024-09-11T23:15:20.251360+0000","last_became_active":"2024-09-11T23:15:13.944724+0000","last_became_peered":"2024-09-11T23:15:13.944724+0000","last_unstale":"2024-09-11T23:15:20.251360+0000","last_undegraded":"2024-09-11T23:15:20.251360+0000","last_fullsized":"2024-09-11T23:15:20.251360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252961+0000","last_change":"2024-09-11T23:15:12.960646+0000","last_active":"2024-09-11T23:15:20.252961+0000","last_peered":"2024-09-11T23:15:20.252961+0000","last_clean":"2024-09-11T23:15:20.252961+0000","last_became_active":"2024-09-11T23:15:12.959926+0000","last_became_peered":"2024-09-11T23:15:12.959926+0000","last_unstale":"2024-09-11T23:15:20.252961+0000","last_undegraded":"2024-09-11T23:15:20.252961+0000","last_fullsized":"2024-09-11T23:15:20.252961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254350+0000","last_change":"2024-09-11T23:15:18.038883+0000","last_active":"2024-09-11T23:15:20.254350+0000","last_peered":"2024-09-11T23:15:20.254350+0000","last_clean":"2024-09-11T23:15:20.254350+0000","last_became_active":"2024-09-11T23:15:18.038060+0000","last_became_peered":"2024-09-11T23:15:18.038060+0000","last_unstale":"2024-09-11T23:15:20.254350+0000","last_undegraded":"2024-09-11T23:15:20.254350+0000","last_fullsized":"2024-09-11T23:15:20.254350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255170+0000","last_change":"2024-09-11T23:15:13.951852+0000","last_active":"2024-09-11T23:15:20.255170+0000","last_peered":"2024-09-11T23:15:20.255170+0000","last_clean":"2024-09-11T23:15:20.255170+0000","last_became_active":"2024-09-11T23:15:13.951463+0000","last_became_peered":"2024-09-11T23:15:13.951463+0000","last_unstale":"2024-09-11T23:15:20.255170+0000","last_undegraded":"2024-09-11T23:15:20.255170+0000","last_fullsized":"2024-09-11T23:15:20.255170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:07.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253562+0000","last_change":"2024-09-11T23:15:12.967704+0000","last_active":"2024-09-11T23:15:20.253562+0000","last_peered":"2024-09-11T23:15:20.253562+0000","last_clean":"2024-09-11T23:15:20.253562+0000","last_became_active":"2024-09-11T23:15:12.966314+0000","last_became_peered":"2024-09-11T23:15:12.966314+0000","last_unstale":"2024-09-11T23:15:20.253562+0000","last_undegraded":"2024-09-11T23:15:20.253562+0000","last_fullsized":"2024-09-11T23:15:20.253562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256718+0000","last_change":"2024-09-11T23:15:18.451095+0000","last_active":"2024-09-11T23:15:20.256718+0000","last_peered":"2024-09-11T23:15:20.256718+0000","last_clean":"2024-09-11T23:15:20.256718+0000","last_became_active":"2024-09-11T23:15:18.449565+0000","last_became_peered":"2024-09-11T23:15:18.449565+0000","last_unstale":"2024-09-11T23:15:20.256718+0000","last_undegraded":"2024-09-11T23:15:20.256718+0000","last_fullsized":"2024-09-11T23:15:20.256718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003000+0000","last_change":"2024-09-11T23:15:13.980670+0000","last_active":"2024-09-11T23:15:20.003000+0000","last_peered":"2024-09-11T23:15:20.003000+0000","last_clean":"2024-09-11T23:15:20.003000+0000","last_became_active":"2024-09-11T23:15:13.980357+0000","last_became_peered":"2024-09-11T23:15:13.980357+0000","last_unstale":"2024-09-11T23:15:20.003000+0000","last_undegraded":"2024-09-11T23:15:20.003000+0000","last_fullsized":"2024-09-11T23:15:20.003000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005545+0000","last_change":"2024-09-11T23:15:12.959799+0000","last_active":"2024-09-11T23:15:20.005545+0000","last_peered":"2024-09-11T23:15:20.005545+0000","last_clean":"2024-09-11T23:15:20.005545+0000","last_became_active":"2024-09-11T23:15:12.959033+0000","last_became_peered":"2024-09-11T23:15:12.959033+0000","last_unstale":"2024-09-11T23:15:20.005545+0000","last_undegraded":"2024-09-11T23:15:20.005545+0000","last_fullsized":"2024-09-11T23:15:20.005545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253840+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:15:20.253840+0000","last_peered":"2024-09-11T23:15:20.253840+0000","last_clean":"2024-09-11T23:15:20.253840+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:15:20.253840+0000","last_undegraded":"2024-09-11T23:15:20.253840+0000","last_fullsized":"2024-09-11T23:15:20.253840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252619+0000","last_change":"2024-09-11T23:15:18.458819+0000","last_active":"2024-09-11T23:15:20.252619+0000","last_peered":"2024-09-11T23:15:20.252619+0000","last_clean":"2024-09-11T23:15:20.252619+0000","last_became_active":"2024-09-11T23:15:18.457747+0000","last_became_peered":"2024-09-11T23:15:18.457747+0000","last_unstale":"2024-09-11T23:15:20.252619+0000","last_undegraded":"2024-09-11T23:15:20.252619+0000","last_fullsized":"2024-09-11T23:15:20.252619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256534+0000","last_change":"2024-09-11T23:15:14.002907+0000","last_active":"2024-09-11T23:15:20.256534+0000","last_peered":"2024-09-11T23:15:20.256534+0000","last_clean":"2024-09-11T23:15:20.256534+0000","last_became_active":"2024-09-11T23:15:13.996895+0000","last_became_peered":"2024-09-11T23:15:13.996895+0000","last_unstale":"2024-09-11T23:15:20.256534+0000","last_undegraded":"2024-09-11T23:15:20.256534+0000","last_fullsized":"2024-09-11T23:15:20.256534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252892+0000","last_change":"2024-09-11T23:15:12.957780+0000","last_active":"2024-09-11T23:15:20.252892+0000","last_peered":"2024-09-11T23:15:20.252892+0000","last_clean":"2024-09-11T23:15:20.252892+0000","last_became_active":"2024-09-11T23:15:12.957375+0000","last_became_peered":"2024-09-11T23:15:12.957375+0000","last_unstale":"2024-09-11T23:15:20.252892+0000","last_undegraded":"2024-09-11T23:15:20.252892+0000","last_fullsized":"2024-09-11T23:15:20.252892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252849+0000","last_change":"2024-09-11T23:15:18.451410+0000","last_active":"2024-09-11T23:15:20.252849+0000","last_peered":"2024-09-11T23:15:20.252849+0000","last_clean":"2024-09-11T23:15:20.252849+0000","last_became_active":"2024-09-11T23:15:18.450381+0000","last_became_peered":"2024-09-11T23:15:18.450381+0000","last_unstale":"2024-09-11T23:15:20.252849+0000","last_undegraded":"2024-09-11T23:15:20.252849+0000","last_fullsized":"2024-09-11T23:15:20.252849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005415+0000","last_change":"2024-09-11T23:15:13.951881+0000","last_active":"2024-09-11T23:15:20.005415+0000","last_peered":"2024-09-11T23:15:20.005415+0000","last_clean":"2024-09-11T23:15:20.005415+0000","last_became_active":"2024-09-11T23:15:13.951002+0000","last_became_peered":"2024-09-11T23:15:13.951002+0000","last_unstale":"2024-09-11T23:15:20.005415+0000","last_undegraded":"2024-09-11T23:15:20.005415+0000","last_fullsized":"2024-09-11T23:15:20.005415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252772+0000","last_change":"2024-09-11T23:15:12.949969+0000","last_active":"2024-09-11T23:15:20.252772+0000","last_peered":"2024-09-11T23:15:20.252772+0000","last_clean":"2024-09-11T23:15:20.252772+0000","last_became_active":"2024-09-11T23:15:12.949624+0000","last_became_peered":"2024-09-11T23:15:12.949624+0000","last_unstale":"2024-09-11T23:15:20.252772+0000","last_undegraded":"2024-09-11T23:15:20.252772+0000","last_fullsized":"2024-09-11T23:15:20.252772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256235+0000","last_change":"2024-09-11T23:15:18.048455+0000","last_active":"2024-09-11T23:15:20.256235+0000","last_peered":"2024-09-11T23:15:20.256235+0000","last_clean":"2024-09-11T23:15:20.256235+0000","last_became_active":"2024-09-11T23:15:18.047979+0000","last_became_peered":"2024-09-11T23:15:18.047979+0000","last_unstale":"2024-09-11T23:15:20.256235+0000","last_undegraded":"2024-09-11T23:15:20.256235+0000","last_fullsized":"2024-09-11T23:15:20.256235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257597+0000","last_change":"2024-09-11T23:15:14.004585+0000","last_active":"2024-09-11T23:15:20.257597+0000","last_peered":"2024-09-11T23:15:20.257597+0000","last_clean":"2024-09-11T23:15:20.257597+0000","last_became_active":"2024-09-11T23:15:14.000088+0000","last_became_peered":"2024-09-11T23:15:14.000088+0000","last_unstale":"2024-09-11T23:15:20.257597+0000","last_undegraded":"2024-09-11T23:15:20.257597+0000","last_fullsized":"2024-09-11T23:15:20.257597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:53.838643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253011+0000","last_change":"2024-09-11T23:15:12.960122+0000","last_active":"2024-09-11T23:15:20.253011+0000","last_peered":"2024-09-11T23:15:20.253011+0000","last_clean":"2024-09-11T23:15:20.253011+0000","last_became_active":"2024-09-11T23:15:12.959575+0000","last_became_peered":"2024-09-11T23:15:12.959575+0000","last_unstale":"2024-09-11T23:15:20.253011+0000","last_undegraded":"2024-09-11T23:15:20.253011+0000","last_fullsized":"2024-09-11T23:15:20.253011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004271+0000","last_change":"2024-09-11T23:15:18.451425+0000","last_active":"2024-09-11T23:15:20.004271+0000","last_peered":"2024-09-11T23:15:20.004271+0000","last_clean":"2024-09-11T23:15:20.004271+0000","last_became_active":"2024-09-11T23:15:18.450141+0000","last_became_peered":"2024-09-11T23:15:18.450141+0000","last_unstale":"2024-09-11T23:15:20.004271+0000","last_undegraded":"2024-09-11T23:15:20.004271+0000","last_fullsized":"2024-09-11T23:15:20.004271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:52.139583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255998+0000","last_change":"2024-09-11T23:15:13.992622+0000","last_active":"2024-09-11T23:15:20.255998+0000","last_peered":"2024-09-11T23:15:20.255998+0000","last_clean":"2024-09-11T23:15:20.255998+0000","last_became_active":"2024-09-11T23:15:13.992126+0000","last_became_peered":"2024-09-11T23:15:13.992126+0000","last_unstale":"2024-09-11T23:15:20.255998+0000","last_undegraded":"2024-09-11T23:15:20.255998+0000","last_fullsized":"2024-09-11T23:15:20.255998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011556+0000","last_change":"2024-09-11T23:15:12.956823+0000","last_active":"2024-09-11T23:15:20.011556+0000","last_peered":"2024-09-11T23:15:20.011556+0000","last_clean":"2024-09-11T23:15:20.011556+0000","last_became_active":"2024-09-11T23:15:12.956008+0000","last_became_peered":"2024-09-11T23:15:12.956008+0000","last_unstale":"2024-09-11T23:15:20.011556+0000","last_undegraded":"2024-09-11T23:15:20.011556+0000","last_fullsized":"2024-09-11T23:15:20.011556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:07.503232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009464+0000","last_change":"2024-09-11T23:15:18.038980+0000","last_active":"2024-09-11T23:15:20.009464+0000","last_peered":"2024-09-11T23:15:20.009464+0000","last_clean":"2024-09-11T23:15:20.009464+0000","last_became_active":"2024-09-11T23:15:18.037945+0000","last_became_peered":"2024-09-11T23:15:18.037945+0000","last_unstale":"2024-09-11T23:15:20.009464+0000","last_undegraded":"2024-09-11T23:15:20.009464+0000","last_fullsized":"2024-09-11T23:15:20.009464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254843+0000","last_change":"2024-09-11T23:15:13.993165+0000","last_active":"2024-09-11T23:15:20.254843+0000","last_peered":"2024-09-11T23:15:20.254843+0000","last_clean":"2024-09-11T23:15:20.254843+0000","last_became_active":"2024-09-11T23:15:13.992504+0000","last_became_peered":"2024-09-11T23:15:13.992504+0000","last_unstale":"2024-09-11T23:15:20.254843+0000","last_undegraded":"2024-09-11T23:15:20.254843+0000","last_fullsized":"2024-09-11T23:15:20.254843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252247+0000","last_change":"2024-09-11T23:15:12.947477+0000","last_active":"2024-09-11T23:15:20.252247+0000","last_peered":"2024-09-11T23:15:20.252247+0000","last_clean":"2024-09-11T23:15:20.252247+0000","last_became_active":"2024-09-11T23:15:12.947007+0000","last_became_peered":"2024-09-11T23:15:12.947007+0000","last_unstale":"2024-09-11T23:15:20.252247+0000","last_undegraded":"2024-09-11T23:15:20.252247+0000","last_fullsized":"2024-09-11T23:15:20.252247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:04.981883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256142+0000","last_change":"2024-09-11T23:15:18.033305+0000","last_active":"2024-09-11T23:15:20.256142+0000","last_peered":"2024-09-11T23:15:20.256142+0000","last_clean":"2024-09-11T23:15:20.256142+0000","last_became_active":"2024-09-11T23:15:18.032851+0000","last_became_peered":"2024-09-11T23:15:18.032851+0000","last_unstale":"2024-09-11T23:15:20.256142+0000","last_undegraded":"2024-09-11T23:15:20.256142+0000","last_fullsized":"2024-09-11T23:15:20.256142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252194+0000","last_change":"2024-09-11T23:15:13.957074+0000","last_active":"2024-09-11T23:15:20.252194+0000","last_peered":"2024-09-11T23:15:20.252194+0000","last_clean":"2024-09-11T23:15:20.252194+0000","last_became_active":"2024-09-11T23:15:13.956301+0000","last_became_peered":"2024-09-11T23:15:13.956301+0000","last_unstale":"2024-09-11T23:15:20.252194+0000","last_undegraded":"2024-09-11T23:15:20.252194+0000","last_fullsized":"2024-09-11T23:15:20.252194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252337+0000","last_change":"2024-09-11T23:15:12.971136+0000","last_active":"2024-09-11T23:15:20.252337+0000","last_peered":"2024-09-11T23:15:20.252337+0000","last_clean":"2024-09-11T23:15:20.252337+0000","last_became_active":"2024-09-11T23:15:12.970142+0000","last_became_peered":"2024-09-11T23:15:12.970142+0000","last_unstale":"2024-09-11T23:15:20.252337+0000","last_undegraded":"2024-09-11T23:15:20.252337+0000","last_fullsized":"2024-09-11T23:15:20.252337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004049+0000","last_change":"2024-09-11T23:15:18.460304+0000","last_active":"2024-09-11T23:15:20.004049+0000","last_peered":"2024-09-11T23:15:20.004049+0000","last_clean":"2024-09-11T23:15:20.004049+0000","last_became_active":"2024-09-11T23:15:18.459166+0000","last_became_peered":"2024-09-11T23:15:18.459166+0000","last_unstale":"2024-09-11T23:15:20.004049+0000","last_undegraded":"2024-09-11T23:15:20.004049+0000","last_fullsized":"2024-09-11T23:15:20.004049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:18.063967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254916+0000","last_change":"2024-09-11T23:15:14.003618+0000","last_active":"2024-09-11T23:15:20.254916+0000","last_peered":"2024-09-11T23:15:20.254916+0000","last_clean":"2024-09-11T23:15:20.254916+0000","last_became_active":"2024-09-11T23:15:14.002919+0000","last_became_peered":"2024-09-11T23:15:14.002919+0000","last_unstale":"2024-09-11T23:15:20.254916+0000","last_undegraded":"2024-09-11T23:15:20.254916+0000","last_fullsized":"2024-09-11T23:15:20.254916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005255+0000","last_change":"2024-09-11T23:15:12.964766+0000","last_active":"2024-09-11T23:15:20.005255+0000","last_peered":"2024-09-11T23:15:20.005255+0000","last_clean":"2024-09-11T23:15:20.005255+0000","last_became_active":"2024-09-11T23:15:12.964115+0000","last_became_peered":"2024-09-11T23:15:12.964115+0000","last_unstale":"2024-09-11T23:15:20.005255+0000","last_undegraded":"2024-09-11T23:15:20.005255+0000","last_fullsized":"2024-09-11T23:15:20.005255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003676+0000","last_change":"2024-09-11T23:15:18.450475+0000","last_active":"2024-09-11T23:15:20.003676+0000","last_peered":"2024-09-11T23:15:20.003676+0000","last_clean":"2024-09-11T23:15:20.003676+0000","last_became_active":"2024-09-11T23:15:18.449418+0000","last_became_peered":"2024-09-11T23:15:18.449418+0000","last_unstale":"2024-09-11T23:15:20.003676+0000","last_undegraded":"2024-09-11T23:15:20.003676+0000","last_fullsized":"2024-09-11T23:15:20.003676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:22.686451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255570+0000","last_change":"2024-09-11T23:15:13.985601+0000","last_active":"2024-09-11T23:15:20.255570+0000","last_peered":"2024-09-11T23:15:20.255570+0000","last_clean":"2024-09-11T23:15:20.255570+0000","last_became_active":"2024-09-11T23:15:13.985289+0000","last_became_peered":"2024-09-11T23:15:13.985289+0000","last_unstale":"2024-09-11T23:15:20.255570+0000","last_undegraded":"2024-09-11T23:15:20.255570+0000","last_fullsized":"2024-09-11T23:15:20.255570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256225+0000","last_change":"2024-09-11T23:15:12.970791+0000","last_active":"2024-09-11T23:15:20.256225+0000","last_peered":"2024-09-11T23:15:20.256225+0000","last_clean":"2024-09-11T23:15:20.256225+0000","last_became_active":"2024-09-11T23:15:12.970526+0000","last_became_peered":"2024-09-11T23:15:12.970526+0000","last_unstale":"2024-09-11T23:15:20.256225+0000","last_undegraded":"2024-09-11T23:15:20.256225+0000","last_fullsized":"2024-09-11T23:15:20.256225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:38.061268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006186+0000","last_change":"2024-09-11T23:15:18.451679+0000","last_active":"2024-09-11T23:15:20.006186+0000","last_peered":"2024-09-11T23:15:20.006186+0000","last_clean":"2024-09-11T23:15:20.006186+0000","last_became_active":"2024-09-11T23:15:18.450530+0000","last_became_peered":"2024-09-11T23:15:18.450530+0000","last_unstale":"2024-09-11T23:15:20.006186+0000","last_undegraded":"2024-09-11T23:15:20.006186+0000","last_fullsized":"2024-09-11T23:15:20.006186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:31.718045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256402+0000","last_change":"2024-09-11T23:15:13.992617+0000","last_active":"2024-09-11T23:15:20.256402+0000","last_peered":"2024-09-11T23:15:20.256402+0000","last_clean":"2024-09-11T23:15:20.256402+0000","last_became_active":"2024-09-11T23:15:13.990843+0000","last_became_peered":"2024-09-11T23:15:13.990843+0000","last_unstale":"2024-09-11T23:15:20.256402+0000","last_undegraded":"2024-09-11T23:15:20.256402+0000","last_fullsized":"2024-09-11T23:15:20.256402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:24.450253+0000","last_change":"2024-09-11T23:15:12.963148+0000","last_active":"2024-09-11T23:15:24.450253+0000","last_peered":"2024-09-11T23:15:24.450253+0000","last_clean":"2024-09-11T23:15:24.450253+0000","last_became_active":"2024-09-11T23:15:12.961283+0000","last_became_peered":"2024-09-11T23:15:12.961283+0000","last_unstale":"2024-09-11T23:15:24.450253+0000","last_undegraded":"2024-09-11T23:15:24.450253+0000","last_fullsized":"2024-09-11T23:15:24.450253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252586+0000","last_change":"2024-09-11T23:15:18.030168+0000","last_active":"2024-09-11T23:15:20.252586+0000","last_peered":"2024-09-11T23:15:20.252586+0000","last_clean":"2024-09-11T23:15:20.252586+0000","last_became_active":"2024-09-11T23:15:18.029815+0000","last_became_peered":"2024-09-11T23:15:18.029815+0000","last_unstale":"2024-09-11T23:15:20.252586+0000","last_undegraded":"2024-09-11T23:15:20.252586+0000","last_fullsized":"2024-09-11T23:15:20.252586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011213+0000","last_change":"2024-09-11T23:15:14.000924+0000","last_active":"2024-09-11T23:15:20.011213+0000","last_peered":"2024-09-11T23:15:20.011213+0000","last_clean":"2024-09-11T23:15:20.011213+0000","last_became_active":"2024-09-11T23:15:14.000344+0000","last_became_peered":"2024-09-11T23:15:14.000344+0000","last_unstale":"2024-09-11T23:15:20.011213+0000","last_undegraded":"2024-09-11T23:15:20.011213+0000","last_fullsized":"2024-09-11T23:15:20.011213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252480+0000","last_change":"2024-09-11T23:15:12.964173+0000","last_active":"2024-09-11T23:15:20.252480+0000","last_peered":"2024-09-11T23:15:20.252480+0000","last_clean":"2024-09-11T23:15:20.252480+0000","last_became_active":"2024-09-11T23:15:12.963819+0000","last_became_peered":"2024-09-11T23:15:12.963819+0000","last_unstale":"2024-09-11T23:15:20.252480+0000","last_undegraded":"2024-09-11T23:15:20.252480+0000","last_fullsized":"2024-09-11T23:15:20.252480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010857+0000","last_change":"2024-09-11T23:15:18.045442+0000","last_active":"2024-09-11T23:15:20.010857+0000","last_peered":"2024-09-11T23:15:20.010857+0000","last_clean":"2024-09-11T23:15:20.010857+0000","last_became_active":"2024-09-11T23:15:18.042533+0000","last_became_peered":"2024-09-11T23:15:18.042533+0000","last_unstale":"2024-09-11T23:15:20.010857+0000","last_undegraded":"2024-09-11T23:15:20.010857+0000","last_fullsized":"2024-09-11T23:15:20.010857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256883+0000","last_change":"2024-09-11T23:15:13.979875+0000","last_active":"2024-09-11T23:15:20.256883+0000","last_peered":"2024-09-11T23:15:20.256883+0000","last_clean":"2024-09-11T23:15:20.256883+0000","last_became_active":"2024-09-11T23:15:13.979554+0000","last_became_peered":"2024-09-11T23:15:13.979554+0000","last_unstale":"2024-09-11T23:15:20.256883+0000","last_undegraded":"2024-09-11T23:15:20.256883+0000","last_fullsized":"2024-09-11T23:15:20.256883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005805+0000","last_change":"2024-09-11T23:15:12.970938+0000","last_active":"2024-09-11T23:15:20.005805+0000","last_peered":"2024-09-11T23:15:20.005805+0000","last_clean":"2024-09-11T23:15:20.005805+0000","last_became_active":"2024-09-11T23:15:12.970457+0000","last_became_peered":"2024-09-11T23:15:12.970457+0000","last_unstale":"2024-09-11T23:15:20.005805+0000","last_undegraded":"2024-09-11T23:15:20.005805+0000","last_fullsized":"2024-09-11T23:15:20.005805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002558+0000","last_change":"2024-09-11T23:15:18.044223+0000","last_active":"2024-09-11T23:15:20.002558+0000","last_peered":"2024-09-11T23:15:20.002558+0000","last_clean":"2024-09-11T23:15:20.002558+0000","last_became_active":"2024-09-11T23:15:18.043622+0000","last_became_peered":"2024-09-11T23:15:18.043622+0000","last_unstale":"2024-09-11T23:15:20.002558+0000","last_undegraded":"2024-09-11T23:15:20.002558+0000","last_fullsized":"2024-09-11T23:15:20.002558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:12.311044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005749+0000","last_change":"2024-09-11T23:15:13.994053+0000","last_active":"2024-09-11T23:15:20.005749+0000","last_peered":"2024-09-11T23:15:20.005749+0000","last_clean":"2024-09-11T23:15:20.005749+0000","last_became_active":"2024-09-11T23:15:13.993527+0000","last_became_peered":"2024-09-11T23:15:13.993527+0000","last_unstale":"2024-09-11T23:15:20.005749+0000","last_undegraded":"2024-09-11T23:15:20.005749+0000","last_fullsized":"2024-09-11T23:15:20.005749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255118+0000","last_change":"2024-09-11T23:15:12.971189+0000","last_active":"2024-09-11T23:15:20.255118+0000","last_peered":"2024-09-11T23:15:20.255118+0000","last_clean":"2024-09-11T23:15:20.255118+0000","last_became_active":"2024-09-11T23:15:12.970367+0000","last_became_peered":"2024-09-11T23:15:12.970367+0000","last_unstale":"2024-09-11T23:15:20.255118+0000","last_undegraded":"2024-09-11T23:15:20.255118+0000","last_fullsized":"2024-09-11T23:15:20.255118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002529+0000","last_change":"2024-09-11T23:15:18.458404+0000","last_active":"2024-09-11T23:15:20.002529+0000","last_peered":"2024-09-11T23:15:20.002529+0000","last_clean":"2024-09-11T23:15:20.002529+0000","last_became_active":"2024-09-11T23:15:18.457383+0000","last_became_peered":"2024-09-11T23:15:18.457383+0000","last_unstale":"2024-09-11T23:15:20.002529+0000","last_undegraded":"2024-09-11T23:15:20.002529+0000","last_fullsized":"2024-09-11T23:15:20.002529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:20.119273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255910+0000","last_change":"2024-09-11T23:15:18.458254+0000","last_active":"2024-09-11T23:15:20.255910+0000","last_peered":"2024-09-11T23:15:20.255910+0000","last_clean":"2024-09-11T23:15:20.255910+0000","last_became_active":"2024-09-11T23:15:18.457195+0000","last_became_peered":"2024-09-11T23:15:18.457195+0000","last_unstale":"2024-09-11T23:15:20.255910+0000","last_undegraded":"2024-09-11T23:15:20.255910+0000","last_fullsized":"2024-09-11T23:15:20.255910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251033+0000","last_change":"2024-09-11T23:15:13.947663+0000","last_active":"2024-09-11T23:15:20.251033+0000","last_peered":"2024-09-11T23:15:20.251033+0000","last_clean":"2024-09-11T23:15:20.251033+0000","last_became_active":"2024-09-11T23:15:13.947339+0000","last_became_peered":"2024-09-11T23:15:13.947339+0000","last_unstale":"2024-09-11T23:15:20.251033+0000","last_undegraded":"2024-09-11T23:15:20.251033+0000","last_fullsized":"2024-09-11T23:15:20.251033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004578+0000","last_change":"2024-09-11T23:15:12.977797+0000","last_active":"2024-09-11T23:15:20.004578+0000","last_peered":"2024-09-11T23:15:20.004578+0000","last_clean":"2024-09-11T23:15:20.004578+0000","last_became_active":"2024-09-11T23:15:12.977335+0000","last_became_peered":"2024-09-11T23:15:12.977335+0000","last_unstale":"2024-09-11T23:15:20.004578+0000","last_undegraded":"2024-09-11T23:15:20.004578+0000","last_fullsized":"2024-09-11T23:15:20.004578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254361+0000","last_change":"2024-09-11T23:15:18.037810+0000","last_active":"2024-09-11T23:15:20.254361+0000","last_peered":"2024-09-11T23:15:20.254361+0000","last_clean":"2024-09-11T23:15:20.254361+0000","last_became_active":"2024-09-11T23:15:18.036750+0000","last_became_peered":"2024-09-11T23:15:18.036750+0000","last_unstale":"2024-09-11T23:15:20.254361+0000","last_undegraded":"2024-09-11T23:15:20.254361+0000","last_fullsized":"2024-09-11T23:15:20.254361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002485+0000","last_change":"2024-09-11T23:15:13.952215+0000","last_active":"2024-09-11T23:15:20.002485+0000","last_peered":"2024-09-11T23:15:20.002485+0000","last_clean":"2024-09-11T23:15:20.002485+0000","last_became_active":"2024-09-11T23:15:13.951888+0000","last_became_peered":"2024-09-11T23:15:13.951888+0000","last_unstale":"2024-09-11T23:15:20.002485+0000","last_undegraded":"2024-09-11T23:15:20.002485+0000","last_fullsized":"2024-09-11T23:15:20.002485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003198+0000","last_change":"2024-09-11T23:15:12.963413+0000","last_active":"2024-09-11T23:15:20.003198+0000","last_peered":"2024-09-11T23:15:20.003198+0000","last_clean":"2024-09-11T23:15:20.003198+0000","last_became_active":"2024-09-11T23:15:12.962997+0000","last_became_peered":"2024-09-11T23:15:12.962997+0000","last_unstale":"2024-09-11T23:15:20.003198+0000","last_undegraded":"2024-09-11T23:15:20.003198+0000","last_fullsized":"2024-09-11T23:15:20.003198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253434+0000","last_change":"2024-09-11T23:15:12.970601+0000","last_active":"2024-09-11T23:15:20.253434+0000","last_peered":"2024-09-11T23:15:20.253434+0000","last_clean":"2024-09-11T23:15:20.253434+0000","last_became_active":"2024-09-11T23:15:12.970093+0000","last_became_peered":"2024-09-11T23:15:12.970093+0000","last_unstale":"2024-09-11T23:15:20.253434+0000","last_undegraded":"2024-09-11T23:15:20.253434+0000","last_fullsized":"2024-09-11T23:15:20.253434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256098+0000","last_change":"2024-09-11T23:15:13.951762+0000","last_active":"2024-09-11T23:15:20.256098+0000","last_peered":"2024-09-11T23:15:20.256098+0000","last_clean":"2024-09-11T23:15:20.256098+0000","last_became_active":"2024-09-11T23:15:13.951454+0000","last_became_peered":"2024-09-11T23:15:13.951454+0000","last_unstale":"2024-09-11T23:15:20.256098+0000","last_undegraded":"2024-09-11T23:15:20.256098+0000","last_fullsized":"2024-09-11T23:15:20.256098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252828+0000","last_change":"2024-09-11T23:15:18.032028+0000","last_active":"2024-09-11T23:15:20.252828+0000","last_peered":"2024-09-11T23:15:20.252828+0000","last_clean":"2024-09-11T23:15:20.252828+0000","last_became_active":"2024-09-11T23:15:18.031566+0000","last_became_peered":"2024-09-11T23:15:18.031566+0000","last_unstale":"2024-09-11T23:15:20.252828+0000","last_undegraded":"2024-09-11T23:15:20.252828+0000","last_fullsized":"2024-09-11T23:15:20.252828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:11.167279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002816+0000","last_change":"2024-09-11T23:15:12.955762+0000","last_active":"2024-09-11T23:15:20.002816+0000","last_peered":"2024-09-11T23:15:20.002816+0000","last_clean":"2024-09-11T23:15:20.002816+0000","last_became_active":"2024-09-11T23:15:12.955387+0000","last_became_peered":"2024-09-11T23:15:12.955387+0000","last_unstale":"2024-09-11T23:15:20.002816+0000","last_undegraded":"2024-09-11T23:15:20.002816+0000","last_fullsized":"2024-09-11T23:15:20.002816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010063+0000","last_change":"2024-09-11T23:15:13.956520+0000","last_active":"2024-09-11T23:15:20.010063+0000","last_peered":"2024-09-11T23:15:20.010063+0000","last_clean":"2024-09-11T23:15:20.010063+0000","last_became_active":"2024-09-11T23:15:13.952595+0000","last_became_peered":"2024-09-11T23:15:13.952595+0000","last_unstale":"2024-09-11T23:15:20.010063+0000","last_undegraded":"2024-09-11T23:15:20.010063+0000","last_fullsized":"2024-09-11T23:15:20.010063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:39.357892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003889+0000","last_change":"2024-09-11T23:15:18.044131+0000","last_active":"2024-09-11T23:15:20.003889+0000","last_peered":"2024-09-11T23:15:20.003889+0000","last_clean":"2024-09-11T23:15:20.003889+0000","last_became_active":"2024-09-11T23:15:18.043680+0000","last_became_peered":"2024-09-11T23:15:18.043680+0000","last_unstale":"2024-09-11T23:15:20.003889+0000","last_undegraded":"2024-09-11T23:15:20.003889+0000","last_fullsized":"2024-09-11T23:15:20.003889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:52.853399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251955+0000","last_change":"2024-09-11T23:15:13.957122+0000","last_active":"2024-09-11T23:15:20.251955+0000","last_peered":"2024-09-11T23:15:20.251955+0000","last_clean":"2024-09-11T23:15:20.251955+0000","last_became_active":"2024-09-11T23:15:13.956367+0000","last_became_peered":"2024-09-11T23:15:13.956367+0000","last_unstale":"2024-09-11T23:15:20.251955+0000","last_undegraded":"2024-09-11T23:15:20.251955+0000","last_fullsized":"2024-09-11T23:15:20.251955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252707+0000","last_change":"2024-09-11T23:15:13.945108+0000","last_active":"2024-09-11T23:15:20.252707+0000","last_peered":"2024-09-11T23:15:20.252707+0000","last_clean":"2024-09-11T23:15:20.252707+0000","last_became_active":"2024-09-11T23:15:13.944837+0000","last_became_peered":"2024-09-11T23:15:13.944837+0000","last_unstale":"2024-09-11T23:15:20.252707+0000","last_undegraded":"2024-09-11T23:15:20.252707+0000","last_fullsized":"2024-09-11T23:15:20.252707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005293+0000","last_change":"2024-09-11T23:15:13.954634+0000","last_active":"2024-09-11T23:15:20.005293+0000","last_peered":"2024-09-11T23:15:20.005293+0000","last_clean":"2024-09-11T23:15:20.005293+0000","last_became_active":"2024-09-11T23:15:13.953799+0000","last_became_peered":"2024-09-11T23:15:13.953799+0000","last_unstale":"2024-09-11T23:15:20.005293+0000","last_undegraded":"2024-09-11T23:15:20.005293+0000","last_fullsized":"2024-09-11T23:15:20.005293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255948+0000","last_change":"2024-09-11T23:15:13.949400+0000","last_active":"2024-09-11T23:15:20.255948+0000","last_peered":"2024-09-11T23:15:20.255948+0000","last_clean":"2024-09-11T23:15:20.255948+0000","last_became_active":"2024-09-11T23:15:13.949032+0000","last_became_peered":"2024-09-11T23:15:13.949032+0000","last_unstale":"2024-09-11T23:15:20.255948+0000","last_undegraded":"2024-09-11T23:15:20.255948+0000","last_fullsized":"2024-09-11T23:15:20.255948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003638+0000","last_change":"2024-09-11T23:15:13.960418+0000","last_active":"2024-09-11T23:15:20.003638+0000","last_peered":"2024-09-11T23:15:20.003638+0000","last_clean":"2024-09-11T23:15:20.003638+0000","last_became_active":"2024-09-11T23:15:13.960081+0000","last_became_peered":"2024-09-11T23:15:13.960081+0000","last_unstale":"2024-09-11T23:15:20.003638+0000","last_undegraded":"2024-09-11T23:15:20.003638+0000","last_fullsized":"2024-09-11T23:15:20.003638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252017+0000","last_change":"2024-09-11T23:15:13.947369+0000","last_active":"2024-09-11T23:15:20.252017+0000","last_peered":"2024-09-11T23:15:20.252017+0000","last_clean":"2024-09-11T23:15:20.252017+0000","last_became_active":"2024-09-11T23:15:13.947074+0000","last_became_peered":"2024-09-11T23:15:13.947074+0000","last_unstale":"2024-09-11T23:15:20.252017+0000","last_undegraded":"2024-09-11T23:15:20.252017+0000","last_fullsized":"2024-09-11T23:15:20.252017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254606+0000","last_change":"2024-09-11T23:15:13.995057+0000","last_active":"2024-09-11T23:15:20.254606+0000","last_peered":"2024-09-11T23:15:20.254606+0000","last_clean":"2024-09-11T23:15:20.254606+0000","last_became_active":"2024-09-11T23:15:13.994547+0000","last_became_peered":"2024-09-11T23:15:13.994547+0000","last_unstale":"2024-09-11T23:15:20.254606+0000","last_undegraded":"2024-09-11T23:15:20.254606+0000","last_fullsized":"2024-09-11T23:15:20.254606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004077+0000","last_change":"2024-09-11T23:15:13.960489+0000","last_active":"2024-09-11T23:15:20.004077+0000","last_peered":"2024-09-11T23:15:20.004077+0000","last_clean":"2024-09-11T23:15:20.004077+0000","last_became_active":"2024-09-11T23:15:13.960138+0000","last_became_peered":"2024-09-11T23:15:13.960138+0000","last_unstale":"2024-09-11T23:15:20.004077+0000","last_undegraded":"2024-09-11T23:15:20.004077+0000","last_fullsized":"2024-09-11T23:15:20.004077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004434+0000","last_change":"2024-09-11T23:15:13.963538+0000","last_active":"2024-09-11T23:15:20.004434+0000","last_peered":"2024-09-11T23:15:20.004434+0000","last_clean":"2024-09-11T23:15:20.004434+0000","last_became_active":"2024-09-11T23:15:13.947789+0000","last_became_peered":"2024-09-11T23:15:13.947789+0000","last_unstale":"2024-09-11T23:15:20.004434+0000","last_undegraded":"2024-09-11T23:15:20.004434+0000","last_fullsized":"2024-09-11T23:15:20.004434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003189+0000","last_change":"2024-09-11T23:15:13.960470+0000","last_active":"2024-09-11T23:15:20.003189+0000","last_peered":"2024-09-11T23:15:20.003189+0000","last_clean":"2024-09-11T23:15:20.003189+0000","last_became_active":"2024-09-11T23:15:13.960148+0000","last_became_peered":"2024-09-11T23:15:13.960148+0000","last_unstale":"2024-09-11T23:15:20.003189+0000","last_undegraded":"2024-09-11T23:15:20.003189+0000","last_fullsized":"2024-09-11T23:15:20.003189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004861+0000","last_change":"2024-09-11T23:15:13.992697+0000","last_active":"2024-09-11T23:15:20.004861+0000","last_peered":"2024-09-11T23:15:20.004861+0000","last_clean":"2024-09-11T23:15:20.004861+0000","last_became_active":"2024-09-11T23:15:13.992059+0000","last_became_peered":"2024-09-11T23:15:13.992059+0000","last_unstale":"2024-09-11T23:15:20.004861+0000","last_undegraded":"2024-09-11T23:15:20.004861+0000","last_fullsized":"2024-09-11T23:15:20.004861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255674+0000","last_change":"2024-09-11T23:15:13.985798+0000","last_active":"2024-09-11T23:15:20.255674+0000","last_peered":"2024-09-11T23:15:20.255674+0000","last_clean":"2024-09-11T23:15:20.255674+0000","last_became_active":"2024-09-11T23:15:13.985274+0000","last_became_peered":"2024-09-11T23:15:13.985274+0000","last_unstale":"2024-09-11T23:15:20.255674+0000","last_undegraded":"2024-09-11T23:15:20.255674+0000","last_fullsized":"2024-09-11T23:15:20.255674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253287+0000","last_change":"2024-09-11T23:15:13.973105+0000","last_active":"2024-09-11T23:15:20.253287+0000","last_peered":"2024-09-11T23:15:20.253287+0000","last_clean":"2024-09-11T23:15:20.253287+0000","last_became_active":"2024-09-11T23:15:13.971617+0000","last_became_peered":"2024-09-11T23:15:13.971617+0000","last_unstale":"2024-09-11T23:15:20.253287+0000","last_undegraded":"2024-09-11T23:15:20.253287+0000","last_fullsized":"2024-09-11T23:15:20.253287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256925+0000","last_change":"2024-09-11T23:15:14.002728+0000","last_active":"2024-09-11T23:15:20.256925+0000","last_peered":"2024-09-11T23:15:20.256925+0000","last_clean":"2024-09-11T23:15:20.256925+0000","last_became_active":"2024-09-11T23:15:13.996868+0000","last_became_peered":"2024-09-11T23:15:13.996868+0000","last_unstale":"2024-09-11T23:15:20.256925+0000","last_undegraded":"2024-09-11T23:15:20.256925+0000","last_fullsized":"2024-09-11T23:15:20.256925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252733+0000","last_change":"2024-09-11T23:15:13.973567+0000","last_active":"2024-09-11T23:15:20.252733+0000","last_peered":"2024-09-11T23:15:20.252733+0000","last_clean":"2024-09-11T23:15:20.252733+0000","last_became_active":"2024-09-11T23:15:13.973278+0000","last_became_peered":"2024-09-11T23:15:13.973278+0000","last_unstale":"2024-09-11T23:15:20.252733+0000","last_undegraded":"2024-09-11T23:15:20.252733+0000","last_fullsized":"2024-09-11T23:15:20.252733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:57.828596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006578+0000","last_change":"2024-09-11T23:15:13.999226+0000","last_active":"2024-09-11T23:15:20.006578+0000","last_peered":"2024-09-11T23:15:20.006578+0000","last_clean":"2024-09-11T23:15:20.006578+0000","last_became_active":"2024-09-11T23:15:13.998747+0000","last_became_peered":"2024-09-11T23:15:13.998747+0000","last_unstale":"2024-09-11T23:15:20.006578+0000","last_undegraded":"2024-09-11T23:15:20.006578+0000","last_fullsized":"2024-09-11T23:15:20.006578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004397+0000","last_change":"2024-09-11T23:15:13.945820+0000","last_active":"2024-09-11T23:15:20.004397+0000","last_peered":"2024-09-11T23:15:20.004397+0000","last_clean":"2024-09-11T23:15:20.004397+0000","last_became_active":"2024-09-11T23:15:13.945048+0000","last_became_peered":"2024-09-11T23:15:13.945048+0000","last_unstale":"2024-09-11T23:15:20.004397+0000","last_undegraded":"2024-09-11T23:15:20.004397+0000","last_fullsized":"2024-09-11T23:15:20.004397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251134+0000","last_change":"2024-09-11T23:15:13.950766+0000","last_active":"2024-09-11T23:15:20.251134+0000","last_peered":"2024-09-11T23:15:20.251134+0000","last_clean":"2024-09-11T23:15:20.251134+0000","last_became_active":"2024-09-11T23:15:13.950395+0000","last_became_peered":"2024-09-11T23:15:13.950395+0000","last_unstale":"2024-09-11T23:15:20.251134+0000","last_undegraded":"2024-09-11T23:15:20.251134+0000","last_fullsized":"2024-09-11T23:15:20.251134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255485+0000","last_change":"2024-09-11T23:15:13.942113+0000","last_active":"2024-09-11T23:15:20.255485+0000","last_peered":"2024-09-11T23:15:20.255485+0000","last_clean":"2024-09-11T23:15:20.255485+0000","last_became_active":"2024-09-11T23:15:13.941820+0000","last_became_peered":"2024-09-11T23:15:13.941820+0000","last_unstale":"2024-09-11T23:15:20.255485+0000","last_undegraded":"2024-09-11T23:15:20.255485+0000","last_fullsized":"2024-09-11T23:15:20.255485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:47.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002696+0000","last_change":"2024-09-11T23:15:13.990426+0000","last_active":"2024-09-11T23:15:20.002696+0000","last_peered":"2024-09-11T23:15:20.002696+0000","last_clean":"2024-09-11T23:15:20.002696+0000","last_became_active":"2024-09-11T23:15:13.990122+0000","last_became_peered":"2024-09-11T23:15:13.990122+0000","last_unstale":"2024-09-11T23:15:20.002696+0000","last_undegraded":"2024-09-11T23:15:20.002696+0000","last_fullsized":"2024-09-11T23:15:20.002696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011130+0000","last_change":"2024-09-11T23:15:13.976923+0000","last_active":"2024-09-11T23:15:20.011130+0000","last_peered":"2024-09-11T23:15:20.011130+0000","last_clean":"2024-09-11T23:15:20.011130+0000","last_became_active":"2024-09-11T23:15:13.976002+0000","last_became_peered":"2024-09-11T23:15:13.976002+0000","last_unstale":"2024-09-11T23:15:20.011130+0000","last_undegraded":"2024-09-11T23:15:20.011130+0000","last_fullsized":"2024-09-11T23:15:20.011130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.533481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253836+0000","last_change":"2024-09-11T23:15:13.988201+0000","last_active":"2024-09-11T23:15:20.253836+0000","last_peered":"2024-09-11T23:15:20.253836+0000","last_clean":"2024-09-11T23:15:20.253836+0000","last_became_active":"2024-09-11T23:15:13.987512+0000","last_became_peered":"2024-09-11T23:15:13.987512+0000","last_unstale":"2024-09-11T23:15:20.253836+0000","last_undegraded":"2024-09-11T23:15:20.253836+0000","last_fullsized":"2024-09-11T23:15:20.253836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254368+0000","last_change":"2024-09-11T23:15:13.988153+0000","last_active":"2024-09-11T23:15:20.254368+0000","last_peered":"2024-09-11T23:15:20.254368+0000","last_clean":"2024-09-11T23:15:20.254368+0000","last_became_active":"2024-09-11T23:15:13.987443+0000","last_became_peered":"2024-09-11T23:15:13.987443+0000","last_unstale":"2024-09-11T23:15:20.254368+0000","last_undegraded":"2024-09-11T23:15:20.254368+0000","last_fullsized":"2024-09-11T23:15:20.254368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257588+0000","last_change":"2024-09-11T23:15:14.002600+0000","last_active":"2024-09-11T23:15:20.257588+0000","last_peered":"2024-09-11T23:15:20.257588+0000","last_clean":"2024-09-11T23:15:20.257588+0000","last_became_active":"2024-09-11T23:15:13.997780+0000","last_became_peered":"2024-09-11T23:15:13.997780+0000","last_unstale":"2024-09-11T23:15:20.257588+0000","last_undegraded":"2024-09-11T23:15:20.257588+0000","last_fullsized":"2024-09-11T23:15:20.257588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002356+0000","last_change":"2024-09-11T23:15:13.978838+0000","last_active":"2024-09-11T23:15:20.002356+0000","last_peered":"2024-09-11T23:15:20.002356+0000","last_clean":"2024-09-11T23:15:20.002356+0000","last_became_active":"2024-09-11T23:15:13.978620+0000","last_became_peered":"2024-09-11T23:15:13.978620+0000","last_unstale":"2024-09-11T23:15:20.002356+0000","last_undegraded":"2024-09-11T23:15:20.002356+0000","last_fullsized":"2024-09-11T23:15:20.002356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254587+0000","last_change":"2024-09-11T23:15:13.993756+0000","last_active":"2024-09-11T23:15:20.254587+0000","last_peered":"2024-09-11T23:15:20.254587+0000","last_clean":"2024-09-11T23:15:20.254587+0000","last_became_active":"2024-09-11T23:15:13.991750+0000","last_became_peered":"2024-09-11T23:15:13.991750+0000","last_unstale":"2024-09-11T23:15:20.254587+0000","last_undegraded":"2024-09-11T23:15:20.254587+0000","last_fullsized":"2024-09-11T23:15:20.254587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004833+0000","last_change":"2024-09-11T23:15:13.980773+0000","last_active":"2024-09-11T23:15:20.004833+0000","last_peered":"2024-09-11T23:15:20.004833+0000","last_clean":"2024-09-11T23:15:20.004833+0000","last_became_active":"2024-09-11T23:15:13.980059+0000","last_became_peered":"2024-09-11T23:15:13.980059+0000","last_unstale":"2024-09-11T23:15:20.004833+0000","last_undegraded":"2024-09-11T23:15:20.004833+0000","last_fullsized":"2024-09-11T23:15:20.004833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254373+0000","last_change":"2024-09-11T23:15:14.002575+0000","last_active":"2024-09-11T23:15:20.254373+0000","last_peered":"2024-09-11T23:15:20.254373+0000","last_clean":"2024-09-11T23:15:20.254373+0000","last_became_active":"2024-09-11T23:15:13.997366+0000","last_became_peered":"2024-09-11T23:15:13.997366+0000","last_unstale":"2024-09-11T23:15:20.254373+0000","last_undegraded":"2024-09-11T23:15:20.254373+0000","last_fullsized":"2024-09-11T23:15:20.254373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004969+0000","last_change":"2024-09-11T23:15:13.964938+0000","last_active":"2024-09-11T23:15:20.004969+0000","last_peered":"2024-09-11T23:15:20.004969+0000","last_clean":"2024-09-11T23:15:20.004969+0000","last_became_active":"2024-09-11T23:15:13.952177+0000","last_became_peered":"2024-09-11T23:15:13.952177+0000","last_unstale":"2024-09-11T23:15:20.004969+0000","last_undegraded":"2024-09-11T23:15:20.004969+0000","last_fullsized":"2024-09-11T23:15:20.004969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256139+0000","last_change":"2024-09-11T23:15:13.944554+0000","last_active":"2024-09-11T23:15:20.256139+0000","last_peered":"2024-09-11T23:15:20.256139+0000","last_clean":"2024-09-11T23:15:20.256139+0000","last_became_active":"2024-09-11T23:15:13.944174+0000","last_became_peered":"2024-09-11T23:15:13.944174+0000","last_unstale":"2024-09-11T23:15:20.256139+0000","last_undegraded":"2024-09-11T23:15:20.256139+0000","last_fullsized":"2024-09-11T23:15:20.256139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253250+0000","last_change":"2024-09-11T23:15:13.941668+0000","last_active":"2024-09-11T23:15:20.253250+0000","last_peered":"2024-09-11T23:15:20.253250+0000","last_clean":"2024-09-11T23:15:20.253250+0000","last_became_active":"2024-09-11T23:15:13.941362+0000","last_became_peered":"2024-09-11T23:15:13.941362+0000","last_unstale":"2024-09-11T23:15:20.253250+0000","last_undegraded":"2024-09-11T23:15:20.253250+0000","last_fullsized":"2024-09-11T23:15:20.253250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257415+0000","last_change":"2024-09-11T23:15:14.003307+0000","last_active":"2024-09-11T23:15:20.257415+0000","last_peered":"2024-09-11T23:15:20.257415+0000","last_clean":"2024-09-11T23:15:20.257415+0000","last_became_active":"2024-09-11T23:15:13.998994+0000","last_became_peered":"2024-09-11T23:15:13.998994+0000","last_unstale":"2024-09-11T23:15:20.257415+0000","last_undegraded":"2024-09-11T23:15:20.257415+0000","last_fullsized":"2024-09-11T23:15:20.257415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:15:35.458 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:15:35.458 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T23:15:35.459 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T23:15:35.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T23:15:35.459 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T23:15:35.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.600+0000 7fb7e44af640 1 Processor -- start 2024-09-11T23:15:35.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.600+0000 7fb7e44af640 1 -- start start 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.600+0000 7fb7e44af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc15d090 0x7fb7dc0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.600+0000 7fb7e44af640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7dc0b37c0 0x7fb7dc15fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.600+0000 7fb7e44af640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc1533f0 con 0x7fb7dc153010 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.600+0000 7fb7e44af640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb7dc0b3c30 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.600+0000 7fb7e44af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc15d4e0 con 0x7fb7dc15d090 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7dc0b37c0 0x7fb7dc15fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7dc0b37c0 0x7fb7dc15fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40446/0 (socket says 172.21.15.94:40446) 2024-09-11T23:15:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 -- 172.21.15.94:0/765672558 learned_addr learned my addr 172.21.15.94:0/765672558 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:35.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 -- 172.21.15.94:0/765672558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc15d090 msgr2=0x7fb7dc0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e1a4a640 1 --2- 172.21.15.94:0/765672558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc15d090 0x7fb7dc0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 --2- 172.21.15.94:0/765672558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc15d090 0x7fb7dc0b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 -- 172.21.15.94:0/765672558 >> v1:172.21.15.155:6789/0 conn(0x7fb7dc153010 legacy=0x7fb7dc072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 -- 172.21.15.94:0/765672558 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc073850 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e2a4c640 1 --2- 172.21.15.94:0/765672558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc15fb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009e50 tx=0x7fb7d401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45afe3c52667776 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e1249640 1 -- 172.21.15.94:0/765672558 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5580 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e1249640 1 -- 172.21.15.94:0/765672558 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d40a5720 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e1249640 1 -- 172.21.15.94:0/765672558 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5af0 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 -- 172.21.15.94:0/765672558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 msgr2=0x7fb7dc15fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 --2- 172.21.15.94:0/765672558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc15fb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009e50 tx=0x7fb7d401c810 comp rx=0 tx=0).stop 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 -- 172.21.15.94:0/765672558 shutdown_connections 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 --2- 172.21.15.94:0/765672558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc15fb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 --2- 172.21.15.94:0/765672558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc15d090 0x7fb7dc0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 -- 172.21.15.94:0/765672558 >> 172.21.15.94:0/765672558 conn(0x7fb7dc0b6870 msgr2=0x7fb7dc0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 -- 172.21.15.94:0/765672558 shutdown_connections 2024-09-11T23:15:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.604+0000 7fb7e44af640 1 -- 172.21.15.94:0/765672558 wait complete. 2024-09-11T23:15:35.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 Processor -- start 2024-09-11T23:15:35.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 -- start start 2024-09-11T23:15:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc153010 0x7fb7dc1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7dc15d090 0x7fb7dc148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc06fe00 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc15c540 con 0x7fb7dc15d090 2024-09-11T23:15:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc0734e0 con 0x7fb7dc153010 2024-09-11T23:15:35.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc14ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40454/0 (socket says 172.21.15.94:40454) 2024-09-11T23:15:35.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 -- 172.21.15.94:0/2373954394 learned_addr learned my addr 172.21.15.94:0/2373954394 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:35.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e1a4a640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc153010 0x7fb7dc1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e2a4c640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7dc15d090 0x7fb7dc148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 -- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc153010 msgr2=0x7fb7dc1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc153010 0x7fb7dc1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 -- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7dc15d090 msgr2=0x7fb7dc148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7dc15d090 0x7fb7dc148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 -- 172.21.15.94:0/2373954394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc148ed0 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e1a4a640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc153010 0x7fb7dc1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:35.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e224b640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc14ab70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c480 tx=0x7fb7d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/2373954394 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8012830 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/2373954394 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d8017070 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc165960 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/2373954394 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8012c30 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc14ba20 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.608+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc15fb30 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.612+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/2373954394 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7d801c460 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.612+0000 7fb7d2ffd640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7c00678f0 0x7fb7c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.612+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/2373954394 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7d8085cf0 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.612+0000 7fb7e1a4a640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7c00678f0 0x7fb7c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.612+0000 7fb7e1a4a640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7c00678f0 0x7fb7c0069db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc006fd0 tx=0x7fb7cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.616+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/2373954394 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7d808a070 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.804+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb7dc072e70 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/2373954394 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166894 (secure 0 0 0) 0x7fb7d8056580 con 0x7fb7dc0b37c0 2024-09-11T23:15:35.815 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7c00678f0 msgr2=0x7fb7c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7e44af640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7c00678f0 0x7fb7c0069db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc006fd0 tx=0x7fb7cc008040 comp rx=0 tx=0).stop 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 msgr2=0x7fb7dc14ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7e44af640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc14ab70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c480 tx=0x7fb7d800c940 comp rx=0 tx=0).stop 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 shutdown_connections 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7e44af640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7dc15d090 0x7fb7dc148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.812+0000 7fb7e44af640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7dc153010 0x7fb7dc1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.816+0000 7fb7e44af640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7c00678f0 0x7fb7c0069db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.816+0000 7fb7e44af640 1 --2- 172.21.15.94:0/2373954394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc0b37c0 0x7fb7dc14ab70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.816+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 >> 172.21.15.94:0/2373954394 conn(0x7fb7dc0b6870 msgr2=0x7fb7dc06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.816+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 shutdown_connections 2024-09-11T23:15:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.816+0000 7fb7e44af640 1 -- 172.21.15.94:0/2373954394 wait complete. 2024-09-11T23:15:35.832 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2054672037},{"type":"v1","addr":"172.21.15.155:6833","nonce":2054672037}]},"active_addr":"172.21.15.155:6833/2054672037","active_change":"2024-09-11T23:14:53.947847+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3951513854}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2850078748}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2096341109}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1795057964}]}]} 2024-09-11T23:15:35.838 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T23:15:35.838 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T23:15:35.838 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:35.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a9727640 1 Processor -- start 2024-09-11T23:15:35.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a9727640 1 -- start start 2024-09-11T23:15:35.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a9727640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a9727640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f13a415c2a0 0x7f13a40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a9727640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13a40b3290 con 0x7f13a40af2a0 2024-09-11T23:15:35.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a9727640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f13a40b3570 con 0x7f13a415c2a0 2024-09-11T23:15:35.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a9727640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13a40b3850 con 0x7f13a415bec0 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f13a415c2a0 0x7f13a40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f13a415c2a0 0x7f13a40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40456/0 (socket says 172.21.15.94:40456) 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 -- 172.21.15.94:0/322345931 learned_addr learned my addr 172.21.15.94:0/322345931 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a2ffd640 1 --2- 172.21.15.94:0/322345931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 -- 172.21.15.94:0/322345931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 msgr2=0x7f13a40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 --2- 172.21.15.94:0/322345931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a40ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 -- 172.21.15.94:0/322345931 >> v1:172.21.15.94:6789/0 conn(0x7f13a40af2a0 legacy=0x7f13a415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:35.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 -- 172.21.15.94:0/322345931 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a40b3b30 con 0x7f13a415c2a0 2024-09-11T23:15:35.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.952+0000 7f13a27fc640 1 --2- 172.21.15.94:0/322345931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a415c2a0 0x7f13a40aed60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f138c009870 tx=0x7f138c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410874d8203d97be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a1ffb640 1 -- 172.21.15.94:0/322345931 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0aa610 con 0x7f13a415c2a0 2024-09-11T23:15:35.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a1ffb640 1 -- 172.21.15.94:0/322345931 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138c0af070 con 0x7f13a415c2a0 2024-09-11T23:15:35.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a1ffb640 1 -- 172.21.15.94:0/322345931 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0aa9d0 con 0x7f13a415c2a0 2024-09-11T23:15:35.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- 172.21.15.94:0/322345931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a415c2a0 msgr2=0x7f13a40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 --2- 172.21.15.94:0/322345931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a415c2a0 0x7f13a40aed60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f138c009870 tx=0x7f138c01c4f0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- 172.21.15.94:0/322345931 shutdown_connections 2024-09-11T23:15:35.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 --2- 172.21.15.94:0/322345931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a415c2a0 0x7f13a40aed60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 --2- 172.21.15.94:0/322345931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- 172.21.15.94:0/322345931 >> 172.21.15.94:0/322345931 conn(0x7f13a40b1f90 msgr2=0x7f13a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:35.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- 172.21.15.94:0/322345931 shutdown_connections 2024-09-11T23:15:35.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- 172.21.15.94:0/322345931 wait complete. 2024-09-11T23:15:35.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 Processor -- start 2024-09-11T23:15:35.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- start start 2024-09-11T23:15:35.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a40af2a0 0x7f13a4152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a415c2a0 0x7f13a4157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f13a40ad740 con 0x7f13a40af2a0 2024-09-11T23:15:35.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13a40afc90 con 0x7f13a415c2a0 2024-09-11T23:15:35.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13a4169000 con 0x7f13a415bec0 2024-09-11T23:15:35.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a40af2a0 0x7f13a4152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a40af2a0 0x7f13a4152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40470/0 (socket says 172.21.15.94:40470) 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 -- 172.21.15.94:0/491008751 learned_addr learned my addr 172.21.15.94:0/491008751 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a27fc640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a37fe640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a415c2a0 0x7f13a4157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 -- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 msgr2=0x7f13a41508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a41508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 -- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a415c2a0 msgr2=0x7f13a4157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a415c2a0 0x7f13a4157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 -- 172.21.15.94:0/491008751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a4155a30 con 0x7f13a40af2a0 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a27fc640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a2ffd640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a40af2a0 0x7f13a4152230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f139400c820 tx=0x7f139400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f139b7fe640 1 -- 172.21.15.94:0/491008751 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394015070 con 0x7f13a40af2a0 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f139b7fe640 1 -- 172.21.15.94:0/491008751 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1394004240 con 0x7f13a40af2a0 2024-09-11T23:15:35.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f139b7fe640 1 -- 172.21.15.94:0/491008751 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139400ce10 con 0x7f13a40af2a0 2024-09-11T23:15:35.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a41528c0 con 0x7f13a40af2a0 2024-09-11T23:15:35.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.956+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a4152e80 con 0x7f13a40af2a0 2024-09-11T23:15:35.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.960+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a40ad200 con 0x7f13a40af2a0 2024-09-11T23:15:35.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.960+0000 7f139b7fe640 1 -- 172.21.15.94:0/491008751 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1394007830 con 0x7f13a40af2a0 2024-09-11T23:15:35.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.960+0000 7f139b7fe640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13840678c0 0x7f1384069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:35.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.960+0000 7f139b7fe640 1 -- 172.21.15.94:0/491008751 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1394085dc0 con 0x7f13a40af2a0 2024-09-11T23:15:35.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.960+0000 7f13a27fc640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13840678c0 0x7f1384069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:35.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.960+0000 7f13a27fc640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13840678c0 0x7f1384069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ae000 tx=0x7f138c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:35.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:35.964+0000 7f139b7fe640 1 -- 172.21.15.94:0/491008751 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1394056650 con 0x7f13a40af2a0 2024-09-11T23:15:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.116+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13a406fcd0 con 0x7f13a40af2a0 2024-09-11T23:15:36.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f139b7fe640 1 -- 172.21.15.94:0/491008751 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f1394055f50 con 0x7f13a40af2a0 2024-09-11T23:15:36.121 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:36.121 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":25,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:19.997149+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13840678c0 msgr2=0x7f1384069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13840678c0 0x7f1384069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ae000 tx=0x7f138c0a7000 comp rx=0 tx=0).stop 2024-09-11T23:15:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a40af2a0 msgr2=0x7f13a4152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a40af2a0 0x7f13a4152230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f139400c820 tx=0x7f139400cce0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 shutdown_connections 2024-09-11T23:15:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a415c2a0 0x7f13a4157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a415bec0 0x7f13a41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13840678c0 0x7f1384069d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 --2- 172.21.15.94:0/491008751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13a40af2a0 0x7f13a4152230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 >> 172.21.15.94:0/491008751 conn(0x7f13a40b1f90 msgr2=0x7f13a415acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 shutdown_connections 2024-09-11T23:15:36.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.120+0000 7f13a9727640 1 -- 172.21.15.94:0/491008751 wait complete. 2024-09-11T23:15:36.139 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T23:15:36.139 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:36.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.252+0000 7fcda8b01640 1 Processor -- start 2024-09-11T23:15:36.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.252+0000 7fcda8b01640 1 -- start start 2024-09-11T23:15:36.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda8b01640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcda41587a0 0x7fcda40b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda8b01640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda40b37d0 0x7fcda406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda8b01640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda406ec60 con 0x7fcda406e4b0 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda8b01640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcda406f870 con 0x7fcda41587a0 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda8b01640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcda40b3c10 con 0x7fcda40b37d0 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcda41587a0 0x7fcda40b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda2d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcda406e4b0 0x7fcda4161e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36354/0 (socket says 172.21.15.94:36354) 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda2d9d640 1 -- 172.21.15.94:0/940924418 learned_addr learned my addr 172.21.15.94:0/940924418 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda1d9b640 1 --2- 172.21.15.94:0/940924418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda40b37d0 0x7fcda406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda259c640 1 -- 172.21.15.94:0/940924418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda40b37d0 msgr2=0x7fcda406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda259c640 1 --2- 172.21.15.94:0/940924418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda40b37d0 0x7fcda406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda259c640 1 -- 172.21.15.94:0/940924418 >> v1:172.21.15.94:6789/0 conn(0x7fcda406e4b0 legacy=0x7fcda4161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda259c640 1 -- 172.21.15.94:0/940924418 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda406ef40 con 0x7fcda41587a0 2024-09-11T23:15:36.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda259c640 1 --2- 172.21.15.94:0/940924418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda41587a0 0x7fcda40b3290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097c0 tx=0x7fcd8c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d95542e973ed2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda159a640 1 -- 172.21.15.94:0/940924418 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0b2070 con 0x7fcda41587a0 2024-09-11T23:15:36.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda159a640 1 -- 172.21.15.94:0/940924418 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0ad640 con 0x7fcda41587a0 2024-09-11T23:15:36.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.256+0000 7fcda159a640 1 -- 172.21.15.94:0/940924418 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ada10 con 0x7fcda41587a0 2024-09-11T23:15:36.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- 172.21.15.94:0/940924418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda41587a0 msgr2=0x7fcda40b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 --2- 172.21.15.94:0/940924418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda41587a0 0x7fcda40b3290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097c0 tx=0x7fcd8c01c470 comp rx=0 tx=0).stop 2024-09-11T23:15:36.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- 172.21.15.94:0/940924418 shutdown_connections 2024-09-11T23:15:36.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 --2- 172.21.15.94:0/940924418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda40b37d0 0x7fcda406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 --2- 172.21.15.94:0/940924418 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda41587a0 0x7fcda40b3290 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- 172.21.15.94:0/940924418 >> 172.21.15.94:0/940924418 conn(0x7fcda40b1f90 msgr2=0x7fcda40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- 172.21.15.94:0/940924418 shutdown_connections 2024-09-11T23:15:36.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- 172.21.15.94:0/940924418 wait complete. 2024-09-11T23:15:36.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 Processor -- start 2024-09-11T23:15:36.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- start start 2024-09-11T23:15:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda406e4b0 0x7fcda4161880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda40b37d0 0x7fcda4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda41587a0 0x7fcda4154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcda4158b80 con 0x7fcda40b37d0 2024-09-11T23:15:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcda4073170 con 0x7fcda406e4b0 2024-09-11T23:15:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcda415f120 con 0x7fcda41587a0 2024-09-11T23:15:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda40b37d0 0x7fcda4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda40b37d0 0x7fcda4154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40488/0 (socket says 172.21.15.94:40488) 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 -- 172.21.15.94:0/480212182 learned_addr learned my addr 172.21.15.94:0/480212182 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda2d9d640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda41587a0 0x7fcda4154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda259c640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda406e4b0 0x7fcda4161880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 -- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda41587a0 msgr2=0x7fcda4154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda41587a0 0x7fcda4154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 -- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda406e4b0 msgr2=0x7fcda4161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda406e4b0 0x7fcda4161880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 -- 172.21.15.94:0/480212182 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda40ad580 con 0x7fcda40b37d0 2024-09-11T23:15:36.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda1d9b640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda40b37d0 0x7fcda4154680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c007f20 tx=0x7fcd9c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcd9affd640 1 -- 172.21.15.94:0/480212182 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c014620 con 0x7fcda40b37d0 2024-09-11T23:15:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcd9affd640 1 -- 172.21.15.94:0/480212182 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9c019070 con 0x7fcda40b37d0 2024-09-11T23:15:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda41422f0 con 0x7fcda40b37d0 2024-09-11T23:15:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcd9affd640 1 -- 172.21.15.94:0/480212182 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c014a00 con 0x7fcda40b37d0 2024-09-11T23:15:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.260+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda4161360 con 0x7fcda40b37d0 2024-09-11T23:15:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.264+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda4142110 con 0x7fcda40b37d0 2024-09-11T23:15:36.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.264+0000 7fcd9affd640 1 -- 172.21.15.94:0/480212182 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd9c014ba0 con 0x7fcda40b37d0 2024-09-11T23:15:36.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.264+0000 7fcd9affd640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcd840678c0 0x7fcd84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.264+0000 7fcd9affd640 1 -- 172.21.15.94:0/480212182 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcd9c086a00 con 0x7fcda40b37d0 2024-09-11T23:15:36.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.264+0000 7fcda259c640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcd840678c0 0x7fcd84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.264+0000 7fcda259c640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcd840678c0 0x7fcd84069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0af000 tx=0x7fcd8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.268+0000 7fcd9affd640 1 -- 172.21.15.94:0/480212182 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcda4142110 con 0x7fcda40b37d0 2024-09-11T23:15:36.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.436+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcda4070080 con 0x7fcda40b37d0 2024-09-11T23:15:36.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.436+0000 7fcd9affd640 1 -- 172.21.15.94:0/480212182 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fcd9c057160 con 0x7fcda40b37d0 2024-09-11T23:15:36.440 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:36.440 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":25,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:19.997149+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:36.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcd840678c0 msgr2=0x7fcd84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcd840678c0 0x7fcd84069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0af000 tx=0x7fcd8c008040 comp rx=0 tx=0).stop 2024-09-11T23:15:36.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda40b37d0 msgr2=0x7fcda4154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda40b37d0 0x7fcda4154680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c007f20 tx=0x7fcd9c00e570 comp rx=0 tx=0).stop 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 shutdown_connections 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda41587a0 0x7fcda4154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcd840678c0 0x7fcd84069d80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcda40b37d0 0x7fcda4154680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 --2- 172.21.15.94:0/480212182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda406e4b0 0x7fcda4161880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 >> 172.21.15.94:0/480212182 conn(0x7fcda40b1f90 msgr2=0x7fcda40ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 shutdown_connections 2024-09-11T23:15:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.440+0000 7fcda8b01640 1 -- 172.21.15.94:0/480212182 wait complete. 2024-09-11T23:15:36.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T23:15:36.460 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T23:15:36.460 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T23:15:36.461 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T23:15:36.461 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T23:15:36.461 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T23:15:36.462 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T23:15:36.462 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T23:15:36.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f7fff640 1 Processor -- start 2024-09-11T23:15:36.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e855cb640 1 Processor -- start 2024-09-11T23:15:36.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f7fff640 1 -- start start 2024-09-11T23:15:36.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 Processor -- start 2024-09-11T23:15:36.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 -- start start 2024-09-11T23:15:36.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8145a00 0x7fc3f8072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc3f8073000 0x7fc3f80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f7fff640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f8073540 con 0x7fc3f80b5740 2024-09-11T23:15:36.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f7fff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f80b5b70 con 0x7fc3f8073000 2024-09-11T23:15:36.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f7fff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f8073820 con 0x7fc3f8145a00 2024-09-11T23:15:36.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e855cb640 1 -- start start 2024-09-11T23:15:36.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e855cb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e800d1c30 0x7f9e80166ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e855cb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8013f360 con 0x7f9e801417c0 2024-09-11T23:15:36.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e855cb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8015c870 con 0x7f9e8013ef80 2024-09-11T23:15:36.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e855cb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9e80142570 con 0x7f9e800d1c30 2024-09-11T23:15:36.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e77fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9e801417c0 0x7f9e800d20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36364/0 (socket says 172.21.15.94:36364) 2024-09-11T23:15:36.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e77fff640 1 -- 172.21.15.94:0/2689947029 learned_addr learned my addr 172.21.15.94:0/2689947029 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f67fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc3f8073000 0x7fc3f80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f67fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc3f8073000 0x7fc3f80b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40490/0 (socket says 172.21.15.94:40490) 2024-09-11T23:15:36.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f67fc640 1 -- 172.21.15.94:0/1049440518 learned_addr learned my addr 172.21.15.94:0/1049440518 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e7f7fe640 1 --2- 172.21.15.94:0/2689947029 >> v2:172.21.15.94:3300/0 conn(0x7f9e800d1c30 0x7f9e80166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c40deb70 0x7f63c4006d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63c400a380 0x7f63c400a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63c4005a70 0x7f63c4005f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f67fc640 1 -- 172.21.15.94:0/1049440518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8145a00 msgr2=0x7fc3f8072ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T23:15:36.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f67fc640 1 --2- 172.21.15.94:0/1049440518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8145a00 0x7fc3f8072ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f67fc640 1 -- 172.21.15.94:0/1049440518 >> v1:172.21.15.155:6789/0 conn(0x7fc3f80b5740 legacy=0x7fc3f80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7fc3f67fc640 1 -- 172.21.15.94:0/1049440518 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f815c7c0 con 0x7fc3f8073000 2024-09-11T23:15:36.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e7f7fe640 1 -- 172.21.15.94:0/2689947029 >> v1:172.21.15.155:6789/0 conn(0x7f9e8013ef80 legacy=0x7f9e80141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e7f7fe640 1 -- 172.21.15.94:0/2689947029 >> v1:172.21.15.94:6789/0 conn(0x7f9e801417c0 legacy=0x7f9e800d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f9e7f7fe640 1 -- 172.21.15.94:0/2689947029 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8015cb50 con 0x7f9e800d1c30 2024-09-11T23:15:36.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f63c401c530 con 0x7f63c4005a70 2024-09-11T23:15:36.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f63c400ace0 con 0x7f63c400a380 2024-09-11T23:15:36.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63c4005a70 0x7f63c4005f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63c4005a70 0x7f63c4005f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40502/0 (socket says 172.21.15.94:40502) 2024-09-11T23:15:36.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 -- 172.21.15.94:0/322557808 learned_addr learned my addr 172.21.15.94:0/322557808 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d0e4e640 1 --2- 172.21.15.94:0/322557808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c40deb70 0x7f63c4006d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d1e50640 1 -- 172.21.15.94:0/322557808 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63c4050210 con 0x7f63c40deb70 2024-09-11T23:15:36.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63cbfff640 1 --2- 172.21.15.94:0/322557808 >> v2:172.21.15.155:3300/0 conn(0x7f63c400a380 0x7f63c400a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f4e0888a640 1 Processor -- start 2024-09-11T23:15:36.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f4e0888a640 1 -- start start 2024-09-11T23:15:36.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f547655f640 1 Processor -- start 2024-09-11T23:15:36.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64aeaac640 1 Processor -- start 2024-09-11T23:15:36.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0888a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4dfc00bc00 0x7f4dfc0de940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0888a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dfc050520 con 0x7f4dfc006d50 2024-09-11T23:15:36.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0888a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dfc050800 con 0x7f4dfc00aac0 2024-09-11T23:15:36.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0888a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4dfc01c560 con 0x7f4dfc00bc00 2024-09-11T23:15:36.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 -- 172.21.15.94:0/322557808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c40deb70 msgr2=0x7f63c4006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 --2- 172.21.15.94:0/322557808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c40deb70 0x7f63c4006d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 -- 172.21.15.94:0/322557808 >> v2:172.21.15.155:3300/0 conn(0x7f63c400a380 msgr2=0x7f63c400a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 --2- 172.21.15.94:0/322557808 >> v2:172.21.15.155:3300/0 conn(0x7f63c400a380 0x7f63c400a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f63d164f640 1 -- 172.21.15.94:0/322557808 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c40504f0 con 0x7f63c4005a70 2024-09-11T23:15:36.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64aeaac640 1 -- start start 2024-09-11T23:15:36.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b59e83640 1 Processor -- start 2024-09-11T23:15:36.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b59e83640 1 -- start start 2024-09-11T23:15:36.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.636+0000 7f547655f640 1 -- start start 2024-09-11T23:15:36.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f547655f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701627a0 0x7f54700b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f547655f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54700b3c20 con 0x7f547006e2a0 2024-09-11T23:15:36.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f547655f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54700b3f00 con 0x7f54701623c0 2024-09-11T23:15:36.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f547655f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5470071f40 con 0x7f54701627a0 2024-09-11T23:15:36.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e02d9d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4dfc00aac0 0x7f4dfc01ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:41580/0 (socket says 172.21.15.94:41580) 2024-09-11T23:15:36.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e02d9d640 1 -- 172.21.15.94:0/496705843 learned_addr learned my addr 172.21.15.94:0/496705843 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0259c640 1 --2- 172.21.15.94:0/496705843 >> v2:172.21.15.155:3300/0 conn(0x7f4dfc00bc00 0x7f4dfc0de940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701627a0 0x7f54700b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701627a0 0x7f54700b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:38528/0 (socket says 172.21.15.94:38528) 2024-09-11T23:15:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546f7fe640 1 -- 172.21.15.94:0/773437399 learned_addr learned my addr 172.21.15.94:0/773437399 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7fd50dcab640 1 Processor -- start 2024-09-11T23:15:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7fd50dcab640 1 -- start start 2024-09-11T23:15:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d164f640 1 --2- 172.21.15.94:0/322557808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c4005a70 0x7f63c4005f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0652f0 tx=0x7f63cc09f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cf8637f7aeec4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f9e7f7fe640 1 --2- 172.21.15.94:0/2689947029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 0x7f9e80166ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009d90 tx=0x7f9e7801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848fb3ff5aa7d83a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64aeaac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80b4cb0 0x7f64a80b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64aeaac640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a80b3990 con 0x7f64a8072310 2024-09-11T23:15:36.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64aeaac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a80b3c70 con 0x7f64a81633f0 2024-09-11T23:15:36.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64aeaac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64a8071ba0 con 0x7f64a80b4cb0 2024-09-11T23:15:36.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546effd640 1 -- 172.21.15.94:0/773437399 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398026390 0 0) 0x7f54700b3f00 con 0x7f54701623c0 2024-09-11T23:15:36.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546effd640 1 -- 172.21.15.94:0/773437399 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5458003530 con 0x7f54701623c0 2024-09-11T23:15:36.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0159a640 1 -- 172.21.15.94:0/496705843 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619021817 0 0) 0x7f4dfc050520 con 0x7f4dfc006d50 2024-09-11T23:15:36.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0159a640 1 -- 172.21.15.94:0/496705843 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dec003530 con 0x7f4dfc006d50 2024-09-11T23:15:36.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64ae2ab640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f64a8072310 0x7f64a8072780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36386/0 (socket says 172.21.15.94:36386) 2024-09-11T23:15:36.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64ae2ab640 1 -- 172.21.15.94:0/1362867645 learned_addr learned my addr 172.21.15.94:0/1362867645 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b59e83640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b4c0e00c0 0x7f1b4c007a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b59e83640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c0069b0 con 0x7f1b4c036110 2024-09-11T23:15:36.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b59e83640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c006c90 con 0x7f1b4c03a290 2024-09-11T23:15:36.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b59e83640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c007f90 con 0x7f1b4c0e00c0 2024-09-11T23:15:36.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64ad2a9640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80b4cb0 0x7f64a80b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b58e81640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b4c0e00c0 0x7f1b4c007a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b58e81640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b4c0e00c0 0x7f1b4c007a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40510/0 (socket says 172.21.15.94:40510) 2024-09-11T23:15:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b58e81640 1 -- 172.21.15.94:0/4102562073 learned_addr learned my addr 172.21.15.94:0/4102562073 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0159a640 1 -- 172.21.15.94:0/496705843 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14781258 0 0) 0x7f4dfc050800 con 0x7f4dfc00aac0 2024-09-11T23:15:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0159a640 1 -- 172.21.15.94:0/496705843 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dfc050520 con 0x7f4dfc00aac0 2024-09-11T23:15:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63cb7fe640 1 -- 172.21.15.94:0/322557808 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc072040 con 0x7f63c4005a70 2024-09-11T23:15:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7fc3f67fc640 1 --2- 172.21.15.94:0/1049440518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8073000 0x7fc3f80b5200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009870 tx=0x7fc3ec01c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcd3f07b897bfc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f9e7e7fc640 1 -- 172.21.15.94:0/2689947029 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780b2070 con 0x7f9e800d1c30 2024-09-11T23:15:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f9e7e7fc640 1 -- 172.21.15.94:0/2689947029 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e780a59a0 con 0x7f9e800d1c30 2024-09-11T23:15:36.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f9e7e7fc640 1 -- 172.21.15.94:0/2689947029 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780a5d70 con 0x7f9e800d1c30 2024-09-11T23:15:36.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886594609 0 0) 0x7f64a80b3990 con 0x7f64a8072310 2024-09-11T23:15:36.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6494003530 con 0x7f64a8072310 2024-09-11T23:15:36.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b58e81640 1 -- 172.21.15.94:0/4102562073 >> v1:172.21.15.155:6789/0 conn(0x7f1b4c03a290 legacy=0x7f1b4c005da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b58e81640 1 -- 172.21.15.94:0/4102562073 >> v1:172.21.15.94:6789/0 conn(0x7f1b4c036110 legacy=0x7f1b4c039b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f1b58e81640 1 -- 172.21.15.94:0/4102562073 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c006f70 con 0x7f1b4c0e00c0 2024-09-11T23:15:36.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935858077 0 0) 0x7f64a80b3c70 con 0x7f64a81633f0 2024-09-11T23:15:36.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64a80b3990 con 0x7f64a81633f0 2024-09-11T23:15:36.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63cb7fe640 1 -- 172.21.15.94:0/322557808 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc06de50 con 0x7f63c4005a70 2024-09-11T23:15:36.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63cb7fe640 1 -- 172.21.15.94:0/322557808 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc12f940 con 0x7f63c4005a70 2024-09-11T23:15:36.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1969371203 0 0) 0x7f6494003530 con 0x7f64a8072310 2024-09-11T23:15:36.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80b4cb0 msgr2=0x7f64a80b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80b4cb0 0x7f64a80b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 >> v1:172.21.15.155:6789/0 conn(0x7f64a81633f0 legacy=0x7f64a80b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a80b3f50 con 0x7f64a8072310 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f64a4001680 con 0x7f64a8072310 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 >> v1:172.21.15.94:6789/0 conn(0x7f64a8072310 legacy=0x7f64a8072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494003b80 0x7f6494003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6494004810 0x7f6494004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6494005220 0x7f649400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8071ba0 con 0x7f6494003b80 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f649400c100 con 0x7f6494004810 2024-09-11T23:15:36.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f649400c300 con 0x7f6494005220 2024-09-11T23:15:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0259c640 1 -- 172.21.15.94:0/496705843 >> v1:172.21.15.155:6789/0 conn(0x7f4dfc00aac0 legacy=0x7f4dfc01ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0259c640 1 -- 172.21.15.94:0/496705843 >> v1:172.21.15.94:6789/0 conn(0x7f4dfc006d50 legacy=0x7f4dfc00a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f4e0259c640 1 -- 172.21.15.94:0/496705843 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc0e5560 con 0x7f4dfc00bc00 2024-09-11T23:15:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d1e50640 1 -- 172.21.15.94:0/322557808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c4005a70 msgr2=0x7f63c4005f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d1e50640 1 --2- 172.21.15.94:0/322557808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c4005a70 0x7f63c4005f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0652f0 tx=0x7f63cc09f2b0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d1e50640 1 -- 172.21.15.94:0/322557808 shutdown_connections 2024-09-11T23:15:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d1e50640 1 --2- 172.21.15.94:0/322557808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c4005a70 0x7f63c4005f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d1e50640 1 --2- 172.21.15.94:0/322557808 >> v2:172.21.15.155:3300/0 conn(0x7f63c400a380 0x7f63c400a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d1e50640 1 --2- 172.21.15.94:0/322557808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c40deb70 0x7f63c4006d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f63d1e50640 1 -- 172.21.15.94:0/322557808 >> 172.21.15.94:0/322557808 conn(0x7f63c40360a0 msgr2=0x7f63c40364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546f7fe640 1 -- 172.21.15.94:0/773437399 >> v1:172.21.15.155:6789/0 conn(0x7f54701623c0 legacy=0x7f547006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546f7fe640 1 -- 172.21.15.94:0/773437399 >> v1:172.21.15.94:6789/0 conn(0x7f547006e2a0 legacy=0x7f54700cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f546f7fe640 1 -- 172.21.15.94:0/773437399 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54700b41e0 con 0x7f54701627a0 2024-09-11T23:15:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7fd50dcab640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd50815a250 0x7fd5080cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64adaaa640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494003b80 0x7f6494003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.640+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6494005220 0x7f649400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- 172.21.15.94:0/2689947029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 msgr2=0x7f9e80166ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 --2- 172.21.15.94:0/2689947029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 0x7f9e80166ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009d90 tx=0x7f9e7801c8e0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd50dcab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5080b5250 0x7fd5080b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 -- 172.21.15.94:0/322557808 shutdown_connections 2024-09-11T23:15:36.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd50cca9640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd508159e70 0x7fd5080b3c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:41612/0 (socket says 172.21.15.94:41612) 2024-09-11T23:15:36.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 -- 172.21.15.94:0/322557808 wait complete. 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64ad2a9640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6494004810 0x7f6494004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- 172.21.15.94:0/2689947029 shutdown_connections 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 --2- 172.21.15.94:0/2689947029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 0x7f9e80166ec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- 172.21.15.94:0/2689947029 >> 172.21.15.94:0/2689947029 conn(0x7f9e8006c0c0 msgr2=0x7f9e8006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd507fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd50815a250 0x7fd5080cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd507fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd50815a250 0x7fd5080cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40534/0 (socket says 172.21.15.94:40534) 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd50cca9640 1 -- 172.21.15.94:0/3319970724 learned_addr learned my addr 172.21.15.94:0/3319970724 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5080cdb30 con 0x7fd508159e70 2024-09-11T23:15:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd5080b5c00 con 0x7fd50815a250 2024-09-11T23:15:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd5080b4320 con 0x7fd5080b5250 2024-09-11T23:15:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f5ffb640 1 -- 172.21.15.94:0/1049440518 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0aa670 con 0x7fc3f8073000 2024-09-11T23:15:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f5ffb640 1 -- 172.21.15.94:0/1049440518 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0af070 con 0x7fc3f8073000 2024-09-11T23:15:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f5ffb640 1 -- 172.21.15.94:0/1049440518 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0aaa30 con 0x7fc3f8073000 2024-09-11T23:15:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- 172.21.15.94:0/2689947029 shutdown_connections 2024-09-11T23:15:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- 172.21.15.94:0/2689947029 wait complete. 2024-09-11T23:15:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd50d4aa640 1 --2- 172.21.15.94:0/3319970724 >> v2:172.21.15.155:3300/0 conn(0x7fd5080b5250 0x7fd5080b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd5077fe640 1 -- 172.21.15.94:0/3319970724 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120581160 0 0) 0x7fd4fc001070 con 0x7fd508159e70 2024-09-11T23:15:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd5077fe640 1 -- 172.21.15.94:0/3319970724 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f0003530 con 0x7fd508159e70 2024-09-11T23:15:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 Processor -- start 2024-09-11T23:15:36.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd507fff640 1 -- 172.21.15.94:0/3319970724 >> v2:172.21.15.155:3300/0 conn(0x7fd5080b5250 msgr2=0x7fd5080b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd507fff640 1 --2- 172.21.15.94:0/3319970724 >> v2:172.21.15.155:3300/0 conn(0x7fd5080b5250 0x7fd5080b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd507fff640 1 -- 172.21.15.94:0/3319970724 >> v1:172.21.15.155:6789/0 conn(0x7fd508159e70 legacy=0x7fd5080b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fd507fff640 1 -- 172.21.15.94:0/3319970724 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5080b4f90 con 0x7fd50815a250 2024-09-11T23:15:36.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0259c640 1 --2- 172.21.15.94:0/496705843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc0de940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4df40097d0 tx=0x7f4df401ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a8ab3c1064f421 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 -- 172.21.15.94:0/1049440518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8073000 msgr2=0x7fc3f80b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 --2- 172.21.15.94:0/1049440518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8073000 0x7fc3f80b5200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009870 tx=0x7fc3ec01c550 comp rx=0 tx=0).stop 2024-09-11T23:15:36.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64ae2ab640 1 -- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6494004810 msgr2=0x7f6494004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6494004810 0x7f6494004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64ae2ab640 1 -- 172.21.15.94:0/1362867645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494003b80 msgr2=0x7f6494003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494003b80 0x7f6494003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64ae2ab640 1 -- 172.21.15.94:0/1362867645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a80b3f50 con 0x7f6494005220 2024-09-11T23:15:36.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64adaaa640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494003b80 0x7f6494003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:36.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 -- 172.21.15.94:0/1049440518 shutdown_connections 2024-09-11T23:15:36.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 --2- 172.21.15.94:0/1049440518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8073000 0x7fc3f80b5200 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 --2- 172.21.15.94:0/1049440518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8145a00 0x7fc3f8072ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 -- 172.21.15.94:0/1049440518 >> 172.21.15.94:0/1049440518 conn(0x7fc3f80b1bf0 msgr2=0x7fc3f80b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 -- 172.21.15.94:0/1049440518 shutdown_connections 2024-09-11T23:15:36.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7fc3f7fff640 1 -- 172.21.15.94:0/1049440518 wait complete. 2024-09-11T23:15:36.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0159a640 1 -- 172.21.15.94:0/496705843 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df40b5070 con 0x7f4dfc00bc00 2024-09-11T23:15:36.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 Processor -- start 2024-09-11T23:15:36.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- start start 2024-09-11T23:15:36.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 -- start start 2024-09-11T23:15:36.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c4005a70 0x7f63c40376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c400a380 0x7f63c4184de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c40deb70 0x7f63c4049470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f63c4033c00 con 0x7f63c400a380 2024-09-11T23:15:36.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f63c401c780 con 0x7f63c40deb70 2024-09-11T23:15:36.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d1e50640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63c4007260 con 0x7f63c4005a70 2024-09-11T23:15:36.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0159a640 1 -- 172.21.15.94:0/496705843 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40a8930 con 0x7f4dfc00bc00 2024-09-11T23:15:36.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0159a640 1 -- 172.21.15.94:0/496705843 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df40a8ce0 con 0x7f4dfc00bc00 2024-09-11T23:15:36.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f1b58e81640 1 --2- 172.21.15.94:0/4102562073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c0e00c0 0x7f1b4c007a50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009870 tx=0x7f1b4001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261542f66369e778 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f546f7fe640 1 --2- 172.21.15.94:0/773437399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701627a0 0x7f54700b2fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54600098a0 tx=0x7f546001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d68ad0b78cf1a819 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6494005220 0x7f649400b9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c290 tx=0x7f64a401cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136fd01ad5d04e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0888a640 1 -- 172.21.15.94:0/496705843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc00bc00 msgr2=0x7f4dfc0de940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0888a640 1 --2- 172.21.15.94:0/496705843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc0de940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4df40097d0 tx=0x7f4df401ec30 comp rx=0 tx=0).stop 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d0e4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c4005a70 0x7f63c40376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d0e4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c4005a70 0x7f63c40376f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:38570/0 (socket says 172.21.15.94:38570) 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d0e4e640 1 -- 172.21.15.94:0/4142824578 learned_addr learned my addr 172.21.15.94:0/4142824578 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63cbfff640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c400a380 0x7f63c4184de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63d164f640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c40deb70 0x7f63c4049470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0888a640 1 -- 172.21.15.94:0/496705843 shutdown_connections 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0888a640 1 --2- 172.21.15.94:0/496705843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc0de940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0888a640 1 -- 172.21.15.94:0/496705843 >> 172.21.15.94:0/496705843 conn(0x7f4dfc0360d0 msgr2=0x7f4dfc0364e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f546effd640 1 -- 172.21.15.94:0/773437399 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600aa610 con 0x7f54701627a0 2024-09-11T23:15:36.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f546effd640 1 -- 172.21.15.94:0/773437399 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54600af070 con 0x7f54701627a0 2024-09-11T23:15:36.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0888a640 1 -- 172.21.15.94:0/496705843 shutdown_connections 2024-09-11T23:15:36.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f546effd640 1 -- 172.21.15.94:0/773437399 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600aa9b0 con 0x7f54701627a0 2024-09-11T23:15:36.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4007d40 con 0x7f6494005220 2024-09-11T23:15:36.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40a9070 con 0x7f6494005220 2024-09-11T23:15:36.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f64acaa8640 1 -- 172.21.15.94:0/1362867645 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4005d60 con 0x7f6494005220 2024-09-11T23:15:36.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 0x7f9e800b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e8013ef80 0x7f9e800b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e801417c0 0x7f9e8013a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d2970 con 0x7f9e800d1c30 2024-09-11T23:15:36.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f9e855cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d27f0 con 0x7f9e8013ef80 2024-09-11T23:15:36.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e855cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8006cdd0 con 0x7f9e801417c0 2024-09-11T23:15:36.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63cbfff640 1 -- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c4005a70 msgr2=0x7f63c40376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63cbfff640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63c4005a70 0x7f63c40376f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63cbfff640 1 -- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c40deb70 msgr2=0x7f63c4049470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63cbfff640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c40deb70 0x7f63c4049470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f63cbfff640 1 -- 172.21.15.94:0/4142824578 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c4048fb0 con 0x7f63c400a380 2024-09-11T23:15:36.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.644+0000 7f4e0888a640 1 -- 172.21.15.94:0/496705843 wait complete. 2024-09-11T23:15:36.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 Processor -- start 2024-09-11T23:15:36.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 -- start start 2024-09-11T23:15:36.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f63cbfff640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c400a380 0x7f63c4184de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d5a0 tx=0x7f63b800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b537fe640 1 -- 172.21.15.94:0/4102562073 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b400b0070 con 0x7f1b4c0e00c0 2024-09-11T23:15:36.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b537fe640 1 -- 172.21.15.94:0/4102562073 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b400ab600 con 0x7f1b4c0e00c0 2024-09-11T23:15:36.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b537fe640 1 -- 172.21.15.94:0/4102562073 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b400ab9d0 con 0x7f1b4c0e00c0 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e77fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e8013ef80 0x7f9e800b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e77fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e8013ef80 0x7f9e800b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:38704/0 (socket says 172.21.15.94:38704) 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e77fff640 1 -- 172.21.15.94:0/2627357867 learned_addr learned my addr 172.21.15.94:0/2627357867 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7f7fe640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e801417c0 0x7f9e8013a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 -- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6494005220 msgr2=0x7f649400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 --2- 172.21.15.94:0/1362867645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6494005220 0x7f649400b9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c290 tx=0x7f64a401cc60 comp rx=0 tx=0).stop 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64ae2ab640 1 -- 172.21.15.94:0/1362867645 reap_dead start 2024-09-11T23:15:36.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 -- 172.21.15.94:0/1362867645 shutdown_connections 2024-09-11T23:15:36.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 -- 172.21.15.94:0/1362867645 >> 172.21.15.94:0/1362867645 conn(0x7f64a80b1bf0 msgr2=0x7f64a80b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7effd640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 0x7f9e800b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 -- 172.21.15.94:0/1362867645 shutdown_connections 2024-09-11T23:15:36.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8073000 0x7fc3f813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3f80b5740 0x7fc3f813d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8145a00 0x7fc3f81383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8168c40 con 0x7fc3f8145a00 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8168ac0 con 0x7fc3f80b5740 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f8168dc0 con 0x7fc3f8073000 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8145a00 0x7fc3f81383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f67fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3f80b5740 0x7fc3f813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8145a00 0x7fc3f81383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40568/0 (socket says 172.21.15.94:40568) 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f67fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3f80b5740 0x7fc3f813d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:38720/0 (socket says 172.21.15.94:38720) 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 -- 172.21.15.94:0/2612847497 learned_addr learned my addr 172.21.15.94:0/2612847497 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f6ffd640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8073000 0x7fc3f813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7f7fe640 1 -- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e8013ef80 msgr2=0x7f9e800b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7f7fe640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e8013ef80 0x7f9e800b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7f7fe640 1 -- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 msgr2=0x7f9e800b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7f7fe640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e800d1c30 0x7f9e800b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7f7fe640 1 -- 172.21.15.94:0/2627357867 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8013d1a0 con 0x7f9e801417c0 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e7f7fe640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e801417c0 0x7f9e8013a510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e780ac000 tx=0x7f9e78019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8019070 con 0x7f63c400a380 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b8004240 con 0x7f63c400a380 2024-09-11T23:15:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8003620 con 0x7f63c400a380 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 -- 172.21.15.94:0/773437399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701627a0 msgr2=0x7f54700b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 --2- 172.21.15.94:0/773437399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701627a0 0x7f54700b2fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54600098a0 tx=0x7f546001c4d0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 -- 172.21.15.94:0/773437399 shutdown_connections 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 --2- 172.21.15.94:0/773437399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701627a0 0x7f54700b2fd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 -- 172.21.15.94:0/773437399 >> 172.21.15.94:0/773437399 conn(0x7f547006f420 msgr2=0x7f547006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 -- 172.21.15.94:0/773437399 shutdown_connections 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 -- 172.21.15.94:0/773437399 wait complete. 2024-09-11T23:15:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b59e83640 1 -- 172.21.15.94:0/4102562073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c0e00c0 msgr2=0x7f1b4c007a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b59e83640 1 --2- 172.21.15.94:0/4102562073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c0e00c0 0x7f1b4c007a50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009870 tx=0x7f1b4001c520 comp rx=0 tx=0).stop 2024-09-11T23:15:36.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b59e83640 1 -- 172.21.15.94:0/4102562073 shutdown_connections 2024-09-11T23:15:36.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b59e83640 1 --2- 172.21.15.94:0/4102562073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c0e00c0 0x7f1b4c007a50 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009870 tx=0x7f1b4001c520 comp rx=0 tx=0).stop 2024-09-11T23:15:36.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b59e83640 1 -- 172.21.15.94:0/4102562073 >> 172.21.15.94:0/4102562073 conn(0x7f1b4c01e1a0 msgr2=0x7f1b4c054ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fd507fff640 1 --2- 172.21.15.94:0/3319970724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd50815a250 0x7fd5080cee50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd5080cd0e0 tx=0x7fd4f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba9b81898489b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 Processor -- start 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 -- start start 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 -- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8073000 msgr2=0x7fc3f813f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3f8073000 0x7fc3f813f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 -- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3f80b5740 msgr2=0x7fc3f813d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3f80b5740 0x7fc3f813d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 -- 172.21.15.94:0/2612847497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f8155120 con 0x7fc3f8145a00 2024-09-11T23:15:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f77fe640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8145a00 0x7fc3f81383e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c710 tx=0x7fc3f000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780bd020 con 0x7f9e801417c0 2024-09-11T23:15:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e780ae6f0 con 0x7f9e801417c0 2024-09-11T23:15:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780b2040 con 0x7f9e801417c0 2024-09-11T23:15:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e855cb640 1 -- 172.21.15.94:0/2627357867 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8013d480 con 0x7f9e801417c0 2024-09-11T23:15:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e855cb640 1 -- 172.21.15.94:0/2627357867 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8013aa50 con 0x7f9e801417c0 2024-09-11T23:15:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 -- 172.21.15.94:0/1362867645 wait complete. 2024-09-11T23:15:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 Processor -- start 2024-09-11T23:15:36.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c4037c30 con 0x7f63c400a380 2024-09-11T23:15:36.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c4185320 con 0x7f63c400a380 2024-09-11T23:15:36.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b59e83640 1 -- 172.21.15.94:0/4102562073 shutdown_connections 2024-09-11T23:15:36.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc006d50 0x7f4dfc0ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dfc00aac0 0x7f4dfc039af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc03a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc033c30 con 0x7f4dfc00bc00 2024-09-11T23:15:36.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc0dee80 con 0x7f4dfc006d50 2024-09-11T23:15:36.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0888a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4dfc0071a0 con 0x7f4dfc00aac0 2024-09-11T23:15:36.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f9e855cb640 1 -- 172.21.15.94:0/2627357867 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e8006ea70 con 0x7f9e801417c0 2024-09-11T23:15:36.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f547655f640 1 Processor -- start 2024-09-11T23:15:36.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f1b59e83640 1 -- 172.21.15.94:0/4102562073 wait complete. 2024-09-11T23:15:36.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fd5077fe640 1 -- 172.21.15.94:0/3319970724 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80b0070 con 0x7fd50815a250 2024-09-11T23:15:36.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fd5077fe640 1 -- 172.21.15.94:0/3319970724 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f80ab600 con 0x7fd50815a250 2024-09-11T23:15:36.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fd5077fe640 1 -- 172.21.15.94:0/3319970724 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80ab9d0 con 0x7fd50815a250 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc03a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc03a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40576/0 (socket says 172.21.15.94:40576) 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 -- 172.21.15.94:0/112145882 learned_addr learned my addr 172.21.15.94:0/112145882 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e0259c640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc006d50 0x7f4dfc0ddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e01d9b640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dfc00aac0 0x7f4dfc039af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 -- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dfc00aac0 msgr2=0x7f4dfc039af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dfc00aac0 0x7f4dfc039af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 -- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc006d50 msgr2=0x7f4dfc0ddd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc006d50 0x7f4dfc0ddd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 -- 172.21.15.94:0/112145882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc0e00a0 con 0x7f4dfc00bc00 2024-09-11T23:15:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f4e02d9d640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc03a030 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e04000b70 tx=0x7f4e040697c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0016020 con 0x7fc3f8145a00 2024-09-11T23:15:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f0006d60 con 0x7fc3f8145a00 2024-09-11T23:15:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0003bc0 con 0x7fc3f8145a00 2024-09-11T23:15:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f8155400 con 0x7fc3f8145a00 2024-09-11T23:15:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f8138920 con 0x7fc3f8145a00 2024-09-11T23:15:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63c400bbd0 con 0x7f63c400a380 2024-09-11T23:15:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f547655f640 1 -- start start 2024-09-11T23:15:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e040754f0 con 0x7f4dfc00bc00 2024-09-11T23:15:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e04090020 con 0x7f4dfc00bc00 2024-09-11T23:15:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0406d350 con 0x7f4dfc00bc00 2024-09-11T23:15:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dfc0df000 con 0x7f4dfc00bc00 2024-09-11T23:15:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dfc0df5c0 con 0x7f4dfc00bc00 2024-09-11T23:15:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.648+0000 7f64aeaac640 1 -- start start 2024-09-11T23:15:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494005220 0x7f64a8158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64adaaa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494005220 0x7f64a8158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64adaaa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494005220 0x7f64a8158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40584/0 (socket says 172.21.15.94:40584) 2024-09-11T23:15:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80cc100 0x7f64a80c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd50815a250 msgr2=0x7fd5080cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 --2- 172.21.15.94:0/3319970724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd50815a250 0x7fd5080cee50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd5080cd0e0 tx=0x7fd4f801c3d0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64adaaa640 1 -- 172.21.15.94:0/3121062419 learned_addr learned my addr 172.21.15.94:0/3121062419 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64a82073e0 0x7f64a8207860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8163950 con 0x7f6494005220 2024-09-11T23:15:36.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81637d0 con 0x7f64a82073e0 2024-09-11T23:15:36.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64a816e3a0 con 0x7f64a80cc100 2024-09-11T23:15:36.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e780c0020 con 0x7f9e801417c0 2024-09-11T23:15:36.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63b801c070 con 0x7f63c400a380 2024-09-11T23:15:36.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63c97fa640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b0067990 0x7f63b0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f63b8085810 con 0x7f63c400a380 2024-09-11T23:15:36.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64a82073e0 0x7f64a8207860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63c97fa640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f63b0071110 0x7f63b0073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 --> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63b0073c20 con 0x7f63b0071110 2024-09-11T23:15:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63b808a2a0 con 0x7f63c400a380 2024-09-11T23:15:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 Processor -- start 2024-09-11T23:15:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 shutdown_connections 2024-09-11T23:15:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 --2- 172.21.15.94:0/3319970724 >> v2:172.21.15.155:3300/0 conn(0x7fd5080b5250 0x7fd5080b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 --2- 172.21.15.94:0/3319970724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd50815a250 0x7fd5080cee50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 >> 172.21.15.94:0/3319970724 conn(0x7fd5080b1bf0 msgr2=0x7fd5080b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ad2a9640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80cc100 0x7f64a80c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f547655f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547006e2a0 0x7f547014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e777fe640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9e60067990 0x7f9e60069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9e781212d0 con 0x7f9e801417c0 2024-09-11T23:15:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f547655f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701623c0 0x7f547015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e777fe640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f9e60071100 0x7f9e60073540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 --> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e78007e80 con 0x7f9e60071100 2024-09-11T23:15:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9e781216c0 con 0x7f9e801417c0 2024-09-11T23:15:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ae2ab640 1 -- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80cc100 msgr2=0x7f64a80c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a80cc100 0x7f64a80c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ae2ab640 1 -- 172.21.15.94:0/3121062419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494005220 msgr2=0x7f64a8158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6494005220 0x7f64a8158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ae2ab640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a80ca060 con 0x7f64a82073e0 2024-09-11T23:15:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e0406d4f0 con 0x7f4dfc00bc00 2024-09-11T23:15:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e7effd640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9e60067990 0x7f9e60069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701623c0 0x7f547015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f546ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547006e2a0 0x7f547014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f546ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547006e2a0 0x7f547014f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:38746/0 (socket says 172.21.15.94:38746) 2024-09-11T23:15:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 shutdown_connections 2024-09-11T23:15:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701623c0 0x7f547015ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:38610/0 (socket says 172.21.15.94:38610) 2024-09-11T23:15:36.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f547655f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54701627a0 0x7f547014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4dfc0de940 con 0x7f4dfc00bc00 2024-09-11T23:15:36.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3f000a850 con 0x7fc3f8145a00 2024-09-11T23:15:36.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64ae2ab640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64a82073e0 0x7f64a8207860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f649400c4d0 tx=0x7f6494005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3d8001040 con 0x7fc3f8145a00 2024-09-11T23:15:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f546ffff640 1 -- 172.21.15.94:0/3249207719 learned_addr learned my addr 172.21.15.94:0/3249207719 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f547655f640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f54701702a0 con 0x7f54701627a0 2024-09-11T23:15:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f547655f640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f54700b3920 con 0x7f547006e2a0 2024-09-11T23:15:36.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f547655f640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5470170420 con 0x7f54701623c0 2024-09-11T23:15:36.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980014f0 con 0x7f64a82073e0 2024-09-11T23:15:36.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a80ca340 con 0x7f64a82073e0 2024-09-11T23:15:36.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a80c5000 con 0x7f64a82073e0 2024-09-11T23:15:36.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fc3dffff640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3e4067990 0x7fc3e4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a4005d40 con 0x7f64a82073e0 2024-09-11T23:15:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4007d40 con 0x7f64a82073e0 2024-09-11T23:15:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4de4067910 0x7f4de4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e04101500 con 0x7f4dfc00bc00 2024-09-11T23:15:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f4de4071010 0x7f4de4073450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 --> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4de4073b20 con 0x7f4de4071010 2024-09-11T23:15:36.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63d164f640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f63b0071110 0x7f63b0073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63d0e4e640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b0067990 0x7f63b0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f63d0e4e640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b0067990 0x7f63b0069e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63c000bb40 tx=0x7f63c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f4e0259c640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4de4067910 0x7f4de4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3f0085aa0 con 0x7fc3f8145a00 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 -- start start 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b4c036110 0x7f1b4c0d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c03a290 0x7f1b4c0d5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b4c0d5e50 0x7f1b4c051b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c053430 con 0x7f1b4c03a290 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c0532b0 con 0x7f1b4c036110 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59e83640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c0535b0 con 0x7f1b4c0d5e50 2024-09-11T23:15:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3dffff640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7fc3e4071110 0x7fc3e4073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 --> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3e4073c20 con 0x7fc3e4071110 2024-09-11T23:15:36.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc3f008c050 con 0x7fc3f8145a00 2024-09-11T23:15:36.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f9e77fff640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f9e60071100 0x7f9e60073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7f1b59682640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b4c0d5e50 0x7f1b4c051b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b59682640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b4c0d5e50 0x7f1b4c051b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:38622/0 (socket says 172.21.15.94:38622) 2024-09-11T23:15:36.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b59682640 1 -- 172.21.15.94:0/1417787173 learned_addr learned my addr 172.21.15.94:0/1417787173 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b53fff640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c03a290 0x7f1b4c0d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f4e01d9b640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f4de4071010 0x7f4de4073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f9e77fff640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f9e60071100 0x7f9e60073540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3f67fc640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7fc3e4071110 0x7fc3e4073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3f6ffd640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3e4067990 0x7fc3e4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b58e81640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b4c036110 0x7f1b4c0d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4e040cda10 con 0x7f4dfc00bc00 2024-09-11T23:15:36.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546f7fe640 1 -- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547006e2a0 msgr2=0x7f547014f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546f7fe640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547006e2a0 0x7f547014f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546f7fe640 1 -- 172.21.15.94:0/3249207719 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54701627a0 msgr2=0x7f547014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546f7fe640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54701627a0 0x7f547014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546f7fe640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547015b1c0 con 0x7f54701623c0 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b53fff640 1 -- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b4c0d5e50 msgr2=0x7f1b4c051b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b53fff640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b4c0d5e50 0x7f1b4c051b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b53fff640 1 -- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b4c036110 msgr2=0x7f1b4c0d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b53fff640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b4c036110 0x7f1b4c0d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b53fff640 1 -- 172.21.15.94:0/1417787173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c0d6360 con 0x7f1b4c03a290 2024-09-11T23:15:36.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6490001040 con 0x7f64a82073e0 2024-09-11T23:15:36.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.652+0000 7fd50dcab640 1 -- 172.21.15.94:0/3319970724 wait complete. 2024-09-11T23:15:36.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 Processor -- start 2024-09-11T23:15:36.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b53fff640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c03a290 0x7f1b4c0d5910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1b5406a610 tx=0x7f1b540697c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f4e01d9b640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f4de4071010 0x7f4de4073450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54075750 con 0x7f1b4c03a290 2024-09-11T23:15:36.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546f7fe640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701623c0 0x7f547015ac80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54600ab000 tx=0x7f546001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== osd.1 v2:172.21.15.94:6824/2486087269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e78007e80 con 0x7f9e60071100 2024-09-11T23:15:36.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f4e0259c640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4de4067910 0x7f4de4069dd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4df40b2000 tx=0x7f4df40aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3f67fc640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7fc3e4071110 0x7fc3e4073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3f6ffd640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3e4067990 0x7fc3e4069e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80098e0 tx=0x7fc3e8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f9e7effd640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9e60067990 0x7f9e60069e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e70007fd0 tx=0x7f9e70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 -- start start 2024-09-11T23:15:36.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5080b5250 0x7fd508203790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd508159e70 0x7fd50815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd50815a250 0x7fd5081490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd5080ce930 con 0x7fd508159e70 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5080ce650 con 0x7fd5080b5250 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50dcab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5080723b0 con 0x7fd50815a250 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd508159e70 0x7fd50815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd508159e70 0x7fd50815b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40624/0 (socket says 172.21.15.94:40624) 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 -- 172.21.15.94:0/1162336605 learned_addr learned my addr 172.21.15.94:0/1162336605 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c0d6640 con 0x7f1b4c03a290 2024-09-11T23:15:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c0d6c00 con 0x7f1b4c03a290 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50d4aa640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd50815a250 0x7fd5081490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50cca9640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5080b5250 0x7fd508203790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 -- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd50815a250 msgr2=0x7fd5081490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd50815a250 0x7fd5081490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 -- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5080b5250 msgr2=0x7fd508203790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5080b5250 0x7fd508203790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 -- 172.21.15.94:0/1162336605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50814bf90 con 0x7fd508159e70 2024-09-11T23:15:36.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd50cca9640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5080b5250 0x7fd508203790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:15:36.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== osd.0 v2:172.21.15.94:6816/3940152591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3e4073c20 con 0x7fc3e4071110 2024-09-11T23:15:36.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f63d164f640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f63b0071110 0x7f63b0073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b4c048a00 con 0x7f1b4c03a290 2024-09-11T23:15:36.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f64a40b7070 con 0x7f64a82073e0 2024-09-11T23:15:36.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7fd507fff640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd508159e70 0x7fd50815b1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4f801a000 tx=0x7fd4f8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5406de50 con 0x7f1b4c03a290 2024-09-11T23:15:36.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54093640 con 0x7f1b4c03a290 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f649e7fc640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f648c0678f0 0x7f648c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f64a411f420 con 0x7f64a82073e0 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f649e7fc640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f648c071070 0x7f648c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f64adaaa640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f648c0678f0 0x7f648c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64a4005650 con 0x7f648c071070 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64a411f810 con 0x7f64a82073e0 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f64ad2a9640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f648c071070 0x7f648c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f64adaaa640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f648c0678f0 0x7f648c069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6498005470 tx=0x7f6498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f64ad2a9640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f648c071070 0x7f648c0734b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== osd.3 v2:172.21.15.94:6800/2578660853 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63b0073c20 con 0x7f63b0071110 2024-09-11T23:15:36.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600bd5f0 con 0x7f54701623c0 2024-09-11T23:15:36.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.656+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54600bd790 con 0x7f54701623c0 2024-09-11T23:15:36.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80b9020 con 0x7fd508159e70 2024-09-11T23:15:36.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f80b5480 con 0x7fd508159e70 2024-09-11T23:15:36.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80b0040 con 0x7fd508159e70 2024-09-11T23:15:36.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50814c270 con 0x7fd508159e70 2024-09-11T23:15:36.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd508156d60 con 0x7fd508159e70 2024-09-11T23:15:36.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f547655f640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547014eda0 con 0x7f54701623c0 2024-09-11T23:15:36.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f547655f640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f547014f9f0 con 0x7f54701623c0 2024-09-11T23:15:36.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54700b2fd0 con 0x7f54701623c0 2024-09-11T23:15:36.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b540937e0 con 0x7f1b4c03a290 2024-09-11T23:15:36.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b517fa640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b380679c0 0x7f1b38069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b54101970 con 0x7f1b4c03a290 2024-09-11T23:15:36.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b58e81640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b380679c0 0x7f1b38069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b517fa640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f1b38071140 0x7f1b38073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 --> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b38073c50 con 0x7f1b38071140 2024-09-11T23:15:36.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b54101d60 con 0x7f1b4c03a290 2024-09-11T23:15:36.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4e8001040 con 0x7fd508159e70 2024-09-11T23:15:36.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b59682640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f1b38071140 0x7f1b38073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f1b58e81640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b380679c0 0x7f1b38069e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b400ad000 tx=0x7f1b40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600bdb60 con 0x7f54701623c0 2024-09-11T23:15:36.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54600b33f0 con 0x7f54701623c0 2024-09-11T23:15:36.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f546cff9640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f545c067990 0x7f545c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5460120a80 con 0x7f54701623c0 2024-09-11T23:15:36.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f546cff9640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7f545c071100 0x7f545c073540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4f80bc020 con 0x7fd508159e70 2024-09-11T23:15:36.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.660+0000 7fd5057fa640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4f4067990 0x7fd4f4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54600bd790 con 0x7f545c071100 2024-09-11T23:15:36.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5460120e70 con 0x7f54701623c0 2024-09-11T23:15:36.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd4f811fa40 con 0x7fd508159e70 2024-09-11T23:15:36.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7fd5057fa640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7fd4f4071090 0x7fd4f40734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 --> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4f80adec0 con 0x7fd4f4071090 2024-09-11T23:15:36.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f546ffff640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f545c067990 0x7f545c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== osd.2 v2:172.21.15.94:6808/2442943552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64a4005650 con 0x7f648c071070 2024-09-11T23:15:36.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7fd50cca9640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4f4067990 0x7fd4f4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f5474afc640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7f545c071100 0x7f545c073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f5474afc640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7f545c071100 0x7f545c073540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f546ffff640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f545c067990 0x7f545c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5468000f90 tx=0x7f5468009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== osd.4 v2:172.21.15.155:6817/3159607984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54600bd790 con 0x7f545c071100 2024-09-11T23:15:36.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.668+0000 7f1b59682640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f1b38071140 0x7f1b38073580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== osd.7 v2:172.21.15.155:6816/4208392943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4de4073b20 con 0x7f4de4071010 2024-09-11T23:15:36.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.668+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== osd.5 v2:172.21.15.155:6800/1079669988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b38073c50 con 0x7f1b38071140 2024-09-11T23:15:36.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.664+0000 7fd50cca9640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4f4067990 0x7fd4f4069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001210 tx=0x7fd4fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.668+0000 7fd50d4aa640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7fd4f4071090 0x7fd4f40734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.668+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4f80ebe70 con 0x7fd508159e70 2024-09-11T23:15:36.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.672+0000 7fd50d4aa640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7fd4f4071090 0x7fd4f40734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.672+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== osd.6 v2:172.21.15.155:6808/1080635284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4f80adec0 con 0x7fd4f4071090 2024-09-11T23:15:36.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e855cb640 1 -- 172.21.15.94:0/2627357867 --> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e8006ee70 con 0x7f9e60071100 2024-09-11T23:15:36.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e777fe640 1 -- 172.21.15.94:0/2627357867 <== osd.1 v2:172.21.15.94:6824/2486087269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e8006ee70 con 0x7f9e60071100 2024-09-11T23:15:36.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 -- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f9e60071100 msgr2=0x7f9e60073540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f9e60071100 0x7f9e60073540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 -- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9e60067990 msgr2=0x7f9e60069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9e60067990 0x7f9e60069e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e70007fd0 tx=0x7f9e70009040 comp rx=0 tx=0).stop 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 -- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e801417c0 msgr2=0x7f9e8013a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 --2- 172.21.15.94:0/2627357867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e801417c0 0x7f9e8013a510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e780ac000 tx=0x7f9e78019680 comp rx=0 tx=0).stop 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e7f7fe640 1 -- 172.21.15.94:0/2627357867 reap_dead start 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 -- 172.21.15.94:0/2627357867 shutdown_connections 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 -- 172.21.15.94:0/2627357867 >> 172.21.15.94:0/2627357867 conn(0x7f9e8006c0c0 msgr2=0x7f9e8006e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 -- 172.21.15.94:0/2627357867 shutdown_connections 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.680+0000 7f9e757fa640 1 -- 172.21.15.94:0/2627357867 wait complete. 2024-09-11T23:15:36.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 --> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6490002de0 con 0x7f648c071070 2024-09-11T23:15:36.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 --> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3d8002d60 con 0x7fc3e4071110 2024-09-11T23:15:36.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f649e7fc640 1 -- 172.21.15.94:0/3121062419 <== osd.2 v2:172.21.15.94:6808/2442943552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6490002de0 con 0x7f648c071070 2024-09-11T23:15:36.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7fc3dffff640 1 -- 172.21.15.94:0/2612847497 <== osd.0 v2:172.21.15.94:6816/3940152591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3d8002d60 con 0x7fc3e4071110 2024-09-11T23:15:36.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 --> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f63c4000cf0 con 0x7f63b0071110 2024-09-11T23:15:36.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f63c97fa640 1 -- 172.21.15.94:0/4142824578 <== osd.3 v2:172.21.15.94:6800/2578660853 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f63c4000cf0 con 0x7f63b0071110 2024-09-11T23:15:36.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f648c071070 msgr2=0x7f648c0734b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f64aeaac640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f648c071070 0x7f648c0734b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f648c0678f0 msgr2=0x7f648c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f64aeaac640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f648c0678f0 0x7f648c069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6498005470 tx=0x7f6498009040 comp rx=0 tx=0).stop 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64a82073e0 msgr2=0x7f64a8207860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f64aeaac640 1 --2- 172.21.15.94:0/3121062419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64a82073e0 0x7f64a8207860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f649400c4d0 tx=0x7f6494005840 comp rx=0 tx=0).stop 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f64ae2ab640 1 -- 172.21.15.94:0/3121062419 reap_dead start 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 shutdown_connections 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 >> 172.21.15.94:0/3121062419 conn(0x7f64a80b1bf0 msgr2=0x7f64a80ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 shutdown_connections 2024-09-11T23:15:36.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f64aeaac640 1 -- 172.21.15.94:0/3121062419 wait complete. 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f63b0071110 msgr2=0x7f63b0073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f63d1e50640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f63b0071110 0x7f63b0073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.688+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b0067990 msgr2=0x7f63b0069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d1e50640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b0067990 0x7f63b0069e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63c000bb40 tx=0x7f63c0008040 comp rx=0 tx=0).stop 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c400a380 msgr2=0x7f63c4184de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d1e50640 1 --2- 172.21.15.94:0/4142824578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c400a380 0x7f63c4184de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d5a0 tx=0x7f63b800da60 comp rx=0 tx=0).stop 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d164f640 1 -- 172.21.15.94:0/4142824578 reap_dead start 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 shutdown_connections 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 >> 172.21.15.94:0/4142824578 conn(0x7f63c40360a0 msgr2=0x7f63c4047770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 shutdown_connections 2024-09-11T23:15:36.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f63d1e50640 1 -- 172.21.15.94:0/4142824578 wait complete. 2024-09-11T23:15:36.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 --> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4dfc052350 con 0x7f4de4071010 2024-09-11T23:15:36.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 --> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b4c007a50 con 0x7f1b38071140 2024-09-11T23:15:36.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7fc3e4071110 msgr2=0x7fc3e4073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7fc3e4071110 0x7fc3e4073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f1b517fa640 1 -- 172.21.15.94:0/1417787173 <== osd.5 v2:172.21.15.155:6800/1079669988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1b4c007a50 con 0x7f1b38071140 2024-09-11T23:15:36.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f4df2ffd640 1 -- 172.21.15.94:0/112145882 <== osd.7 v2:172.21.15.155:6816/4208392943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4dfc052350 con 0x7f4de4071010 2024-09-11T23:15:36.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 --> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f547014fc40 con 0x7f545c071100 2024-09-11T23:15:36.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f1b38071140 msgr2=0x7f1b38073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7f1b59e83640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f1b38071140 0x7f1b38073580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3e4067990 msgr2=0x7fc3e4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3e4067990 0x7fc3e4069e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80098e0 tx=0x7fc3e8009060 comp rx=0 tx=0).stop 2024-09-11T23:15:36.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8145a00 msgr2=0x7fc3f81383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 --2- 172.21.15.94:0/2612847497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3f8145a00 0x7fc3f81383e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c710 tx=0x7fc3f000cbd0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f77fe640 1 -- 172.21.15.94:0/2612847497 reap_dead start 2024-09-11T23:15:36.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 shutdown_connections 2024-09-11T23:15:36.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 >> 172.21.15.94:0/2612847497 conn(0x7fc3f80b1bf0 msgr2=0x7fc3f8143100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 shutdown_connections 2024-09-11T23:15:36.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.692+0000 7fc3f7fff640 1 -- 172.21.15.94:0/2612847497 wait complete. 2024-09-11T23:15:36.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f546cff9640 1 -- 172.21.15.94:0/3249207719 <== osd.4 v2:172.21.15.155:6817/3159607984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f547014fc40 con 0x7f545c071100 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b380679c0 msgr2=0x7f1b38069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f1b59e83640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b380679c0 0x7f1b38069e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b400ad000 tx=0x7f1b40008040 comp rx=0 tx=0).stop 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c03a290 msgr2=0x7f1b4c0d5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f1b59e83640 1 --2- 172.21.15.94:0/1417787173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b4c03a290 0x7f1b4c0d5910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1b5406a610 tx=0x7f1b540697c0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f1b59682640 1 -- 172.21.15.94:0/1417787173 reap_dead start 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 shutdown_connections 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 >> 172.21.15.94:0/1417787173 conn(0x7f1b4c01e1a0 msgr2=0x7f1b4c005d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7f545c071100 msgr2=0x7f545c073540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7f545c071100 0x7f545c073540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 --> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4e8002de0 con 0x7fd4f4071090 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f4de4071010 msgr2=0x7f4de4073450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f4de4071010 0x7f4de4073450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4de4067910 msgr2=0x7f4de4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4de4067910 0x7f4de4069dd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4df40b2000 tx=0x7f4df40aa070 comp rx=0 tx=0).stop 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dfc00bc00 msgr2=0x7f4dfc03a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 --2- 172.21.15.94:0/112145882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dfc00bc00 0x7f4dfc03a030 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e04000b70 tx=0x7f4e040697c0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e02d9d640 1 -- 172.21.15.94:0/112145882 reap_dead start 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 shutdown_connections 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 >> 172.21.15.94:0/112145882 conn(0x7f4dfc0360d0 msgr2=0x7f4dfc04a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 shutdown_connections 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f4e0888a640 1 -- 172.21.15.94:0/112145882 wait complete. 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f545c067990 msgr2=0x7f545c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f545c067990 0x7f545c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5468000f90 tx=0x7f5468009040 comp rx=0 tx=0).stop 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701623c0 msgr2=0x7f547015ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 --2- 172.21.15.94:0/3249207719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54701623c0 0x7f547015ac80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54600ab000 tx=0x7f546001ad10 comp rx=0 tx=0).stop 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f5474afc640 1 -- 172.21.15.94:0/3249207719 reap_dead start 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 shutdown_connections 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 >> 172.21.15.94:0/3249207719 conn(0x7f547006f420 msgr2=0x7f5470158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 shutdown_connections 2024-09-11T23:15:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7f54567fc640 1 -- 172.21.15.94:0/3249207719 wait complete. 2024-09-11T23:15:36.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd5057fa640 1 -- 172.21.15.94:0/1162336605 <== osd.6 v2:172.21.15.155:6808/1080635284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd4e8002de0 con 0x7fd4f4071090 2024-09-11T23:15:36.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7fd4f4071090 msgr2=0x7fd4f40734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7fd4f4071090 0x7fd4f40734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4f4067990 msgr2=0x7fd4f4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4f4067990 0x7fd4f4069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001210 tx=0x7fd4fc009040 comp rx=0 tx=0).stop 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd508159e70 msgr2=0x7fd50815b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 --2- 172.21.15.94:0/1162336605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd508159e70 0x7fd50815b1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4f801a000 tx=0x7fd4f8019170 comp rx=0 tx=0).stop 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50d4aa640 1 -- 172.21.15.94:0/1162336605 reap_dead start 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 shutdown_connections 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.696+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 >> 172.21.15.94:0/1162336605 conn(0x7fd5080b1bf0 msgr2=0x7fd5080b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.700+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 shutdown_connections 2024-09-11T23:15:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.700+0000 7f1b59e83640 1 -- 172.21.15.94:0/1417787173 wait complete. 2024-09-11T23:15:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.700+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 shutdown_connections 2024-09-11T23:15:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.700+0000 7fd50dcab640 1 -- 172.21.15.94:0/1162336605 wait complete. 2024-09-11T23:15:36.753 INFO:teuthology.orchestra.run.smithi094.stdout:55834574859 2024-09-11T23:15:36.753 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T23:15:36.754 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:36.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T23:15:36.755 INFO:teuthology.orchestra.run.smithi094.stdout:55834574857 2024-09-11T23:15:36.755 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T23:15:36.756 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:36.756 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T23:15:36.757 INFO:teuthology.orchestra.run.smithi094.stdout:55834574857 2024-09-11T23:15:36.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T23:15:36.758 INFO:teuthology.orchestra.run.smithi094.stdout:55834574857 2024-09-11T23:15:36.758 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T23:15:36.759 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:36.759 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T23:15:36.760 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:36.760 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T23:15:36.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21c532640 1 Processor -- start 2024-09-11T23:15:36.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21c532640 1 -- start start 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21c532640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2140b4090 0x7fb2140b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21c532640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb2140b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21c532640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21406fa50 con 0x7fb214144d60 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21c532640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb214070660 con 0x7fb2140b4090 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21a2ce640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb214144d60 0x7fb214070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36412/0 (socket says 172.21.15.94:36412) 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21c532640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb21406fd30 con 0x7fb2140b4ba0 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21a2ce640 1 -- 172.21.15.94:0/3377327567 learned_addr learned my addr 172.21.15.94:0/3377327567 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb219acd640 1 --2- 172.21.15.94:0/3377327567 >> v2:172.21.15.155:3300/0 conn(0x7fb2140b4090 0x7fb2140b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb21aacf640 1 --2- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb2140b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb2192cc640 1 -- 172.21.15.94:0/3377327567 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3969381553 0 0) 0x7fb21406fa50 con 0x7fb214144d60 2024-09-11T23:15:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb2192cc640 1 -- 172.21.15.94:0/3377327567 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb200003530 con 0x7fb214144d60 2024-09-11T23:15:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb219acd640 1 -- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 msgr2=0x7fb2140b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb219acd640 1 --2- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb2140b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb219acd640 1 -- 172.21.15.94:0/3377327567 >> v1:172.21.15.94:6789/0 conn(0x7fb214144d60 legacy=0x7fb214070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.964+0000 7fb219acd640 1 -- 172.21.15.94:0/3377327567 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb214070010 con 0x7fb2140b4090 2024-09-11T23:15:36.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57c374640 1 Processor -- start 2024-09-11T23:15:36.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57c374640 1 -- start start 2024-09-11T23:15:36.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30cb0b1640 1 Processor -- start 2024-09-11T23:15:36.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30cb0b1640 1 -- start start 2024-09-11T23:15:36.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 Processor -- start 2024-09-11T23:15:36.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 -- start start 2024-09-11T23:15:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30cb0b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc0546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30cb0b1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f30bc0e0d10 0x7f30bc0e1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30c98ae640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f30bc0e0d10 0x7f30bc0e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30c98ae640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f30bc0e0d10 0x7f30bc0e1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40626/0 (socket says 172.21.15.94:40626) 2024-09-11T23:15:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57c374640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe574154810 0x7fe57415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30c98ae640 1 -- 172.21.15.94:0/3939497227 learned_addr learned my addr 172.21.15.94:0/3939497227 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57c374640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe57406e2a0 0x7fe5740ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa46815b0d0 0x7fa4680b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f8df2e56640 1 Processor -- start 2024-09-11T23:15:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa4680b4ee0 0x7fa46806f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57c374640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5740cdc10 con 0x7fe574071c10 2024-09-11T23:15:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57c374640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe574154bf0 con 0x7fe57406e2a0 2024-09-11T23:15:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57c374640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe5740723b0 con 0x7fe574154810 2024-09-11T23:15:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57990f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe574071c10 0x7fe57406db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36418/0 (socket says 172.21.15.94:36418) 2024-09-11T23:15:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57990f640 1 -- 172.21.15.94:0/986955861 learned_addr learned my addr 172.21.15.94:0/986955861 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30ca0af640 1 --2- 172.21.15.94:0/3939497227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc0546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fb219acd640 1 --2- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2140b4090 0x7fb2140b44e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2040097c0 tx=0x7fb20401c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a9b17916de597af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57a110640 1 --2- 172.21.15.94:0/986955861 >> v2:172.21.15.155:3300/0 conn(0x7fe574154810 0x7fe57415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57a911640 1 --2- 172.21.15.94:0/986955861 >> v2:172.21.15.94:3300/0 conn(0x7fe57406e2a0 0x7fe5740ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa465d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa4680b4ee0 0x7fa46806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa465d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa4680b4ee0 0x7fa46806f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40632/0 (socket says 172.21.15.94:40632) 2024-09-11T23:15:36.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa465d9b640 1 -- 172.21.15.94:0/3710937154 learned_addr learned my addr 172.21.15.94:0/3710937154 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30bc054c10 con 0x7f30bc005de0 2024-09-11T23:15:36.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0e1840 con 0x7f30bc0e0d10 2024-09-11T23:15:36.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc0e1b20 con 0x7f30bc034430 2024-09-11T23:15:36.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46659c640 1 --2- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa46815b0d0 0x7fa4680b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 --2- 172.21.15.94:0/3710937154 >> v2:172.21.15.155:3300/0 conn(0x7fa46806f6b0 0x7fa46815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa468070ab0 con 0x7fa4680b4ee0 2024-09-11T23:15:36.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57910e640 1 -- 172.21.15.94:0/986955861 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451747717 0 0) 0x7fe570001120 con 0x7fe574071c10 2024-09-11T23:15:36.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57910e640 1 -- 172.21.15.94:0/986955861 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe560003530 con 0x7fe574071c10 2024-09-11T23:15:36.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa4680b5320 con 0x7fa46806f6b0 2024-09-11T23:15:36.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa46806ff30 con 0x7fa46815b0d0 2024-09-11T23:15:36.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f8df2e56640 1 -- start start 2024-09-11T23:15:36.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fa466d9d640 1 --2- 172.21.15.94:0/3710937154 >> v2:172.21.15.155:3300/0 conn(0x7fa46806f6b0 0x7fa46815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57a911640 1 -- 172.21.15.94:0/986955861 >> v2:172.21.15.155:3300/0 conn(0x7fe574154810 msgr2=0x7fe57415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57a911640 1 --2- 172.21.15.94:0/986955861 >> v2:172.21.15.155:3300/0 conn(0x7fe574154810 0x7fe57415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57a911640 1 -- 172.21.15.94:0/986955861 >> v1:172.21.15.94:6789/0 conn(0x7fe574071c10 legacy=0x7fe57406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7fe57a911640 1 -- 172.21.15.94:0/986955861 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe574072690 con 0x7fe57406e2a0 2024-09-11T23:15:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f8df2e56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8de4035cb0 0x7f8de4009180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f8df2e56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de40572e0 0x7f8de4038240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f8df2e56640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de400be50 con 0x7f8de4038780 2024-09-11T23:15:36.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f8df2e56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8de4036090 con 0x7f8de4035cb0 2024-09-11T23:15:36.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f8df2e56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8de4054300 con 0x7f8de40572e0 2024-09-11T23:15:36.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30c98ae640 1 -- 172.21.15.94:0/3939497227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 msgr2=0x7f30bc0546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30c98ae640 1 --2- 172.21.15.94:0/3939497227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc0546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30c98ae640 1 -- 172.21.15.94:0/3939497227 >> v1:172.21.15.155:6789/0 conn(0x7f30bc005de0 legacy=0x7f30bc039af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.968+0000 7f30c98ae640 1 -- 172.21.15.94:0/3939497227 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc053ed0 con 0x7f30bc0e0d10 2024-09-11T23:15:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c7243b640 1 Processor -- start 2024-09-11T23:15:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c7243b640 1 -- start start 2024-09-11T23:15:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8debfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de40572e0 0x7f8de4038240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8df13f3640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8de4038780 0x7f8de4007760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36422/0 (socket says 172.21.15.94:36422) 2024-09-11T23:15:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8df13f3640 1 -- 172.21.15.94:0/3060539331 learned_addr learned my addr 172.21.15.94:0/3060539331 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8df0bf2640 1 --2- 172.21.15.94:0/3060539331 >> v2:172.21.15.155:3300/0 conn(0x7f8de4035cb0 0x7f8de4009180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fa466d9d640 1 -- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa46815b0d0 msgr2=0x7fa4680b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fa466d9d640 1 --2- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa46815b0d0 0x7fa4680b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fa466d9d640 1 -- 172.21.15.94:0/3710937154 >> v2:172.21.15.94:3300/0 conn(0x7fa4680b4ee0 msgr2=0x7fa46806f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fa466d9d640 1 --2- 172.21.15.94:0/3710937154 >> v2:172.21.15.94:3300/0 conn(0x7fa4680b4ee0 0x7fa46806f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fa466d9d640 1 -- 172.21.15.94:0/3710937154 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa468070210 con 0x7fa46806f6b0 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fa466d9d640 1 --2- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46806f6b0 0x7fa46815eb50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ceca0 tx=0x7fa46001c6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad0e8d2b7874cfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57a911640 1 --2- 172.21.15.94:0/986955861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe5740ce3b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5740b2d40 tx=0x7fe56c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d0b67823b78630 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57910e640 1 -- 172.21.15.94:0/986955861 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c0b2070 con 0x7fe57406e2a0 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57910e640 1 -- 172.21.15.94:0/986955861 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe56c0a5980 con 0x7fe57406e2a0 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57910e640 1 -- 172.21.15.94:0/986955861 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c0a5d50 con 0x7fe57406e2a0 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57c374640 1 -- 172.21.15.94:0/986955861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 msgr2=0x7fe5740ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57c374640 1 --2- 172.21.15.94:0/986955861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe5740ce3b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5740b2d40 tx=0x7fe56c01c8c0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57c374640 1 -- 172.21.15.94:0/986955861 shutdown_connections 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57c374640 1 --2- 172.21.15.94:0/986955861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe5740ce3b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57c374640 1 --2- 172.21.15.94:0/986955861 >> v2:172.21.15.155:3300/0 conn(0x7fe574154810 0x7fe57415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fe57c374640 1 -- 172.21.15.94:0/986955861 >> 172.21.15.94:0/986955861 conn(0x7fe57406f420 msgr2=0x7fe57406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c7243b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c6c0b3960 0x7f4c6c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c7243b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c6c0d3fd0 0x7f4c6c0d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c7243b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c6c0cefa0 con 0x7f4c6c15e360 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c7243b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6c0d0750 con 0x7f4c6c0d3fd0 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c7243b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6c0b3760 con 0x7f4c6c0b3960 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c70c38640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c6c0b3960 0x7f4c6c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c70c38640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c6c0b3960 0x7f4c6c0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:38816/0 (socket says 172.21.15.94:38816) 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c70c38640 1 -- 172.21.15.94:0/347810225 learned_addr learned my addr 172.21.15.94:0/347810225 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c70c38640 1 -- 172.21.15.94:0/347810225 >> v2:172.21.15.94:3300/0 conn(0x7f4c6c0d3fd0 msgr2=0x7f4c6c0d4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c70c38640 1 --2- 172.21.15.94:0/347810225 >> v2:172.21.15.94:3300/0 conn(0x7f4c6c0d3fd0 0x7f4c6c0d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c70c38640 1 -- 172.21.15.94:0/347810225 >> v1:172.21.15.155:6789/0 conn(0x7f4c6c15e360 legacy=0x7f4c6c0d0040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f4c70c38640 1 -- 172.21.15.94:0/347810225 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c0cf280 con 0x7f4c6c0b3960 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f30c98ae640 1 --2- 172.21.15.94:0/3939497227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 0x7f30bc0e1150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009870 tx=0x7f30b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe990745e7220cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f30c90ad640 1 -- 172.21.15.94:0/3939497227 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40b0070 con 0x7f30bc0e0d10 2024-09-11T23:15:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f30c90ad640 1 -- 172.21.15.94:0/3939497227 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40ab600 con 0x7f30bc0e0d10 2024-09-11T23:15:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f30c90ad640 1 -- 172.21.15.94:0/3939497227 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40ab9d0 con 0x7f30bc0e0d10 2024-09-11T23:15:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8debfff640 1 -- 172.21.15.94:0/3060539331 >> v2:172.21.15.155:3300/0 conn(0x7f8de4035cb0 msgr2=0x7f8de4009180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8debfff640 1 --2- 172.21.15.94:0/3060539331 >> v2:172.21.15.155:3300/0 conn(0x7f8de4035cb0 0x7f8de4009180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8debfff640 1 -- 172.21.15.94:0/3060539331 >> v1:172.21.15.94:6789/0 conn(0x7f8de4038780 legacy=0x7f8de4007760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7f8debfff640 1 -- 172.21.15.94:0/3060539331 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de400c0f0 con 0x7f8de40572e0 2024-09-11T23:15:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb2192cc640 1 -- 172.21.15.94:0/3377327567 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2040b0070 con 0x7fb2140b4090 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb2192cc640 1 -- 172.21.15.94:0/3377327567 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2040ab600 con 0x7fb2140b4090 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb2192cc640 1 -- 172.21.15.94:0/3377327567 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2040ab9d0 con 0x7fb2140b4090 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 -- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2140b4090 msgr2=0x7fb2140b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 --2- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2140b4090 0x7fb2140b44e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2040097c0 tx=0x7fb20401c4c0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 -- 172.21.15.94:0/3377327567 shutdown_connections 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 --2- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb2140b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 --2- 172.21.15.94:0/3377327567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2140b4090 0x7fb2140b44e0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2040097c0 tx=0x7fb20401c4c0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 -- 172.21.15.94:0/3377327567 >> 172.21.15.94:0/3377327567 conn(0x7fb21409aa00 msgr2=0x7fb2140b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 -- 172.21.15.94:0/3377327567 shutdown_connections 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.972+0000 7fb21c532640 1 -- 172.21.15.94:0/3377327567 wait complete. 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 -- 172.21.15.94:0/986955861 shutdown_connections 2024-09-11T23:15:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8debfff640 1 --2- 172.21.15.94:0/3060539331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de40572e0 0x7f8de4038240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80097c0 tx=0x7f8dd801ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf85d756f9e52981 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8deb7fe640 1 -- 172.21.15.94:0/3060539331 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80b5070 con 0x7f8de40572e0 2024-09-11T23:15:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8deb7fe640 1 -- 172.21.15.94:0/3060539331 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd80a87f0 con 0x7f8de40572e0 2024-09-11T23:15:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8deb7fe640 1 -- 172.21.15.94:0/3060539331 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80a8c00 con 0x7f8de40572e0 2024-09-11T23:15:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 msgr2=0x7f30bc0e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/3939497227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 0x7f30bc0e1150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009870 tx=0x7f30b401c490 comp rx=0 tx=0).stop 2024-09-11T23:15:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46559a640 1 -- 172.21.15.94:0/3710937154 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600ac070 con 0x7fa46806f6b0 2024-09-11T23:15:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46559a640 1 -- 172.21.15.94:0/3710937154 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4600a6610 con 0x7fa46806f6b0 2024-09-11T23:15:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46559a640 1 -- 172.21.15.94:0/3710937154 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600a69e0 con 0x7fa46806f6b0 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46806f6b0 msgr2=0x7fa46815eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 --2- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46806f6b0 0x7fa46815eb50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ceca0 tx=0x7fa46001c6b0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 shutdown_connections 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 --2- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46806f6b0 0x7fa46815eb50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 --2- 172.21.15.94:0/3710937154 >> v2:172.21.15.94:3300/0 conn(0x7fa4680b4ee0 0x7fa46806f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 --2- 172.21.15.94:0/3710937154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa46815b0d0 0x7fa4680b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 >> 172.21.15.94:0/3710937154 conn(0x7fa4680cd970 msgr2=0x7fa4680cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 -- 172.21.15.94:0/3060539331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de40572e0 msgr2=0x7f8de4038240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 --2- 172.21.15.94:0/3060539331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de40572e0 0x7f8de4038240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80097c0 tx=0x7f8dd801ebf0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 shutdown_connections 2024-09-11T23:15:36.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/3939497227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 0x7f30bc0e1150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/3939497227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc0546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 >> 172.21.15.94:0/3939497227 conn(0x7f30bc01e1d0 msgr2=0x7f30bc054e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 Processor -- start 2024-09-11T23:15:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 shutdown_connections 2024-09-11T23:15:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 -- 172.21.15.94:0/986955861 wait complete. 2024-09-11T23:15:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 Processor -- start 2024-09-11T23:15:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 -- start start 2024-09-11T23:15:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 shutdown_connections 2024-09-11T23:15:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 -- start start 2024-09-11T23:15:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 -- 172.21.15.94:0/3060539331 shutdown_connections 2024-09-11T23:15:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 --2- 172.21.15.94:0/3060539331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de40572e0 0x7f8de4038240 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 --2- 172.21.15.94:0/3060539331 >> v2:172.21.15.155:3300/0 conn(0x7f8de4035cb0 0x7f8de4009180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 -- 172.21.15.94:0/3060539331 >> 172.21.15.94:0/3060539331 conn(0x7f8de40567c0 msgr2=0x7f8de4056bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 -- 172.21.15.94:0/3060539331 shutdown_connections 2024-09-11T23:15:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f4c70c38640 1 --2- 172.21.15.94:0/347810225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c0b3db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0ce860 tx=0x7f4c640301b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259ee59c2f6ddcfb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb214141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb214144d60 0x7fb214142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2140b1f40 0x7fb2140b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb2140af1f0 con 0x7fb2140b1f40 2024-09-11T23:15:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb2140af070 con 0x7fb214144d60 2024-09-11T23:15:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21c532640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb214167d60 con 0x7fb2140b4ba0 2024-09-11T23:15:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f8df2e56640 1 -- 172.21.15.94:0/3060539331 wait complete. 2024-09-11T23:15:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 -- 172.21.15.94:0/3710937154 wait complete. 2024-09-11T23:15:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f30cb0b1640 1 -- 172.21.15.94:0/3939497227 wait complete. 2024-09-11T23:15:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f4c63fff640 1 -- 172.21.15.94:0/347810225 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640c5070 con 0x7f4c6c0b3960 2024-09-11T23:15:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f4c63fff640 1 -- 172.21.15.94:0/347810225 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c640c0400 con 0x7f4c6c0b3960 2024-09-11T23:15:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f4c63fff640 1 -- 172.21.15.94:0/347810225 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640c07d0 con 0x7f4c6c0b3960 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21a2ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb214141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb219acd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb214144d60 0x7fb214142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21a2ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb214141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:38668/0 (socket says 172.21.15.94:38668) 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21a2ce640 1 -- 172.21.15.94:0/1376576485 learned_addr learned my addr 172.21.15.94:0/1376576485 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21aacf640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2140b1f40 0x7fb2140b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe574153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe574071c10 0x7fe5740b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe574154810 0x7fe5740b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe5740cf280 con 0x7fe57406e2a0 2024-09-11T23:15:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5740cf100 con 0x7fe574154810 2024-09-11T23:15:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57c374640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe5740cf400 con 0x7fe574071c10 2024-09-11T23:15:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 Processor -- start 2024-09-11T23:15:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57a110640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe574153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57a110640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe574153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40670/0 (socket says 172.21.15.94:40670) 2024-09-11T23:15:36.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57a110640 1 -- 172.21.15.94:0/3264845690 learned_addr learned my addr 172.21.15.94:0/3264845690 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:36.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57990f640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe574071c10 0x7fe5740b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fa46759e640 1 -- start start 2024-09-11T23:15:36.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fe57a911640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe574154810 0x7fe5740b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f4c7243b640 1 -- 172.21.15.94:0/347810225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 msgr2=0x7f4c6c0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7f4c7243b640 1 --2- 172.21.15.94:0/347810225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c0b3db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0ce860 tx=0x7f4c640301b0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21aacf640 1 -- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 msgr2=0x7fb214141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21aacf640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb214141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21aacf640 1 -- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb214144d60 msgr2=0x7fb214142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21aacf640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb214144d60 0x7fb214142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.976+0000 7fb21aacf640 1 -- 172.21.15.94:0/1376576485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2140b0ea0 con 0x7fb2140b1f40 2024-09-11T23:15:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 -- 172.21.15.94:0/347810225 shutdown_connections 2024-09-11T23:15:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 --2- 172.21.15.94:0/347810225 >> v2:172.21.15.94:3300/0 conn(0x7f4c6c0d3fd0 0x7f4c6c0d4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 --2- 172.21.15.94:0/347810225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c0b3db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 -- 172.21.15.94:0/347810225 >> 172.21.15.94:0/347810225 conn(0x7f4c6c08dc90 msgr2=0x7f4c6c09d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 Processor -- start 2024-09-11T23:15:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57a110640 1 -- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe574071c10 msgr2=0x7fe5740b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57a110640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe574071c10 0x7fe5740b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57a110640 1 -- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe574154810 msgr2=0x7fe5740b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57a110640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe574154810 0x7fe5740b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57a110640 1 -- 172.21.15.94:0/3264845690 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5740ccfc0 con 0x7fe57406e2a0 2024-09-11T23:15:37.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fb21aacf640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2140b1f40 0x7fb2140b23f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00efc0 tx=0x7fb20c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57a110640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe574153a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e870 tx=0x7fe56400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46806f6b0 0x7fa46815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4680b4ee0 0x7fa46815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46815b0d0 0x7fa46814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa46806be40 con 0x7fa46806f6b0 2024-09-11T23:15:37.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa46806bcc0 con 0x7fa46815b0d0 2024-09-11T23:15:37.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa46806bfc0 con 0x7fa4680b4ee0 2024-09-11T23:15:37.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30cb0b1640 1 Processor -- start 2024-09-11T23:15:37.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20bfff640 1 Processor -- start 2024-09-11T23:15:37.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46806f6b0 0x7fa46815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46806f6b0 0x7fa46815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40676/0 (socket says 172.21.15.94:40676) 2024-09-11T23:15:37.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 -- 172.21.15.94:0/1871034545 learned_addr learned my addr 172.21.15.94:0/1871034545 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 -- start start 2024-09-11T23:15:37.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30cb0b1640 1 -- start start 2024-09-11T23:15:37.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa465d9b640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4680b4ee0 0x7fa46815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 -- 172.21.15.94:0/347810225 shutdown_connections 2024-09-11T23:15:37.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de4035cb0 0x7f8de40e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8de4038780 0x7f8de404a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8de40572e0 0x7f8de40e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8de40096c0 con 0x7f8de40572e0 2024-09-11T23:15:37.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8de400c6b0 con 0x7f8de4038780 2024-09-11T23:15:37.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8df2e56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40557a0 con 0x7f8de4035cb0 2024-09-11T23:15:37.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 -- 172.21.15.94:0/347810225 wait complete. 2024-09-11T23:15:37.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 -- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4680b4ee0 msgr2=0x7fa46815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4680b4ee0 0x7fa46815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 -- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46815b0d0 msgr2=0x7fa46814a930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T23:15:37.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46815b0d0 0x7fa46814a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 -- 172.21.15.94:0/1871034545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa468165350 con 0x7fa46806f6b0 2024-09-11T23:15:37.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46659c640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46806f6b0 0x7fa46815e0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa45800e9d0 tx=0x7fa45800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fb20affd640 1 -- 172.21.15.94:0/1376576485 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c018020 con 0x7fb2140b1f40 2024-09-11T23:15:37.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fb20affd640 1 -- 172.21.15.94:0/1376576485 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c014480 con 0x7fb2140b1f40 2024-09-11T23:15:37.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fb20affd640 1 -- 172.21.15.94:0/1376576485 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c014870 con 0x7fb2140b1f40 2024-09-11T23:15:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20bfff640 1 -- start start 2024-09-11T23:15:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20bfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc20c15acd0 0x7fc20c072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c0b2c00 0x7fc20c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20bfff640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20c073520 con 0x7fc20c073080 2024-09-11T23:15:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20bfff640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc20c0b3590 con 0x7fc20c15acd0 2024-09-11T23:15:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20bfff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc20c073ae0 con 0x7fc20c0b2c00 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa456ffd640 1 -- 172.21.15.94:0/1871034545 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45800de60 con 0x7fa46806f6b0 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa456ffd640 1 -- 172.21.15.94:0/1871034545 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa458010440 con 0x7fa46806f6b0 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa456ffd640 1 -- 172.21.15.94:0/1871034545 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4580107f0 con 0x7fa46806f6b0 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe56affd640 1 -- 172.21.15.94:0/3264845690 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe564017070 con 0x7fe57406e2a0 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe56affd640 1 -- 172.21.15.94:0/3264845690 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe56400c940 con 0x7fe57406e2a0 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe56affd640 1 -- 172.21.15.94:0/3264845690 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56400ccf0 con 0x7fe57406e2a0 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57c374640 1 -- 172.21.15.94:0/3264845690 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe574163b10 con 0x7fe57406e2a0 2024-09-11T23:15:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57c374640 1 -- 172.21.15.94:0/3264845690 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe574163550 con 0x7fe57406e2a0 2024-09-11T23:15:37.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30cb0b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc005de0 0x7f30bc0d6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c0b2c00 0x7fc20c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c0b2c00 0x7fc20c0b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:38690/0 (socket says 172.21.15.94:38690) 2024-09-11T23:15:37.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20b7fe640 1 -- 172.21.15.94:0/178898907 learned_addr learned my addr 172.21.15.94:0/178898907 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20affd640 1 --2- 172.21.15.94:0/178898907 >> v2:172.21.15.155:3300/0 conn(0x7fc20c15acd0 0x7fc20c072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30cb0b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc04f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa468165630 con 0x7fa46806f6b0 2024-09-11T23:15:37.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46815cf20 con 0x7fa46806f6b0 2024-09-11T23:15:37.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fe57c374640 1 -- 172.21.15.94:0/3264845690 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5740ce3b0 con 0x7fe57406e2a0 2024-09-11T23:15:37.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 Processor -- start 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30ca0af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc005de0 0x7f30bc0d6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30ca0af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc005de0 0x7f30bc0d6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:38884/0 (socket says 172.21.15.94:38884) 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30ca0af640 1 -- 172.21.15.94:0/2490426306 learned_addr learned my addr 172.21.15.94:0/2490426306 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30c98ae640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc04f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 0x7f30bc036e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0066a0 con 0x7f30bc0e0d10 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc053bc0 con 0x7f30bc005de0 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc0de290 con 0x7f30bc034430 2024-09-11T23:15:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8de4038780 0x7f8de404a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8de4038780 0x7f8de404a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:38868/0 (socket says 172.21.15.94:38868) 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 -- 172.21.15.94:0/2102747069 learned_addr learned my addr 172.21.15.94:0/2102747069 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 -- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de4035cb0 msgr2=0x7f8de40e48e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de4035cb0 0x7f8de40e48e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 -- 172.21.15.94:0/2102747069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8de40572e0 msgr2=0x7f8de40e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8de40572e0 0x7f8de40e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 -- 172.21.15.94:0/2102747069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de404ac40 con 0x7f8de4038780 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f8debfff640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8de4038780 0x7f8de404a260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b3040 tx=0x7f8dd801b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f8de97fa640 1 -- 172.21.15.94:0/2102747069 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80b5040 con 0x7f8de4038780 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f8de97fa640 1 -- 172.21.15.94:0/2102747069 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd80b0440 con 0x7f8de4038780 2024-09-11T23:15:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f8de97fa640 1 -- 172.21.15.94:0/2102747069 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80b0810 con 0x7f8de4038780 2024-09-11T23:15:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2140b1180 con 0x7fb2140b1f40 2024-09-11T23:15:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2140b1740 con 0x7fb2140b1f40 2024-09-11T23:15:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20b7fe640 1 -- 172.21.15.94:0/178898907 >> v2:172.21.15.155:3300/0 conn(0x7fc20c15acd0 msgr2=0x7fc20c072b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20b7fe640 1 --2- 172.21.15.94:0/178898907 >> v2:172.21.15.155:3300/0 conn(0x7fc20c15acd0 0x7fc20c072b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20b7fe640 1 -- 172.21.15.94:0/178898907 >> v1:172.21.15.94:6789/0 conn(0x7fc20c073080 legacy=0x7fc20c070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7fc20b7fe640 1 -- 172.21.15.94:0/178898907 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c073800 con 0x7fc20c0b2c00 2024-09-11T23:15:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.980+0000 7f4c7243b640 1 -- start start 2024-09-11T23:15:37.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de404af20 con 0x7f8de4038780 2024-09-11T23:15:37.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de40e4e20 con 0x7f8de4038780 2024-09-11T23:15:37.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c7243b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30c98ae640 1 -- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc005de0 msgr2=0x7f30bc0d6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30c98ae640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc005de0 0x7f30bc0d6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30c98ae640 1 -- 172.21.15.94:0/2490426306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 msgr2=0x7f30bc036e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:15:37.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30c98ae640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 0x7f30bc036e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30c98ae640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0db390 con 0x7f30bc034430 2024-09-11T23:15:37.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fa456ffd640 1 -- 172.21.15.94:0/1871034545 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa458010990 con 0x7fa46806f6b0 2024-09-11T23:15:37.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fe56affd640 1 -- 172.21.15.94:0/3264845690 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe56401a070 con 0x7fe57406e2a0 2024-09-11T23:15:37.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c7243b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c6c0d3fd0 0x7f4c6c1ef100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c7243b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c6c15e360 0x7f4c6c0b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c7243b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0cfb20 con 0x7f4c6c15e360 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c7243b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0cf840 con 0x7f4c6c0b3960 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c7243b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b42f0 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c71439640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c71439640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c15b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:38900/0 (socket says 172.21.15.94:38900) 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c71439640 1 -- 172.21.15.94:0/3846102224 learned_addr learned my addr 172.21.15.94:0/3846102224 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c70c38640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c6c0d3fd0 0x7f4c6c1ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c71c3a640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c6c15e360 0x7f4c6c0b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30c98ae640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc04f3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00f0d0 tx=0x7f30b4019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2140b44e0 con 0x7fb2140b1f40 2024-09-11T23:15:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fe56affd640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe558067910 0x7fe558069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c70c38640 1 -- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 msgr2=0x7f4c6c15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c70c38640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c70c38640 1 -- 172.21.15.94:0/3846102224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c6c15e360 msgr2=0x7f4c6c0b90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c70c38640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c6c15e360 0x7f4c6c0b90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c70c38640 1 -- 172.21.15.94:0/3846102224 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c0b80a0 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c71c3a640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c6c15e360 0x7f4c6c0b90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c71439640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30baffd640 1 -- 172.21.15.94:0/2490426306 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40b9070 con 0x7f30bc034430 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30baffd640 1 -- 172.21.15.94:0/2490426306 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40b4640 con 0x7f30bc034430 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30baffd640 1 -- 172.21.15.94:0/2490426306 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40b0040 con 0x7f30bc034430 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc0dd520 con 0x7f30bc034430 2024-09-11T23:15:37.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc0db910 con 0x7f30bc034430 2024-09-11T23:15:37.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fe56affd640 1 -- 172.21.15.94:0/3264845690 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe5640548a0 con 0x7fe57406e2a0 2024-09-11T23:15:37.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fe57990f640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe558067910 0x7fe558069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fc20b7fe640 1 --2- 172.21.15.94:0/178898907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c0b2c00 0x7fc20c0b3050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc20400d150 tx=0x7fc20401eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f5b8f908af02bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fa456ffd640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa448067910 0x7fa448069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fa456ffd640 1 -- 172.21.15.94:0/1871034545 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa458086710 con 0x7fa46806f6b0 2024-09-11T23:15:37.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4680691c0 con 0x7fa46806f6b0 2024-09-11T23:15:37.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac0052a0 con 0x7f30bc034430 2024-09-11T23:15:37.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7f4c70c38640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c6c0d3fd0 0x7f4c6c1ef100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4c640bf000 tx=0x7f4c6402cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fc209ffb640 1 -- 172.21.15.94:0/178898907 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20400b2d0 con 0x7fc20c0b2c00 2024-09-11T23:15:37.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fc209ffb640 1 -- 172.21.15.94:0/178898907 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20400b470 con 0x7fc20c0b2c00 2024-09-11T23:15:37.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fa465d9b640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa448067910 0x7fa448069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4009180 con 0x7f8de4038780 2024-09-11T23:15:37.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fe57990f640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe558067910 0x7fe558069dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe570007e70 tx=0x7fe570007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5631fb1640 1 Processor -- start 2024-09-11T23:15:37.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- 172.21.15.94:0/178898907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c0b2c00 msgr2=0x7fc20c0b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 --2- 172.21.15.94:0/178898907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c0b2c00 0x7fc20c0b3050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc20400d150 tx=0x7fc20401eb50 comp rx=0 tx=0).stop 2024-09-11T23:15:37.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.984+0000 7fb20affd640 1 -- 172.21.15.94:0/1376576485 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb20c01b020 con 0x7fb2140b1f40 2024-09-11T23:15:37.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fb20affd640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1f8067910 0x7fb1f8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fb20affd640 1 -- 172.21.15.94:0/1376576485 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb20c087240 con 0x7fb2140b1f40 2024-09-11T23:15:37.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f8de97fa640 1 -- 172.21.15.94:0/2102747069 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8dd80c1020 con 0x7f8de4038780 2024-09-11T23:15:37.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- 172.21.15.94:0/178898907 shutdown_connections 2024-09-11T23:15:37.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 --2- 172.21.15.94:0/178898907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c0b2c00 0x7fc20c0b3050 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 --2- 172.21.15.94:0/178898907 >> v2:172.21.15.155:3300/0 conn(0x7fc20c15acd0 0x7fc20c072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- 172.21.15.94:0/178898907 >> 172.21.15.94:0/178898907 conn(0x7fc20c06ee40 msgr2=0x7fc20c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f4c61ffb640 1 -- 172.21.15.94:0/3846102224 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640d1020 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- 172.21.15.94:0/178898907 shutdown_connections 2024-09-11T23:15:37.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f4c61ffb640 1 -- 172.21.15.94:0/3846102224 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c640ca460 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f4c61ffb640 1 -- 172.21.15.94:0/3846102224 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640c5040 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fa465d9b640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa448067910 0x7fa448069dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa468073370 tx=0x7fa45c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f8de97fa640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8dd0067990 0x7f8dd0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f8de97fa640 1 -- 172.21.15.94:0/2102747069 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8dd8122a60 con 0x7f8de4038780 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5631fb1640 1 -- start start 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5631fb1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f562c0c57c0 0x7f562c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f562bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f562c0c57c0 0x7f562c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f562bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f562c0c57c0 0x7f562c06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40712/0 (socket says 172.21.15.94:40712) 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5630faf640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f562c165d80 0x7f562c0c50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36444/0 (socket says 172.21.15.94:36444) 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5631fb1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0b16c0 0x7f562c1661e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f562bfff640 1 -- 172.21.15.94:0/3204716865 learned_addr learned my addr 172.21.15.94:0/3204716865 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562c06d3b0 con 0x7f562c165d80 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f562c09aa00 con 0x7f562c0c57c0 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f56317b0640 1 --2- 172.21.15.94:0/3204716865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0b16c0 0x7f562c1661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f562c09b2a0 con 0x7f562c0b16c0 2024-09-11T23:15:37.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f30baffd640 1 -- 172.21.15.94:0/2490426306 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30b40b33c0 con 0x7f30bc034430 2024-09-11T23:15:37.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f30baffd640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30a8067990 0x7f30a8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f30baffd640 1 -- 172.21.15.94:0/2490426306 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f30b411f5c0 con 0x7f30bc034430 2024-09-11T23:15:37.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f30ca0af640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30a8067990 0x7f30a8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f8df0bf2640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8dd0067990 0x7f8dd0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- 172.21.15.94:0/178898907 wait complete. 2024-09-11T23:15:37.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 Processor -- start 2024-09-11T23:15:37.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c0b8310 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c0b88d0 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c6c15e740 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f30ca0af640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30a8067990 0x7f30a8069e50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0e3190 tx=0x7f30c0006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f8df0bf2640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8dd0067990 0x7f8dd0069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8dec06b5b0 tx=0x7f8dec074880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- start start 2024-09-11T23:15:37.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c073080 0x7fc20c206b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20c0b2c00 0x7fc20c164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20c15acd0 0x7fc20c164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15b230 con 0x7fc20c0b2c00 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15b0b0 con 0x7fc20c15acd0 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20bfff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc20c073ea0 con 0x7fc20c073080 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20c0b2c00 0x7fc20c164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20c0b2c00 0x7fc20c164290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40724/0 (socket says 172.21.15.94:40724) 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 -- 172.21.15.94:0/3191263081 learned_addr learned my addr 172.21.15.94:0/3191263081 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20affd640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c073080 0x7fc20c206b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20b7fe640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20c15acd0 0x7fc20c164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 -- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c073080 msgr2=0x7fc20c206b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c073080 0x7fc20c206b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 -- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20c15acd0 msgr2=0x7fc20c164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20c15acd0 0x7fc20c164dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7fc20a7fc640 1 -- 172.21.15.94:0/3191263081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c15c980 con 0x7fc20c0b2c00 2024-09-11T23:15:37.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.992+0000 7fc20a7fc640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20c0b2c00 0x7fc20c164290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b3e0 tx=0x7fc20000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f562bfff640 1 -- 172.21.15.94:0/3204716865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0b16c0 msgr2=0x7f562c1661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:37.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f562bfff640 1 --2- 172.21.15.94:0/3204716865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0b16c0 0x7f562c1661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f562bfff640 1 -- 172.21.15.94:0/3204716865 >> v1:172.21.15.94:6789/0 conn(0x7f562c165d80 legacy=0x7f562c0c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.988+0000 7f562bfff640 1 -- 172.21.15.94:0/3204716865 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c09ac50 con 0x7f562c0c57c0 2024-09-11T23:15:37.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.992+0000 7fb21a2ce640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1f8067910 0x7fb1f8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.992+0000 7f562bfff640 1 --2- 172.21.15.94:0/3204716865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c0c57c0 0x7f562c06cdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5618009870 tx=0x7f561801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a6f648be4af253 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.992+0000 7fe56affd640 1 -- 172.21.15.94:0/3264845690 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe564056800 con 0x7fe57406e2a0 2024-09-11T23:15:37.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.992+0000 7fb21a2ce640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1f8067910 0x7fb1f8069dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb210007fd0 tx=0x7fb210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:36.996+0000 7fb20affd640 1 -- 172.21.15.94:0/1376576485 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb20c022030 con 0x7fb2140b1f40 2024-09-11T23:15:37.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f562b7fe640 1 -- 172.21.15.94:0/3204716865 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56180b0070 con 0x7f562c0c57c0 2024-09-11T23:15:37.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7fc1f37fe640 1 -- 172.21.15.94:0/3191263081 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200015020 con 0x7fc20c0b2c00 2024-09-11T23:15:37.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7fa456ffd640 1 -- 172.21.15.94:0/1871034545 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4580568a0 con 0x7fa46806f6b0 2024-09-11T23:15:37.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f562b7fe640 1 -- 172.21.15.94:0/3204716865 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56180ab600 con 0x7f562c0c57c0 2024-09-11T23:15:37.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20c15cc60 con 0x7fc20c0b2c00 2024-09-11T23:15:37.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20c15d220 con 0x7fc20c0b2c00 2024-09-11T23:15:37.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7fc1f37fe640 1 -- 172.21.15.94:0/3191263081 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc200011830 con 0x7fc20c0b2c00 2024-09-11T23:15:37.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7fc1f37fe640 1 -- 172.21.15.94:0/3191263081 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200011be0 con 0x7fc20c0b2c00 2024-09-11T23:15:37.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f562b7fe640 1 -- 172.21.15.94:0/3204716865 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56180ab9d0 con 0x7f562c0c57c0 2024-09-11T23:15:37.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c0c57c0 msgr2=0x7f562c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 --2- 172.21.15.94:0/3204716865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c0c57c0 0x7f562c06cdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5618009870 tx=0x7f561801c560 comp rx=0 tx=0).stop 2024-09-11T23:15:37.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 shutdown_connections 2024-09-11T23:15:37.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 --2- 172.21.15.94:0/3204716865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0b16c0 0x7f562c1661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 --2- 172.21.15.94:0/3204716865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c0c57c0 0x7f562c06cdd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec0052a0 con 0x7fc20c0b2c00 2024-09-11T23:15:37.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 >> 172.21.15.94:0/3204716865 conn(0x7f562c0b3bd0 msgr2=0x7f562c0b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 shutdown_connections 2024-09-11T23:15:37.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.000+0000 7f5631fb1640 1 -- 172.21.15.94:0/3204716865 wait complete. 2024-09-11T23:15:37.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f8de97fa640 1 -- 172.21.15.94:0/2102747069 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8dd80c8020 con 0x7f8de4038780 2024-09-11T23:15:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f30baffd640 1 -- 172.21.15.94:0/2490426306 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f30b4016110 con 0x7f30bc034430 2024-09-11T23:15:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7fc1f37fe640 1 -- 172.21.15.94:0/3191263081 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc200018020 con 0x7fc20c0b2c00 2024-09-11T23:15:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7fc1f37fe640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1f80678f0 0x7fc1f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7fc1f37fe640 1 -- 172.21.15.94:0/3191263081 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc200085de0 con 0x7fc20c0b2c00 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 Processor -- start 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 -- start start 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f562c0b16c0 0x7f562c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0c57c0 0x7f562c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c158800 0x7f562c156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f562c16f700 con 0x7f562c158800 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f562c16f580 con 0x7f562c0b16c0 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5631fb1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f562c16f880 con 0x7f562c0c57c0 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f56317b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c158800 0x7f562c156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f56317b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c158800 0x7f562c156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40740/0 (socket says 172.21.15.94:40740) 2024-09-11T23:15:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f56317b0640 1 -- 172.21.15.94:0/70747877 learned_addr learned my addr 172.21.15.94:0/70747877 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f562bfff640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0c57c0 0x7f562c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.004+0000 7f5630faf640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f562c0b16c0 0x7f562c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7fc20affd640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1f80678f0 0x7fc1f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56317b0640 1 -- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0c57c0 msgr2=0x7f562c157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56317b0640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0c57c0 0x7f562c157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56317b0640 1 -- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f562c0b16c0 msgr2=0x7f562c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56317b0640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f562c0b16c0 0x7f562c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56317b0640 1 -- 172.21.15.94:0/70747877 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c0c96f0 con 0x7f562c158800 2024-09-11T23:15:37.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56317b0640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c158800 0x7f562c156600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f562400efc0 tx=0x7f562400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7fc20affd640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1f80678f0 0x7fc1f8069db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009b60 tx=0x7fc1fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56297fa640 1 -- 172.21.15.94:0/70747877 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624018020 con 0x7f562c158800 2024-09-11T23:15:37.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56297fa640 1 -- 172.21.15.94:0/70747877 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5624014480 con 0x7f562c158800 2024-09-11T23:15:37.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f56297fa640 1 -- 172.21.15.94:0/70747877 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624009e60 con 0x7f562c158800 2024-09-11T23:15:37.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562c0cbca0 con 0x7f562c158800 2024-09-11T23:15:37.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.008+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f562c0c86a0 con 0x7f562c158800 2024-09-11T23:15:37.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f4c61ffb640 1 -- 172.21.15.94:0/3846102224 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c640d4070 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562c09bc30 con 0x7f562c158800 2024-09-11T23:15:37.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7fc1f37fe640 1 -- 172.21.15.94:0/3191263081 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc20001f020 con 0x7fc20c0b2c00 2024-09-11T23:15:37.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f4c61ffb640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c500678c0 0x7f4c50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f4c61ffb640 1 -- 172.21.15.94:0/3846102224 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4c64134560 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f4c71439640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c500678c0 0x7f4c50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f4c71439640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c500678c0 0x7f4c50069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0c7c70 tx=0x7f4c68009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f56297fa640 1 -- 172.21.15.94:0/70747877 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f562401b020 con 0x7f562c158800 2024-09-11T23:15:37.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f56297fa640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56100678c0 0x7f5610069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:37.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f56297fa640 1 -- 172.21.15.94:0/70747877 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5624086c80 con 0x7f562c158800 2024-09-11T23:15:37.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.012+0000 7f5630faf640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56100678c0 0x7f5610069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:37.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.016+0000 7f5630faf640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56100678c0 0x7f5610069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5620000f70 tx=0x7f5620007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:37.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.016+0000 7f4c61ffb640 1 -- 172.21.15.94:0/3846102224 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c64029d10 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.016+0000 7f56297fa640 1 -- 172.21.15.94:0/70747877 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5624022030 con 0x7f562c158800 2024-09-11T23:15:37.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.308+0000 7fe57c374640 1 -- 172.21.15.94:0/3264845690 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe57406bdd0 con 0x7fe57406e2a0 2024-09-11T23:15:37.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.308+0000 7fe56affd640 1 -- 172.21.15.94:0/3264845690 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe56405ab00 con 0x7fe57406e2a0 2024-09-11T23:15:37.314 INFO:teuthology.orchestra.run.smithi094.stdout:55834574856 2024-09-11T23:15:37.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb21413fe70 con 0x7fb2140b1f40 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 -- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe558067910 msgr2=0x7fe558069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe558067910 0x7fe558069dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe570007e70 tx=0x7fe570007e00 comp rx=0 tx=0).stop 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 -- 172.21.15.94:0/3264845690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 msgr2=0x7fe574153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe574153a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e870 tx=0x7fe56400ec70 comp rx=0 tx=0).stop 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 -- 172.21.15.94:0/3264845690 shutdown_connections 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe574154810 0x7fe5740b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe574071c10 0x7fe5740b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe558067910 0x7fe558069dd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 --2- 172.21.15.94:0/3264845690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe57406e2a0 0x7fe574153a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 -- 172.21.15.94:0/3264845690 >> 172.21.15.94:0/3264845690 conn(0x7fe57406f420 msgr2=0x7fe57415b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 -- 172.21.15.94:0/3264845690 shutdown_connections 2024-09-11T23:15:37.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fe568ff9640 1 -- 172.21.15.94:0/3264845690 wait complete. 2024-09-11T23:15:37.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.316+0000 7fb20affd640 1 -- 172.21.15.94:0/1376576485 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb20c010040 con 0x7fb2140b1f40 2024-09-11T23:15:37.321 INFO:teuthology.orchestra.run.smithi094.stdout:55834574857 2024-09-11T23:15:37.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8de4049b70 con 0x7f8de4038780 2024-09-11T23:15:37.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1f8067910 msgr2=0x7fb1f8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1f8067910 0x7fb1f8069dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb210007fd0 tx=0x7fb210009040 comp rx=0 tx=0).stop 2024-09-11T23:15:37.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2140b1f40 msgr2=0x7fb2140b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2140b1f40 0x7fb2140b23f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00efc0 tx=0x7fb20c00c490 comp rx=0 tx=0).stop 2024-09-11T23:15:37.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 shutdown_connections 2024-09-11T23:15:37.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1f8067910 0x7fb1f8069dd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2140b1f40 0x7fb2140b23f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb214144d60 0x7fb214142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 --2- 172.21.15.94:0/1376576485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b4ba0 0x7fb214141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 >> 172.21.15.94:0/1376576485 conn(0x7fb21409aa00 msgr2=0x7fb214165080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 shutdown_connections 2024-09-11T23:15:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7fb21c532640 1 -- 172.21.15.94:0/1376576485 wait complete. 2024-09-11T23:15:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.324+0000 7f8de97fa640 1 -- 172.21.15.94:0/2102747069 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8dd8018750 con 0x7f8de4038780 2024-09-11T23:15:37.328 INFO:teuthology.orchestra.run.smithi094.stdout:55834574856 2024-09-11T23:15:37.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa46806f170 con 0x7fa46806f6b0 2024-09-11T23:15:37.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8dd0067990 msgr2=0x7f8dd0069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8dd0067990 0x7f8dd0069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8dec06b5b0 tx=0x7f8dec074880 comp rx=0 tx=0).stop 2024-09-11T23:15:37.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8de4038780 msgr2=0x7f8de404a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8de4038780 0x7f8de404a260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b3040 tx=0x7f8dd801b990 comp rx=0 tx=0).stop 2024-09-11T23:15:37.334 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:37.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7fa456ffd640 1 -- 172.21.15.94:0/1871034545 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa45805aba0 con 0x7fa46806f6b0 2024-09-11T23:15:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 shutdown_connections 2024-09-11T23:15:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8dd0067990 0x7f8dd0069e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8de40572e0 0x7f8de40e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8de4038780 0x7f8de404a260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 --2- 172.21.15.94:0/2102747069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8de4035cb0 0x7f8de40e48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 >> 172.21.15.94:0/2102747069 conn(0x7f8de40567c0 msgr2=0x7f8de4054eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 shutdown_connections 2024-09-11T23:15:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.332+0000 7f8df2e56640 1 -- 172.21.15.94:0/2102747069 wait complete. 2024-09-11T23:15:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa448067910 msgr2=0x7fa448069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa448067910 0x7fa448069dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa468073370 tx=0x7fa45c009240 comp rx=0 tx=0).stop 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46806f6b0 msgr2=0x7fa46815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46806f6b0 0x7fa46815e0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa45800e9d0 tx=0x7fa45800ee90 comp rx=0 tx=0).stop 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 shutdown_connections 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46815b0d0 0x7fa46814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4680b4ee0 0x7fa46815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa448067910 0x7fa448069dd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 --2- 172.21.15.94:0/1871034545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46806f6b0 0x7fa46815e0b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 >> 172.21.15.94:0/1871034545 conn(0x7fa4680cd970 msgr2=0x7fa4681542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 shutdown_connections 2024-09-11T23:15:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7fa46759e640 1 -- 172.21.15.94:0/1871034545 wait complete. 2024-09-11T23:15:37.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4c6c06ccf0 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.336+0000 7f4c61ffb640 1 -- 172.21.15.94:0/3846102224 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c64104940 con 0x7f4c6c0d3fd0 2024-09-11T23:15:37.340 INFO:teuthology.orchestra.run.smithi094.stdout:55834574857 2024-09-11T23:15:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.340+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc1ec005590 con 0x7fc20c0b2c00 2024-09-11T23:15:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.340+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f562c0b8060 con 0x7f562c158800 2024-09-11T23:15:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.340+0000 7fc1f37fe640 1 -- 172.21.15.94:0/3191263081 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2000565d0 con 0x7fc20c0b2c00 2024-09-11T23:15:37.342 INFO:teuthology.orchestra.run.smithi094.stdout:55834574857 2024-09-11T23:15:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.340+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c500678c0 msgr2=0x7f4c50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c500678c0 0x7f4c50069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0c7c70 tx=0x7f4c68009110 comp rx=0 tx=0).stop 2024-09-11T23:15:37.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c6c0d3fd0 msgr2=0x7f4c6c1ef100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c6c0d3fd0 0x7f4c6c1ef100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4c640bf000 tx=0x7f4c6402cf50 comp rx=0 tx=0).stop 2024-09-11T23:15:37.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f56297fa640 1 -- 172.21.15.94:0/70747877 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5624010040 con 0x7f562c158800 2024-09-11T23:15:37.347 INFO:teuthology.orchestra.run.smithi094.stdout:55834574857 2024-09-11T23:15:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 shutdown_connections 2024-09-11T23:15:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f30ac005860 con 0x7f30bc034430 2024-09-11T23:15:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f30baffd640 1 -- 172.21.15.94:0/2490426306 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30b40ef7e0 con 0x7f30bc034430 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1f80678f0 msgr2=0x7fc1f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1f80678f0 0x7fc1f8069db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009b60 tx=0x7fc1fc009190 comp rx=0 tx=0).stop 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20c0b2c00 msgr2=0x7fc20c164290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20c0b2c00 0x7fc20c164290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b3e0 tx=0x7fc20000b8a0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 shutdown_connections 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20c15acd0 0x7fc20c164dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1f80678f0 0x7fc1f8069db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20c0b2c00 0x7fc20c164290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 --2- 172.21.15.94:0/3191263081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20c073080 0x7fc20c206b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 >> 172.21.15.94:0/3191263081 conn(0x7fc20c06ee40 msgr2=0x7fc20c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 shutdown_connections 2024-09-11T23:15:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7fc20bfff640 1 -- 172.21.15.94:0/3191263081 wait complete. 2024-09-11T23:15:37.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-09-11T23:15:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c500678c0 0x7f4c50069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.351 INFO:teuthology.orchestra.run.smithi094.stdout:55834574856 2024-09-11T23:15:37.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c6c15e360 0x7f4c6c0b90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c6c0d3fd0 0x7f4c6c1ef100 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 --2- 172.21.15.94:0/3846102224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6c0b3960 0x7f4c6c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 >> 172.21.15.94:0/3846102224 conn(0x7f4c6c08dc90 msgr2=0x7f4c6c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.344+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 shutdown_connections 2024-09-11T23:15:37.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56100678c0 msgr2=0x7f5610069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f4c7243b640 1 -- 172.21.15.94:0/3846102224 wait complete. 2024-09-11T23:15:37.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56100678c0 0x7f5610069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5620000f70 tx=0x7f5620007e50 comp rx=0 tx=0).stop 2024-09-11T23:15:37.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c158800 msgr2=0x7f562c156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c158800 0x7f562c156600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f562400efc0 tx=0x7f562400c490 comp rx=0 tx=0).stop 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 shutdown_connections 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56100678c0 0x7f5610069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f562c158800 0x7f562c156600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f562c0c57c0 0x7f562c157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 --2- 172.21.15.94:0/70747877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f562c0b16c0 0x7f562c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 >> 172.21.15.94:0/70747877 conn(0x7f562c0b3bd0 msgr2=0x7f562c15f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 shutdown_connections 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.348+0000 7f5631fb1640 1 -- 172.21.15.94:0/70747877 wait complete. 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30a8067990 msgr2=0x7f30a8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30a8067990 0x7f30a8069e50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0e3190 tx=0x7f30c0006f90 comp rx=0 tx=0).stop 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 msgr2=0x7f30bc04f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc04f3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00f0d0 tx=0x7f30b4019230 comp rx=0 tx=0).stop 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 shutdown_connections 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30a8067990 0x7f30a8069e50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30bc0e0d10 0x7f30bc036e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc034430 0x7f30bc04f3c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 --2- 172.21.15.94:0/2490426306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc005de0 0x7f30bc0d6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 >> 172.21.15.94:0/2490426306 conn(0x7f30bc01e1d0 msgr2=0x7f30bc039af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 shutdown_connections 2024-09-11T23:15:37.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:37.352+0000 7f30cb0b1640 1 -- 172.21.15.94:0/2490426306 wait complete. 2024-09-11T23:15:37.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-09-11T23:15:37.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-09-11T23:15:37.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-09-11T23:15:37.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-09-11T23:15:37.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-09-11T23:15:37.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-09-11T23:15:37.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-09-11T23:15:38.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T23:15:38.360 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T23:15:38.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T23:15:38.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T23:15:38.377 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T23:15:38.378 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T23:15:38.380 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T23:15:38.383 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T23:15:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.528+0000 7fb979248640 1 Processor -- start 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.528+0000 7fb979248640 1 -- start start 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb979248640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb97415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb979248640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9740b2fd0 0x7fb9740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb979248640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97415aec0 con 0x7fb974072db0 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb979248640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb97415b1a0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb979248640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb97415b480 con 0x7fb97415a200 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb97259c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb974072db0 0x7fb974072340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36460/0 (socket says 172.21.15.94:36460) 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb97259c640 1 -- 172.21.15.94:0/695254713 learned_addr learned my addr 172.21.15.94:0/695254713 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb972d9d640 1 --2- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb97415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb97359e640 1 --2- 172.21.15.94:0/695254713 >> v2:172.21.15.155:3300/0 conn(0x7fb9740b2fd0 0x7fb9740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb97359e640 1 -- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 msgr2=0x7fb97415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb97359e640 1 --2- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb97415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb97359e640 1 -- 172.21.15.94:0/695254713 >> v1:172.21.15.94:6789/0 conn(0x7fb974072db0 legacy=0x7fb974072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.532+0000 7fb97359e640 1 -- 172.21.15.94:0/695254713 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb974071e20 con 0x7fb9740b2fd0 2024-09-11T23:15:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb97359e640 1 --2- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740b2fd0 0x7fb9740b3480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c980 tx=0x7fb96401e740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b429e0dd8242dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb971d9b640 1 -- 172.21.15.94:0/695254713 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9640ad070 con 0x7fb9740b2fd0 2024-09-11T23:15:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb971d9b640 1 -- 172.21.15.94:0/695254713 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9640a7770 con 0x7fb9740b2fd0 2024-09-11T23:15:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 -- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740b2fd0 msgr2=0x7fb9740b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 --2- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740b2fd0 0x7fb9740b3480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c980 tx=0x7fb96401e740 comp rx=0 tx=0).stop 2024-09-11T23:15:38.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 -- 172.21.15.94:0/695254713 shutdown_connections 2024-09-11T23:15:38.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 --2- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740b2fd0 0x7fb9740b3480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 --2- 172.21.15.94:0/695254713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb97415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 -- 172.21.15.94:0/695254713 >> 172.21.15.94:0/695254713 conn(0x7fb9740b1cd0 msgr2=0x7fb9740b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 -- 172.21.15.94:0/695254713 shutdown_connections 2024-09-11T23:15:38.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.536+0000 7fb979248640 1 -- 172.21.15.94:0/695254713 wait complete. 2024-09-11T23:15:38.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 Processor -- start 2024-09-11T23:15:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 -- start start 2024-09-11T23:15:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb974072db0 0x7fb9740aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9740b2fd0 0x7fb9742005b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb974200af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb974072bd0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb974072a50 con 0x7fb974072db0 2024-09-11T23:15:38.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb979248640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9740b27f0 con 0x7fb97415a200 2024-09-11T23:15:38.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb97259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9740b2fd0 0x7fb9742005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb97259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9740b2fd0 0x7fb9742005b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40752/0 (socket says 172.21.15.94:40752) 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb97259c640 1 -- 172.21.15.94:0/1863859339 learned_addr learned my addr 172.21.15.94:0/1863859339 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb972d9d640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb974072db0 0x7fb9740aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.540+0000 7fb97359e640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb974200af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb97259c640 1 -- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 msgr2=0x7fb974200af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb97259c640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb974200af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb97259c640 1 -- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb974072db0 msgr2=0x7fb9740aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb97259c640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb974072db0 0x7fb9740aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb97259c640 1 -- 172.21.15.94:0/1863859339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9740aaa20 con 0x7fb9740b2fd0 2024-09-11T23:15:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb97259c640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9740b2fd0 0x7fb9742005b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb968009e80 tx=0x7fb96800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb95b7fe640 1 -- 172.21.15.94:0/1863859339 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968019070 con 0x7fb9740b2fd0 2024-09-11T23:15:38.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb979248640 1 -- 172.21.15.94:0/1863859339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9740aad00 con 0x7fb9740b2fd0 2024-09-11T23:15:38.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.544+0000 7fb979248640 1 -- 172.21.15.94:0/1863859339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9740ab2c0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.548+0000 7fb95b7fe640 1 -- 172.21.15.94:0/1863859339 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9680078f0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.548+0000 7fb95b7fe640 1 -- 172.21.15.94:0/1863859339 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968007ce0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.548+0000 7fb979248640 1 -- 172.21.15.94:0/1863859339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97415a5e0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.548+0000 7fb95b7fe640 1 -- 172.21.15.94:0/1863859339 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb96801c070 con 0x7fb9740b2fd0 2024-09-11T23:15:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.548+0000 7fb95b7fe640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb960067990 0x7fb960069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.548+0000 7fb95b7fe640 1 -- 172.21.15.94:0/1863859339 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb968087cc0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.548+0000 7fb972d9d640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb960067990 0x7fb960069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.552+0000 7fb972d9d640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb960067990 0x7fb960069e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb974159810 tx=0x7fb96c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.556+0000 7fb95b7fe640 1 -- 172.21.15.94:0/1863859339 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb968057e50 con 0x7fb9740b2fd0 2024-09-11T23:15:38.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d97410640 1 Processor -- start 2024-09-11T23:15:38.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d97410640 1 -- start start 2024-09-11T23:15:38.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d97410640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9d90147c90 0x7f9d900b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d97410640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d9006f9b0 0x7f9d900b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d97410640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d900b45d0 con 0x7f9d9006bcc0 2024-09-11T23:15:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d97410640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9d90148070 con 0x7f9d90147c90 2024-09-11T23:15:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d97410640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9d90070830 con 0x7f9d9006f9b0 2024-09-11T23:15:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb7279640 1 Processor -- start 2024-09-11T23:15:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb7279640 1 -- start start 2024-09-11T23:15:38.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d951ac640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9d90147c90 0x7f9d900b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d951ac640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9d90147c90 0x7f9d900b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40758/0 (socket says 172.21.15.94:40758) 2024-09-11T23:15:38.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d951ac640 1 -- 172.21.15.94:0/2991658600 learned_addr learned my addr 172.21.15.94:0/2991658600 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d949ab640 1 --2- 172.21.15.94:0/2991658600 >> v2:172.21.15.155:3300/0 conn(0x7f9d9006f9b0 0x7f9d900b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d951ac640 1 -- 172.21.15.94:0/2991658600 >> v2:172.21.15.155:3300/0 conn(0x7f9d9006f9b0 msgr2=0x7f9d900b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d951ac640 1 --2- 172.21.15.94:0/2991658600 >> v2:172.21.15.155:3300/0 conn(0x7f9d9006f9b0 0x7f9d900b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d951ac640 1 -- 172.21.15.94:0/2991658600 >> v1:172.21.15.155:6789/0 conn(0x7f9d9006bcc0 legacy=0x7f9d900ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d951ac640 1 -- 172.21.15.94:0/2991658600 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d900b5af0 con 0x7f9d90147c90 2024-09-11T23:15:38.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f9d949ab640 1 --2- 172.21.15.94:0/2991658600 >> v2:172.21.15.155:3300/0 conn(0x7f9d9006f9b0 0x7f9d900b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:15:38.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb7279640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa8050e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb7279640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa80e4a40 con 0x7fefa80356a0 2024-09-11T23:15:38.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb7279640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa80e4d20 con 0x7fefa8036280 2024-09-11T23:15:38.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb7279640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fefa80e47f0 con 0x7fefa8052c40 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb6a78640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fefa80356a0 0x7fefa80513c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36472/0 (socket says 172.21.15.94:36472) 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7fefb6a78640 1 -- 172.21.15.94:0/2975018752 learned_addr learned my addr 172.21.15.94:0/2975018752 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7fefb5a76640 1 --2- 172.21.15.94:0/2975018752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa8050e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7fefb5275640 1 -- 172.21.15.94:0/2975018752 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093783339 0 0) 0x7fefa80e4a40 con 0x7fefa80356a0 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7fefb5275640 1 -- 172.21.15.94:0/2975018752 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef9c003530 con 0x7fefa80356a0 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26dc116640 1 Processor -- start 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26dc116640 1 -- start start 2024-09-11T23:15:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7fefb5a76640 1 -- 172.21.15.94:0/2975018752 >> v1:172.21.15.155:6789/0 conn(0x7fefa8036280 legacy=0x7fefa8052530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7fefb5a76640 1 -- 172.21.15.94:0/2975018752 >> v1:172.21.15.94:6789/0 conn(0x7fefa80356a0 legacy=0x7fefa80513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7fefb5a76640 1 -- 172.21.15.94:0/2975018752 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa80e5000 con 0x7fefa8052c40 2024-09-11T23:15:38.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d951ac640 1 --2- 172.21.15.94:0/2991658600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d90147c90 0x7f9d900b5fd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d90073d00 tx=0x7f9d8c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28ba2b110a05e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d87fff640 1 -- 172.21.15.94:0/2991658600 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0ab660 con 0x7f9d90147c90 2024-09-11T23:15:38.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26dc116640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f26d40b50c0 0x7f26d40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26dc116640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d40ae780 con 0x7f26d406d3e0 2024-09-11T23:15:38.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26dc116640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d4158ce0 con 0x7f26d4158900 2024-09-11T23:15:38.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26dc116640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f26d40b5730 con 0x7f26d40b50c0 2024-09-11T23:15:38.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d87fff640 1 -- 172.21.15.94:0/2991658600 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0b0070 con 0x7f9d90147c90 2024-09-11T23:15:38.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d87fff640 1 -- 172.21.15.94:0/2991658600 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0aba20 con 0x7f9d90147c90 2024-09-11T23:15:38.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26d9eb2640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f26d4158900 0x7f26d406ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:41674/0 (socket says 172.21.15.94:41674) 2024-09-11T23:15:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26d9eb2640 1 -- 172.21.15.94:0/874287371 learned_addr learned my addr 172.21.15.94:0/874287371 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26da6b3640 1 --2- 172.21.15.94:0/874287371 >> v2:172.21.15.94:3300/0 conn(0x7f26d40b50c0 0x7f26d40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d97410640 1 -- 172.21.15.94:0/2991658600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d90147c90 msgr2=0x7f9d900b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d97410640 1 --2- 172.21.15.94:0/2991658600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d90147c90 0x7f9d900b5fd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d90073d00 tx=0x7f9d8c01c460 comp rx=0 tx=0).stop 2024-09-11T23:15:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26da6b3640 1 -- 172.21.15.94:0/874287371 >> v1:172.21.15.155:6789/0 conn(0x7f26d4158900 legacy=0x7f26d406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26da6b3640 1 -- 172.21.15.94:0/874287371 >> v1:172.21.15.94:6789/0 conn(0x7f26d406d3e0 legacy=0x7f26d40b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f26da6b3640 1 -- 172.21.15.94:0/874287371 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d415e960 con 0x7f26d40b50c0 2024-09-11T23:15:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f5d4772a640 1 Processor -- start 2024-09-11T23:15:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f5d4772a640 1 -- start start 2024-09-11T23:15:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d97410640 1 -- 172.21.15.94:0/2991658600 shutdown_connections 2024-09-11T23:15:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d97410640 1 --2- 172.21.15.94:0/2991658600 >> v2:172.21.15.155:3300/0 conn(0x7f9d9006f9b0 0x7f9d900b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d97410640 1 --2- 172.21.15.94:0/2991658600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d90147c90 0x7f9d900b5fd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f9d97410640 1 -- 172.21.15.94:0/2991658600 >> 172.21.15.94:0/2991658600 conn(0x7f9d9009aa00 msgr2=0x7f9d900b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7fefb5a76640 1 --2- 172.21.15.94:0/2975018752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa8050e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefa80e4970 tx=0x7fefac01c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aff8d8033481667 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 -- 172.21.15.94:0/2991658600 shutdown_connections 2024-09-11T23:15:38.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5275640 1 -- 172.21.15.94:0/2975018752 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac0b1070 con 0x7fefa8052c40 2024-09-11T23:15:38.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5275640 1 -- 172.21.15.94:0/2975018752 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefac0ac640 con 0x7fefa8052c40 2024-09-11T23:15:38.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5275640 1 -- 172.21.15.94:0/2975018752 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac0ac9f0 con 0x7fefa8052c40 2024-09-11T23:15:38.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- 172.21.15.94:0/2975018752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 msgr2=0x7fefa8050e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 --2- 172.21.15.94:0/2975018752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa8050e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefa80e4970 tx=0x7fefac01c2f0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d4772a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 0x7f5d400b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d4772a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5d400b50c0 0x7f5d4006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- 172.21.15.94:0/2975018752 shutdown_connections 2024-09-11T23:15:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 --2- 172.21.15.94:0/2975018752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa8050e80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- 172.21.15.94:0/2975018752 >> 172.21.15.94:0/2975018752 conn(0x7fefa801ea50 msgr2=0x7fefa80556f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- 172.21.15.94:0/2975018752 shutdown_connections 2024-09-11T23:15:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d45cc7640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5d4006d210 0x7f5d40161e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36484/0 (socket says 172.21.15.94:36484) 2024-09-11T23:15:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d45cc7640 1 -- 172.21.15.94:0/3430828238 learned_addr learned my addr 172.21.15.94:0/3430828238 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- 172.21.15.94:0/2975018752 wait complete. 2024-09-11T23:15:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d454c6640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 0x7f5d400b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3430828238 >> v2:172.21.15.155:3300/0 conn(0x7f5d400b50c0 0x7f5d4006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d400ae780 con 0x7f5d4006d210 2024-09-11T23:15:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 -- 172.21.15.94:0/2991658600 wait complete. 2024-09-11T23:15:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5d400b57a0 con 0x7f5d400b50c0 2024-09-11T23:15:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 Processor -- start 2024-09-11T23:15:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d400b5520 con 0x7f5d40158a90 2024-09-11T23:15:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029351076 0 0) 0x7f5d380014a0 con 0x7f5d4006d210 2024-09-11T23:15:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2c003530 con 0x7f5d4006d210 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4276959210 0 0) 0x7f5d2c003530 con 0x7f5d4006d210 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 msgr2=0x7f5d400b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 0x7f5d400b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 >> v2:172.21.15.155:3300/0 conn(0x7f5d400b50c0 msgr2=0x7f5d4006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 --2- 172.21.15.94:0/3430828238 >> v2:172.21.15.155:3300/0 conn(0x7f5d400b50c0 0x7f5d4006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4015e960 con 0x7f5d4006d210 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f5d38001bd0 con 0x7f5d4006d210 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 >> v1:172.21.15.94:6789/0 conn(0x7f5d4006d210 legacy=0x7f5d40161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c0039c0 0x7f5d2c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d2c004810 0x7f5d2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 0x7f5d2c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400b57a0 con 0x7f5d2c0039c0 2024-09-11T23:15:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400b5520 con 0x7f5d2c004810 2024-09-11T23:15:38.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c0141e0 con 0x7f5d40158a90 2024-09-11T23:15:38.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f26da6b3640 1 --2- 172.21.15.94:0/874287371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d40b50c0 0x7f26d40b5b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009d90 tx=0x7f26cc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bd1af88b77a26b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d2c004810 0x7f5d2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d454c6640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c0039c0 0x7f5d2c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 -- start start 2024-09-11T23:15:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d9006bcc0 0x7f9d901449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 Processor -- start 2024-09-11T23:15:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- start start 2024-09-11T23:15:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9006f9b0 0x7f9d9009e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d90147c90 0x7f9d901f9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9006c4e0 con 0x7f9d9006f9b0 2024-09-11T23:15:38.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9016b0e0 con 0x7f9d9006bcc0 2024-09-11T23:15:38.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d97410640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9009c7f0 con 0x7f9d90147c90 2024-09-11T23:15:38.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d45cc7640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 0x7f5d2c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9006f9b0 0x7f9d9009e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9006f9b0 0x7f9d9009e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40796/0 (socket says 172.21.15.94:40796) 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 -- 172.21.15.94:0/1802450439 learned_addr learned my addr 172.21.15.94:0/1802450439 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d951ac640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d9006bcc0 0x7f9d901449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d959ad640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d90147c90 0x7f9d901f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d44cc5640 1 -- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 msgr2=0x7f5d2c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40158a90 0x7f5d2c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d44cc5640 1 -- 172.21.15.94:0/3430828238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c0039c0 msgr2=0x7f5d2c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c0039c0 0x7f5d2c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f5d44cc5640 1 -- 172.21.15.94:0/3430828238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c003530 con 0x7f5d2c004810 2024-09-11T23:15:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 -- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d90147c90 msgr2=0x7f9d901f9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d90147c90 0x7f9d901f9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa80356a0 0x7fefa8007d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefa8036280 0x7fefa804d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 -- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d9006bcc0 msgr2=0x7f9d901449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d9006bcc0 0x7f9d901449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 -- 172.21.15.94:0/1802450439 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9009cad0 con 0x7f9d9006f9b0 2024-09-11T23:15:38.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa804d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fefa8036660 con 0x7fefa8036280 2024-09-11T23:15:38.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fefa80e5370 con 0x7fefa80356a0 2024-09-11T23:15:38.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb7279640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fefa80367e0 con 0x7fefa8052c40 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefa8036280 0x7fefa804d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefa8036280 0x7fefa804d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40812/0 (socket says 172.21.15.94:40812) 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb6a78640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa804d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 -- 172.21.15.94:0/231055762 learned_addr learned my addr 172.21.15.94:0/231055762 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb6277640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa80356a0 0x7fefa8007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 -- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 msgr2=0x7fefa804d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa804d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 -- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa80356a0 msgr2=0x7fefa8007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7f9d949ab640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9006f9b0 0x7f9d9009e8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000d800 tx=0x7f9d8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa80356a0 0x7fefa8007d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.584+0000 7fefb5a76640 1 -- 172.21.15.94:0/231055762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa804de20 con 0x7fefa8036280 2024-09-11T23:15:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f9d85ffb640 1 -- 172.21.15.94:0/1802450439 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80018020 con 0x7f9d9006f9b0 2024-09-11T23:15:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26d8eb0640 1 -- 172.21.15.94:0/874287371 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0b1070 con 0x7f26d40b50c0 2024-09-11T23:15:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefb5a76640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefa8036280 0x7fefa804d1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fefac000c10 tx=0x7fefac019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26d8eb0640 1 -- 172.21.15.94:0/874287371 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26cc0a4b90 con 0x7f26d40b50c0 2024-09-11T23:15:38.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f3e38599640 1 Processor -- start 2024-09-11T23:15:38.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.576+0000 7f3e38599640 1 -- start start 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e38599640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e3006f020 0x7f3e3006f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e38599640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3e300b3e10 0x7f3e30071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e38599640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e3016c1f0 con 0x7f3e30072380 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e38599640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f3e300b3980 con 0x7f3e300b3e10 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e38599640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3e3006f940 con 0x7f3e3006f020 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e35b34640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3e300b3e10 0x7f3e30071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e35b34640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3e300b3e10 0x7f3e30071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40768/0 (socket says 172.21.15.94:40768) 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e35b34640 1 -- 172.21.15.94:0/69459046 learned_addr learned my addr 172.21.15.94:0/69459046 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e36335640 1 --2- 172.21.15.94:0/69459046 >> v2:172.21.15.155:3300/0 conn(0x7f3e3006f020 0x7f3e3006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.580+0000 7f3e35333640 1 -- 172.21.15.94:0/69459046 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304116221 0 0) 0x7f3e3016c1f0 con 0x7f3e30072380 2024-09-11T23:15:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26dc116640 1 -- 172.21.15.94:0/874287371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d40b50c0 msgr2=0x7f26d40b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26dc116640 1 --2- 172.21.15.94:0/874287371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d40b50c0 0x7f26d40b5b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009d90 tx=0x7f26cc01c390 comp rx=0 tx=0).stop 2024-09-11T23:15:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9009cdb0 con 0x7f9d9006f9b0 2024-09-11T23:15:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d90144ee0 con 0x7f9d9006f9b0 2024-09-11T23:15:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f9d85ffb640 1 -- 172.21.15.94:0/1802450439 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d800096c0 con 0x7f9d9006f9b0 2024-09-11T23:15:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f3e35333640 1 -- 172.21.15.94:0/69459046 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e1c003dc0 con 0x7f3e30072380 2024-09-11T23:15:38.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f9d85ffb640 1 -- 172.21.15.94:0/1802450439 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80009ab0 con 0x7f9d9006f9b0 2024-09-11T23:15:38.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefa6ffd640 1 -- 172.21.15.94:0/231055762 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac0bc020 con 0x7fefa8036280 2024-09-11T23:15:38.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefa6ffd640 1 -- 172.21.15.94:0/231055762 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefac0044e0 con 0x7fefa8036280 2024-09-11T23:15:38.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa804e100 con 0x7fefa8036280 2024-09-11T23:15:38.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefa6ffd640 1 -- 172.21.15.94:0/231055762 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac0b1040 con 0x7fefa8036280 2024-09-11T23:15:38.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa804e6c0 con 0x7fefa8036280 2024-09-11T23:15:38.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f3e35b34640 1 -- 172.21.15.94:0/69459046 >> v2:172.21.15.155:3300/0 conn(0x7f3e3006f020 msgr2=0x7f3e3006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f3e35b34640 1 --2- 172.21.15.94:0/69459046 >> v2:172.21.15.155:3300/0 conn(0x7f3e3006f020 0x7f3e3006f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f3e35b34640 1 -- 172.21.15.94:0/69459046 >> v1:172.21.15.155:6789/0 conn(0x7f3e30072380 legacy=0x7f3e3016c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f3e35b34640 1 -- 172.21.15.94:0/69459046 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e300b3070 con 0x7f3e300b3e10 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d2c004810 0x7f5d2c004c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009ab0 tx=0x7f5d3001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9156920a4fc3f729 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d300096b0 con 0x7f5d2c004810 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d300b0400 con 0x7f5d2c004810 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d37fff640 1 -- 172.21.15.94:0/3430828238 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d300b07b0 con 0x7f5d2c004810 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26dc116640 1 -- 172.21.15.94:0/874287371 shutdown_connections 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26dc116640 1 --2- 172.21.15.94:0/874287371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d40b50c0 0x7f26d40b5b70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26dc116640 1 -- 172.21.15.94:0/874287371 >> 172.21.15.94:0/874287371 conn(0x7f26d4072670 msgr2=0x7f26d4072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26dc116640 1 -- 172.21.15.94:0/874287371 shutdown_connections 2024-09-11T23:15:38.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d2c004810 msgr2=0x7f5d2c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d4772a640 1 --2- 172.21.15.94:0/3430828238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d2c004810 0x7f5d2c004c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009ab0 tx=0x7f5d3001ca30 comp rx=0 tx=0).stop 2024-09-11T23:15:38.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d45cc7640 1 -- 172.21.15.94:0/3430828238 reap_dead start 2024-09-11T23:15:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 shutdown_connections 2024-09-11T23:15:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 >> 172.21.15.94:0/3430828238 conn(0x7f5d40072670 msgr2=0x7f5d40072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 shutdown_connections 2024-09-11T23:15:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f5d4772a640 1 -- 172.21.15.94:0/3430828238 wait complete. 2024-09-11T23:15:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f9d85ffb640 1 -- 172.21.15.94:0/1802450439 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d8001b020 con 0x7f9d9006f9b0 2024-09-11T23:15:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d700052a0 con 0x7f9d9006f9b0 2024-09-11T23:15:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f3e35b34640 1 --2- 172.21.15.94:0/69459046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e300b3e10 0x7f3e30071e40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e2001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7379da9f3c1a8f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa803afa0 con 0x7fefa8036280 2024-09-11T23:15:38.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7fefa6ffd640 1 -- 172.21.15.94:0/231055762 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fefac0bf020 con 0x7fefa8036280 2024-09-11T23:15:38.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7fefa6ffd640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef940678c0 0x7fef94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7fefa6ffd640 1 -- 172.21.15.94:0/231055762 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fefac1208c0 con 0x7fefa8036280 2024-09-11T23:15:38.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.588+0000 7f26dc116640 1 -- 172.21.15.94:0/874287371 wait complete. 2024-09-11T23:15:38.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 Processor -- start 2024-09-11T23:15:38.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f9d85ffb640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9d74067990 0x7f9d74069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f9d85ffb640 1 -- 172.21.15.94:0/1802450439 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d80086440 con 0x7f9d9006f9b0 2024-09-11T23:15:38.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f9d951ac640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9d74067990 0x7f9d74069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 Processor -- start 2024-09-11T23:15:38.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 -- start start 2024-09-11T23:15:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f9d951ac640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9d74067990 0x7f9d74069e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0af000 tx=0x7f9d8c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 -- start start 2024-09-11T23:15:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d406d3e0 0x7f26d4201e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26d40b50c0 0x7f26d41ff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d4158900 0x7f26d414fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f26d415f720 con 0x7f26d4158900 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f26d415f200 con 0x7f26d40b50c0 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26dc116640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f26d4169fb0 con 0x7f26d406d3e0 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d4158900 0x7f26d414fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26d96b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26d40b50c0 0x7f26d41ff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d4158900 0x7f26d414fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40816/0 (socket says 172.21.15.94:40816) 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 -- 172.21.15.94:0/3323444298 learned_addr learned my addr 172.21.15.94:0/3323444298 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26d9eb2640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d406d3e0 0x7f26d4201e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c004810 0x7f5d400b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 -- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d406d3e0 msgr2=0x7f26d4201e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d406d3e0 0x7f26d4201e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 -- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26d40b50c0 msgr2=0x7f26d41ff3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26d40b50c0 0x7f26d41ff3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 -- 172.21.15.94:0/3323444298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d414ed80 con 0x7f26d4158900 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4014a2d0 0x7f5d40160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40160b70 0x7f5d4014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4015f720 con 0x7f5d2c004810 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c004810 0x7f5d400b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c004810 0x7f5d400b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40820/0 (socket says 172.21.15.94:40820) 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 -- 172.21.15.94:0/3013803569 learned_addr learned my addr 172.21.15.94:0/3013803569 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400b5ff0 con 0x7f5d4014a2d0 2024-09-11T23:15:38.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d400a9460 con 0x7f5d40160b70 2024-09-11T23:15:38.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f26da6b3640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d4158900 0x7f26d414fe20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26cc01aa40 tx=0x7f26cc019450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4014a2d0 0x7f5d40160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d45cc7640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40160b70 0x7f5d4014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 -- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40160b70 msgr2=0x7f5d4014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40160b70 0x7f5d4014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 -- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4014a2d0 msgr2=0x7f5d40160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4014a2d0 0x7f5d40160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 -- 172.21.15.94:0/3013803569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4015c820 con 0x7f5d2c004810 2024-09-11T23:15:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.592+0000 7f5d454c6640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c004810 0x7f5d400b05d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c011960 tx=0x7f5d3c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7fefb6277640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef940678c0 0x7fef94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7fefa6ffd640 1 -- 172.21.15.94:0/231055762 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fefac0c6030 con 0x7fefa8036280 2024-09-11T23:15:38.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84cd956640 1 Processor -- start 2024-09-11T23:15:38.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84cd956640 1 -- start start 2024-09-11T23:15:38.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7fefb6277640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef940678c0 0x7fef94069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009fd0 tx=0x7fefa0009ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed58132640 1 Processor -- start 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed58132640 1 -- start start 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed58132640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed50156610 0x7fed5015c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed58132640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed5006f020 0x7fed5006f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed58132640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed500cd560 con 0x7fed50070140 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed58132640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fed5015de10 con 0x7fed5006f020 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed58132640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fed501569f0 con 0x7fed50156610 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed566cf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed5006f020 0x7fed5006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed566cf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed5006f020 0x7fed5006f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40838/0 (socket says 172.21.15.94:40838) 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed566cf640 1 -- 172.21.15.94:0/707599188 learned_addr learned my addr 172.21.15.94:0/707599188 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed55ece640 1 --2- 172.21.15.94:0/707599188 >> v2:172.21.15.155:3300/0 conn(0x7fed50156610 0x7fed5015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed566cf640 1 -- 172.21.15.94:0/707599188 >> v2:172.21.15.155:3300/0 conn(0x7fed50156610 msgr2=0x7fed5015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed566cf640 1 --2- 172.21.15.94:0/707599188 >> v2:172.21.15.155:3300/0 conn(0x7fed50156610 0x7fed5015c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed566cf640 1 -- 172.21.15.94:0/707599188 >> v1:172.21.15.94:6789/0 conn(0x7fed50070140 legacy=0x7fed5015d700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T23:15:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7fed566cf640 1 -- 172.21.15.94:0/707599188 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5006f940 con 0x7fed5006f020 2024-09-11T23:15:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84cd956640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84c8144d60 0x7f84c8070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84cd956640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c8071030 con 0x7f84c80b52b0 2024-09-11T23:15:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84cd956640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c806fa50 con 0x7f84c80b4090 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84cd956640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f84c8070660 con 0x7f84c8144d60 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84c6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84c8144d60 0x7f84c8070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84c6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84c8144d60 0x7f84c8070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40832/0 (socket says 172.21.15.94:40832) 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84c77fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f84c80b52b0 0x7f84c80ae610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36488/0 (socket says 172.21.15.94:36488) 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84c6ffd640 1 -- 172.21.15.94:0/2526225403 learned_addr learned my addr 172.21.15.94:0/2526225403 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84c6ffd640 1 -- 172.21.15.94:0/2526225403 >> v1:172.21.15.155:6789/0 conn(0x7f84c80b4090 legacy=0x7f84c80b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84c6ffd640 1 -- 172.21.15.94:0/2526225403 >> v1:172.21.15.94:6789/0 conn(0x7f84c80b52b0 legacy=0x7f84c80ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.596+0000 7f84c6ffd640 1 -- 172.21.15.94:0/2526225403 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c8161d40 con 0x7f84c8144d60 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.600+0000 7f84c6ffd640 1 --2- 172.21.15.94:0/2526225403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c8144d60 0x7f84c8070af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84bc011f90 tx=0x7f84bc02d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc98df4ebea35a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7fed566cf640 1 --2- 172.21.15.94:0/707599188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed5006f020 0x7fed5006f400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed5006eba0 tx=0x7fed4801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bd1ad3ad64a5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f3e35333640 1 -- 172.21.15.94:0/69459046 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e200aa650 con 0x7f3e300b3e10 2024-09-11T23:15:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f84c5ffb640 1 -- 172.21.15.94:0/2526225403 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0c1070 con 0x7f84c8144d60 2024-09-11T23:15:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f3e35333640 1 -- 172.21.15.94:0/69459046 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200af070 con 0x7f3e300b3e10 2024-09-11T23:15:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f3e35333640 1 -- 172.21.15.94:0/69459046 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e200aa9f0 con 0x7f3e300b3e10 2024-09-11T23:15:38.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f5d35ffb640 1 -- 172.21.15.94:0/3013803569 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00fa90 con 0x7f5d2c004810 2024-09-11T23:15:38.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f5d35ffb640 1 -- 172.21.15.94:0/3013803569 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c00fc30 con 0x7f5d2c004810 2024-09-11T23:15:38.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f5d35ffb640 1 -- 172.21.15.94:0/3013803569 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c014440 con 0x7f5d2c004810 2024-09-11T23:15:38.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f9d85ffb640 1 -- 172.21.15.94:0/1802450439 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9d80022020 con 0x7f9d9006f9b0 2024-09-11T23:15:38.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7fed54ecc640 1 -- 172.21.15.94:0/707599188 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed480a5840 con 0x7fed5006f020 2024-09-11T23:15:38.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7fed54ecc640 1 -- 172.21.15.94:0/707599188 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed480a59e0 con 0x7fed5006f020 2024-09-11T23:15:38.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4015cb00 con 0x7f5d2c004810 2024-09-11T23:15:38.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4015d0c0 con 0x7f5d2c004810 2024-09-11T23:15:38.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 -- 172.21.15.94:0/69459046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e300b3e10 msgr2=0x7f3e30071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 --2- 172.21.15.94:0/69459046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e300b3e10 0x7f3e30071e40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e2001c510 comp rx=0 tx=0).stop 2024-09-11T23:15:38.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 -- 172.21.15.94:0/707599188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed5006f020 msgr2=0x7fed5006f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 --2- 172.21.15.94:0/707599188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed5006f020 0x7fed5006f400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed5006eba0 tx=0x7fed4801c980 comp rx=0 tx=0).stop 2024-09-11T23:15:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 -- 172.21.15.94:0/69459046 shutdown_connections 2024-09-11T23:15:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 --2- 172.21.15.94:0/69459046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e300b3e10 0x7f3e30071e40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 --2- 172.21.15.94:0/69459046 >> v2:172.21.15.155:3300/0 conn(0x7f3e3006f020 0x7f3e3006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 -- 172.21.15.94:0/69459046 >> 172.21.15.94:0/69459046 conn(0x7f3e300b1cd0 msgr2=0x7f3e300b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 -- 172.21.15.94:0/707599188 shutdown_connections 2024-09-11T23:15:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 --2- 172.21.15.94:0/707599188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed5006f020 0x7fed5006f400 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 --2- 172.21.15.94:0/707599188 >> v2:172.21.15.155:3300/0 conn(0x7fed50156610 0x7fed5015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 -- 172.21.15.94:0/707599188 >> 172.21.15.94:0/707599188 conn(0x7fed500b1cd0 msgr2=0x7fed500b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 -- 172.21.15.94:0/69459046 shutdown_connections 2024-09-11T23:15:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 -- 172.21.15.94:0/69459046 wait complete. 2024-09-11T23:15:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 -- 172.21.15.94:0/707599188 shutdown_connections 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 -- 172.21.15.94:0/707599188 wait complete. 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f26ca7fc640 1 -- 172.21.15.94:0/3323444298 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0b1040 con 0x7f26d4158900 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f26ca7fc640 1 -- 172.21.15.94:0/3323444298 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26cc0be070 con 0x7f26d4158900 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f26ca7fc640 1 -- 172.21.15.94:0/3323444298 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0b7670 con 0x7f26d4158900 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f84c5ffb640 1 -- 172.21.15.94:0/2526225403 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc0112d0 con 0x7f84c8144d60 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.604+0000 7f84c5ffb640 1 -- 172.21.15.94:0/2526225403 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0116a0 con 0x7f84c8144d60 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- 172.21.15.94:0/2526225403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c8144d60 msgr2=0x7f84c8070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 --2- 172.21.15.94:0/2526225403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c8144d60 0x7f84c8070af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84bc011f90 tx=0x7f84bc02d460 comp rx=0 tx=0).stop 2024-09-11T23:15:38.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- 172.21.15.94:0/2526225403 shutdown_connections 2024-09-11T23:15:38.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 --2- 172.21.15.94:0/2526225403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c8144d60 0x7f84c8070af0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84bc011f90 tx=0x7f84bc02d460 comp rx=0 tx=0).stop 2024-09-11T23:15:38.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- 172.21.15.94:0/2526225403 >> 172.21.15.94:0/2526225403 conn(0x7f84c809aa00 msgr2=0x7f84c80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- 172.21.15.94:0/2526225403 shutdown_connections 2024-09-11T23:15:38.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- 172.21.15.94:0/2526225403 wait complete. 2024-09-11T23:15:38.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4006ccd0 con 0x7f5d2c004810 2024-09-11T23:15:38.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 Processor -- start 2024-09-11T23:15:38.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 Processor -- start 2024-09-11T23:15:38.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 Processor -- start 2024-09-11T23:15:38.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d414f060 con 0x7f26d4158900 2024-09-11T23:15:38.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d414f620 con 0x7f26d4158900 2024-09-11T23:15:38.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 -- start start 2024-09-11T23:15:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f5d35ffb640 1 -- 172.21.15.94:0/3013803569 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d3c012040 con 0x7f5d2c004810 2024-09-11T23:15:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f5d35ffb640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5d24067940 0x7f5d24069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f5d35ffb640 1 -- 172.21.15.94:0/3013803569 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5d3c0864a0 con 0x7f5d2c004810 2024-09-11T23:15:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5d24067940 0x7f5d24069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d40b5b70 con 0x7f26d4158900 2024-09-11T23:15:38.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 -- start start 2024-09-11T23:15:38.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e3006f020 0x7f3e301635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e30072380 0x7f3e3006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e38599640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e300b3e10 0x7f3e3006e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- start start 2024-09-11T23:15:38.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c80b4090 0x7f84c813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84c80b52b0 0x7f84c809d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84c80ce430 0x7f84c80ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84c80b6fd0 con 0x7f84c80b4090 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f84c80b6e50 con 0x7f84c80b52b0 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84cd956640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f84c80af130 con 0x7f84c80ce430 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed50070140 0x7fed5014b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e36335640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e3006f020 0x7f3e301635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f3e36335640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e3006f020 0x7f3e301635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40846/0 (socket says 172.21.15.94:40846) 2024-09-11T23:15:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed50156610 0x7fed501542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed50154820 0x7fed5014c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7fed58132640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fed5015d430 con 0x7fed50156610 2024-09-11T23:15:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36335640 1 -- 172.21.15.94:0/2263797859 learned_addr learned my addr 172.21.15.94:0/2263797859 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.608+0000 7f84c6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c80b4090 0x7f84c813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c80b4090 0x7f84c813fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40852/0 (socket says 172.21.15.94:40852) 2024-09-11T23:15:38.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 -- 172.21.15.94:0/3181298400 learned_addr learned my addr 172.21.15.94:0/3181298400 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed58132640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fed500ccc20 con 0x7fed50154820 2024-09-11T23:15:38.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed58132640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fed500ce220 con 0x7fed50070140 2024-09-11T23:15:38.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f5d44cc5640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5d24067940 0x7f5d24069e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d300af000 tx=0x7f5d300046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e35b34640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e30072380 0x7f3e3006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30072910 con 0x7f3e3006f020 2024-09-11T23:15:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30072790 con 0x7f3e30072380 2024-09-11T23:15:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3008bc00 con 0x7f3e300b3e10 2024-09-11T23:15:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c77fe640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84c80ce430 0x7f84c80ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed55ece640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed50070140 0x7fed5014b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 -- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84c80ce430 msgr2=0x7f84c80ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36b36640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e300b3e10 0x7f3e3006e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84c80ce430 0x7f84c80ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 -- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84c80b52b0 msgr2=0x7f84c809d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84c80b52b0 0x7f84c809d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 -- 172.21.15.94:0/3181298400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c80d1360 con 0x7f84c80b4090 2024-09-11T23:15:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed50154820 0x7fed5014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed50154820 0x7fed5014c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:39032/0 (socket says 172.21.15.94:39032) 2024-09-11T23:15:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 -- 172.21.15.94:0/3555496941 learned_addr learned my addr 172.21.15.94:0/3555496941 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:38.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c77fe640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84c80ce430 0x7f84c80ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:38.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36335640 1 -- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e300b3e10 msgr2=0x7f3e3006e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36335640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e300b3e10 0x7f3e3006e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36335640 1 -- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e30072380 msgr2=0x7f3e3006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36335640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e30072380 0x7f3e3006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36335640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3020c560 con 0x7f3e3006f020 2024-09-11T23:15:38.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed556cd640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed50156610 0x7fed501542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f84c6ffd640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c80b4090 0x7f84c813fda0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84bc02b090 tx=0x7f84bc02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7f3e36335640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e3006f020 0x7f3e301635f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00dae0 tx=0x7f3e2c00b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 -- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed50070140 msgr2=0x7fed5014b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed50070140 0x7fed5014b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 -- 172.21.15.94:0/3555496941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed50156610 msgr2=0x7fed501542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed50156610 0x7fed501542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 -- 172.21.15.94:0/3555496941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed50154e50 con 0x7fed50154820 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed556cd640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed50156610 0x7fed501542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed566cf640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed50154820 0x7fed5014c100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed480af040 tx=0x7fed4801b1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed467fc640 1 -- 172.21.15.94:0/3555496941 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed480bc070 con 0x7fed50154820 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed467fc640 1 -- 172.21.15.94:0/3555496941 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed48007b00 con 0x7fed50154820 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed50155130 con 0x7fed50154820 2024-09-11T23:15:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed501556f0 con 0x7fed50154820 2024-09-11T23:15:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed467fc640 1 -- 172.21.15.94:0/3555496941 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed480b6640 con 0x7fed50154820 2024-09-11T23:15:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.612+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed380052a0 con 0x7fed50154820 2024-09-11T23:15:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7fed467fc640 1 -- 172.21.15.94:0/3555496941 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed480c7060 con 0x7fed50154820 2024-09-11T23:15:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7fed467fc640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed340678f0 0x7fed34069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7fed467fc640 1 -- 172.21.15.94:0/3555496941 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fed48124790 con 0x7fed50154820 2024-09-11T23:15:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f3e26ffd640 1 -- 172.21.15.94:0/2263797859 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c019410 con 0x7f3e3006f020 2024-09-11T23:15:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3020c800 con 0x7f3e3006f020 2024-09-11T23:15:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3020cdc0 con 0x7f3e3006f020 2024-09-11T23:15:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.620+0000 7f3e26ffd640 1 -- 172.21.15.94:0/2263797859 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0195b0 con 0x7f3e3006f020 2024-09-11T23:15:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.620+0000 7f3e26ffd640 1 -- 172.21.15.94:0/2263797859 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c019960 con 0x7f3e3006f020 2024-09-11T23:15:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f84affff640 1 -- 172.21.15.94:0/3181298400 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0cb030 con 0x7f84c80b4090 2024-09-11T23:15:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c80d1640 con 0x7f84c80b4090 2024-09-11T23:15:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c809b3d0 con 0x7f84c80b4090 2024-09-11T23:15:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.620+0000 7f84affff640 1 -- 172.21.15.94:0/3181298400 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc0112d0 con 0x7f84c80b4090 2024-09-11T23:15:38.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f26ca7fc640 1 -- 172.21.15.94:0/3323444298 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26cc0b7810 con 0x7f26d4158900 2024-09-11T23:15:38.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f26ca7fc640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f26b8067910 0x7f26b8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f26d9eb2640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f26b8067910 0x7f26b8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f26ca7fc640 1 -- 172.21.15.94:0/3323444298 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f26cc0ef320 con 0x7f26d4158900 2024-09-11T23:15:38.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.620+0000 7f26d9eb2640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f26b8067910 0x7f26b8069dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26d0000c10 tx=0x7f26d0007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7f5d35ffb640 1 -- 172.21.15.94:0/3013803569 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5d3c019030 con 0x7f5d2c004810 2024-09-11T23:15:38.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7fed55ece640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed340678f0 0x7fed34069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.616+0000 7fed55ece640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed340678f0 0x7fed34069db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed5014cee0 tx=0x7fed40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.620+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3006f400 con 0x7f3e3006f020 2024-09-11T23:15:38.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.620+0000 7f84affff640 1 -- 172.21.15.94:0/3181298400 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0c1040 con 0x7f84c80b4090 2024-09-11T23:15:38.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.620+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a80052a0 con 0x7f84c80b4090 2024-09-11T23:15:38.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.624+0000 7f26ca7fc640 1 -- 172.21.15.94:0/3323444298 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f26cc016480 con 0x7f26d4158900 2024-09-11T23:15:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.624+0000 7f84affff640 1 -- 172.21.15.94:0/3181298400 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84bc0ce070 con 0x7f84c80b4090 2024-09-11T23:15:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f84affff640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f84b40678f0 0x7f84b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f84affff640 1 -- 172.21.15.94:0/3181298400 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84bc1314c0 con 0x7f84c80b4090 2024-09-11T23:15:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f3e26ffd640 1 -- 172.21.15.94:0/2263797859 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e2c017020 con 0x7f3e3006f020 2024-09-11T23:15:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f3e26ffd640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e140678f0 0x7f3e14069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f3e26ffd640 1 -- 172.21.15.94:0/2263797859 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e2c086c50 con 0x7f3e3006f020 2024-09-11T23:15:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f3e35b34640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e140678f0 0x7f3e14069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f84c67fc640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f84b40678f0 0x7f84b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f3e35b34640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e140678f0 0x7f3e14069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ae000 tx=0x7f3e200a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f3e26ffd640 1 -- 172.21.15.94:0/2263797859 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e2c028080 con 0x7f3e3006f020 2024-09-11T23:15:38.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7f84c67fc640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f84b40678f0 0x7f84b4069db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84b8000f70 tx=0x7f84b80079e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:38.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.628+0000 7fed467fc640 1 -- 172.21.15.94:0/3555496941 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed480165a0 con 0x7fed50154820 2024-09-11T23:15:38.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.640+0000 7f84affff640 1 -- 172.21.15.94:0/3181298400 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f84bc0d6020 con 0x7f84c80b4090 2024-09-11T23:15:38.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.880+0000 7fb979248640 1 -- 172.21.15.94:0/1863859339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb974153df0 con 0x7fb9740b2fd0 2024-09-11T23:15:38.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.880+0000 7fb95b7fe640 1 -- 172.21.15.94:0/1863859339 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb96805c150 con 0x7fb9740b2fd0 2024-09-11T23:15:38.885 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 -- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb960067990 msgr2=0x7fb960069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb960067990 0x7fb960069e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb974159810 tx=0x7fb96c00b040 comp rx=0 tx=0).stop 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 -- 172.21.15.94:0/1863859339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9740b2fd0 msgr2=0x7fb9742005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9740b2fd0 0x7fb9742005b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb968009e80 tx=0x7fb96800c430 comp rx=0 tx=0).stop 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 -- 172.21.15.94:0/1863859339 shutdown_connections 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb97415a200 0x7fb974200af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb960067990 0x7fb960069e50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9740b2fd0 0x7fb9742005b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 --2- 172.21.15.94:0/1863859339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb974072db0 0x7fb9740aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 -- 172.21.15.94:0/1863859339 >> 172.21.15.94:0/1863859339 conn(0x7fb9740b1cd0 msgr2=0x7fb974154280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 -- 172.21.15.94:0/1863859339 shutdown_connections 2024-09-11T23:15:38.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.884+0000 7fb9597fa640 1 -- 172.21.15.94:0/1863859339 wait complete. 2024-09-11T23:15:38.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2024-09-11T23:15:38.908 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.924+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fefa80dec40 con 0x7fefa8036280 2024-09-11T23:15:38.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.924+0000 7fefa6ffd640 1 -- 172.21.15.94:0/231055762 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fefac015f70 con 0x7fefa8036280 2024-09-11T23:15:38.930 INFO:teuthology.orchestra.run.smithi094.stdout:55834574860 2024-09-11T23:15:38.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.924+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9d70005590 con 0x7f9d9006f9b0 2024-09-11T23:15:38.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d85ffb640 1 -- 172.21.15.94:0/1802450439 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d80056660 con 0x7f9d9006f9b0 2024-09-11T23:15:38.930 INFO:teuthology.orchestra.run.smithi094.stdout:55834574859 2024-09-11T23:15:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef940678c0 msgr2=0x7fef94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef940678c0 0x7fef94069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009fd0 tx=0x7fefa0009ac0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefa8036280 msgr2=0x7fefa804d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefa8036280 0x7fefa804d1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fefac000c10 tx=0x7fefac019090 comp rx=0 tx=0).stop 2024-09-11T23:15:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 shutdown_connections 2024-09-11T23:15:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa8052c40 0x7fefa804d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef940678c0 0x7fef94069d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fefa8036280 0x7fefa804d1d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 --2- 172.21.15.94:0/231055762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa80356a0 0x7fefa8007d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 >> 172.21.15.94:0/231055762 conn(0x7fefa801ea50 msgr2=0x7fefa803a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 shutdown_connections 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7fefb7279640 1 -- 172.21.15.94:0/231055762 wait complete. 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9d74067990 msgr2=0x7f9d74069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9d74067990 0x7f9d74069e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0af000 tx=0x7f9d8c0a7000 comp rx=0 tx=0).stop 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9006f9b0 msgr2=0x7f9d9009e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9006f9b0 0x7f9d9009e8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000d800 tx=0x7f9d8000dcc0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 shutdown_connections 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d90147c90 0x7f9d901f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9d74067990 0x7f9d74069e50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9006f9b0 0x7f9d9009e8f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 --2- 172.21.15.94:0/1802450439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d9006bcc0 0x7f9d901449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 >> 172.21.15.94:0/1802450439 conn(0x7f9d9009aa00 msgr2=0x7f9d900b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 shutdown_connections 2024-09-11T23:15:38.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.928+0000 7f9d97410640 1 -- 172.21.15.94:0/1802450439 wait complete. 2024-09-11T23:15:38.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.940+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fed38005860 con 0x7fed50154820 2024-09-11T23:15:38.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.940+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f84a8005860 con 0x7f84c80b4090 2024-09-11T23:15:38.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.940+0000 7fed467fc640 1 -- 172.21.15.94:0/3555496941 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed480f4920 con 0x7fed50154820 2024-09-11T23:15:38.945 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:38.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84affff640 1 -- 172.21.15.94:0/3181298400 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84bc027050 con 0x7f84c80b4090 2024-09-11T23:15:38.945 INFO:teuthology.orchestra.run.smithi094.stdout:55834574858 2024-09-11T23:15:38.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5d40160f50 con 0x7f5d2c004810 2024-09-11T23:15:38.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f84b40678f0 msgr2=0x7f84b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f84b40678f0 0x7f84b4069db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84b8000f70 tx=0x7f84b80079e0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c80b4090 msgr2=0x7f84c813fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c80b4090 0x7f84c813fda0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84bc02b090 tx=0x7f84bc02a200 comp rx=0 tx=0).stop 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 shutdown_connections 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84c80ce430 0x7f84c80ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84c80b52b0 0x7f84c809d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f84b40678f0 0x7f84b4069db0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 --2- 172.21.15.94:0/3181298400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84c80b4090 0x7f84c813fda0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 >> 172.21.15.94:0/3181298400 conn(0x7f84c809aa00 msgr2=0x7f84c815db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 shutdown_connections 2024-09-11T23:15:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f5d35ffb640 1 -- 172.21.15.94:0/3013803569 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d3c056c80 con 0x7f5d2c004810 2024-09-11T23:15:38.949 INFO:teuthology.orchestra.run.smithi094.stdout:55834574859 2024-09-11T23:15:38.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7f84cd956640 1 -- 172.21.15.94:0/3181298400 wait complete. 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed340678f0 msgr2=0x7fed34069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed340678f0 0x7fed34069db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed5014cee0 tx=0x7fed40008040 comp rx=0 tx=0).stop 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed50154820 msgr2=0x7fed5014c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed50154820 0x7fed5014c100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed480af040 tx=0x7fed4801b1c0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 shutdown_connections 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed50154820 0x7fed5014c100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fed340678f0 0x7fed34069db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed50156610 0x7fed501542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 --2- 172.21.15.94:0/3555496941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed50070140 0x7fed5014b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.944+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 >> 172.21.15.94:0/3555496941 conn(0x7fed500b1cd0 msgr2=0x7fed5006edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 shutdown_connections 2024-09-11T23:15:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7fed58132640 1 -- 172.21.15.94:0/3555496941 wait complete. 2024-09-11T23:15:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5d24067940 msgr2=0x7f5d24069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5d24067940 0x7f5d24069e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d300af000 tx=0x7f5d300046d0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c004810 msgr2=0x7f5d400b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c004810 0x7f5d400b05d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c011960 tx=0x7f5d3c011e20 comp rx=0 tx=0).stop 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 shutdown_connections 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d40160b70 0x7f5d4014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4014a2d0 0x7f5d40160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5d24067940 0x7f5d24069e00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 --2- 172.21.15.94:0/3013803569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d2c004810 0x7f5d400b05d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 >> 172.21.15.94:0/3013803569 conn(0x7f5d40072670 msgr2=0x7f5d4006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f26d40afb70 con 0x7f26d4158900 2024-09-11T23:15:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 shutdown_connections 2024-09-11T23:15:38.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f5d4772a640 1 -- 172.21.15.94:0/3013803569 wait complete. 2024-09-11T23:15:38.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.948+0000 7f26ca7fc640 1 -- 172.21.15.94:0/3323444298 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f26cc0f1280 con 0x7f26d4158900 2024-09-11T23:15:38.953 INFO:teuthology.orchestra.run.smithi094.stdout:55834574859 2024-09-11T23:15:38.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.952+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f26b8067910 msgr2=0x7f26b8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.952+0000 7f26dc116640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f26b8067910 0x7f26b8069dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26d0000c10 tx=0x7f26d0007e70 comp rx=0 tx=0).stop 2024-09-11T23:15:38.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.952+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d4158900 msgr2=0x7f26d414fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.952+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3e30072160 con 0x7f3e3006f020 2024-09-11T23:15:38.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.952+0000 7f26dc116640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d4158900 0x7f26d414fe20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26cc01aa40 tx=0x7f26cc019450 comp rx=0 tx=0).stop 2024-09-11T23:15:38.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 shutdown_connections 2024-09-11T23:15:38.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f3e26ffd640 1 -- 172.21.15.94:0/2263797859 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e2c056df0 con 0x7f3e3006f020 2024-09-11T23:15:38.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.1 2024-09-11T23:15:38.958 INFO:teuthology.orchestra.run.smithi094.stdout:55834574859 2024-09-11T23:15:38.959 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f26b8067910 0x7f26b8069dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26d4158900 0x7f26d414fe20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26d40b50c0 0x7f26d41ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 --2- 172.21.15.94:0/3323444298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d406d3e0 0x7f26d4201e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 >> 172.21.15.94:0/3323444298 conn(0x7f26d4072670 msgr2=0x7f26d414d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 shutdown_connections 2024-09-11T23:15:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.956+0000 7f26dc116640 1 -- 172.21.15.94:0/3323444298 wait complete. 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e140678f0 msgr2=0x7f3e14069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e140678f0 0x7f3e14069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ae000 tx=0x7f3e200a7000 comp rx=0 tx=0).stop 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e3006f020 msgr2=0x7f3e301635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e3006f020 0x7f3e301635f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00dae0 tx=0x7f3e2c00b2b0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 shutdown_connections 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e300b3e10 0x7f3e3006e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e30072380 0x7f3e3006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e140678f0 0x7f3e14069db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 --2- 172.21.15.94:0/2263797859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e3006f020 0x7f3e301635f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:38.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.6 2024-09-11T23:15:38.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 >> 172.21.15.94:0/2263797859 conn(0x7f3e300b1cd0 msgr2=0x7f3e30163fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 shutdown_connections 2024-09-11T23:15:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:38.960+0000 7f3e38599640 1 -- 172.21.15.94:0/2263797859 wait complete. 2024-09-11T23:15:38.963 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.7 2024-09-11T23:15:38.976 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.4 2024-09-11T23:15:38.976 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.0 2024-09-11T23:15:38.982 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.5 2024-09-11T23:15:38.983 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.3 2024-09-11T23:15:38.987 DEBUG:teuthology.parallel:result is None 2024-09-11T23:15:38.987 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:15:38.987 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:15:39.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5e678640 1 Processor -- start 2024-09-11T23:15:39.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5e678640 1 -- start start 2024-09-11T23:15:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5e678640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580d3060 0x7efc580cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5e678640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc580d0300 con 0x7efc580cf450 2024-09-11T23:15:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5e678640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc580b0f60 con 0x7efc58161a60 2024-09-11T23:15:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5e678640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc580cfd40 con 0x7efc580d3060 2024-09-11T23:15:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5cc15640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7efc580cf450 0x7efc5806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36502/0 (socket says 172.21.15.94:36502) 2024-09-11T23:15:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc5cc15640 1 -- 172.21.15.94:0/3352340275 learned_addr learned my addr 172.21.15.94:0/3352340275 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc4f7fe640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580d3060 0x7efc580cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608533449 0 0) 0x7efc500014a0 con 0x7efc580cf450 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc38003530 con 0x7efc580cf450 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3272958707 0 0) 0x7efc38003530 con 0x7efc580cf450 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.136+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580d3060 msgr2=0x7efc580cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580d3060 0x7efc580cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 >> v1:172.21.15.155:6789/0 conn(0x7efc58161a60 legacy=0x7efc580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc580d0020 con 0x7efc580cf450 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7efc50001bd0 con 0x7efc580cf450 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 >> v1:172.21.15.94:6789/0 conn(0x7efc580cf450 legacy=0x7efc5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc38003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc38004810 0x7efc38004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580d3060 0x7efc38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc580cfd40 con 0x7efc380039f0 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc3800bb00 con 0x7efc38004810 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc3800bd00 con 0x7efc580d3060 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc57fff640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc38003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc4f7fe640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc38004810 0x7efc38004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc57fff640 1 -- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580d3060 msgr2=0x7efc38005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc57fff640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580d3060 0x7efc38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc57fff640 1 -- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc38004810 msgr2=0x7efc38004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc57fff640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc38004810 0x7efc38004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc57fff640 1 -- 172.21.15.94:0/3352340275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc38003530 con 0x7efc380039f0 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc57fff640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc38003e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efc48001780 tx=0x7efc4801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab01ec716a8f29e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc480013a0 con 0x7efc380039f0 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc480052f0 con 0x7efc380039f0 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc577fe640 1 -- 172.21.15.94:0/3352340275 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48003840 con 0x7efc380039f0 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc5e678640 1 -- 172.21.15.94:0/3352340275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 msgr2=0x7efc38003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc5e678640 1 --2- 172.21.15.94:0/3352340275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc38003e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efc48001780 tx=0x7efc4801c3f0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc5cc15640 1 -- 172.21.15.94:0/3352340275 reap_dead start 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc5e678640 1 -- 172.21.15.94:0/3352340275 shutdown_connections 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc5e678640 1 -- 172.21.15.94:0/3352340275 >> 172.21.15.94:0/3352340275 conn(0x7efc5808bf90 msgr2=0x7efc5809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc5e678640 1 -- 172.21.15.94:0/3352340275 shutdown_connections 2024-09-11T23:15:39.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.140+0000 7efc5e678640 1 -- 172.21.15.94:0/3352340275 wait complete. 2024-09-11T23:15:39.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 Processor -- start 2024-09-11T23:15:39.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 -- start start 2024-09-11T23:15:39.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc581574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580b2c90 0x7efc5815c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc5815cb90 0x7efc580cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc580cfa00 con 0x7efc380039f0 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc580cf880 con 0x7efc5815cb90 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc580cef10 con 0x7efc580b2c90 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc581574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc581574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40862/0 (socket says 172.21.15.94:40862) 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 -- 172.21.15.94:0/2715882760 learned_addr learned my addr 172.21.15.94:0/2715882760 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc4f7fe640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580b2c90 0x7efc5815c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5cc15640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc5815cb90 0x7efc580cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 -- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580b2c90 msgr2=0x7efc5815c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580b2c90 0x7efc5815c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 -- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc5815cb90 msgr2=0x7efc580cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc5815cb90 0x7efc580cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 -- 172.21.15.94:0/2715882760 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc580b1620 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc4f7fe640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580b2c90 0x7efc5815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5cc15640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc5815cb90 0x7efc580cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc57fff640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc581574e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc48001780 tx=0x7efc38005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc557fa640 1 -- 172.21.15.94:0/2715882760 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48007a40 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc557fa640 1 -- 172.21.15.94:0/2715882760 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc480054a0 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc580b1900 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc557fa640 1 -- 172.21.15.94:0/2715882760 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc480013a0 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc580b1ec0 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5806d6b0 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc557fa640 1 -- 172.21.15.94:0/2715882760 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc480bd020 con 0x7efc380039f0 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc557fa640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc3c0678c0 0x7efc3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.144+0000 7efc557fa640 1 -- 172.21.15.94:0/2715882760 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc4811f440 con 0x7efc380039f0 2024-09-11T23:15:39.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.148+0000 7efc4f7fe640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc3c0678c0 0x7efc3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.148+0000 7efc4f7fe640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc3c0678c0 0x7efc3c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc40006cf0 tx=0x7efc40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.148+0000 7efc557fa640 1 -- 172.21.15.94:0/2715882760 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc480c4020 con 0x7efc380039f0 2024-09-11T23:15:39.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.296+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc580b13d0 con 0x7efc3c0678c0 2024-09-11T23:15:39.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.320+0000 7efc557fa640 1 -- 172.21.15.94:0/2715882760 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7efc580b13d0 con 0x7efc3c0678c0 2024-09-11T23:15:39.326 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:39.329 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:15:39.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.324+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc3c0678c0 msgr2=0x7efc3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.324+0000 7efc5e678640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc3c0678c0 0x7efc3c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc40006cf0 tx=0x7efc40008040 comp rx=0 tx=0).stop 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.324+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 msgr2=0x7efc581574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.324+0000 7efc5e678640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc581574e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc48001780 tx=0x7efc38005840 comp rx=0 tx=0).stop 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 shutdown_connections 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc5815cb90 0x7efc580cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc580b2c90 0x7efc5815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc3c0678c0 0x7efc3c069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 --2- 172.21.15.94:0/2715882760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc380039f0 0x7efc581574e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 >> 172.21.15.94:0/2715882760 conn(0x7efc5808bf90 msgr2=0x7efc580d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 shutdown_connections 2024-09-11T23:15:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.328+0000 7efc5e678640 1 -- 172.21.15.94:0/2715882760 wait complete. 2024-09-11T23:15:39.344 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-11T23:15:37.974938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236204,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738516,"statfs":{"total":773094113280,"available":772852240384,"internally_reserved":0,"allocated":3383296,"data_stored":2049164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004663"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256938+0000","last_change":"2024-09-11T23:15:12.971939+0000","last_active":"2024-09-11T23:15:20.256938+0000","last_peered":"2024-09-11T23:15:20.256938+0000","last_clean":"2024-09-11T23:15:20.256938+0000","last_became_active":"2024-09-11T23:15:12.971664+0000","last_became_peered":"2024-09-11T23:15:12.971664+0000","last_unstale":"2024-09-11T23:15:20.256938+0000","last_undegraded":"2024-09-11T23:15:20.256938+0000","last_fullsized":"2024-09-11T23:15:20.256938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:21.586294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003953+0000","last_change":"2024-09-11T23:15:13.990297+0000","last_active":"2024-09-11T23:15:20.003953+0000","last_peered":"2024-09-11T23:15:20.003953+0000","last_clean":"2024-09-11T23:15:20.003953+0000","last_became_active":"2024-09-11T23:15:13.989971+0000","last_became_peered":"2024-09-11T23:15:13.989971+0000","last_unstale":"2024-09-11T23:15:20.003953+0000","last_undegraded":"2024-09-11T23:15:20.003953+0000","last_fullsized":"2024-09-11T23:15:20.003953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002406+0000","last_change":"2024-09-11T23:15:18.458647+0000","last_active":"2024-09-11T23:15:20.002406+0000","last_peered":"2024-09-11T23:15:20.002406+0000","last_clean":"2024-09-11T23:15:20.002406+0000","last_became_active":"2024-09-11T23:15:18.457571+0000","last_became_peered":"2024-09-11T23:15:18.457571+0000","last_unstale":"2024-09-11T23:15:20.002406+0000","last_undegraded":"2024-09-11T23:15:20.002406+0000","last_fullsized":"2024-09-11T23:15:20.002406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:45.970652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004208+0000","last_change":"2024-09-11T23:15:12.963138+0000","last_active":"2024-09-11T23:15:20.004208+0000","last_peered":"2024-09-11T23:15:20.004208+0000","last_clean":"2024-09-11T23:15:20.004208+0000","last_became_active":"2024-09-11T23:15:12.962545+0000","last_became_peered":"2024-09-11T23:15:12.962545+0000","last_unstale":"2024-09-11T23:15:20.004208+0000","last_undegraded":"2024-09-11T23:15:20.004208+0000","last_fullsized":"2024-09-11T23:15:20.004208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256716+0000","last_change":"2024-09-11T23:15:13.979850+0000","last_active":"2024-09-11T23:15:20.256716+0000","last_peered":"2024-09-11T23:15:20.256716+0000","last_clean":"2024-09-11T23:15:20.256716+0000","last_became_active":"2024-09-11T23:15:13.979530+0000","last_became_peered":"2024-09-11T23:15:13.979530+0000","last_unstale":"2024-09-11T23:15:20.256716+0000","last_undegraded":"2024-09-11T23:15:20.256716+0000","last_fullsized":"2024-09-11T23:15:20.256716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009823+0000","last_change":"2024-09-11T23:15:18.048713+0000","last_active":"2024-09-11T23:15:20.009823+0000","last_peered":"2024-09-11T23:15:20.009823+0000","last_clean":"2024-09-11T23:15:20.009823+0000","last_became_active":"2024-09-11T23:15:18.047487+0000","last_became_peered":"2024-09-11T23:15:18.047487+0000","last_unstale":"2024-09-11T23:15:20.009823+0000","last_undegraded":"2024-09-11T23:15:20.009823+0000","last_fullsized":"2024-09-11T23:15:20.009823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256782+0000","last_change":"2024-09-11T23:15:12.973574+0000","last_active":"2024-09-11T23:15:20.256782+0000","last_peered":"2024-09-11T23:15:20.256782+0000","last_clean":"2024-09-11T23:15:20.256782+0000","last_became_active":"2024-09-11T23:15:12.972945+0000","last_became_peered":"2024-09-11T23:15:12.972945+0000","last_unstale":"2024-09-11T23:15:20.256782+0000","last_undegraded":"2024-09-11T23:15:20.256782+0000","last_fullsized":"2024-09-11T23:15:20.256782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.523986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005274+0000","last_change":"2024-09-11T23:15:13.955300+0000","last_active":"2024-09-11T23:15:20.005274+0000","last_peered":"2024-09-11T23:15:20.005274+0000","last_clean":"2024-09-11T23:15:20.005274+0000","last_became_active":"2024-09-11T23:15:13.952807+0000","last_became_peered":"2024-09-11T23:15:13.952807+0000","last_unstale":"2024-09-11T23:15:20.005274+0000","last_undegraded":"2024-09-11T23:15:20.005274+0000","last_fullsized":"2024-09-11T23:15:20.005274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010459+0000","last_change":"2024-09-11T23:15:18.046772+0000","last_active":"2024-09-11T23:15:20.010459+0000","last_peered":"2024-09-11T23:15:20.010459+0000","last_clean":"2024-09-11T23:15:20.010459+0000","last_became_active":"2024-09-11T23:15:18.044361+0000","last_became_peered":"2024-09-11T23:15:18.044361+0000","last_unstale":"2024-09-11T23:15:20.010459+0000","last_undegraded":"2024-09-11T23:15:20.010459+0000","last_fullsized":"2024-09-11T23:15:20.010459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254970+0000","last_change":"2024-09-11T23:15:12.973316+0000","last_active":"2024-09-11T23:15:20.254970+0000","last_peered":"2024-09-11T23:15:20.254970+0000","last_clean":"2024-09-11T23:15:20.254970+0000","last_became_active":"2024-09-11T23:15:12.972758+0000","last_became_peered":"2024-09-11T23:15:12.972758+0000","last_unstale":"2024-09-11T23:15:20.254970+0000","last_undegraded":"2024-09-11T23:15:20.254970+0000","last_fullsized":"2024-09-11T23:15:20.254970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:56.819101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006154+0000","last_change":"2024-09-11T23:15:13.974148+0000","last_active":"2024-09-11T23:15:20.006154+0000","last_peered":"2024-09-11T23:15:20.006154+0000","last_clean":"2024-09-11T23:15:20.006154+0000","last_became_active":"2024-09-11T23:15:13.973423+0000","last_became_peered":"2024-09-11T23:15:13.973423+0000","last_unstale":"2024-09-11T23:15:20.006154+0000","last_undegraded":"2024-09-11T23:15:20.006154+0000","last_fullsized":"2024-09-11T23:15:20.006154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009681+0000","last_change":"2024-09-11T23:15:18.039529+0000","last_active":"2024-09-11T23:15:20.009681+0000","last_peered":"2024-09-11T23:15:20.009681+0000","last_clean":"2024-09-11T23:15:20.009681+0000","last_became_active":"2024-09-11T23:15:18.035361+0000","last_became_peered":"2024-09-11T23:15:18.035361+0000","last_unstale":"2024-09-11T23:15:20.009681+0000","last_undegraded":"2024-09-11T23:15:20.009681+0000","last_fullsized":"2024-09-11T23:15:20.009681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252965+0000","last_change":"2024-09-11T23:15:13.987303+0000","last_active":"2024-09-11T23:15:20.252965+0000","last_peered":"2024-09-11T23:15:20.252965+0000","last_clean":"2024-09-11T23:15:20.252965+0000","last_became_active":"2024-09-11T23:15:13.986026+0000","last_became_peered":"2024-09-11T23:15:13.986026+0000","last_unstale":"2024-09-11T23:15:20.252965+0000","last_undegraded":"2024-09-11T23:15:20.252965+0000","last_fullsized":"2024-09-11T23:15:20.252965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255344+0000","last_change":"2024-09-11T23:15:12.978008+0000","last_active":"2024-09-11T23:15:20.255344+0000","last_peered":"2024-09-11T23:15:20.255344+0000","last_clean":"2024-09-11T23:15:20.255344+0000","last_became_active":"2024-09-11T23:15:12.977577+0000","last_became_peered":"2024-09-11T23:15:12.977577+0000","last_unstale":"2024-09-11T23:15:20.255344+0000","last_undegraded":"2024-09-11T23:15:20.255344+0000","last_fullsized":"2024-09-11T23:15:20.255344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:04.986111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011696+0000","last_change":"2024-09-11T23:15:18.040717+0000","last_active":"2024-09-11T23:15:20.011696+0000","last_peered":"2024-09-11T23:15:20.011696+0000","last_clean":"2024-09-11T23:15:20.011696+0000","last_became_active":"2024-09-11T23:15:18.039316+0000","last_became_peered":"2024-09-11T23:15:18.039316+0000","last_unstale":"2024-09-11T23:15:20.011696+0000","last_undegraded":"2024-09-11T23:15:20.011696+0000","last_fullsized":"2024-09-11T23:15:20.011696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002755+0000","last_change":"2024-09-11T23:15:13.951501+0000","last_active":"2024-09-11T23:15:20.002755+0000","last_peered":"2024-09-11T23:15:20.002755+0000","last_clean":"2024-09-11T23:15:20.002755+0000","last_became_active":"2024-09-11T23:15:13.951199+0000","last_became_peered":"2024-09-11T23:15:13.951199+0000","last_unstale":"2024-09-11T23:15:20.002755+0000","last_undegraded":"2024-09-11T23:15:20.002755+0000","last_fullsized":"2024-09-11T23:15:20.002755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253117+0000","last_change":"2024-09-11T23:15:12.963618+0000","last_active":"2024-09-11T23:15:20.253117+0000","last_peered":"2024-09-11T23:15:20.253117+0000","last_clean":"2024-09-11T23:15:20.253117+0000","last_became_active":"2024-09-11T23:15:12.963221+0000","last_became_peered":"2024-09-11T23:15:12.963221+0000","last_unstale":"2024-09-11T23:15:20.253117+0000","last_undegraded":"2024-09-11T23:15:20.253117+0000","last_fullsized":"2024-09-11T23:15:20.253117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011380+0000","last_change":"2024-09-11T23:15:18.037481+0000","last_active":"2024-09-11T23:15:20.011380+0000","last_peered":"2024-09-11T23:15:20.011380+0000","last_clean":"2024-09-11T23:15:20.011380+0000","last_became_active":"2024-09-11T23:15:18.036406+0000","last_became_peered":"2024-09-11T23:15:18.036406+0000","last_unstale":"2024-09-11T23:15:20.011380+0000","last_undegraded":"2024-09-11T23:15:20.011380+0000","last_fullsized":"2024-09-11T23:15:20.011380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002601+0000","last_change":"2024-09-11T23:15:13.946573+0000","last_active":"2024-09-11T23:15:20.002601+0000","last_peered":"2024-09-11T23:15:20.002601+0000","last_clean":"2024-09-11T23:15:20.002601+0000","last_became_active":"2024-09-11T23:15:13.946197+0000","last_became_peered":"2024-09-11T23:15:13.946197+0000","last_unstale":"2024-09-11T23:15:20.002601+0000","last_undegraded":"2024-09-11T23:15:20.002601+0000","last_fullsized":"2024-09-11T23:15:20.002601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251927+0000","last_change":"2024-09-11T23:15:12.973005+0000","last_active":"2024-09-11T23:15:20.251927+0000","last_peered":"2024-09-11T23:15:20.251927+0000","last_clean":"2024-09-11T23:15:20.251927+0000","last_became_active":"2024-09-11T23:15:12.972755+0000","last_became_peered":"2024-09-11T23:15:12.972755+0000","last_unstale":"2024-09-11T23:15:20.251927+0000","last_undegraded":"2024-09-11T23:15:20.251927+0000","last_fullsized":"2024-09-11T23:15:20.251927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254128+0000","last_change":"2024-09-11T23:15:18.458359+0000","last_active":"2024-09-11T23:15:20.254128+0000","last_peered":"2024-09-11T23:15:20.254128+0000","last_clean":"2024-09-11T23:15:20.254128+0000","last_became_active":"2024-09-11T23:15:18.457312+0000","last_became_peered":"2024-09-11T23:15:18.457312+0000","last_unstale":"2024-09-11T23:15:20.254128+0000","last_undegraded":"2024-09-11T23:15:20.254128+0000","last_fullsized":"2024-09-11T23:15:20.254128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010080+0000","last_change":"2024-09-11T23:15:13.949978+0000","last_active":"2024-09-11T23:15:20.010080+0000","last_peered":"2024-09-11T23:15:20.010080+0000","last_clean":"2024-09-11T23:15:20.010080+0000","last_became_active":"2024-09-11T23:15:13.948572+0000","last_became_peered":"2024-09-11T23:15:13.948572+0000","last_unstale":"2024-09-11T23:15:20.010080+0000","last_undegraded":"2024-09-11T23:15:20.010080+0000","last_fullsized":"2024-09-11T23:15:20.010080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:18.647972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253258+0000","last_change":"2024-09-11T23:15:12.967038+0000","last_active":"2024-09-11T23:15:20.253258+0000","last_peered":"2024-09-11T23:15:20.253258+0000","last_clean":"2024-09-11T23:15:20.253258+0000","last_became_active":"2024-09-11T23:15:12.965415+0000","last_became_peered":"2024-09-11T23:15:12.965415+0000","last_unstale":"2024-09-11T23:15:20.253258+0000","last_undegraded":"2024-09-11T23:15:20.253258+0000","last_fullsized":"2024-09-11T23:15:20.253258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011695+0000","last_change":"2024-09-11T23:15:18.046520+0000","last_active":"2024-09-11T23:15:20.011695+0000","last_peered":"2024-09-11T23:15:20.011695+0000","last_clean":"2024-09-11T23:15:20.011695+0000","last_became_active":"2024-09-11T23:15:18.045457+0000","last_became_peered":"2024-09-11T23:15:18.045457+0000","last_unstale":"2024-09-11T23:15:20.011695+0000","last_undegraded":"2024-09-11T23:15:20.011695+0000","last_fullsized":"2024-09-11T23:15:20.011695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256732+0000","last_change":"2024-09-11T23:15:13.941941+0000","last_active":"2024-09-11T23:15:20.256732+0000","last_peered":"2024-09-11T23:15:20.256732+0000","last_clean":"2024-09-11T23:15:20.256732+0000","last_became_active":"2024-09-11T23:15:13.941593+0000","last_became_peered":"2024-09-11T23:15:13.941593+0000","last_unstale":"2024-09-11T23:15:20.256732+0000","last_undegraded":"2024-09-11T23:15:20.256732+0000","last_fullsized":"2024-09-11T23:15:20.256732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:33.314997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255566+0000","last_change":"2024-09-11T23:15:12.980259+0000","last_active":"2024-09-11T23:15:20.255566+0000","last_peered":"2024-09-11T23:15:20.255566+0000","last_clean":"2024-09-11T23:15:20.255566+0000","last_became_active":"2024-09-11T23:15:12.979084+0000","last_became_peered":"2024-09-11T23:15:12.979084+0000","last_unstale":"2024-09-11T23:15:20.255566+0000","last_undegraded":"2024-09-11T23:15:20.255566+0000","last_fullsized":"2024-09-11T23:15:20.255566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010030+0000","last_change":"2024-09-11T23:15:18.450939+0000","last_active":"2024-09-11T23:15:20.010030+0000","last_peered":"2024-09-11T23:15:20.010030+0000","last_clean":"2024-09-11T23:15:20.010030+0000","last_became_active":"2024-09-11T23:15:18.449905+0000","last_became_peered":"2024-09-11T23:15:18.449905+0000","last_unstale":"2024-09-11T23:15:20.010030+0000","last_undegraded":"2024-09-11T23:15:20.010030+0000","last_fullsized":"2024-09-11T23:15:20.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004150+0000","last_change":"2024-09-11T23:15:13.998809+0000","last_active":"2024-09-11T23:15:20.004150+0000","last_peered":"2024-09-11T23:15:20.004150+0000","last_clean":"2024-09-11T23:15:20.004150+0000","last_became_active":"2024-09-11T23:15:13.998546+0000","last_became_peered":"2024-09-11T23:15:13.998546+0000","last_unstale":"2024-09-11T23:15:20.004150+0000","last_undegraded":"2024-09-11T23:15:20.004150+0000","last_fullsized":"2024-09-11T23:15:20.004150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253620+0000","last_change":"2024-09-11T23:15:12.962583+0000","last_active":"2024-09-11T23:15:20.253620+0000","last_peered":"2024-09-11T23:15:20.253620+0000","last_clean":"2024-09-11T23:15:20.253620+0000","last_became_active":"2024-09-11T23:15:12.962238+0000","last_became_peered":"2024-09-11T23:15:12.962238+0000","last_unstale":"2024-09-11T23:15:20.253620+0000","last_undegraded":"2024-09-11T23:15:20.253620+0000","last_fullsized":"2024-09-11T23:15:20.253620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002270+0000","last_change":"2024-09-11T23:15:18.450216+0000","last_active":"2024-09-11T23:15:20.002270+0000","last_peered":"2024-09-11T23:15:20.002270+0000","last_clean":"2024-09-11T23:15:20.002270+0000","last_became_active":"2024-09-11T23:15:18.449301+0000","last_became_peered":"2024-09-11T23:15:18.449301+0000","last_unstale":"2024-09-11T23:15:20.002270+0000","last_undegraded":"2024-09-11T23:15:20.002270+0000","last_fullsized":"2024-09-11T23:15:20.002270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251732+0000","last_change":"2024-09-11T23:15:13.945641+0000","last_active":"2024-09-11T23:15:20.251732+0000","last_peered":"2024-09-11T23:15:20.251732+0000","last_clean":"2024-09-11T23:15:20.251732+0000","last_became_active":"2024-09-11T23:15:13.945333+0000","last_became_peered":"2024-09-11T23:15:13.945333+0000","last_unstale":"2024-09-11T23:15:20.251732+0000","last_undegraded":"2024-09-11T23:15:20.251732+0000","last_fullsized":"2024-09-11T23:15:20.251732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257048+0000","last_change":"2024-09-11T23:15:12.974878+0000","last_active":"2024-09-11T23:15:20.257048+0000","last_peered":"2024-09-11T23:15:20.257048+0000","last_clean":"2024-09-11T23:15:20.257048+0000","last_became_active":"2024-09-11T23:15:12.973946+0000","last_became_peered":"2024-09-11T23:15:12.973946+0000","last_unstale":"2024-09-11T23:15:20.257048+0000","last_undegraded":"2024-09-11T23:15:20.257048+0000","last_fullsized":"2024-09-11T23:15:20.257048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255824+0000","last_change":"2024-09-11T23:15:18.452665+0000","last_active":"2024-09-11T23:15:20.255824+0000","last_peered":"2024-09-11T23:15:20.255824+0000","last_clean":"2024-09-11T23:15:20.255824+0000","last_became_active":"2024-09-11T23:15:18.450946+0000","last_became_peered":"2024-09-11T23:15:18.450946+0000","last_unstale":"2024-09-11T23:15:20.255824+0000","last_undegraded":"2024-09-11T23:15:20.255824+0000","last_fullsized":"2024-09-11T23:15:20.255824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006334+0000","last_change":"2024-09-11T23:15:13.951679+0000","last_active":"2024-09-11T23:15:20.006334+0000","last_peered":"2024-09-11T23:15:20.006334+0000","last_clean":"2024-09-11T23:15:20.006334+0000","last_became_active":"2024-09-11T23:15:13.947656+0000","last_became_peered":"2024-09-11T23:15:13.947656+0000","last_unstale":"2024-09-11T23:15:20.006334+0000","last_undegraded":"2024-09-11T23:15:20.006334+0000","last_fullsized":"2024-09-11T23:15:20.006334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251827+0000","last_change":"2024-09-11T23:15:12.945808+0000","last_active":"2024-09-11T23:15:20.251827+0000","last_peered":"2024-09-11T23:15:20.251827+0000","last_clean":"2024-09-11T23:15:20.251827+0000","last_became_active":"2024-09-11T23:15:12.945339+0000","last_became_peered":"2024-09-11T23:15:12.945339+0000","last_unstale":"2024-09-11T23:15:20.251827+0000","last_undegraded":"2024-09-11T23:15:20.251827+0000","last_fullsized":"2024-09-11T23:15:20.251827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252167+0000","last_change":"2024-09-11T23:15:18.042569+0000","last_active":"2024-09-11T23:15:20.252167+0000","last_peered":"2024-09-11T23:15:20.252167+0000","last_clean":"2024-09-11T23:15:20.252167+0000","last_became_active":"2024-09-11T23:15:18.042221+0000","last_became_peered":"2024-09-11T23:15:18.042221+0000","last_unstale":"2024-09-11T23:15:20.252167+0000","last_undegraded":"2024-09-11T23:15:20.252167+0000","last_fullsized":"2024-09-11T23:15:20.252167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011131+0000","last_change":"2024-09-11T23:15:13.959260+0000","last_active":"2024-09-11T23:15:20.011131+0000","last_peered":"2024-09-11T23:15:20.011131+0000","last_clean":"2024-09-11T23:15:20.011131+0000","last_became_active":"2024-09-11T23:15:13.958012+0000","last_became_peered":"2024-09-11T23:15:13.958012+0000","last_unstale":"2024-09-11T23:15:20.011131+0000","last_undegraded":"2024-09-11T23:15:20.011131+0000","last_fullsized":"2024-09-11T23:15:20.011131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:00.528239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005527+0000","last_change":"2024-09-11T23:15:12.956721+0000","last_active":"2024-09-11T23:15:20.005527+0000","last_peered":"2024-09-11T23:15:20.005527+0000","last_clean":"2024-09-11T23:15:20.005527+0000","last_became_active":"2024-09-11T23:15:12.956051+0000","last_became_peered":"2024-09-11T23:15:12.956051+0000","last_unstale":"2024-09-11T23:15:20.005527+0000","last_undegraded":"2024-09-11T23:15:20.005527+0000","last_fullsized":"2024-09-11T23:15:20.005527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251677+0000","last_change":"2024-09-11T23:15:18.038561+0000","last_active":"2024-09-11T23:15:20.251677+0000","last_peered":"2024-09-11T23:15:20.251677+0000","last_clean":"2024-09-11T23:15:20.251677+0000","last_became_active":"2024-09-11T23:15:18.038087+0000","last_became_peered":"2024-09-11T23:15:18.038087+0000","last_unstale":"2024-09-11T23:15:20.251677+0000","last_undegraded":"2024-09-11T23:15:20.251677+0000","last_fullsized":"2024-09-11T23:15:20.251677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251360+0000","last_change":"2024-09-11T23:15:13.945048+0000","last_active":"2024-09-11T23:15:20.251360+0000","last_peered":"2024-09-11T23:15:20.251360+0000","last_clean":"2024-09-11T23:15:20.251360+0000","last_became_active":"2024-09-11T23:15:13.944724+0000","last_became_peered":"2024-09-11T23:15:13.944724+0000","last_unstale":"2024-09-11T23:15:20.251360+0000","last_undegraded":"2024-09-11T23:15:20.251360+0000","last_fullsized":"2024-09-11T23:15:20.251360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252961+0000","last_change":"2024-09-11T23:15:12.960646+0000","last_active":"2024-09-11T23:15:20.252961+0000","last_peered":"2024-09-11T23:15:20.252961+0000","last_clean":"2024-09-11T23:15:20.252961+0000","last_became_active":"2024-09-11T23:15:12.959926+0000","last_became_peered":"2024-09-11T23:15:12.959926+0000","last_unstale":"2024-09-11T23:15:20.252961+0000","last_undegraded":"2024-09-11T23:15:20.252961+0000","last_fullsized":"2024-09-11T23:15:20.252961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254350+0000","last_change":"2024-09-11T23:15:18.038883+0000","last_active":"2024-09-11T23:15:20.254350+0000","last_peered":"2024-09-11T23:15:20.254350+0000","last_clean":"2024-09-11T23:15:20.254350+0000","last_became_active":"2024-09-11T23:15:18.038060+0000","last_became_peered":"2024-09-11T23:15:18.038060+0000","last_unstale":"2024-09-11T23:15:20.254350+0000","last_undegraded":"2024-09-11T23:15:20.254350+0000","last_fullsized":"2024-09-11T23:15:20.254350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255170+0000","last_change":"2024-09-11T23:15:13.951852+0000","last_active":"2024-09-11T23:15:20.255170+0000","last_peered":"2024-09-11T23:15:20.255170+0000","last_clean":"2024-09-11T23:15:20.255170+0000","last_became_active":"2024-09-11T23:15:13.951463+0000","last_became_peered":"2024-09-11T23:15:13.951463+0000","last_unstale":"2024-09-11T23:15:20.255170+0000","last_undegraded":"2024-09-11T23:15:20.255170+0000","last_fullsized":"2024-09-11T23:15:20.255170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:07.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253562+0000","last_change":"2024-09-11T23:15:12.967704+0000","last_active":"2024-09-11T23:15:20.253562+0000","last_peered":"2024-09-11T23:15:20.253562+0000","last_clean":"2024-09-11T23:15:20.253562+0000","last_became_active":"2024-09-11T23:15:12.966314+0000","last_became_peered":"2024-09-11T23:15:12.966314+0000","last_unstale":"2024-09-11T23:15:20.253562+0000","last_undegraded":"2024-09-11T23:15:20.253562+0000","last_fullsized":"2024-09-11T23:15:20.253562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256718+0000","last_change":"2024-09-11T23:15:18.451095+0000","last_active":"2024-09-11T23:15:20.256718+0000","last_peered":"2024-09-11T23:15:20.256718+0000","last_clean":"2024-09-11T23:15:20.256718+0000","last_became_active":"2024-09-11T23:15:18.449565+0000","last_became_peered":"2024-09-11T23:15:18.449565+0000","last_unstale":"2024-09-11T23:15:20.256718+0000","last_undegraded":"2024-09-11T23:15:20.256718+0000","last_fullsized":"2024-09-11T23:15:20.256718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003000+0000","last_change":"2024-09-11T23:15:13.980670+0000","last_active":"2024-09-11T23:15:20.003000+0000","last_peered":"2024-09-11T23:15:20.003000+0000","last_clean":"2024-09-11T23:15:20.003000+0000","last_became_active":"2024-09-11T23:15:13.980357+0000","last_became_peered":"2024-09-11T23:15:13.980357+0000","last_unstale":"2024-09-11T23:15:20.003000+0000","last_undegraded":"2024-09-11T23:15:20.003000+0000","last_fullsized":"2024-09-11T23:15:20.003000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005545+0000","last_change":"2024-09-11T23:15:12.959799+0000","last_active":"2024-09-11T23:15:20.005545+0000","last_peered":"2024-09-11T23:15:20.005545+0000","last_clean":"2024-09-11T23:15:20.005545+0000","last_became_active":"2024-09-11T23:15:12.959033+0000","last_became_peered":"2024-09-11T23:15:12.959033+0000","last_unstale":"2024-09-11T23:15:20.005545+0000","last_undegraded":"2024-09-11T23:15:20.005545+0000","last_fullsized":"2024-09-11T23:15:20.005545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253840+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:15:20.253840+0000","last_peered":"2024-09-11T23:15:20.253840+0000","last_clean":"2024-09-11T23:15:20.253840+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:15:20.253840+0000","last_undegraded":"2024-09-11T23:15:20.253840+0000","last_fullsized":"2024-09-11T23:15:20.253840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252619+0000","last_change":"2024-09-11T23:15:18.458819+0000","last_active":"2024-09-11T23:15:20.252619+0000","last_peered":"2024-09-11T23:15:20.252619+0000","last_clean":"2024-09-11T23:15:20.252619+0000","last_became_active":"2024-09-11T23:15:18.457747+0000","last_became_peered":"2024-09-11T23:15:18.457747+0000","last_unstale":"2024-09-11T23:15:20.252619+0000","last_undegraded":"2024-09-11T23:15:20.252619+0000","last_fullsized":"2024-09-11T23:15:20.252619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256534+0000","last_change":"2024-09-11T23:15:14.002907+0000","last_active":"2024-09-11T23:15:20.256534+0000","last_peered":"2024-09-11T23:15:20.256534+0000","last_clean":"2024-09-11T23:15:20.256534+0000","last_became_active":"2024-09-11T23:15:13.996895+0000","last_became_peered":"2024-09-11T23:15:13.996895+0000","last_unstale":"2024-09-11T23:15:20.256534+0000","last_undegraded":"2024-09-11T23:15:20.256534+0000","last_fullsized":"2024-09-11T23:15:20.256534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252892+0000","last_change":"2024-09-11T23:15:12.957780+0000","last_active":"2024-09-11T23:15:20.252892+0000","last_peered":"2024-09-11T23:15:20.252892+0000","last_clean":"2024-09-11T23:15:20.252892+0000","last_became_active":"2024-09-11T23:15:12.957375+0000","last_became_peered":"2024-09-11T23:15:12.957375+0000","last_unstale":"2024-09-11T23:15:20.252892+0000","last_undegraded":"2024-09-11T23:15:20.252892+0000","last_fullsized":"2024-09-11T23:15:20.252892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252849+0000","last_change":"2024-09-11T23:15:18.451410+0000","last_active":"2024-09-11T23:15:20.252849+0000","last_peered":"2024-09-11T23:15:20.252849+0000","last_clean":"2024-09-11T23:15:20.252849+0000","last_became_active":"2024-09-11T23:15:18.450381+0000","last_became_peered":"2024-09-11T23:15:18.450381+0000","last_unstale":"2024-09-11T23:15:20.252849+0000","last_undegraded":"2024-09-11T23:15:20.252849+0000","last_fullsized":"2024-09-11T23:15:20.252849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005415+0000","last_change":"2024-09-11T23:15:13.951881+0000","last_active":"2024-09-11T23:15:20.005415+0000","last_peered":"2024-09-11T23:15:20.005415+0000","last_clean":"2024-09-11T23:15:20.005415+0000","last_became_active":"2024-09-11T23:15:13.951002+0000","last_became_peered":"2024-09-11T23:15:13.951002+0000","last_unstale":"2024-09-11T23:15:20.005415+0000","last_undegraded":"2024-09-11T23:15:20.005415+0000","last_fullsized":"2024-09-11T23:15:20.005415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252772+0000","last_change":"2024-09-11T23:15:12.949969+0000","last_active":"2024-09-11T23:15:20.252772+0000","last_peered":"2024-09-11T23:15:20.252772+0000","last_clean":"2024-09-11T23:15:20.252772+0000","last_became_active":"2024-09-11T23:15:12.949624+0000","last_became_peered":"2024-09-11T23:15:12.949624+0000","last_unstale":"2024-09-11T23:15:20.252772+0000","last_undegraded":"2024-09-11T23:15:20.252772+0000","last_fullsized":"2024-09-11T23:15:20.252772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256235+0000","last_change":"2024-09-11T23:15:18.048455+0000","last_active":"2024-09-11T23:15:20.256235+0000","last_peered":"2024-09-11T23:15:20.256235+0000","last_clean":"2024-09-11T23:15:20.256235+0000","last_became_active":"2024-09-11T23:15:18.047979+0000","last_became_peered":"2024-09-11T23:15:18.047979+0000","last_unstale":"2024-09-11T23:15:20.256235+0000","last_undegraded":"2024-09-11T23:15:20.256235+0000","last_fullsized":"2024-09-11T23:15:20.256235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257597+0000","last_change":"2024-09-11T23:15:14.004585+0000","last_active":"2024-09-11T23:15:20.257597+0000","last_peered":"2024-09-11T23:15:20.257597+0000","last_clean":"2024-09-11T23:15:20.257597+0000","last_became_active":"2024-09-11T23:15:14.000088+0000","last_became_peered":"2024-09-11T23:15:14.000088+0000","last_unstale":"2024-09-11T23:15:20.257597+0000","last_undegraded":"2024-09-11T23:15:20.257597+0000","last_fullsized":"2024-09-11T23:15:20.257597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:53.838643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253011+0000","last_change":"2024-09-11T23:15:12.960122+0000","last_active":"2024-09-11T23:15:20.253011+0000","last_peered":"2024-09-11T23:15:20.253011+0000","last_clean":"2024-09-11T23:15:20.253011+0000","last_became_active":"2024-09-11T23:15:12.959575+0000","last_became_peered":"2024-09-11T23:15:12.959575+0000","last_unstale":"2024-09-11T23:15:20.253011+0000","last_undegraded":"2024-09-11T23:15:20.253011+0000","last_fullsized":"2024-09-11T23:15:20.253011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004271+0000","last_change":"2024-09-11T23:15:18.451425+0000","last_active":"2024-09-11T23:15:20.004271+0000","last_peered":"2024-09-11T23:15:20.004271+0000","last_clean":"2024-09-11T23:15:20.004271+0000","last_became_active":"2024-09-11T23:15:18.450141+0000","last_became_peered":"2024-09-11T23:15:18.450141+0000","last_unstale":"2024-09-11T23:15:20.004271+0000","last_undegraded":"2024-09-11T23:15:20.004271+0000","last_fullsized":"2024-09-11T23:15:20.004271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:52.139583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255998+0000","last_change":"2024-09-11T23:15:13.992622+0000","last_active":"2024-09-11T23:15:20.255998+0000","last_peered":"2024-09-11T23:15:20.255998+0000","last_clean":"2024-09-11T23:15:20.255998+0000","last_became_active":"2024-09-11T23:15:13.992126+0000","last_became_peered":"2024-09-11T23:15:13.992126+0000","last_unstale":"2024-09-11T23:15:20.255998+0000","last_undegraded":"2024-09-11T23:15:20.255998+0000","last_fullsized":"2024-09-11T23:15:20.255998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011556+0000","last_change":"2024-09-11T23:15:12.956823+0000","last_active":"2024-09-11T23:15:20.011556+0000","last_peered":"2024-09-11T23:15:20.011556+0000","last_clean":"2024-09-11T23:15:20.011556+0000","last_became_active":"2024-09-11T23:15:12.956008+0000","last_became_peered":"2024-09-11T23:15:12.956008+0000","last_unstale":"2024-09-11T23:15:20.011556+0000","last_undegraded":"2024-09-11T23:15:20.011556+0000","last_fullsized":"2024-09-11T23:15:20.011556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:07.503232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009464+0000","last_change":"2024-09-11T23:15:18.038980+0000","last_active":"2024-09-11T23:15:20.009464+0000","last_peered":"2024-09-11T23:15:20.009464+0000","last_clean":"2024-09-11T23:15:20.009464+0000","last_became_active":"2024-09-11T23:15:18.037945+0000","last_became_peered":"2024-09-11T23:15:18.037945+0000","last_unstale":"2024-09-11T23:15:20.009464+0000","last_undegraded":"2024-09-11T23:15:20.009464+0000","last_fullsized":"2024-09-11T23:15:20.009464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254843+0000","last_change":"2024-09-11T23:15:13.993165+0000","last_active":"2024-09-11T23:15:20.254843+0000","last_peered":"2024-09-11T23:15:20.254843+0000","last_clean":"2024-09-11T23:15:20.254843+0000","last_became_active":"2024-09-11T23:15:13.992504+0000","last_became_peered":"2024-09-11T23:15:13.992504+0000","last_unstale":"2024-09-11T23:15:20.254843+0000","last_undegraded":"2024-09-11T23:15:20.254843+0000","last_fullsized":"2024-09-11T23:15:20.254843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252247+0000","last_change":"2024-09-11T23:15:12.947477+0000","last_active":"2024-09-11T23:15:20.252247+0000","last_peered":"2024-09-11T23:15:20.252247+0000","last_clean":"2024-09-11T23:15:20.252247+0000","last_became_active":"2024-09-11T23:15:12.947007+0000","last_became_peered":"2024-09-11T23:15:12.947007+0000","last_unstale":"2024-09-11T23:15:20.252247+0000","last_undegraded":"2024-09-11T23:15:20.252247+0000","last_fullsized":"2024-09-11T23:15:20.252247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:04.981883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256142+0000","last_change":"2024-09-11T23:15:18.033305+0000","last_active":"2024-09-11T23:15:20.256142+0000","last_peered":"2024-09-11T23:15:20.256142+0000","last_clean":"2024-09-11T23:15:20.256142+0000","last_became_active":"2024-09-11T23:15:18.032851+0000","last_became_peered":"2024-09-11T23:15:18.032851+0000","last_unstale":"2024-09-11T23:15:20.256142+0000","last_undegraded":"2024-09-11T23:15:20.256142+0000","last_fullsized":"2024-09-11T23:15:20.256142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252194+0000","last_change":"2024-09-11T23:15:13.957074+0000","last_active":"2024-09-11T23:15:20.252194+0000","last_peered":"2024-09-11T23:15:20.252194+0000","last_clean":"2024-09-11T23:15:20.252194+0000","last_became_active":"2024-09-11T23:15:13.956301+0000","last_became_peered":"2024-09-11T23:15:13.956301+0000","last_unstale":"2024-09-11T23:15:20.252194+0000","last_undegraded":"2024-09-11T23:15:20.252194+0000","last_fullsized":"2024-09-11T23:15:20.252194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252337+0000","last_change":"2024-09-11T23:15:12.971136+0000","last_active":"2024-09-11T23:15:20.252337+0000","last_peered":"2024-09-11T23:15:20.252337+0000","last_clean":"2024-09-11T23:15:20.252337+0000","last_became_active":"2024-09-11T23:15:12.970142+0000","last_became_peered":"2024-09-11T23:15:12.970142+0000","last_unstale":"2024-09-11T23:15:20.252337+0000","last_undegraded":"2024-09-11T23:15:20.252337+0000","last_fullsized":"2024-09-11T23:15:20.252337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004049+0000","last_change":"2024-09-11T23:15:18.460304+0000","last_active":"2024-09-11T23:15:20.004049+0000","last_peered":"2024-09-11T23:15:20.004049+0000","last_clean":"2024-09-11T23:15:20.004049+0000","last_became_active":"2024-09-11T23:15:18.459166+0000","last_became_peered":"2024-09-11T23:15:18.459166+0000","last_unstale":"2024-09-11T23:15:20.004049+0000","last_undegraded":"2024-09-11T23:15:20.004049+0000","last_fullsized":"2024-09-11T23:15:20.004049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:18.063967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254916+0000","last_change":"2024-09-11T23:15:14.003618+0000","last_active":"2024-09-11T23:15:20.254916+0000","last_peered":"2024-09-11T23:15:20.254916+0000","last_clean":"2024-09-11T23:15:20.254916+0000","last_became_active":"2024-09-11T23:15:14.002919+0000","last_became_peered":"2024-09-11T23:15:14.002919+0000","last_unstale":"2024-09-11T23:15:20.254916+0000","last_undegraded":"2024-09-11T23:15:20.254916+0000","last_fullsized":"2024-09-11T23:15:20.254916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005255+0000","last_change":"2024-09-11T23:15:12.964766+0000","last_active":"2024-09-11T23:15:20.005255+0000","last_peered":"2024-09-11T23:15:20.005255+0000","last_clean":"2024-09-11T23:15:20.005255+0000","last_became_active":"2024-09-11T23:15:12.964115+0000","last_became_peered":"2024-09-11T23:15:12.964115+0000","last_unstale":"2024-09-11T23:15:20.005255+0000","last_undegraded":"2024-09-11T23:15:20.005255+0000","last_fullsized":"2024-09-11T23:15:20.005255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003676+0000","last_change":"2024-09-11T23:15:18.450475+0000","last_active":"2024-09-11T23:15:20.003676+0000","last_peered":"2024-09-11T23:15:20.003676+0000","last_clean":"2024-09-11T23:15:20.003676+0000","last_became_active":"2024-09-11T23:15:18.449418+0000","last_became_peered":"2024-09-11T23:15:18.449418+0000","last_unstale":"2024-09-11T23:15:20.003676+0000","last_undegraded":"2024-09-11T23:15:20.003676+0000","last_fullsized":"2024-09-11T23:15:20.003676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:22.686451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255570+0000","last_change":"2024-09-11T23:15:13.985601+0000","last_active":"2024-09-11T23:15:20.255570+0000","last_peered":"2024-09-11T23:15:20.255570+0000","last_clean":"2024-09-11T23:15:20.255570+0000","last_became_active":"2024-09-11T23:15:13.985289+0000","last_became_peered":"2024-09-11T23:15:13.985289+0000","last_unstale":"2024-09-11T23:15:20.255570+0000","last_undegraded":"2024-09-11T23:15:20.255570+0000","last_fullsized":"2024-09-11T23:15:20.255570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256225+0000","last_change":"2024-09-11T23:15:12.970791+0000","last_active":"2024-09-11T23:15:20.256225+0000","last_peered":"2024-09-11T23:15:20.256225+0000","last_clean":"2024-09-11T23:15:20.256225+0000","last_became_active":"2024-09-11T23:15:12.970526+0000","last_became_peered":"2024-09-11T23:15:12.970526+0000","last_unstale":"2024-09-11T23:15:20.256225+0000","last_undegraded":"2024-09-11T23:15:20.256225+0000","last_fullsized":"2024-09-11T23:15:20.256225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:38.061268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006186+0000","last_change":"2024-09-11T23:15:18.451679+0000","last_active":"2024-09-11T23:15:20.006186+0000","last_peered":"2024-09-11T23:15:20.006186+0000","last_clean":"2024-09-11T23:15:20.006186+0000","last_became_active":"2024-09-11T23:15:18.450530+0000","last_became_peered":"2024-09-11T23:15:18.450530+0000","last_unstale":"2024-09-11T23:15:20.006186+0000","last_undegraded":"2024-09-11T23:15:20.006186+0000","last_fullsized":"2024-09-11T23:15:20.006186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:31.718045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256402+0000","last_change":"2024-09-11T23:15:13.992617+0000","last_active":"2024-09-11T23:15:20.256402+0000","last_peered":"2024-09-11T23:15:20.256402+0000","last_clean":"2024-09-11T23:15:20.256402+0000","last_became_active":"2024-09-11T23:15:13.990843+0000","last_became_peered":"2024-09-11T23:15:13.990843+0000","last_unstale":"2024-09-11T23:15:20.256402+0000","last_undegraded":"2024-09-11T23:15:20.256402+0000","last_fullsized":"2024-09-11T23:15:20.256402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:24.450253+0000","last_change":"2024-09-11T23:15:12.963148+0000","last_active":"2024-09-11T23:15:24.450253+0000","last_peered":"2024-09-11T23:15:24.450253+0000","last_clean":"2024-09-11T23:15:24.450253+0000","last_became_active":"2024-09-11T23:15:12.961283+0000","last_became_peered":"2024-09-11T23:15:12.961283+0000","last_unstale":"2024-09-11T23:15:24.450253+0000","last_undegraded":"2024-09-11T23:15:24.450253+0000","last_fullsized":"2024-09-11T23:15:24.450253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252586+0000","last_change":"2024-09-11T23:15:18.030168+0000","last_active":"2024-09-11T23:15:20.252586+0000","last_peered":"2024-09-11T23:15:20.252586+0000","last_clean":"2024-09-11T23:15:20.252586+0000","last_became_active":"2024-09-11T23:15:18.029815+0000","last_became_peered":"2024-09-11T23:15:18.029815+0000","last_unstale":"2024-09-11T23:15:20.252586+0000","last_undegraded":"2024-09-11T23:15:20.252586+0000","last_fullsized":"2024-09-11T23:15:20.252586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011213+0000","last_change":"2024-09-11T23:15:14.000924+0000","last_active":"2024-09-11T23:15:20.011213+0000","last_peered":"2024-09-11T23:15:20.011213+0000","last_clean":"2024-09-11T23:15:20.011213+0000","last_became_active":"2024-09-11T23:15:14.000344+0000","last_became_peered":"2024-09-11T23:15:14.000344+0000","last_unstale":"2024-09-11T23:15:20.011213+0000","last_undegraded":"2024-09-11T23:15:20.011213+0000","last_fullsized":"2024-09-11T23:15:20.011213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252480+0000","last_change":"2024-09-11T23:15:12.964173+0000","last_active":"2024-09-11T23:15:20.252480+0000","last_peered":"2024-09-11T23:15:20.252480+0000","last_clean":"2024-09-11T23:15:20.252480+0000","last_became_active":"2024-09-11T23:15:12.963819+0000","last_became_peered":"2024-09-11T23:15:12.963819+0000","last_unstale":"2024-09-11T23:15:20.252480+0000","last_undegraded":"2024-09-11T23:15:20.252480+0000","last_fullsized":"2024-09-11T23:15:20.252480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010857+0000","last_change":"2024-09-11T23:15:18.045442+0000","last_active":"2024-09-11T23:15:20.010857+0000","last_peered":"2024-09-11T23:15:20.010857+0000","last_clean":"2024-09-11T23:15:20.010857+0000","last_became_active":"2024-09-11T23:15:18.042533+0000","last_became_peered":"2024-09-11T23:15:18.042533+0000","last_unstale":"2024-09-11T23:15:20.010857+0000","last_undegraded":"2024-09-11T23:15:20.010857+0000","last_fullsized":"2024-09-11T23:15:20.010857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256883+0000","last_change":"2024-09-11T23:15:13.979875+0000","last_active":"2024-09-11T23:15:20.256883+0000","last_peered":"2024-09-11T23:15:20.256883+0000","last_clean":"2024-09-11T23:15:20.256883+0000","last_became_active":"2024-09-11T23:15:13.979554+0000","last_became_peered":"2024-09-11T23:15:13.979554+0000","last_unstale":"2024-09-11T23:15:20.256883+0000","last_undegraded":"2024-09-11T23:15:20.256883+0000","last_fullsized":"2024-09-11T23:15:20.256883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005805+0000","last_change":"2024-09-11T23:15:12.970938+0000","last_active":"2024-09-11T23:15:20.005805+0000","last_peered":"2024-09-11T23:15:20.005805+0000","last_clean":"2024-09-11T23:15:20.005805+0000","last_became_active":"2024-09-11T23:15:12.970457+0000","last_became_peered":"2024-09-11T23:15:12.970457+0000","last_unstale":"2024-09-11T23:15:20.005805+0000","last_undegraded":"2024-09-11T23:15:20.005805+0000","last_fullsized":"2024-09-11T23:15:20.005805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002558+0000","last_change":"2024-09-11T23:15:18.044223+0000","last_active":"2024-09-11T23:15:20.002558+0000","last_peered":"2024-09-11T23:15:20.002558+0000","last_clean":"2024-09-11T23:15:20.002558+0000","last_became_active":"2024-09-11T23:15:18.043622+0000","last_became_peered":"2024-09-11T23:15:18.043622+0000","last_unstale":"2024-09-11T23:15:20.002558+0000","last_undegraded":"2024-09-11T23:15:20.002558+0000","last_fullsized":"2024-09-11T23:15:20.002558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:12.311044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005749+0000","last_change":"2024-09-11T23:15:13.994053+0000","last_active":"2024-09-11T23:15:20.005749+0000","last_peered":"2024-09-11T23:15:20.005749+0000","last_clean":"2024-09-11T23:15:20.005749+0000","last_became_active":"2024-09-11T23:15:13.993527+0000","last_became_peered":"2024-09-11T23:15:13.993527+0000","last_unstale":"2024-09-11T23:15:20.005749+0000","last_undegraded":"2024-09-11T23:15:20.005749+0000","last_fullsized":"2024-09-11T23:15:20.005749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255118+0000","last_change":"2024-09-11T23:15:12.971189+0000","last_active":"2024-09-11T23:15:20.255118+0000","last_peered":"2024-09-11T23:15:20.255118+0000","last_clean":"2024-09-11T23:15:20.255118+0000","last_became_active":"2024-09-11T23:15:12.970367+0000","last_became_peered":"2024-09-11T23:15:12.970367+0000","last_unstale":"2024-09-11T23:15:20.255118+0000","last_undegraded":"2024-09-11T23:15:20.255118+0000","last_fullsized":"2024-09-11T23:15:20.255118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002529+0000","last_change":"2024-09-11T23:15:18.458404+0000","last_active":"2024-09-11T23:15:20.002529+0000","last_peered":"2024-09-11T23:15:20.002529+0000","last_clean":"2024-09-11T23:15:20.002529+0000","last_became_active":"2024-09-11T23:15:18.457383+0000","last_became_peered":"2024-09-11T23:15:18.457383+0000","last_unstale":"2024-09-11T23:15:20.002529+0000","last_undegraded":"2024-09-11T23:15:20.002529+0000","last_fullsized":"2024-09-11T23:15:20.002529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:20.119273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255910+0000","last_change":"2024-09-11T23:15:18.458254+0000","last_active":"2024-09-11T23:15:20.255910+0000","last_peered":"2024-09-11T23:15:20.255910+0000","last_clean":"2024-09-11T23:15:20.255910+0000","last_became_active":"2024-09-11T23:15:18.457195+0000","last_became_peered":"2024-09-11T23:15:18.457195+0000","last_unstale":"2024-09-11T23:15:20.255910+0000","last_undegraded":"2024-09-11T23:15:20.255910+0000","last_fullsized":"2024-09-11T23:15:20.255910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251033+0000","last_change":"2024-09-11T23:15:13.947663+0000","last_active":"2024-09-11T23:15:20.251033+0000","last_peered":"2024-09-11T23:15:20.251033+0000","last_clean":"2024-09-11T23:15:20.251033+0000","last_became_active":"2024-09-11T23:15:13.947339+0000","last_became_peered":"2024-09-11T23:15:13.947339+0000","last_unstale":"2024-09-11T23:15:20.251033+0000","last_undegraded":"2024-09-11T23:15:20.251033+0000","last_fullsized":"2024-09-11T23:15:20.251033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004578+0000","last_change":"2024-09-11T23:15:12.977797+0000","last_active":"2024-09-11T23:15:20.004578+0000","last_peered":"2024-09-11T23:15:20.004578+0000","last_clean":"2024-09-11T23:15:20.004578+0000","last_became_active":"2024-09-11T23:15:12.977335+0000","last_became_peered":"2024-09-11T23:15:12.977335+0000","last_unstale":"2024-09-11T23:15:20.004578+0000","last_undegraded":"2024-09-11T23:15:20.004578+0000","last_fullsized":"2024-09-11T23:15:20.004578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254361+0000","last_change":"2024-09-11T23:15:18.037810+0000","last_active":"2024-09-11T23:15:20.254361+0000","last_peered":"2024-09-11T23:15:20.254361+0000","last_clean":"2024-09-11T23:15:20.254361+0000","last_became_active":"2024-09-11T23:15:18.036750+0000","last_became_peered":"2024-09-11T23:15:18.036750+0000","last_unstale":"2024-09-11T23:15:20.254361+0000","last_undegraded":"2024-09-11T23:15:20.254361+0000","last_fullsized":"2024-09-11T23:15:20.254361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002485+0000","last_change":"2024-09-11T23:15:13.952215+0000","last_active":"2024-09-11T23:15:20.002485+0000","last_peered":"2024-09-11T23:15:20.002485+0000","last_clean":"2024-09-11T23:15:20.002485+0000","last_became_active":"2024-09-11T23:15:13.951888+0000","last_became_peered":"2024-09-11T23:15:13.951888+0000","last_unstale":"2024-09-11T23:15:20.002485+0000","last_undegraded":"2024-09-11T23:15:20.002485+0000","last_fullsized":"2024-09-11T23:15:20.002485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003198+0000","last_change":"2024-09-11T23:15:12.963413+0000","last_active":"2024-09-11T23:15:20.003198+0000","last_peered":"2024-09-11T23:15:20.003198+0000","last_clean":"2024-09-11T23:15:20.003198+0000","last_became_active":"2024-09-11T23:15:12.962997+0000","last_became_peered":"2024-09-11T23:15:12.962997+0000","last_unstale":"2024-09-11T23:15:20.003198+0000","last_undegraded":"2024-09-11T23:15:20.003198+0000","last_fullsized":"2024-09-11T23:15:20.003198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253434+0000","last_change":"2024-09-11T23:15:12.970601+0000","last_active":"2024-09-11T23:15:20.253434+0000","last_peered":"2024-09-11T23:15:20.253434+0000","last_clean":"2024-09-11T23:15:20.253434+0000","last_became_active":"2024-09-11T23:15:12.970093+0000","last_became_peered":"2024-09-11T23:15:12.970093+0000","last_unstale":"2024-09-11T23:15:20.253434+0000","last_undegraded":"2024-09-11T23:15:20.253434+0000","last_fullsized":"2024-09-11T23:15:20.253434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256098+0000","last_change":"2024-09-11T23:15:13.951762+0000","last_active":"2024-09-11T23:15:20.256098+0000","last_peered":"2024-09-11T23:15:20.256098+0000","last_clean":"2024-09-11T23:15:20.256098+0000","last_became_active":"2024-09-11T23:15:13.951454+0000","last_became_peered":"2024-09-11T23:15:13.951454+0000","last_unstale":"2024-09-11T23:15:20.256098+0000","last_undegraded":"2024-09-11T23:15:20.256098+0000","last_fullsized":"2024-09-11T23:15:20.256098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252828+0000","last_change":"2024-09-11T23:15:18.032028+0000","last_active":"2024-09-11T23:15:20.252828+0000","last_peered":"2024-09-11T23:15:20.252828+0000","last_clean":"2024-09-11T23:15:20.252828+0000","last_became_active":"2024-09-11T23:15:18.031566+0000","last_became_peered":"2024-09-11T23:15:18.031566+0000","last_unstale":"2024-09-11T23:15:20.252828+0000","last_undegraded":"2024-09-11T23:15:20.252828+0000","last_fullsized":"2024-09-11T23:15:20.252828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:11.167279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002816+0000","last_change":"2024-09-11T23:15:12.955762+0000","last_active":"2024-09-11T23:15:20.002816+0000","last_peered":"2024-09-11T23:15:20.002816+0000","last_clean":"2024-09-11T23:15:20.002816+0000","last_became_active":"2024-09-11T23:15:12.955387+0000","last_became_peered":"2024-09-11T23:15:12.955387+0000","last_unstale":"2024-09-11T23:15:20.002816+0000","last_undegraded":"2024-09-11T23:15:20.002816+0000","last_fullsized":"2024-09-11T23:15:20.002816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010063+0000","last_change":"2024-09-11T23:15:13.956520+0000","last_active":"2024-09-11T23:15:20.010063+0000","last_peered":"2024-09-11T23:15:20.010063+0000","last_clean":"2024-09-11T23:15:20.010063+0000","last_became_active":"2024-09-11T23:15:13.952595+0000","last_became_peered":"2024-09-11T23:15:13.952595+0000","last_unstale":"2024-09-11T23:15:20.010063+0000","last_undegraded":"2024-09-11T23:15:20.010063+0000","last_fullsized":"2024-09-11T23:15:20.010063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:39.357892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003889+0000","last_change":"2024-09-11T23:15:18.044131+0000","last_active":"2024-09-11T23:15:20.003889+0000","last_peered":"2024-09-11T23:15:20.003889+0000","last_clean":"2024-09-11T23:15:20.003889+0000","last_became_active":"2024-09-11T23:15:18.043680+0000","last_became_peered":"2024-09-11T23:15:18.043680+0000","last_unstale":"2024-09-11T23:15:20.003889+0000","last_undegraded":"2024-09-11T23:15:20.003889+0000","last_fullsized":"2024-09-11T23:15:20.003889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:52.853399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251955+0000","last_change":"2024-09-11T23:15:13.957122+0000","last_active":"2024-09-11T23:15:20.251955+0000","last_peered":"2024-09-11T23:15:20.251955+0000","last_clean":"2024-09-11T23:15:20.251955+0000","last_became_active":"2024-09-11T23:15:13.956367+0000","last_became_peered":"2024-09-11T23:15:13.956367+0000","last_unstale":"2024-09-11T23:15:20.251955+0000","last_undegraded":"2024-09-11T23:15:20.251955+0000","last_fullsized":"2024-09-11T23:15:20.251955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252707+0000","last_change":"2024-09-11T23:15:13.945108+0000","last_active":"2024-09-11T23:15:20.252707+0000","last_peered":"2024-09-11T23:15:20.252707+0000","last_clean":"2024-09-11T23:15:20.252707+0000","last_became_active":"2024-09-11T23:15:13.944837+0000","last_became_peered":"2024-09-11T23:15:13.944837+0000","last_unstale":"2024-09-11T23:15:20.252707+0000","last_undegraded":"2024-09-11T23:15:20.252707+0000","last_fullsized":"2024-09-11T23:15:20.252707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005293+0000","last_change":"2024-09-11T23:15:13.954634+0000","last_active":"2024-09-11T23:15:20.005293+0000","last_peered":"2024-09-11T23:15:20.005293+0000","last_clean":"2024-09-11T23:15:20.005293+0000","last_became_active":"2024-09-11T23:15:13.953799+0000","last_became_peered":"2024-09-11T23:15:13.953799+0000","last_unstale":"2024-09-11T23:15:20.005293+0000","last_undegraded":"2024-09-11T23:15:20.005293+0000","last_fullsized":"2024-09-11T23:15:20.005293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255948+0000","last_change":"2024-09-11T23:15:13.949400+0000","last_active":"2024-09-11T23:15:20.255948+0000","last_peered":"2024-09-11T23:15:20.255948+0000","last_clean":"2024-09-11T23:15:20.255948+0000","last_became_active":"2024-09-11T23:15:13.949032+0000","last_became_peered":"2024-09-11T23:15:13.949032+0000","last_unstale":"2024-09-11T23:15:20.255948+0000","last_undegraded":"2024-09-11T23:15:20.255948+0000","last_fullsized":"2024-09-11T23:15:20.255948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003638+0000","last_change":"2024-09-11T23:15:13.960418+0000","last_active":"2024-09-11T23:15:20.003638+0000","last_peered":"2024-09-11T23:15:20.003638+0000","last_clean":"2024-09-11T23:15:20.003638+0000","last_became_active":"2024-09-11T23:15:13.960081+0000","last_became_peered":"2024-09-11T23:15:13.960081+0000","last_unstale":"2024-09-11T23:15:20.003638+0000","last_undegraded":"2024-09-11T23:15:20.003638+0000","last_fullsized":"2024-09-11T23:15:20.003638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252017+0000","last_change":"2024-09-11T23:15:13.947369+0000","last_active":"2024-09-11T23:15:20.252017+0000","last_peered":"2024-09-11T23:15:20.252017+0000","last_clean":"2024-09-11T23:15:20.252017+0000","last_became_active":"2024-09-11T23:15:13.947074+0000","last_became_peered":"2024-09-11T23:15:13.947074+0000","last_unstale":"2024-09-11T23:15:20.252017+0000","last_undegraded":"2024-09-11T23:15:20.252017+0000","last_fullsized":"2024-09-11T23:15:20.252017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254606+0000","last_change":"2024-09-11T23:15:13.995057+0000","last_active":"2024-09-11T23:15:20.254606+0000","last_peered":"2024-09-11T23:15:20.254606+0000","last_clean":"2024-09-11T23:15:20.254606+0000","last_became_active":"2024-09-11T23:15:13.994547+0000","last_became_peered":"2024-09-11T23:15:13.994547+0000","last_unstale":"2024-09-11T23:15:20.254606+0000","last_undegraded":"2024-09-11T23:15:20.254606+0000","last_fullsized":"2024-09-11T23:15:20.254606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004077+0000","last_change":"2024-09-11T23:15:13.960489+0000","last_active":"2024-09-11T23:15:20.004077+0000","last_peered":"2024-09-11T23:15:20.004077+0000","last_clean":"2024-09-11T23:15:20.004077+0000","last_became_active":"2024-09-11T23:15:13.960138+0000","last_became_peered":"2024-09-11T23:15:13.960138+0000","last_unstale":"2024-09-11T23:15:20.004077+0000","last_undegraded":"2024-09-11T23:15:20.004077+0000","last_fullsized":"2024-09-11T23:15:20.004077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004434+0000","last_change":"2024-09-11T23:15:13.963538+0000","last_active":"2024-09-11T23:15:20.004434+0000","last_peered":"2024-09-11T23:15:20.004434+0000","last_clean":"2024-09-11T23:15:20.004434+0000","last_became_active":"2024-09-11T23:15:13.947789+0000","last_became_peered":"2024-09-11T23:15:13.947789+0000","last_unstale":"2024-09-11T23:15:20.004434+0000","last_undegraded":"2024-09-11T23:15:20.004434+0000","last_fullsized":"2024-09-11T23:15:20.004434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003189+0000","last_change":"2024-09-11T23:15:13.960470+0000","last_active":"2024-09-11T23:15:20.003189+0000","last_peered":"2024-09-11T23:15:20.003189+0000","last_clean":"2024-09-11T23:15:20.003189+0000","last_became_active":"2024-09-11T23:15:13.960148+0000","last_became_peered":"2024-09-11T23:15:13.960148+0000","last_unstale":"2024-09-11T23:15:20.003189+0000","last_undegraded":"2024-09-11T23:15:20.003189+0000","last_fullsized":"2024-09-11T23:15:20.003189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004861+0000","last_change":"2024-09-11T23:15:13.992697+0000","last_active":"2024-09-11T23:15:20.004861+0000","last_peered":"2024-09-11T23:15:20.004861+0000","last_clean":"2024-09-11T23:15:20.004861+0000","last_became_active":"2024-09-11T23:15:13.992059+0000","last_became_peered":"2024-09-11T23:15:13.992059+0000","last_unstale":"2024-09-11T23:15:20.004861+0000","last_undegraded":"2024-09-11T23:15:20.004861+0000","last_fullsized":"2024-09-11T23:15:20.004861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255674+0000","last_change":"2024-09-11T23:15:13.985798+0000","last_active":"2024-09-11T23:15:20.255674+0000","last_peered":"2024-09-11T23:15:20.255674+0000","last_clean":"2024-09-11T23:15:20.255674+0000","last_became_active":"2024-09-11T23:15:13.985274+0000","last_became_peered":"2024-09-11T23:15:13.985274+0000","last_unstale":"2024-09-11T23:15:20.255674+0000","last_undegraded":"2024-09-11T23:15:20.255674+0000","last_fullsized":"2024-09-11T23:15:20.255674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253287+0000","last_change":"2024-09-11T23:15:13.973105+0000","last_active":"2024-09-11T23:15:20.253287+0000","last_peered":"2024-09-11T23:15:20.253287+0000","last_clean":"2024-09-11T23:15:20.253287+0000","last_became_active":"2024-09-11T23:15:13.971617+0000","last_became_peered":"2024-09-11T23:15:13.971617+0000","last_unstale":"2024-09-11T23:15:20.253287+0000","last_undegraded":"2024-09-11T23:15:20.253287+0000","last_fullsized":"2024-09-11T23:15:20.253287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256925+0000","last_change":"2024-09-11T23:15:14.002728+0000","last_active":"2024-09-11T23:15:20.256925+0000","last_peered":"2024-09-11T23:15:20.256925+0000","last_clean":"2024-09-11T23:15:20.256925+0000","last_became_active":"2024-09-11T23:15:13.996868+0000","last_became_peered":"2024-09-11T23:15:13.996868+0000","last_unstale":"2024-09-11T23:15:20.256925+0000","last_undegraded":"2024-09-11T23:15:20.256925+0000","last_fullsized":"2024-09-11T23:15:20.256925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252733+0000","last_change":"2024-09-11T23:15:13.973567+0000","last_active":"2024-09-11T23:15:20.252733+0000","last_peered":"2024-09-11T23:15:20.252733+0000","last_clean":"2024-09-11T23:15:20.252733+0000","last_became_active":"2024-09-11T23:15:13.973278+0000","last_became_peered":"2024-09-11T23:15:13.973278+0000","last_unstale":"2024-09-11T23:15:20.252733+0000","last_undegraded":"2024-09-11T23:15:20.252733+0000","last_fullsized":"2024-09-11T23:15:20.252733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:57.828596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006578+0000","last_change":"2024-09-11T23:15:13.999226+0000","last_active":"2024-09-11T23:15:20.006578+0000","last_peered":"2024-09-11T23:15:20.006578+0000","last_clean":"2024-09-11T23:15:20.006578+0000","last_became_active":"2024-09-11T23:15:13.998747+0000","last_became_peered":"2024-09-11T23:15:13.998747+0000","last_unstale":"2024-09-11T23:15:20.006578+0000","last_undegraded":"2024-09-11T23:15:20.006578+0000","last_fullsized":"2024-09-11T23:15:20.006578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004397+0000","last_change":"2024-09-11T23:15:13.945820+0000","last_active":"2024-09-11T23:15:20.004397+0000","last_peered":"2024-09-11T23:15:20.004397+0000","last_clean":"2024-09-11T23:15:20.004397+0000","last_became_active":"2024-09-11T23:15:13.945048+0000","last_became_peered":"2024-09-11T23:15:13.945048+0000","last_unstale":"2024-09-11T23:15:20.004397+0000","last_undegraded":"2024-09-11T23:15:20.004397+0000","last_fullsized":"2024-09-11T23:15:20.004397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251134+0000","last_change":"2024-09-11T23:15:13.950766+0000","last_active":"2024-09-11T23:15:20.251134+0000","last_peered":"2024-09-11T23:15:20.251134+0000","last_clean":"2024-09-11T23:15:20.251134+0000","last_became_active":"2024-09-11T23:15:13.950395+0000","last_became_peered":"2024-09-11T23:15:13.950395+0000","last_unstale":"2024-09-11T23:15:20.251134+0000","last_undegraded":"2024-09-11T23:15:20.251134+0000","last_fullsized":"2024-09-11T23:15:20.251134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255485+0000","last_change":"2024-09-11T23:15:13.942113+0000","last_active":"2024-09-11T23:15:20.255485+0000","last_peered":"2024-09-11T23:15:20.255485+0000","last_clean":"2024-09-11T23:15:20.255485+0000","last_became_active":"2024-09-11T23:15:13.941820+0000","last_became_peered":"2024-09-11T23:15:13.941820+0000","last_unstale":"2024-09-11T23:15:20.255485+0000","last_undegraded":"2024-09-11T23:15:20.255485+0000","last_fullsized":"2024-09-11T23:15:20.255485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:47.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002696+0000","last_change":"2024-09-11T23:15:13.990426+0000","last_active":"2024-09-11T23:15:20.002696+0000","last_peered":"2024-09-11T23:15:20.002696+0000","last_clean":"2024-09-11T23:15:20.002696+0000","last_became_active":"2024-09-11T23:15:13.990122+0000","last_became_peered":"2024-09-11T23:15:13.990122+0000","last_unstale":"2024-09-11T23:15:20.002696+0000","last_undegraded":"2024-09-11T23:15:20.002696+0000","last_fullsized":"2024-09-11T23:15:20.002696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011130+0000","last_change":"2024-09-11T23:15:13.976923+0000","last_active":"2024-09-11T23:15:20.011130+0000","last_peered":"2024-09-11T23:15:20.011130+0000","last_clean":"2024-09-11T23:15:20.011130+0000","last_became_active":"2024-09-11T23:15:13.976002+0000","last_became_peered":"2024-09-11T23:15:13.976002+0000","last_unstale":"2024-09-11T23:15:20.011130+0000","last_undegraded":"2024-09-11T23:15:20.011130+0000","last_fullsized":"2024-09-11T23:15:20.011130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.533481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253836+0000","last_change":"2024-09-11T23:15:13.988201+0000","last_active":"2024-09-11T23:15:20.253836+0000","last_peered":"2024-09-11T23:15:20.253836+0000","last_clean":"2024-09-11T23:15:20.253836+0000","last_became_active":"2024-09-11T23:15:13.987512+0000","last_became_peered":"2024-09-11T23:15:13.987512+0000","last_unstale":"2024-09-11T23:15:20.253836+0000","last_undegraded":"2024-09-11T23:15:20.253836+0000","last_fullsized":"2024-09-11T23:15:20.253836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254368+0000","last_change":"2024-09-11T23:15:13.988153+0000","last_active":"2024-09-11T23:15:20.254368+0000","last_peered":"2024-09-11T23:15:20.254368+0000","last_clean":"2024-09-11T23:15:20.254368+0000","last_became_active":"2024-09-11T23:15:13.987443+0000","last_became_peered":"2024-09-11T23:15:13.987443+0000","last_unstale":"2024-09-11T23:15:20.254368+0000","last_undegraded":"2024-09-11T23:15:20.254368+0000","last_fullsized":"2024-09-11T23:15:20.254368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257588+0000","last_change":"2024-09-11T23:15:14.002600+0000","last_active":"2024-09-11T23:15:20.257588+0000","last_peered":"2024-09-11T23:15:20.257588+0000","last_clean":"2024-09-11T23:15:20.257588+0000","last_became_active":"2024-09-11T23:15:13.997780+0000","last_became_peered":"2024-09-11T23:15:13.997780+0000","last_unstale":"2024-09-11T23:15:20.257588+0000","last_undegraded":"2024-09-11T23:15:20.257588+0000","last_fullsized":"2024-09-11T23:15:20.257588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002356+0000","last_change":"2024-09-11T23:15:13.978838+0000","last_active":"2024-09-11T23:15:20.002356+0000","last_peered":"2024-09-11T23:15:20.002356+0000","last_clean":"2024-09-11T23:15:20.002356+0000","last_became_active":"2024-09-11T23:15:13.978620+0000","last_became_peered":"2024-09-11T23:15:13.978620+0000","last_unstale":"2024-09-11T23:15:20.002356+0000","last_undegraded":"2024-09-11T23:15:20.002356+0000","last_fullsized":"2024-09-11T23:15:20.002356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254587+0000","last_change":"2024-09-11T23:15:13.993756+0000","last_active":"2024-09-11T23:15:20.254587+0000","last_peered":"2024-09-11T23:15:20.254587+0000","last_clean":"2024-09-11T23:15:20.254587+0000","last_became_active":"2024-09-11T23:15:13.991750+0000","last_became_peered":"2024-09-11T23:15:13.991750+0000","last_unstale":"2024-09-11T23:15:20.254587+0000","last_undegraded":"2024-09-11T23:15:20.254587+0000","last_fullsized":"2024-09-11T23:15:20.254587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004833+0000","last_change":"2024-09-11T23:15:13.980773+0000","last_active":"2024-09-11T23:15:20.004833+0000","last_peered":"2024-09-11T23:15:20.004833+0000","last_clean":"2024-09-11T23:15:20.004833+0000","last_became_active":"2024-09-11T23:15:13.980059+0000","last_became_peered":"2024-09-11T23:15:13.980059+0000","last_unstale":"2024-09-11T23:15:20.004833+0000","last_undegraded":"2024-09-11T23:15:20.004833+0000","last_fullsized":"2024-09-11T23:15:20.004833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254373+0000","last_change":"2024-09-11T23:15:14.002575+0000","last_active":"2024-09-11T23:15:20.254373+0000","last_peered":"2024-09-11T23:15:20.254373+0000","last_clean":"2024-09-11T23:15:20.254373+0000","last_became_active":"2024-09-11T23:15:13.997366+0000","last_became_peered":"2024-09-11T23:15:13.997366+0000","last_unstale":"2024-09-11T23:15:20.254373+0000","last_undegraded":"2024-09-11T23:15:20.254373+0000","last_fullsized":"2024-09-11T23:15:20.254373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004969+0000","last_change":"2024-09-11T23:15:13.964938+0000","last_active":"2024-09-11T23:15:20.004969+0000","last_peered":"2024-09-11T23:15:20.004969+0000","last_clean":"2024-09-11T23:15:20.004969+0000","last_became_active":"2024-09-11T23:15:13.952177+0000","last_became_peered":"2024-09-11T23:15:13.952177+0000","last_unstale":"2024-09-11T23:15:20.004969+0000","last_undegraded":"2024-09-11T23:15:20.004969+0000","last_fullsized":"2024-09-11T23:15:20.004969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256139+0000","last_change":"2024-09-11T23:15:13.944554+0000","last_active":"2024-09-11T23:15:20.256139+0000","last_peered":"2024-09-11T23:15:20.256139+0000","last_clean":"2024-09-11T23:15:20.256139+0000","last_became_active":"2024-09-11T23:15:13.944174+0000","last_became_peered":"2024-09-11T23:15:13.944174+0000","last_unstale":"2024-09-11T23:15:20.256139+0000","last_undegraded":"2024-09-11T23:15:20.256139+0000","last_fullsized":"2024-09-11T23:15:20.256139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253250+0000","last_change":"2024-09-11T23:15:13.941668+0000","last_active":"2024-09-11T23:15:20.253250+0000","last_peered":"2024-09-11T23:15:20.253250+0000","last_clean":"2024-09-11T23:15:20.253250+0000","last_became_active":"2024-09-11T23:15:13.941362+0000","last_became_peered":"2024-09-11T23:15:13.941362+0000","last_unstale":"2024-09-11T23:15:20.253250+0000","last_undegraded":"2024-09-11T23:15:20.253250+0000","last_fullsized":"2024-09-11T23:15:20.253250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257415+0000","last_change":"2024-09-11T23:15:14.003307+0000","last_active":"2024-09-11T23:15:20.257415+0000","last_peered":"2024-09-11T23:15:20.257415+0000","last_clean":"2024-09-11T23:15:20.257415+0000","last_became_active":"2024-09-11T23:15:13.998994+0000","last_became_peered":"2024-09-11T23:15:13.998994+0000","last_unstale":"2024-09-11T23:15:20.257415+0000","last_undegraded":"2024-09-11T23:15:20.257415+0000","last_fullsized":"2024-09-11T23:15:20.257415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:15:39.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:15:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.504+0000 7f9c5d2c6640 1 Processor -- start 2024-09-11T23:15:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.504+0000 7f9c5d2c6640 1 -- start start 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c5d2c6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c5806c3d0 0x7f9c5815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c5d2c6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5815fc10 con 0x7f9c5815f830 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c5d2c6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5815d800 con 0x7f9c5815d290 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c5d2c6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9c5815da40 con 0x7f9c5806c3d0 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c4ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c5806c3d0 0x7f9c5815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c4ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c5806c3d0 0x7f9c5815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40868/0 (socket says 172.21.15.94:40868) 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c4ffff640 1 -- 172.21.15.94:0/3584509365 learned_addr learned my addr 172.21.15.94:0/3584509365 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c4ffff640 1 -- 172.21.15.94:0/3584509365 >> v1:172.21.15.155:6789/0 conn(0x7f9c5815d290 legacy=0x7f9c5815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c4ffff640 1 -- 172.21.15.94:0/3584509365 >> v1:172.21.15.94:6789/0 conn(0x7f9c5815f830 legacy=0x7f9c5806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c4ffff640 1 -- 172.21.15.94:0/3584509365 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580b3570 con 0x7f9c5806c3d0 2024-09-11T23:15:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c4ffff640 1 --2- 172.21.15.94:0/3584509365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5806c3d0 0x7f9c5815ded0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009870 tx=0x7f9c5815f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfc452f2e53ac97 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c567fc640 1 -- 172.21.15.94:0/3584509365 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400aa650 con 0x7f9c5806c3d0 2024-09-11T23:15:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c567fc640 1 -- 172.21.15.94:0/3584509365 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c400af070 con 0x7f9c5806c3d0 2024-09-11T23:15:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.508+0000 7f9c567fc640 1 -- 172.21.15.94:0/3584509365 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400aaa10 con 0x7f9c5806c3d0 2024-09-11T23:15:39.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/3584509365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5806c3d0 msgr2=0x7f9c5815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/3584509365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5806c3d0 0x7f9c5815ded0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009870 tx=0x7f9c5815f330 comp rx=0 tx=0).stop 2024-09-11T23:15:39.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/3584509365 shutdown_connections 2024-09-11T23:15:39.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/3584509365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5806c3d0 0x7f9c5815ded0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/3584509365 >> 172.21.15.94:0/3584509365 conn(0x7f9c580b6800 msgr2=0x7f9c580b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/3584509365 shutdown_connections 2024-09-11T23:15:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/3584509365 wait complete. 2024-09-11T23:15:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 Processor -- start 2024-09-11T23:15:39.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- start start 2024-09-11T23:15:39.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5806c3d0 0x7f9c5813fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5815d290 0x7f9c580b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5815f830 0x7f9c581f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5816a3a0 con 0x7f9c5815d290 2024-09-11T23:15:39.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5816a220 con 0x7f9c5806c3d0 2024-09-11T23:15:39.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5816a520 con 0x7f9c5815f830 2024-09-11T23:15:39.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5815d290 0x7f9c580b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5815d290 0x7f9c580b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40874/0 (socket says 172.21.15.94:40874) 2024-09-11T23:15:39.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 -- 172.21.15.94:0/2729016263 learned_addr learned my addr 172.21.15.94:0/2729016263 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:39.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c56ffd640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5806c3d0 0x7f9c5813fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c577fe640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5815f830 0x7f9c581f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 -- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5815f830 msgr2=0x7f9c581f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5815f830 0x7f9c581f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 -- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5806c3d0 msgr2=0x7f9c5813fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5806c3d0 0x7f9c5813fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 -- 172.21.15.94:0/2729016263 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c58140040 con 0x7f9c5815d290 2024-09-11T23:15:39.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c56ffd640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5806c3d0 0x7f9c5813fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:39.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4ffff640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5815d290 0x7f9c580b1d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c400ac040 tx=0x7f9c4001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4f7fe640 1 -- 172.21.15.94:0/2729016263 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400b3800 con 0x7f9c5815d290 2024-09-11T23:15:39.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4f7fe640 1 -- 172.21.15.94:0/2729016263 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c400a6040 con 0x7f9c5815d290 2024-09-11T23:15:39.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c580b0c90 con 0x7f9c5815d290 2024-09-11T23:15:39.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c4f7fe640 1 -- 172.21.15.94:0/2729016263 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400b3c00 con 0x7f9c5815d290 2024-09-11T23:15:39.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.512+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c580b1250 con 0x7f9c5815d290 2024-09-11T23:15:39.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.516+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c5806bcc0 con 0x7f9c5815d290 2024-09-11T23:15:39.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.516+0000 7f9c4f7fe640 1 -- 172.21.15.94:0/2729016263 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c400c6390 con 0x7f9c5815d290 2024-09-11T23:15:39.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.516+0000 7f9c4f7fe640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c380678c0 0x7f9c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.516+0000 7f9c4f7fe640 1 -- 172.21.15.94:0/2729016263 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9c40120600 con 0x7f9c5815d290 2024-09-11T23:15:39.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.516+0000 7f9c56ffd640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c380678c0 0x7f9c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.516+0000 7f9c56ffd640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c380678c0 0x7f9c38069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c480016f0 tx=0x7f9c48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.520+0000 7f9c4f7fe640 1 -- 172.21.15.94:0/2729016263 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9c400c3060 con 0x7f9c5815d290 2024-09-11T23:15:39.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.664+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c5815a050 con 0x7f9c380678c0 2024-09-11T23:15:39.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.688+0000 7f9c4f7fe640 1 -- 172.21.15.94:0/2729016263 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f9c5815a050 con 0x7f9c380678c0 2024-09-11T23:15:39.693 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:39.695 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:15:39.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c380678c0 msgr2=0x7f9c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c380678c0 0x7f9c38069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c480016f0 tx=0x7f9c48009040 comp rx=0 tx=0).stop 2024-09-11T23:15:39.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5815d290 msgr2=0x7f9c580b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5815d290 0x7f9c580b1d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c400ac040 tx=0x7f9c4001ad30 comp rx=0 tx=0).stop 2024-09-11T23:15:39.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 shutdown_connections 2024-09-11T23:15:39.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5815f830 0x7f9c581f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c380678c0 0x7f9c38069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c5815d290 0x7f9c580b1d30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 --2- 172.21.15.94:0/2729016263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5806c3d0 0x7f9c5813fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 >> 172.21.15.94:0/2729016263 conn(0x7f9c580b6800 msgr2=0x7f9c581506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:39.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 shutdown_connections 2024-09-11T23:15:39.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.692+0000 7f9c5d2c6640 1 -- 172.21.15.94:0/2729016263 wait complete. 2024-09-11T23:15:39.710 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-11T23:15:37.974938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236204,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738516,"statfs":{"total":773094113280,"available":772852240384,"internally_reserved":0,"allocated":3383296,"data_stored":2049164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004663"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256938+0000","last_change":"2024-09-11T23:15:12.971939+0000","last_active":"2024-09-11T23:15:20.256938+0000","last_peered":"2024-09-11T23:15:20.256938+0000","last_clean":"2024-09-11T23:15:20.256938+0000","last_became_active":"2024-09-11T23:15:12.971664+0000","last_became_peered":"2024-09-11T23:15:12.971664+0000","last_unstale":"2024-09-11T23:15:20.256938+0000","last_undegraded":"2024-09-11T23:15:20.256938+0000","last_fullsized":"2024-09-11T23:15:20.256938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:21.586294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003953+0000","last_change":"2024-09-11T23:15:13.990297+0000","last_active":"2024-09-11T23:15:20.003953+0000","last_peered":"2024-09-11T23:15:20.003953+0000","last_clean":"2024-09-11T23:15:20.003953+0000","last_became_active":"2024-09-11T23:15:13.989971+0000","last_became_peered":"2024-09-11T23:15:13.989971+0000","last_unstale":"2024-09-11T23:15:20.003953+0000","last_undegraded":"2024-09-11T23:15:20.003953+0000","last_fullsized":"2024-09-11T23:15:20.003953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002406+0000","last_change":"2024-09-11T23:15:18.458647+0000","last_active":"2024-09-11T23:15:20.002406+0000","last_peered":"2024-09-11T23:15:20.002406+0000","last_clean":"2024-09-11T23:15:20.002406+0000","last_became_active":"2024-09-11T23:15:18.457571+0000","last_became_peered":"2024-09-11T23:15:18.457571+0000","last_unstale":"2024-09-11T23:15:20.002406+0000","last_undegraded":"2024-09-11T23:15:20.002406+0000","last_fullsized":"2024-09-11T23:15:20.002406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:45.970652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004208+0000","last_change":"2024-09-11T23:15:12.963138+0000","last_active":"2024-09-11T23:15:20.004208+0000","last_peered":"2024-09-11T23:15:20.004208+0000","last_clean":"2024-09-11T23:15:20.004208+0000","last_became_active":"2024-09-11T23:15:12.962545+0000","last_became_peered":"2024-09-11T23:15:12.962545+0000","last_unstale":"2024-09-11T23:15:20.004208+0000","last_undegraded":"2024-09-11T23:15:20.004208+0000","last_fullsized":"2024-09-11T23:15:20.004208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256716+0000","last_change":"2024-09-11T23:15:13.979850+0000","last_active":"2024-09-11T23:15:20.256716+0000","last_peered":"2024-09-11T23:15:20.256716+0000","last_clean":"2024-09-11T23:15:20.256716+0000","last_became_active":"2024-09-11T23:15:13.979530+0000","last_became_peered":"2024-09-11T23:15:13.979530+0000","last_unstale":"2024-09-11T23:15:20.256716+0000","last_undegraded":"2024-09-11T23:15:20.256716+0000","last_fullsized":"2024-09-11T23:15:20.256716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009823+0000","last_change":"2024-09-11T23:15:18.048713+0000","last_active":"2024-09-11T23:15:20.009823+0000","last_peered":"2024-09-11T23:15:20.009823+0000","last_clean":"2024-09-11T23:15:20.009823+0000","last_became_active":"2024-09-11T23:15:18.047487+0000","last_became_peered":"2024-09-11T23:15:18.047487+0000","last_unstale":"2024-09-11T23:15:20.009823+0000","last_undegraded":"2024-09-11T23:15:20.009823+0000","last_fullsized":"2024-09-11T23:15:20.009823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256782+0000","last_change":"2024-09-11T23:15:12.973574+0000","last_active":"2024-09-11T23:15:20.256782+0000","last_peered":"2024-09-11T23:15:20.256782+0000","last_clean":"2024-09-11T23:15:20.256782+0000","last_became_active":"2024-09-11T23:15:12.972945+0000","last_became_peered":"2024-09-11T23:15:12.972945+0000","last_unstale":"2024-09-11T23:15:20.256782+0000","last_undegraded":"2024-09-11T23:15:20.256782+0000","last_fullsized":"2024-09-11T23:15:20.256782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.523986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005274+0000","last_change":"2024-09-11T23:15:13.955300+0000","last_active":"2024-09-11T23:15:20.005274+0000","last_peered":"2024-09-11T23:15:20.005274+0000","last_clean":"2024-09-11T23:15:20.005274+0000","last_became_active":"2024-09-11T23:15:13.952807+0000","last_became_peered":"2024-09-11T23:15:13.952807+0000","last_unstale":"2024-09-11T23:15:20.005274+0000","last_undegraded":"2024-09-11T23:15:20.005274+0000","last_fullsized":"2024-09-11T23:15:20.005274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010459+0000","last_change":"2024-09-11T23:15:18.046772+0000","last_active":"2024-09-11T23:15:20.010459+0000","last_peered":"2024-09-11T23:15:20.010459+0000","last_clean":"2024-09-11T23:15:20.010459+0000","last_became_active":"2024-09-11T23:15:18.044361+0000","last_became_peered":"2024-09-11T23:15:18.044361+0000","last_unstale":"2024-09-11T23:15:20.010459+0000","last_undegraded":"2024-09-11T23:15:20.010459+0000","last_fullsized":"2024-09-11T23:15:20.010459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254970+0000","last_change":"2024-09-11T23:15:12.973316+0000","last_active":"2024-09-11T23:15:20.254970+0000","last_peered":"2024-09-11T23:15:20.254970+0000","last_clean":"2024-09-11T23:15:20.254970+0000","last_became_active":"2024-09-11T23:15:12.972758+0000","last_became_peered":"2024-09-11T23:15:12.972758+0000","last_unstale":"2024-09-11T23:15:20.254970+0000","last_undegraded":"2024-09-11T23:15:20.254970+0000","last_fullsized":"2024-09-11T23:15:20.254970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:56.819101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006154+0000","last_change":"2024-09-11T23:15:13.974148+0000","last_active":"2024-09-11T23:15:20.006154+0000","last_peered":"2024-09-11T23:15:20.006154+0000","last_clean":"2024-09-11T23:15:20.006154+0000","last_became_active":"2024-09-11T23:15:13.973423+0000","last_became_peered":"2024-09-11T23:15:13.973423+0000","last_unstale":"2024-09-11T23:15:20.006154+0000","last_undegraded":"2024-09-11T23:15:20.006154+0000","last_fullsized":"2024-09-11T23:15:20.006154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009681+0000","last_change":"2024-09-11T23:15:18.039529+0000","last_active":"2024-09-11T23:15:20.009681+0000","last_peered":"2024-09-11T23:15:20.009681+0000","last_clean":"2024-09-11T23:15:20.009681+0000","last_became_active":"2024-09-11T23:15:18.035361+0000","last_became_peered":"2024-09-11T23:15:18.035361+0000","last_unstale":"2024-09-11T23:15:20.009681+0000","last_undegraded":"2024-09-11T23:15:20.009681+0000","last_fullsized":"2024-09-11T23:15:20.009681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252965+0000","last_change":"2024-09-11T23:15:13.987303+0000","last_active":"2024-09-11T23:15:20.252965+0000","last_peered":"2024-09-11T23:15:20.252965+0000","last_clean":"2024-09-11T23:15:20.252965+0000","last_became_active":"2024-09-11T23:15:13.986026+0000","last_became_peered":"2024-09-11T23:15:13.986026+0000","last_unstale":"2024-09-11T23:15:20.252965+0000","last_undegraded":"2024-09-11T23:15:20.252965+0000","last_fullsized":"2024-09-11T23:15:20.252965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255344+0000","last_change":"2024-09-11T23:15:12.978008+0000","last_active":"2024-09-11T23:15:20.255344+0000","last_peered":"2024-09-11T23:15:20.255344+0000","last_clean":"2024-09-11T23:15:20.255344+0000","last_became_active":"2024-09-11T23:15:12.977577+0000","last_became_peered":"2024-09-11T23:15:12.977577+0000","last_unstale":"2024-09-11T23:15:20.255344+0000","last_undegraded":"2024-09-11T23:15:20.255344+0000","last_fullsized":"2024-09-11T23:15:20.255344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:04.986111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011696+0000","last_change":"2024-09-11T23:15:18.040717+0000","last_active":"2024-09-11T23:15:20.011696+0000","last_peered":"2024-09-11T23:15:20.011696+0000","last_clean":"2024-09-11T23:15:20.011696+0000","last_became_active":"2024-09-11T23:15:18.039316+0000","last_became_peered":"2024-09-11T23:15:18.039316+0000","last_unstale":"2024-09-11T23:15:20.011696+0000","last_undegraded":"2024-09-11T23:15:20.011696+0000","last_fullsized":"2024-09-11T23:15:20.011696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002755+0000","last_change":"2024-09-11T23:15:13.951501+0000","last_active":"2024-09-11T23:15:20.002755+0000","last_peered":"2024-09-11T23:15:20.002755+0000","last_clean":"2024-09-11T23:15:20.002755+0000","last_became_active":"2024-09-11T23:15:13.951199+0000","last_became_peered":"2024-09-11T23:15:13.951199+0000","last_unstale":"2024-09-11T23:15:20.002755+0000","last_undegraded":"2024-09-11T23:15:20.002755+0000","last_fullsized":"2024-09-11T23:15:20.002755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253117+0000","last_change":"2024-09-11T23:15:12.963618+0000","last_active":"2024-09-11T23:15:20.253117+0000","last_peered":"2024-09-11T23:15:20.253117+0000","last_clean":"2024-09-11T23:15:20.253117+0000","last_became_active":"2024-09-11T23:15:12.963221+0000","last_became_peered":"2024-09-11T23:15:12.963221+0000","last_unstale":"2024-09-11T23:15:20.253117+0000","last_undegraded":"2024-09-11T23:15:20.253117+0000","last_fullsized":"2024-09-11T23:15:20.253117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011380+0000","last_change":"2024-09-11T23:15:18.037481+0000","last_active":"2024-09-11T23:15:20.011380+0000","last_peered":"2024-09-11T23:15:20.011380+0000","last_clean":"2024-09-11T23:15:20.011380+0000","last_became_active":"2024-09-11T23:15:18.036406+0000","last_became_peered":"2024-09-11T23:15:18.036406+0000","last_unstale":"2024-09-11T23:15:20.011380+0000","last_undegraded":"2024-09-11T23:15:20.011380+0000","last_fullsized":"2024-09-11T23:15:20.011380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002601+0000","last_change":"2024-09-11T23:15:13.946573+0000","last_active":"2024-09-11T23:15:20.002601+0000","last_peered":"2024-09-11T23:15:20.002601+0000","last_clean":"2024-09-11T23:15:20.002601+0000","last_became_active":"2024-09-11T23:15:13.946197+0000","last_became_peered":"2024-09-11T23:15:13.946197+0000","last_unstale":"2024-09-11T23:15:20.002601+0000","last_undegraded":"2024-09-11T23:15:20.002601+0000","last_fullsized":"2024-09-11T23:15:20.002601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251927+0000","last_change":"2024-09-11T23:15:12.973005+0000","last_active":"2024-09-11T23:15:20.251927+0000","last_peered":"2024-09-11T23:15:20.251927+0000","last_clean":"2024-09-11T23:15:20.251927+0000","last_became_active":"2024-09-11T23:15:12.972755+0000","last_became_peered":"2024-09-11T23:15:12.972755+0000","last_unstale":"2024-09-11T23:15:20.251927+0000","last_undegraded":"2024-09-11T23:15:20.251927+0000","last_fullsized":"2024-09-11T23:15:20.251927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254128+0000","last_change":"2024-09-11T23:15:18.458359+0000","last_active":"2024-09-11T23:15:20.254128+0000","last_peered":"2024-09-11T23:15:20.254128+0000","last_clean":"2024-09-11T23:15:20.254128+0000","last_became_active":"2024-09-11T23:15:18.457312+0000","last_became_peered":"2024-09-11T23:15:18.457312+0000","last_unstale":"2024-09-11T23:15:20.254128+0000","last_undegraded":"2024-09-11T23:15:20.254128+0000","last_fullsized":"2024-09-11T23:15:20.254128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010080+0000","last_change":"2024-09-11T23:15:13.949978+0000","last_active":"2024-09-11T23:15:20.010080+0000","last_peered":"2024-09-11T23:15:20.010080+0000","last_clean":"2024-09-11T23:15:20.010080+0000","last_became_active":"2024-09-11T23:15:13.948572+0000","last_became_peered":"2024-09-11T23:15:13.948572+0000","last_unstale":"2024-09-11T23:15:20.010080+0000","last_undegraded":"2024-09-11T23:15:20.010080+0000","last_fullsized":"2024-09-11T23:15:20.010080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:18.647972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253258+0000","last_change":"2024-09-11T23:15:12.967038+0000","last_active":"2024-09-11T23:15:20.253258+0000","last_peered":"2024-09-11T23:15:20.253258+0000","last_clean":"2024-09-11T23:15:20.253258+0000","last_became_active":"2024-09-11T23:15:12.965415+0000","last_became_peered":"2024-09-11T23:15:12.965415+0000","last_unstale":"2024-09-11T23:15:20.253258+0000","last_undegraded":"2024-09-11T23:15:20.253258+0000","last_fullsized":"2024-09-11T23:15:20.253258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011695+0000","last_change":"2024-09-11T23:15:18.046520+0000","last_active":"2024-09-11T23:15:20.011695+0000","last_peered":"2024-09-11T23:15:20.011695+0000","last_clean":"2024-09-11T23:15:20.011695+0000","last_became_active":"2024-09-11T23:15:18.045457+0000","last_became_peered":"2024-09-11T23:15:18.045457+0000","last_unstale":"2024-09-11T23:15:20.011695+0000","last_undegraded":"2024-09-11T23:15:20.011695+0000","last_fullsized":"2024-09-11T23:15:20.011695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256732+0000","last_change":"2024-09-11T23:15:13.941941+0000","last_active":"2024-09-11T23:15:20.256732+0000","last_peered":"2024-09-11T23:15:20.256732+0000","last_clean":"2024-09-11T23:15:20.256732+0000","last_became_active":"2024-09-11T23:15:13.941593+0000","last_became_peered":"2024-09-11T23:15:13.941593+0000","last_unstale":"2024-09-11T23:15:20.256732+0000","last_undegraded":"2024-09-11T23:15:20.256732+0000","last_fullsized":"2024-09-11T23:15:20.256732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:33.314997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255566+0000","last_change":"2024-09-11T23:15:12.980259+0000","last_active":"2024-09-11T23:15:20.255566+0000","last_peered":"2024-09-11T23:15:20.255566+0000","last_clean":"2024-09-11T23:15:20.255566+0000","last_became_active":"2024-09-11T23:15:12.979084+0000","last_became_peered":"2024-09-11T23:15:12.979084+0000","last_unstale":"2024-09-11T23:15:20.255566+0000","last_undegraded":"2024-09-11T23:15:20.255566+0000","last_fullsized":"2024-09-11T23:15:20.255566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010030+0000","last_change":"2024-09-11T23:15:18.450939+0000","last_active":"2024-09-11T23:15:20.010030+0000","last_peered":"2024-09-11T23:15:20.010030+0000","last_clean":"2024-09-11T23:15:20.010030+0000","last_became_active":"2024-09-11T23:15:18.449905+0000","last_became_peered":"2024-09-11T23:15:18.449905+0000","last_unstale":"2024-09-11T23:15:20.010030+0000","last_undegraded":"2024-09-11T23:15:20.010030+0000","last_fullsized":"2024-09-11T23:15:20.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004150+0000","last_change":"2024-09-11T23:15:13.998809+0000","last_active":"2024-09-11T23:15:20.004150+0000","last_peered":"2024-09-11T23:15:20.004150+0000","last_clean":"2024-09-11T23:15:20.004150+0000","last_became_active":"2024-09-11T23:15:13.998546+0000","last_became_peered":"2024-09-11T23:15:13.998546+0000","last_unstale":"2024-09-11T23:15:20.004150+0000","last_undegraded":"2024-09-11T23:15:20.004150+0000","last_fullsized":"2024-09-11T23:15:20.004150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253620+0000","last_change":"2024-09-11T23:15:12.962583+0000","last_active":"2024-09-11T23:15:20.253620+0000","last_peered":"2024-09-11T23:15:20.253620+0000","last_clean":"2024-09-11T23:15:20.253620+0000","last_became_active":"2024-09-11T23:15:12.962238+0000","last_became_peered":"2024-09-11T23:15:12.962238+0000","last_unstale":"2024-09-11T23:15:20.253620+0000","last_undegraded":"2024-09-11T23:15:20.253620+0000","last_fullsized":"2024-09-11T23:15:20.253620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002270+0000","last_change":"2024-09-11T23:15:18.450216+0000","last_active":"2024-09-11T23:15:20.002270+0000","last_peered":"2024-09-11T23:15:20.002270+0000","last_clean":"2024-09-11T23:15:20.002270+0000","last_became_active":"2024-09-11T23:15:18.449301+0000","last_became_peered":"2024-09-11T23:15:18.449301+0000","last_unstale":"2024-09-11T23:15:20.002270+0000","last_undegraded":"2024-09-11T23:15:20.002270+0000","last_fullsized":"2024-09-11T23:15:20.002270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251732+0000","last_change":"2024-09-11T23:15:13.945641+0000","last_active":"2024-09-11T23:15:20.251732+0000","last_peered":"2024-09-11T23:15:20.251732+0000","last_clean":"2024-09-11T23:15:20.251732+0000","last_became_active":"2024-09-11T23:15:13.945333+0000","last_became_peered":"2024-09-11T23:15:13.945333+0000","last_unstale":"2024-09-11T23:15:20.251732+0000","last_undegraded":"2024-09-11T23:15:20.251732+0000","last_fullsized":"2024-09-11T23:15:20.251732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257048+0000","last_change":"2024-09-11T23:15:12.974878+0000","last_active":"2024-09-11T23:15:20.257048+0000","last_peered":"2024-09-11T23:15:20.257048+0000","last_clean":"2024-09-11T23:15:20.257048+0000","last_became_active":"2024-09-11T23:15:12.973946+0000","last_became_peered":"2024-09-11T23:15:12.973946+0000","last_unstale":"2024-09-11T23:15:20.257048+0000","last_undegraded":"2024-09-11T23:15:20.257048+0000","last_fullsized":"2024-09-11T23:15:20.257048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255824+0000","last_change":"2024-09-11T23:15:18.452665+0000","last_active":"2024-09-11T23:15:20.255824+0000","last_peered":"2024-09-11T23:15:20.255824+0000","last_clean":"2024-09-11T23:15:20.255824+0000","last_became_active":"2024-09-11T23:15:18.450946+0000","last_became_peered":"2024-09-11T23:15:18.450946+0000","last_unstale":"2024-09-11T23:15:20.255824+0000","last_undegraded":"2024-09-11T23:15:20.255824+0000","last_fullsized":"2024-09-11T23:15:20.255824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:57.907577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006334+0000","last_change":"2024-09-11T23:15:13.951679+0000","last_active":"2024-09-11T23:15:20.006334+0000","last_peered":"2024-09-11T23:15:20.006334+0000","last_clean":"2024-09-11T23:15:20.006334+0000","last_became_active":"2024-09-11T23:15:13.947656+0000","last_became_peered":"2024-09-11T23:15:13.947656+0000","last_unstale":"2024-09-11T23:15:20.006334+0000","last_undegraded":"2024-09-11T23:15:20.006334+0000","last_fullsized":"2024-09-11T23:15:20.006334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251827+0000","last_change":"2024-09-11T23:15:12.945808+0000","last_active":"2024-09-11T23:15:20.251827+0000","last_peered":"2024-09-11T23:15:20.251827+0000","last_clean":"2024-09-11T23:15:20.251827+0000","last_became_active":"2024-09-11T23:15:12.945339+0000","last_became_peered":"2024-09-11T23:15:12.945339+0000","last_unstale":"2024-09-11T23:15:20.251827+0000","last_undegraded":"2024-09-11T23:15:20.251827+0000","last_fullsized":"2024-09-11T23:15:20.251827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252167+0000","last_change":"2024-09-11T23:15:18.042569+0000","last_active":"2024-09-11T23:15:20.252167+0000","last_peered":"2024-09-11T23:15:20.252167+0000","last_clean":"2024-09-11T23:15:20.252167+0000","last_became_active":"2024-09-11T23:15:18.042221+0000","last_became_peered":"2024-09-11T23:15:18.042221+0000","last_unstale":"2024-09-11T23:15:20.252167+0000","last_undegraded":"2024-09-11T23:15:20.252167+0000","last_fullsized":"2024-09-11T23:15:20.252167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011131+0000","last_change":"2024-09-11T23:15:13.959260+0000","last_active":"2024-09-11T23:15:20.011131+0000","last_peered":"2024-09-11T23:15:20.011131+0000","last_clean":"2024-09-11T23:15:20.011131+0000","last_became_active":"2024-09-11T23:15:13.958012+0000","last_became_peered":"2024-09-11T23:15:13.958012+0000","last_unstale":"2024-09-11T23:15:20.011131+0000","last_undegraded":"2024-09-11T23:15:20.011131+0000","last_fullsized":"2024-09-11T23:15:20.011131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:00.528239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005527+0000","last_change":"2024-09-11T23:15:12.956721+0000","last_active":"2024-09-11T23:15:20.005527+0000","last_peered":"2024-09-11T23:15:20.005527+0000","last_clean":"2024-09-11T23:15:20.005527+0000","last_became_active":"2024-09-11T23:15:12.956051+0000","last_became_peered":"2024-09-11T23:15:12.956051+0000","last_unstale":"2024-09-11T23:15:20.005527+0000","last_undegraded":"2024-09-11T23:15:20.005527+0000","last_fullsized":"2024-09-11T23:15:20.005527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251677+0000","last_change":"2024-09-11T23:15:18.038561+0000","last_active":"2024-09-11T23:15:20.251677+0000","last_peered":"2024-09-11T23:15:20.251677+0000","last_clean":"2024-09-11T23:15:20.251677+0000","last_became_active":"2024-09-11T23:15:18.038087+0000","last_became_peered":"2024-09-11T23:15:18.038087+0000","last_unstale":"2024-09-11T23:15:20.251677+0000","last_undegraded":"2024-09-11T23:15:20.251677+0000","last_fullsized":"2024-09-11T23:15:20.251677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251360+0000","last_change":"2024-09-11T23:15:13.945048+0000","last_active":"2024-09-11T23:15:20.251360+0000","last_peered":"2024-09-11T23:15:20.251360+0000","last_clean":"2024-09-11T23:15:20.251360+0000","last_became_active":"2024-09-11T23:15:13.944724+0000","last_became_peered":"2024-09-11T23:15:13.944724+0000","last_unstale":"2024-09-11T23:15:20.251360+0000","last_undegraded":"2024-09-11T23:15:20.251360+0000","last_fullsized":"2024-09-11T23:15:20.251360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252961+0000","last_change":"2024-09-11T23:15:12.960646+0000","last_active":"2024-09-11T23:15:20.252961+0000","last_peered":"2024-09-11T23:15:20.252961+0000","last_clean":"2024-09-11T23:15:20.252961+0000","last_became_active":"2024-09-11T23:15:12.959926+0000","last_became_peered":"2024-09-11T23:15:12.959926+0000","last_unstale":"2024-09-11T23:15:20.252961+0000","last_undegraded":"2024-09-11T23:15:20.252961+0000","last_fullsized":"2024-09-11T23:15:20.252961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254350+0000","last_change":"2024-09-11T23:15:18.038883+0000","last_active":"2024-09-11T23:15:20.254350+0000","last_peered":"2024-09-11T23:15:20.254350+0000","last_clean":"2024-09-11T23:15:20.254350+0000","last_became_active":"2024-09-11T23:15:18.038060+0000","last_became_peered":"2024-09-11T23:15:18.038060+0000","last_unstale":"2024-09-11T23:15:20.254350+0000","last_undegraded":"2024-09-11T23:15:20.254350+0000","last_fullsized":"2024-09-11T23:15:20.254350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:06.873404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255170+0000","last_change":"2024-09-11T23:15:13.951852+0000","last_active":"2024-09-11T23:15:20.255170+0000","last_peered":"2024-09-11T23:15:20.255170+0000","last_clean":"2024-09-11T23:15:20.255170+0000","last_became_active":"2024-09-11T23:15:13.951463+0000","last_became_peered":"2024-09-11T23:15:13.951463+0000","last_unstale":"2024-09-11T23:15:20.255170+0000","last_undegraded":"2024-09-11T23:15:20.255170+0000","last_fullsized":"2024-09-11T23:15:20.255170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:07.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253562+0000","last_change":"2024-09-11T23:15:12.967704+0000","last_active":"2024-09-11T23:15:20.253562+0000","last_peered":"2024-09-11T23:15:20.253562+0000","last_clean":"2024-09-11T23:15:20.253562+0000","last_became_active":"2024-09-11T23:15:12.966314+0000","last_became_peered":"2024-09-11T23:15:12.966314+0000","last_unstale":"2024-09-11T23:15:20.253562+0000","last_undegraded":"2024-09-11T23:15:20.253562+0000","last_fullsized":"2024-09-11T23:15:20.253562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256718+0000","last_change":"2024-09-11T23:15:18.451095+0000","last_active":"2024-09-11T23:15:20.256718+0000","last_peered":"2024-09-11T23:15:20.256718+0000","last_clean":"2024-09-11T23:15:20.256718+0000","last_became_active":"2024-09-11T23:15:18.449565+0000","last_became_peered":"2024-09-11T23:15:18.449565+0000","last_unstale":"2024-09-11T23:15:20.256718+0000","last_undegraded":"2024-09-11T23:15:20.256718+0000","last_fullsized":"2024-09-11T23:15:20.256718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:41.548250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003000+0000","last_change":"2024-09-11T23:15:13.980670+0000","last_active":"2024-09-11T23:15:20.003000+0000","last_peered":"2024-09-11T23:15:20.003000+0000","last_clean":"2024-09-11T23:15:20.003000+0000","last_became_active":"2024-09-11T23:15:13.980357+0000","last_became_peered":"2024-09-11T23:15:13.980357+0000","last_unstale":"2024-09-11T23:15:20.003000+0000","last_undegraded":"2024-09-11T23:15:20.003000+0000","last_fullsized":"2024-09-11T23:15:20.003000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005545+0000","last_change":"2024-09-11T23:15:12.959799+0000","last_active":"2024-09-11T23:15:20.005545+0000","last_peered":"2024-09-11T23:15:20.005545+0000","last_clean":"2024-09-11T23:15:20.005545+0000","last_became_active":"2024-09-11T23:15:12.959033+0000","last_became_peered":"2024-09-11T23:15:12.959033+0000","last_unstale":"2024-09-11T23:15:20.005545+0000","last_undegraded":"2024-09-11T23:15:20.005545+0000","last_fullsized":"2024-09-11T23:15:20.005545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253840+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:15:20.253840+0000","last_peered":"2024-09-11T23:15:20.253840+0000","last_clean":"2024-09-11T23:15:20.253840+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:15:20.253840+0000","last_undegraded":"2024-09-11T23:15:20.253840+0000","last_fullsized":"2024-09-11T23:15:20.253840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252619+0000","last_change":"2024-09-11T23:15:18.458819+0000","last_active":"2024-09-11T23:15:20.252619+0000","last_peered":"2024-09-11T23:15:20.252619+0000","last_clean":"2024-09-11T23:15:20.252619+0000","last_became_active":"2024-09-11T23:15:18.457747+0000","last_became_peered":"2024-09-11T23:15:18.457747+0000","last_unstale":"2024-09-11T23:15:20.252619+0000","last_undegraded":"2024-09-11T23:15:20.252619+0000","last_fullsized":"2024-09-11T23:15:20.252619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256534+0000","last_change":"2024-09-11T23:15:14.002907+0000","last_active":"2024-09-11T23:15:20.256534+0000","last_peered":"2024-09-11T23:15:20.256534+0000","last_clean":"2024-09-11T23:15:20.256534+0000","last_became_active":"2024-09-11T23:15:13.996895+0000","last_became_peered":"2024-09-11T23:15:13.996895+0000","last_unstale":"2024-09-11T23:15:20.256534+0000","last_undegraded":"2024-09-11T23:15:20.256534+0000","last_fullsized":"2024-09-11T23:15:20.256534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252892+0000","last_change":"2024-09-11T23:15:12.957780+0000","last_active":"2024-09-11T23:15:20.252892+0000","last_peered":"2024-09-11T23:15:20.252892+0000","last_clean":"2024-09-11T23:15:20.252892+0000","last_became_active":"2024-09-11T23:15:12.957375+0000","last_became_peered":"2024-09-11T23:15:12.957375+0000","last_unstale":"2024-09-11T23:15:20.252892+0000","last_undegraded":"2024-09-11T23:15:20.252892+0000","last_fullsized":"2024-09-11T23:15:20.252892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252849+0000","last_change":"2024-09-11T23:15:18.451410+0000","last_active":"2024-09-11T23:15:20.252849+0000","last_peered":"2024-09-11T23:15:20.252849+0000","last_clean":"2024-09-11T23:15:20.252849+0000","last_became_active":"2024-09-11T23:15:18.450381+0000","last_became_peered":"2024-09-11T23:15:18.450381+0000","last_unstale":"2024-09-11T23:15:20.252849+0000","last_undegraded":"2024-09-11T23:15:20.252849+0000","last_fullsized":"2024-09-11T23:15:20.252849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.157253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005415+0000","last_change":"2024-09-11T23:15:13.951881+0000","last_active":"2024-09-11T23:15:20.005415+0000","last_peered":"2024-09-11T23:15:20.005415+0000","last_clean":"2024-09-11T23:15:20.005415+0000","last_became_active":"2024-09-11T23:15:13.951002+0000","last_became_peered":"2024-09-11T23:15:13.951002+0000","last_unstale":"2024-09-11T23:15:20.005415+0000","last_undegraded":"2024-09-11T23:15:20.005415+0000","last_fullsized":"2024-09-11T23:15:20.005415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252772+0000","last_change":"2024-09-11T23:15:12.949969+0000","last_active":"2024-09-11T23:15:20.252772+0000","last_peered":"2024-09-11T23:15:20.252772+0000","last_clean":"2024-09-11T23:15:20.252772+0000","last_became_active":"2024-09-11T23:15:12.949624+0000","last_became_peered":"2024-09-11T23:15:12.949624+0000","last_unstale":"2024-09-11T23:15:20.252772+0000","last_undegraded":"2024-09-11T23:15:20.252772+0000","last_fullsized":"2024-09-11T23:15:20.252772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.075146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256235+0000","last_change":"2024-09-11T23:15:18.048455+0000","last_active":"2024-09-11T23:15:20.256235+0000","last_peered":"2024-09-11T23:15:20.256235+0000","last_clean":"2024-09-11T23:15:20.256235+0000","last_became_active":"2024-09-11T23:15:18.047979+0000","last_became_peered":"2024-09-11T23:15:18.047979+0000","last_unstale":"2024-09-11T23:15:20.256235+0000","last_undegraded":"2024-09-11T23:15:20.256235+0000","last_fullsized":"2024-09-11T23:15:20.256235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257597+0000","last_change":"2024-09-11T23:15:14.004585+0000","last_active":"2024-09-11T23:15:20.257597+0000","last_peered":"2024-09-11T23:15:20.257597+0000","last_clean":"2024-09-11T23:15:20.257597+0000","last_became_active":"2024-09-11T23:15:14.000088+0000","last_became_peered":"2024-09-11T23:15:14.000088+0000","last_unstale":"2024-09-11T23:15:20.257597+0000","last_undegraded":"2024-09-11T23:15:20.257597+0000","last_fullsized":"2024-09-11T23:15:20.257597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:53.838643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253011+0000","last_change":"2024-09-11T23:15:12.960122+0000","last_active":"2024-09-11T23:15:20.253011+0000","last_peered":"2024-09-11T23:15:20.253011+0000","last_clean":"2024-09-11T23:15:20.253011+0000","last_became_active":"2024-09-11T23:15:12.959575+0000","last_became_peered":"2024-09-11T23:15:12.959575+0000","last_unstale":"2024-09-11T23:15:20.253011+0000","last_undegraded":"2024-09-11T23:15:20.253011+0000","last_fullsized":"2024-09-11T23:15:20.253011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:32.565832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004271+0000","last_change":"2024-09-11T23:15:18.451425+0000","last_active":"2024-09-11T23:15:20.004271+0000","last_peered":"2024-09-11T23:15:20.004271+0000","last_clean":"2024-09-11T23:15:20.004271+0000","last_became_active":"2024-09-11T23:15:18.450141+0000","last_became_peered":"2024-09-11T23:15:18.450141+0000","last_unstale":"2024-09-11T23:15:20.004271+0000","last_undegraded":"2024-09-11T23:15:20.004271+0000","last_fullsized":"2024-09-11T23:15:20.004271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:52.139583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255998+0000","last_change":"2024-09-11T23:15:13.992622+0000","last_active":"2024-09-11T23:15:20.255998+0000","last_peered":"2024-09-11T23:15:20.255998+0000","last_clean":"2024-09-11T23:15:20.255998+0000","last_became_active":"2024-09-11T23:15:13.992126+0000","last_became_peered":"2024-09-11T23:15:13.992126+0000","last_unstale":"2024-09-11T23:15:20.255998+0000","last_undegraded":"2024-09-11T23:15:20.255998+0000","last_fullsized":"2024-09-11T23:15:20.255998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:46.407377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011556+0000","last_change":"2024-09-11T23:15:12.956823+0000","last_active":"2024-09-11T23:15:20.011556+0000","last_peered":"2024-09-11T23:15:20.011556+0000","last_clean":"2024-09-11T23:15:20.011556+0000","last_became_active":"2024-09-11T23:15:12.956008+0000","last_became_peered":"2024-09-11T23:15:12.956008+0000","last_unstale":"2024-09-11T23:15:20.011556+0000","last_undegraded":"2024-09-11T23:15:20.011556+0000","last_fullsized":"2024-09-11T23:15:20.011556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:07.503232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.009464+0000","last_change":"2024-09-11T23:15:18.038980+0000","last_active":"2024-09-11T23:15:20.009464+0000","last_peered":"2024-09-11T23:15:20.009464+0000","last_clean":"2024-09-11T23:15:20.009464+0000","last_became_active":"2024-09-11T23:15:18.037945+0000","last_became_peered":"2024-09-11T23:15:18.037945+0000","last_unstale":"2024-09-11T23:15:20.009464+0000","last_undegraded":"2024-09-11T23:15:20.009464+0000","last_fullsized":"2024-09-11T23:15:20.009464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:04.831045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254843+0000","last_change":"2024-09-11T23:15:13.993165+0000","last_active":"2024-09-11T23:15:20.254843+0000","last_peered":"2024-09-11T23:15:20.254843+0000","last_clean":"2024-09-11T23:15:20.254843+0000","last_became_active":"2024-09-11T23:15:13.992504+0000","last_became_peered":"2024-09-11T23:15:13.992504+0000","last_unstale":"2024-09-11T23:15:20.254843+0000","last_undegraded":"2024-09-11T23:15:20.254843+0000","last_fullsized":"2024-09-11T23:15:20.254843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252247+0000","last_change":"2024-09-11T23:15:12.947477+0000","last_active":"2024-09-11T23:15:20.252247+0000","last_peered":"2024-09-11T23:15:20.252247+0000","last_clean":"2024-09-11T23:15:20.252247+0000","last_became_active":"2024-09-11T23:15:12.947007+0000","last_became_peered":"2024-09-11T23:15:12.947007+0000","last_unstale":"2024-09-11T23:15:20.252247+0000","last_undegraded":"2024-09-11T23:15:20.252247+0000","last_fullsized":"2024-09-11T23:15:20.252247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:04.981883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256142+0000","last_change":"2024-09-11T23:15:18.033305+0000","last_active":"2024-09-11T23:15:20.256142+0000","last_peered":"2024-09-11T23:15:20.256142+0000","last_clean":"2024-09-11T23:15:20.256142+0000","last_became_active":"2024-09-11T23:15:18.032851+0000","last_became_peered":"2024-09-11T23:15:18.032851+0000","last_unstale":"2024-09-11T23:15:20.256142+0000","last_undegraded":"2024-09-11T23:15:20.256142+0000","last_fullsized":"2024-09-11T23:15:20.256142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252194+0000","last_change":"2024-09-11T23:15:13.957074+0000","last_active":"2024-09-11T23:15:20.252194+0000","last_peered":"2024-09-11T23:15:20.252194+0000","last_clean":"2024-09-11T23:15:20.252194+0000","last_became_active":"2024-09-11T23:15:13.956301+0000","last_became_peered":"2024-09-11T23:15:13.956301+0000","last_unstale":"2024-09-11T23:15:20.252194+0000","last_undegraded":"2024-09-11T23:15:20.252194+0000","last_fullsized":"2024-09-11T23:15:20.252194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252337+0000","last_change":"2024-09-11T23:15:12.971136+0000","last_active":"2024-09-11T23:15:20.252337+0000","last_peered":"2024-09-11T23:15:20.252337+0000","last_clean":"2024-09-11T23:15:20.252337+0000","last_became_active":"2024-09-11T23:15:12.970142+0000","last_became_peered":"2024-09-11T23:15:12.970142+0000","last_unstale":"2024-09-11T23:15:20.252337+0000","last_undegraded":"2024-09-11T23:15:20.252337+0000","last_fullsized":"2024-09-11T23:15:20.252337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004049+0000","last_change":"2024-09-11T23:15:18.460304+0000","last_active":"2024-09-11T23:15:20.004049+0000","last_peered":"2024-09-11T23:15:20.004049+0000","last_clean":"2024-09-11T23:15:20.004049+0000","last_became_active":"2024-09-11T23:15:18.459166+0000","last_became_peered":"2024-09-11T23:15:18.459166+0000","last_unstale":"2024-09-11T23:15:20.004049+0000","last_undegraded":"2024-09-11T23:15:20.004049+0000","last_fullsized":"2024-09-11T23:15:20.004049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:18.063967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254916+0000","last_change":"2024-09-11T23:15:14.003618+0000","last_active":"2024-09-11T23:15:20.254916+0000","last_peered":"2024-09-11T23:15:20.254916+0000","last_clean":"2024-09-11T23:15:20.254916+0000","last_became_active":"2024-09-11T23:15:14.002919+0000","last_became_peered":"2024-09-11T23:15:14.002919+0000","last_unstale":"2024-09-11T23:15:20.254916+0000","last_undegraded":"2024-09-11T23:15:20.254916+0000","last_fullsized":"2024-09-11T23:15:20.254916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005255+0000","last_change":"2024-09-11T23:15:12.964766+0000","last_active":"2024-09-11T23:15:20.005255+0000","last_peered":"2024-09-11T23:15:20.005255+0000","last_clean":"2024-09-11T23:15:20.005255+0000","last_became_active":"2024-09-11T23:15:12.964115+0000","last_became_peered":"2024-09-11T23:15:12.964115+0000","last_unstale":"2024-09-11T23:15:20.005255+0000","last_undegraded":"2024-09-11T23:15:20.005255+0000","last_fullsized":"2024-09-11T23:15:20.005255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003676+0000","last_change":"2024-09-11T23:15:18.450475+0000","last_active":"2024-09-11T23:15:20.003676+0000","last_peered":"2024-09-11T23:15:20.003676+0000","last_clean":"2024-09-11T23:15:20.003676+0000","last_became_active":"2024-09-11T23:15:18.449418+0000","last_became_peered":"2024-09-11T23:15:18.449418+0000","last_unstale":"2024-09-11T23:15:20.003676+0000","last_undegraded":"2024-09-11T23:15:20.003676+0000","last_fullsized":"2024-09-11T23:15:20.003676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:22.686451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255570+0000","last_change":"2024-09-11T23:15:13.985601+0000","last_active":"2024-09-11T23:15:20.255570+0000","last_peered":"2024-09-11T23:15:20.255570+0000","last_clean":"2024-09-11T23:15:20.255570+0000","last_became_active":"2024-09-11T23:15:13.985289+0000","last_became_peered":"2024-09-11T23:15:13.985289+0000","last_unstale":"2024-09-11T23:15:20.255570+0000","last_undegraded":"2024-09-11T23:15:20.255570+0000","last_fullsized":"2024-09-11T23:15:20.255570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256225+0000","last_change":"2024-09-11T23:15:12.970791+0000","last_active":"2024-09-11T23:15:20.256225+0000","last_peered":"2024-09-11T23:15:20.256225+0000","last_clean":"2024-09-11T23:15:20.256225+0000","last_became_active":"2024-09-11T23:15:12.970526+0000","last_became_peered":"2024-09-11T23:15:12.970526+0000","last_unstale":"2024-09-11T23:15:20.256225+0000","last_undegraded":"2024-09-11T23:15:20.256225+0000","last_fullsized":"2024-09-11T23:15:20.256225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:38.061268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006186+0000","last_change":"2024-09-11T23:15:18.451679+0000","last_active":"2024-09-11T23:15:20.006186+0000","last_peered":"2024-09-11T23:15:20.006186+0000","last_clean":"2024-09-11T23:15:20.006186+0000","last_became_active":"2024-09-11T23:15:18.450530+0000","last_became_peered":"2024-09-11T23:15:18.450530+0000","last_unstale":"2024-09-11T23:15:20.006186+0000","last_undegraded":"2024-09-11T23:15:20.006186+0000","last_fullsized":"2024-09-11T23:15:20.006186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:31.718045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256402+0000","last_change":"2024-09-11T23:15:13.992617+0000","last_active":"2024-09-11T23:15:20.256402+0000","last_peered":"2024-09-11T23:15:20.256402+0000","last_clean":"2024-09-11T23:15:20.256402+0000","last_became_active":"2024-09-11T23:15:13.990843+0000","last_became_peered":"2024-09-11T23:15:13.990843+0000","last_unstale":"2024-09-11T23:15:20.256402+0000","last_undegraded":"2024-09-11T23:15:20.256402+0000","last_fullsized":"2024-09-11T23:15:20.256402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:05.164231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:24.450253+0000","last_change":"2024-09-11T23:15:12.963148+0000","last_active":"2024-09-11T23:15:24.450253+0000","last_peered":"2024-09-11T23:15:24.450253+0000","last_clean":"2024-09-11T23:15:24.450253+0000","last_became_active":"2024-09-11T23:15:12.961283+0000","last_became_peered":"2024-09-11T23:15:12.961283+0000","last_unstale":"2024-09-11T23:15:24.450253+0000","last_undegraded":"2024-09-11T23:15:24.450253+0000","last_fullsized":"2024-09-11T23:15:24.450253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252586+0000","last_change":"2024-09-11T23:15:18.030168+0000","last_active":"2024-09-11T23:15:20.252586+0000","last_peered":"2024-09-11T23:15:20.252586+0000","last_clean":"2024-09-11T23:15:20.252586+0000","last_became_active":"2024-09-11T23:15:18.029815+0000","last_became_peered":"2024-09-11T23:15:18.029815+0000","last_unstale":"2024-09-11T23:15:20.252586+0000","last_undegraded":"2024-09-11T23:15:20.252586+0000","last_fullsized":"2024-09-11T23:15:20.252586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:45.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011213+0000","last_change":"2024-09-11T23:15:14.000924+0000","last_active":"2024-09-11T23:15:20.011213+0000","last_peered":"2024-09-11T23:15:20.011213+0000","last_clean":"2024-09-11T23:15:20.011213+0000","last_became_active":"2024-09-11T23:15:14.000344+0000","last_became_peered":"2024-09-11T23:15:14.000344+0000","last_unstale":"2024-09-11T23:15:20.011213+0000","last_undegraded":"2024-09-11T23:15:20.011213+0000","last_fullsized":"2024-09-11T23:15:20.011213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252480+0000","last_change":"2024-09-11T23:15:12.964173+0000","last_active":"2024-09-11T23:15:20.252480+0000","last_peered":"2024-09-11T23:15:20.252480+0000","last_clean":"2024-09-11T23:15:20.252480+0000","last_became_active":"2024-09-11T23:15:12.963819+0000","last_became_peered":"2024-09-11T23:15:12.963819+0000","last_unstale":"2024-09-11T23:15:20.252480+0000","last_undegraded":"2024-09-11T23:15:20.252480+0000","last_fullsized":"2024-09-11T23:15:20.252480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:17.638476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010857+0000","last_change":"2024-09-11T23:15:18.045442+0000","last_active":"2024-09-11T23:15:20.010857+0000","last_peered":"2024-09-11T23:15:20.010857+0000","last_clean":"2024-09-11T23:15:20.010857+0000","last_became_active":"2024-09-11T23:15:18.042533+0000","last_became_peered":"2024-09-11T23:15:18.042533+0000","last_unstale":"2024-09-11T23:15:20.010857+0000","last_undegraded":"2024-09-11T23:15:20.010857+0000","last_fullsized":"2024-09-11T23:15:20.010857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:01.140299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256883+0000","last_change":"2024-09-11T23:15:13.979875+0000","last_active":"2024-09-11T23:15:20.256883+0000","last_peered":"2024-09-11T23:15:20.256883+0000","last_clean":"2024-09-11T23:15:20.256883+0000","last_became_active":"2024-09-11T23:15:13.979554+0000","last_became_peered":"2024-09-11T23:15:13.979554+0000","last_unstale":"2024-09-11T23:15:20.256883+0000","last_undegraded":"2024-09-11T23:15:20.256883+0000","last_fullsized":"2024-09-11T23:15:20.256883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005805+0000","last_change":"2024-09-11T23:15:12.970938+0000","last_active":"2024-09-11T23:15:20.005805+0000","last_peered":"2024-09-11T23:15:20.005805+0000","last_clean":"2024-09-11T23:15:20.005805+0000","last_became_active":"2024-09-11T23:15:12.970457+0000","last_became_peered":"2024-09-11T23:15:12.970457+0000","last_unstale":"2024-09-11T23:15:20.005805+0000","last_undegraded":"2024-09-11T23:15:20.005805+0000","last_fullsized":"2024-09-11T23:15:20.005805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002558+0000","last_change":"2024-09-11T23:15:18.044223+0000","last_active":"2024-09-11T23:15:20.002558+0000","last_peered":"2024-09-11T23:15:20.002558+0000","last_clean":"2024-09-11T23:15:20.002558+0000","last_became_active":"2024-09-11T23:15:18.043622+0000","last_became_peered":"2024-09-11T23:15:18.043622+0000","last_unstale":"2024-09-11T23:15:20.002558+0000","last_undegraded":"2024-09-11T23:15:20.002558+0000","last_fullsized":"2024-09-11T23:15:20.002558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:12.311044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005749+0000","last_change":"2024-09-11T23:15:13.994053+0000","last_active":"2024-09-11T23:15:20.005749+0000","last_peered":"2024-09-11T23:15:20.005749+0000","last_clean":"2024-09-11T23:15:20.005749+0000","last_became_active":"2024-09-11T23:15:13.993527+0000","last_became_peered":"2024-09-11T23:15:13.993527+0000","last_unstale":"2024-09-11T23:15:20.005749+0000","last_undegraded":"2024-09-11T23:15:20.005749+0000","last_fullsized":"2024-09-11T23:15:20.005749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255118+0000","last_change":"2024-09-11T23:15:12.971189+0000","last_active":"2024-09-11T23:15:20.255118+0000","last_peered":"2024-09-11T23:15:20.255118+0000","last_clean":"2024-09-11T23:15:20.255118+0000","last_became_active":"2024-09-11T23:15:12.970367+0000","last_became_peered":"2024-09-11T23:15:12.970367+0000","last_unstale":"2024-09-11T23:15:20.255118+0000","last_undegraded":"2024-09-11T23:15:20.255118+0000","last_fullsized":"2024-09-11T23:15:20.255118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002529+0000","last_change":"2024-09-11T23:15:18.458404+0000","last_active":"2024-09-11T23:15:20.002529+0000","last_peered":"2024-09-11T23:15:20.002529+0000","last_clean":"2024-09-11T23:15:20.002529+0000","last_became_active":"2024-09-11T23:15:18.457383+0000","last_became_peered":"2024-09-11T23:15:18.457383+0000","last_unstale":"2024-09-11T23:15:20.002529+0000","last_undegraded":"2024-09-11T23:15:20.002529+0000","last_fullsized":"2024-09-11T23:15:20.002529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:20.119273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255910+0000","last_change":"2024-09-11T23:15:18.458254+0000","last_active":"2024-09-11T23:15:20.255910+0000","last_peered":"2024-09-11T23:15:20.255910+0000","last_clean":"2024-09-11T23:15:20.255910+0000","last_became_active":"2024-09-11T23:15:18.457195+0000","last_became_peered":"2024-09-11T23:15:18.457195+0000","last_unstale":"2024-09-11T23:15:20.255910+0000","last_undegraded":"2024-09-11T23:15:20.255910+0000","last_fullsized":"2024-09-11T23:15:20.255910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:15.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251033+0000","last_change":"2024-09-11T23:15:13.947663+0000","last_active":"2024-09-11T23:15:20.251033+0000","last_peered":"2024-09-11T23:15:20.251033+0000","last_clean":"2024-09-11T23:15:20.251033+0000","last_became_active":"2024-09-11T23:15:13.947339+0000","last_became_peered":"2024-09-11T23:15:13.947339+0000","last_unstale":"2024-09-11T23:15:20.251033+0000","last_undegraded":"2024-09-11T23:15:20.251033+0000","last_fullsized":"2024-09-11T23:15:20.251033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004578+0000","last_change":"2024-09-11T23:15:12.977797+0000","last_active":"2024-09-11T23:15:20.004578+0000","last_peered":"2024-09-11T23:15:20.004578+0000","last_clean":"2024-09-11T23:15:20.004578+0000","last_became_active":"2024-09-11T23:15:12.977335+0000","last_became_peered":"2024-09-11T23:15:12.977335+0000","last_unstale":"2024-09-11T23:15:20.004578+0000","last_undegraded":"2024-09-11T23:15:20.004578+0000","last_fullsized":"2024-09-11T23:15:20.004578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:32.098201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254361+0000","last_change":"2024-09-11T23:15:18.037810+0000","last_active":"2024-09-11T23:15:20.254361+0000","last_peered":"2024-09-11T23:15:20.254361+0000","last_clean":"2024-09-11T23:15:20.254361+0000","last_became_active":"2024-09-11T23:15:18.036750+0000","last_became_peered":"2024-09-11T23:15:18.036750+0000","last_unstale":"2024-09-11T23:15:20.254361+0000","last_undegraded":"2024-09-11T23:15:20.254361+0000","last_fullsized":"2024-09-11T23:15:20.254361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.479799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002485+0000","last_change":"2024-09-11T23:15:13.952215+0000","last_active":"2024-09-11T23:15:20.002485+0000","last_peered":"2024-09-11T23:15:20.002485+0000","last_clean":"2024-09-11T23:15:20.002485+0000","last_became_active":"2024-09-11T23:15:13.951888+0000","last_became_peered":"2024-09-11T23:15:13.951888+0000","last_unstale":"2024-09-11T23:15:20.002485+0000","last_undegraded":"2024-09-11T23:15:20.002485+0000","last_fullsized":"2024-09-11T23:15:20.002485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003198+0000","last_change":"2024-09-11T23:15:12.963413+0000","last_active":"2024-09-11T23:15:20.003198+0000","last_peered":"2024-09-11T23:15:20.003198+0000","last_clean":"2024-09-11T23:15:20.003198+0000","last_became_active":"2024-09-11T23:15:12.962997+0000","last_became_peered":"2024-09-11T23:15:12.962997+0000","last_unstale":"2024-09-11T23:15:20.003198+0000","last_undegraded":"2024-09-11T23:15:20.003198+0000","last_fullsized":"2024-09-11T23:15:20.003198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:26.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253434+0000","last_change":"2024-09-11T23:15:12.970601+0000","last_active":"2024-09-11T23:15:20.253434+0000","last_peered":"2024-09-11T23:15:20.253434+0000","last_clean":"2024-09-11T23:15:20.253434+0000","last_became_active":"2024-09-11T23:15:12.970093+0000","last_became_peered":"2024-09-11T23:15:12.970093+0000","last_unstale":"2024-09-11T23:15:20.253434+0000","last_undegraded":"2024-09-11T23:15:20.253434+0000","last_fullsized":"2024-09-11T23:15:20.253434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:59.518744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256098+0000","last_change":"2024-09-11T23:15:13.951762+0000","last_active":"2024-09-11T23:15:20.256098+0000","last_peered":"2024-09-11T23:15:20.256098+0000","last_clean":"2024-09-11T23:15:20.256098+0000","last_became_active":"2024-09-11T23:15:13.951454+0000","last_became_peered":"2024-09-11T23:15:13.951454+0000","last_unstale":"2024-09-11T23:15:20.256098+0000","last_undegraded":"2024-09-11T23:15:20.256098+0000","last_fullsized":"2024-09-11T23:15:20.256098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252828+0000","last_change":"2024-09-11T23:15:18.032028+0000","last_active":"2024-09-11T23:15:20.252828+0000","last_peered":"2024-09-11T23:15:20.252828+0000","last_clean":"2024-09-11T23:15:20.252828+0000","last_became_active":"2024-09-11T23:15:18.031566+0000","last_became_peered":"2024-09-11T23:15:18.031566+0000","last_unstale":"2024-09-11T23:15:20.252828+0000","last_undegraded":"2024-09-11T23:15:20.252828+0000","last_fullsized":"2024-09-11T23:15:20.252828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:11.167279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002816+0000","last_change":"2024-09-11T23:15:12.955762+0000","last_active":"2024-09-11T23:15:20.002816+0000","last_peered":"2024-09-11T23:15:20.002816+0000","last_clean":"2024-09-11T23:15:20.002816+0000","last_became_active":"2024-09-11T23:15:12.955387+0000","last_became_peered":"2024-09-11T23:15:12.955387+0000","last_unstale":"2024-09-11T23:15:20.002816+0000","last_undegraded":"2024-09-11T23:15:20.002816+0000","last_fullsized":"2024-09-11T23:15:20.002816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:11.905352+0000","last_clean_scrub_stamp":"2024-09-11T23:15:11.905352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.010063+0000","last_change":"2024-09-11T23:15:13.956520+0000","last_active":"2024-09-11T23:15:20.010063+0000","last_peered":"2024-09-11T23:15:20.010063+0000","last_clean":"2024-09-11T23:15:20.010063+0000","last_became_active":"2024-09-11T23:15:13.952595+0000","last_became_peered":"2024-09-11T23:15:13.952595+0000","last_unstale":"2024-09-11T23:15:20.010063+0000","last_undegraded":"2024-09-11T23:15:20.010063+0000","last_fullsized":"2024-09-11T23:15:20.010063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:39.357892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003889+0000","last_change":"2024-09-11T23:15:18.044131+0000","last_active":"2024-09-11T23:15:20.003889+0000","last_peered":"2024-09-11T23:15:20.003889+0000","last_clean":"2024-09-11T23:15:20.003889+0000","last_became_active":"2024-09-11T23:15:18.043680+0000","last_became_peered":"2024-09-11T23:15:18.043680+0000","last_unstale":"2024-09-11T23:15:20.003889+0000","last_undegraded":"2024-09-11T23:15:20.003889+0000","last_fullsized":"2024-09-11T23:15:20.003889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:16.983780+0000","last_clean_scrub_stamp":"2024-09-11T23:15:16.983780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:52.853399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251955+0000","last_change":"2024-09-11T23:15:13.957122+0000","last_active":"2024-09-11T23:15:20.251955+0000","last_peered":"2024-09-11T23:15:20.251955+0000","last_clean":"2024-09-11T23:15:20.251955+0000","last_became_active":"2024-09-11T23:15:13.956367+0000","last_became_peered":"2024-09-11T23:15:13.956367+0000","last_unstale":"2024-09-11T23:15:20.251955+0000","last_undegraded":"2024-09-11T23:15:20.251955+0000","last_fullsized":"2024-09-11T23:15:20.251955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252707+0000","last_change":"2024-09-11T23:15:13.945108+0000","last_active":"2024-09-11T23:15:20.252707+0000","last_peered":"2024-09-11T23:15:20.252707+0000","last_clean":"2024-09-11T23:15:20.252707+0000","last_became_active":"2024-09-11T23:15:13.944837+0000","last_became_peered":"2024-09-11T23:15:13.944837+0000","last_unstale":"2024-09-11T23:15:20.252707+0000","last_undegraded":"2024-09-11T23:15:20.252707+0000","last_fullsized":"2024-09-11T23:15:20.252707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.084641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.005293+0000","last_change":"2024-09-11T23:15:13.954634+0000","last_active":"2024-09-11T23:15:20.005293+0000","last_peered":"2024-09-11T23:15:20.005293+0000","last_clean":"2024-09-11T23:15:20.005293+0000","last_became_active":"2024-09-11T23:15:13.953799+0000","last_became_peered":"2024-09-11T23:15:13.953799+0000","last_unstale":"2024-09-11T23:15:20.005293+0000","last_undegraded":"2024-09-11T23:15:20.005293+0000","last_fullsized":"2024-09-11T23:15:20.005293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255948+0000","last_change":"2024-09-11T23:15:13.949400+0000","last_active":"2024-09-11T23:15:20.255948+0000","last_peered":"2024-09-11T23:15:20.255948+0000","last_clean":"2024-09-11T23:15:20.255948+0000","last_became_active":"2024-09-11T23:15:13.949032+0000","last_became_peered":"2024-09-11T23:15:13.949032+0000","last_unstale":"2024-09-11T23:15:20.255948+0000","last_undegraded":"2024-09-11T23:15:20.255948+0000","last_fullsized":"2024-09-11T23:15:20.255948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003638+0000","last_change":"2024-09-11T23:15:13.960418+0000","last_active":"2024-09-11T23:15:20.003638+0000","last_peered":"2024-09-11T23:15:20.003638+0000","last_clean":"2024-09-11T23:15:20.003638+0000","last_became_active":"2024-09-11T23:15:13.960081+0000","last_became_peered":"2024-09-11T23:15:13.960081+0000","last_unstale":"2024-09-11T23:15:20.003638+0000","last_undegraded":"2024-09-11T23:15:20.003638+0000","last_fullsized":"2024-09-11T23:15:20.003638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252017+0000","last_change":"2024-09-11T23:15:13.947369+0000","last_active":"2024-09-11T23:15:20.252017+0000","last_peered":"2024-09-11T23:15:20.252017+0000","last_clean":"2024-09-11T23:15:20.252017+0000","last_became_active":"2024-09-11T23:15:13.947074+0000","last_became_peered":"2024-09-11T23:15:13.947074+0000","last_unstale":"2024-09-11T23:15:20.252017+0000","last_undegraded":"2024-09-11T23:15:20.252017+0000","last_fullsized":"2024-09-11T23:15:20.252017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:45.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254606+0000","last_change":"2024-09-11T23:15:13.995057+0000","last_active":"2024-09-11T23:15:20.254606+0000","last_peered":"2024-09-11T23:15:20.254606+0000","last_clean":"2024-09-11T23:15:20.254606+0000","last_became_active":"2024-09-11T23:15:13.994547+0000","last_became_peered":"2024-09-11T23:15:13.994547+0000","last_unstale":"2024-09-11T23:15:20.254606+0000","last_undegraded":"2024-09-11T23:15:20.254606+0000","last_fullsized":"2024-09-11T23:15:20.254606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004077+0000","last_change":"2024-09-11T23:15:13.960489+0000","last_active":"2024-09-11T23:15:20.004077+0000","last_peered":"2024-09-11T23:15:20.004077+0000","last_clean":"2024-09-11T23:15:20.004077+0000","last_became_active":"2024-09-11T23:15:13.960138+0000","last_became_peered":"2024-09-11T23:15:13.960138+0000","last_unstale":"2024-09-11T23:15:20.004077+0000","last_undegraded":"2024-09-11T23:15:20.004077+0000","last_fullsized":"2024-09-11T23:15:20.004077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004434+0000","last_change":"2024-09-11T23:15:13.963538+0000","last_active":"2024-09-11T23:15:20.004434+0000","last_peered":"2024-09-11T23:15:20.004434+0000","last_clean":"2024-09-11T23:15:20.004434+0000","last_became_active":"2024-09-11T23:15:13.947789+0000","last_became_peered":"2024-09-11T23:15:13.947789+0000","last_unstale":"2024-09-11T23:15:20.004434+0000","last_undegraded":"2024-09-11T23:15:20.004434+0000","last_fullsized":"2024-09-11T23:15:20.004434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:42.888038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.003189+0000","last_change":"2024-09-11T23:15:13.960470+0000","last_active":"2024-09-11T23:15:20.003189+0000","last_peered":"2024-09-11T23:15:20.003189+0000","last_clean":"2024-09-11T23:15:20.003189+0000","last_became_active":"2024-09-11T23:15:13.960148+0000","last_became_peered":"2024-09-11T23:15:13.960148+0000","last_unstale":"2024-09-11T23:15:20.003189+0000","last_undegraded":"2024-09-11T23:15:20.003189+0000","last_fullsized":"2024-09-11T23:15:20.003189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004861+0000","last_change":"2024-09-11T23:15:13.992697+0000","last_active":"2024-09-11T23:15:20.004861+0000","last_peered":"2024-09-11T23:15:20.004861+0000","last_clean":"2024-09-11T23:15:20.004861+0000","last_became_active":"2024-09-11T23:15:13.992059+0000","last_became_peered":"2024-09-11T23:15:13.992059+0000","last_unstale":"2024-09-11T23:15:20.004861+0000","last_undegraded":"2024-09-11T23:15:20.004861+0000","last_fullsized":"2024-09-11T23:15:20.004861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255674+0000","last_change":"2024-09-11T23:15:13.985798+0000","last_active":"2024-09-11T23:15:20.255674+0000","last_peered":"2024-09-11T23:15:20.255674+0000","last_clean":"2024-09-11T23:15:20.255674+0000","last_became_active":"2024-09-11T23:15:13.985274+0000","last_became_peered":"2024-09-11T23:15:13.985274+0000","last_unstale":"2024-09-11T23:15:20.255674+0000","last_undegraded":"2024-09-11T23:15:20.255674+0000","last_fullsized":"2024-09-11T23:15:20.255674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:49.630646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253287+0000","last_change":"2024-09-11T23:15:13.973105+0000","last_active":"2024-09-11T23:15:20.253287+0000","last_peered":"2024-09-11T23:15:20.253287+0000","last_clean":"2024-09-11T23:15:20.253287+0000","last_became_active":"2024-09-11T23:15:13.971617+0000","last_became_peered":"2024-09-11T23:15:13.971617+0000","last_unstale":"2024-09-11T23:15:20.253287+0000","last_undegraded":"2024-09-11T23:15:20.253287+0000","last_fullsized":"2024-09-11T23:15:20.253287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256925+0000","last_change":"2024-09-11T23:15:14.002728+0000","last_active":"2024-09-11T23:15:20.256925+0000","last_peered":"2024-09-11T23:15:20.256925+0000","last_clean":"2024-09-11T23:15:20.256925+0000","last_became_active":"2024-09-11T23:15:13.996868+0000","last_became_peered":"2024-09-11T23:15:13.996868+0000","last_unstale":"2024-09-11T23:15:20.256925+0000","last_undegraded":"2024-09-11T23:15:20.256925+0000","last_fullsized":"2024-09-11T23:15:20.256925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:36.410866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.252733+0000","last_change":"2024-09-11T23:15:13.973567+0000","last_active":"2024-09-11T23:15:20.252733+0000","last_peered":"2024-09-11T23:15:20.252733+0000","last_clean":"2024-09-11T23:15:20.252733+0000","last_became_active":"2024-09-11T23:15:13.973278+0000","last_became_peered":"2024-09-11T23:15:13.973278+0000","last_unstale":"2024-09-11T23:15:20.252733+0000","last_undegraded":"2024-09-11T23:15:20.252733+0000","last_fullsized":"2024-09-11T23:15:20.252733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:57.828596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.006578+0000","last_change":"2024-09-11T23:15:13.999226+0000","last_active":"2024-09-11T23:15:20.006578+0000","last_peered":"2024-09-11T23:15:20.006578+0000","last_clean":"2024-09-11T23:15:20.006578+0000","last_became_active":"2024-09-11T23:15:13.998747+0000","last_became_peered":"2024-09-11T23:15:13.998747+0000","last_unstale":"2024-09-11T23:15:20.006578+0000","last_undegraded":"2024-09-11T23:15:20.006578+0000","last_fullsized":"2024-09-11T23:15:20.006578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.254949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004397+0000","last_change":"2024-09-11T23:15:13.945820+0000","last_active":"2024-09-11T23:15:20.004397+0000","last_peered":"2024-09-11T23:15:20.004397+0000","last_clean":"2024-09-11T23:15:20.004397+0000","last_became_active":"2024-09-11T23:15:13.945048+0000","last_became_peered":"2024-09-11T23:15:13.945048+0000","last_unstale":"2024-09-11T23:15:20.004397+0000","last_undegraded":"2024-09-11T23:15:20.004397+0000","last_fullsized":"2024-09-11T23:15:20.004397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.251134+0000","last_change":"2024-09-11T23:15:13.950766+0000","last_active":"2024-09-11T23:15:20.251134+0000","last_peered":"2024-09-11T23:15:20.251134+0000","last_clean":"2024-09-11T23:15:20.251134+0000","last_became_active":"2024-09-11T23:15:13.950395+0000","last_became_peered":"2024-09-11T23:15:13.950395+0000","last_unstale":"2024-09-11T23:15:20.251134+0000","last_undegraded":"2024-09-11T23:15:20.251134+0000","last_fullsized":"2024-09-11T23:15:20.251134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.951846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.255485+0000","last_change":"2024-09-11T23:15:13.942113+0000","last_active":"2024-09-11T23:15:20.255485+0000","last_peered":"2024-09-11T23:15:20.255485+0000","last_clean":"2024-09-11T23:15:20.255485+0000","last_became_active":"2024-09-11T23:15:13.941820+0000","last_became_peered":"2024-09-11T23:15:13.941820+0000","last_unstale":"2024-09-11T23:15:20.255485+0000","last_undegraded":"2024-09-11T23:15:20.255485+0000","last_fullsized":"2024-09-11T23:15:20.255485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:47.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002696+0000","last_change":"2024-09-11T23:15:13.990426+0000","last_active":"2024-09-11T23:15:20.002696+0000","last_peered":"2024-09-11T23:15:20.002696+0000","last_clean":"2024-09-11T23:15:20.002696+0000","last_became_active":"2024-09-11T23:15:13.990122+0000","last_became_peered":"2024-09-11T23:15:13.990122+0000","last_unstale":"2024-09-11T23:15:20.002696+0000","last_undegraded":"2024-09-11T23:15:20.002696+0000","last_fullsized":"2024-09-11T23:15:20.002696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.011130+0000","last_change":"2024-09-11T23:15:13.976923+0000","last_active":"2024-09-11T23:15:20.011130+0000","last_peered":"2024-09-11T23:15:20.011130+0000","last_clean":"2024-09-11T23:15:20.011130+0000","last_became_active":"2024-09-11T23:15:13.976002+0000","last_became_peered":"2024-09-11T23:15:13.976002+0000","last_unstale":"2024-09-11T23:15:20.011130+0000","last_undegraded":"2024-09-11T23:15:20.011130+0000","last_fullsized":"2024-09-11T23:15:20.011130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.533481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253836+0000","last_change":"2024-09-11T23:15:13.988201+0000","last_active":"2024-09-11T23:15:20.253836+0000","last_peered":"2024-09-11T23:15:20.253836+0000","last_clean":"2024-09-11T23:15:20.253836+0000","last_became_active":"2024-09-11T23:15:13.987512+0000","last_became_peered":"2024-09-11T23:15:13.987512+0000","last_unstale":"2024-09-11T23:15:20.253836+0000","last_undegraded":"2024-09-11T23:15:20.253836+0000","last_fullsized":"2024-09-11T23:15:20.253836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:35.864510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254368+0000","last_change":"2024-09-11T23:15:13.988153+0000","last_active":"2024-09-11T23:15:20.254368+0000","last_peered":"2024-09-11T23:15:20.254368+0000","last_clean":"2024-09-11T23:15:20.254368+0000","last_became_active":"2024-09-11T23:15:13.987443+0000","last_became_peered":"2024-09-11T23:15:13.987443+0000","last_unstale":"2024-09-11T23:15:20.254368+0000","last_undegraded":"2024-09-11T23:15:20.254368+0000","last_fullsized":"2024-09-11T23:15:20.254368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:45.900947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257588+0000","last_change":"2024-09-11T23:15:14.002600+0000","last_active":"2024-09-11T23:15:20.257588+0000","last_peered":"2024-09-11T23:15:20.257588+0000","last_clean":"2024-09-11T23:15:20.257588+0000","last_became_active":"2024-09-11T23:15:13.997780+0000","last_became_peered":"2024-09-11T23:15:13.997780+0000","last_unstale":"2024-09-11T23:15:20.257588+0000","last_undegraded":"2024-09-11T23:15:20.257588+0000","last_fullsized":"2024-09-11T23:15:20.257588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:56.088319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.002356+0000","last_change":"2024-09-11T23:15:13.978838+0000","last_active":"2024-09-11T23:15:20.002356+0000","last_peered":"2024-09-11T23:15:20.002356+0000","last_clean":"2024-09-11T23:15:20.002356+0000","last_became_active":"2024-09-11T23:15:13.978620+0000","last_became_peered":"2024-09-11T23:15:13.978620+0000","last_unstale":"2024-09-11T23:15:20.002356+0000","last_undegraded":"2024-09-11T23:15:20.002356+0000","last_fullsized":"2024-09-11T23:15:20.002356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254587+0000","last_change":"2024-09-11T23:15:13.993756+0000","last_active":"2024-09-11T23:15:20.254587+0000","last_peered":"2024-09-11T23:15:20.254587+0000","last_clean":"2024-09-11T23:15:20.254587+0000","last_became_active":"2024-09-11T23:15:13.991750+0000","last_became_peered":"2024-09-11T23:15:13.991750+0000","last_unstale":"2024-09-11T23:15:20.254587+0000","last_undegraded":"2024-09-11T23:15:20.254587+0000","last_fullsized":"2024-09-11T23:15:20.254587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.147318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004833+0000","last_change":"2024-09-11T23:15:13.980773+0000","last_active":"2024-09-11T23:15:20.004833+0000","last_peered":"2024-09-11T23:15:20.004833+0000","last_clean":"2024-09-11T23:15:20.004833+0000","last_became_active":"2024-09-11T23:15:13.980059+0000","last_became_peered":"2024-09-11T23:15:13.980059+0000","last_unstale":"2024-09-11T23:15:20.004833+0000","last_undegraded":"2024-09-11T23:15:20.004833+0000","last_fullsized":"2024-09-11T23:15:20.004833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.254373+0000","last_change":"2024-09-11T23:15:14.002575+0000","last_active":"2024-09-11T23:15:20.254373+0000","last_peered":"2024-09-11T23:15:20.254373+0000","last_clean":"2024-09-11T23:15:20.254373+0000","last_became_active":"2024-09-11T23:15:13.997366+0000","last_became_peered":"2024-09-11T23:15:13.997366+0000","last_unstale":"2024-09-11T23:15:20.254373+0000","last_undegraded":"2024-09-11T23:15:20.254373+0000","last_fullsized":"2024-09-11T23:15:20.254373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:00.896711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.004969+0000","last_change":"2024-09-11T23:15:13.964938+0000","last_active":"2024-09-11T23:15:20.004969+0000","last_peered":"2024-09-11T23:15:20.004969+0000","last_clean":"2024-09-11T23:15:20.004969+0000","last_became_active":"2024-09-11T23:15:13.952177+0000","last_became_peered":"2024-09-11T23:15:13.952177+0000","last_unstale":"2024-09-11T23:15:20.004969+0000","last_undegraded":"2024-09-11T23:15:20.004969+0000","last_fullsized":"2024-09-11T23:15:20.004969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:15.240676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.256139+0000","last_change":"2024-09-11T23:15:13.944554+0000","last_active":"2024-09-11T23:15:20.256139+0000","last_peered":"2024-09-11T23:15:20.256139+0000","last_clean":"2024-09-11T23:15:20.256139+0000","last_became_active":"2024-09-11T23:15:13.944174+0000","last_became_peered":"2024-09-11T23:15:13.944174+0000","last_unstale":"2024-09-11T23:15:20.256139+0000","last_undegraded":"2024-09-11T23:15:20.256139+0000","last_fullsized":"2024-09-11T23:15:20.256139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.253250+0000","last_change":"2024-09-11T23:15:13.941668+0000","last_active":"2024-09-11T23:15:20.253250+0000","last_peered":"2024-09-11T23:15:20.253250+0000","last_clean":"2024-09-11T23:15:20.253250+0000","last_became_active":"2024-09-11T23:15:13.941362+0000","last_became_peered":"2024-09-11T23:15:13.941362+0000","last_unstale":"2024-09-11T23:15:20.253250+0000","last_undegraded":"2024-09-11T23:15:20.253250+0000","last_fullsized":"2024-09-11T23:15:20.253250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:51.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T23:15:20.257415+0000","last_change":"2024-09-11T23:15:14.003307+0000","last_active":"2024-09-11T23:15:20.257415+0000","last_peered":"2024-09-11T23:15:20.257415+0000","last_clean":"2024-09-11T23:15:20.257415+0000","last_became_active":"2024-09-11T23:15:13.998994+0000","last_became_peered":"2024-09-11T23:15:13.998994+0000","last_unstale":"2024-09-11T23:15:20.257415+0000","last_undegraded":"2024-09-11T23:15:20.257415+0000","last_fullsized":"2024-09-11T23:15:20.257415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:12.914847+0000","last_clean_scrub_stamp":"2024-09-11T23:15:12.914847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":278528,"data_stored":111237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:15:39.716 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:15:39.716 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T23:15:39.716 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T23:15:39.716 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T23:15:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.860+0000 7efdddfd7640 1 Processor -- start 2024-09-11T23:15:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.860+0000 7efdddfd7640 1 -- start start 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efdd81587a0 0x7efdd80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efdd80b37d0 0x7efdd806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd806ec60 con 0x7efdd806e4b0 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80b3c40 con 0x7efdd81587a0 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efdd806f870 con 0x7efdd80b37d0 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efdd81587a0 0x7efdd80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efdd81587a0 0x7efdd80b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53144/0 (socket says 172.21.15.94:53144) 2024-09-11T23:15:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 -- 172.21.15.94:0/1461099839 learned_addr learned my addr 172.21.15.94:0/1461099839 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:39.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 -- 172.21.15.94:0/1461099839 >> v2:172.21.15.155:3300/0 conn(0x7efdd80b37d0 msgr2=0x7efdd806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:39.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 --2- 172.21.15.94:0/1461099839 >> v2:172.21.15.155:3300/0 conn(0x7efdd80b37d0 0x7efdd806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 -- 172.21.15.94:0/1461099839 >> v1:172.21.15.155:6789/0 conn(0x7efdd806e4b0 legacy=0x7efdd8161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:39.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 -- 172.21.15.94:0/1461099839 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd806ef40 con 0x7efdd81587a0 2024-09-11T23:15:39.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd77fe640 1 --2- 172.21.15.94:0/1461099839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd81587a0 0x7efdd80b3290 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdd8161d90 tx=0x7efdc801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c541921812b9ddc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd67fc640 1 -- 172.21.15.94:0/1461099839 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc80b1070 con 0x7efdd81587a0 2024-09-11T23:15:39.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd67fc640 1 -- 172.21.15.94:0/1461099839 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc80ac630 con 0x7efdd81587a0 2024-09-11T23:15:39.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdd67fc640 1 -- 172.21.15.94:0/1461099839 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc80a8050 con 0x7efdd81587a0 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- 172.21.15.94:0/1461099839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd81587a0 msgr2=0x7efdd80b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 --2- 172.21.15.94:0/1461099839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd81587a0 0x7efdd80b3290 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdd8161d90 tx=0x7efdc801c4b0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- 172.21.15.94:0/1461099839 shutdown_connections 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 --2- 172.21.15.94:0/1461099839 >> v2:172.21.15.155:3300/0 conn(0x7efdd80b37d0 0x7efdd806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 --2- 172.21.15.94:0/1461099839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd81587a0 0x7efdd80b3290 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- 172.21.15.94:0/1461099839 >> 172.21.15.94:0/1461099839 conn(0x7efdd80b1f90 msgr2=0x7efdd80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- 172.21.15.94:0/1461099839 shutdown_connections 2024-09-11T23:15:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.864+0000 7efdddfd7640 1 -- 172.21.15.94:0/1461099839 wait complete. 2024-09-11T23:15:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 Processor -- start 2024-09-11T23:15:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 -- start start 2024-09-11T23:15:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd806e4b0 0x7efdd81459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd80b37d0 0x7efdd8154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd81587a0 0x7efdd809d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8158b80 con 0x7efdd806e4b0 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8073170 con 0x7efdd81587a0 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efdd8157970 con 0x7efdd80b37d0 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd806e4b0 0x7efdd81459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd806e4b0 0x7efdd81459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53148/0 (socket says 172.21.15.94:53148) 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 -- 172.21.15.94:0/2732944261 learned_addr learned my addr 172.21.15.94:0/2732944261 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd6ffd640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd80b37d0 0x7efdd8154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd7fff640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd81587a0 0x7efdd809d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 -- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd80b37d0 msgr2=0x7efdd8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd80b37d0 0x7efdd8154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 -- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd81587a0 msgr2=0x7efdd809d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd81587a0 0x7efdd809d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 -- 172.21.15.94:0/2732944261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd8157690 con 0x7efdd806e4b0 2024-09-11T23:15:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdd77fe640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd806e4b0 0x7efdd81459a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdc80af040 tx=0x7efdc8019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdbffff640 1 -- 172.21.15.94:0/2732944261 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc80b1040 con 0x7efdd806e4b0 2024-09-11T23:15:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdbffff640 1 -- 172.21.15.94:0/2732944261 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc80ba070 con 0x7efdd806e4b0 2024-09-11T23:15:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd8154490 con 0x7efdd806e4b0 2024-09-11T23:15:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdbffff640 1 -- 172.21.15.94:0/2732944261 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc80a8040 con 0x7efdd806e4b0 2024-09-11T23:15:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd8154a50 con 0x7efdd806e4b0 2024-09-11T23:15:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd8070080 con 0x7efdd806e4b0 2024-09-11T23:15:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdbffff640 1 -- 172.21.15.94:0/2732944261 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efdc80b58a0 con 0x7efdd806e4b0 2024-09-11T23:15:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdbffff640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdc40678f0 0x7efdc4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.868+0000 7efdbffff640 1 -- 172.21.15.94:0/2732944261 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efdc811fd40 con 0x7efdd806e4b0 2024-09-11T23:15:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.872+0000 7efdd6ffd640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdc40678f0 0x7efdc4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.872+0000 7efdd6ffd640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdc40678f0 0x7efdc4069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efdd8147bf0 tx=0x7efdcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:39.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:39.872+0000 7efdbffff640 1 -- 172.21.15.94:0/2732944261 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efdc80160d0 con 0x7efdd806e4b0 2024-09-11T23:15:40.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efdd8073a50 con 0x7efdd806e4b0 2024-09-11T23:15:40.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdbffff640 1 -- 172.21.15.94:0/2732944261 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7efdc80f04a0 con 0x7efdd806e4b0 2024-09-11T23:15:40.062 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:40.063 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T23:15:40.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdc40678f0 msgr2=0x7efdc4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdc40678f0 0x7efdc4069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efdd8147bf0 tx=0x7efdcc008040 comp rx=0 tx=0).stop 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd806e4b0 msgr2=0x7efdd81459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd806e4b0 0x7efdd81459a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdc80af040 tx=0x7efdc8019250 comp rx=0 tx=0).stop 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 shutdown_connections 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd81587a0 0x7efdd809d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd80b37d0 0x7efdd8154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdc40678f0 0x7efdc4069db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 --2- 172.21.15.94:0/2732944261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdd806e4b0 0x7efdd81459a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 >> 172.21.15.94:0/2732944261 conn(0x7efdd80b1f90 msgr2=0x7efdd80ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 shutdown_connections 2024-09-11T23:15:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.060+0000 7efdddfd7640 1 -- 172.21.15.94:0/2732944261 wait complete. 2024-09-11T23:15:40.079 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T23:15:40.080 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:40.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff1090a2640 1 Processor -- start 2024-09-11T23:15:40.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff1090a2640 1 -- start start 2024-09-11T23:15:40.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff1090a2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 0x7ff1040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff1090a2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1040af2a0 0x7ff10406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff1090a2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1040b3290 con 0x7ff10415bec0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff1090a2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff1040b3570 con 0x7ff1040af2a0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff1090a2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1040b3850 con 0x7ff10415c2a0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff102d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff10415bec0 0x7ff1040ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50486/0 (socket says 172.21.15.94:50486) 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff102d9d640 1 -- 172.21.15.94:0/3768865856 learned_addr learned my addr 172.21.15.94:0/3768865856 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10359e640 1 --2- 172.21.15.94:0/3768865856 >> v2:172.21.15.155:3300/0 conn(0x7ff1040af2a0 0x7ff10406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff0fa59c640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 0x7ff1040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991989850 0 0) 0x7ff1040b3290 con 0x7ff10415bec0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f0003530 con 0x7ff10415bec0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2785545174 0 0) 0x7ff0f0003530 con 0x7ff10415bec0 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 msgr2=0x7ff1040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10259c640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 0x7ff1040aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 >> v2:172.21.15.155:3300/0 conn(0x7ff1040af2a0 msgr2=0x7ff10406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.184+0000 7ff10259c640 1 --2- 172.21.15.94:0/3768865856 >> v2:172.21.15.155:3300/0 conn(0x7ff1040af2a0 0x7ff10406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1040b3b30 con 0x7ff10415bec0 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7ff0f4001680 con 0x7ff10415bec0 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 >> v1:172.21.15.94:6789/0 conn(0x7ff10415bec0 legacy=0x7ff1040ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0f00039c0 0x7ff0f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 0x7ff0f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0f0004d50 0x7ff0f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040b3570 con 0x7ff0f0004d50 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040b3850 con 0x7ff0f00039c0 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f000b9d0 con 0x7ff10415c2a0 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0f0004d50 0x7ff0f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff102d9d640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0f00039c0 0x7ff0f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff0fa59c640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 0x7ff0f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 -- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 msgr2=0x7ff0f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10415c2a0 0x7ff0f0004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 -- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0f00039c0 msgr2=0x7ff0f0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0f00039c0 0x7ff0f0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 -- 172.21.15.94:0/3768865856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0003530 con 0x7ff0f0004d50 2024-09-11T23:15:40.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0f0004d50 0x7ff0f00051d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009fc0 tx=0x7ff0fc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0838f3a587cd83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0b2070 con 0x7ff0f0004d50 2024-09-11T23:15:40.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0a5cd0 con 0x7ff0f0004d50 2024-09-11T23:15:40.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10259c640 1 -- 172.21.15.94:0/3768865856 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc009c10 con 0x7ff0f0004d50 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff1090a2640 1 -- 172.21.15.94:0/3768865856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0f0004d50 msgr2=0x7ff0f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff1090a2640 1 --2- 172.21.15.94:0/3768865856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0f0004d50 0x7ff0f00051d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009fc0 tx=0x7ff0fc01ccc0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff10359e640 1 -- 172.21.15.94:0/3768865856 reap_dead start 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff1090a2640 1 -- 172.21.15.94:0/3768865856 shutdown_connections 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff1090a2640 1 -- 172.21.15.94:0/3768865856 >> 172.21.15.94:0/3768865856 conn(0x7ff1040b1f90 msgr2=0x7ff1040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff1090a2640 1 -- 172.21.15.94:0/3768865856 shutdown_connections 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.188+0000 7ff1090a2640 1 -- 172.21.15.94:0/3768865856 wait complete. 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 Processor -- start 2024-09-11T23:15:40.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 -- start start 2024-09-11T23:15:40.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff10406ec80 0x7ff1041eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10406f060 0x7ff1041ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff104151900 0x7ff104151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040af730 con 0x7ff104151900 2024-09-11T23:15:40.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040b40f0 con 0x7ff10406ec80 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1040afc90 con 0x7ff10406f060 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff104151900 0x7ff104151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff104151900 0x7ff104151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53162/0 (socket says 172.21.15.94:53162) 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 -- 172.21.15.94:0/211870471 learned_addr learned my addr 172.21.15.94:0/211870471 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff0fa59c640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10406f060 0x7ff1041ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff102d9d640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff10406ec80 0x7ff1041eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 -- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10406f060 msgr2=0x7ff1041ef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10406f060 0x7ff1041ef1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 -- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff10406ec80 msgr2=0x7ff1041eecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff10406ec80 0x7ff1041eecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 -- 172.21.15.94:0/211870471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff104152630 con 0x7ff104151900 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff10359e640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff104151900 0x7ff104151d70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc002240 tx=0x7ff0fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff0fbfff640 1 -- 172.21.15.94:0/211870471 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0bd070 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff0fbfff640 1 -- 172.21.15.94:0/211870471 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0a5ad0 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff104152910 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff0fbfff640 1 -- 172.21.15.94:0/211870471 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0b2040 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1041533c0 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff104152e30 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.192+0000 7ff0fbfff640 1 -- 172.21.15.94:0/211870471 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0fc0c0070 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.196+0000 7ff0fbfff640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff0e40678f0 0x7ff0e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.196+0000 7ff0fbfff640 1 -- 172.21.15.94:0/211870471 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff0fc11fe80 con 0x7ff104151900 2024-09-11T23:15:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.196+0000 7ff102d9d640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff0e40678f0 0x7ff0e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.196+0000 7ff102d9d640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff0e40678f0 0x7ff0e4069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4005980 tx=0x7ff0f4000bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.200+0000 7ff0fbfff640 1 -- 172.21.15.94:0/211870471 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff104152e30 con 0x7ff104151900 2024-09-11T23:15:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.380+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1040aed60 con 0x7ff104151900 2024-09-11T23:15:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.380+0000 7ff0fbfff640 1 -- 172.21.15.94:0/211870471 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7ff0fc0169d0 con 0x7ff104151900 2024-09-11T23:15:40.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:40.383 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:15:40.383 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:15:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff0e40678f0 msgr2=0x7ff0e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff0e40678f0 0x7ff0e4069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4005980 tx=0x7ff0f4000bd0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff104151900 msgr2=0x7ff104151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff104151900 0x7ff104151d70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc002240 tx=0x7ff0fc009750 comp rx=0 tx=0).stop 2024-09-11T23:15:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 shutdown_connections 2024-09-11T23:15:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff0e40678f0 0x7ff0e4069db0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff104151900 0x7ff104151d70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10406f060 0x7ff1041ef1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 --2- 172.21.15.94:0/211870471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff10406ec80 0x7ff1041eecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 >> 172.21.15.94:0/211870471 conn(0x7ff1040b1f90 msgr2=0x7ff1041553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 shutdown_connections 2024-09-11T23:15:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.384+0000 7ff1090a2640 1 -- 172.21.15.94:0/211870471 wait complete. 2024-09-11T23:15:40.401 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:40.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.504+0000 7fc03c91b640 1 Processor -- start 2024-09-11T23:15:40.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.504+0000 7fc03c91b640 1 -- start start 2024-09-11T23:15:40.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03c91b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0380d3060 0x7fc0380cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03c91b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0380cf450 0x7fc03806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03c91b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0380d0300 con 0x7fc038161a60 2024-09-11T23:15:40.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03c91b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc0380b0f60 con 0x7fc0380cf450 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03c91b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc0380cfd40 con 0x7fc0380d3060 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0380cf450 0x7fc03806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0380cf450 0x7fc03806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53170/0 (socket says 172.21.15.94:53170) 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 -- 172.21.15.94:0/491472191 learned_addr learned my addr 172.21.15.94:0/491472191 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc035d9b640 1 --2- 172.21.15.94:0/491472191 >> v2:172.21.15.155:3300/0 conn(0x7fc0380d3060 0x7fc0380cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 -- 172.21.15.94:0/491472191 >> v2:172.21.15.155:3300/0 conn(0x7fc0380d3060 msgr2=0x7fc0380cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 --2- 172.21.15.94:0/491472191 >> v2:172.21.15.155:3300/0 conn(0x7fc0380d3060 0x7fc0380cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 -- 172.21.15.94:0/491472191 >> v1:172.21.15.155:6789/0 conn(0x7fc038161a60 legacy=0x7fc0380d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 -- 172.21.15.94:0/491472191 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0380d0020 con 0x7fc0380cf450 2024-09-11T23:15:40.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc036d9d640 1 --2- 172.21.15.94:0/491472191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380cf450 0x7fc03806d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc03808d850 tx=0x7fc03001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510ba9e0e54e97c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03559a640 1 -- 172.21.15.94:0/491472191 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0300a57f0 con 0x7fc0380cf450 2024-09-11T23:15:40.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03559a640 1 -- 172.21.15.94:0/491472191 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0300a5990 con 0x7fc0380cf450 2024-09-11T23:15:40.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.508+0000 7fc03559a640 1 -- 172.21.15.94:0/491472191 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0300a5d60 con 0x7fc0380cf450 2024-09-11T23:15:40.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- 172.21.15.94:0/491472191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380cf450 msgr2=0x7fc03806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 --2- 172.21.15.94:0/491472191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380cf450 0x7fc03806d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc03808d850 tx=0x7fc03001c930 comp rx=0 tx=0).stop 2024-09-11T23:15:40.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- 172.21.15.94:0/491472191 shutdown_connections 2024-09-11T23:15:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 --2- 172.21.15.94:0/491472191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380cf450 0x7fc03806d6b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 --2- 172.21.15.94:0/491472191 >> v2:172.21.15.155:3300/0 conn(0x7fc0380d3060 0x7fc0380cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- 172.21.15.94:0/491472191 >> 172.21.15.94:0/491472191 conn(0x7fc03808bf90 msgr2=0x7fc03809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- 172.21.15.94:0/491472191 shutdown_connections 2024-09-11T23:15:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- 172.21.15.94:0/491472191 wait complete. 2024-09-11T23:15:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 Processor -- start 2024-09-11T23:15:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- start start 2024-09-11T23:15:40.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0380cf450 0x7fc038159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380d3060 0x7fc038158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc038161a60 0x7fc038156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc03806e400 con 0x7fc0380d3060 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc0380cfad0 con 0x7fc0380cf450 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc03806e580 con 0x7fc038161a60 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380d3060 0x7fc038158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380d3060 0x7fc038158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53176/0 (socket says 172.21.15.94:53176) 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 -- 172.21.15.94:0/1999755554 learned_addr learned my addr 172.21.15.94:0/1999755554 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03659c640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0380cf450 0x7fc038159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc036d9d640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc038161a60 0x7fc038156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 -- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc038161a60 msgr2=0x7fc038156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc038161a60 0x7fc038156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 -- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0380cf450 msgr2=0x7fc038159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0380cf450 0x7fc038159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 -- 172.21.15.94:0/1999755554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0380b4cb0 con 0x7fc0380d3060 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03659c640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0380cf450 0x7fc038159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc036d9d640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc038161a60 0x7fc038156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc035d9b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380d3060 0x7fc038158180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc02800e8a0 tx=0x7fc02800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc026ffd640 1 -- 172.21.15.94:0/1999755554 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028017070 con 0x7fc0380d3060 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc026ffd640 1 -- 172.21.15.94:0/1999755554 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02800c940 con 0x7fc0380d3060 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0381586c0 con 0x7fc0380d3060 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc026ffd640 1 -- 172.21.15.94:0/1999755554 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02800ccf0 con 0x7fc0380d3060 2024-09-11T23:15:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.512+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03815a300 con 0x7fc0380d3060 2024-09-11T23:15:40.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.516+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03806d6b0 con 0x7fc0380d3060 2024-09-11T23:15:40.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.516+0000 7fc026ffd640 1 -- 172.21.15.94:0/1999755554 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc02801a070 con 0x7fc0380d3060 2024-09-11T23:15:40.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.516+0000 7fc026ffd640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc0180678c0 0x7fc018069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.516+0000 7fc026ffd640 1 -- 172.21.15.94:0/1999755554 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc028085ee0 con 0x7fc0380d3060 2024-09-11T23:15:40.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.516+0000 7fc03659c640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc0180678c0 0x7fc018069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.516+0000 7fc03659c640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc0180678c0 0x7fc018069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc02c001650 tx=0x7fc02c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.520+0000 7fc026ffd640 1 -- 172.21.15.94:0/1999755554 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc0381586c0 con 0x7fc0380d3060 2024-09-11T23:15:40.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.704+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0380d49e0 con 0x7fc0380d3060 2024-09-11T23:15:40.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.704+0000 7fc026ffd640 1 -- 172.21.15.94:0/1999755554 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7fc0280566e0 con 0x7fc0380d3060 2024-09-11T23:15:40.707 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:40.707 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:15:40.707 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc0180678c0 msgr2=0x7fc018069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc0180678c0 0x7fc018069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc02c001650 tx=0x7fc02c009040 comp rx=0 tx=0).stop 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380d3060 msgr2=0x7fc038158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380d3060 0x7fc038158180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc02800e8a0 tx=0x7fc02800eca0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 shutdown_connections 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc038161a60 0x7fc038156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc0180678c0 0x7fc018069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0380d3060 0x7fc038158180 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 --2- 172.21.15.94:0/1999755554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0380cf450 0x7fc038159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 >> 172.21.15.94:0/1999755554 conn(0x7fc03808bf90 msgr2=0x7fc03809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 shutdown_connections 2024-09-11T23:15:40.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.708+0000 7fc03c91b640 1 -- 172.21.15.94:0/1999755554 wait complete. 2024-09-11T23:15:40.724 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:40.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.840+0000 7f09062f8640 1 Processor -- start 2024-09-11T23:15:40.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.840+0000 7f09062f8640 1 -- start start 2024-09-11T23:15:40.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f09062f8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f090006f010 0x7f0900166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f09062f8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09000b3290 con 0x7f090015c2a0 2024-09-11T23:15:40.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f09062f8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09000b3570 con 0x7f090015bec0 2024-09-11T23:15:40.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f09062f8640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f09000b3850 con 0x7f090006f010 2024-09-11T23:15:40.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f0904895640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f090006f010 0x7f0900166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f0904895640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f090006f010 0x7f0900166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53184/0 (socket says 172.21.15.94:53184) 2024-09-11T23:15:40.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f0904895640 1 -- 172.21.15.94:0/1552066178 learned_addr learned my addr 172.21.15.94:0/1552066178 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:40.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f0904895640 1 -- 172.21.15.94:0/1552066178 >> v1:172.21.15.155:6789/0 conn(0x7f090015bec0 legacy=0x7f09000ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:40.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f0904895640 1 -- 172.21.15.94:0/1552066178 >> v1:172.21.15.94:6789/0 conn(0x7f090015c2a0 legacy=0x7f09000aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f0904895640 1 -- 172.21.15.94:0/1552066178 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09000b3b30 con 0x7f090006f010 2024-09-11T23:15:40.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.844+0000 7f0904895640 1 --2- 172.21.15.94:0/1552066178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900166ff0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009e50 tx=0x7f08f801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8127d4dab79ec8d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08feffd640 1 -- 172.21.15.94:0/1552066178 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f80a5790 con 0x7f090006f010 2024-09-11T23:15:40.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08feffd640 1 -- 172.21.15.94:0/1552066178 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f80a5930 con 0x7f090006f010 2024-09-11T23:15:40.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08feffd640 1 -- 172.21.15.94:0/1552066178 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f80a5d00 con 0x7f090006f010 2024-09-11T23:15:40.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- 172.21.15.94:0/1552066178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 msgr2=0x7f0900166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 --2- 172.21.15.94:0/1552066178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900166ff0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009e50 tx=0x7f08f801c9c0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- 172.21.15.94:0/1552066178 shutdown_connections 2024-09-11T23:15:40.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 --2- 172.21.15.94:0/1552066178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900166ff0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- 172.21.15.94:0/1552066178 >> 172.21.15.94:0/1552066178 conn(0x7f09000b1f90 msgr2=0x7f09000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- 172.21.15.94:0/1552066178 shutdown_connections 2024-09-11T23:15:40.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- 172.21.15.94:0/1552066178 wait complete. 2024-09-11T23:15:40.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 Processor -- start 2024-09-11T23:15:40.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- start start 2024-09-11T23:15:40.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f090015bec0 0x7f09000738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090015c2a0 0x7f0900072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0900169ed0 con 0x7f090006f010 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0900169d50 con 0x7f090015c2a0 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f090016a050 con 0x7f090015bec0 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53200/0 (socket says 172.21.15.94:53200) 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 -- 172.21.15.94:0/2066033593 learned_addr learned my addr 172.21.15.94:0/2066033593 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08ff7fe640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f090015bec0 0x7f09000738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f0904895640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090015c2a0 0x7f0900072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 -- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f090015bec0 msgr2=0x7f09000738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f090015bec0 0x7f09000738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 -- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090015c2a0 msgr2=0x7f0900072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090015c2a0 0x7f0900072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 -- 172.21.15.94:0/2066033593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0900071fb0 con 0x7f090006f010 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fffff640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900150080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08f000c450 tx=0x7f08f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fcff9640 1 -- 172.21.15.94:0/2066033593 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0012830 con 0x7f090006f010 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fcff9640 1 -- 172.21.15.94:0/2066033593 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f0017070 con 0x7f090006f010 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f08fcff9640 1 -- 172.21.15.94:0/2066033593 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0012c30 con 0x7f090006f010 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09001644a0 con 0x7f090006f010 2024-09-11T23:15:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.848+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0900072530 con 0x7f090006f010 2024-09-11T23:15:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.852+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09000ad200 con 0x7f090006f010 2024-09-11T23:15:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.852+0000 7f08fcff9640 1 -- 172.21.15.94:0/2066033593 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08f001c460 con 0x7f090006f010 2024-09-11T23:15:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.852+0000 7f08fcff9640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08ec0678c0 0x7f08ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.852+0000 7f08fcff9640 1 -- 172.21.15.94:0/2066033593 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f08f0085cc0 con 0x7f090006f010 2024-09-11T23:15:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.852+0000 7f08ff7fe640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08ec0678c0 0x7f08ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.852+0000 7f08ff7fe640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08ec0678c0 0x7f08ec069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09001faa70 tx=0x7f08f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:40.856+0000 7f08fcff9640 1 -- 172.21.15.94:0/2066033593 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f08f008c080 con 0x7f090006f010 2024-09-11T23:15:41.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.016+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f090006fcd0 con 0x7f090006f010 2024-09-11T23:15:41.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.020+0000 7f08fcff9640 1 -- 172.21.15.94:0/2066033593 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f08f0055dd0 con 0x7f090006f010 2024-09-11T23:15:41.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:41.023 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":25,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:19.997149+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:41.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08ec0678c0 msgr2=0x7f08ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08ec0678c0 0x7f08ec069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09001faa70 tx=0x7f08f4009040 comp rx=0 tx=0).stop 2024-09-11T23:15:41.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 msgr2=0x7f0900150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900150080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08f000c450 tx=0x7f08f000c910 comp rx=0 tx=0).stop 2024-09-11T23:15:41.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 shutdown_connections 2024-09-11T23:15:41.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f090015c2a0 0x7f0900072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f090015bec0 0x7f09000738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f08ec0678c0 0x7f08ec069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 --2- 172.21.15.94:0/2066033593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f090006f010 0x7f0900150080 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 >> 172.21.15.94:0/2066033593 conn(0x7f09000b1f90 msgr2=0x7f0900158320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 shutdown_connections 2024-09-11T23:15:41.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.024+0000 7f09062f8640 1 -- 172.21.15.94:0/2066033593 wait complete. 2024-09-11T23:15:41.041 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:15:41.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dff5a3640 1 Processor -- start 2024-09-11T23:15:41.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dff5a3640 1 -- start start 2024-09-11T23:15:41.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dff5a3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2df81587a0 0x7f2df80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dff5a3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2df806e680 0x7f2df8072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dff5a3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2df806ec60 con 0x7f2df80b37d0 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dff5a3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2df80b3c40 con 0x7f2df806e680 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dff5a3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2df806f870 con 0x7f2df81587a0 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfdb40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2df806e680 0x7f2df8072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfdb40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2df806e680 0x7f2df8072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53204/0 (socket says 172.21.15.94:53204) 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfdb40640 1 -- 172.21.15.94:0/3748321389 learned_addr learned my addr 172.21.15.94:0/3748321389 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfd33f640 1 --2- 172.21.15.94:0/3748321389 >> v2:172.21.15.155:3300/0 conn(0x7f2df81587a0 0x7f2df80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfdb40640 1 -- 172.21.15.94:0/3748321389 >> v2:172.21.15.155:3300/0 conn(0x7f2df81587a0 msgr2=0x7f2df80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfdb40640 1 --2- 172.21.15.94:0/3748321389 >> v2:172.21.15.155:3300/0 conn(0x7f2df81587a0 0x7f2df80b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfdb40640 1 -- 172.21.15.94:0/3748321389 >> v1:172.21.15.155:6789/0 conn(0x7f2df80b37d0 legacy=0x7f2df806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.156+0000 7f2dfdb40640 1 -- 172.21.15.94:0/3748321389 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df806ef40 con 0x7f2df806e680 2024-09-11T23:15:41.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dfdb40640 1 --2- 172.21.15.94:0/3748321389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df8072160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2df8071710 tx=0x7f2df001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f3aab972cefe90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2deffff640 1 -- 172.21.15.94:0/3748321389 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df00a5880 con 0x7f2df806e680 2024-09-11T23:15:41.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2deffff640 1 -- 172.21.15.94:0/3748321389 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df00a5a20 con 0x7f2df806e680 2024-09-11T23:15:41.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2deffff640 1 -- 172.21.15.94:0/3748321389 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df00a5df0 con 0x7f2df806e680 2024-09-11T23:15:41.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3748321389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 msgr2=0x7f2df8072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3748321389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df8072160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2df8071710 tx=0x7f2df001c9c0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3748321389 shutdown_connections 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3748321389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df8072160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3748321389 >> v2:172.21.15.155:3300/0 conn(0x7f2df81587a0 0x7f2df80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3748321389 >> 172.21.15.94:0/3748321389 conn(0x7f2df80b1f90 msgr2=0x7f2df80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3748321389 shutdown_connections 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3748321389 wait complete. 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 Processor -- start 2024-09-11T23:15:41.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.160+0000 7f2dff5a3640 1 -- start start 2024-09-11T23:15:41.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df80aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2df80b37d0 0x7f2df815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2df81587a0 0x7f2df815d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2df8073030 con 0x7f2df806e680 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2df8072eb0 con 0x7f2df81587a0 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2df80731b0 con 0x7f2df80b37d0 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df80aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df80aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53214/0 (socket says 172.21.15.94:53214) 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 -- 172.21.15.94:0/3348063397 learned_addr learned my addr 172.21.15.94:0/3348063397 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfdb40640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2df81587a0 0x7f2df815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfcb3e640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2df80b37d0 0x7f2df815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 -- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2df80b37d0 msgr2=0x7f2df815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2df80b37d0 0x7f2df815cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 -- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2df81587a0 msgr2=0x7f2df815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2df81587a0 0x7f2df815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 -- 172.21.15.94:0/3348063397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df809d090 con 0x7f2df806e680 2024-09-11T23:15:41.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfdb40640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2df81587a0 0x7f2df815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:41.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfd33f640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df80aee10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d620 tx=0x7f2df400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dedffb640 1 -- 172.21.15.94:0/3348063397 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df400b620 con 0x7f2df806e680 2024-09-11T23:15:41.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dedffb640 1 -- 172.21.15.94:0/3348063397 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df4019070 con 0x7f2df806e680 2024-09-11T23:15:41.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df809d370 con 0x7f2df806e680 2024-09-11T23:15:41.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dedffb640 1 -- 172.21.15.94:0/3348063397 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df400ba20 con 0x7f2df806e680 2024-09-11T23:15:41.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df809d930 con 0x7f2df806e680 2024-09-11T23:15:41.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df8072160 con 0x7f2df806e680 2024-09-11T23:15:41.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dedffb640 1 -- 172.21.15.94:0/3348063397 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2df400bbc0 con 0x7f2df806e680 2024-09-11T23:15:41.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dedffb640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ddc0678c0 0x7f2ddc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dedffb640 1 -- 172.21.15.94:0/3348063397 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2df40863e0 con 0x7f2df806e680 2024-09-11T23:15:41.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.164+0000 7f2dfcb3e640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ddc0678c0 0x7f2ddc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.168+0000 7f2dfcb3e640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ddc0678c0 0x7f2ddc069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2de8007fd0 tx=0x7f2de8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.168+0000 7f2dedffb640 1 -- 172.21.15.94:0/3348063397 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2df4056c70 con 0x7f2df806e680 2024-09-11T23:15:41.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.352+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2df8070080 con 0x7f2df806e680 2024-09-11T23:15:41.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dedffb640 1 -- 172.21.15.94:0/3348063397 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f2df4056570 con 0x7f2df806e680 2024-09-11T23:15:41.357 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:41.358 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:15:41.358 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:15:41.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ddc0678c0 msgr2=0x7f2ddc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ddc0678c0 0x7f2ddc069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2de8007fd0 tx=0x7f2de8009040 comp rx=0 tx=0).stop 2024-09-11T23:15:41.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 msgr2=0x7f2df80aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df80aee10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d620 tx=0x7f2df400dae0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 shutdown_connections 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2df81587a0 0x7f2df815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2df80b37d0 0x7f2df815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ddc0678c0 0x7f2ddc069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 --2- 172.21.15.94:0/3348063397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2df806e680 0x7f2df80aee10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 >> 172.21.15.94:0/3348063397 conn(0x7f2df80b1f90 msgr2=0x7f2df81605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 shutdown_connections 2024-09-11T23:15:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.356+0000 7f2dff5a3640 1 -- 172.21.15.94:0/3348063397 wait complete. 2024-09-11T23:15:41.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:15:13.299318+0000', 'modified': '2024-09-11T23:15:33.415957+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6835/2765753940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 2765753940}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 2765753940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4263, 'qdb_cluster': [4263]} 2024-09-11T23:15:41.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:15:41.778 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:15:41.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb819d640 1 Processor -- start 2024-09-11T23:15:41.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb819d640 1 -- start start 2024-09-11T23:15:41.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb819d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4eb015bec0 0x7f4eb00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb819d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb015c2a0 0x7f4eb00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb819d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb00b3290 con 0x7f4eb00af2a0 2024-09-11T23:15:41.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb819d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb00b3570 con 0x7f4eb015bec0 2024-09-11T23:15:41.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb819d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00b3850 con 0x7f4eb015c2a0 2024-09-11T23:15:41.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5f39640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4eb015bec0 0x7f4eb00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5f39640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4eb015bec0 0x7f4eb00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53218/0 (socket says 172.21.15.94:53218) 2024-09-11T23:15:41.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5f39640 1 -- 172.21.15.94:0/3703500798 learned_addr learned my addr 172.21.15.94:0/3703500798 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5738640 1 --2- 172.21.15.94:0/3703500798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb015c2a0 0x7f4eb00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5f39640 1 -- 172.21.15.94:0/3703500798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb015c2a0 msgr2=0x7f4eb00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3703500798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb015c2a0 0x7f4eb00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5f39640 1 -- 172.21.15.94:0/3703500798 >> v1:172.21.15.94:6789/0 conn(0x7f4eb00af2a0 legacy=0x7f4eb015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.904+0000 7f4eb5f39640 1 -- 172.21.15.94:0/3703500798 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb00b3b30 con 0x7f4eb015bec0 2024-09-11T23:15:41.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3703500798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015bec0 0x7f4eb00ad200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e50 tx=0x7f4ea001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e984ffcc8fd670 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb4f37640 1 -- 172.21.15.94:0/3703500798 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a58d0 con 0x7f4eb015bec0 2024-09-11T23:15:41.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb4f37640 1 -- 172.21.15.94:0/3703500798 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00a5a70 con 0x7f4eb015bec0 2024-09-11T23:15:41.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb4f37640 1 -- 172.21.15.94:0/3703500798 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a5e40 con 0x7f4eb015bec0 2024-09-11T23:15:41.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 -- 172.21.15.94:0/3703500798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015bec0 msgr2=0x7f4eb00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3703500798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015bec0 0x7f4eb00ad200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e50 tx=0x7f4ea001ca00 comp rx=0 tx=0).stop 2024-09-11T23:15:41.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 -- 172.21.15.94:0/3703500798 shutdown_connections 2024-09-11T23:15:41.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3703500798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb015c2a0 0x7f4eb00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3703500798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015bec0 0x7f4eb00ad200 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 -- 172.21.15.94:0/3703500798 >> 172.21.15.94:0/3703500798 conn(0x7f4eb00b1f90 msgr2=0x7f4eb00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 -- 172.21.15.94:0/3703500798 shutdown_connections 2024-09-11T23:15:41.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 -- 172.21.15.94:0/3703500798 wait complete. 2024-09-11T23:15:41.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 Processor -- start 2024-09-11T23:15:41.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.908+0000 7f4eb819d640 1 -- start start 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb00af2a0 0x7f4eb01557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eb015bec0 0x7f4eb01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015c2a0 0x7f4eb014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00af6b0 con 0x7f4eb015c2a0 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00ad740 con 0x7f4eb015bec0 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb0169000 con 0x7f4eb00af2a0 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015c2a0 0x7f4eb014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015c2a0 0x7f4eb014f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53234/0 (socket says 172.21.15.94:53234) 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 -- 172.21.15.94:0/3431386544 learned_addr learned my addr 172.21.15.94:0/3431386544 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb5738640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eb015bec0 0x7f4eb01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb00af2a0 0x7f4eb01557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 -- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb00af2a0 msgr2=0x7f4eb01557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb00af2a0 0x7f4eb01557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 -- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eb015bec0 msgr2=0x7f4eb01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eb015bec0 0x7f4eb01548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 -- 172.21.15.94:0/3431386544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb015e880 con 0x7f4eb015c2a0 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb673a640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015c2a0 0x7f4eb014f7e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c460 tx=0x7f4ea800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eae7fc640 1 -- 172.21.15.94:0/3431386544 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8016020 con 0x7f4eb015c2a0 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eae7fc640 1 -- 172.21.15.94:0/3431386544 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea8005220 con 0x7f4eb015c2a0 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb015eb60 con 0x7f4eb015c2a0 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eae7fc640 1 -- 172.21.15.94:0/3431386544 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8007030 con 0x7f4eb015c2a0 2024-09-11T23:15:41.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb015f120 con 0x7f4eb015c2a0 2024-09-11T23:15:41.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eae7fc640 1 -- 172.21.15.94:0/3431386544 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ea80071d0 con 0x7f4eb015c2a0 2024-09-11T23:15:41.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eae7fc640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e9c0678c0 0x7f4e9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eae7fc640 1 -- 172.21.15.94:0/3431386544 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4ea8085950 con 0x7f4eb015c2a0 2024-09-11T23:15:41.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.912+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e9c0678c0 0x7f4e9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 Processor -- start 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- start start 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e9c0678c0 0x7f4e9c069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ae000 tx=0x7f4ea00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be17bab20 0x557be17baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bb440 0x557be1770d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be1771670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557be1658b60 con 0x557be17bab20 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557be15bfc70 con 0x557be1771290 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557be1565ed0 con 0x557be17bb440 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be17bab20 0x557be17baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be17bab20 0x557be17baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53240/0 (socket says 172.21.15.94:53240) 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 -- 172.21.15.94:0/2096342187 learned_addr learned my addr 172.21.15.94:0/2096342187 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be1771670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 -- 172.21.15.94:0/2096342187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bb440 msgr2=0x557be1770d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bb440 0x557be1770d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 -- 172.21.15.94:0/2096342187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 msgr2=0x557be1771670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be1771670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 -- 172.21.15.94:0/2096342187 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be1577e50 con 0x557be17bab20 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be17bab20 0x557be17baf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0000f90 tx=0x7f4ea0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d223b625049e7b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4e977fe640 1 -- 172.21.15.94:0/2096342187 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00ca070 con 0x557be17bab20 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4e977fe640 1 -- 172.21.15.94:0/2096342187 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00a5a50 con 0x557be17bab20 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4e977fe640 1 -- 172.21.15.94:0/2096342187 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00bab30 con 0x557be17bab20 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- 172.21.15.94:0/2096342187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be17bab20 msgr2=0x557be17baf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be17bab20 0x557be17baf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0000f90 tx=0x7f4ea0004ac0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- 172.21.15.94:0/2096342187 shutdown_connections 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be1771670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bb440 0x557be1770d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2096342187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be17bab20 0x557be17baf00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- 172.21.15.94:0/2096342187 >> 172.21.15.94:0/2096342187 conn(0x557be1777600 msgr2=0x557be176f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- 172.21.15.94:0/2096342187 shutdown_connections 2024-09-11T23:15:41.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- 172.21.15.94:0/2096342187 wait complete. 2024-09-11T23:15:41.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- start start 2024-09-11T23:15:41.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 Processor -- start 2024-09-11T23:15:41.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be1775e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bb440 0x557be177bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be177c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557be1621b00 con 0x557be1776390 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557be159a360 con 0x557be17bb440 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557be15972d0 con 0x557be17bab20 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4ebb259000 10 client.0 _ll_register_callbacks cb 0x557be175c820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be177c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be177c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53248/0 (socket says 172.21.15.94:53248) 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 -- 172.21.15.94:0/2850821167 learned_addr learned my addr 172.21.15.94:0/2850821167 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be1775e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb5738640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bb440 0x557be177bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 -- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 msgr2=0x557be1775e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be1775e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 -- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bb440 msgr2=0x557be177bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.916+0000 7f4eb673a640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bb440 0x557be177bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4eb673a640 1 -- 172.21.15.94:0/2850821167 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557be1566120 con 0x557be1776390 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4eb5738640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bb440 0x557be177bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4eb673a640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be177c230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005630 tx=0x7f4ea8056200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29907718f0b4e629 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 1 -- 172.21.15.94:0/2850821167 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea805e620 con 0x557be1776390 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 1 -- 172.21.15.94:0/2850821167 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4ea80520b0 con 0x557be1776390 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea00a5a50 con 0x557be1776390 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 1 -- 172.21.15.94:0/2850821167 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f4ea805c070 con 0x557be1776390 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 10 client.4668 fetch_fsmap learned FSMap version 8 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557be155f450 con 0x557be1776390 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 1 -- 172.21.15.94:0/2850821167 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00a5a50 con 0x557be1776390 2024-09-11T23:15:41.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 1 -- 172.21.15.94:0/2850821167 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f4ea8054e90 con 0x557be1776390 2024-09-11T23:15:41.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T23:15:41.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 10 client.4668 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:15:41.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 20 client.4668 populate_metadata read hostname 'smithi094' 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17c9280 0x557be17cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 4 client.4668 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 --> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557be1559c00 con 0x557be17c9280 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17c9280 0x557be17cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 10 client.4668 ms_handle_connect on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17c9280 0x557be17cb670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410bb9d3cd7c3af4 server_cookie=b1bcf2d790e53c4c in_seq=0 out_seq=0 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 1 -- 172.21.15.94:0/2850821167 <== mds.0 v2:172.21.15.94:6834/2765753940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557be1559c00 con 0x557be17c9280 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 10 client.4668 handle_command_reply: tid=0 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 client.4668 shutdown 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 msgr2=0x557be177c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be177c230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005630 tx=0x7f4ea8056200 comp rx=0 tx=0).stop 2024-09-11T23:15:41.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 shutdown_connections 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17c9280 0x557be17cb670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be177c230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bb440 0x557be177bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 --2- 172.21.15.94:0/2850821167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be1775e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 >> 172.21.15.94:0/2850821167 conn(0x557be1771290 msgr2=0x557be176fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4e94ff9640 0 client.4668 ms_handle_reset on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 shutdown_connections 2024-09-11T23:15:41.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 1 -- 172.21.15.94:0/2850821167 wait complete. 2024-09-11T23:15:41.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.920+0000 7f4ebb259000 20 client.4668 trim_cache size 0 max 16384 2024-09-11T23:15:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.936+0000 7f4ebb259000 1 Processor -- start 2024-09-11T23:15:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.936+0000 7f4ebb259000 1 -- start start 2024-09-11T23:15:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1771290 0x557be17b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be1776390 0x557be17ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bab20 0x557be17cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0201dc0 con 0x557be1771290 2024-09-11T23:15:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb015d910 con 0x557be17bab20 2024-09-11T23:15:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb0201770 con 0x557be1776390 2024-09-11T23:15:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1771290 0x557be17b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1771290 0x557be17b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53250/0 (socket says 172.21.15.94:53250) 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 -- 172.21.15.94:0/262461963 learned_addr learned my addr 172.21.15.94:0/262461963 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 -- 172.21.15.94:0/262461963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be1776390 msgr2=0x557be17ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/262461963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be1776390 0x557be17ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 -- 172.21.15.94:0/262461963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bab20 msgr2=0x557be17cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/262461963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bab20 0x557be17cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 -- 172.21.15.94:0/262461963 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be1546fd0 con 0x557be1771290 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/262461963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1771290 0x557be17b9cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0004b00 tx=0x7f4ea0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a80a2a4dc8091e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4e96ffd640 1 -- 172.21.15.94:0/262461963 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00ca040 con 0x557be1771290 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4e96ffd640 1 -- 172.21.15.94:0/262461963 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00d6040 con 0x557be1771290 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4e96ffd640 1 -- 172.21.15.94:0/262461963 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00ba930 con 0x557be1771290 2024-09-11T23:15:41.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- 172.21.15.94:0/262461963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1771290 msgr2=0x557be17b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- 172.21.15.94:0/262461963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1771290 0x557be17b9cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0004b00 tx=0x7f4ea0009810 comp rx=0 tx=0).stop 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- 172.21.15.94:0/262461963 shutdown_connections 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- 172.21.15.94:0/262461963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be17bab20 0x557be17cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- 172.21.15.94:0/262461963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be1776390 0x557be17ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- 172.21.15.94:0/262461963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1771290 0x557be17b9cc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- 172.21.15.94:0/262461963 >> 172.21.15.94:0/262461963 conn(0x557be17c6040 msgr2=0x557be1775650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- 172.21.15.94:0/262461963 shutdown_connections 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- 172.21.15.94:0/262461963 wait complete. 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- start start 2024-09-11T23:15:41.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 Processor -- start 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be17ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be17edd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be17ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557be15bef80 con 0x557be1776390 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557be1577ca0 con 0x557be1771290 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557be15c42a0 con 0x557be17bab20 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 10 client.0 _ll_register_callbacks cb 0x7f4ea8055810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be17edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be17edd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53266/0 (socket says 172.21.15.94:53266) 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 -- 172.21.15.94:0/3351153962 learned_addr learned my addr 172.21.15.94:0/3351153962 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb673a640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be17ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be17ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 -- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 msgr2=0x557be17ee2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be17ee2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 -- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 msgr2=0x557be17ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be17ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 -- 172.21.15.94:0/3351153962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557be1642750 con 0x557be1776390 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb673a640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be17ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4eb5738640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be17edd70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400ada0 tx=0x7f4ea400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3070e8e347d07140 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4e94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4e94ff9640 1 -- 172.21.15.94:0/3351153962 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4018020 con 0x557be1776390 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4e94ff9640 1 -- 172.21.15.94:0/3351153962 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4ea4014680 con 0x557be1776390 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea00d6040 con 0x557be1776390 2024-09-11T23:15:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.940+0000 7f4e94ff9640 1 -- 172.21.15.94:0/3351153962 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f4ea4022050 con 0x557be1776390 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 10 client.4674 fetch_fsmap learned FSMap version 8 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557be154da30 con 0x557be1776390 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4e94ff9640 1 -- 172.21.15.94:0/3351153962 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00d6040 con 0x557be1776390 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4e94ff9640 1 -- 172.21.15.94:0/3351153962 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f4ea4025020 con 0x557be1776390 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 10 client.4674 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 20 client.4674 populate_metadata read hostname 'smithi094' 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17bb440 0x557be17ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 4 client.4674 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 --> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] -- command(tid 0: {"prefix": "status"}) -- 0x557be15cd3a0 con 0x557be17bb440 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17bb440 0x557be17ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4e94ff9640 10 client.4674 ms_handle_connect on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb5f39640 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17bb440 0x557be17ee7f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7807ca7faee1cc5e server_cookie=3c43262047ec6802 in_seq=0 out_seq=0 2024-09-11T23:15:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4e94ff9640 1 -- 172.21.15.94:0/3351153962 <== mds.0 v2:172.21.15.94:6834/2765753940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x557be15cd3a0 con 0x557be17bb440 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4e94ff9640 10 client.4674 handle_command_reply: tid=0 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 client.4674 shutdown 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 msgr2=0x557be17edd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be17edd70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400ada0 tx=0x7f4ea400f5b0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 shutdown_connections 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:6834/2765753940,v1:172.21.15.94:6835/2765753940] conn(0x557be17bb440 0x557be17ee7f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557be17bab20 0x557be17ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557be1776390 0x557be17edd70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4e94ff9640 0 client.4674 ms_handle_reset on v2:172.21.15.94:6834/2765753940 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 --2- 172.21.15.94:0/3351153962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557be1771290 0x557be17ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 >> 172.21.15.94:0/3351153962 conn(0x557be17c6040 msgr2=0x557be17b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 shutdown_connections 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 1 -- 172.21.15.94:0/3351153962 wait complete. 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4ebb259000 20 client.4674 trim_cache size 0 max 16384 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4263, 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:15:41.953 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:15:41.954 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 28.017407520999999, 2024-09-11T23:15:41.954 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 8, 2024-09-11T23:15:41.954 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 25, 2024-09-11T23:15:41.954 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 25, 2024-09-11T23:15:41.954 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 34.099657252 2024-09-11T23:15:41.954 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e9c0678c0 msgr2=0x7f4e9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e9c0678c0 0x7f4e9c069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ae000 tx=0x7f4ea00a7070 comp rx=0 tx=0).stop 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015c2a0 msgr2=0x7f4eb014f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015c2a0 0x7f4eb014f7e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c460 tx=0x7f4ea800c920 comp rx=0 tx=0).stop 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 shutdown_connections 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e9c0678c0 0x7f4e9c069d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4eb015c2a0 0x7f4eb014f7e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eb015bec0 0x7f4eb01548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 --2- 172.21.15.94:0/3431386544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eb00af2a0 0x7f4eb01557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 >> 172.21.15.94:0/3431386544 conn(0x7f4eb00b1f90 msgr2=0x7f4eb00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 shutdown_connections 2024-09-11T23:15:41.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:41.944+0000 7f4eb819d640 1 -- 172.21.15.94:0/3431386544 wait complete. 2024-09-11T23:15:41.961 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T23:15:41.971 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T23:15:41.971 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T23:15:41.971 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T23:15:41.971 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T23:15:41.993 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T23:15:41.993 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-11T23:15:41.993 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-11T23:15:41.993 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:15:41.993 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:41.993 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-11T23:15:41.994 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:15:41.994 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:41.994 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-11T23:15:41.994 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:15:41.994 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:41.994 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-11T23:15:41.994 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:15:41.994 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:41.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:41.995 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-11T23:15:42.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:42.005 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-11T23:15:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-11T23:15:42.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:15:42.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:42.065 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:15:42.071 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T23:15:42.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:42.072 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:15:42.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:42.125 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-09-11T23:15:42.322 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T23:15:42.322 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:15:42.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:15:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.448+0000 7f507633b640 1 Processor -- start 2024-09-11T23:15:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.448+0000 7f507633b640 1 -- start start 2024-09-11T23:15:42.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f507633b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5070161a60 0x7f50700d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:42.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f507633b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50700d32b0 con 0x7f50700cf620 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f507633b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50700d0300 con 0x7f50700d2e90 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f507633b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f50700cfa90 con 0x7f5070161a60 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5070161a60 0x7f50700d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5070161a60 0x7f50700d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53276/0 (socket says 172.21.15.94:53276) 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506ffff640 1 -- 172.21.15.94:0/1082232613 learned_addr learned my addr 172.21.15.94:0/1082232613 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506ffff640 1 -- 172.21.15.94:0/1082232613 >> v1:172.21.15.155:6789/0 conn(0x7f50700d2e90 legacy=0x7f50700cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506ffff640 1 -- 172.21.15.94:0/1082232613 >> v1:172.21.15.94:6789/0 conn(0x7f50700cf620 legacy=0x7f507006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:42.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506ffff640 1 -- 172.21.15.94:0/1082232613 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50700b0f60 con 0x7f5070161a60 2024-09-11T23:15:42.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506ffff640 1 --2- 172.21.15.94:0/1082232613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5070161a60 0x7f50700d2950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5064009870 tx=0x7f506401c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801acc453e48a9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:42.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506effd640 1 -- 172.21.15.94:0/1082232613 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50640b0070 con 0x7f5070161a60 2024-09-11T23:15:42.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506effd640 1 -- 172.21.15.94:0/1082232613 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50640ab600 con 0x7f5070161a60 2024-09-11T23:15:42.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.452+0000 7f506effd640 1 -- 172.21.15.94:0/1082232613 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50640ab9d0 con 0x7f5070161a60 2024-09-11T23:15:42.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- 172.21.15.94:0/1082232613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5070161a60 msgr2=0x7f50700d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:42.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 --2- 172.21.15.94:0/1082232613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5070161a60 0x7f50700d2950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5064009870 tx=0x7f506401c280 comp rx=0 tx=0).stop 2024-09-11T23:15:42.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- 172.21.15.94:0/1082232613 shutdown_connections 2024-09-11T23:15:42.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 --2- 172.21.15.94:0/1082232613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5070161a60 0x7f50700d2950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:42.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- 172.21.15.94:0/1082232613 >> 172.21.15.94:0/1082232613 conn(0x7f507008bf90 msgr2=0x7f507009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:42.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- 172.21.15.94:0/1082232613 shutdown_connections 2024-09-11T23:15:42.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- 172.21.15.94:0/1082232613 wait complete. 2024-09-11T23:15:42.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 Processor -- start 2024-09-11T23:15:42.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- start start 2024-09-11T23:15:42.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700cf620 0x7f507015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:42.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50700d2e90 0x7f5070159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:42.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5070161a60 0x7f507015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:42.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f507016bf30 con 0x7f50700d2e90 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f507006d190 con 0x7f50700cf620 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f507016c0b0 con 0x7f5070161a60 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50700d2e90 0x7f5070159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50700d2e90 0x7f5070159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53286/0 (socket says 172.21.15.94:53286) 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 -- 172.21.15.94:0/3607309720 learned_addr learned my addr 172.21.15.94:0/3607309720 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506ffff640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700cf620 0x7f507015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f50748d8640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5070161a60 0x7f507015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 -- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5070161a60 msgr2=0x7f507015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5070161a60 0x7f507015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 -- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700cf620 msgr2=0x7f507015e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700cf620 0x7f507015e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:42.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 -- 172.21.15.94:0/3607309720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5070154210 con 0x7f50700d2e90 2024-09-11T23:15:42.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506f7fe640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50700d2e90 0x7f5070159dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f506000c7c0 tx=0x7f506000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:42.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506cff9640 1 -- 172.21.15.94:0/3607309720 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060016020 con 0x7f50700d2e90 2024-09-11T23:15:42.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506cff9640 1 -- 172.21.15.94:0/3607309720 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506000aa50 con 0x7f50700d2e90 2024-09-11T23:15:42.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50701610d0 con 0x7f50700d2e90 2024-09-11T23:15:42.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f506cff9640 1 -- 172.21.15.94:0/3607309720 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060012420 con 0x7f50700d2e90 2024-09-11T23:15:42.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.456+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507013c200 con 0x7f50700d2e90 2024-09-11T23:15:42.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.460+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5070074b80 con 0x7f50700d2e90 2024-09-11T23:15:42.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.460+0000 7f506cff9640 1 -- 172.21.15.94:0/3607309720 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5060019020 con 0x7f50700d2e90 2024-09-11T23:15:42.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.460+0000 7f506cff9640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f505c0678c0 0x7f505c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:42.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.460+0000 7f506cff9640 1 -- 172.21.15.94:0/3607309720 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5060085ff0 con 0x7f50700d2e90 2024-09-11T23:15:42.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.460+0000 7f506ffff640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f505c0678c0 0x7f505c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:42.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.460+0000 7f506ffff640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f505c0678c0 0x7f505c069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50640ad000 tx=0x7f50640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:42.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.464+0000 7f506cff9640 1 -- 172.21.15.94:0/3607309720 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5060020030 con 0x7f50700d2e90 2024-09-11T23:15:42.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f50700b5720 con 0x7f50700d2e90 2024-09-11T23:15:42.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f506cff9640 1 -- 172.21.15.94:0/3607309720 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f5060056880 con 0x7f50700d2e90 2024-09-11T23:15:42.662 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f505c0678c0 msgr2=0x7f505c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f505c0678c0 0x7f505c069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50640ad000 tx=0x7f50640a6000 comp rx=0 tx=0).stop 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50700d2e90 msgr2=0x7f5070159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50700d2e90 0x7f5070159dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f506000c7c0 tx=0x7f506000cc80 comp rx=0 tx=0).stop 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 shutdown_connections 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5070161a60 0x7f507015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f505c0678c0 0x7f505c069d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50700d2e90 0x7f5070159dd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 --2- 172.21.15.94:0/3607309720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700cf620 0x7f507015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.660+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 >> 172.21.15.94:0/3607309720 conn(0x7f507008bf90 msgr2=0x7f507015dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:42.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.664+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 shutdown_connections 2024-09-11T23:15:42.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42.664+0000 7f507633b640 1 -- 172.21.15.94:0/3607309720 wait complete. 2024-09-11T23:15:42.680 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:15:42.680 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:15:42.680 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:15:42.681 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:15:42.681 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:42.681 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:15:42.681 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:15:42.681 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:15:42.681 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:15:42.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:42.681 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:15:42.687 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:42.687 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:42.687 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:42.687 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:42.687 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:42.687 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:42.687 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42446sec preferred_lft 42446sec 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:15:42.688 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:42.689 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:15:42.689 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:42.689 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:15:42.689 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:42.689 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:15:42.689 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:42.689 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:42.689 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:15:42.689 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2024-09-11T23:15:42.689 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2024-09-11T23:15:42.690 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:15:42.690 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:42.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:42.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:42.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:42.815 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:15:42.866 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:15:42.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:42.868 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:15:42.917 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:15:42.917 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:15:42.917 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:15:42.917 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:15:42.917 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:15:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:15:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:15:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:42.918 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:15:42.918 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:42.918 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:42.918 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:15:42.918 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:15:42.919 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:15:42.919 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:43.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:43.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:43.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:43.041 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:15:43.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:43.047 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-09-11T23:15:43.093 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:43.093 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:43.093 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:43.094 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T23:15:43.094 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:43.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:43.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:43.210 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T23:15:43.210 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:43.210 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:43.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T23:15:43.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:15:43.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T23:15:43.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T23:15:43.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T23:15:43.211 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:43.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:43.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:43.303 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:43.303 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:43.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:15:43.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:15:43.303 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:43.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:43.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:43.406 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:15:43.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:43.406 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:43.428 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:15:43.451 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:15:43.453 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:15:43.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:43.454 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:43.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:43.603 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:43.650 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:43.650 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:43.651 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:43.652 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:43.653 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:43.653 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:43.653 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:43.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:43.654 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:43.701 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:15:43.702 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:15:43.746 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:43.760 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:43.809 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:43.809 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:43.810 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:43.812 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:43.812 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:43.812 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:43.812 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:43.812 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:43.812 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:43.812 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:43.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:43.813 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:43.827 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:15:43.824+0000 7faa5a730580 -1 init, newargv = 0x55c495af7110 newargc=15 2024-09-11T23:15:43.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[36344]: starting ceph client 2024-09-11T23:15:43.833 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[36344]: starting fuse 2024-09-11T23:15:44.932 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:44.948 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:44.998 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:44.998 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:44.998 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:44.998 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:44.998 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:44.998 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:45.001 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:45.001 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:45.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:45.002 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:45.053 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:15:45.054 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:15:45.054 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:15:45.054 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:15:45.054 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:15:45.054 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:15:45.054 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:15:45.054 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:15:45.055 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:15:45.056 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:15:45.056 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:15:45.056 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:15:45.056 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:45.056 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:15:45.056 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:15:45.179 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.36344.asok 2024-09-11T23:15:45.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:45.191 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36344.asok 2024-09-11T23:15:45.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:45.191 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36344.asok status 2024-09-11T23:15:45.341 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:15:45.341 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:15:45.341 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "36344", 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4689, 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:15:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4689 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2515679167 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:15:45.343 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2515679167 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4689 192.168.0.1:0/2515679167", 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/2515679167", 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 8, 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 25, 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:15:45.344 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:15:45.355 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:15:45.356 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:15:45.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.472+0000 7fd07fbb7640 1 Processor -- start 2024-09-11T23:15:45.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07fbb7640 1 -- start start 2024-09-11T23:15:45.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07fbb7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd078161a60 0x7fd0780d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07fbb7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd0780cf620 0x7fd07806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07fbb7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0780d32b0 con 0x7fd0780d2e90 2024-09-11T23:15:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07fbb7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd0780d0300 con 0x7fd0780cf620 2024-09-11T23:15:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07fbb7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd0780cfa90 con 0x7fd078161a60 2024-09-11T23:15:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd0780cf620 0x7fd07806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd0780cf620 0x7fd07806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53302/0 (socket says 172.21.15.94:53302) 2024-09-11T23:15:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 -- 172.21.15.94:0/1084030392 learned_addr learned my addr 172.21.15.94:0/1084030392 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07d953640 1 --2- 172.21.15.94:0/1084030392 >> v2:172.21.15.155:3300/0 conn(0x7fd078161a60 0x7fd0780d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 -- 172.21.15.94:0/1084030392 >> v2:172.21.15.155:3300/0 conn(0x7fd078161a60 msgr2=0x7fd0780d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 --2- 172.21.15.94:0/1084030392 >> v2:172.21.15.155:3300/0 conn(0x7fd078161a60 0x7fd0780d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 -- 172.21.15.94:0/1084030392 >> v1:172.21.15.155:6789/0 conn(0x7fd0780d2e90 legacy=0x7fd0780cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 -- 172.21.15.94:0/1084030392 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0780b0f60 con 0x7fd0780cf620 2024-09-11T23:15:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07e154640 1 --2- 172.21.15.94:0/1084030392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0780cf620 0x7fd07806d6b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd07808e010 tx=0x7fd07001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69ded503a19e558 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.476+0000 7fd07c951640 1 -- 172.21.15.94:0/1084030392 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700a57b0 con 0x7fd0780cf620 2024-09-11T23:15:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07c951640 1 -- 172.21.15.94:0/1084030392 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0700a5950 con 0x7fd0780cf620 2024-09-11T23:15:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07c951640 1 -- 172.21.15.94:0/1084030392 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700a5d20 con 0x7fd0780cf620 2024-09-11T23:15:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- 172.21.15.94:0/1084030392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0780cf620 msgr2=0x7fd07806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/1084030392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0780cf620 0x7fd07806d6b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd07808e010 tx=0x7fd07001c8f0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- 172.21.15.94:0/1084030392 shutdown_connections 2024-09-11T23:15:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/1084030392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0780cf620 0x7fd07806d6b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/1084030392 >> v2:172.21.15.155:3300/0 conn(0x7fd078161a60 0x7fd0780d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- 172.21.15.94:0/1084030392 >> 172.21.15.94:0/1084030392 conn(0x7fd07808bf90 msgr2=0x7fd07809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- 172.21.15.94:0/1084030392 shutdown_connections 2024-09-11T23:15:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- 172.21.15.94:0/1084030392 wait complete. 2024-09-11T23:15:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 Processor -- start 2024-09-11T23:15:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- start start 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0780cf620 0x7fd07813d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0780d2e90 0x7fd078152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd078161a60 0x7fd0780b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd07806e400 con 0x7fd078161a60 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd07806d190 con 0x7fd0780cf620 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd07806e580 con 0x7fd0780d2e90 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd078161a60 0x7fd0780b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd078161a60 0x7fd0780b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53312/0 (socket says 172.21.15.94:53312) 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 -- 172.21.15.94:0/2898141298 learned_addr learned my addr 172.21.15.94:0/2898141298 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07d152640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0780d2e90 0x7fd078152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:45.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07d953640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0780cf620 0x7fd07813d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 -- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0780d2e90 msgr2=0x7fd078152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0780d2e90 0x7fd078152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 -- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0780cf620 msgr2=0x7fd07813d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0780cf620 0x7fd07813d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 -- 172.21.15.94:0/2898141298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07813f720 con 0x7fd078161a60 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07d953640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0780cf620 0x7fd07813d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07e154640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd078161a60 0x7fd0780b3f30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd07001afa0 tx=0x7fd070019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd06e7fc640 1 -- 172.21.15.94:0/2898141298 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700b8670 con 0x7fd078161a60 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd06e7fc640 1 -- 172.21.15.94:0/2898141298 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0700be070 con 0x7fd078161a60 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.480+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07813fa00 con 0x7fd078161a60 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd06e7fc640 1 -- 172.21.15.94:0/2898141298 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700b8a70 con 0x7fd078161a60 2024-09-11T23:15:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07813ffc0 con 0x7fd078161a60 2024-09-11T23:15:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07806d6b0 con 0x7fd078161a60 2024-09-11T23:15:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd06e7fc640 1 -- 172.21.15.94:0/2898141298 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0700b8c10 con 0x7fd078161a60 2024-09-11T23:15:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd06e7fc640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd05c0678c0 0x7fd05c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd06e7fc640 1 -- 172.21.15.94:0/2898141298 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd070121260 con 0x7fd078161a60 2024-09-11T23:15:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd07d953640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd05c0678c0 0x7fd05c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.484+0000 7fd07d953640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd05c0678c0 0x7fd05c069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd074009840 tx=0x7fd074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:45.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.488+0000 7fd06e7fc640 1 -- 172.21.15.94:0/2898141298 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0700165a0 con 0x7fd078161a60 2024-09-11T23:15:45.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd07809d950 con 0x7fd078161a60 2024-09-11T23:15:45.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd06e7fc640 1 -- 172.21.15.94:0/2898141298 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fd0700f1a50 con 0x7fd078161a60 2024-09-11T23:15:45.690 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:15:45.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd05c0678c0 msgr2=0x7fd05c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:45.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd05c0678c0 0x7fd05c069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd074009840 tx=0x7fd074008040 comp rx=0 tx=0).stop 2024-09-11T23:15:45.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd078161a60 msgr2=0x7fd0780b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:45.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd078161a60 0x7fd0780b3f30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd07001afa0 tx=0x7fd070019690 comp rx=0 tx=0).stop 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 shutdown_connections 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd05c0678c0 0x7fd05c069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd078161a60 0x7fd0780b3f30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0780d2e90 0x7fd078152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 --2- 172.21.15.94:0/2898141298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0780cf620 0x7fd07813d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 >> 172.21.15.94:0/2898141298 conn(0x7fd07808bf90 msgr2=0x7fd07815d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 shutdown_connections 2024-09-11T23:15:45.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45.688+0000 7fd07fbb7640 1 -- 172.21.15.94:0/2898141298 wait complete. 2024-09-11T23:15:45.709 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:15:45.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:15:45.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:15:45.709 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-11T23:15:45.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:45.710 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:15:45.710 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:15:45.710 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:15:45.710 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-11T23:15:45.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:45.710 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:45.717 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:45.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:45.718 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:15:45.765 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:15:45.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:45.766 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:15:45.817 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:45.818 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:15:45.819 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:45.819 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:45.819 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:15:45.819 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:15:45.819 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:15:45.819 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:45.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:45.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:45.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:45.941 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:15:45.946 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:15:45.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:45.947 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-09-11T23:15:45.993 INFO:teuthology.orchestra.run.smithi094.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-11T23:15:45.993 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:45.994 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:45.994 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:15:45.994 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-11T23:15:45.994 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:46.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:46.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:46.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:46.109 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T23:15:46.165 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether ce:15:13:02:02:86 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::cc15:13ff:fe02:286/64 scope link 2024-09-11T23:15:46.166 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:46.167 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether ce:15:13:02:02:86 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:15:46.224 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:15:46.225 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.225 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::cc15:13ff:fe02:286/64 scope link 2024-09-11T23:15:46.225 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:46.225 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-11T23:15:46.225 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:46.225 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:46.225 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-11T23:15:46.226 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T23:15:46.226 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-11T23:15:46.226 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-11T23:15:46.226 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-11T23:15:46.226 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:46.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:46.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:46.362 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:46.362 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:15:46.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.1 up 2024-09-11T23:15:46.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T23:15:46.362 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:15:46.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:46.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:46.423 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-11T23:15:46.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:46.424 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:46.469 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-11T23:15:46.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:46.470 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:46.521 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:46.578 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:46.627 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:46.628 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:46.630 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:46.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:46.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:46.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:46.630 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:46.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:15:46.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:15:46.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:46.631 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:46.677 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:15:46.677 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:15:46.678 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-11T23:15:46.722 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:46.738 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:46.785 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:46.785 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:46.785 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:46.785 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:46.785 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:46.785 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:46.786 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:46.787 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:15:46.788 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:15:46.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:46.789 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:46.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi094.stderr:2024-09-11T23:15:46.800+0000 7fde009db580 -1 init, newargv = 0x55a4dced0230 newargc=15 2024-09-11T23:15:46.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi094.stderr:ceph-fuse[36489]: starting ceph client 2024-09-11T23:15:46.808 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:15:46.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi094.stderr:ceph-fuse[36489]: starting fuse 2024-09-11T23:15:47.910 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:15:47.925 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:47.974 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:15:47.974 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:15:47.974 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:15:47.974 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:15:47.975 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:15:47.976 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:47.977 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:15:47.977 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:15:47.977 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:47.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:47.978 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:15:48.025 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:15:48.025 INFO:teuthology.orchestra.run.smithi094.stdout:46 2024-09-11T23:15:48.026 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-11T23:15:48.026 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:15:48.027 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:15:48.028 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:15:48.028 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.2")) 2024-09-11T23:15:48.028 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:15:48.150 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.2.36489.asok 2024-09-11T23:15:48.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:48.162 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.36489.asok 2024-09-11T23:15:48.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:48.162 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.36489.asok status 2024-09-11T23:15:48.321 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:15:48.714 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "2", 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "36489", 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:15:48.715 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4701, 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4701 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 278941406 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:15:48.716 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 278941406 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4701 192.168.0.2:0/278941406", 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.2:0/278941406", 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 8, 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 25, 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:15:48.717 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:15:48.719 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:15:48.719 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:15:48.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fac5f1640 1 Processor -- start 2024-09-11T23:15:48.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fac5f1640 1 -- start start 2024-09-11T23:15:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fac5f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 0x7f5fa40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fac5f1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa40b3290 con 0x7f5fa40af2a0 2024-09-11T23:15:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fac5f1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa40b3570 con 0x7f5fa415bec0 2024-09-11T23:15:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fac5f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa40b3850 con 0x7f5fa415c2a0 2024-09-11T23:15:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5fa40af2a0 0x7f5fa406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50522/0 (socket says 172.21.15.94:50522) 2024-09-11T23:15:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 -- 172.21.15.94:0/1543753894 learned_addr learned my addr 172.21.15.94:0/1543753894 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258428830 0 0) 0x7f5fa40b3290 con 0x7f5fa40af2a0 2024-09-11T23:15:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa9b8c640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 0x7f5fa40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f8c003530 con 0x7f5fa40af2a0 2024-09-11T23:15:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 972042428 0 0) 0x7f5f8c003530 con 0x7f5fa40af2a0 2024-09-11T23:15:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 msgr2=0x7f5fa40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 0x7f5fa40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 >> v1:172.21.15.155:6789/0 conn(0x7f5fa415bec0 legacy=0x7f5fa40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa40b3b30 con 0x7f5fa40af2a0 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f5f94001a00 con 0x7f5fa40af2a0 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 >> v1:172.21.15.94:6789/0 conn(0x7f5fa40af2a0 legacy=0x7f5fa406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 0x7f5f8c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f8c003f70 0x7f5f8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5f8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa40b3850 con 0x7f5f8c004d50 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c00bab0 con 0x7f5f8c003f70 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8c0100c0 con 0x7f5fa415c2a0 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5f8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faa38d640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 0x7f5f8c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5fa9b8c640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f8c003f70 0x7f5f8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 -- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 msgr2=0x7f5f8c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415c2a0 0x7f5f8c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 -- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f8c003f70 msgr2=0x7f5f8c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f8c003f70 0x7f5f8c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.848+0000 7f5faab8e640 1 -- 172.21.15.94:0/1543753894 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8c003530 con 0x7f5f8c004d50 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5faab8e640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5f8c0051d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400a840 tx=0x7f5f9401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d582fb703e8aab85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400a460 con 0x7f5f8c004d50 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f940ad650 con 0x7f5f8c004d50 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fa938b640 1 -- 172.21.15.94:0/1543753894 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f940ada80 con 0x7f5f8c004d50 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1543753894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 msgr2=0x7f5f8c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 --2- 172.21.15.94:0/1543753894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5f8c0051d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400a840 tx=0x7f5f9401d360 comp rx=0 tx=0).stop 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5faab8e640 1 -- 172.21.15.94:0/1543753894 reap_dead start 2024-09-11T23:15:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1543753894 shutdown_connections 2024-09-11T23:15:48.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1543753894 >> 172.21.15.94:0/1543753894 conn(0x7f5fa40b1f90 msgr2=0x7f5fa40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:48.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1543753894 shutdown_connections 2024-09-11T23:15:48.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1543753894 wait complete. 2024-09-11T23:15:48.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 Processor -- start 2024-09-11T23:15:48.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- start start 2024-09-11T23:15:48.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5fa409db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415eb60 0x7f5fa415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa41e52c0 0x7f5fa41e5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa40af730 con 0x7f5f8c004d50 2024-09-11T23:15:48.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa40b40f0 con 0x7f5fa41e52c0 2024-09-11T23:15:48.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.852+0000 7f5fac5f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa40afc90 con 0x7f5fa415eb60 2024-09-11T23:15:48.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5fa409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5fa409db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53320/0 (socket says 172.21.15.94:53320) 2024-09-11T23:15:48.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 -- 172.21.15.94:0/1615674375 learned_addr learned my addr 172.21.15.94:0/1615674375 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:48.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faab8e640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa41e52c0 0x7f5fa41e5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 -- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415eb60 msgr2=0x7f5fa415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415eb60 0x7f5fa415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 -- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa41e52c0 msgr2=0x7f5fa41e5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa41e52c0 0x7f5fa41e5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 -- 172.21.15.94:0/1615674375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa41e5c80 con 0x7f5f8c004d50 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5faa38d640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5fa409db00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00e580 tx=0x7f5f9c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fa2ffd640 1 -- 172.21.15.94:0/1615674375 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0052e0 con 0x7f5f8c004d50 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fa2ffd640 1 -- 172.21.15.94:0/1615674375 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c018070 con 0x7f5f8c004d50 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fa2ffd640 1 -- 172.21.15.94:0/1615674375 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c003820 con 0x7f5f8c004d50 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa41e5f40 con 0x7f5f8c004d50 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa4142140 con 0x7f5f8c004d50 2024-09-11T23:15:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa40aed60 con 0x7f5f8c004d50 2024-09-11T23:15:48.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fa2ffd640 1 -- 172.21.15.94:0/1615674375 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f9c0039c0 con 0x7f5f8c004d50 2024-09-11T23:15:48.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fa2ffd640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5f900678c0 0x7f5f90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fa2ffd640 1 -- 172.21.15.94:0/1615674375 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5f9c085c40 con 0x7f5f8c004d50 2024-09-11T23:15:48.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.856+0000 7f5fa9b8c640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5f900678c0 0x7f5f90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.860+0000 7f5fa9b8c640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5f900678c0 0x7f5f90069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40b58f0 tx=0x7f5f98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:48.860+0000 7f5fa2ffd640 1 -- 172.21.15.94:0/1615674375 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f9c056450 con 0x7f5f8c004d50 2024-09-11T23:15:49.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5fa409e330 con 0x7f5f8c004d50 2024-09-11T23:15:49.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fa2ffd640 1 -- 172.21.15.94:0/1615674375 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f5f9c055d50 con 0x7f5f8c004d50 2024-09-11T23:15:49.062 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:15:49.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5f900678c0 msgr2=0x7f5f90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5f900678c0 0x7f5f90069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40b58f0 tx=0x7f5f98008040 comp rx=0 tx=0).stop 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 msgr2=0x7f5fa409db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5fa409db00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00e580 tx=0x7f5f9c00ea40 comp rx=0 tx=0).stop 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 shutdown_connections 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa41e52c0 0x7f5fa41e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fa415eb60 0x7f5fa415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5f900678c0 0x7f5f90069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:49.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 --2- 172.21.15.94:0/1615674375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f8c004d50 0x7f5fa409db00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:49.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 >> 172.21.15.94:0/1615674375 conn(0x7f5fa40b1f90 msgr2=0x7f5fa40b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:49.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 shutdown_connections 2024-09-11T23:15:49.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:49.060+0000 7f5fac5f1640 1 -- 172.21.15.94:0/1615674375 wait complete. 2024-09-11T23:15:49.081 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:15:49.081 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:15:49.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-11T23:15:49.081 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:15:49.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:49.082 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:15:49.082 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:15:49.082 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:15:49.082 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:15:49.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:49.082 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:49.089 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42451sec preferred_lft 42451sec 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:15:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:07:9e:6a:14 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:49.091 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:15:49.091 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:49.091 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:15:49.091 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:49.091 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:49.091 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:15:49.091 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-09-11T23:15:49.091 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-09-11T23:15:49.091 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:15:49.091 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:49.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:49.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:49.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:49.222 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:15:49.232 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-11T23:15:49.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:49.234 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-11T23:15:49.304 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-11T23:15:49.304 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:15:49.304 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:15:49.304 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:15:49.304 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:15:49.304 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:15:49.304 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:15:49.305 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:49.305 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:49.305 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:49.305 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:15:49.305 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:49.305 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:49.305 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:15:49.305 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:15:49.305 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:15:49.305 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:49.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:49.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:49.431 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-11T23:15:49.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:49.437 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-09-11T23:15:49.485 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:49.485 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:49.485 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:49.485 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-11T23:15:49.485 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:49.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:49.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:49.605 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-11T23:15:49.605 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:49.605 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:49.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-11T23:15:49.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:15:49.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-11T23:15:49.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-11T23:15:49.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-11T23:15:49.606 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:49.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:49.704 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:49.704 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:49.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-11T23:15:49.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:15:49.704 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:49.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:49.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:49.811 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:15:49.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:49.811 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:49.859 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:15:49.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:49.859 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:49.910 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-11T23:15:49.963 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:50.012 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-11T23:15:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T23:15:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T23:15:50.015 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T23:15:50.015 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-11T23:15:50.015 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:50.015 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:50.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:50.016 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-11T23:15:50.064 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:15:50.064 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T23:15:50.109 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-11T23:15:50.123 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:50.172 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-11T23:15:50.172 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-11T23:15:50.172 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-11T23:15:50.172 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-11T23:15:50.172 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-09-11T23:15:50.173 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:50.174 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:50.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:50.175 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-11T23:15:50.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:2024-09-11T23:15:50.186+0000 7f36ceca3580 -1 init, newargv = 0x55e15864be40 newargc=15 2024-09-11T23:15:50.192 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[34850]: starting ceph client 2024-09-11T23:15:50.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[34850]: starting fuse 2024-09-11T23:15:51.298 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-11T23:15:51.314 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:51.362 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-09-11T23:15:51.363 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-09-11T23:15:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:51.365 INFO:teuthology.orchestra.run.smithi155.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:51.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:51.367 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-11T23:15:51.412 INFO:teuthology.orchestra.run.smithi155.stdout:45 2024-09-11T23:15:51.412 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:15:51.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-09-11T23:15:51.413 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.1")) 2024-09-11T23:15:51.414 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-09-11T23:15:51.534 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.1.34850.asok 2024-09-11T23:15:51.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:51.546 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34850.asok 2024-09-11T23:15:51.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:51.546 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34850.asok status 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "1", 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:15:51.697 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "34850", 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4466, 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4466 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:15:51.698 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 4134183256 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 4134183256 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4466 192.168.0.1:0/4134183256", 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/4134183256", 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 8, 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 25, 2024-09-11T23:15:51.699 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:15:51.700 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-09-11T23:15:51.700 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-09-11T23:15:51.700 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-11T23:15:51.710 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:15:51.711 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:15:51.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2263405640 1 Processor -- start 2024-09-11T23:15:51.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2263405640 1 -- start start 2024-09-11T23:15:51.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2263405640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f225c158c90 0x7f225c0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2263405640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 0x7f225c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2263405640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225c159070 con 0x7f225c15f840 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2263405640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f225c06d070 con 0x7f225c158c90 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2263405640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f225c06d2c0 con 0x7f225c0b3e00 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22609a0640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f225c15f840 0x7f225c06e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44852/0 (socket says 172.21.15.94:44852) 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22609a0640 1 -- 172.21.15.94:0/876329220 learned_addr learned my addr 172.21.15.94:0/876329220 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22619a2640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 0x7f225c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229358364 0 0) 0x7f225c159070 con 0x7f225c15f840 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22611a1640 1 --2- 172.21.15.94:0/876329220 >> v2:172.21.15.155:3300/0 conn(0x7f225c158c90 0x7f225c0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2248003530 con 0x7f225c15f840 2024-09-11T23:15:51.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3419063668 0 0) 0x7f2248003530 con 0x7f225c15f840 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 msgr2=0x7f225c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 0x7f225c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 >> v2:172.21.15.155:3300/0 conn(0x7f225c158c90 msgr2=0x7f225c0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 --2- 172.21.15.94:0/876329220 >> v2:172.21.15.155:3300/0 conn(0x7f225c158c90 0x7f225c0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c06d5a0 con 0x7f225c15f840 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f224c001680 con 0x7f225c15f840 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 >> v1:172.21.15.94:6789/0 conn(0x7f225c15f840 legacy=0x7f225c06e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22480039c0 0x7f2248003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 0x7f2248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004d50 0x7f22480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f225c06d070 con 0x7f22480039c0 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f225c06d2c0 con 0x7f2248004d50 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f224800b9d0 con 0x7f225c0b3e00 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22611a1640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22480039c0 0x7f2248003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22609a0640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 0x7f2248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22619a2640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004d50 0x7f22480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22611a1640 1 -- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 msgr2=0x7f2248004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22611a1640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225c0b3e00 0x7f2248004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22611a1640 1 -- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004d50 msgr2=0x7f22480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22611a1640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004d50 0x7f22480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:51.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22611a1640 1 -- 172.21.15.94:0/876329220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2248003530 con 0x7f22480039c0 2024-09-11T23:15:51.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.839+0000 7f22619a2640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004d50 0x7f22480051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:51.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f22611a1640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22480039c0 0x7f2248003de0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2258009ae0 tx=0x7f225801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea81751f885ebc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580096b0 con 0x7f22480039c0 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22580a6490 con 0x7f22480039c0 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2253fff640 1 -- 172.21.15.94:0/876329220 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580a6880 con 0x7f22480039c0 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 -- 172.21.15.94:0/876329220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22480039c0 msgr2=0x7f2248003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 --2- 172.21.15.94:0/876329220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22480039c0 0x7f2248003de0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2258009ae0 tx=0x7f225801cab0 comp rx=0 tx=0).stop 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f22619a2640 1 -- 172.21.15.94:0/876329220 reap_dead start 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 -- 172.21.15.94:0/876329220 shutdown_connections 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 -- 172.21.15.94:0/876329220 >> 172.21.15.94:0/876329220 conn(0x7f225c06bcc0 msgr2=0x7f225c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 -- 172.21.15.94:0/876329220 shutdown_connections 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 -- 172.21.15.94:0/876329220 wait complete. 2024-09-11T23:15:51.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 Processor -- start 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.843+0000 7f2263405640 1 -- start start 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480039c0 0x7f225c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f225c14eae0 0x7f225c141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f225c153890 0x7f225c0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f225c0b4620 con 0x7f225c153890 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f225c0cd000 con 0x7f225c14eae0 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f225c1420f0 con 0x7f22480039c0 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f225c153890 0x7f225c0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f225c153890 0x7f225c0cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32840/0 (socket says 172.21.15.94:32840) 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 -- 172.21.15.94:0/1154114841 learned_addr learned my addr 172.21.15.94:0/1154114841 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22609a0640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f225c14eae0 0x7f225c141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22611a1640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480039c0 0x7f225c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 -- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480039c0 msgr2=0x7f225c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:51.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480039c0 0x7f225c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:51.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 -- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f225c14eae0 msgr2=0x7f225c141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:51.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f225c14eae0 0x7f225c141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:51.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 -- 172.21.15.94:0/1154114841 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c159470 con 0x7f225c153890 2024-09-11T23:15:51.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22619a2640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f225c153890 0x7f225c0cd3d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f225c0cc7a0 tx=0x7f225400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:51.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2251ffb640 1 -- 172.21.15.94:0/1154114841 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225400fe30 con 0x7f225c153890 2024-09-11T23:15:51.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2251ffb640 1 -- 172.21.15.94:0/1154114841 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22540039a0 con 0x7f225c153890 2024-09-11T23:15:51.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225c152db0 con 0x7f225c153890 2024-09-11T23:15:51.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2251ffb640 1 -- 172.21.15.94:0/1154114841 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254003d90 con 0x7f225c153890 2024-09-11T23:15:51.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225c153370 con 0x7f225c153890 2024-09-11T23:15:51.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225c153570 con 0x7f225c153890 2024-09-11T23:15:51.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2251ffb640 1 -- 172.21.15.94:0/1154114841 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f225401e020 con 0x7f225c153890 2024-09-11T23:15:51.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2251ffb640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f22400678c0 0x7f2240069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:51.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f2251ffb640 1 -- 172.21.15.94:0/1154114841 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2254086340 con 0x7f225c153890 2024-09-11T23:15:51.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.847+0000 7f22611a1640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f22400678c0 0x7f2240069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:51.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.851+0000 7f22611a1640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f22400678c0 0x7f2240069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22580ad000 tx=0x7f22580b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:51.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:51.851+0000 7f2251ffb640 1 -- 172.21.15.94:0/1154114841 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f225c153570 con 0x7f225c153890 2024-09-11T23:15:52.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.043+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f225c0b17f0 con 0x7f225c153890 2024-09-11T23:15:52.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.043+0000 7f2251ffb640 1 -- 172.21.15.94:0/1154114841 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f2254012070 con 0x7f225c153890 2024-09-11T23:15:52.049 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:15:52.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f22400678c0 msgr2=0x7f2240069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f22400678c0 0x7f2240069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22580ad000 tx=0x7f22580b2040 comp rx=0 tx=0).stop 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f225c153890 msgr2=0x7f225c0cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f225c153890 0x7f225c0cd3d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f225c0cc7a0 tx=0x7f225400f4a0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 shutdown_connections 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f22400678c0 0x7f2240069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f225c153890 0x7f225c0cd3d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f225c14eae0 0x7f225c141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 --2- 172.21.15.94:0/1154114841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480039c0 0x7f225c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 >> 172.21.15.94:0/1154114841 conn(0x7f225c06bcc0 msgr2=0x7f225c15ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 shutdown_connections 2024-09-11T23:15:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:52.047+0000 7f2263405640 1 -- 172.21.15.94:0/1154114841 wait complete. 2024-09-11T23:15:52.066 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:15:52.066 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:15:52.066 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-11T23:15:52.066 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-11T23:15:52.066 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:52.067 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:15:52.067 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:15:52.067 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:15:52.067 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-11T23:15:52.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:52.067 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:15:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:07:9e:6a:14 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:15:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:52.077 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:15:52.131 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-11T23:15:52.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:52.133 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:15:52.187 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:15:52.187 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:52.187 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:52.187 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:15:52.187 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:15:52.187 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:15:52.187 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:52.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:52.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:52.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:52.310 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-11T23:15:52.360 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:15:52.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:52.361 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-09-11T23:15:52.412 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-11T23:15:52.412 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:52.412 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:52.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:15:52.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-11T23:15:52.412 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:52.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:52.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:52.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:52.528 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T23:15:52.539 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:52.539 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:52.539 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:52.539 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.539 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:52.540 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.540 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:15:52.540 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 8e:e1:c2:08:d2:74 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:15:52.540 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:15:52.540 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.540 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::8ce1:c2ff:fe08:d274/64 scope link 2024-09-11T23:15:52.540 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:52.541 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T23:15:52.594 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 8e:e1:c2:08:d2:74 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::8ce1:c2ff:fe08:d274/64 scope link 2024-09-11T23:15:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:15:52.596 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-11T23:15:52.597 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:52.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:52.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:52.739 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:15:52.739 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-11T23:15:52.739 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.1 up 2024-09-11T23:15:52.739 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T23:15:52.739 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-11T23:15:52.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:15:52.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:52.801 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-11T23:15:52.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:52.801 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:52.847 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-11T23:15:52.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:15:52.847 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:52.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-11T23:15:52.957 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:53.006 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-11T23:15:53.006 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-11T23:15:53.006 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-11T23:15:53.006 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-11T23:15:53.006 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-11T23:15:53.006 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:53.007 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:53.008 INFO:teuthology.orchestra.run.smithi155.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:53.009 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:15:53.009 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:15:53.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:53.010 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-11T23:15:53.056 INFO:teuthology.orchestra.run.smithi155.stdout:45 2024-09-11T23:15:53.056 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:15:53.056 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-11T23:15:53.100 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-11T23:15:53.116 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:53.164 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-11T23:15:53.164 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-11T23:15:53.165 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T23:15:53.166 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-11T23:15:53.167 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:53.167 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:53.167 INFO:teuthology.orchestra.run.smithi155.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:53.167 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:15:53.167 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:15:53.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:53.167 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-11T23:15:53.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi155.stderr:2024-09-11T23:15:53.178+0000 7f18d2999580 -1 init, newargv = 0x5573d0b3dec0 newargc=15 2024-09-11T23:15:53.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi155.stderr:ceph-fuse[34969]: starting ceph client 2024-09-11T23:15:53.184 INFO:teuthology.orchestra.run.smithi155.stdout:45 2024-09-11T23:15:53.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi155.stderr:ceph-fuse[34969]: starting fuse 2024-09-11T23:15:54.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-11T23:15:54.302 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:15:54.350 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-11T23:15:54.351 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-11T23:15:54.352 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-11T23:15:54.352 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:15:54.352 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-11T23:15:54.352 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-11T23:15:54.353 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:15:54.354 INFO:teuthology.orchestra.run.smithi155.stdout:/home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:54.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.355 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-11T23:15:54.404 INFO:teuthology.orchestra.run.smithi155.stdout:45 2024-09-11T23:15:54.404 INFO:teuthology.orchestra.run.smithi155.stdout:46 2024-09-11T23:15:54.404 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:15:54.405 DEBUG:teuthology.orchestra.run.smithi155:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:15:54.405 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-09-11T23:15:54.405 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-09-11T23:15:54.405 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-09-11T23:15:54.405 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-09-11T23:15:54.405 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:54.405 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:15:54.406 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.3")) 2024-09-11T23:15:54.407 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-09-11T23:15:54.529 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.3.34969.asok 2024-09-11T23:15:54.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-11T23:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:15:54.541 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.34969.asok 2024-09-11T23:15:54.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.541 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.34969.asok status 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "3", 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "34969", 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-09-11T23:15:54.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4478, 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4478 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 1932229898 2024-09-11T23:15:54.692 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 1932229898 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4478 192.168.0.2:0/1932229898", 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.2:0/1932229898", 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 8, 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 25, 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:15:54.693 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-09-11T23:15:54.694 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-09-11T23:15:54.694 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-11T23:15:54.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.705 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:15:54.705 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:54.712 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:15:54.712 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:54.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.713 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:54.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.770 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:15:54.771 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:54.823 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:15:54.823 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:54.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.823 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-11T23:15:54.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.877 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-09-11T23:15:54.877 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:54.884 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-09-11T23:15:54.884 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:54.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:54.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.944 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-09-11T23:15:54.944 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:54.993 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-09-11T23:15:54.993 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:54.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:54.993 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-11T23:15:55.048 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-11T23:15:55.095 INFO:tasks.cephfs_test_runner:Starting test: test_dir_deletion (tasks.cephfs.test_strays.TestStrays) That when deleting a bunch of dentries and the containing 2024-09-11T23:15:55.095 INFO:tasks.cephfs_test_runner:test_dir_deletion (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:15:55.096 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:15:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.227+0000 7f170a9e4640 1 Processor -- start 2024-09-11T23:15:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.227+0000 7f170a9e4640 1 -- start start 2024-09-11T23:15:55.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f170a9e4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f170415c2a0 0x7f17040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f170a9e4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17040b3290 con 0x7f17040af2a0 2024-09-11T23:15:55.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f170a9e4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17040b3570 con 0x7f170415bec0 2024-09-11T23:15:55.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f170a9e4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f17040b3850 con 0x7f170415c2a0 2024-09-11T23:15:55.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1708f81640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f17040af2a0 0x7f170406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44868/0 (socket says 172.21.15.94:44868) 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1708f81640 1 -- 172.21.15.94:0/3262756472 learned_addr learned my addr 172.21.15.94:0/3262756472 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f17037fe640 1 --2- 172.21.15.94:0/3262756472 >> v2:172.21.15.155:3300/0 conn(0x7f170415c2a0 0x7f17040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510551717 0 0) 0x7f17040b3290 con 0x7f17040af2a0 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f0003530 con 0x7f17040af2a0 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1648437978 0 0) 0x7f16f0003530 con 0x7f17040af2a0 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 >> v2:172.21.15.155:3300/0 conn(0x7f170415c2a0 msgr2=0x7f17040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 --2- 172.21.15.94:0/3262756472 >> v2:172.21.15.155:3300/0 conn(0x7f170415c2a0 0x7f17040aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 >> v1:172.21.15.155:6789/0 conn(0x7f170415bec0 legacy=0x7f17040ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17040b3b30 con 0x7f17040af2a0 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f16fc001a00 con 0x7f17040af2a0 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 >> v1:172.21.15.94:6789/0 conn(0x7f17040af2a0 legacy=0x7f170406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f16f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f0004810 0x7f16f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f00051d0 0x7f16f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f17040b3850 con 0x7f16f00039c0 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16f000c070 con 0x7f16f00051d0 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f16f000c270 con 0x7f16f0004810 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1703fff640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f16f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1708f81640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f00051d0 0x7f16f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1703fff640 1 -- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f0004810 msgr2=0x7f16f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1703fff640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16f0004810 0x7f16f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1703fff640 1 -- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f00051d0 msgr2=0x7f16f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1703fff640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f00051d0 0x7f16f000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1703fff640 1 -- 172.21.15.94:0/3262756472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f0003530 con 0x7f16f00039c0 2024-09-11T23:15:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1708f81640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16f00051d0 0x7f16f000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:55.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.231+0000 7f1708f81640 1 -- 172.21.15.94:0/3262756472 reap_dead start 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f16f0003de0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f16f4001780 tx=0x7f16f401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4c5f9e39048ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f40013a0 con 0x7f16f00039c0 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f40052f0 con 0x7f16f00039c0 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1702ffd640 1 -- 172.21.15.94:0/3262756472 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4003840 con 0x7f16f00039c0 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- 172.21.15.94:0/3262756472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 msgr2=0x7f16f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f16f0003de0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f16f4001780 tx=0x7f16f401c3d0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- 172.21.15.94:0/3262756472 shutdown_connections 2024-09-11T23:15:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 --2- 172.21.15.94:0/3262756472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f16f0003de0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- 172.21.15.94:0/3262756472 >> 172.21.15.94:0/3262756472 conn(0x7f17040b1f90 msgr2=0x7f17040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:55.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- 172.21.15.94:0/3262756472 shutdown_connections 2024-09-11T23:15:55.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- 172.21.15.94:0/3262756472 wait complete. 2024-09-11T23:15:55.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 Processor -- start 2024-09-11T23:15:55.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- start start 2024-09-11T23:15:55.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f170415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f170415f590 0x7f170415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f170415ded0 0x7f1704155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f17040af680 con 0x7f16f00039c0 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17040ad610 con 0x7f170415f590 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f170415c6e0 con 0x7f170415ded0 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f170415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f170415f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32864/0 (socket says 172.21.15.94:32864) 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 -- 172.21.15.94:0/2056927201 learned_addr learned my addr 172.21.15.94:0/2056927201 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1708f81640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f170415ded0 0x7f1704155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f17037fe640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f170415f590 0x7f170415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 -- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f170415ded0 msgr2=0x7f1704155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f170415ded0 0x7f1704155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 -- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f170415f590 msgr2=0x7f170415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f170415f590 0x7f170415d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 -- 172.21.15.94:0/2056927201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170415c910 con 0x7f16f00039c0 2024-09-11T23:15:55.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1708f81640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f170415ded0 0x7f1704155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1703fff640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f170415f050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16f4005040 tx=0x7f16f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1700ff9640 1 -- 172.21.15.94:0/2056927201 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4007a40 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f1700ff9640 1 -- 172.21.15.94:0/2056927201 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f40ba070 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.235+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170415cbd0 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f1700ff9640 1 -- 172.21.15.94:0/2056927201 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f40054a0 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170415d190 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1704160470 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f1700ff9640 1 -- 172.21.15.94:0/2056927201 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16f4007030 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f1700ff9640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16e40678c0 0x7f16e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f1700ff9640 1 -- 172.21.15.94:0/2056927201 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f16f4120060 con 0x7f16f00039c0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f17037fe640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16e40678c0 0x7f16e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.239+0000 7f17037fe640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16e40678c0 0x7f16e4069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17040b1be0 tx=0x7f16ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.243+0000 7f1700ff9640 1 -- 172.21.15.94:0/2056927201 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f16f4016110 con 0x7f16f00039c0 2024-09-11T23:15:55.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.407+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17040aff90 con 0x7f16f00039c0 2024-09-11T23:15:55.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.407+0000 7f1700ff9640 1 -- 172.21.15.94:0/2056927201 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19058 (secure 0 0 0) 0x7f16f40f06e0 con 0x7f16f00039c0 2024-09-11T23:15:55.411 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:15:55.411 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":27,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:55.160219+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:55.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16e40678c0 msgr2=0x7f16e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16e40678c0 0x7f16e4069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17040b1be0 tx=0x7f16ec008040 comp rx=0 tx=0).stop 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 msgr2=0x7f170415f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f170415f050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16f4005040 tx=0x7f16f0005840 comp rx=0 tx=0).stop 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 shutdown_connections 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f170415ded0 0x7f1704155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f170415f590 0x7f170415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16e40678c0 0x7f16e4069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 --2- 172.21.15.94:0/2056927201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16f00039c0 0x7f170415f050 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 >> 172.21.15.94:0/2056927201 conn(0x7f17040b1f90 msgr2=0x7f1704159a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 shutdown_connections 2024-09-11T23:15:55.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.411+0000 7f170a9e4640 1 -- 172.21.15.94:0/2056927201 wait complete. 2024-09-11T23:15:55.430 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:15:02.040073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:15:11.099857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:15:12.279669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T23:15:16.026837+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T23:15:55.431 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:15:55.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f572042c640 1 Processor -- start 2024-09-11T23:15:55.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f572042c640 1 -- start start 2024-09-11T23:15:55.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f572042c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5718073e60 0x7f571806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f572042c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f571806fef0 0x7f571815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f572042c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571815bda0 con 0x7f57180b3d50 2024-09-11T23:15:55.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f572042c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f571806ee50 con 0x7f571806fef0 2024-09-11T23:15:55.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f572042c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f571806f130 con 0x7f5718073e60 2024-09-11T23:15:55.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571e1c8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5718073e60 0x7f571806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571e1c8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5718073e60 0x7f571806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:40688/0 (socket says 172.21.15.94:40688) 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571d9c7640 1 --2- 172.21.15.94:0/1048154918 >> v2:172.21.15.155:3300/0 conn(0x7f571806fef0 0x7f571815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571e1c8640 1 -- 172.21.15.94:0/1048154918 learned_addr learned my addr 172.21.15.94:0/1048154918 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571d9c7640 1 -- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5718073e60 msgr2=0x7f571806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571d9c7640 1 --2- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5718073e60 0x7f571806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571d9c7640 1 -- 172.21.15.94:0/1048154918 >> v1:172.21.15.155:6789/0 conn(0x7f57180b3d50 legacy=0x7f57180b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571d9c7640 1 -- 172.21.15.94:0/1048154918 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571806f410 con 0x7f571806fef0 2024-09-11T23:15:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.547+0000 7f571e1c8640 1 --2- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5718073e60 0x7f571806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:55.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f571d9c7640 1 --2- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 0x7f571815b860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57080097c0 tx=0x7f570801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f0cf20a599a1a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f571d1c6640 1 -- 172.21.15.94:0/1048154918 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080b0070 con 0x7f571806fef0 2024-09-11T23:15:55.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f571d1c6640 1 -- 172.21.15.94:0/1048154918 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57080ab600 con 0x7f571806fef0 2024-09-11T23:15:55.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f571d1c6640 1 -- 172.21.15.94:0/1048154918 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080ab9d0 con 0x7f571806fef0 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 -- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 msgr2=0x7f571815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 --2- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 0x7f571815b860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57080097c0 tx=0x7f570801c410 comp rx=0 tx=0).stop 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 -- 172.21.15.94:0/1048154918 shutdown_connections 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 --2- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 0x7f571815b860 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 --2- 172.21.15.94:0/1048154918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5718073e60 0x7f571806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 -- 172.21.15.94:0/1048154918 >> 172.21.15.94:0/1048154918 conn(0x7f57180b1f90 msgr2=0x7f57180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 -- 172.21.15.94:0/1048154918 shutdown_connections 2024-09-11T23:15:55.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 -- 172.21.15.94:0/1048154918 wait complete. 2024-09-11T23:15:55.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 Processor -- start 2024-09-11T23:15:55.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.551+0000 7f572042c640 1 -- start start 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 0x7f571814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5718073e60 0x7f57181519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57180b3d50 0x7f57181f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f57180729e0 con 0x7f5718073e60 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5718072860 con 0x7f571806fef0 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5718072b60 con 0x7f57180b3d50 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5718073e60 0x7f57181519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5718073e60 0x7f57181519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32870/0 (socket says 172.21.15.94:32870) 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 -- 172.21.15.94:0/4229781320 learned_addr learned my addr 172.21.15.94:0/4229781320 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571e1c8640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 0x7f571814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571e9c9640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57180b3d50 0x7f57181f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 -- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57180b3d50 msgr2=0x7f57181f82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57180b3d50 0x7f57181f82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 -- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 msgr2=0x7f571814d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 0x7f571814d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 -- 172.21.15.94:0/4229781320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571814db70 con 0x7f5718073e60 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571d9c7640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5718073e60 0x7f57181519c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57080ae040 tx=0x7f57080191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f570effd640 1 -- 172.21.15.94:0/4229781320 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080ba070 con 0x7f5718073e60 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571814de50 con 0x7f5718073e60 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f570effd640 1 -- 172.21.15.94:0/4229781320 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57080b43f0 con 0x7f5718073e60 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f570effd640 1 -- 172.21.15.94:0/4229781320 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080b0040 con 0x7f5718073e60 2024-09-11T23:15:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571814e410 con 0x7f5718073e60 2024-09-11T23:15:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571815b860 con 0x7f5718073e60 2024-09-11T23:15:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f570effd640 1 -- 172.21.15.94:0/4229781320 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57080b4800 con 0x7f5718073e60 2024-09-11T23:15:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f570effd640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56fc0678c0 0x7f56fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f570effd640 1 -- 172.21.15.94:0/4229781320 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f570811f250 con 0x7f5718073e60 2024-09-11T23:15:55.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.555+0000 7f571e1c8640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56fc0678c0 0x7f56fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.559+0000 7f571e1c8640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56fc0678c0 0x7f56fc069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f571400b8e0 tx=0x7f571400f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.559+0000 7f570effd640 1 -- 172.21.15.94:0/4229781320 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5708016090 con 0x7f5718073e60 2024-09-11T23:15:55.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.723+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f57180723f0 con 0x7f5718073e60 2024-09-11T23:15:55.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.723+0000 7f570effd640 1 -- 172.21.15.94:0/4229781320 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f57080ef2a0 con 0x7f5718073e60 2024-09-11T23:15:55.729 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-09-11T23:15:55.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56fc0678c0 msgr2=0x7f56fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56fc0678c0 0x7f56fc069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f571400b8e0 tx=0x7f571400f040 comp rx=0 tx=0).stop 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5718073e60 msgr2=0x7f57181519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5718073e60 0x7f57181519c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57080ae040 tx=0x7f57080191b0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 shutdown_connections 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57180b3d50 0x7f57181f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56fc0678c0 0x7f56fc069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5718073e60 0x7f57181519c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 --2- 172.21.15.94:0/4229781320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f571806fef0 0x7f571814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 >> 172.21.15.94:0/4229781320 conn(0x7f57180b1f90 msgr2=0x7f571815d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 shutdown_connections 2024-09-11T23:15:55.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.727+0000 7f572042c640 1 -- 172.21.15.94:0/4229781320 wait complete. 2024-09-11T23:15:55.746 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T23:15:55.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707e63b640 1 Processor -- start 2024-09-11T23:15:55.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707e63b640 1 -- start start 2024-09-11T23:15:55.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707e63b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f707815bec0 0x7f70780ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707e63b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f707815c2a0 0x7f70780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707e63b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70780b3290 con 0x7f70780af2a0 2024-09-11T23:15:55.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707e63b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f70780b3570 con 0x7f707815bec0 2024-09-11T23:15:55.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707e63b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70780b3850 con 0x7f707815c2a0 2024-09-11T23:15:55.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f7077fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f707815bec0 0x7f70780ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707cbd8640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f70780af2a0 0x7f707815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44880/0 (socket says 172.21.15.94:44880) 2024-09-11T23:15:55.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f707cbd8640 1 -- 172.21.15.94:0/3880490441 learned_addr learned my addr 172.21.15.94:0/3880490441 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:55.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f70777fe640 1 --2- 172.21.15.94:0/3880490441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f707815c2a0 0x7f70780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f7077fff640 1 -- 172.21.15.94:0/3880490441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f707815c2a0 msgr2=0x7f70780aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:55.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f7077fff640 1 --2- 172.21.15.94:0/3880490441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f707815c2a0 0x7f70780aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f7077fff640 1 -- 172.21.15.94:0/3880490441 >> v1:172.21.15.94:6789/0 conn(0x7f70780af2a0 legacy=0x7f707815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f7077fff640 1 -- 172.21.15.94:0/3880490441 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70780b3b30 con 0x7f707815bec0 2024-09-11T23:15:55.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.871+0000 7f70777fe640 1 --2- 172.21.15.94:0/3880490441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f707815c2a0 0x7f70780aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:15:55.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f7077fff640 1 --2- 172.21.15.94:0/3880490441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815bec0 0x7f70780ad200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70680097c0 tx=0x7f706801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937f82cf62ce6152 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f7076ffd640 1 -- 172.21.15.94:0/3880490441 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680a7070 con 0x7f707815bec0 2024-09-11T23:15:55.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f7076ffd640 1 -- 172.21.15.94:0/3880490441 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70680b0070 con 0x7f707815bec0 2024-09-11T23:15:55.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f7076ffd640 1 -- 172.21.15.94:0/3880490441 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680ab890 con 0x7f707815bec0 2024-09-11T23:15:55.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- 172.21.15.94:0/3880490441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815bec0 msgr2=0x7f70780ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 --2- 172.21.15.94:0/3880490441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815bec0 0x7f70780ad200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70680097c0 tx=0x7f706801c470 comp rx=0 tx=0).stop 2024-09-11T23:15:55.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- 172.21.15.94:0/3880490441 shutdown_connections 2024-09-11T23:15:55.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 --2- 172.21.15.94:0/3880490441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f707815c2a0 0x7f70780aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 --2- 172.21.15.94:0/3880490441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815bec0 0x7f70780ad200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- 172.21.15.94:0/3880490441 >> 172.21.15.94:0/3880490441 conn(0x7f70780b1f90 msgr2=0x7f70780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:55.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- 172.21.15.94:0/3880490441 shutdown_connections 2024-09-11T23:15:55.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- 172.21.15.94:0/3880490441 wait complete. 2024-09-11T23:15:55.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 Processor -- start 2024-09-11T23:15:55.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- start start 2024-09-11T23:15:55.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70780af2a0 0x7f7078154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707815bec0 0x7f70781f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815c2a0 0x7f7078152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f70780af6b0 con 0x7f707815c2a0 2024-09-11T23:15:55.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70780ad740 con 0x7f707815bec0 2024-09-11T23:15:55.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7078169000 con 0x7f70780af2a0 2024-09-11T23:15:55.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815c2a0 0x7f7078152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815c2a0 0x7f7078152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32896/0 (socket says 172.21.15.94:32896) 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 -- 172.21.15.94:0/1411571765 learned_addr learned my addr 172.21.15.94:0/1411571765 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f7077fff640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70780af2a0 0x7f7078154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 -- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70780af2a0 msgr2=0x7f7078154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70780af2a0 0x7f7078154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f70777fe640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707815bec0 0x7f70781f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 -- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707815bec0 msgr2=0x7f70781f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707815bec0 0x7f70781f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 -- 172.21.15.94:0/1411571765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70781f9430 con 0x7f707815c2a0 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707cbd8640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815c2a0 0x7f7078152470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f707000cbc0 tx=0x7f707000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f7074ff9640 1 -- 172.21.15.94:0/1411571765 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070017070 con 0x7f707815c2a0 2024-09-11T23:15:55.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f7074ff9640 1 -- 172.21.15.94:0/1411571765 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707000ad40 con 0x7f707815c2a0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.875+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70781f9710 con 0x7f707815c2a0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f7074ff9640 1 -- 172.21.15.94:0/1411571765 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070012600 con 0x7f707815c2a0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707809a4a0 con 0x7f707815c2a0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7078151da0 con 0x7f707815c2a0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f7074ff9640 1 -- 172.21.15.94:0/1411571765 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f707001a070 con 0x7f707815c2a0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f7074ff9640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70640678c0 0x7f7064069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f7074ff9640 1 -- 172.21.15.94:0/1411571765 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7070085d50 con 0x7f707815c2a0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f7077fff640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70640678c0 0x7f7064069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:55.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.879+0000 7f7077fff640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70640678c0 0x7f7064069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70680af000 tx=0x7f7068008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:55.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:55.883+0000 7f7074ff9640 1 -- 172.21.15.94:0/1411571765 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7070089030 con 0x7f707815c2a0 2024-09-11T23:15:56.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.043+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f70780ad200 con 0x7f707815c2a0 2024-09-11T23:15:56.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.043+0000 7f7074ff9640 1 -- 172.21.15.94:0/1411571765 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f7070055e20 con 0x7f707815c2a0 2024-09-11T23:15:56.049 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-09-11T23:15:56.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70640678c0 msgr2=0x7f7064069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70640678c0 0x7f7064069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70680af000 tx=0x7f7068008040 comp rx=0 tx=0).stop 2024-09-11T23:15:56.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815c2a0 msgr2=0x7f7078152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815c2a0 0x7f7078152470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f707000cbc0 tx=0x7f707000a430 comp rx=0 tx=0).stop 2024-09-11T23:15:56.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 shutdown_connections 2024-09-11T23:15:56.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70640678c0 0x7f7064069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f707815c2a0 0x7f7078152470 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707815bec0 0x7f70781f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 --2- 172.21.15.94:0/1411571765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70780af2a0 0x7f7078154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 >> 172.21.15.94:0/1411571765 conn(0x7f70780b1f90 msgr2=0x7f70780b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:56.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 shutdown_connections 2024-09-11T23:15:56.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.047+0000 7f707e63b640 1 -- 172.21.15.94:0/1411571765 wait complete. 2024-09-11T23:15:56.068 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T23:15:56.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.187+0000 7f37221c6640 1 Processor -- start 2024-09-11T23:15:56.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.187+0000 7f37221c6640 1 -- start start 2024-09-11T23:15:56.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f37221c6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f371c0cfaf0 0x7f371c168f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f37221c6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371c06d9c0 con 0x7f371c15e5f0 2024-09-11T23:15:56.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f37221c6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371c06dca0 con 0x7f371c0ce9d0 2024-09-11T23:15:56.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f37221c6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f371c06d7a0 con 0x7f371c0cfaf0 2024-09-11T23:15:56.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f371c15e5f0 0x7f371c06d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44890/0 (socket says 172.21.15.94:44890) 2024-09-11T23:15:56.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f371c0cfaf0 0x7f371c168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371b7fe640 1 -- 172.21.15.94:0/2779780533 learned_addr learned my addr 172.21.15.94:0/2779780533 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:56.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371a7fc640 1 -- 172.21.15.94:0/2779780533 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381815989 0 0) 0x7f371c06d9c0 con 0x7f371c15e5f0 2024-09-11T23:15:56.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371a7fc640 1 -- 172.21.15.94:0/2779780533 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3704003530 con 0x7f371c15e5f0 2024-09-11T23:15:56.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371bfff640 1 -- 172.21.15.94:0/2779780533 >> v1:172.21.15.155:6789/0 conn(0x7f371c0ce9d0 legacy=0x7f371c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:56.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371bfff640 1 -- 172.21.15.94:0/2779780533 >> v1:172.21.15.94:6789/0 conn(0x7f371c15e5f0 legacy=0x7f371c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.191+0000 7f371bfff640 1 -- 172.21.15.94:0/2779780533 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c06df80 con 0x7f371c0cfaf0 2024-09-11T23:15:56.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371bfff640 1 --2- 172.21.15.94:0/2779780533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c168f90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d90 tx=0x7f371401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8744cef24fcbfe3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371a7fc640 1 -- 172.21.15.94:0/2779780533 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37140b2070 con 0x7f371c0cfaf0 2024-09-11T23:15:56.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371a7fc640 1 -- 172.21.15.94:0/2779780533 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37140a5900 con 0x7f371c0cfaf0 2024-09-11T23:15:56.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371a7fc640 1 -- 172.21.15.94:0/2779780533 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37140a5cb0 con 0x7f371c0cfaf0 2024-09-11T23:15:56.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- 172.21.15.94:0/2779780533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 msgr2=0x7f371c168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 --2- 172.21.15.94:0/2779780533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c168f90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d90 tx=0x7f371401c930 comp rx=0 tx=0).stop 2024-09-11T23:15:56.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- 172.21.15.94:0/2779780533 shutdown_connections 2024-09-11T23:15:56.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 --2- 172.21.15.94:0/2779780533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c168f90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- 172.21.15.94:0/2779780533 >> 172.21.15.94:0/2779780533 conn(0x7f371c074030 msgr2=0x7f371c09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:56.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- 172.21.15.94:0/2779780533 shutdown_connections 2024-09-11T23:15:56.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- 172.21.15.94:0/2779780533 wait complete. 2024-09-11T23:15:56.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 Processor -- start 2024-09-11T23:15:56.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- start start 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c157c60 0x7f371c0b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0b9190 0x7f371c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f371c16c080 con 0x7f371c0cfaf0 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f371c16bf00 con 0x7f371c0b9190 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f37221c6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f371c16c200 con 0x7f371c157c60 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32922/0 (socket says 172.21.15.94:32922) 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 -- 172.21.15.94:0/3726559001 learned_addr learned my addr 172.21.15.94:0/3726559001 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 -- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c157c60 msgr2=0x7f371c0b8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371affd640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c157c60 0x7f371c0b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371bfff640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0b9190 0x7f371c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c157c60 0x7f371c0b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 -- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0b9190 msgr2=0x7f371c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0b9190 0x7f371c153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.195+0000 7f371b7fe640 1 -- 172.21.15.94:0/3726559001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c0b7420 con 0x7f371c0cfaf0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f371b7fe640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c157720 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c4b0 tx=0x7f370c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f3703fff640 1 -- 172.21.15.94:0/3726559001 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c017070 con 0x7f371c0cfaf0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f3703fff640 1 -- 172.21.15.94:0/3726559001 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f370c005cf0 con 0x7f371c0cfaf0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c15a310 con 0x7f371c0cfaf0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f3703fff640 1 -- 172.21.15.94:0/3726559001 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c007290 con 0x7f371c0cfaf0 2024-09-11T23:15:56.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c0b7700 con 0x7f371c0cfaf0 2024-09-11T23:15:56.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c0b9570 con 0x7f371c0cfaf0 2024-09-11T23:15:56.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f3703fff640 1 -- 172.21.15.94:0/3726559001 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f370c01a070 con 0x7f371c0cfaf0 2024-09-11T23:15:56.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f3703fff640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37080678c0 0x7f3708069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f3703fff640 1 -- 172.21.15.94:0/3726559001 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f370c0853d0 con 0x7f371c0cfaf0 2024-09-11T23:15:56.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f371affd640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37080678c0 0x7f3708069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.199+0000 7f371affd640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37080678c0 0x7f3708069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f371c0b69b0 tx=0x7f3710008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.203+0000 7f3703fff640 1 -- 172.21.15.94:0/3726559001 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f370c055af0 con 0x7f371c0cfaf0 2024-09-11T23:15:56.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.351+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f371c0b71b0 con 0x7f371c0cfaf0 2024-09-11T23:15:56.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.351+0000 7f3703fff640 1 -- 172.21.15.94:0/3726559001 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f370c0553f0 con 0x7f371c0cfaf0 2024-09-11T23:15:56.355 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37080678c0 msgr2=0x7f3708069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37080678c0 0x7f3708069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f371c0b69b0 tx=0x7f3710008040 comp rx=0 tx=0).stop 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 msgr2=0x7f371c157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c157720 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c4b0 tx=0x7f370c00c970 comp rx=0 tx=0).stop 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 shutdown_connections 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0b9190 0x7f371c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c157c60 0x7f371c0b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37080678c0 0x7f3708069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 --2- 172.21.15.94:0/3726559001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f371c0cfaf0 0x7f371c157720 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 >> 172.21.15.94:0/3726559001 conn(0x7f371c0ce9d0 msgr2=0x7f371c0b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 shutdown_connections 2024-09-11T23:15:56.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.355+0000 7f37221c6640 1 -- 172.21.15.94:0/3726559001 wait complete. 2024-09-11T23:15:56.372 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T23:15:56.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.487+0000 7f3114e00640 1 Processor -- start 2024-09-11T23:15:56.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.487+0000 7f3114e00640 1 -- start start 2024-09-11T23:15:56.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f3114e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311015bec0 0x7f31100ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f3114e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f311015c2a0 0x7f31100aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f3114e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f311015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f3114e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f31100b3290 con 0x7f311015bec0 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f3114e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f31100b3570 con 0x7f311015c2a0 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f3114e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f31100b3850 con 0x7f31100af2a0 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311015bec0 0x7f31100ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311015bec0 0x7f31100ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32932/0 (socket says 172.21.15.94:32932) 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 -- 172.21.15.94:0/875657102 learned_addr learned my addr 172.21.15.94:0/875657102 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310ed9d640 1 --2- 172.21.15.94:0/875657102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f311015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 -- 172.21.15.94:0/875657102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 msgr2=0x7f311015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:56.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 --2- 172.21.15.94:0/875657102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f311015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 -- 172.21.15.94:0/875657102 >> v2:172.21.15.155:3300/0 conn(0x7f311015c2a0 msgr2=0x7f31100aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:56.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 --2- 172.21.15.94:0/875657102 >> v2:172.21.15.155:3300/0 conn(0x7f311015c2a0 0x7f31100aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 -- 172.21.15.94:0/875657102 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31100b3b30 con 0x7f311015bec0 2024-09-11T23:15:56.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310e59c640 1 --2- 172.21.15.94:0/875657102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015bec0 0x7f31100ad200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31100ae510 tx=0x7f310001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e0814b73115a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310d59a640 1 -- 172.21.15.94:0/875657102 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31000b0070 con 0x7f311015bec0 2024-09-11T23:15:56.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310d59a640 1 -- 172.21.15.94:0/875657102 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31000ab600 con 0x7f311015bec0 2024-09-11T23:15:56.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.491+0000 7f310d59a640 1 -- 172.21.15.94:0/875657102 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31000ab9d0 con 0x7f311015bec0 2024-09-11T23:15:56.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/875657102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015bec0 msgr2=0x7f31100ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 --2- 172.21.15.94:0/875657102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015bec0 0x7f31100ad200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31100ae510 tx=0x7f310001c230 comp rx=0 tx=0).stop 2024-09-11T23:15:56.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/875657102 shutdown_connections 2024-09-11T23:15:56.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 --2- 172.21.15.94:0/875657102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f311015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 --2- 172.21.15.94:0/875657102 >> v2:172.21.15.155:3300/0 conn(0x7f311015c2a0 0x7f31100aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 --2- 172.21.15.94:0/875657102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015bec0 0x7f31100ad200 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/875657102 >> 172.21.15.94:0/875657102 conn(0x7f31100b1f90 msgr2=0x7f31100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:56.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/875657102 shutdown_connections 2024-09-11T23:15:56.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/875657102 wait complete. 2024-09-11T23:15:56.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 Processor -- start 2024-09-11T23:15:56.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- start start 2024-09-11T23:15:56.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f31101526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f311015bec0 0x7f31100aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015c2a0 0x7f31100b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f31100af6b0 con 0x7f311015c2a0 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31100ad740 con 0x7f311015bec0 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f311006e000 con 0x7f31100af2a0 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015c2a0 0x7f31100b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015c2a0 0x7f31100b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32944/0 (socket says 172.21.15.94:32944) 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 -- 172.21.15.94:0/3054286773 learned_addr learned my addr 172.21.15.94:0/3054286773 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310dd9b640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f311015bec0 0x7f31100aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310e59c640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f31101526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 -- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 msgr2=0x7f31101526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f31101526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 -- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f311015bec0 msgr2=0x7f31100aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f311015bec0 0x7f31100aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 -- 172.21.15.94:0/3054286773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3110152c00 con 0x7f311015c2a0 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f310ed9d640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015c2a0 0x7f31100b0440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f310800cd70 tx=0x7f310800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f30feffd640 1 -- 172.21.15.94:0/3054286773 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108003ba0 con 0x7f311015c2a0 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f30feffd640 1 -- 172.21.15.94:0/3054286773 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3108003d40 con 0x7f311015c2a0 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31100cdf60 con 0x7f311015c2a0 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f30feffd640 1 -- 172.21.15.94:0/3054286773 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108004240 con 0x7f311015c2a0 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31100ce520 con 0x7f311015c2a0 2024-09-11T23:15:56.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.495+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31100ad200 con 0x7f311015c2a0 2024-09-11T23:15:56.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.499+0000 7f30feffd640 1 -- 172.21.15.94:0/3054286773 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31080043e0 con 0x7f311015c2a0 2024-09-11T23:15:56.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.499+0000 7f30feffd640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30f00678c0 0x7f30f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.499+0000 7f30feffd640 1 -- 172.21.15.94:0/3054286773 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f3108086b30 con 0x7f311015c2a0 2024-09-11T23:15:56.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.499+0000 7f310e59c640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30f00678c0 0x7f30f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.499+0000 7f310e59c640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30f00678c0 0x7f30f0069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31000ad000 tx=0x7f3100008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.503+0000 7f30feffd640 1 -- 172.21.15.94:0/3054286773 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f310801d340 con 0x7f311015c2a0 2024-09-11T23:15:56.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.651+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f311006fcd0 con 0x7f311015c2a0 2024-09-11T23:15:56.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.651+0000 7f30feffd640 1 -- 172.21.15.94:0/3054286773 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f31080572e0 con 0x7f311015c2a0 2024-09-11T23:15:56.657 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-09-11T23:15:56.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30f00678c0 msgr2=0x7f30f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30f00678c0 0x7f30f0069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31000ad000 tx=0x7f3100008040 comp rx=0 tx=0).stop 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015c2a0 msgr2=0x7f31100b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015c2a0 0x7f31100b0440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f310800cd70 tx=0x7f310800a660 comp rx=0 tx=0).stop 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 shutdown_connections 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f30f00678c0 0x7f30f0069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311015c2a0 0x7f31100b0440 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f311015bec0 0x7f31100aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 --2- 172.21.15.94:0/3054286773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31100af2a0 0x7f31101526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 >> 172.21.15.94:0/3054286773 conn(0x7f31100b1f90 msgr2=0x7f3110075150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:56.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 shutdown_connections 2024-09-11T23:15:56.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.655+0000 7f3114e00640 1 -- 172.21.15.94:0/3054286773 wait complete. 2024-09-11T23:15:56.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2024-09-11T23:15:56.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca6531640 1 Processor -- start 2024-09-11T23:15:56.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca6531640 1 -- start start 2024-09-11T23:15:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca6531640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8ca006c3d0 0x7f8ca015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca6531640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ca015d290 0x7f8ca015e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca6531640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca015fc10 con 0x7f8ca015f830 2024-09-11T23:15:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca6531640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca015da40 con 0x7f8ca006c3d0 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca6531640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca015d800 con 0x7f8ca015d290 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8c9f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8ca006c3d0 0x7f8ca015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8c9f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8ca006c3d0 0x7f8ca015ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32960/0 (socket says 172.21.15.94:32960) 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/290583490 learned_addr learned my addr 172.21.15.94:0/290583490 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8ca4ace640 1 --2- 172.21.15.94:0/290583490 >> v2:172.21.15.155:3300/0 conn(0x7f8ca015d290 0x7f8ca015e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/290583490 >> v2:172.21.15.155:3300/0 conn(0x7f8ca015d290 msgr2=0x7f8ca015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8c9f7fe640 1 --2- 172.21.15.94:0/290583490 >> v2:172.21.15.155:3300/0 conn(0x7f8ca015d290 0x7f8ca015e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/290583490 >> v1:172.21.15.155:6789/0 conn(0x7f8ca015f830 legacy=0x7f8ca006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:56.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.791+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/290583490 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00b3570 con 0x7f8ca006c3d0 2024-09-11T23:15:56.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 --2- 172.21.15.94:0/290583490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca006c3d0 0x7f8ca015ded0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0069f60 tx=0x7f8c9401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0e5cc361a14494 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9effd640 1 -- 172.21.15.94:0/290583490 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c940aa610 con 0x7f8ca006c3d0 2024-09-11T23:15:56.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9effd640 1 -- 172.21.15.94:0/290583490 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c940af070 con 0x7f8ca006c3d0 2024-09-11T23:15:56.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9effd640 1 -- 172.21.15.94:0/290583490 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c940aa9d0 con 0x7f8ca006c3d0 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- 172.21.15.94:0/290583490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca006c3d0 msgr2=0x7f8ca015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 --2- 172.21.15.94:0/290583490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca006c3d0 0x7f8ca015ded0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0069f60 tx=0x7f8c9401c4b0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- 172.21.15.94:0/290583490 shutdown_connections 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 --2- 172.21.15.94:0/290583490 >> v2:172.21.15.155:3300/0 conn(0x7f8ca015d290 0x7f8ca015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 --2- 172.21.15.94:0/290583490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca006c3d0 0x7f8ca015ded0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- 172.21.15.94:0/290583490 >> 172.21.15.94:0/290583490 conn(0x7f8ca00b6800 msgr2=0x7f8ca00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- 172.21.15.94:0/290583490 shutdown_connections 2024-09-11T23:15:56.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- 172.21.15.94:0/290583490 wait complete. 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 Processor -- start 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- start start 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca006c3d0 0x7f8ca0146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca015d290 0x7f8ca014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ca015f830 0x7f8ca014c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca0169390 con 0x7f8ca015d290 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca0169210 con 0x7f8ca006c3d0 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca6531640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca0169510 con 0x7f8ca015f830 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca015d290 0x7f8ca014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca015d290 0x7f8ca014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32966/0 (socket says 172.21.15.94:32966) 2024-09-11T23:15:56.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/64325714 learned_addr learned my addr 172.21.15.94:0/64325714 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8ca4ace640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ca015f830 0x7f8ca014c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9ffff640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca006c3d0 0x7f8ca0146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ca015f830 msgr2=0x7f8ca014c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ca015f830 0x7f8ca014c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca006c3d0 msgr2=0x7f8ca0146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca006c3d0 0x7f8ca0146a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.795+0000 7f8c9f7fe640 1 -- 172.21.15.94:0/64325714 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca014f220 con 0x7f8ca015d290 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9f7fe640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca015d290 0x7f8ca014ece0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8c940ac040 tx=0x7f8c9401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9cff9640 1 -- 172.21.15.94:0/64325714 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c940b3800 con 0x7f8ca015d290 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9cff9640 1 -- 172.21.15.94:0/64325714 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c940b39a0 con 0x7f8ca015d290 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca00b6170 con 0x7f8ca015d290 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9cff9640 1 -- 172.21.15.94:0/64325714 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c940b3d90 con 0x7f8ca015d290 2024-09-11T23:15:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca00b53b0 con 0x7f8ca015d290 2024-09-11T23:15:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca006bcc0 con 0x7f8ca015d290 2024-09-11T23:15:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9cff9640 1 -- 172.21.15.94:0/64325714 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c940b2380 con 0x7f8ca015d290 2024-09-11T23:15:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9cff9640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9cff9640 1 -- 172.21.15.94:0/64325714 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f8c94120600 con 0x7f8ca015d290 2024-09-11T23:15:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9ffff640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.799+0000 7f8c9ffff640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c8c0678c0 0x7f8c8c069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c90007fd0 tx=0x7f8c90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:56.803+0000 7f8c9cff9640 1 -- 172.21.15.94:0/64325714 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c940c3060 con 0x7f8ca015d290 2024-09-11T23:15:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.027+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) -- 0x7f8ca006e7c0 con 0x7f8ca015d290 2024-09-11T23:15:57.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.183+0000 7f8c9cff9640 1 -- 172.21.15.94:0/64325714 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v61) ==== 135+0+0 (secure 0 0 0) 0x7f8c940a7070 con 0x7f8ca015d290 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c8c0678c0 msgr2=0x7f8c8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c8c0678c0 0x7f8c8c069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c90007fd0 tx=0x7f8c90009040 comp rx=0 tx=0).stop 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca015d290 msgr2=0x7f8ca014ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca015d290 0x7f8ca014ece0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8c940ac040 tx=0x7f8c9401acf0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 shutdown_connections 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ca015f830 0x7f8ca014c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ca015d290 0x7f8ca014ece0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 --2- 172.21.15.94:0/64325714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca006c3d0 0x7f8ca0146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 >> 172.21.15.94:0/64325714 conn(0x7f8ca00b6800 msgr2=0x7f8ca00cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 shutdown_connections 2024-09-11T23:15:57.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.187+0000 7f8ca6531640 1 -- 172.21.15.94:0/64325714 wait complete. 2024-09-11T23:15:57.209 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:15:57.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa3be3640 1 Processor -- start 2024-09-11T23:15:57.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa3be3640 1 -- start start 2024-09-11T23:15:57.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa3be3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4f9c1587a0 0x7f4f9c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa3be3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f9c06e680 0x7f4f9c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa3be3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c06ec60 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa3be3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4f9c0b3c40 con 0x7f4f9c1587a0 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa3be3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4f9c06f870 con 0x7f4f9c06e680 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa197f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4f9c1587a0 0x7f4f9c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa197f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4f9c1587a0 0x7f4f9c0b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32976/0 (socket says 172.21.15.94:32976) 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa197f640 1 -- 172.21.15.94:0/524728423 learned_addr learned my addr 172.21.15.94:0/524728423 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa2180640 1 --2- 172.21.15.94:0/524728423 >> v2:172.21.15.155:3300/0 conn(0x7f4f9c06e680 0x7f4f9c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa197f640 1 -- 172.21.15.94:0/524728423 >> v2:172.21.15.155:3300/0 conn(0x7f4f9c06e680 msgr2=0x7f4f9c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa197f640 1 --2- 172.21.15.94:0/524728423 >> v2:172.21.15.155:3300/0 conn(0x7f4f9c06e680 0x7f4f9c072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa197f640 1 -- 172.21.15.94:0/524728423 >> v1:172.21.15.155:6789/0 conn(0x7f4f9c0b37d0 legacy=0x7f4f9c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.331+0000 7f4fa197f640 1 -- 172.21.15.94:0/524728423 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c06ef40 con 0x7f4f9c1587a0 2024-09-11T23:15:57.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa197f640 1 --2- 172.21.15.94:0/524728423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c1587a0 0x7f4f9c0b3290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0af930 tx=0x7f4f9801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d7e200350deba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:57.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa097d640 1 -- 172.21.15.94:0/524728423 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f980ab600 con 0x7f4f9c1587a0 2024-09-11T23:15:57.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa097d640 1 -- 172.21.15.94:0/524728423 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980b0070 con 0x7f4f9c1587a0 2024-09-11T23:15:57.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa097d640 1 -- 172.21.15.94:0/524728423 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f980ab9c0 con 0x7f4f9c1587a0 2024-09-11T23:15:57.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 -- 172.21.15.94:0/524728423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c1587a0 msgr2=0x7f4f9c0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/524728423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c1587a0 0x7f4f9c0b3290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0af930 tx=0x7f4f9801c4f0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 -- 172.21.15.94:0/524728423 shutdown_connections 2024-09-11T23:15:57.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/524728423 >> v2:172.21.15.155:3300/0 conn(0x7f4f9c06e680 0x7f4f9c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/524728423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c1587a0 0x7f4f9c0b3290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 -- 172.21.15.94:0/524728423 >> 172.21.15.94:0/524728423 conn(0x7f4f9c0b1f90 msgr2=0x7f4f9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:57.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 -- 172.21.15.94:0/524728423 shutdown_connections 2024-09-11T23:15:57.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 -- 172.21.15.94:0/524728423 wait complete. 2024-09-11T23:15:57.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 Processor -- start 2024-09-11T23:15:57.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.335+0000 7f4fa3be3640 1 -- start start 2024-09-11T23:15:57.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9c06e680 0x7f4f9c14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c0b37d0 0x7f4f9c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f9c1587a0 0x7f4f9c147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c073030 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c072eb0 con 0x7f4f9c06e680 2024-09-11T23:15:57.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c0731b0 con 0x7f4f9c1587a0 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c0b37d0 0x7f4f9c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c0b37d0 0x7f4f9c155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32978/0 (socket says 172.21.15.94:32978) 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 -- 172.21.15.94:0/1175386905 learned_addr learned my addr 172.21.15.94:0/1175386905 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 -- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f9c1587a0 msgr2=0x7f4f9c147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f9c1587a0 0x7f4f9c147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 -- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9c06e680 msgr2=0x7f4f9c14cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9c06e680 0x7f4f9c14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 -- 172.21.15.94:0/1175386905 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c1f83a0 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa117e640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c0b37d0 0x7f4f9c155da0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c450 tx=0x7f4f8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4f927fc640 1 -- 172.21.15.94:0/1175386905 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c016020 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4f927fc640 1 -- 172.21.15.94:0/1175386905 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0052d0 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4f927fc640 1 -- 172.21.15.94:0/1175386905 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c007260 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c14c420 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c14c6c0 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c072160 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4f927fc640 1 -- 172.21.15.94:0/1175386905 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f8c007400 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4f927fc640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f800678c0 0x7f4f80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4f927fc640 1 -- 172.21.15.94:0/1175386905 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f4f8c0859e0 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.339+0000 7f4fa197f640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f800678c0 0x7f4f80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.343+0000 7f4fa197f640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f800678c0 0x7f4f80069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f980af000 tx=0x7f4f98004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:57.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.343+0000 7f4f927fc640 1 -- 172.21.15.94:0/1175386905 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f8c020020 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.507+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4f9c070080 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.511+0000 7f4f927fc640 1 -- 172.21.15.94:0/1175386905 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f4f8c005480 con 0x7f4f9c0b37d0 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f800678c0 msgr2=0x7f4f80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f800678c0 0x7f4f80069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f980af000 tx=0x7f4f98004740 comp rx=0 tx=0).stop 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c0b37d0 msgr2=0x7f4f9c155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c0b37d0 0x7f4f9c155da0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c450 tx=0x7f4f8c00c910 comp rx=0 tx=0).stop 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 shutdown_connections 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f9c1587a0 0x7f4f9c147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f800678c0 0x7f4f80069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9c0b37d0 0x7f4f9c155da0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 --2- 172.21.15.94:0/1175386905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9c06e680 0x7f4f9c14cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 >> 172.21.15.94:0/1175386905 conn(0x7f4f9c0b1f90 msgr2=0x7f4f9c0ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:57.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 shutdown_connections 2024-09-11T23:15:57.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.515+0000 7f4fa3be3640 1 -- 172.21.15.94:0/1175386905 wait complete. 2024-09-11T23:15:57.534 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:15:57.535 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:15:57.578 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:15:57.621 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:15:57.621 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:57.621 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:57.627 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:57.627 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:57.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:57.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.835+0000 7f27397e1640 1 Processor -- start 2024-09-11T23:15:57.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.835+0000 7f27397e1640 1 -- start start 2024-09-11T23:15:57.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27397e1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 0x7f2734166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27397e1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27340b3290 con 0x7f273415c2a0 2024-09-11T23:15:57.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27397e1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27340b3570 con 0x7f273415bec0 2024-09-11T23:15:57.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27397e1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27340b3850 con 0x7f273406f010 2024-09-11T23:15:57.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f273415c2a0 0x7f27340aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44902/0 (socket says 172.21.15.94:44902) 2024-09-11T23:15:57.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 -- 172.21.15.94:0/3684895198 learned_addr learned my addr 172.21.15.94:0/3684895198 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:57.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553018652 0 0) 0x7f27340b3290 con 0x7f273415c2a0 2024-09-11T23:15:57.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2720003530 con 0x7f273415c2a0 2024-09-11T23:15:57.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27337fe640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 0x7f2734166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 876168766 0 0) 0x7f2720003530 con 0x7f273415c2a0 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 msgr2=0x7f2734166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 0x7f2734166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 >> v1:172.21.15.155:6789/0 conn(0x7f273415bec0 legacy=0x7f27340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27340b3b30 con 0x7f273415c2a0 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f271c001680 con 0x7f273415c2a0 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 >> v1:172.21.15.94:6789/0 conn(0x7f273415c2a0 legacy=0x7f27340aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 0x7f27200039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2720004020 0x7f2720004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2720004d50 0x7f27200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f27340b3850 con 0x7f2720004020 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f272000bb90 con 0x7f2720004d50 2024-09-11T23:15:57.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f272000bd90 con 0x7f273406f010 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2720004020 0x7f2720004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f2732ffd640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 0x7f27200039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27337fe640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2720004d50 0x7f27200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 -- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 msgr2=0x7f27200039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273406f010 0x7f27200039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 -- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2720004d50 msgr2=0x7f27200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2720004d50 0x7f27200051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 -- 172.21.15.94:0/3684895198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2720003530 con 0x7f2720004020 2024-09-11T23:15:57.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.839+0000 7f27327fc640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2720004020 0x7f2720004810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c190 tx=0x7f271c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bcfe96cae9e715 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:57.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c007d00 con 0x7f2720004020 2024-09-11T23:15:57.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c005b00 con 0x7f2720004020 2024-09-11T23:15:57.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f2731ffb640 1 -- 172.21.15.94:0/3684895198 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c007070 con 0x7f2720004020 2024-09-11T23:15:57.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- 172.21.15.94:0/3684895198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2720004020 msgr2=0x7f2720004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 --2- 172.21.15.94:0/3684895198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2720004020 0x7f2720004810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c190 tx=0x7f271c01f390 comp rx=0 tx=0).stop 2024-09-11T23:15:57.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 -- 172.21.15.94:0/3684895198 reap_dead start 2024-09-11T23:15:57.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- 172.21.15.94:0/3684895198 shutdown_connections 2024-09-11T23:15:57.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- 172.21.15.94:0/3684895198 >> 172.21.15.94:0/3684895198 conn(0x7f27340b1f90 msgr2=0x7f27340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:57.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- 172.21.15.94:0/3684895198 shutdown_connections 2024-09-11T23:15:57.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- 172.21.15.94:0/3684895198 wait complete. 2024-09-11T23:15:57.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 Processor -- start 2024-09-11T23:15:57.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- start start 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27341496c0 0x7f273409d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273409d6d0 0x7f27340b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27340b05c0 0x7f273415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f27340afc90 con 0x7f27340b05c0 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27340b40f0 con 0x7f273409d6d0 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27397e1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27340af470 con 0x7f27341496c0 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27340b05c0 0x7f273415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27340b05c0 0x7f273415c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33002/0 (socket says 172.21.15.94:33002) 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 -- 172.21.15.94:0/134126787 learned_addr learned my addr 172.21.15.94:0/134126787 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f2732ffd640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27341496c0 0x7f273409d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27327fc640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273409d6d0 0x7f27340b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 -- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27341496c0 msgr2=0x7f273409d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27341496c0 0x7f273409d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 -- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273409d6d0 msgr2=0x7f27340b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273409d6d0 0x7f27340b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 -- 172.21.15.94:0/134126787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273415dcf0 con 0x7f27340b05c0 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.843+0000 7f27337fe640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27340b05c0 0x7f273415c6e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f272400e420 tx=0x7f272400e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f272b7fe640 1 -- 172.21.15.94:0/134126787 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272400f040 con 0x7f27340b05c0 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f272b7fe640 1 -- 172.21.15.94:0/134126787 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2724019070 con 0x7f27340b05c0 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273409dd10 con 0x7f27340b05c0 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f272b7fe640 1 -- 172.21.15.94:0/134126787 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724013850 con 0x7f27340b05c0 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2734149aa0 con 0x7f27340b05c0 2024-09-11T23:15:57.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27340aed60 con 0x7f27340b05c0 2024-09-11T23:15:57.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f272b7fe640 1 -- 172.21.15.94:0/134126787 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27240139f0 con 0x7f27340b05c0 2024-09-11T23:15:57.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f272b7fe640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678f0 0x7f2714069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:57.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f272b7fe640 1 -- 172.21.15.94:0/134126787 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f27240858b0 con 0x7f27340b05c0 2024-09-11T23:15:57.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f2732ffd640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678f0 0x7f2714069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:57.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.847+0000 7f2732ffd640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678f0 0x7f2714069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f272c005210 tx=0x7f272c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:57.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:57.851+0000 7f272b7fe640 1 -- 172.21.15.94:0/134126787 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2724055fd0 con 0x7f27340b05c0 2024-09-11T23:15:58.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.011+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27340b2520 con 0x7f27340b05c0 2024-09-11T23:15:58.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.011+0000 7f272b7fe640 1 -- 172.21.15.94:0/134126787 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f27240558d0 con 0x7f27340b05c0 2024-09-11T23:15:58.016 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:15:58.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678f0 msgr2=0x7f2714069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678f0 0x7f2714069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f272c005210 tx=0x7f272c009040 comp rx=0 tx=0).stop 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27340b05c0 msgr2=0x7f273415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27340b05c0 0x7f273415c6e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f272400e420 tx=0x7f272400e8e0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 shutdown_connections 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678f0 0x7f2714069db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27340b05c0 0x7f273415c6e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273409d6d0 0x7f27340b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 --2- 172.21.15.94:0/134126787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27341496c0 0x7f273409d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 >> 172.21.15.94:0/134126787 conn(0x7f27340b1f90 msgr2=0x7f2734075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 shutdown_connections 2024-09-11T23:15:58.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.015+0000 7f27397e1640 1 -- 172.21.15.94:0/134126787 wait complete. 2024-09-11T23:15:58.034 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:58.034 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:58.038 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:58.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.195+0000 7fce3cf97640 1 Processor -- start 2024-09-11T23:15:58.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.195+0000 7fce3cf97640 1 -- start start 2024-09-11T23:15:58.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.195+0000 7fce3cf97640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b4090 0x7fce380b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.195+0000 7fce3cf97640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce380b4ba0 0x7fce380b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce3cf97640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3806fa50 con 0x7fce38144d60 2024-09-11T23:15:58.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce3cf97640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fce38070660 con 0x7fce380b4ba0 2024-09-11T23:15:58.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce3cf97640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce3806fd30 con 0x7fce380b4090 2024-09-11T23:15:58.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce36d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce380b4ba0 0x7fce380b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce3659c640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fce38144d60 0x7fce38070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:35816/0 (socket says 172.21.15.94:35816) 2024-09-11T23:15:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce2dd9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b4090 0x7fce380b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce3659c640 1 -- 172.21.15.94:0/1989098320 learned_addr learned my addr 172.21.15.94:0/1989098320 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce36d9d640 1 -- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b4090 msgr2=0x7fce380b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce36d9d640 1 --2- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b4090 0x7fce380b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce36d9d640 1 -- 172.21.15.94:0/1989098320 >> v1:172.21.15.155:6789/0 conn(0x7fce38144d60 legacy=0x7fce38070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce36d9d640 1 -- 172.21.15.94:0/1989098320 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce38070010 con 0x7fce380b4ba0 2024-09-11T23:15:58.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce2dd9b640 1 --2- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b4090 0x7fce380b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:58.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce36d9d640 1 --2- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4ba0 0x7fce380b5030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7f9867a5e11117 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce35d9b640 1 -- 172.21.15.94:0/1989098320 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce300b2070 con 0x7fce380b4ba0 2024-09-11T23:15:58.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce35d9b640 1 -- 172.21.15.94:0/1989098320 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce300a5830 con 0x7fce380b4ba0 2024-09-11T23:15:58.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.199+0000 7fce35d9b640 1 -- 172.21.15.94:0/1989098320 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce300a5c00 con 0x7fce380b4ba0 2024-09-11T23:15:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4ba0 msgr2=0x7fce380b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 --2- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4ba0 0x7fce380b5030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3001c970 comp rx=0 tx=0).stop 2024-09-11T23:15:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- 172.21.15.94:0/1989098320 shutdown_connections 2024-09-11T23:15:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 --2- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4ba0 0x7fce380b5030 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 --2- 172.21.15.94:0/1989098320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b4090 0x7fce380b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- 172.21.15.94:0/1989098320 >> 172.21.15.94:0/1989098320 conn(0x7fce3809aa00 msgr2=0x7fce380b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- 172.21.15.94:0/1989098320 shutdown_connections 2024-09-11T23:15:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- 172.21.15.94:0/1989098320 wait complete. 2024-09-11T23:15:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 Processor -- start 2024-09-11T23:15:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- start start 2024-09-11T23:15:58.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4090 0x7fce3815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce380b4ba0 0x7fce3815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce38144d60 0x7fce38142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fce380af1b0 con 0x7fce380b4ba0 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce380af030 con 0x7fce380b4090 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce380af330 con 0x7fce38144d60 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce380b4ba0 0x7fce3815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce380b4ba0 0x7fce3815ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33012/0 (socket says 172.21.15.94:33012) 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 -- 172.21.15.94:0/3113826943 learned_addr learned my addr 172.21.15.94:0/3113826943 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3659c640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4090 0x7fce3815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce36d9d640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce38144d60 0x7fce38142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 -- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce38144d60 msgr2=0x7fce38142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce38144d60 0x7fce38142ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 -- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4090 msgr2=0x7fce3815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4090 0x7fce3815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 -- 172.21.15.94:0/3113826943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3815bbb0 con 0x7fce380b4ba0 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2dd9b640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce380b4ba0 0x7fce3815ae50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fce2000ebb0 tx=0x7fce2000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2f7fe640 1 -- 172.21.15.94:0/3113826943 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20017070 con 0x7fce380b4ba0 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2f7fe640 1 -- 172.21.15.94:0/3113826943 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2000cc30 con 0x7fce380b4ba0 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3815be90 con 0x7fce380b4ba0 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce2f7fe640 1 -- 172.21.15.94:0/3113826943 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20013470 con 0x7fce380b4ba0 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.203+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3815c450 con 0x7fce380b4ba0 2024-09-11T23:15:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.207+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce380b44b0 con 0x7fce380b4ba0 2024-09-11T23:15:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.207+0000 7fce2f7fe640 1 -- 172.21.15.94:0/3113826943 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce2001a070 con 0x7fce380b4ba0 2024-09-11T23:15:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.207+0000 7fce2f7fe640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fce180678c0 0x7fce18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.207+0000 7fce2f7fe640 1 -- 172.21.15.94:0/3113826943 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fce200860d0 con 0x7fce380b4ba0 2024-09-11T23:15:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.207+0000 7fce3659c640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fce180678c0 0x7fce18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.207+0000 7fce3659c640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fce180678c0 0x7fce18069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce28005890 tx=0x7fce28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.211+0000 7fce2f7fe640 1 -- 172.21.15.94:0/3113826943 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce20056750 con 0x7fce380b4ba0 2024-09-11T23:15:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.383+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fce380750d0 con 0x7fce380b4ba0 2024-09-11T23:15:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.383+0000 7fce2f7fe640 1 -- 172.21.15.94:0/3113826943 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fce20056050 con 0x7fce380b4ba0 2024-09-11T23:15:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fce180678c0 msgr2=0x7fce18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fce180678c0 0x7fce18069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce28005890 tx=0x7fce28009040 comp rx=0 tx=0).stop 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce380b4ba0 msgr2=0x7fce3815ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce380b4ba0 0x7fce3815ae50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fce2000ebb0 tx=0x7fce2000c520 comp rx=0 tx=0).stop 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 shutdown_connections 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce38144d60 0x7fce38142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fce180678c0 0x7fce18069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce380b4ba0 0x7fce3815ae50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 --2- 172.21.15.94:0/3113826943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce380b4090 0x7fce3815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 >> 172.21.15.94:0/3113826943 conn(0x7fce3809aa00 msgr2=0x7fce380b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:58.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 shutdown_connections 2024-09-11T23:15:58.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.387+0000 7fce3cf97640 1 -- 172.21.15.94:0/3113826943 wait complete. 2024-09-11T23:15:58.407 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:15:58.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:58.408 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:15:58.420 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:15:58.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:15:58.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:58.420 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:15:58.464 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:15:58.465 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:58.471 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:15:58.471 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:58.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:58.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.631+0000 7f755884c640 1 Processor -- start 2024-09-11T23:15:58.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.631+0000 7f755884c640 1 -- start start 2024-09-11T23:15:58.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755884c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75540b3280 0x7f75540cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755884c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f755415d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755884c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75540ce140 con 0x7f755415d0d0 2024-09-11T23:15:58.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755884c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f75540ce420 con 0x7f75540b3280 2024-09-11T23:15:58.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755884c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75540ce700 con 0x7f75540cf1e0 2024-09-11T23:15:58.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755259c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75540b3280 0x7f75540cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f7552d9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f755415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755259c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75540b3280 0x7f75540cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:44264/0 (socket says 172.21.15.94:44264) 2024-09-11T23:15:58.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f755259c640 1 -- 172.21.15.94:0/102695496 learned_addr learned my addr 172.21.15.94:0/102695496 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:58.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f7551d9b640 1 --1- 172.21.15.94:0/102695496 >> v1:172.21.15.155:6789/0 conn(0x7f755415d0d0 0x7f75540b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:35832/0 (socket says 172.21.15.94:35832) 2024-09-11T23:15:58.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f7552d9d640 1 -- 172.21.15.94:0/102695496 >> v2:172.21.15.155:3300/0 conn(0x7f75540b3280 msgr2=0x7f75540cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:58.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f7552d9d640 1 --2- 172.21.15.94:0/102695496 >> v2:172.21.15.155:3300/0 conn(0x7f75540b3280 0x7f75540cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f7552d9d640 1 -- 172.21.15.94:0/102695496 >> v1:172.21.15.155:6789/0 conn(0x7f755415d0d0 legacy=0x7f75540b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.635+0000 7f7552d9d640 1 -- 172.21.15.94:0/102695496 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75540ce9e0 con 0x7f75540cf1e0 2024-09-11T23:15:58.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f7552d9d640 1 --2- 172.21.15.94:0/102695496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f755415d810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f754c009d90 tx=0x7f754c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7393bb67819be137 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755159a640 1 -- 172.21.15.94:0/102695496 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0b2070 con 0x7f75540cf1e0 2024-09-11T23:15:58.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755159a640 1 -- 172.21.15.94:0/102695496 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c0a5890 con 0x7f75540cf1e0 2024-09-11T23:15:58.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755159a640 1 -- 172.21.15.94:0/102695496 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0a5c60 con 0x7f75540cf1e0 2024-09-11T23:15:58.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- 172.21.15.94:0/102695496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 msgr2=0x7f755415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 --2- 172.21.15.94:0/102695496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f755415d810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f754c009d90 tx=0x7f754c01c8b0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- 172.21.15.94:0/102695496 shutdown_connections 2024-09-11T23:15:58.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 --2- 172.21.15.94:0/102695496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f755415d810 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 --2- 172.21.15.94:0/102695496 >> v2:172.21.15.155:3300/0 conn(0x7f75540b3280 0x7f75540cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- 172.21.15.94:0/102695496 >> 172.21.15.94:0/102695496 conn(0x7f75540b6870 msgr2=0x7f75540b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:58.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- 172.21.15.94:0/102695496 shutdown_connections 2024-09-11T23:15:58.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- 172.21.15.94:0/102695496 wait complete. 2024-09-11T23:15:58.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 Processor -- start 2024-09-11T23:15:58.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- start start 2024-09-11T23:15:58.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75540b3280 0x7f75540ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f75540b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755415d0d0 0x7f755415a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f755415e2e0 con 0x7f75540b3280 2024-09-11T23:15:58.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f755415e160 con 0x7f755415d0d0 2024-09-11T23:15:58.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755884c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75541694a0 con 0x7f75540cf1e0 2024-09-11T23:15:58.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75540b3280 0x7f75540ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75540b3280 0x7f75540ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33022/0 (socket says 172.21.15.94:33022) 2024-09-11T23:15:58.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 -- 172.21.15.94:0/3933863857 learned_addr learned my addr 172.21.15.94:0/3933863857 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:58.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f7551d9b640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f75540b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f7552d9d640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755415d0d0 0x7f755415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 -- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 msgr2=0x7f75540b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f75540b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 -- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755415d0d0 msgr2=0x7f755415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755415d0d0 0x7f755415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.639+0000 7f755259c640 1 -- 172.21.15.94:0/3933863857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75540ac310 con 0x7f75540b3280 2024-09-11T23:15:58.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f755259c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75540b3280 0x7f75540ad3b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f754400e7f0 tx=0x7f754400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7542ffd640 1 -- 172.21.15.94:0/3933863857 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544017070 con 0x7f75540b3280 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7542ffd640 1 -- 172.21.15.94:0/3933863857 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754400c940 con 0x7f75540b3280 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75540ac5f0 con 0x7f75540b3280 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7542ffd640 1 -- 172.21.15.94:0/3933863857 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754400cd30 con 0x7f75540b3280 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75540acbb0 con 0x7f75540b3280 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75540cdb00 con 0x7f75540b3280 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7542ffd640 1 -- 172.21.15.94:0/3933863857 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f754401a070 con 0x7f75540b3280 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7542ffd640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75340678c0 0x7f7534069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7542ffd640 1 -- 172.21.15.94:0/3933863857 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7544086420 con 0x7f75540b3280 2024-09-11T23:15:58.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7551d9b640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75340678c0 0x7f7534069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.643+0000 7f7551d9b640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75340678c0 0x7f7534069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75540cdad0 tx=0x7f7548007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.647+0000 7f7542ffd640 1 -- 172.21.15.94:0/3933863857 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7544056aa0 con 0x7f75540b3280 2024-09-11T23:15:58.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.807+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7554159470 con 0x7f75540b3280 2024-09-11T23:15:58.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.807+0000 7f7542ffd640 1 -- 172.21.15.94:0/3933863857 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f75440563a0 con 0x7f75540b3280 2024-09-11T23:15:58.811 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75340678c0 msgr2=0x7f7534069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75340678c0 0x7f7534069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75540cdad0 tx=0x7f7548007cd0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75540b3280 msgr2=0x7f75540ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75540b3280 0x7f75540ad3b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f754400e7f0 tx=0x7f754400ecb0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 shutdown_connections 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755415d0d0 0x7f755415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75540cf1e0 0x7f75540b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75340678c0 0x7f7534069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 --2- 172.21.15.94:0/3933863857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75540b3280 0x7f75540ad3b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 >> 172.21.15.94:0/3933863857 conn(0x7f75540b6870 msgr2=0x7f755415e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:58.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 shutdown_connections 2024-09-11T23:15:58.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.811+0000 7f755884c640 1 -- 172.21.15.94:0/3933863857 wait complete. 2024-09-11T23:15:58.829 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:15:58.829 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:58.836 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:58.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f54565bd640 1 Processor -- start 2024-09-11T23:15:58.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f54565bd640 1 -- start start 2024-09-11T23:15:58.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f54565bd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5450070020 0x7f545015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f54565bd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54500aede0 con 0x7f54501520a0 2024-09-11T23:15:58.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f54565bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f545015fa10 con 0x7f545015f1d0 2024-09-11T23:15:58.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f54565bd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5450152480 con 0x7f5450070020 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f54501520a0 0x7f545006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44908/0 (socket says 172.21.15.94:44908) 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544ffff640 1 -- 172.21.15.94:0/1917998532 learned_addr learned my addr 172.21.15.94:0/1917998532 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544f7fe640 1 --2- 172.21.15.94:0/1917998532 >> v2:172.21.15.155:3300/0 conn(0x7f5450070020 0x7f545015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003661096 0 0) 0x7f54500aede0 con 0x7f54501520a0 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5438003530 con 0x7f54501520a0 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2585499771 0 0) 0x7f5438003530 con 0x7f54501520a0 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 >> v2:172.21.15.155:3300/0 conn(0x7f5450070020 msgr2=0x7f545015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 --2- 172.21.15.94:0/1917998532 >> v2:172.21.15.155:3300/0 conn(0x7f5450070020 0x7f545015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 >> v1:172.21.15.155:6789/0 conn(0x7f545015f1d0 legacy=0x7f54500adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5450074250 con 0x7f54501520a0 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f5440001a00 con 0x7f54501520a0 2024-09-11T23:15:58.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 >> v1:172.21.15.94:6789/0 conn(0x7f54501520a0 legacy=0x7f545006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54380039c0 0x7f5438003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5438004810 0x7f5438004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54380051d0 0x7f543800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f543800e300 con 0x7f54380051d0 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f543800e4b0 con 0x7f54380039c0 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f543800e6b0 con 0x7f5438004810 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544f7fe640 1 --2- 172.21.15.94:0/1917998532 >> v2:172.21.15.155:3300/0 conn(0x7f5450070020 0x7f545015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f5454b5a640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54380051d0 0x7f543800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f544ffff640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54380039c0 0x7f5438003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f5454b5a640 1 -- 172.21.15.94:0/1917998532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5438004810 msgr2=0x7f5438004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f5454b5a640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5438004810 0x7f5438004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f5454b5a640 1 -- 172.21.15.94:0/1917998532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54380039c0 msgr2=0x7f5438003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:58.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f5454b5a640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54380039c0 0x7f5438003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.951+0000 7f5454b5a640 1 -- 172.21.15.94:0/1917998532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5438003530 con 0x7f54380051d0 2024-09-11T23:15:58.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 -- 172.21.15.94:0/1917998532 reap_dead start 2024-09-11T23:15:58.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54380051d0 0x7f543800dbe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5448001780 tx=0x7f544801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148c5d2c44410b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480013a0 con 0x7f54380051d0 2024-09-11T23:15:58.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54480a9070 con 0x7f54380051d0 2024-09-11T23:15:58.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f544effd640 1 -- 172.21.15.94:0/1917998532 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5448003600 con 0x7f54380051d0 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- 172.21.15.94:0/1917998532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54380051d0 msgr2=0x7f543800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54380051d0 0x7f543800dbe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5448001780 tx=0x7f544801c420 comp rx=0 tx=0).stop 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- 172.21.15.94:0/1917998532 shutdown_connections 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 --2- 172.21.15.94:0/1917998532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54380051d0 0x7f543800dbe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- 172.21.15.94:0/1917998532 >> 172.21.15.94:0/1917998532 conn(0x7f54500b1f90 msgr2=0x7f54500b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- 172.21.15.94:0/1917998532 shutdown_connections 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- 172.21.15.94:0/1917998532 wait complete. 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 Processor -- start 2024-09-11T23:15:58.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- start start 2024-09-11T23:15:58.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54380051d0 0x7f545015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f545006f4c0 0x7f545014a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f545014a8f0 0x7f5450151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5450073a50 con 0x7f545014a8f0 2024-09-11T23:15:58.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5450073770 con 0x7f545006f4c0 2024-09-11T23:15:58.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f54565bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5450073d30 con 0x7f54380051d0 2024-09-11T23:15:58.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f545014a8f0 0x7f5450151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f545014a8f0 0x7f5450151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33048/0 (socket says 172.21.15.94:33048) 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 -- 172.21.15.94:0/564202984 learned_addr learned my addr 172.21.15.94:0/564202984 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 -- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54380051d0 msgr2=0x7f545015acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54380051d0 0x7f545015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 -- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f545006f4c0 msgr2=0x7f545014a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f545006f4c0 0x7f545014a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 -- 172.21.15.94:0/564202984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545014cd20 con 0x7f545014a8f0 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.955+0000 7f5454b5a640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f545014a8f0 0x7f5450151100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f544801c250 tx=0x7f5438005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544cff9640 1 -- 172.21.15.94:0/564202984 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480bb070 con 0x7f545014a8f0 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544cff9640 1 -- 172.21.15.94:0/564202984 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5448004b50 con 0x7f545014a8f0 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5450146430 con 0x7f545014a8f0 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544cff9640 1 -- 172.21.15.94:0/564202984 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480013a0 con 0x7f545014a8f0 2024-09-11T23:15:58.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54500b42e0 con 0x7f545014a8f0 2024-09-11T23:15:58.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5450068e50 con 0x7f545014a8f0 2024-09-11T23:15:58.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544cff9640 1 -- 172.21.15.94:0/564202984 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54480be070 con 0x7f545014a8f0 2024-09-11T23:15:58.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544cff9640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f543c0678f0 0x7f543c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:58.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544cff9640 1 -- 172.21.15.94:0/564202984 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f544811f3c0 con 0x7f545014a8f0 2024-09-11T23:15:58.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544ffff640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f543c0678f0 0x7f543c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:58.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.959+0000 7f544ffff640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f543c0678f0 0x7f543c069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5440001b70 tx=0x7f5440009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:58.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:58.963+0000 7f544cff9640 1 -- 172.21.15.94:0/564202984 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5448016130 con 0x7f545014a8f0 2024-09-11T23:15:59.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.123+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f54500aede0 con 0x7f545014a8f0 2024-09-11T23:15:59.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.123+0000 7f544cff9640 1 -- 172.21.15.94:0/564202984 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f54480efae0 con 0x7f545014a8f0 2024-09-11T23:15:59.127 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:15:59.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.123+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f543c0678f0 msgr2=0x7f543c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.123+0000 7f54565bd640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f543c0678f0 0x7f543c069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5440001b70 tx=0x7f5440009040 comp rx=0 tx=0).stop 2024-09-11T23:15:59.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f545014a8f0 msgr2=0x7f5450151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f545014a8f0 0x7f5450151100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f544801c250 tx=0x7f5438005840 comp rx=0 tx=0).stop 2024-09-11T23:15:59.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 shutdown_connections 2024-09-11T23:15:59.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f543c0678f0 0x7f543c069db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f545014a8f0 0x7f5450151100 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f545006f4c0 0x7f545014a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 --2- 172.21.15.94:0/564202984 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54380051d0 0x7f545015acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 >> 172.21.15.94:0/564202984 conn(0x7f54500b1f90 msgr2=0x7f5450071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:59.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 shutdown_connections 2024-09-11T23:15:59.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.127+0000 7f54565bd640 1 -- 172.21.15.94:0/564202984 wait complete. 2024-09-11T23:15:59.144 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-09-11T23:15:59.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:59.145 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:15:59.175 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:15:59.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:15:59.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:15:59.175 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:15:59.230 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:59.230 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:59.236 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:59.236 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:59.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:59.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.447+0000 7f0d0b02a640 1 Processor -- start 2024-09-11T23:15:59.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.447+0000 7f0d0b02a640 1 -- start start 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.447+0000 7f0d0b02a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d0415bec0 0x7f0d040ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.447+0000 7f0d0b02a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d040b3290 con 0x7f0d0415c2a0 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.447+0000 7f0d0b02a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d040b3570 con 0x7f0d040af470 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.447+0000 7f0d0b02a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0d040b3850 con 0x7f0d0415bec0 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d08dc6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d0415bec0 0x7f0d040ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d08dc6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d0415bec0 0x7f0d040ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33050/0 (socket says 172.21.15.94:33050) 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d08dc6640 1 -- 172.21.15.94:0/473081617 learned_addr learned my addr 172.21.15.94:0/473081617 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d08dc6640 1 -- 172.21.15.94:0/473081617 >> v1:172.21.15.155:6789/0 conn(0x7f0d040af470 legacy=0x7f0d0406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:59.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d08dc6640 1 -- 172.21.15.94:0/473081617 >> v1:172.21.15.94:6789/0 conn(0x7f0d0415c2a0 legacy=0x7f0d040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d08dc6640 1 -- 172.21.15.94:0/473081617 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d040b3b30 con 0x7f0d0415bec0 2024-09-11T23:15:59.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d08dc6640 1 --2- 172.21.15.94:0/473081617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415bec0 0x7f0d040ad200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009870 tx=0x7f0d0001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fb8c0bd36260bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:59.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0cfb7fe640 1 -- 172.21.15.94:0/473081617 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000aa650 con 0x7f0d0415bec0 2024-09-11T23:15:59.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0cfb7fe640 1 -- 172.21.15.94:0/473081617 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d000af070 con 0x7f0d0415bec0 2024-09-11T23:15:59.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0cfb7fe640 1 -- 172.21.15.94:0/473081617 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000aaa10 con 0x7f0d0415bec0 2024-09-11T23:15:59.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d0b02a640 1 -- 172.21.15.94:0/473081617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415bec0 msgr2=0x7f0d040ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/473081617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415bec0 0x7f0d040ad200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009870 tx=0x7f0d0001c4f0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d0b02a640 1 -- 172.21.15.94:0/473081617 shutdown_connections 2024-09-11T23:15:59.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/473081617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415bec0 0x7f0d040ad200 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d0b02a640 1 -- 172.21.15.94:0/473081617 >> 172.21.15.94:0/473081617 conn(0x7f0d040b1f90 msgr2=0x7f0d040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:59.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d0b02a640 1 -- 172.21.15.94:0/473081617 shutdown_connections 2024-09-11T23:15:59.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.451+0000 7f0d0b02a640 1 -- 172.21.15.94:0/473081617 wait complete. 2024-09-11T23:15:59.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 Processor -- start 2024-09-11T23:15:59.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 -- start start 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d040af470 0x7f0d04073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d0415bec0 0x7f0d0415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415c2a0 0x7f0d0415e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0406ef20 con 0x7f0d0415c2a0 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d040ad740 con 0x7f0d040af470 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0406f0a0 con 0x7f0d0415bec0 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415c2a0 0x7f0d0415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415c2a0 0x7f0d0415e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33056/0 (socket says 172.21.15.94:33056) 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 -- 172.21.15.94:0/796751541 learned_addr learned my addr 172.21.15.94:0/796751541 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d08dc6640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d040af470 0x7f0d04073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 -- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d0415bec0 msgr2=0x7f0d0415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d0415bec0 0x7f0d0415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 -- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d040af470 msgr2=0x7f0d04073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d040af470 0x7f0d04073190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 -- 172.21.15.94:0/796751541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0415d3a0 con 0x7f0d0415c2a0 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d095c7640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415c2a0 0x7f0d0415e980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c780 tx=0x7f0cfc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0cf97fa640 1 -- 172.21.15.94:0/796751541 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc004b70 con 0x7f0d0415c2a0 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0cf97fa640 1 -- 172.21.15.94:0/796751541 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cfc004d10 con 0x7f0d0415c2a0 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0cf97fa640 1 -- 172.21.15.94:0/796751541 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00aa90 con 0x7f0d0415c2a0 2024-09-11T23:15:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0415d680 con 0x7f0d0415c2a0 2024-09-11T23:15:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0415dc40 con 0x7f0d0415c2a0 2024-09-11T23:15:59.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d040ad200 con 0x7f0d0415c2a0 2024-09-11T23:15:59.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.455+0000 7f0cf97fa640 1 -- 172.21.15.94:0/796751541 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cfc00ac30 con 0x7f0d0415c2a0 2024-09-11T23:15:59.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.459+0000 7f0cf97fa640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cf00678c0 0x7f0cf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.459+0000 7f0cf97fa640 1 -- 172.21.15.94:0/796751541 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f0cfc086340 con 0x7f0d0415c2a0 2024-09-11T23:15:59.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.459+0000 7f0d08dc6640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cf00678c0 0x7f0cf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.459+0000 7f0d08dc6640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cf00678c0 0x7f0cf0069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d000ae000 tx=0x7f0d00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.463+0000 7f0cf97fa640 1 -- 172.21.15.94:0/796751541 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0cfc020070 con 0x7f0d0415c2a0 2024-09-11T23:15:59.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.635+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0d040b2bd0 con 0x7f0d0415c2a0 2024-09-11T23:15:59.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0cf97fa640 1 -- 172.21.15.94:0/796751541 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f0cfc056ad0 con 0x7f0d0415c2a0 2024-09-11T23:15:59.641 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cf00678c0 msgr2=0x7f0cf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cf00678c0 0x7f0cf0069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d000ae000 tx=0x7f0d00008040 comp rx=0 tx=0).stop 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415c2a0 msgr2=0x7f0d0415e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415c2a0 0x7f0d0415e980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c780 tx=0x7f0cfc00cc40 comp rx=0 tx=0).stop 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 shutdown_connections 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cf00678c0 0x7f0cf0069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d0415c2a0 0x7f0d0415e980 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d0415bec0 0x7f0d0415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 --2- 172.21.15.94:0/796751541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d040af470 0x7f0d04073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 >> 172.21.15.94:0/796751541 conn(0x7f0d040b1f90 msgr2=0x7f0d040d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:59.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 shutdown_connections 2024-09-11T23:15:59.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.639+0000 7f0d0b02a640 1 -- 172.21.15.94:0/796751541 wait complete. 2024-09-11T23:15:59.660 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:15:59.660 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:15:59.666 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:15:59.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf60b76640 1 Processor -- start 2024-09-11T23:15:59.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf60b76640 1 -- start start 2024-09-11T23:15:59.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf60b76640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faf5c15e650 0x7faf5c06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf60b76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 0x7faf5c0d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf60b76640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5c06e7a0 con 0x7faf5c06e170 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf60b76640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7faf5c0d1550 con 0x7faf5c15e650 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf60b76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0d0f00 con 0x7faf5c0b4510 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faf5c15e650 0x7faf5c06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faf5c15e650 0x7faf5c06dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33066/0 (socket says 172.21.15.94:33066) 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 -- 172.21.15.94:0/533905050 learned_addr learned my addr 172.21.15.94:0/533905050 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 -- 172.21.15.94:0/533905050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 msgr2=0x7faf5c0d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 --2- 172.21.15.94:0/533905050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 0x7faf5c0d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 -- 172.21.15.94:0/533905050 >> v1:172.21.15.155:6789/0 conn(0x7faf5c06e170 legacy=0x7faf5c0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:15:59.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 -- 172.21.15.94:0/533905050 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c0d11e0 con 0x7faf5c15e650 2024-09-11T23:15:59.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5a59c640 1 --2- 172.21.15.94:0/533905050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c06dc30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1b1b046aac8d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:59.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5959a640 1 -- 172.21.15.94:0/533905050 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0b0070 con 0x7faf5c15e650 2024-09-11T23:15:59.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5959a640 1 -- 172.21.15.94:0/533905050 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c0ab600 con 0x7faf5c15e650 2024-09-11T23:15:59.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.827+0000 7faf5959a640 1 -- 172.21.15.94:0/533905050 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0ab9d0 con 0x7faf5c15e650 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- 172.21.15.94:0/533905050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 msgr2=0x7faf5c06dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 --2- 172.21.15.94:0/533905050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c06dc30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c01c540 comp rx=0 tx=0).stop 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- 172.21.15.94:0/533905050 shutdown_connections 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 --2- 172.21.15.94:0/533905050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 0x7faf5c0d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 --2- 172.21.15.94:0/533905050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c06dc30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- 172.21.15.94:0/533905050 >> 172.21.15.94:0/533905050 conn(0x7faf5c06bcc0 msgr2=0x7faf5c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- 172.21.15.94:0/533905050 shutdown_connections 2024-09-11T23:15:59.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- 172.21.15.94:0/533905050 wait complete. 2024-09-11T23:15:59.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 Processor -- start 2024-09-11T23:15:59.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- start start 2024-09-11T23:15:59.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf5c06e170 0x7faf5c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 0x7faf5c161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0d2ac0 con 0x7faf5c15e650 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0d2940 con 0x7faf5c06e170 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0d2c40 con 0x7faf5c0b4510 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c160860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33080/0 (socket says 172.21.15.94:33080) 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 -- 172.21.15.94:0/1178493317 learned_addr learned my addr 172.21.15.94:0/1178493317 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5a59c640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf5c06e170 0x7faf5c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 -- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 msgr2=0x7faf5c161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 0x7faf5c161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 -- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf5c06e170 msgr2=0x7faf5c1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf5c06e170 0x7faf5c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:59.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 -- 172.21.15.94:0/1178493317 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c15ec30 con 0x7faf5c15e650 2024-09-11T23:15:59.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf5ad9d640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c160860 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf5400b9e0 tx=0x7faf5400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:59.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf52ffd640 1 -- 172.21.15.94:0/1178493317 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54019070 con 0x7faf5c15e650 2024-09-11T23:15:59.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf52ffd640 1 -- 172.21.15.94:0/1178493317 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5400cb40 con 0x7faf5c15e650 2024-09-11T23:15:59.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c161a60 con 0x7faf5c15e650 2024-09-11T23:15:59.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf52ffd640 1 -- 172.21.15.94:0/1178493317 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54014440 con 0x7faf5c15e650 2024-09-11T23:15:59.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.831+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c15eea0 con 0x7faf5c15e650 2024-09-11T23:15:59.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.835+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c0b1ac0 con 0x7faf5c15e650 2024-09-11T23:15:59.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.835+0000 7faf52ffd640 1 -- 172.21.15.94:0/1178493317 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf5401c070 con 0x7faf5c15e650 2024-09-11T23:15:59.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.835+0000 7faf52ffd640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faf3c0678f0 0x7faf3c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:59.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.835+0000 7faf52ffd640 1 -- 172.21.15.94:0/1178493317 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7faf54085d20 con 0x7faf5c15e650 2024-09-11T23:15:59.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.835+0000 7faf5a59c640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faf3c0678f0 0x7faf3c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:59.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.835+0000 7faf5a59c640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faf3c0678f0 0x7faf3c069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0ad000 tx=0x7faf4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:59.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:15:59.839+0000 7faf52ffd640 1 -- 172.21.15.94:0/1178493317 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf54056440 con 0x7faf5c15e650 2024-09-11T23:16:00.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.003+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faf5c0d19c0 con 0x7faf5c15e650 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.003+0000 7faf52ffd640 1 -- 172.21.15.94:0/1178493317 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7faf54055d40 con 0x7faf5c15e650 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faf3c0678f0 msgr2=0x7faf3c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faf3c0678f0 0x7faf3c069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0ad000 tx=0x7faf4c008040 comp rx=0 tx=0).stop 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 msgr2=0x7faf5c160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c160860 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf5400b9e0 tx=0x7faf5400bea0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 shutdown_connections 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faf3c0678f0 0x7faf3c069db0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf5c15e650 0x7faf5c160860 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf5c0b4510 0x7faf5c161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 --2- 172.21.15.94:0/1178493317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf5c06e170 0x7faf5c1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 >> 172.21.15.94:0/1178493317 conn(0x7faf5c06bcc0 msgr2=0x7faf5c0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:00.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 shutdown_connections 2024-09-11T23:16:00.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.007+0000 7faf60b76640 1 -- 172.21.15.94:0/1178493317 wait complete. 2024-09-11T23:16:00.025 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:16:00.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:00.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-11T23:16:00.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:00.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:16:00.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:00.036 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:16:00.085 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:16:00.085 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:00.091 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:16:00.091 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:00.142 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:16:00.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2e0d29640 1 Processor -- start 2024-09-11T23:16:00.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2e0d29640 1 -- start start 2024-09-11T23:16:00.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2e0d29640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc2dc0aee70 0x7fc2dc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2e0d29640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc0af300 con 0x7fc2dc0adad0 2024-09-11T23:16:00.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2e0d29640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc0af5e0 con 0x7fc2dc155450 2024-09-11T23:16:00.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2e0d29640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc2dc0af8c0 con 0x7fc2dc0aee70 2024-09-11T23:16:00.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2d9d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc2dc0aee70 0x7fc2dc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2d9d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc2dc0aee70 0x7fc2dc15f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36534/0 (socket says 172.21.15.94:36534) 2024-09-11T23:16:00.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2d9d9b640 1 -- 172.21.15.94:0/748640146 learned_addr learned my addr 172.21.15.94:0/748640146 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:00.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2d9d9b640 1 -- 172.21.15.94:0/748640146 >> v1:172.21.15.155:6789/0 conn(0x7fc2dc155450 legacy=0x7fc2dc0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:00.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2d9d9b640 1 -- 172.21.15.94:0/748640146 >> v1:172.21.15.94:6789/0 conn(0x7fc2dc0adad0 legacy=0x7fc2dc154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.251+0000 7fc2d9d9b640 1 -- 172.21.15.94:0/748640146 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc0afba0 con 0x7fc2dc0aee70 2024-09-11T23:16:00.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2d9d9b640 1 --2- 172.21.15.94:0/748640146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc0aee70 0x7fc2dc15f320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009870 tx=0x7fc2d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0d38aebfd5028c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2d959a640 1 -- 172.21.15.94:0/748640146 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00b0070 con 0x7fc2dc0aee70 2024-09-11T23:16:00.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2d959a640 1 -- 172.21.15.94:0/748640146 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d00ab600 con 0x7fc2dc0aee70 2024-09-11T23:16:00.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2d959a640 1 -- 172.21.15.94:0/748640146 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00ab9d0 con 0x7fc2dc0aee70 2024-09-11T23:16:00.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- 172.21.15.94:0/748640146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc0aee70 msgr2=0x7fc2dc15f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/748640146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc0aee70 0x7fc2dc15f320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009870 tx=0x7fc2d001c520 comp rx=0 tx=0).stop 2024-09-11T23:16:00.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- 172.21.15.94:0/748640146 shutdown_connections 2024-09-11T23:16:00.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/748640146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc0aee70 0x7fc2dc15f320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- 172.21.15.94:0/748640146 >> 172.21.15.94:0/748640146 conn(0x7fc2dc0736d0 msgr2=0x7fc2dc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:00.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- 172.21.15.94:0/748640146 shutdown_connections 2024-09-11T23:16:00.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- 172.21.15.94:0/748640146 wait complete. 2024-09-11T23:16:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 Processor -- start 2024-09-11T23:16:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- start start 2024-09-11T23:16:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0adad0 0x7fc2dc157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc155450 0x7fc2dc0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc14d820 0x7fc2dc0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc0b03a0 con 0x7fc2dc14d820 2024-09-11T23:16:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc0b0520 con 0x7fc2dc0adad0 2024-09-11T23:16:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.255+0000 7fc2e0d29640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc16ca50 con 0x7fc2dc155450 2024-09-11T23:16:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc14d820 0x7fc2dc0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc14d820 0x7fc2dc0b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36550/0 (socket says 172.21.15.94:36550) 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 -- 172.21.15.94:0/2036759625 learned_addr learned my addr 172.21.15.94:0/2036759625 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2da59c640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0adad0 0x7fc2dc157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2d9d9b640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc155450 0x7fc2dc0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 -- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc155450 msgr2=0x7fc2dc0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc155450 0x7fc2dc0b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 -- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0adad0 msgr2=0x7fc2dc157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0adad0 0x7fc2dc157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 -- 172.21.15.94:0/2036759625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc15e8b0 con 0x7fc2dc14d820 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2d9d9b640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc155450 0x7fc2dc0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:00.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2dad9d640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc14d820 0x7fc2dc0b2200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b9a0 tx=0x7fc2d400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2caffd640 1 -- 172.21.15.94:0/2036759625 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4019070 con 0x7fc2dc14d820 2024-09-11T23:16:00.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2caffd640 1 -- 172.21.15.94:0/2036759625 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d400cba0 con 0x7fc2dc14d820 2024-09-11T23:16:00.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc152740 con 0x7fc2dc14d820 2024-09-11T23:16:00.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2caffd640 1 -- 172.21.15.94:0/2036759625 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4014440 con 0x7fc2dc14d820 2024-09-11T23:16:00.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc152d00 con 0x7fc2dc14d820 2024-09-11T23:16:00.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc15f320 con 0x7fc2dc14d820 2024-09-11T23:16:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2caffd640 1 -- 172.21.15.94:0/2036759625 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc2d401c070 con 0x7fc2dc14d820 2024-09-11T23:16:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2caffd640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2bc0678c0 0x7fc2bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2caffd640 1 -- 172.21.15.94:0/2036759625 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc2d4085cc0 con 0x7fc2dc14d820 2024-09-11T23:16:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2da59c640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2bc0678c0 0x7fc2bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.259+0000 7fc2da59c640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2bc0678c0 0x7fc2bc069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc001810 tx=0x7fc2cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.263+0000 7fc2caffd640 1 -- 172.21.15.94:0/2036759625 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc2d4055d00 con 0x7fc2dc14d820 2024-09-11T23:16:00.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.423+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2dc1620f0 con 0x7fc2dc14d820 2024-09-11T23:16:00.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.423+0000 7fc2caffd640 1 -- 172.21.15.94:0/2036759625 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc2d405a000 con 0x7fc2dc14d820 2024-09-11T23:16:00.427 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2bc0678c0 msgr2=0x7fc2bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2bc0678c0 0x7fc2bc069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc001810 tx=0x7fc2cc009040 comp rx=0 tx=0).stop 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc14d820 msgr2=0x7fc2dc0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc14d820 0x7fc2dc0b2200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b9a0 tx=0x7fc2d400be60 comp rx=0 tx=0).stop 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 shutdown_connections 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2bc0678c0 0x7fc2bc069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2dc14d820 0x7fc2dc0b2200 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc155450 0x7fc2dc0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 --2- 172.21.15.94:0/2036759625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0adad0 0x7fc2dc157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 >> 172.21.15.94:0/2036759625 conn(0x7fc2dc0736d0 msgr2=0x7fc2dc14e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 shutdown_connections 2024-09-11T23:16:00.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.427+0000 7fc2e0d29640 1 -- 172.21.15.94:0/2036759625 wait complete. 2024-09-11T23:16:00.445 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:16:00.445 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:00.451 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:16:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 Processor -- start 2024-09-11T23:16:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 -- start start 2024-09-11T23:16:00.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27301520a0 0x7f273006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273006fe50 0x7f273015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f273015f1d0 0x7f2730071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2730152480 con 0x7f273015f1d0 2024-09-11T23:16:00.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2730070250 con 0x7f27301520a0 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2737693640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27300aede0 con 0x7f273006fe50 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f273015f1d0 0x7f2730071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f273015f1d0 0x7f2730071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36558/0 (socket says 172.21.15.94:36558) 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 -- 172.21.15.94:0/1521344623 learned_addr learned my addr 172.21.15.94:0/1521344623 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2734c2e640 1 --2- 172.21.15.94:0/1521344623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273006fe50 0x7f273015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f273542f640 1 --2- 172.21.15.94:0/1521344623 >> v2:172.21.15.155:3300/0 conn(0x7f27301520a0 0x7f273006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 -- 172.21.15.94:0/1521344623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273006fe50 msgr2=0x7f273015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 --2- 172.21.15.94:0/1521344623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273006fe50 0x7f273015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 -- 172.21.15.94:0/1521344623 >> v2:172.21.15.155:3300/0 conn(0x7f27301520a0 msgr2=0x7f273006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 --2- 172.21.15.94:0/1521344623 >> v2:172.21.15.155:3300/0 conn(0x7f27301520a0 0x7f273006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.571+0000 7f2735c30640 1 -- 172.21.15.94:0/1521344623 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273015fa10 con 0x7f273015f1d0 2024-09-11T23:16:00.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2735c30640 1 --2- 172.21.15.94:0/1521344623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273015f1d0 0x7f2730071f10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2730071710 tx=0x7f272801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fc846860c07541 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2727fff640 1 -- 172.21.15.94:0/1521344623 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5590 con 0x7f273015f1d0 2024-09-11T23:16:00.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2727fff640 1 -- 172.21.15.94:0/1521344623 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27280a5730 con 0x7f273015f1d0 2024-09-11T23:16:00.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2727fff640 1 -- 172.21.15.94:0/1521344623 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5b00 con 0x7f273015f1d0 2024-09-11T23:16:00.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- 172.21.15.94:0/1521344623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273015f1d0 msgr2=0x7f2730071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 --2- 172.21.15.94:0/1521344623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273015f1d0 0x7f2730071f10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2730071710 tx=0x7f272801c710 comp rx=0 tx=0).stop 2024-09-11T23:16:00.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- 172.21.15.94:0/1521344623 shutdown_connections 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 --2- 172.21.15.94:0/1521344623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273015f1d0 0x7f2730071f10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 --2- 172.21.15.94:0/1521344623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273006fe50 0x7f273015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 --2- 172.21.15.94:0/1521344623 >> v2:172.21.15.155:3300/0 conn(0x7f27301520a0 0x7f273006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- 172.21.15.94:0/1521344623 >> 172.21.15.94:0/1521344623 conn(0x7f27300b1f90 msgr2=0x7f27300b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- 172.21.15.94:0/1521344623 shutdown_connections 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- 172.21.15.94:0/1521344623 wait complete. 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 Processor -- start 2024-09-11T23:16:00.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- start start 2024-09-11T23:16:00.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273006fe50 0x7f2730148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27301520a0 0x7f27300cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f1d0 0x7f273014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2730073d30 con 0x7f273006fe50 2024-09-11T23:16:00.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2730073a50 con 0x7f27301520a0 2024-09-11T23:16:00.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.575+0000 7f2737693640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f273015f680 con 0x7f273015f1d0 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273006fe50 0x7f2730148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273006fe50 0x7f2730148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36564/0 (socket says 172.21.15.94:36564) 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 -- 172.21.15.94:0/3265003472 learned_addr learned my addr 172.21.15.94:0/3265003472 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2734c2e640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27301520a0 0x7f27300cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2735c30640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f1d0 0x7f273014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 -- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f1d0 msgr2=0x7f273014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f1d0 0x7f273014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 -- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27301520a0 msgr2=0x7f27300cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27301520a0 0x7f27300cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 -- 172.21.15.94:0/3265003472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27300ccd50 con 0x7f273006fe50 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f273542f640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273006fe50 0x7f2730148c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f272c00d800 tx=0x7f272c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2725ffb640 1 -- 172.21.15.94:0/3265003472 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c00b6c0 con 0x7f273006fe50 2024-09-11T23:16:00.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2725ffb640 1 -- 172.21.15.94:0/3265003472 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c019070 con 0x7f273006fe50 2024-09-11T23:16:00.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2725ffb640 1 -- 172.21.15.94:0/3265003472 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c00ba60 con 0x7f273006fe50 2024-09-11T23:16:00.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27300cd030 con 0x7f273006fe50 2024-09-11T23:16:00.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27300cd5f0 con 0x7f273006fe50 2024-09-11T23:16:00.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273006f910 con 0x7f273006fe50 2024-09-11T23:16:00.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2725ffb640 1 -- 172.21.15.94:0/3265003472 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f272c00bc00 con 0x7f273006fe50 2024-09-11T23:16:00.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2725ffb640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678c0 0x7f2714069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2725ffb640 1 -- 172.21.15.94:0/3265003472 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f272c0864f0 con 0x7f273006fe50 2024-09-11T23:16:00.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2734c2e640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678c0 0x7f2714069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.579+0000 7f2734c2e640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678c0 0x7f2714069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f273015e2c0 tx=0x7f2720008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.583+0000 7f2725ffb640 1 -- 172.21.15.94:0/3265003472 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f272c056c10 con 0x7f273006fe50 2024-09-11T23:16:00.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.743+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f273006e540 con 0x7f273006fe50 2024-09-11T23:16:00.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2725ffb640 1 -- 172.21.15.94:0/3265003472 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f272c056510 con 0x7f273006fe50 2024-09-11T23:16:00.750 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:16:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678c0 msgr2=0x7f2714069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678c0 0x7f2714069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f273015e2c0 tx=0x7f2720008040 comp rx=0 tx=0).stop 2024-09-11T23:16:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273006fe50 msgr2=0x7f2730148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273006fe50 0x7f2730148c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f272c00d800 tx=0x7f272c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 shutdown_connections 2024-09-11T23:16:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f1d0 0x7f273014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27301520a0 0x7f27300cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27140678c0 0x7f2714069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 --2- 172.21.15.94:0/3265003472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273006fe50 0x7f2730148c70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 >> 172.21.15.94:0/3265003472 conn(0x7f27300b1f90 msgr2=0x7f27300ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 shutdown_connections 2024-09-11T23:16:00.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.747+0000 7f2737693640 1 -- 172.21.15.94:0/3265003472 wait complete. 2024-09-11T23:16:00.769 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-09-11T23:16:00.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:00.770 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-11T23:16:00.785 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:00.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:16:00.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:00.786 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:16:00.833 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:16:00.836 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:00.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4eecd96640 1 Processor -- start 2024-09-11T23:16:00.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4eecd96640 1 -- start start 2024-09-11T23:16:00.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4eecd96640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4ee815b5a0 0x7f4ee815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4eecd96640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4ee80b4e50 0x7f4ee80b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4eecd96640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee815c040 con 0x7f4ee80ce0a0 2024-09-11T23:16:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4eecd96640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee80cfe00 con 0x7f4ee80b4e50 2024-09-11T23:16:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4eecd96640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee815c320 con 0x7f4ee815b5a0 2024-09-11T23:16:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee6d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4ee80b4e50 0x7f4ee80b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee6d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4ee80b4e50 0x7f4ee80b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36580/0 (socket says 172.21.15.94:36580) 2024-09-11T23:16:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/1001852788 learned_addr learned my addr 172.21.15.94:0/1001852788 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee5d9b640 1 --2- 172.21.15.94:0/1001852788 >> v2:172.21.15.155:3300/0 conn(0x7f4ee815b5a0 0x7f4ee815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/1001852788 >> v2:172.21.15.155:3300/0 conn(0x7f4ee815b5a0 msgr2=0x7f4ee815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee6d9d640 1 --2- 172.21.15.94:0/1001852788 >> v2:172.21.15.155:3300/0 conn(0x7f4ee815b5a0 0x7f4ee815ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/1001852788 >> v1:172.21.15.155:6789/0 conn(0x7f4ee80ce0a0 legacy=0x7f4ee80d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.959+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/1001852788 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee80cfa90 con 0x7f4ee80b4e50 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4ee6d9d640 1 --2- 172.21.15.94:0/1001852788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee80b4e50 0x7f4ee80b52e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009e50 tx=0x7f4ee001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edbf53e7a154777 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4ee559a640 1 -- 172.21.15.94:0/1001852788 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00a5670 con 0x7f4ee80b4e50 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4ee559a640 1 -- 172.21.15.94:0/1001852788 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee00a5810 con 0x7f4ee80b4e50 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4ee559a640 1 -- 172.21.15.94:0/1001852788 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00a5be0 con 0x7f4ee80b4e50 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- 172.21.15.94:0/1001852788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee80b4e50 msgr2=0x7f4ee80b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 --2- 172.21.15.94:0/1001852788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee80b4e50 0x7f4ee80b52e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009e50 tx=0x7f4ee001c9b0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- 172.21.15.94:0/1001852788 shutdown_connections 2024-09-11T23:16:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 --2- 172.21.15.94:0/1001852788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee80b4e50 0x7f4ee80b52e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 --2- 172.21.15.94:0/1001852788 >> v2:172.21.15.155:3300/0 conn(0x7f4ee815b5a0 0x7f4ee815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- 172.21.15.94:0/1001852788 >> 172.21.15.94:0/1001852788 conn(0x7f4ee8073580 msgr2=0x7f4ee806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:00.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- 172.21.15.94:0/1001852788 shutdown_connections 2024-09-11T23:16:00.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- 172.21.15.94:0/1001852788 wait complete. 2024-09-11T23:16:00.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 Processor -- start 2024-09-11T23:16:00.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- start start 2024-09-11T23:16:00.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ee80b4e50 0x7f4ee813bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ee80ce0a0 0x7f4ee813c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee815b5a0 0x7f4ee813e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee815d1a0 con 0x7f4ee815b5a0 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee815d020 con 0x7f4ee80b4e50 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4eecd96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee8167ce0 con 0x7f4ee80ce0a0 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4ee6d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee815b5a0 0x7f4ee813e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4ee6d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee815b5a0 0x7f4ee813e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36588/0 (socket says 172.21.15.94:36588) 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.963+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/2341310815 learned_addr learned my addr 172.21.15.94:0/2341310815 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee659c640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ee80b4e50 0x7f4ee813bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee5d9b640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ee80ce0a0 0x7f4ee813c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ee80ce0a0 msgr2=0x7f4ee813c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee6d9d640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ee80ce0a0 0x7f4ee813c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ee80b4e50 msgr2=0x7f4ee813bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee6d9d640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ee80b4e50 0x7f4ee813bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee6d9d640 1 -- 172.21.15.94:0/2341310815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee806d1c0 con 0x7f4ee815b5a0 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee659c640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ee80b4e50 0x7f4ee813bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:00.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee6d9d640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee815b5a0 0x7f4ee813e290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00af040 tx=0x7f4ee0019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ed6ffd640 1 -- 172.21.15.94:0/2341310815 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0009510 con 0x7f4ee815b5a0 2024-09-11T23:16:00.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ed6ffd640 1 -- 172.21.15.94:0/2341310815 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee00be070 con 0x7f4ee815b5a0 2024-09-11T23:16:00.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee8158c60 con 0x7f4ee815b5a0 2024-09-11T23:16:00.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ed6ffd640 1 -- 172.21.15.94:0/2341310815 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00b88d0 con 0x7f4ee815b5a0 2024-09-11T23:16:00.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee81586a0 con 0x7f4ee815b5a0 2024-09-11T23:16:00.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee80b52e0 con 0x7f4ee815b5a0 2024-09-11T23:16:00.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ed6ffd640 1 -- 172.21.15.94:0/2341310815 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ee00b8a70 con 0x7f4ee815b5a0 2024-09-11T23:16:00.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ed6ffd640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4ec80678c0 0x7f4ec8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:00.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ed6ffd640 1 -- 172.21.15.94:0/2341310815 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f4ee0121080 con 0x7f4ee815b5a0 2024-09-11T23:16:00.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee659c640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4ec80678c0 0x7f4ec8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:00.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.967+0000 7f4ee659c640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4ec80678c0 0x7f4ec8069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ee815bdc0 tx=0x7f4ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:00.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:00.971+0000 7f4ed6ffd640 1 -- 172.21.15.94:0/2341310815 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ee806d1c0 con 0x7f4ee815b5a0 2024-09-11T23:16:01.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.167+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ee8070d00 con 0x7f4ee815b5a0 2024-09-11T23:16:01.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4ed6ffd640 1 -- 172.21.15.94:0/2341310815 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f4ee00165a0 con 0x7f4ee815b5a0 2024-09-11T23:16:01.174 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:01.174 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:16:01.175 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:16:01.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4ec80678c0 msgr2=0x7f4ec8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4ec80678c0 0x7f4ec8069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ee815bdc0 tx=0x7f4ed8009040 comp rx=0 tx=0).stop 2024-09-11T23:16:01.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee815b5a0 msgr2=0x7f4ee813e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee815b5a0 0x7f4ee813e290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00af040 tx=0x7f4ee0019750 comp rx=0 tx=0).stop 2024-09-11T23:16:01.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 shutdown_connections 2024-09-11T23:16:01.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4ec80678c0 0x7f4ec8069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ee815b5a0 0x7f4ee813e290 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ee80ce0a0 0x7f4ee813c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 --2- 172.21.15.94:0/2341310815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ee80b4e50 0x7f4ee813bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 >> 172.21.15.94:0/2341310815 conn(0x7f4ee8073580 msgr2=0x7f4ee815f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:01.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 shutdown_connections 2024-09-11T23:16:01.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.171+0000 7f4eecd96640 1 -- 172.21.15.94:0/2341310815 wait complete. 2024-09-11T23:16:01.193 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:01.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f2601240640 1 Processor -- start 2024-09-11T23:16:01.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f2601240640 1 -- start start 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f2601240640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25fc0d3060 0x7f25fc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f2601240640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25fc0d0300 con 0x7f25fc161a60 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f2601240640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25fc0b0f60 con 0x7f25fc0cf450 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f2601240640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f25fc0cfd40 con 0x7f25fc0d3060 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f25fc161a60 0x7f25fc0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45328/0 (socket says 172.21.15.94:45328) 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 -- 172.21.15.94:0/2433575335 learned_addr learned my addr 172.21.15.94:0/2433575335 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327542217 0 0) 0x7f25ec0014a0 con 0x7f25fc161a60 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fa59c640 1 --2- 172.21.15.94:0/2433575335 >> v2:172.21.15.155:3300/0 conn(0x7f25fc0d3060 0x7f25fc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25e4003530 con 0x7f25fc161a60 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2860091051 0 0) 0x7f25e4003530 con 0x7f25fc161a60 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 >> v2:172.21.15.155:3300/0 conn(0x7f25fc0d3060 msgr2=0x7f25fc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 --2- 172.21.15.94:0/2433575335 >> v2:172.21.15.155:3300/0 conn(0x7f25fc0d3060 0x7f25fc0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 >> v1:172.21.15.155:6789/0 conn(0x7f25fc0cf450 legacy=0x7f25fc06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc0d0020 con 0x7f25fc161a60 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f25ec001bd0 con 0x7f25fc161a60 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 >> v1:172.21.15.94:6789/0 conn(0x7f25fc161a60 legacy=0x7f25fc0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25e40039c0 0x7f25e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e4004810 0x7f25e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40051d0 0x7f25e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc0cfd40 con 0x7f25e40039c0 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f25e400c170 con 0x7f25e4004810 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25e400c370 con 0x7f25e40051d0 2024-09-11T23:16:01.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25e40039c0 0x7f25e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 -- 172.21.15.94:0/2433575335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40051d0 msgr2=0x7f25e400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40051d0 0x7f25e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 -- 172.21.15.94:0/2433575335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e4004810 msgr2=0x7f25e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e4004810 0x7f25e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fad9d640 1 -- 172.21.15.94:0/2433575335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e4003530 con 0x7f25e40039c0 2024-09-11T23:16:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.303+0000 7f25fb59e640 1 -- 172.21.15.94:0/2433575335 reap_dead start 2024-09-11T23:16:01.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f25fad9d640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25e40039c0 0x7f25e4003de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00aa30 tx=0x7f25ec01d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc8b867b2639acd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00a650 con 0x7f25e40039c0 2024-09-11T23:16:01.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ec0ad650 con 0x7f25e40039c0 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f25f9d9b640 1 -- 172.21.15.94:0/2433575335 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0ada80 con 0x7f25e40039c0 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 -- 172.21.15.94:0/2433575335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25e40039c0 msgr2=0x7f25e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25e40039c0 0x7f25e4003de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00aa30 tx=0x7f25ec01d350 comp rx=0 tx=0).stop 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 -- 172.21.15.94:0/2433575335 shutdown_connections 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 --2- 172.21.15.94:0/2433575335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25e40039c0 0x7f25e4003de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 -- 172.21.15.94:0/2433575335 >> 172.21.15.94:0/2433575335 conn(0x7f25fc08bf90 msgr2=0x7f25fc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 -- 172.21.15.94:0/2433575335 shutdown_connections 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 -- 172.21.15.94:0/2433575335 wait complete. 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 Processor -- start 2024-09-11T23:16:01.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.307+0000 7f2601240640 1 -- start start 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40039c0 0x7f25fc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25fc1592a0 0x7f25fc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25fc159720 0x7f25fc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc0d2ce0 con 0x7f25fc1592a0 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc0d2b60 con 0x7f25fc159720 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25fc0d2e60 con 0x7f25e40039c0 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25fc1592a0 0x7f25fc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25fc1592a0 0x7f25fc0b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36594/0 (socket says 172.21.15.94:36594) 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 -- 172.21.15.94:0/1426020485 learned_addr learned my addr 172.21.15.94:0/1426020485 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fb59e640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25fc159720 0x7f25fc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fad9d640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40039c0 0x7f25fc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 -- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40039c0 msgr2=0x7f25fc157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40039c0 0x7f25fc157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 -- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25fc159720 msgr2=0x7f25fc0b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25fc159720 0x7f25fc0b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 -- 172.21.15.94:0/1426020485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc15a930 con 0x7f25fc1592a0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fa59c640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25fc1592a0 0x7f25fc0b49f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e870 tx=0x7f25f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25e37fe640 1 -- 172.21.15.94:0/1426020485 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0017070 con 0x7f25fc1592a0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25e37fe640 1 -- 172.21.15.94:0/1426020485 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f000c940 con 0x7f25fc1592a0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc15ac10 con 0x7f25fc1592a0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25e37fe640 1 -- 172.21.15.94:0/1426020485 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f000cd30 con 0x7f25fc1592a0 2024-09-11T23:16:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc15c0f0 con 0x7f25fc1592a0 2024-09-11T23:16:01.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc0d1220 con 0x7f25fc1592a0 2024-09-11T23:16:01.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25e37fe640 1 -- 172.21.15.94:0/1426020485 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25f001a070 con 0x7f25fc1592a0 2024-09-11T23:16:01.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25e37fe640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f25e80678c0 0x7f25e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25e37fe640 1 -- 172.21.15.94:0/1426020485 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f25f00862c0 con 0x7f25fc1592a0 2024-09-11T23:16:01.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.311+0000 7f25fad9d640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f25e80678c0 0x7f25e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.315+0000 7f25fad9d640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f25e80678c0 0x7f25e8069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ad000 tx=0x7f25ec0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.315+0000 7f25e37fe640 1 -- 172.21.15.94:0/1426020485 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f25f00569f0 con 0x7f25fc1592a0 2024-09-11T23:16:01.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.511+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25fc162a30 con 0x7f25fc1592a0 2024-09-11T23:16:01.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f25e37fe640 1 -- 172.21.15.94:0/1426020485 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f25f00562f0 con 0x7f25fc1592a0 2024-09-11T23:16:01.517 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:01.517 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:16:01.517 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:16:01.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f25e80678c0 msgr2=0x7f25e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f25e80678c0 0x7f25e8069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ad000 tx=0x7f25ec0a7000 comp rx=0 tx=0).stop 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25fc1592a0 msgr2=0x7f25fc0b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25fc1592a0 0x7f25fc0b49f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e870 tx=0x7f25f000ed30 comp rx=0 tx=0).stop 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 shutdown_connections 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25fc159720 0x7f25fc0b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f25e80678c0 0x7f25e8069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25fc1592a0 0x7f25fc0b49f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 --2- 172.21.15.94:0/1426020485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40039c0 0x7f25fc157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 >> 172.21.15.94:0/1426020485 conn(0x7f25fc08bf90 msgr2=0x7f25fc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 shutdown_connections 2024-09-11T23:16:01.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.515+0000 7f2601240640 1 -- 172.21.15.94:0/1426020485 wait complete. 2024-09-11T23:16:01.537 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:01.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f1954fdb640 1 Processor -- start 2024-09-11T23:16:01.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f1954fdb640 1 -- start start 2024-09-11T23:16:01.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f1954fdb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f195015d090 0x7f19500b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f1954fdb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f195015fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f1954fdb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19501533f0 con 0x7f1950153010 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f1954fdb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f195015d4e0 con 0x7f195015d090 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f1954fdb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19500b3c00 con 0x7f19500b37c0 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194dd9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f195015d090 0x7f19500b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194dd9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f195015d090 0x7f19500b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36600/0 (socket says 172.21.15.94:36600) 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194dd9b640 1 -- 172.21.15.94:0/565212770 learned_addr learned my addr 172.21.15.94:0/565212770 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194ed9d640 1 --2- 172.21.15.94:0/565212770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f195015fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194dd9b640 1 -- 172.21.15.94:0/565212770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 msgr2=0x7f195015fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194dd9b640 1 --2- 172.21.15.94:0/565212770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f195015fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194dd9b640 1 -- 172.21.15.94:0/565212770 >> v1:172.21.15.94:6789/0 conn(0x7f1950153010 legacy=0x7f1950072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.655+0000 7f194dd9b640 1 -- 172.21.15.94:0/565212770 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1950073850 con 0x7f195015d090 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194dd9b640 1 --2- 172.21.15.94:0/565212770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f19500b3280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1944009870 tx=0x7f194401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c416840435cc1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194d59a640 1 -- 172.21.15.94:0/565212770 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440ab650 con 0x7f195015d090 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194d59a640 1 -- 172.21.15.94:0/565212770 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19440b0070 con 0x7f195015d090 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194d59a640 1 -- 172.21.15.94:0/565212770 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440aba10 con 0x7f195015d090 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- 172.21.15.94:0/565212770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 msgr2=0x7f19500b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 --2- 172.21.15.94:0/565212770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f19500b3280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1944009870 tx=0x7f194401c560 comp rx=0 tx=0).stop 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- 172.21.15.94:0/565212770 shutdown_connections 2024-09-11T23:16:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 --2- 172.21.15.94:0/565212770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f195015fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 --2- 172.21.15.94:0/565212770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f19500b3280 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- 172.21.15.94:0/565212770 >> 172.21.15.94:0/565212770 conn(0x7f19500b6870 msgr2=0x7f19500b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- 172.21.15.94:0/565212770 shutdown_connections 2024-09-11T23:16:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- 172.21.15.94:0/565212770 wait complete. 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 Processor -- start 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- start start 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f19500c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1950153010 0x7f195014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f195014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f195006fe00 con 0x7f195015d090 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f195015c540 con 0x7f1950153010 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19500734e0 con 0x7f19500b37c0 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f195014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f195014e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36606/0 (socket says 172.21.15.94:36606) 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 -- 172.21.15.94:0/921253070 learned_addr learned my addr 172.21.15.94:0/921253070 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194e59c640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f19500c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194dd9b640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1950153010 0x7f195014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 -- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 msgr2=0x7f19500c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f19500c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 -- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1950153010 msgr2=0x7f195014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1950153010 0x7f195014d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 -- 172.21.15.94:0/921253070 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19500cd770 con 0x7f195015d090 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f194ed9d640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f195014e5f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f194800cc30 tx=0x7f194800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f193effd640 1 -- 172.21.15.94:0/921253070 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194800ce40 con 0x7f195015d090 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f193effd640 1 -- 172.21.15.94:0/921253070 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19480039a0 con 0x7f195015d090 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19500c6890 con 0x7f195015d090 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f193effd640 1 -- 172.21.15.94:0/921253070 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948003d50 con 0x7f195015d090 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.659+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1950163910 con 0x7f195015d090 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.663+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195015fb30 con 0x7f195015d090 2024-09-11T23:16:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.663+0000 7f193effd640 1 -- 172.21.15.94:0/921253070 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1948003f50 con 0x7f195015d090 2024-09-11T23:16:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.663+0000 7f193effd640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19300678c0 0x7f1930069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.663+0000 7f193effd640 1 -- 172.21.15.94:0/921253070 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f19480864d0 con 0x7f195015d090 2024-09-11T23:16:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.663+0000 7f194e59c640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19300678c0 0x7f1930069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.663+0000 7f194e59c640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19300678c0 0x7f1930069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1940007fd0 tx=0x7f1940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.667+0000 7f193effd640 1 -- 172.21.15.94:0/921253070 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1948014030 con 0x7f195015d090 2024-09-11T23:16:01.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.815+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19500b6df0 con 0x7f195015d090 2024-09-11T23:16:01.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f193effd640 1 -- 172.21.15.94:0/921253070 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19058 (secure 0 0 0) 0x7f1948056c80 con 0x7f195015d090 2024-09-11T23:16:01.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:01.823 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":27,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:55.160219+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:01.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19300678c0 msgr2=0x7f1930069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19300678c0 0x7f1930069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1940007fd0 tx=0x7f1940009040 comp rx=0 tx=0).stop 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 msgr2=0x7f195014e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f195014e5f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f194800cc30 tx=0x7f194800a5c0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 shutdown_connections 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19300678c0 0x7f1930069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f195015d090 0x7f195014e5f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1950153010 0x7f195014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 --2- 172.21.15.94:0/921253070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19500b37c0 0x7f19500c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 >> 172.21.15.94:0/921253070 conn(0x7f19500b6870 msgr2=0x7f19500b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 shutdown_connections 2024-09-11T23:16:01.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.819+0000 7f1954fdb640 1 -- 172.21.15.94:0/921253070 wait complete. 2024-09-11T23:16:01.841 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:16:01.841 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:01.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.947+0000 7fa44b181640 1 Processor -- start 2024-09-11T23:16:01.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.947+0000 7fa44b181640 1 -- start start 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44b181640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 0x7fa44409ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44b181640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa44409b040 0x7fa4440af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44b181640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4440afd80 con 0x7fa4440b0e20 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44b181640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa4440b0060 con 0x7fa44409b040 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44b181640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4440b0340 con 0x7fa44409ac60 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa4440b0e20 0x7fa4440b1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45348/0 (socket says 172.21.15.94:45348) 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 -- 172.21.15.94:0/1249106562 learned_addr learned my addr 172.21.15.94:0/1249106562 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:01.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa448f1d640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 0x7fa44409ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa443fff640 1 --2- 172.21.15.94:0/1249106562 >> v2:172.21.15.155:3300/0 conn(0x7fa44409b040 0x7fa4440af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465417662 0 0) 0x7fa4440afd80 con 0x7fa4440b0e20 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa434003530 con 0x7fa4440b0e20 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1596065543 0 0) 0x7fa434003530 con 0x7fa4440b0e20 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 msgr2=0x7fa44409ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 0x7fa44409ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 >> v2:172.21.15.155:3300/0 conn(0x7fa44409b040 msgr2=0x7fa4440af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 --2- 172.21.15.94:0/1249106562 >> v2:172.21.15.155:3300/0 conn(0x7fa44409b040 0x7fa4440af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4440b0620 con 0x7fa4440b0e20 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fa43c001a00 con 0x7fa4440b0e20 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 >> v1:172.21.15.94:6789/0 conn(0x7fa4440b0e20 legacy=0x7fa4440b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4340039c0 0x7fa434003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 0x7fa434004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa434004d50 0x7fa4340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440b0060 con 0x7fa434004d50 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440b0340 con 0x7fa4340039c0 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa43400ba50 con 0x7fa44409ac60 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa434004d50 0x7fa4340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa448f1d640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4340039c0 0x7fa434003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 -- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 msgr2=0x7fa434004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa443fff640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 0x7fa434004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa44409ac60 0x7fa434004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 -- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4340039c0 msgr2=0x7fa434003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4340039c0 0x7fa434003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 -- 172.21.15.94:0/1249106562 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa434003530 con 0x7fa434004d50 2024-09-11T23:16:01.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa448f1d640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4340039c0 0x7fa434003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.951+0000 7fa44971e640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa434004d50 0x7fa4340051d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0013e0 tx=0x7fa43c01ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faf737f90d25591 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00a4e0 con 0x7fa434004d50 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43c0072f0 con 0x7fa434004d50 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa4437fe640 1 -- 172.21.15.94:0/1249106562 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0076e0 con 0x7fa434004d50 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- 172.21.15.94:0/1249106562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa434004d50 msgr2=0x7fa4340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 --2- 172.21.15.94:0/1249106562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa434004d50 0x7fa4340051d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0013e0 tx=0x7fa43c01ddd0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44971e640 1 -- 172.21.15.94:0/1249106562 reap_dead start 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- 172.21.15.94:0/1249106562 shutdown_connections 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- 172.21.15.94:0/1249106562 >> 172.21.15.94:0/1249106562 conn(0x7fa4440b78d0 msgr2=0x7fa4440b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- 172.21.15.94:0/1249106562 shutdown_connections 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- 172.21.15.94:0/1249106562 wait complete. 2024-09-11T23:16:01.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 Processor -- start 2024-09-11T23:16:01.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- start start 2024-09-11T23:16:01.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa444151660 0x7fa444152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa444151a40 0x7fa44415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa444152d90 0x7fa44415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440b2690 con 0x7fa444151a40 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440b2510 con 0x7fa444151660 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44b181640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa44415d010 con 0x7fa444152d90 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa444151a40 0x7fa44415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa444151a40 0x7fa44415ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36620/0 (socket says 172.21.15.94:36620) 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 -- 172.21.15.94:0/1508195631 learned_addr learned my addr 172.21.15.94:0/1508195631 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa448f1d640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa444151660 0x7fa444152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 -- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa444152d90 msgr2=0x7fa44415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa44971e640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa444152d90 0x7fa44415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa444152d90 0x7fa44415f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 -- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa444151660 msgr2=0x7fa444152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa444151660 0x7fa444152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa443fff640 1 -- 172.21.15.94:0/1508195631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa444153330 con 0x7fa444151a40 2024-09-11T23:16:01.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.955+0000 7fa448f1d640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa444151660 0x7fa444152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:01.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa443fff640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa444151a40 0x7fa44415ec10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa4300108d0 tx=0x7fa430010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa4417fa640 1 -- 172.21.15.94:0/1508195631 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43000f040 con 0x7fa444151a40 2024-09-11T23:16:01.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa4417fa640 1 -- 172.21.15.94:0/1508195631 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43000eb60 con 0x7fa444151a40 2024-09-11T23:16:01.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa444153610 con 0x7fa444151a40 2024-09-11T23:16:01.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa4417fa640 1 -- 172.21.15.94:0/1508195631 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43001c400 con 0x7fa444151a40 2024-09-11T23:16:01.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa444153bd0 con 0x7fa444151a40 2024-09-11T23:16:01.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa44415d4a0 con 0x7fa444151a40 2024-09-11T23:16:01.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa4417fa640 1 -- 172.21.15.94:0/1508195631 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa43001c5a0 con 0x7fa444151a40 2024-09-11T23:16:01.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa4417fa640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4280678c0 0x7fa428069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa4417fa640 1 -- 172.21.15.94:0/1508195631 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fa430086810 con 0x7fa444151a40 2024-09-11T23:16:01.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa448f1d640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4280678c0 0x7fa428069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.959+0000 7fa448f1d640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4280678c0 0x7fa428069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa438009ac0 tx=0x7fa438008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:01.963+0000 7fa4417fa640 1 -- 172.21.15.94:0/1508195631 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa430018030 con 0x7fa444151a40 2024-09-11T23:16:02.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.147+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4440b6870 con 0x7fa444151a40 2024-09-11T23:16:02.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.147+0000 7fa4417fa640 1 -- 172.21.15.94:0/1508195631 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7fa430056f30 con 0x7fa444151a40 2024-09-11T23:16:02.151 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:02.151 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:16:02.151 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4280678c0 msgr2=0x7fa428069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4280678c0 0x7fa428069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa438009ac0 tx=0x7fa438008040 comp rx=0 tx=0).stop 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa444151a40 msgr2=0x7fa44415ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa444151a40 0x7fa44415ec10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa4300108d0 tx=0x7fa430010d90 comp rx=0 tx=0).stop 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 shutdown_connections 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa444152d90 0x7fa44415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa4280678c0 0x7fa428069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa444151a40 0x7fa44415ec10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 --2- 172.21.15.94:0/1508195631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa444151660 0x7fa444152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 >> 172.21.15.94:0/1508195631 conn(0x7fa4440b78d0 msgr2=0x7fa444158900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:02.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 shutdown_connections 2024-09-11T23:16:02.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.151+0000 7fa44b181640 1 -- 172.21.15.94:0/1508195631 wait complete. 2024-09-11T23:16:02.168 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:02.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.271+0000 7f819a273640 1 Processor -- start 2024-09-11T23:16:02.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f819a273640 1 -- start start 2024-09-11T23:16:02.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f819a273640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f819a273640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f81940ce9d0 0x7f81940cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f819a273640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819406d9c0 con 0x7f81940cf920 2024-09-11T23:16:02.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f819a273640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f81940cfd90 con 0x7f819415e5f0 2024-09-11T23:16:02.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f819a273640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f819406dca0 con 0x7f81940ce9d0 2024-09-11T23:16:02.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36636/0 (socket says 172.21.15.94:36636) 2024-09-11T23:16:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 -- 172.21.15.94:0/3900421960 learned_addr learned my addr 172.21.15.94:0/3900421960 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 -- 172.21.15.94:0/3900421960 >> v2:172.21.15.155:3300/0 conn(0x7f81940ce9d0 msgr2=0x7f81940cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f81937fe640 1 --2- 172.21.15.94:0/3900421960 >> v2:172.21.15.155:3300/0 conn(0x7f81940ce9d0 0x7f81940cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 --2- 172.21.15.94:0/3900421960 >> v2:172.21.15.155:3300/0 conn(0x7f81940ce9d0 0x7f81940cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 -- 172.21.15.94:0/3900421960 >> v1:172.21.15.155:6789/0 conn(0x7f81940cf920 legacy=0x7f81940d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 -- 172.21.15.94:0/3900421960 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819406df80 con 0x7f819415e5f0 2024-09-11T23:16:02.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f81937fe640 1 --2- 172.21.15.94:0/3900421960 >> v2:172.21.15.155:3300/0 conn(0x7f81940ce9d0 0x7f81940cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8193fff640 1 --2- 172.21.15.94:0/3900421960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f819415e5f0 0x7f819406d090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f81940ce980 tx=0x7f818c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2af8c1edb98759 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8192ffd640 1 -- 172.21.15.94:0/3900421960 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c0b1070 con 0x7f819415e5f0 2024-09-11T23:16:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8192ffd640 1 -- 172.21.15.94:0/3900421960 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818c0ac640 con 0x7f819415e5f0 2024-09-11T23:16:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.275+0000 7f8192ffd640 1 -- 172.21.15.94:0/3900421960 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c0aca10 con 0x7f819415e5f0 2024-09-11T23:16:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/3900421960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f819415e5f0 msgr2=0x7f819406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 --2- 172.21.15.94:0/3900421960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f819415e5f0 0x7f819406d090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f81940ce980 tx=0x7f818c01c4e0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/3900421960 shutdown_connections 2024-09-11T23:16:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 --2- 172.21.15.94:0/3900421960 >> v2:172.21.15.155:3300/0 conn(0x7f81940ce9d0 0x7f81940cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 --2- 172.21.15.94:0/3900421960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/3900421960 >> 172.21.15.94:0/3900421960 conn(0x7f8194074030 msgr2=0x7f819409d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/3900421960 shutdown_connections 2024-09-11T23:16:02.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/3900421960 wait complete. 2024-09-11T23:16:02.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 Processor -- start 2024-09-11T23:16:02.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- start start 2024-09-11T23:16:02.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81940cf920 0x7f819414dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8194158770 0x7f81940b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819414be60 0x7f8194156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f819416b120 con 0x7f8194158770 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f819416afa0 con 0x7f819414be60 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f819416b2a0 con 0x7f81940cf920 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8194158770 0x7f81940b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8194158770 0x7f81940b9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36650/0 (socket says 172.21.15.94:36650) 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 -- 172.21.15.94:0/962723727 learned_addr learned my addr 172.21.15.94:0/962723727 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f8193fff640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81940cf920 0x7f819414dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f8198810640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819414be60 0x7f8194156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 -- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81940cf920 msgr2=0x7f819414dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81940cf920 0x7f819414dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 -- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819414be60 msgr2=0x7f8194156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819414be60 0x7f8194156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 -- 172.21.15.94:0/962723727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81940b7370 con 0x7f8194158770 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f81937fe640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8194158770 0x7f81940b9b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c820 tx=0x7f817c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f8190ff9640 1 -- 172.21.15.94:0/962723727 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c0079d0 con 0x7f8194158770 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f8190ff9640 1 -- 172.21.15.94:0/962723727 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c007b70 con 0x7f8194158770 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819414d240 con 0x7f8194158770 2024-09-11T23:16:02.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f8190ff9640 1 -- 172.21.15.94:0/962723727 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c0113f0 con 0x7f8194158770 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819414d800 con 0x7f8194158770 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.279+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81940b4160 con 0x7f8194158770 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.283+0000 7f8190ff9640 1 -- 172.21.15.94:0/962723727 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f817c011590 con 0x7f8194158770 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.283+0000 7f8190ff9640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81740678f0 0x7f8174069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.283+0000 7f8190ff9640 1 -- 172.21.15.94:0/962723727 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f817c086170 con 0x7f8194158770 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.283+0000 7f8193fff640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81740678f0 0x7f8174069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.283+0000 7f8193fff640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81740678f0 0x7f8174069db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f818c0ae000 tx=0x7f818c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.287+0000 7f8190ff9640 1 -- 172.21.15.94:0/962723727 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f817c015020 con 0x7f8194158770 2024-09-11T23:16:02.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.475+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81940b3e80 con 0x7f8194158770 2024-09-11T23:16:02.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.475+0000 7f8190ff9640 1 -- 172.21.15.94:0/962723727 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7f817c056890 con 0x7f8194158770 2024-09-11T23:16:02.480 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"btime":"2024-09-11T23:15:34:067712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/247019935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":247019935},{"type":"v1","addr":"172.21.15.155:6836","nonce":247019935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3650711239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3650711239},{"type":"v1","addr":"172.21.15.155:6837","nonce":3650711239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/446599897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":446599897},{"type":"v1","addr":"172.21.15.94:6833","nonce":446599897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:15:13.299318+0000","modified":"2024-09-11T23:15:33.415957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2765753940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2765753940},{"type":"v1","addr":"172.21.15.94:6835","nonce":2765753940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-09-11T23:16:02.480 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-09-11T23:16:02.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81740678f0 msgr2=0x7f8174069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81740678f0 0x7f8174069db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f818c0ae000 tx=0x7f818c008040 comp rx=0 tx=0).stop 2024-09-11T23:16:02.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8194158770 msgr2=0x7f81940b9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8194158770 0x7f81940b9b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c820 tx=0x7f817c00cce0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 shutdown_connections 2024-09-11T23:16:02.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819414be60 0x7f8194156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81740678f0 0x7f8174069db0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8194158770 0x7f81940b9b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 --2- 172.21.15.94:0/962723727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81940cf920 0x7f819414dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 >> 172.21.15.94:0/962723727 conn(0x7f81940ce9d0 msgr2=0x7f81940b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:02.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 shutdown_connections 2024-09-11T23:16:02.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.479+0000 7f819a273640 1 -- 172.21.15.94:0/962723727 wait complete. 2024-09-11T23:16:02.498 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:02.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1f6246640 1 Processor -- start 2024-09-11T23:16:02.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1f6246640 1 -- start start 2024-09-11T23:16:02.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1f6246640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1f00cf800 0x7fa1f00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1f6246640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa1f00b4340 0x7fa1f00d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1f6246640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f00d27a0 con 0x7fa1f01457a0 2024-09-11T23:16:02.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1f6246640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f00b4790 con 0x7fa1f00b4340 2024-09-11T23:16:02.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1f6246640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f00d2a80 con 0x7fa1f00cf800 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1effff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa1f00b4340 0x7fa1f00d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1effff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa1f00b4340 0x7fa1f00d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36666/0 (socket says 172.21.15.94:36666) 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1effff640 1 -- 172.21.15.94:0/344545462 learned_addr learned my addr 172.21.15.94:0/344545462 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1eeffd640 1 --2- 172.21.15.94:0/344545462 >> v2:172.21.15.155:3300/0 conn(0x7fa1f00cf800 0x7fa1f00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1effff640 1 -- 172.21.15.94:0/344545462 >> v2:172.21.15.155:3300/0 conn(0x7fa1f00cf800 msgr2=0x7fa1f00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1effff640 1 --2- 172.21.15.94:0/344545462 >> v2:172.21.15.155:3300/0 conn(0x7fa1f00cf800 0x7fa1f00b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1effff640 1 -- 172.21.15.94:0/344545462 >> v1:172.21.15.155:6789/0 conn(0x7fa1f01457a0 legacy=0x7fa1f00d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.603+0000 7fa1effff640 1 -- 172.21.15.94:0/344545462 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f00d2d60 con 0x7fa1f00b4340 2024-09-11T23:16:02.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1effff640 1 --2- 172.21.15.94:0/344545462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f00d0710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00cfc70 tx=0x7fa1e001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b823365d3f025999 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ee7fc640 1 -- 172.21.15.94:0/344545462 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00a5620 con 0x7fa1f00b4340 2024-09-11T23:16:02.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ee7fc640 1 -- 172.21.15.94:0/344545462 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e00a57c0 con 0x7fa1f00b4340 2024-09-11T23:16:02.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ee7fc640 1 -- 172.21.15.94:0/344545462 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00a5b90 con 0x7fa1f00b4340 2024-09-11T23:16:02.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- 172.21.15.94:0/344545462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 msgr2=0x7fa1f00d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 --2- 172.21.15.94:0/344545462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f00d0710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00cfc70 tx=0x7fa1e001c960 comp rx=0 tx=0).stop 2024-09-11T23:16:02.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- 172.21.15.94:0/344545462 shutdown_connections 2024-09-11T23:16:02.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 --2- 172.21.15.94:0/344545462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f00d0710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 --2- 172.21.15.94:0/344545462 >> v2:172.21.15.155:3300/0 conn(0x7fa1f00cf800 0x7fa1f00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- 172.21.15.94:0/344545462 >> 172.21.15.94:0/344545462 conn(0x7fa1f006bcc0 msgr2=0x7fa1f006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:02.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- 172.21.15.94:0/344545462 shutdown_connections 2024-09-11T23:16:02.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- 172.21.15.94:0/344545462 wait complete. 2024-09-11T23:16:02.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 Processor -- start 2024-09-11T23:16:02.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- start start 2024-09-11T23:16:02.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f0144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1f00cf800 0x7fa1f0164630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f01457a0 0x7fa1f0165ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01690b0 con 0x7fa1f00b4340 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f00d1670 con 0x7fa1f01457a0 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1f6246640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f0169230 con 0x7fa1f00cf800 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f0144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f0144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36676/0 (socket says 172.21.15.94:36676) 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 -- 172.21.15.94:0/2200953156 learned_addr learned my addr 172.21.15.94:0/2200953156 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1effff640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f01457a0 0x7fa1f0165ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 -- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1f00cf800 msgr2=0x7fa1f0164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1f00cf800 0x7fa1f0164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 -- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f01457a0 msgr2=0x7fa1f0165ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f01457a0 0x7fa1f0165ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1ef7fe640 1 -- 172.21.15.94:0/2200953156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f0163590 con 0x7fa1f00b4340 2024-09-11T23:16:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.607+0000 7fa1effff640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f01457a0 0x7fa1f0165ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:02.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1ef7fe640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f0144810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c370 tx=0x7fa1e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1e7fff640 1 -- 172.21.15.94:0/2200953156 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80052d0 con 0x7fa1f00b4340 2024-09-11T23:16:02.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1e7fff640 1 -- 172.21.15.94:0/2200953156 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e8005470 con 0x7fa1f00b4340 2024-09-11T23:16:02.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f0163870 con 0x7fa1f00b4340 2024-09-11T23:16:02.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1e7fff640 1 -- 172.21.15.94:0/2200953156 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8007260 con 0x7fa1f00b4340 2024-09-11T23:16:02.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f0163e30 con 0x7fa1f00b4340 2024-09-11T23:16:02.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f00d0710 con 0x7fa1f00b4340 2024-09-11T23:16:02.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1e7fff640 1 -- 172.21.15.94:0/2200953156 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1e8007400 con 0x7fa1f00b4340 2024-09-11T23:16:02.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1e7fff640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1d00678c0 0x7fa1d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1e7fff640 1 -- 172.21.15.94:0/2200953156 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fa1e80854c0 con 0x7fa1f00b4340 2024-09-11T23:16:02.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1eeffd640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1d00678c0 0x7fa1d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.611+0000 7fa1eeffd640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1d00678c0 0x7fa1d0069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00cf480 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.615+0000 7fa1e7fff640 1 -- 172.21.15.94:0/2200953156 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa1e8055c70 con 0x7fa1f00b4340 2024-09-11T23:16:02.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.775+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1f00b3f30 con 0x7fa1f00b4340 2024-09-11T23:16:02.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.779+0000 7fa1e7fff640 1 -- 172.21.15.94:0/2200953156 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19058 (secure 0 0 0) 0x7fa1e8055570 con 0x7fa1f00b4340 2024-09-11T23:16:02.783 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:02.784 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":27,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:15:55.160219+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:15:11.099857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:15:12.279669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:15:16.026837+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1d00678c0 msgr2=0x7fa1d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1d00678c0 0x7fa1d0069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00cf480 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 msgr2=0x7fa1f0144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f0144810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c370 tx=0x7fa1e800c830 comp rx=0 tx=0).stop 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 shutdown_connections 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f01457a0 0x7fa1f0165ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1f00cf800 0x7fa1f0164630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1d00678c0 0x7fa1d0069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 --2- 172.21.15.94:0/2200953156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1f00b4340 0x7fa1f0144810 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 >> 172.21.15.94:0/2200953156 conn(0x7fa1f006bcc0 msgr2=0x7fa1f006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:02.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 shutdown_connections 2024-09-11T23:16:02.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.783+0000 7fa1f6246640 1 -- 172.21.15.94:0/2200953156 wait complete. 2024-09-11T23:16:02.802 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:16:02.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7621716640 1 Processor -- start 2024-09-11T23:16:02.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7621716640 1 -- start start 2024-09-11T23:16:02.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7621716640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 0x7f761c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7621716640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f761c0b3d50 0x7f761c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7621716640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f761c06ee50 con 0x7f761c073e60 2024-09-11T23:16:02.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7621716640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f761c0b46c0 con 0x7f761c0b3d50 2024-09-11T23:16:02.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7621716640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f761c06f130 con 0x7f761c06fef0 2024-09-11T23:16:02.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761affd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f761c073e60 0x7f761c15b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45362/0 (socket says 172.21.15.94:45362) 2024-09-11T23:16:02.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761affd640 1 -- 172.21.15.94:0/3133312436 learned_addr learned my addr 172.21.15.94:0/3133312436 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761a7fc640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 0x7f761c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828289921 0 0) 0x7f761c06ee50 con 0x7f761c073e60 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7604003530 con 0x7f761c073e60 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761b7fe640 1 --2- 172.21.15.94:0/3133312436 >> v2:172.21.15.155:3300/0 conn(0x7f761c0b3d50 0x7f761c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1495084703 0 0) 0x7f7604003530 con 0x7f761c073e60 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 msgr2=0x7f761c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 0x7f761c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 >> v2:172.21.15.155:3300/0 conn(0x7f761c0b3d50 msgr2=0x7f761c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 --2- 172.21.15.94:0/3133312436 >> v2:172.21.15.155:3300/0 conn(0x7f761c0b3d50 0x7f761c0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c06f410 con 0x7f761c073e60 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f760c001680 con 0x7f761c073e60 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 >> v1:172.21.15.94:6789/0 conn(0x7f761c073e60 legacy=0x7f761c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 0x7f76040039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7604003ff0 0x7f7604004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7604004d50 0x7f76040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f761c0b46c0 con 0x7f7604004d50 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f761c06f130 con 0x7f7604003ff0 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f760400bb90 con 0x7f761c06fef0 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761b7fe640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7604004d50 0x7f76040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761affd640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 0x7f76040039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761a7fc640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7604003ff0 0x7f7604004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761b7fe640 1 -- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 msgr2=0x7f76040039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761b7fe640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 0x7f76040039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761b7fe640 1 -- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7604003ff0 msgr2=0x7f7604004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:02.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761b7fe640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7604003ff0 0x7f7604004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761b7fe640 1 -- 172.21.15.94:0/3133312436 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7604003530 con 0x7f7604004d50 2024-09-11T23:16:02.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.911+0000 7f761affd640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c06fef0 0x7f76040039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f761b7fe640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7604004d50 0x7f76040051d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7614007360 tx=0x7f761401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f7fd6b0c5f54d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76140b2070 con 0x7f7604004d50 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76140a5d80 con 0x7f7604004d50 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7619ffb640 1 -- 172.21.15.94:0/3133312436 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614009be0 con 0x7f7604004d50 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- 172.21.15.94:0/3133312436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7604004d50 msgr2=0x7f76040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 --2- 172.21.15.94:0/3133312436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7604004d50 0x7f76040051d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7614007360 tx=0x7f761401ce80 comp rx=0 tx=0).stop 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f761b7fe640 1 -- 172.21.15.94:0/3133312436 reap_dead start 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- 172.21.15.94:0/3133312436 shutdown_connections 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- 172.21.15.94:0/3133312436 >> 172.21.15.94:0/3133312436 conn(0x7f761c0b1f90 msgr2=0x7f761c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:02.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- 172.21.15.94:0/3133312436 shutdown_connections 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- 172.21.15.94:0/3133312436 wait complete. 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 Processor -- start 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- start start 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f761c098770 0x7f761c098b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c147e40 0x7f761c1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0afeb0 0x7f761c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f761c06df70 con 0x7f761c098770 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f761c074240 con 0x7f761c147e40 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f7621716640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f761c06e0f0 con 0x7f761c0afeb0 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f761affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f761c098770 0x7f761c098b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f761affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f761c098770 0x7f761c098b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36688/0 (socket says 172.21.15.94:36688) 2024-09-11T23:16:02.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.915+0000 7f761affd640 1 -- 172.21.15.94:0/3070527707 learned_addr learned my addr 172.21.15.94:0/3070527707 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761b7fe640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0afeb0 0x7f761c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761a7fc640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c147e40 0x7f761c1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761affd640 1 -- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0afeb0 msgr2=0x7f761c0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761affd640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0afeb0 0x7f761c0b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761affd640 1 -- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c147e40 msgr2=0x7f761c1482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761affd640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c147e40 0x7f761c1482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761affd640 1 -- 172.21.15.94:0/3070527707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c0994d0 con 0x7f761c098770 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761affd640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f761c098770 0x7f761c098b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f760c010c30 tx=0x7f760c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f76037fe640 1 -- 172.21.15.94:0/3070527707 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c01b070 con 0x7f761c098770 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f76037fe640 1 -- 172.21.15.94:0/3070527707 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c011040 con 0x7f761c098770 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f76037fe640 1 -- 172.21.15.94:0/3070527707 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c0145c0 con 0x7f761c098770 2024-09-11T23:16:02.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761c0999f0 con 0x7f761c098770 2024-09-11T23:16:02.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761c099090 con 0x7f761c098770 2024-09-11T23:16:02.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761c06e4b0 con 0x7f761c098770 2024-09-11T23:16:02.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f76037fe640 1 -- 172.21.15.94:0/3070527707 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f760c014760 con 0x7f761c098770 2024-09-11T23:16:02.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f76037fe640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76080678c0 0x7f7608069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:02.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f76037fe640 1 -- 172.21.15.94:0/3070527707 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f760c088d10 con 0x7f761c098770 2024-09-11T23:16:02.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761a7fc640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76080678c0 0x7f7608069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:02.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.919+0000 7f761a7fc640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76080678c0 0x7f7608069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f761c0751c0 tx=0x7f7610008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:02.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:02.923+0000 7f76037fe640 1 -- 172.21.15.94:0/3070527707 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f760c059440 con 0x7f761c098770 2024-09-11T23:16:03.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.103+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f761c15a850 con 0x7f761c098770 2024-09-11T23:16:03.109 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:16:03.107+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:16:03.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.107+0000 7f76037fe640 1 -- 172.21.15.94:0/3070527707 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f760c058d40 con 0x7f761c098770 2024-09-11T23:16:03.111 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:16:03.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76080678c0 msgr2=0x7f7608069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76080678c0 0x7f7608069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f761c0751c0 tx=0x7f7610008040 comp rx=0 tx=0).stop 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f761c098770 msgr2=0x7f761c098b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f761c098770 0x7f761c098b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f760c010c30 tx=0x7f760c00e4d0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 shutdown_connections 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0afeb0 0x7f761c0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c147e40 0x7f761c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76080678c0 0x7f7608069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 --2- 172.21.15.94:0/3070527707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f761c098770 0x7f761c098b50 secure :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f760c010c30 tx=0x7f760c00e4d0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 >> 172.21.15.94:0/3070527707 conn(0x7f761c0b1f90 msgr2=0x7f761c1577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 shutdown_connections 2024-09-11T23:16:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.111+0000 7f7621716640 1 -- 172.21.15.94:0/3070527707 wait complete. 2024-09-11T23:16:03.121 INFO:tasks.ceph.mds.c.smithi094.stderr: -3712> 2024-09-11T23:15:14.897+0000 7f6f7d472640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:16:03.130 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:16:03.163 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:16:03.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f944707b640 1 Processor -- start 2024-09-11T23:16:03.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f944707b640 1 -- start start 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f944707b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 0x7f94400d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f944707b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94400d32b0 con 0x7f94400d2e90 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f944707b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94400cfad0 con 0x7f94400cf620 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f944707b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94400d0300 con 0x7f9440161a60 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f94400d2e90 0x7f94400cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45366/0 (socket says 172.21.15.94:45366) 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943ffff640 1 -- 172.21.15.94:0/3599333175 learned_addr learned my addr 172.21.15.94:0/3599333175 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 0x7f94400d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673534067 0 0) 0x7f94400d32b0 con 0x7f94400d2e90 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9428003530 con 0x7f94400d2e90 2024-09-11T23:16:03.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4132118903 0 0) 0x7f9428003530 con 0x7f94400d2e90 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 msgr2=0x7f94400d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 0x7f94400d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 >> v1:172.21.15.155:6789/0 conn(0x7f94400cf620 legacy=0x7f944006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94400b0f60 con 0x7f94400d2e90 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f9434001680 con 0x7f94400d2e90 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 0x7f94400d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 >> v1:172.21.15.94:6789/0 conn(0x7f94400d2e90 legacy=0x7f94400cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94280039f0 0x7f9428003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9428004810 0x7f9428004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 0x7f942800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f94400d0300 con 0x7f94280039f0 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94280054f0 con 0x7f9428004810 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f942800bf10 con 0x7f9440161a60 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94280039f0 0x7f9428003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 -- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 msgr2=0x7f942800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9440161a60 0x7f942800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f943ffff640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9428004810 0x7f9428004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 -- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9428004810 msgr2=0x7f9428004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9428004810 0x7f9428004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.239+0000 7f9444e17640 1 -- 172.21.15.94:0/3599333175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9428003530 con 0x7f94280039f0 2024-09-11T23:16:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f9444e17640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94280039f0 0x7f9428003e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94300098d0 tx=0x7f943001c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6346bca064fa1453 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943000f040 con 0x7f94280039f0 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94300af070 con 0x7f94280039f0 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943f7fe640 1 -- 172.21.15.94:0/3599333175 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94300aa880 con 0x7f94280039f0 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- 172.21.15.94:0/3599333175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94280039f0 msgr2=0x7f9428003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 --2- 172.21.15.94:0/3599333175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94280039f0 0x7f9428003e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94300098d0 tx=0x7f943001c5e0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f9445618640 1 -- 172.21.15.94:0/3599333175 reap_dead start 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- 172.21.15.94:0/3599333175 shutdown_connections 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- 172.21.15.94:0/3599333175 >> 172.21.15.94:0/3599333175 conn(0x7f944008bf90 msgr2=0x7f944009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- 172.21.15.94:0/3599333175 shutdown_connections 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- 172.21.15.94:0/3599333175 wait complete. 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 Processor -- start 2024-09-11T23:16:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- start start 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94280039f0 0x7f9440158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94400c8810 0x7f94400c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94400d0ef0 0x7f94400d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9440169f20 con 0x7f94400c8810 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f944006d190 con 0x7f94400d0ef0 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f944707b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f944016a0a0 con 0x7f94280039f0 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94400c8810 0x7f94400c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94400c8810 0x7f94400c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36732/0 (socket says 172.21.15.94:36732) 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 -- 172.21.15.94:0/1229262836 learned_addr learned my addr 172.21.15.94:0/1229262836 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f9445618640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94400d0ef0 0x7f94400d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f9444e17640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94280039f0 0x7f9440158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 -- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94280039f0 msgr2=0x7f9440158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94280039f0 0x7f9440158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 -- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94400d0ef0 msgr2=0x7f94400d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94400d0ef0 0x7f94400d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.243+0000 7f943ffff640 1 -- 172.21.15.94:0/1229262836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94400b7580 con 0x7f94400c8810 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f943ffff640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94400c8810 0x7f94400c8c90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9434007fd0 tx=0x7f943400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f943d7fa640 1 -- 172.21.15.94:0/1229262836 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434019070 con 0x7f94400c8810 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f943d7fa640 1 -- 172.21.15.94:0/1229262836 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340072d0 con 0x7f94400c8810 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94400b7860 con 0x7f94400c8810 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f943d7fa640 1 -- 172.21.15.94:0/1229262836 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434007680 con 0x7f94400c8810 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94400b7e20 con 0x7f94400c8810 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944006d6b0 con 0x7f94400c8810 2024-09-11T23:16:03.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f943d7fa640 1 -- 172.21.15.94:0/1229262836 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f943401c070 con 0x7f94400c8810 2024-09-11T23:16:03.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f943d7fa640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f942c0678c0 0x7f942c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:03.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f943d7fa640 1 -- 172.21.15.94:0/1229262836 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7f9434085a50 con 0x7f94400c8810 2024-09-11T23:16:03.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f9444e17640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f942c0678c0 0x7f942c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:03.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.247+0000 7f9444e17640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f942c0678c0 0x7f942c069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f94300ae000 tx=0x7f94300046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:03.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.251+0000 7f943d7fa640 1 -- 172.21.15.94:0/1229262836 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9434056180 con 0x7f94400c8810 2024-09-11T23:16:03.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:03.435+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9440075690 con 0x7f94400c8810 2024-09-11T23:16:04.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.111+0000 7f943d7fa640 1 -- 172.21.15.94:0/1229262836 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f9434055a80 con 0x7f94400c8810 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f942c0678c0 msgr2=0x7f942c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f942c0678c0 0x7f942c069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f94300ae000 tx=0x7f94300046d0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94400c8810 msgr2=0x7f94400c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94400c8810 0x7f94400c8c90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9434007fd0 tx=0x7f943400dc00 comp rx=0 tx=0).stop 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 shutdown_connections 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94400d0ef0 0x7f94400d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f942c0678c0 0x7f942c069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94400c8810 0x7f94400c8c90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 --2- 172.21.15.94:0/1229262836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94280039f0 0x7f9440158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 >> 172.21.15.94:0/1229262836 conn(0x7f944008bf90 msgr2=0x7f94400b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:04.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 shutdown_connections 2024-09-11T23:16:04.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.115+0000 7f944707b640 1 -- 172.21.15.94:0/1229262836 wait complete. 2024-09-11T23:16:04.141 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:16:04.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60c2e1640 1 Processor -- start 2024-09-11T23:16:04.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60c2e1640 1 -- start start 2024-09-11T23:16:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60c2e1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb60406fef0 0x7fb60406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60c2e1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb6040b3d50 0x7fb6040b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60c2e1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60406ee50 con 0x7fb604073e60 2024-09-11T23:16:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60c2e1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb6040b46c0 con 0x7fb60406fef0 2024-09-11T23:16:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60c2e1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb60406f130 con 0x7fb6040b3d50 2024-09-11T23:16:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60987c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb60406fef0 0x7fb60406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60a07d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb604073e60 0x7fb60415b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45376/0 (socket says 172.21.15.94:45376) 2024-09-11T23:16:04.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60a07d640 1 -- 172.21.15.94:0/1914656570 learned_addr learned my addr 172.21.15.94:0/1914656570 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:04.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60a87e640 1 --2- 172.21.15.94:0/1914656570 >> v2:172.21.15.155:3300/0 conn(0x7fb6040b3d50 0x7fb6040b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:04.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60987c640 1 -- 172.21.15.94:0/1914656570 >> v2:172.21.15.155:3300/0 conn(0x7fb6040b3d50 msgr2=0x7fb6040b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:04.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60987c640 1 --2- 172.21.15.94:0/1914656570 >> v2:172.21.15.155:3300/0 conn(0x7fb6040b3d50 0x7fb6040b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60987c640 1 -- 172.21.15.94:0/1914656570 >> v1:172.21.15.94:6789/0 conn(0x7fb604073e60 legacy=0x7fb60415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:04.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.311+0000 7fb60987c640 1 -- 172.21.15.94:0/1914656570 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60406f410 con 0x7fb60406fef0 2024-09-11T23:16:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60987c640 1 --2- 172.21.15.94:0/1914656570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60406fef0 0x7fb60406e800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb6040afdb0 tx=0x7fb5f401d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5623779b0ca3e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60907b640 1 -- 172.21.15.94:0/1914656570 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400b040 con 0x7fb60406fef0 2024-09-11T23:16:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60907b640 1 -- 172.21.15.94:0/1914656570 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40a76b0 con 0x7fb60406fef0 2024-09-11T23:16:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60907b640 1 -- 172.21.15.94:0/1914656570 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a7a80 con 0x7fb60406fef0 2024-09-11T23:16:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1914656570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60406fef0 msgr2=0x7fb60406e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1914656570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60406fef0 0x7fb60406e800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb6040afdb0 tx=0x7fb5f401d7c0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1914656570 shutdown_connections 2024-09-11T23:16:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1914656570 >> v2:172.21.15.155:3300/0 conn(0x7fb6040b3d50 0x7fb6040b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1914656570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60406fef0 0x7fb60406e800 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1914656570 >> 172.21.15.94:0/1914656570 conn(0x7fb6040b1f90 msgr2=0x7fb6040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1914656570 shutdown_connections 2024-09-11T23:16:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1914656570 wait complete. 2024-09-11T23:16:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 Processor -- start 2024-09-11T23:16:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- start start 2024-09-11T23:16:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60406fef0 0x7fb6041522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb604073e60 0x7fb60414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040b3d50 0x7fb6041f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040729a0 con 0x7fb604073e60 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb604072820 con 0x7fb60406fef0 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60c2e1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb604072b20 con 0x7fb6040b3d50 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60987c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb604073e60 0x7fb60414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60987c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb604073e60 0x7fb60414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36754/0 (socket says 172.21.15.94:36754) 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.315+0000 7fb60987c640 1 -- 172.21.15.94:0/1481034829 learned_addr learned my addr 172.21.15.94:0/1481034829 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60a07d640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60406fef0 0x7fb6041522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60987c640 1 -- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040b3d50 msgr2=0x7fb6041f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60987c640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040b3d50 0x7fb6041f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60987c640 1 -- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60406fef0 msgr2=0x7fb6041522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60987c640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60406fef0 0x7fb6041522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60987c640 1 -- 172.21.15.94:0/1481034829 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60415a4c0 con 0x7fb604073e60 2024-09-11T23:16:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60987c640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb604073e60 0x7fb60414c550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb5f401a3d0 tx=0x7fb5f401a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb5faffd640 1 -- 172.21.15.94:0/1481034829 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b8440 con 0x7fb604073e60 2024-09-11T23:16:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb5faffd640 1 -- 172.21.15.94:0/1481034829 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40bf070 con 0x7fb604073e60 2024-09-11T23:16:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60414d0a0 con 0x7fb604073e60 2024-09-11T23:16:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb5faffd640 1 -- 172.21.15.94:0/1481034829 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b8820 con 0x7fb604073e60 2024-09-11T23:16:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60414ca90 con 0x7fb604073e60 2024-09-11T23:16:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60406e800 con 0x7fb604073e60 2024-09-11T23:16:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb5faffd640 1 -- 172.21.15.94:0/1481034829 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5f40b89c0 con 0x7fb604073e60 2024-09-11T23:16:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb5faffd640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5e80678c0 0x7fb5e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb5faffd640 1 -- 172.21.15.94:0/1481034829 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7fb5f4120610 con 0x7fb604073e60 2024-09-11T23:16:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60a07d640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5e80678c0 0x7fb5e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.319+0000 7fb60a07d640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5e80678c0 0x7fb5e8069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb600000f70 tx=0x7fb600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:04.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.323+0000 7fb5faffd640 1 -- 172.21.15.94:0/1481034829 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb5f40c8020 con 0x7fb604073e60 2024-09-11T23:16:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:04.479+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6040723f0 con 0x7fb604073e60 2024-09-11T23:16:05.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.215+0000 7fb5faffd640 1 -- 172.21.15.94:0/1481034829 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fb5f4017440 con 0x7fb604073e60 2024-09-11T23:16:05.218 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:16:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5e80678c0 msgr2=0x7fb5e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5e80678c0 0x7fb5e8069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb600000f70 tx=0x7fb600009040 comp rx=0 tx=0).stop 2024-09-11T23:16:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb604073e60 msgr2=0x7fb60414c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb604073e60 0x7fb60414c550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb5f401a3d0 tx=0x7fb5f401a560 comp rx=0 tx=0).stop 2024-09-11T23:16:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 shutdown_connections 2024-09-11T23:16:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040b3d50 0x7fb6041f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb5e80678c0 0x7fb5e8069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb604073e60 0x7fb60414c550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 --2- 172.21.15.94:0/1481034829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60406fef0 0x7fb6041522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 >> 172.21.15.94:0/1481034829 conn(0x7fb6040b1f90 msgr2=0x7fb6040b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 shutdown_connections 2024-09-11T23:16:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.219+0000 7fb60c2e1640 1 -- 172.21.15.94:0/1481034829 wait complete. 2024-09-11T23:16:05.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:16:05.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc71634a640 1 Processor -- start 2024-09-11T23:16:05.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc71634a640 1 -- start start 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc71634a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7100aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc71634a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7100af2a0 0x7fc71006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc71634a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7100b3290 con 0x7fc71015bec0 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc71634a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc7100b3570 con 0x7fc7100af2a0 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc71634a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7100b3850 con 0x7fc71015c2a0 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc7148e7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7100af2a0 0x7fc71006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc7148e7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7100af2a0 0x7fc71006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36758/0 (socket says 172.21.15.94:36758) 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc7148e7640 1 -- 172.21.15.94:0/2160683520 learned_addr learned my addr 172.21.15.94:0/2160683520 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:05.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc70f7fe640 1 --2- 172.21.15.94:0/2160683520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7100aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:05.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc7148e7640 1 -- 172.21.15.94:0/2160683520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 msgr2=0x7fc7100aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:05.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc7148e7640 1 --2- 172.21.15.94:0/2160683520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7100aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc7148e7640 1 -- 172.21.15.94:0/2160683520 >> v1:172.21.15.155:6789/0 conn(0x7fc71015bec0 legacy=0x7fc7100ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:05.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.367+0000 7fc7148e7640 1 -- 172.21.15.94:0/2160683520 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7100b3b30 con 0x7fc7100af2a0 2024-09-11T23:16:05.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc7148e7640 1 --2- 172.21.15.94:0/2160683520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc71006e000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc708009e50 tx=0x7fc70801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923c37a715e7bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:05.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc70effd640 1 -- 172.21.15.94:0/2160683520 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080a5840 con 0x7fc7100af2a0 2024-09-11T23:16:05.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc70effd640 1 -- 172.21.15.94:0/2160683520 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7080a59e0 con 0x7fc7100af2a0 2024-09-11T23:16:05.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc70effd640 1 -- 172.21.15.94:0/2160683520 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080a5db0 con 0x7fc7100af2a0 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 -- 172.21.15.94:0/2160683520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 msgr2=0x7fc71006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 --2- 172.21.15.94:0/2160683520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc71006e000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc708009e50 tx=0x7fc70801c9c0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 -- 172.21.15.94:0/2160683520 shutdown_connections 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 --2- 172.21.15.94:0/2160683520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc71006e000 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 --2- 172.21.15.94:0/2160683520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7100aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 -- 172.21.15.94:0/2160683520 >> 172.21.15.94:0/2160683520 conn(0x7fc7100b1f90 msgr2=0x7fc7100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 -- 172.21.15.94:0/2160683520 shutdown_connections 2024-09-11T23:16:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 -- 172.21.15.94:0/2160683520 wait complete. 2024-09-11T23:16:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 Processor -- start 2024-09-11T23:16:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.371+0000 7fc71634a640 1 -- start start 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc7101477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc71015bec0 0x7fc710148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7101485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc71006ed50 con 0x7fc7100af2a0 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7100afc90 con 0x7fc71015bec0 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc71006eed0 con 0x7fc71015c2a0 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc7101477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc7101477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36766/0 (socket says 172.21.15.94:36766) 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 -- 172.21.15.94:0/52146399 learned_addr learned my addr 172.21.15.94:0/52146399 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc7148e7640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7101485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 -- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 msgr2=0x7fc7101485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7101485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 -- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc71015bec0 msgr2=0x7fc710148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70f7fe640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc71015bec0 0x7fc710148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc71015bec0 0x7fc710148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 -- 172.21.15.94:0/52146399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71014a0b0 con 0x7fc7100af2a0 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70ffff640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc7101477a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c480 tx=0x7fc70000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70cff9640 1 -- 172.21.15.94:0/52146399 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700007020 con 0x7fc7100af2a0 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70cff9640 1 -- 172.21.15.94:0/52146399 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7000071c0 con 0x7fc7100af2a0 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70cff9640 1 -- 172.21.15.94:0/52146399 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7000075f0 con 0x7fc7100af2a0 2024-09-11T23:16:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71014a390 con 0x7fc7100af2a0 2024-09-11T23:16:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc710147ce0 con 0x7fc7100af2a0 2024-09-11T23:16:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71006f280 con 0x7fc7100af2a0 2024-09-11T23:16:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70cff9640 1 -- 172.21.15.94:0/52146399 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc700019020 con 0x7fc7100af2a0 2024-09-11T23:16:05.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70cff9640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6fc0678c0 0x7fc6fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:05.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70cff9640 1 -- 172.21.15.94:0/52146399 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6412+0+0 (secure 0 0 0) 0x7fc700085690 con 0x7fc7100af2a0 2024-09-11T23:16:05.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.375+0000 7fc70f7fe640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6fc0678c0 0x7fc6fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:05.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.379+0000 7fc70f7fe640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6fc0678c0 0x7fc6fc069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc710158160 tx=0x7fc704008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.379+0000 7fc70cff9640 1 -- 172.21.15.94:0/52146399 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc700055fa0 con 0x7fc7100af2a0 2024-09-11T23:16:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:05.547+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc7100b2c60 con 0x7fc7100af2a0 2024-09-11T23:16:06.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.231+0000 7fc70cff9640 1 -- 172.21.15.94:0/52146399 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fc7000558a0 con 0x7fc7100af2a0 2024-09-11T23:16:06.236 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:16:06.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.235+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6fc0678c0 msgr2=0x7fc6fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.235+0000 7fc71634a640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6fc0678c0 0x7fc6fc069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc710158160 tx=0x7fc704008040 comp rx=0 tx=0).stop 2024-09-11T23:16:06.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.235+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 msgr2=0x7fc7101477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.235+0000 7fc71634a640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc7101477a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c480 tx=0x7fc70000c940 comp rx=0 tx=0).stop 2024-09-11T23:16:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 shutdown_connections 2024-09-11T23:16:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc71015c2a0 0x7fc7101485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc71015bec0 0x7fc710148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6fc0678c0 0x7fc6fc069d80 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc710158160 tx=0x7fc704008040 comp rx=0 tx=0).stop 2024-09-11T23:16:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 --2- 172.21.15.94:0/52146399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7100af2a0 0x7fc7101477a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 >> 172.21.15.94:0/52146399 conn(0x7fc7100b1f90 msgr2=0x7fc7100cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:06.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 shutdown_connections 2024-09-11T23:16:06.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.239+0000 7fc71634a640 1 -- 172.21.15.94:0/52146399 wait complete. 2024-09-11T23:16:06.263 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T23:16:06.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e93c47640 1 Processor -- start 2024-09-11T23:16:06.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e93c47640 1 -- start start 2024-09-11T23:16:06.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e93c47640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3e8c15bec0 0x7f3e8c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e93c47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c0af470 0x7f3e8c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e93c47640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8c0b3290 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e93c47640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f3e8c0b3570 con 0x7f3e8c15bec0 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e93c47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8c0b3850 con 0x7f3e8c0af470 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e919e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3e8c15bec0 0x7f3e8c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e919e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3e8c15bec0 0x7f3e8c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36768/0 (socket says 172.21.15.94:36768) 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e919e3640 1 -- 172.21.15.94:0/1998579930 learned_addr learned my addr 172.21.15.94:0/1998579930 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e919e3640 1 -- 172.21.15.94:0/1998579930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c0af470 msgr2=0x7f3e8c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e919e3640 1 --2- 172.21.15.94:0/1998579930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c0af470 0x7f3e8c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e919e3640 1 -- 172.21.15.94:0/1998579930 >> v1:172.21.15.155:6789/0 conn(0x7f3e8c15c2a0 legacy=0x7f3e8c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:06.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.383+0000 7f3e919e3640 1 -- 172.21.15.94:0/1998579930 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c0b3b30 con 0x7f3e8c15bec0 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e919e3640 1 --2- 172.21.15.94:0/1998579930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15bec0 0x7f3e8c0ad200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009870 tx=0x7f3e8401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c8eeeb6857eb99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e909e1640 1 -- 172.21.15.94:0/1998579930 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840ab620 con 0x7f3e8c15bec0 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e909e1640 1 -- 172.21.15.94:0/1998579930 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e840b0070 con 0x7f3e8c15bec0 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e909e1640 1 -- 172.21.15.94:0/1998579930 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840ab9e0 con 0x7f3e8c15bec0 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 -- 172.21.15.94:0/1998579930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15bec0 msgr2=0x7f3e8c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1998579930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15bec0 0x7f3e8c0ad200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009870 tx=0x7f3e8401c460 comp rx=0 tx=0).stop 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 -- 172.21.15.94:0/1998579930 shutdown_connections 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1998579930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c0af470 0x7f3e8c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1998579930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15bec0 0x7f3e8c0ad200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 -- 172.21.15.94:0/1998579930 >> 172.21.15.94:0/1998579930 conn(0x7f3e8c0b1f90 msgr2=0x7f3e8c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:06.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 -- 172.21.15.94:0/1998579930 shutdown_connections 2024-09-11T23:16:06.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 -- 172.21.15.94:0/1998579930 wait complete. 2024-09-11T23:16:06.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 Processor -- start 2024-09-11T23:16:06.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.387+0000 7f3e93c47640 1 -- start start 2024-09-11T23:16:06.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e8c0af470 0x7f3e8c1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c15bec0 0x7f3e8c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15c2a0 0x7f3e8c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c06ed50 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c0ad740 con 0x7f3e8c0af470 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8c06eed0 con 0x7f3e8c15bec0 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15c2a0 0x7f3e8c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15c2a0 0x7f3e8c150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36784/0 (socket says 172.21.15.94:36784) 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 -- 172.21.15.94:0/1840185438 learned_addr learned my addr 172.21.15.94:0/1840185438 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 -- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c15bec0 msgr2=0x7f3e8c150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c15bec0 0x7f3e8c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 -- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e8c0af470 msgr2=0x7f3e8c1498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e919e3640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e8c0af470 0x7f3e8c1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e8c0af470 0x7f3e8c1498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 -- 172.21.15.94:0/1840185438 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c1576c0 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e921e4640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15c2a0 0x7f3e8c150570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800b9a0 tx=0x7f3e8800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e827fc640 1 -- 172.21.15.94:0/1840185438 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88019070 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e827fc640 1 -- 172.21.15.94:0/1840185438 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8800cbc0 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8c1579a0 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e827fc640 1 -- 172.21.15.94:0/1840185438 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88014440 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8c157f60 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8c15d1d0 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e827fc640 1 -- 172.21.15.94:0/1840185438 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e8801c070 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e827fc640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e700678c0 0x7f3e70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e827fc640 1 -- 172.21.15.94:0/1840185438 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5882+0+0 (secure 0 0 0) 0x7f3e88085e50 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.391+0000 7f3e919e3640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e700678c0 0x7f3e70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.395+0000 7f3e919e3640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e700678c0 0x7f3e70069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3e840af000 tx=0x7f3e84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:06.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.395+0000 7f3e827fc640 1 -- 172.21.15.94:0/1840185438 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e88023020 con 0x7f3e8c15c2a0 2024-09-11T23:16:06.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:06.563+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3e8c06fcd0 con 0x7f3e8c15c2a0 2024-09-11T23:16:07.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.235+0000 7f3e827fc640 1 -- 172.21.15.94:0/1840185438 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f3e880569c0 con 0x7f3e8c15c2a0 2024-09-11T23:16:07.238 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data_ec' removed 2024-09-11T23:16:07.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e700678c0 msgr2=0x7f3e70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e700678c0 0x7f3e70069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3e840af000 tx=0x7f3e84008040 comp rx=0 tx=0).stop 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15c2a0 msgr2=0x7f3e8c150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15c2a0 0x7f3e8c150570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800b9a0 tx=0x7f3e8800be60 comp rx=0 tx=0).stop 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 shutdown_connections 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e700678c0 0x7f3e70069d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e8c15c2a0 0x7f3e8c150570 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e8c15bec0 0x7f3e8c150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 --2- 172.21.15.94:0/1840185438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e8c0af470 0x7f3e8c1498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.239+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 >> 172.21.15.94:0/1840185438 conn(0x7f3e8c0b1f90 msgr2=0x7f3e8c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:07.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.243+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 shutdown_connections 2024-09-11T23:16:07.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.243+0000 7f3e93c47640 1 -- 172.21.15.94:0/1840185438 wait complete. 2024-09-11T23:16:07.265 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:16:07.266 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:16:07.266 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:16:07.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:07.266 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:16:07.267 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:16:07.267 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:16:07.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:07.267 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:16:07.267 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:16:07.267 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:16:07.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:07.268 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:16:07.268 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:16:07.268 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:16:07.268 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:07.277 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:16:07.278 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:16:07.279 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:16:07.279 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:16:07.289 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:16:07.289 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:16:07.290 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:16:07.290 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:16:07.322 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:16:07.322 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:07.323 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:16:07.323 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:07.333 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:16:07.333 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:07.334 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:16:07.334 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:07.334 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:16:07.398 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:16:07.402 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:16:07.412 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:16:07.412 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:16:07.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b8e722640 1 Processor -- start 2024-09-11T23:16:07.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b8e722640 1 -- start start 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b8e722640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b880b3e00 0x7f1b880b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b8e722640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b8806e7a0 con 0x7f1b880d19e0 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b8e722640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b880d0f00 con 0x7f1b8815e650 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b8e722640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1b880d1550 con 0x7f1b880b3e00 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b877fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b880b3e00 0x7f1b880b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b877fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b880b3e00 0x7f1b880b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36810/0 (socket says 172.21.15.94:36810) 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b877fe640 1 -- 172.21.15.94:0/1061516146 learned_addr learned my addr 172.21.15.94:0/1061516146 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b877fe640 1 -- 172.21.15.94:0/1061516146 >> v1:172.21.15.155:6789/0 conn(0x7f1b8815e650 legacy=0x7f1b8806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b877fe640 1 -- 172.21.15.94:0/1061516146 >> v1:172.21.15.94:6789/0 conn(0x7f1b880d19e0 legacy=0x7f1b880d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:07.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.459+0000 7f1b877fe640 1 -- 172.21.15.94:0/1061516146 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b880d11e0 con 0x7f1b880b3e00 2024-09-11T23:16:07.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b877fe640 1 --2- 172.21.15.94:0/1061516146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b4240 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b880d16d0 tx=0x7f1b7001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe238c9ea73fd9c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:07.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b86ffd640 1 -- 172.21.15.94:0/1061516146 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b700b0070 con 0x7f1b880b3e00 2024-09-11T23:16:07.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b86ffd640 1 -- 172.21.15.94:0/1061516146 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b700ab600 con 0x7f1b880b3e00 2024-09-11T23:16:07.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b86ffd640 1 -- 172.21.15.94:0/1061516146 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b700ab9d0 con 0x7f1b880b3e00 2024-09-11T23:16:07.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- 172.21.15.94:0/1061516146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 msgr2=0x7f1b880b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:07.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 --2- 172.21.15.94:0/1061516146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b4240 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b880d16d0 tx=0x7f1b7001c500 comp rx=0 tx=0).stop 2024-09-11T23:16:07.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- 172.21.15.94:0/1061516146 shutdown_connections 2024-09-11T23:16:07.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 --2- 172.21.15.94:0/1061516146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b4240 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:07.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- 172.21.15.94:0/1061516146 >> 172.21.15.94:0/1061516146 conn(0x7f1b8806bcc0 msgr2=0x7f1b8806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:07.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- 172.21.15.94:0/1061516146 shutdown_connections 2024-09-11T23:16:07.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- 172.21.15.94:0/1061516146 wait complete. 2024-09-11T23:16:07.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 Processor -- start 2024-09-11T23:16:07.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- start start 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880d19e0 0x7f1b8814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8815e650 0x7f1b8814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8816c290 con 0x7f1b880b3e00 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8806e550 con 0x7f1b880d19e0 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8816c410 con 0x7f1b8815e650 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36816/0 (socket says 172.21.15.94:36816) 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 -- 172.21.15.94:0/3818070779 learned_addr learned my addr 172.21.15.94:0/3818070779 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8ccbf640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8815e650 0x7f1b8814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b877fe640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880d19e0 0x7f1b8814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 -- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8815e650 msgr2=0x7f1b8814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:07.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8815e650 0x7f1b8814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 -- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880d19e0 msgr2=0x7f1b8814f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880d19e0 0x7f1b8814f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 -- 172.21.15.94:0/3818070779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b881528e0 con 0x7f1b880b3e00 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b87fff640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b7c30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c7c0 tx=0x7f1b7800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b84ff9640 1 -- 172.21.15.94:0/3818070779 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78016020 con 0x7f1b880b3e00 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b84ff9640 1 -- 172.21.15.94:0/3818070779 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7800aa50 con 0x7f1b880b3e00 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b88152bc0 con 0x7f1b880b3e00 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b84ff9640 1 -- 172.21.15.94:0/3818070779 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78012420 con 0x7f1b880b3e00 2024-09-11T23:16:07.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.463+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b88147fd0 con 0x7f1b880b3e00 2024-09-11T23:16:07.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.467+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b880b4240 con 0x7f1b880b3e00 2024-09-11T23:16:07.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.467+0000 7f1b84ff9640 1 -- 172.21.15.94:0/3818070779 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b78019020 con 0x7f1b880b3e00 2024-09-11T23:16:07.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.467+0000 7f1b84ff9640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b680678c0 0x7f1b68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:07.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.467+0000 7f1b84ff9640 1 -- 172.21.15.94:0/3818070779 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7f1b78085c00 con 0x7f1b880b3e00 2024-09-11T23:16:07.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.467+0000 7f1b877fe640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b680678c0 0x7f1b68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:07.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.467+0000 7f1b877fe640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b680678c0 0x7f1b68069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b700ad000 tx=0x7f1b700a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:07.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.471+0000 7f1b84ff9640 1 -- 172.21.15.94:0/3818070779 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b7808c080 con 0x7f1b880b3e00 2024-09-11T23:16:07.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:07.643+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1b880b2280 con 0x7f1b880b3e00 2024-09-11T23:16:08.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.263+0000 7f1b84ff9640 1 -- 172.21.15.94:0/3818070779 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7f1b78020030 con 0x7f1b880b3e00 2024-09-11T23:16:08.266 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2024-09-11T23:16:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b680678c0 msgr2=0x7f1b68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b680678c0 0x7f1b68069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b700ad000 tx=0x7f1b700a4f90 comp rx=0 tx=0).stop 2024-09-11T23:16:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 msgr2=0x7f1b880b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b7c30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c7c0 tx=0x7f1b7800cc80 comp rx=0 tx=0).stop 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 shutdown_connections 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8815e650 0x7f1b8814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880d19e0 0x7f1b8814f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b680678c0 0x7f1b68069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 --2- 172.21.15.94:0/3818070779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b880b3e00 0x7f1b880b7c30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 >> 172.21.15.94:0/3818070779 conn(0x7f1b8806bcc0 msgr2=0x7f1b88157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 shutdown_connections 2024-09-11T23:16:08.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.267+0000 7f1b8e722640 1 -- 172.21.15.94:0/3818070779 wait complete. 2024-09-11T23:16:08.293 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:16:08.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f813a287640 1 Processor -- start 2024-09-11T23:16:08.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f813a287640 1 -- start start 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f813a287640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8134161a60 0x7f81340d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f813a287640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 0x7f81340cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f813a287640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81340d32b0 con 0x7f81340cf450 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f813a287640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f81340d0300 con 0x7f8134161a60 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f813a287640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f813406e6c0 con 0x7f81340d2e90 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8138824640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f81340cf450 0x7f81340d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45402/0 (socket says 172.21.15.94:45402) 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8138824640 1 -- 172.21.15.94:0/1527924077 learned_addr learned my addr 172.21.15.94:0/1527924077 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8133fff640 1 --2- 172.21.15.94:0/1527924077 >> v2:172.21.15.155:3300/0 conn(0x7f8134161a60 0x7f81340d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802151218 0 0) 0x7f81340d32b0 con 0x7f81340cf450 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8120003530 con 0x7f81340cf450 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f81337fe640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 0x7f81340cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 661488163 0 0) 0x7f8120003530 con 0x7f81340cf450 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 msgr2=0x7f81340cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 0x7f81340cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 >> v2:172.21.15.155:3300/0 conn(0x7f8134161a60 msgr2=0x7f81340d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 --2- 172.21.15.94:0/1527924077 >> v2:172.21.15.155:3300/0 conn(0x7f8134161a60 0x7f81340d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340b0f60 con 0x7f81340cf450 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f812c001a00 con 0x7f81340cf450 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 >> v1:172.21.15.94:6789/0 conn(0x7f81340cf450 legacy=0x7f81340d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81200039c0 0x7f8120003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 0x7f8120004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8120004d50 0x7f81200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f81340d0300 con 0x7f81200039c0 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f813406e6c0 con 0x7f8120004d50 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f812000ba80 con 0x7f81340d2e90 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8133fff640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81200039c0 0x7f8120003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8133fff640 1 -- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 msgr2=0x7f8120004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f81337fe640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 0x7f8120004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8133fff640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81340d2e90 0x7f8120004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8133fff640 1 -- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8120004d50 msgr2=0x7f81200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8133fff640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8120004d50 0x7f81200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.411+0000 7f8133fff640 1 -- 172.21.15.94:0/1527924077 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8120003530 con 0x7f81200039c0 2024-09-11T23:16:08.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f8133fff640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81200039c0 0x7f8120003de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f811c009ae0 tx=0x7f811c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a85ea7091afafa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c0b2070 con 0x7f81200039c0 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c0a5650 con 0x7f81200039c0 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f8132ffd640 1 -- 172.21.15.94:0/1527924077 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c0096b0 con 0x7f81200039c0 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- 172.21.15.94:0/1527924077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81200039c0 msgr2=0x7f8120003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 --2- 172.21.15.94:0/1527924077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81200039c0 0x7f8120003de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f811c009ae0 tx=0x7f811c01ca80 comp rx=0 tx=0).stop 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f8138824640 1 -- 172.21.15.94:0/1527924077 reap_dead start 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- 172.21.15.94:0/1527924077 shutdown_connections 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- 172.21.15.94:0/1527924077 >> 172.21.15.94:0/1527924077 conn(0x7f813408bf90 msgr2=0x7f813409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- 172.21.15.94:0/1527924077 shutdown_connections 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- 172.21.15.94:0/1527924077 wait complete. 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 Processor -- start 2024-09-11T23:16:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- start start 2024-09-11T23:16:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81200039c0 0x7f8134153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81340b80a0 0x7f8134153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81341f7290 0x7f8134160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f813406d190 con 0x7f81340b80a0 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81340d1930 con 0x7f81200039c0 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f813a287640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f81340cf880 con 0x7f81341f7290 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f81337fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81340b80a0 0x7f8134153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f81337fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81340b80a0 0x7f8134153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36834/0 (socket says 172.21.15.94:36834) 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.415+0000 7f81337fe640 1 -- 172.21.15.94:0/1959920819 learned_addr learned my addr 172.21.15.94:0/1959920819 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8133fff640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81200039c0 0x7f8134153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f81337fe640 1 -- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81341f7290 msgr2=0x7f8134160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8138824640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81341f7290 0x7f8134160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f81337fe640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81341f7290 0x7f8134160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f81337fe640 1 -- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81200039c0 msgr2=0x7f8134153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f81337fe640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81200039c0 0x7f8134153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f81337fe640 1 -- 172.21.15.94:0/1959920819 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81341f7710 con 0x7f81340b80a0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f81337fe640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81340b80a0 0x7f8134153170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f812400e840 tx=0x7f812400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8130ff9640 1 -- 172.21.15.94:0/1959920819 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124017070 con 0x7f81340b80a0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8130ff9640 1 -- 172.21.15.94:0/1959920819 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812400c6d0 con 0x7f81340b80a0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81340b85f0 con 0x7f81340b80a0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8130ff9640 1 -- 172.21.15.94:0/1959920819 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812400f040 con 0x7f81340b80a0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8134163740 con 0x7f81340b80a0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813415f010 con 0x7f81340b80a0 2024-09-11T23:16:08.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8130ff9640 1 -- 172.21.15.94:0/1959920819 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f812401a070 con 0x7f81340b80a0 2024-09-11T23:16:08.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8130ff9640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81140678f0 0x7f8114069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8130ff9640 1 -- 172.21.15.94:0/1959920819 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f8124085610 con 0x7f81340b80a0 2024-09-11T23:16:08.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8133fff640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81140678f0 0x7f8114069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.419+0000 7f8133fff640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81140678f0 0x7f8114069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f811c0af000 tx=0x7f811c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.423+0000 7f8130ff9640 1 -- 172.21.15.94:0/1959920819 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81341f7710 con 0x7f81340b80a0 2024-09-11T23:16:08.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.643+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f813415ed30 con 0x7f81340b80a0 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.643+0000 7f8130ff9640 1 -- 172.21.15.94:0/1959920819 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f81240563a0 con 0x7f81340b80a0 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg==", 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ==", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ==", 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg==", 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ==", 2024-09-11T23:16:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g==", 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow==", 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2024-09-11T23:16:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA==", 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw==", 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g==", 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA==", 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA==", 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ==", 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw==", 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ==", 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw==", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:16:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmAziHChAAz9c8+z77RX+g6eeV2hnBGA==", 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-mds", 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBpJOJm5vGQEhAAx0pSj/hNIOzCHrxCOrKVMw==", 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-mds" 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-mgr", 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBpJOJmswGREhAA6EB06mgI0XjA1SanvIlUHA==", 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-11T23:16:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-osd", 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBpJOJmPg6REhAA70cc9o7Q7v7ajc6/lO3feA==", 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-osd" 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-rbd", 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBpJOJmmRqREhAAtR4xUh+HcskKRePhprlQ9w==", 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBpJOJmDSeREhAAXnSThgpkLCfo/Ce8/W1qKQ==", 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-rgw", 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBpJOJm9jOREhAAsG3QHvJHGLiNoNjM/8UFbA==", 2024-09-11T23:16:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA==", 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg==", 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:16:08.664 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81140678f0 msgr2=0x7f8114069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81140678f0 0x7f8114069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f811c0af000 tx=0x7f811c0046d0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81340b80a0 msgr2=0x7f8134153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81340b80a0 0x7f8134153170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f812400e840 tx=0x7f812400ed00 comp rx=0 tx=0).stop 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 shutdown_connections 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81341f7290 0x7f8134160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f81140678f0 0x7f8114069db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81340b80a0 0x7f8134153170 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 --2- 172.21.15.94:0/1959920819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81200039c0 0x7f8134153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 >> 172.21.15.94:0/1959920819 conn(0x7f813408bf90 msgr2=0x7f813415f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 shutdown_connections 2024-09-11T23:16:08.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.647+0000 7f813a287640 1 -- 172.21.15.94:0/1959920819 wait complete. 2024-09-11T23:16:08.667 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-11T23:16:08.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.779+0000 7f0075fcd640 1 Processor -- start 2024-09-11T23:16:08.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.779+0000 7f0075fcd640 1 -- start start 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.779+0000 7f0075fcd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00701520a0 0x7f007006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.779+0000 7f0075fcd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007006fe50 0x7f007015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.779+0000 7f0075fcd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0070070250 con 0x7f007015f1d0 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.779+0000 7f0075fcd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0070152480 con 0x7f00701520a0 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.779+0000 7f0075fcd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f00700aede0 con 0x7f007006fe50 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006effd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007006fe50 0x7f007015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00701520a0 0x7f007006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00701520a0 0x7f007006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:56518/0 (socket says 172.21.15.94:56518) 2024-09-11T23:16:08.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 -- 172.21.15.94:0/248809422 learned_addr learned my addr 172.21.15.94:0/248809422 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:08.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 -- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007006fe50 msgr2=0x7f007015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:08.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 --2- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007006fe50 0x7f007015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 -- 172.21.15.94:0/248809422 >> v1:172.21.15.155:6789/0 conn(0x7f007015f1d0 legacy=0x7f0070071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 -- 172.21.15.94:0/248809422 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007015fa10 con 0x7f00701520a0 2024-09-11T23:16:08.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006effd640 1 --2- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007006fe50 0x7f007015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:08.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006f7fe640 1 --2- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 0x7f007006f910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0068009e50 tx=0x7f006801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bdfca0e131631f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006e7fc640 1 -- 172.21.15.94:0/248809422 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00680a57f0 con 0x7f00701520a0 2024-09-11T23:16:08.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006e7fc640 1 -- 172.21.15.94:0/248809422 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00680a5990 con 0x7f00701520a0 2024-09-11T23:16:08.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f006e7fc640 1 -- 172.21.15.94:0/248809422 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00680a5d60 con 0x7f00701520a0 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 -- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 msgr2=0x7f007006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 --2- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 0x7f007006f910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0068009e50 tx=0x7f006801ca10 comp rx=0 tx=0).stop 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 -- 172.21.15.94:0/248809422 shutdown_connections 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 --2- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007006fe50 0x7f007015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 --2- 172.21.15.94:0/248809422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 0x7f007006f910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 -- 172.21.15.94:0/248809422 >> 172.21.15.94:0/248809422 conn(0x7f00700b1f90 msgr2=0x7f00700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 -- 172.21.15.94:0/248809422 shutdown_connections 2024-09-11T23:16:08.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.783+0000 7f0075fcd640 1 -- 172.21.15.94:0/248809422 wait complete. 2024-09-11T23:16:08.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 Processor -- start 2024-09-11T23:16:08.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 -- start start 2024-09-11T23:16:08.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007006fe50 0x7f0070146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 0x7f00700982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007015f1d0 0x7f0070147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0070073d30 con 0x7f007006fe50 2024-09-11T23:16:08.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0070073a50 con 0x7f00701520a0 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f007015f600 con 0x7f007015f1d0 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007006fe50 0x7f0070146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007006fe50 0x7f0070146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36844/0 (socket says 172.21.15.94:36844) 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 -- 172.21.15.94:0/1926283127 learned_addr learned my addr 172.21.15.94:0/1926283127 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006effd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 0x7f00700982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006ffff640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007015f1d0 0x7f0070147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 -- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007015f1d0 msgr2=0x7f0070147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007015f1d0 0x7f0070147a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 -- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 msgr2=0x7f00700982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 0x7f00700982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 -- 172.21.15.94:0/1926283127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0070099c70 con 0x7f007006fe50 2024-09-11T23:16:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f006f7fe640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007006fe50 0x7f0070146340 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f00680af040 tx=0x7f00680197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0067fff640 1 -- 172.21.15.94:0/1926283127 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00680b8470 con 0x7f007006fe50 2024-09-11T23:16:08.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0067fff640 1 -- 172.21.15.94:0/1926283127 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00680b8630 con 0x7f007006fe50 2024-09-11T23:16:08.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0070144490 con 0x7f007006fe50 2024-09-11T23:16:08.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0067fff640 1 -- 172.21.15.94:0/1926283127 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00680b8a20 con 0x7f007006fe50 2024-09-11T23:16:08.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0070144a10 con 0x7f007006fe50 2024-09-11T23:16:08.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.787+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007015ec90 con 0x7f007006fe50 2024-09-11T23:16:08.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.791+0000 7f0067fff640 1 -- 172.21.15.94:0/1926283127 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00680c0020 con 0x7f007006fe50 2024-09-11T23:16:08.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.791+0000 7f0067fff640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f00500678c0 0x7f0050069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.791+0000 7f0067fff640 1 -- 172.21.15.94:0/1926283127 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f0068120500 con 0x7f007006fe50 2024-09-11T23:16:08.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.791+0000 7f006effd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f00500678c0 0x7f0050069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.791+0000 7f006effd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f00500678c0 0x7f0050069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0058009580 tx=0x7f0058009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:08.795+0000 7f0067fff640 1 -- 172.21.15.94:0/1926283127 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0068016600 con 0x7f007006fe50 2024-09-11T23:16:09.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.011+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f007006e540 con 0x7f007006fe50 2024-09-11T23:16:09.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0067fff640 1 -- 172.21.15.94:0/1926283127 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f00680f1200 con 0x7f007006fe50 2024-09-11T23:16:09.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f00500678c0 msgr2=0x7f0050069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f00500678c0 0x7f0050069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0058009580 tx=0x7f0058009190 comp rx=0 tx=0).stop 2024-09-11T23:16:09.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007006fe50 msgr2=0x7f0070146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007006fe50 0x7f0070146340 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f00680af040 tx=0x7f00680197b0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 shutdown_connections 2024-09-11T23:16:09.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f007015f1d0 0x7f0070147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00701520a0 0x7f00700982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f00500678c0 0x7f0050069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 --2- 172.21.15.94:0/1926283127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007006fe50 0x7f0070146340 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 >> 172.21.15.94:0/1926283127 conn(0x7f00700b1f90 msgr2=0x7f007006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:09.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 shutdown_connections 2024-09-11T23:16:09.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.015+0000 7f0075fcd640 1 -- 172.21.15.94:0/1926283127 wait complete. 2024-09-11T23:16:09.036 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-11T23:16:09.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca2a27640 1 Processor -- start 2024-09-11T23:16:09.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca2a27640 1 -- start start 2024-09-11T23:16:09.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca2a27640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 0x7f7c9c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca2a27640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c9c0d2e90 0x7f7c9c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca2a27640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9c0d32b0 con 0x7f7c9c0cf450 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca2a27640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9c0d0300 con 0x7f7c9c0d2e90 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca2a27640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c06e6c0 con 0x7f7c9c161a60 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca0fc4640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7c9c0cf450 0x7f7c9c0d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45412/0 (socket says 172.21.15.94:45412) 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.155+0000 7f7ca0fc4640 1 -- 172.21.15.94:0/3566965655 learned_addr learned my addr 172.21.15.94:0/3566965655 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449516525 0 0) 0x7f7c9c0d32b0 con 0x7f7c9c0cf450 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c937fe640 1 --2- 172.21.15.94:0/3566965655 >> v2:172.21.15.155:3300/0 conn(0x7f7c9c0d2e90 0x7f7c9c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9bfff640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 0x7f7c9c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c88003530 con 0x7f7c9c0cf450 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 145364649 0 0) 0x7f7c88003530 con 0x7f7c9c0cf450 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 msgr2=0x7f7c9c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 0x7f7c9c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 >> v2:172.21.15.155:3300/0 conn(0x7f7c9c0d2e90 msgr2=0x7f7c9c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 --2- 172.21.15.94:0/3566965655 >> v2:172.21.15.155:3300/0 conn(0x7f7c9c0d2e90 0x7f7c9c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c0b0f60 con 0x7f7c9c0cf450 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7c94001a00 con 0x7f7c9c0cf450 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 >> v1:172.21.15.94:6789/0 conn(0x7f7c9c0cf450 legacy=0x7f7c9c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c880039c0 0x7f7c88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 0x7f7c88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0d0300 con 0x7f7c88004d50 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c06e6c0 con 0x7f7c880039c0 2024-09-11T23:16:09.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8800b9d0 con 0x7f7c9c161a60 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c937fe640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 0x7f7c88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9bfff640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c880039c0 0x7f7c88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 -- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 msgr2=0x7f7c88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c161a60 0x7f7c88004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 -- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c880039c0 msgr2=0x7f7c88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c880039c0 0x7f7c88003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 -- 172.21.15.94:0/3566965655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c88003530 con 0x7f7c88004d50 2024-09-11T23:16:09.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400a8a0 tx=0x7f7c9401fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47fcbcc723d448a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400a4c0 con 0x7f7c88004d50 2024-09-11T23:16:09.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c940ad020 con 0x7f7c88004d50 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7c9b7fe640 1 -- 172.21.15.94:0/3566965655 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c940a9740 con 0x7f7c88004d50 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3566965655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 msgr2=0x7f7c880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca2a27640 1 --2- 172.21.15.94:0/3566965655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400a8a0 tx=0x7f7c9401fb20 comp rx=0 tx=0).stop 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca0fc4640 1 -- 172.21.15.94:0/3566965655 reap_dead start 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3566965655 shutdown_connections 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3566965655 >> 172.21.15.94:0/3566965655 conn(0x7f7c9c08bf90 msgr2=0x7f7c9c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.159+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3566965655 shutdown_connections 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3566965655 wait complete. 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 Processor -- start 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- start start 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c9c09e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c09fa80 0x7f7c9c0a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c160d00 0x7f7c9c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c06ceb0 con 0x7f7c88004d50 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0d0020 con 0x7f7c9c09fa80 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c06d190 con 0x7f7c9c160d00 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c9c09e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c9c09e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36868/0 (socket says 172.21.15.94:36868) 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 -- 172.21.15.94:0/3684342097 learned_addr learned my addr 172.21.15.94:0/3684342097 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca0fc4640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c160d00 0x7f7c9c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c937fe640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c09fa80 0x7f7c9c0a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 -- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c160d00 msgr2=0x7f7c9c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c160d00 0x7f7c9c155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 -- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c09fa80 msgr2=0x7f7c9c0a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c09fa80 0x7f7c9c0a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 -- 172.21.15.94:0/3684342097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c09e9e0 con 0x7f7c88004d50 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca0fc4640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c160d00 0x7f7c9c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c9bfff640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c9c09e070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c010890 tx=0x7f7c8c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c997fa640 1 -- 172.21.15.94:0/3684342097 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00f040 con 0x7f7c88004d50 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c997fa640 1 -- 172.21.15.94:0/3684342097 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00eb60 con 0x7f7c88004d50 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c09ecc0 con 0x7f7c88004d50 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7c997fa640 1 -- 172.21.15.94:0/3684342097 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c01c400 con 0x7f7c88004d50 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c09f560 con 0x7f7c88004d50 2024-09-11T23:16:09.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.163+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c09ee90 con 0x7f7c88004d50 2024-09-11T23:16:09.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.167+0000 7f7c997fa640 1 -- 172.21.15.94:0/3684342097 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c8c01c5a0 con 0x7f7c88004d50 2024-09-11T23:16:09.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.167+0000 7f7c997fa640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7c7c0678c0 0x7f7c7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.167+0000 7f7c997fa640 1 -- 172.21.15.94:0/3684342097 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f7c8c086190 con 0x7f7c88004d50 2024-09-11T23:16:09.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.167+0000 7f7c937fe640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7c7c0678c0 0x7f7c7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.167+0000 7f7c937fe640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7c7c0678c0 0x7f7c7c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c09fe80 tx=0x7f7c84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.171+0000 7f7c997fa640 1 -- 172.21.15.94:0/3684342097 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7c8c018030 con 0x7f7c88004d50 2024-09-11T23:16:09.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.395+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f7c9c0cf900 con 0x7f7c88004d50 2024-09-11T23:16:09.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7c997fa640 1 -- 172.21.15.94:0/3684342097 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f7c8c056e90 con 0x7f7c88004d50 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7c7c0678c0 msgr2=0x7f7c7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7c7c0678c0 0x7f7c7c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c09fe80 tx=0x7f7c84008040 comp rx=0 tx=0).stop 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 msgr2=0x7f7c9c09e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c9c09e070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c010890 tx=0x7f7c8c010d50 comp rx=0 tx=0).stop 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 shutdown_connections 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c160d00 0x7f7c9c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c09fa80 0x7f7c9c0a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7c7c0678c0 0x7f7c7c069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 --2- 172.21.15.94:0/3684342097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c88004d50 0x7f7c9c09e070 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 >> 172.21.15.94:0/3684342097 conn(0x7f7c9c08bf90 msgr2=0x7f7c9c0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:09.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 shutdown_connections 2024-09-11T23:16:09.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.399+0000 7f7ca2a27640 1 -- 172.21.15.94:0/3684342097 wait complete. 2024-09-11T23:16:09.421 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-11T23:16:09.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.535+0000 7fd17ad0d640 1 Processor -- start 2024-09-11T23:16:09.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.535+0000 7fd17ad0d640 1 -- start start 2024-09-11T23:16:09.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.535+0000 7fd17ad0d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.535+0000 7fd17ad0d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1740cd8e0 0x7fd17406c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.535+0000 7fd17ad0d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1740ce030 con 0x7fd1741609f0 2024-09-11T23:16:09.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.535+0000 7fd17ad0d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd1740ce310 con 0x7fd1740cd8e0 2024-09-11T23:16:09.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.535+0000 7fd17ad0d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd1740ce5f0 con 0x7fd1740d0b70 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd173fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd1792aa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1740cd8e0 0x7fd17406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd178aa9640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd1741609f0 0x7fd1740d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:34420/0 (socket says 172.21.15.94:34420) 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd173fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17406bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:34902/0 (socket says 172.21.15.94:34902) 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd178aa9640 1 -- 172.21.15.94:0/3354699823 learned_addr learned my addr 172.21.15.94:0/3354699823 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd173fff640 1 -- 172.21.15.94:0/3354699823 >> v2:172.21.15.155:3300/0 conn(0x7fd1740cd8e0 msgr2=0x7fd17406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd173fff640 1 --2- 172.21.15.94:0/3354699823 >> v2:172.21.15.155:3300/0 conn(0x7fd1740cd8e0 0x7fd17406c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd173fff640 1 -- 172.21.15.94:0/3354699823 >> v1:172.21.15.155:6789/0 conn(0x7fd1741609f0 legacy=0x7fd1740d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd173fff640 1 -- 172.21.15.94:0/3354699823 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1740cdd20 con 0x7fd1740d0b70 2024-09-11T23:16:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd1792aa640 1 --2- 172.21.15.94:0/3354699823 >> v2:172.21.15.155:3300/0 conn(0x7fd1740cd8e0 0x7fd17406c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd173fff640 1 --2- 172.21.15.94:0/3354699823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17406bcc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097c0 tx=0x7fd16801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3b213a091879368 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd1737fe640 1 -- 172.21.15.94:0/3354699823 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1680ab430 con 0x7fd1740d0b70 2024-09-11T23:16:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd1737fe640 1 -- 172.21.15.94:0/3354699823 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1680b0070 con 0x7fd1740d0b70 2024-09-11T23:16:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.539+0000 7fd1737fe640 1 -- 172.21.15.94:0/3354699823 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1680ab7f0 con 0x7fd1740d0b70 2024-09-11T23:16:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- 172.21.15.94:0/3354699823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 msgr2=0x7fd17406bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/3354699823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17406bcc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097c0 tx=0x7fd16801c410 comp rx=0 tx=0).stop 2024-09-11T23:16:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- 172.21.15.94:0/3354699823 shutdown_connections 2024-09-11T23:16:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/3354699823 >> v2:172.21.15.155:3300/0 conn(0x7fd1740cd8e0 0x7fd17406c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/3354699823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17406bcc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- 172.21.15.94:0/3354699823 >> 172.21.15.94:0/3354699823 conn(0x7fd17409aa00 msgr2=0x7fd1740b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- 172.21.15.94:0/3354699823 shutdown_connections 2024-09-11T23:16:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- 172.21.15.94:0/3354699823 wait complete. 2024-09-11T23:16:09.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 Processor -- start 2024-09-11T23:16:09.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- start start 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740cd8e0 0x7fd17415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17409d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1741609f0 0x7fd17409b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd17406cb10 con 0x7fd1741609f0 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd17406c990 con 0x7fd1740cd8e0 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd1741698d0 con 0x7fd1740d0b70 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1741609f0 0x7fd17409b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1741609f0 0x7fd17409b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36878/0 (socket says 172.21.15.94:36878) 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 -- 172.21.15.94:0/1825789822 learned_addr learned my addr 172.21.15.94:0/1825789822 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd178aa9640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740cd8e0 0x7fd17415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd173fff640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 -- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 msgr2=0x7fd17409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 -- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740cd8e0 msgr2=0x7fd17415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740cd8e0 0x7fd17415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 -- 172.21.15.94:0/1825789822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17409bc50 con 0x7fd1741609f0 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1792aa640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1741609f0 0x7fd17409b400 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00efc0 tx=0x7fd16c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1717fa640 1 -- 172.21.15.94:0/1825789822 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c018030 con 0x7fd1741609f0 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1717fa640 1 -- 172.21.15.94:0/1825789822 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16c00cdf0 con 0x7fd1741609f0 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17409bf30 con 0x7fd1741609f0 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd1717fa640 1 -- 172.21.15.94:0/1825789822 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c003bc0 con 0x7fd1741609f0 2024-09-11T23:16:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.543+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1740b44b0 con 0x7fd1741609f0 2024-09-11T23:16:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.547+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17409c450 con 0x7fd1741609f0 2024-09-11T23:16:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.547+0000 7fd1717fa640 1 -- 172.21.15.94:0/1825789822 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd16c01b070 con 0x7fd1741609f0 2024-09-11T23:16:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.547+0000 7fd1717fa640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1600678c0 0x7fd160069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.547+0000 7fd1717fa640 1 -- 172.21.15.94:0/1825789822 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fd16c0863f0 con 0x7fd1741609f0 2024-09-11T23:16:09.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.547+0000 7fd178aa9640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1600678c0 0x7fd160069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.547+0000 7fd178aa9640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1600678c0 0x7fd160069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd164000f70 tx=0x7fd164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.551+0000 7fd1717fa640 1 -- 172.21.15.94:0/1825789822 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd16c022070 con 0x7fd1741609f0 2024-09-11T23:16:09.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.775+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fd1740d0460 con 0x7fd1741609f0 2024-09-11T23:16:09.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.779+0000 7fd1717fa640 1 -- 172.21.15.94:0/1825789822 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fd16c010040 con 0x7fd1741609f0 2024-09-11T23:16:09.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1600678c0 msgr2=0x7fd160069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1600678c0 0x7fd160069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd164000f70 tx=0x7fd164009040 comp rx=0 tx=0).stop 2024-09-11T23:16:09.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1741609f0 msgr2=0x7fd17409b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1741609f0 0x7fd17409b400 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00efc0 tx=0x7fd16c00c490 comp rx=0 tx=0).stop 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 shutdown_connections 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1600678c0 0x7fd160069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1741609f0 0x7fd17409b400 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1740d0b70 0x7fd17409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 --2- 172.21.15.94:0/1825789822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740cd8e0 0x7fd17415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 >> 172.21.15.94:0/1825789822 conn(0x7fd17409aa00 msgr2=0x7fd1740cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 shutdown_connections 2024-09-11T23:16:09.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.783+0000 7fd17ad0d640 1 -- 172.21.15.94:0/1825789822 wait complete. 2024-09-11T23:16:09.803 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-11T23:16:09.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.919+0000 7ff5f7c4f640 1 Processor -- start 2024-09-11T23:16:09.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.919+0000 7ff5f7c4f640 1 -- start start 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f7c4f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff5f00cf620 0x7ff5f0168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f7c4f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f00d0300 con 0x7ff5f0161a60 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f7c4f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f006e6c0 con 0x7ff5f00d3060 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f7c4f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f00cfa90 con 0x7ff5f00cf620 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f59eb640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff5f0161a60 0x7ff5f00d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59504/0 (socket says 172.21.15.94:59504) 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f59eb640 1 -- 172.21.15.94:0/3957310270 learned_addr learned my addr 172.21.15.94:0/3957310270 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750562373 0 0) 0x7ff5ec001120 con 0x7ff5f0161a60 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/3957310270 >> v2:172.21.15.155:3300/0 conn(0x7ff5f00cf620 0x7ff5f0168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5dc003530 con 0x7ff5f0161a60 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3135047868 0 0) 0x7ff5dc003530 con 0x7ff5f0161a60 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 >> v2:172.21.15.155:3300/0 conn(0x7ff5f00cf620 msgr2=0x7ff5f0168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 --2- 172.21.15.94:0/3957310270 >> v2:172.21.15.155:3300/0 conn(0x7ff5f00cf620 0x7ff5f0168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 >> v1:172.21.15.155:6789/0 conn(0x7ff5f00d3060 legacy=0x7ff5f00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f00b0f60 con 0x7ff5f0161a60 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7ff5ec001850 con 0x7ff5f0161a60 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/3957310270 >> v2:172.21.15.155:3300/0 conn(0x7ff5f00cf620 0x7ff5f0168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:09.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 >> v1:172.21.15.94:6789/0 conn(0x7ff5f0161a60 legacy=0x7ff5f00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0039c0 0x7ff5dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5dc004810 0x7ff5dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5dc0052f0 0x7ff5dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f00cfa90 con 0x7ff5dc0052f0 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc00c1c0 con 0x7ff5dc004810 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5dc00c3c0 con 0x7ff5dc0039c0 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5dc0052f0 0x7ff5dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f51ea640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5dc004810 0x7ff5dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 -- 172.21.15.94:0/3957310270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0039c0 msgr2=0x7ff5dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0039c0 0x7ff5dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 -- 172.21.15.94:0/3957310270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5dc004810 msgr2=0x7ff5dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:09.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5dc004810 0x7ff5dc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 -- 172.21.15.94:0/3957310270 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc003530 con 0x7ff5dc0052f0 2024-09-11T23:16:09.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.923+0000 7ff5f61ec640 1 -- 172.21.15.94:0/3957310270 reap_dead start 2024-09-11T23:16:09.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5dc0052f0 0x7ff5dc00b9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80073b0 tx=0x7ff5e801ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e82e2f3cc37281 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8009c80 con 0x7ff5dc0052f0 2024-09-11T23:16:09.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e80a5d60 con 0x7ff5dc0052f0 2024-09-11T23:16:09.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f49e9640 1 -- 172.21.15.94:0/3957310270 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80ad680 con 0x7ff5dc0052f0 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/3957310270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5dc0052f0 msgr2=0x7ff5dc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5dc0052f0 0x7ff5dc00b9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80073b0 tx=0x7ff5e801ce60 comp rx=0 tx=0).stop 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/3957310270 shutdown_connections 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/3957310270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5dc0052f0 0x7ff5dc00b9d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/3957310270 >> 172.21.15.94:0/3957310270 conn(0x7ff5f008bf90 msgr2=0x7ff5f009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/3957310270 shutdown_connections 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/3957310270 wait complete. 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 Processor -- start 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- start start 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0052f0 0x7ff5f01f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f01f77d0 0x7ff5f015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5f015c7e0 0x7ff5f0157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f006d190 con 0x7ff5f015c7e0 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f006ceb0 con 0x7ff5f01f77d0 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f00cfc70 con 0x7ff5dc0052f0 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5f015c7e0 0x7ff5f0157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5f015c7e0 0x7ff5f0157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42742/0 (socket says 172.21.15.94:42742) 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 -- 172.21.15.94:0/2743207199 learned_addr learned my addr 172.21.15.94:0/2743207199 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f59eb640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0052f0 0x7ff5f01f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f51ea640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f01f77d0 0x7ff5f015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 -- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0052f0 msgr2=0x7ff5f01f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0052f0 0x7ff5f01f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 -- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f01f77d0 msgr2=0x7ff5f015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f01f77d0 0x7ff5f015c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 -- 172.21.15.94:0/2743207199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f0156da0 con 0x7ff5f015c7e0 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f59eb640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0052f0 0x7ff5f01f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f51ea640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f01f77d0 0x7ff5f015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f61ec640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5f015c7e0 0x7ff5f0157b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c030 tx=0x7ff5dc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5e67fc640 1 -- 172.21.15.94:0/2743207199 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80ada40 con 0x7ff5f015c7e0 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5e67fc640 1 -- 172.21.15.94:0/2743207199 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e80adc00 con 0x7ff5f015c7e0 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5e67fc640 1 -- 172.21.15.94:0/2743207199 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80b93f0 con 0x7ff5f015c7e0 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f0157080 con 0x7ff5f015c7e0 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.927+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f0157640 con 0x7ff5f015c7e0 2024-09-11T23:16:09.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.931+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f00cef10 con 0x7ff5f015c7e0 2024-09-11T23:16:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.931+0000 7ff5e67fc640 1 -- 172.21.15.94:0/2743207199 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5e80ac3e0 con 0x7ff5f015c7e0 2024-09-11T23:16:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.931+0000 7ff5e67fc640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5d40678c0 0x7ff5d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.931+0000 7ff5e67fc640 1 -- 172.21.15.94:0/2743207199 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ff5e811ff40 con 0x7ff5f015c7e0 2024-09-11T23:16:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.931+0000 7ff5f59eb640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5d40678c0 0x7ff5d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.931+0000 7ff5f59eb640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5d40678c0 0x7ff5d4069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec004880 tx=0x7ff5ec00c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:09.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:09.935+0000 7ff5e67fc640 1 -- 172.21.15.94:0/2743207199 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5e80b5070 con 0x7ff5f015c7e0 2024-09-11T23:16:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.155+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff5f015f710 con 0x7ff5f015c7e0 2024-09-11T23:16:10.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.159+0000 7ff5e67fc640 1 -- 172.21.15.94:0/2743207199 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7ff5e8016c30 con 0x7ff5f015c7e0 2024-09-11T23:16:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.159+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5d40678c0 msgr2=0x7ff5d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.159+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5d40678c0 0x7ff5d4069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec004880 tx=0x7ff5ec00c040 comp rx=0 tx=0).stop 2024-09-11T23:16:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5f015c7e0 msgr2=0x7ff5f0157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5f015c7e0 0x7ff5f0157b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c030 tx=0x7ff5dc005840 comp rx=0 tx=0).stop 2024-09-11T23:16:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 shutdown_connections 2024-09-11T23:16:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5d40678c0 0x7ff5d4069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5f015c7e0 0x7ff5f0157b60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f01f77d0 0x7ff5f015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 --2- 172.21.15.94:0/2743207199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5dc0052f0 0x7ff5f01f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 >> 172.21.15.94:0/2743207199 conn(0x7ff5f008bf90 msgr2=0x7ff5f006dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 shutdown_connections 2024-09-11T23:16:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.163+0000 7ff5f7c4f640 1 -- 172.21.15.94:0/2743207199 wait complete. 2024-09-11T23:16:10.182 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-11T23:16:10.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 Processor -- start 2024-09-11T23:16:10.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 -- start start 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc180ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcc1815c2a0 0x7fcc180aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc180af2a0 0x7fcc1815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcc180b3290 con 0x7fcc1815c2a0 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcc180b3570 con 0x7fcc180af2a0 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1c985640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc180b3850 con 0x7fcc1815bec0 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcc1815c2a0 0x7fcc180aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc1659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc180ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcc1815c2a0 0x7fcc180aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42746/0 (socket says 172.21.15.94:42746) 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 -- 172.21.15.94:0/1186716092 learned_addr learned my addr 172.21.15.94:0/1186716092 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc16d9d640 1 --2- 172.21.15.94:0/1186716092 >> v2:172.21.15.155:3300/0 conn(0x7fcc180af2a0 0x7fcc1815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 -- 172.21.15.94:0/1186716092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 msgr2=0x7fcc180ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 --2- 172.21.15.94:0/1186716092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc180ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 -- 172.21.15.94:0/1186716092 >> v2:172.21.15.155:3300/0 conn(0x7fcc180af2a0 msgr2=0x7fcc1815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 --2- 172.21.15.94:0/1186716092 >> v2:172.21.15.155:3300/0 conn(0x7fcc180af2a0 0x7fcc1815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc15d9b640 1 -- 172.21.15.94:0/1186716092 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc180b3b30 con 0x7fcc1815c2a0 2024-09-11T23:16:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.299+0000 7fcc16d9d640 1 --2- 172.21.15.94:0/1186716092 >> v2:172.21.15.155:3300/0 conn(0x7fcc180af2a0 0x7fcc1815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:10.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc15d9b640 1 --2- 172.21.15.94:0/1186716092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc180aed60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcc180ada40 tx=0x7fcc0c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d5c271004dd0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1559a640 1 -- 172.21.15.94:0/1186716092 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0b0070 con 0x7fcc1815c2a0 2024-09-11T23:16:10.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1559a640 1 -- 172.21.15.94:0/1186716092 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c0ab600 con 0x7fcc1815c2a0 2024-09-11T23:16:10.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1559a640 1 -- 172.21.15.94:0/1186716092 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0ab9d0 con 0x7fcc1815c2a0 2024-09-11T23:16:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 -- 172.21.15.94:0/1186716092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 msgr2=0x7fcc180aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 --2- 172.21.15.94:0/1186716092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc180aed60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcc180ada40 tx=0x7fcc0c01c230 comp rx=0 tx=0).stop 2024-09-11T23:16:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 -- 172.21.15.94:0/1186716092 shutdown_connections 2024-09-11T23:16:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 --2- 172.21.15.94:0/1186716092 >> v2:172.21.15.155:3300/0 conn(0x7fcc180af2a0 0x7fcc1815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 --2- 172.21.15.94:0/1186716092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc180aed60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 --2- 172.21.15.94:0/1186716092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc180ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 -- 172.21.15.94:0/1186716092 >> 172.21.15.94:0/1186716092 conn(0x7fcc180b1f90 msgr2=0x7fcc180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 -- 172.21.15.94:0/1186716092 shutdown_connections 2024-09-11T23:16:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 -- 172.21.15.94:0/1186716092 wait complete. 2024-09-11T23:16:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 Processor -- start 2024-09-11T23:16:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 -- start start 2024-09-11T23:16:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc180af2a0 0x7fcc1815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc18166740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.303+0000 7fcc1c985640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc181413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1c985640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc180af6b0 con 0x7fcc1815c2a0 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1c985640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc180ad740 con 0x7fcc180af2a0 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1c985640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1806e000 con 0x7fcc1815bec0 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc181413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc181413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42760/0 (socket says 172.21.15.94:42760) 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 -- 172.21.15.94:0/2634579126 learned_addr learned my addr 172.21.15.94:0/2634579126 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1659c640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc180af2a0 0x7fcc1815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc15d9b640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc18166740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 -- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 msgr2=0x7fcc18166740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc18166740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 -- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc180af2a0 msgr2=0x7fcc1815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc180af2a0 0x7fcc1815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 -- 172.21.15.94:0/2634579126 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc18165080 con 0x7fcc1815c2a0 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1659c640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc180af2a0 0x7fcc1815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc16d9d640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc181413d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009fd0 tx=0x7fcc1000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc06ffd640 1 -- 172.21.15.94:0/2634579126 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1001a070 con 0x7fcc1815c2a0 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc06ffd640 1 -- 172.21.15.94:0/2634579126 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc10003bc0 con 0x7fcc1815c2a0 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc06ffd640 1 -- 172.21.15.94:0/2634579126 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10004030 con 0x7fcc1815c2a0 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc18141c20 con 0x7fcc1815c2a0 2024-09-11T23:16:10.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc18165320 con 0x7fcc1815c2a0 2024-09-11T23:16:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc180ad200 con 0x7fcc1815c2a0 2024-09-11T23:16:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc06ffd640 1 -- 172.21.15.94:0/2634579126 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc1001d070 con 0x7fcc1815c2a0 2024-09-11T23:16:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc06ffd640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc06ffd640 1 -- 172.21.15.94:0/2634579126 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fcc100862a0 con 0x7fcc1815c2a0 2024-09-11T23:16:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.307+0000 7fcc1659c640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.311+0000 7fcc1659c640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcbf80678c0 0x7fcbf8069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc1815a7b0 tx=0x7fcc08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.311+0000 7fcc06ffd640 1 -- 172.21.15.94:0/2634579126 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcc10024080 con 0x7fcc1815c2a0 2024-09-11T23:16:10.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.527+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fcc1806fcd0 con 0x7fcc1815c2a0 2024-09-11T23:16:10.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.531+0000 7fcc06ffd640 1 -- 172.21.15.94:0/2634579126 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7fcc10010070 con 0x7fcc1815c2a0 2024-09-11T23:16:10.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcbf80678c0 msgr2=0x7fcbf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcbf80678c0 0x7fcbf8069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc1815a7b0 tx=0x7fcc08008040 comp rx=0 tx=0).stop 2024-09-11T23:16:10.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 msgr2=0x7fcc181413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc181413d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009fd0 tx=0x7fcc1000d560 comp rx=0 tx=0).stop 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 shutdown_connections 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc1815c2a0 0x7fcc181413d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc1815bec0 0x7fcc18166740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 --2- 172.21.15.94:0/2634579126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc180af2a0 0x7fcc1815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 >> 172.21.15.94:0/2634579126 conn(0x7fcc180b1f90 msgr2=0x7fcc18159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 shutdown_connections 2024-09-11T23:16:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.535+0000 7fcc1c985640 1 -- 172.21.15.94:0/2634579126 wait complete. 2024-09-11T23:16:10.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-11T23:16:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa5a5a55640 1 Processor -- start 2024-09-11T23:16:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa5a5a55640 1 -- start start 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa5a5a55640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5a015f830 0x7fa5a006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa5a5a55640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 0x7fa5a006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa5a5a55640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a015fc10 con 0x7fa5a015d290 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa5a5a55640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a015da40 con 0x7fa5a015f830 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa5a5a55640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a015d800 con 0x7fa5a015eee0 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59e7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa5a015d290 0x7fa5a015fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59510/0 (socket says 172.21.15.94:59510) 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59e7fc640 1 -- 172.21.15.94:0/2722072398 learned_addr learned my addr 172.21.15.94:0/2722072398 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59effd640 1 --2- 172.21.15.94:0/2722072398 >> v2:172.21.15.155:3300/0 conn(0x7fa5a015f830 0x7fa5a006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901134058 0 0) 0x7fa5a015fc10 con 0x7fa5a015d290 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa588003530 con 0x7fa5a015d290 2024-09-11T23:16:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 0x7fa5a006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 811385102 0 0) 0x7fa588003530 con 0x7fa5a015d290 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 msgr2=0x7fa5a006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 0x7fa5a006c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 >> v2:172.21.15.155:3300/0 conn(0x7fa5a015f830 msgr2=0x7fa5a006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 --2- 172.21.15.94:0/2722072398 >> v2:172.21.15.155:3300/0 conn(0x7fa5a015f830 0x7fa5a006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a00b3570 con 0x7fa5a015d290 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fa594001680 con 0x7fa5a015d290 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 >> v1:172.21.15.94:6789/0 conn(0x7fa5a015d290 legacy=0x7fa5a015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 0x7fa5880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588003ff0 0x7fa588004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa588004d50 0x7fa5880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a015da40 con 0x7fa588004d50 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a015d800 con 0x7fa588003ff0 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa58800bad0 con 0x7fa5a015eee0 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa588004d50 0x7fa5880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59effd640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 0x7fa5880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59e7fc640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588003ff0 0x7fa588004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59f7fe640 1 -- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 msgr2=0x7fa5880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a015eee0 0x7fa5880039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59f7fe640 1 -- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588003ff0 msgr2=0x7fa588004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588003ff0 0x7fa588004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.663+0000 7fa59f7fe640 1 -- 172.21.15.94:0/2722072398 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa588003530 con 0x7fa588004d50 2024-09-11T23:16:10.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa588004d50 0x7fa5880051d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa598009fc0 tx=0x7fa59801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be330c9f1a6b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5980b2070 con 0x7fa588004d50 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5980a5d00 con 0x7fa588004d50 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa59dffb640 1 -- 172.21.15.94:0/2722072398 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa598009bc0 con 0x7fa588004d50 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 -- 172.21.15.94:0/2722072398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa588004d50 msgr2=0x7fa5880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 --2- 172.21.15.94:0/2722072398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa588004d50 0x7fa5880051d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa598009fc0 tx=0x7fa59801ce00 comp rx=0 tx=0).stop 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa59f7fe640 1 -- 172.21.15.94:0/2722072398 reap_dead start 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 -- 172.21.15.94:0/2722072398 shutdown_connections 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 -- 172.21.15.94:0/2722072398 >> 172.21.15.94:0/2722072398 conn(0x7fa5a00b6800 msgr2=0x7fa5a00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 -- 172.21.15.94:0/2722072398 shutdown_connections 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 -- 172.21.15.94:0/2722072398 wait complete. 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 Processor -- start 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.667+0000 7fa5a5a55640 1 -- start start 2024-09-11T23:16:10.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a0143a10 0x7fa5a01530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5a0143df0 0x7fa5a009e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5a014cd10 0x7fa5a009ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a0073460 con 0x7fa5a014cd10 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a00b3b30 con 0x7fa5a0143df0 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a00735e0 con 0x7fa5a0143a10 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5a014cd10 0x7fa5a009ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5a014cd10 0x7fa5a009ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42768/0 (socket says 172.21.15.94:42768) 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 -- 172.21.15.94:0/1708032887 learned_addr learned my addr 172.21.15.94:0/1708032887 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59e7fc640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5a0143df0 0x7fa5a009e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59effd640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a0143a10 0x7fa5a01530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 -- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a0143a10 msgr2=0x7fa5a01530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a0143a10 0x7fa5a01530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 -- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5a0143df0 msgr2=0x7fa5a009e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5a0143df0 0x7fa5a009e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 -- 172.21.15.94:0/1708032887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a01538d0 con 0x7fa5a014cd10 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59f7fe640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5a014cd10 0x7fa5a009ebc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa598002240 tx=0x7fa598019ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa587fff640 1 -- 172.21.15.94:0/1708032887 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5980b2070 con 0x7fa5a014cd10 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa587fff640 1 -- 172.21.15.94:0/1708032887 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5980bc070 con 0x7fa5a014cd10 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a0153bb0 con 0x7fa5a014cd10 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa587fff640 1 -- 172.21.15.94:0/1708032887 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa598009bc0 con 0x7fa5a014cd10 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a009b710 con 0x7fa5a014cd10 2024-09-11T23:16:10.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a009aa00 con 0x7fa5a014cd10 2024-09-11T23:16:10.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa587fff640 1 -- 172.21.15.94:0/1708032887 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5980c1460 con 0x7fa5a014cd10 2024-09-11T23:16:10.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa587fff640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa58c0678c0 0x7fa58c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa587fff640 1 -- 172.21.15.94:0/1708032887 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa5981204e0 con 0x7fa5a014cd10 2024-09-11T23:16:10.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.671+0000 7fa59effd640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa58c0678c0 0x7fa58c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.675+0000 7fa59effd640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa58c0678c0 0x7fa58c069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa59000ba30 tx=0x7fa590008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.675+0000 7fa587fff640 1 -- 172.21.15.94:0/1708032887 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa598016b10 con 0x7fa5a014cd10 2024-09-11T23:16:10.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.883+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fa5a006e7c0 con 0x7fa5a014cd10 2024-09-11T23:16:10.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.883+0000 7fa587fff640 1 -- 172.21.15.94:0/1708032887 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fa5980f1150 con 0x7fa5a014cd10 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa58c0678c0 msgr2=0x7fa58c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa58c0678c0 0x7fa58c069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa59000ba30 tx=0x7fa590008040 comp rx=0 tx=0).stop 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5a014cd10 msgr2=0x7fa5a009ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5a014cd10 0x7fa5a009ebc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa598002240 tx=0x7fa598019ba0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 shutdown_connections 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa58c0678c0 0x7fa58c069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5a014cd10 0x7fa5a009ebc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5a0143df0 0x7fa5a009e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 --2- 172.21.15.94:0/1708032887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5a0143a10 0x7fa5a01530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 >> 172.21.15.94:0/1708032887 conn(0x7fa5a00b6800 msgr2=0x7fa5a00b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:10.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 shutdown_connections 2024-09-11T23:16:10.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:10.887+0000 7fa5a5a55640 1 -- 172.21.15.94:0/1708032887 wait complete. 2024-09-11T23:16:10.907 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:16:11.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702c61e640 1 Processor -- start 2024-09-11T23:16:11.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702c61e640 1 -- start start 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702c61e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70241520a0 0x7f702406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702c61e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f702406fe50 0x7f702415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702c61e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7024070250 con 0x7f702415f1d0 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702c61e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7024152480 con 0x7f702406fe50 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702c61e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70240aede0 con 0x7f70241520a0 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702abbb640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f702415f1d0 0x7f7024071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59518/0 (socket says 172.21.15.94:59518) 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702abbb640 1 -- 172.21.15.94:0/255133714 learned_addr learned my addr 172.21.15.94:0/255133714 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f7029bb9640 1 --2- 172.21.15.94:0/255133714 >> v2:172.21.15.155:3300/0 conn(0x7f702406fe50 0x7f702415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457747051 0 0) 0x7f7024070250 con 0x7f702415f1d0 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f702a3ba640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70241520a0 0x7f702406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7010003530 con 0x7f702415f1d0 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2956670938 0 0) 0x7f7010003530 con 0x7f702415f1d0 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70241520a0 msgr2=0x7f702406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70241520a0 0x7f702406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 >> v2:172.21.15.155:3300/0 conn(0x7f702406fe50 msgr2=0x7f702415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 --2- 172.21.15.94:0/255133714 >> v2:172.21.15.155:3300/0 conn(0x7f702406fe50 0x7f702415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702415fa10 con 0x7f702415f1d0 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f701c001a00 con 0x7f702415f1d0 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 >> v1:172.21.15.94:6789/0 conn(0x7f702415f1d0 legacy=0x7f7024071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70241520a0 0x7f70100039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7010003f40 0x7f7010004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004d50 0x7f70100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f70240aede0 con 0x7f7010003f40 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f701000b9d0 con 0x7f7010004d50 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f701000bb50 con 0x7f70241520a0 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f7029bb9640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7010003f40 0x7f7010004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f7029bb9640 1 -- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70241520a0 msgr2=0x7f70100039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f7029bb9640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70241520a0 0x7f70100039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f7029bb9640 1 -- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004d50 msgr2=0x7f70100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f7029bb9640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004d50 0x7f70100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.019+0000 7f7029bb9640 1 -- 172.21.15.94:0/255133714 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7010003530 con 0x7f7010003f40 2024-09-11T23:16:11.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f7029bb9640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7010003f40 0x7f7010004810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7014009ab0 tx=0x7f701401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeaf22921d6b0c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:11.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140b2070 con 0x7f7010003f40 2024-09-11T23:16:11.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70140a5680 con 0x7f7010003f40 2024-09-11T23:16:11.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f70293b8640 1 -- 172.21.15.94:0/255133714 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140096b0 con 0x7f7010003f40 2024-09-11T23:16:11.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- 172.21.15.94:0/255133714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7010003f40 msgr2=0x7f7010004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 --2- 172.21.15.94:0/255133714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7010003f40 0x7f7010004810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7014009ab0 tx=0x7f701401ca30 comp rx=0 tx=0).stop 2024-09-11T23:16:11.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702abbb640 1 -- 172.21.15.94:0/255133714 reap_dead start 2024-09-11T23:16:11.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- 172.21.15.94:0/255133714 shutdown_connections 2024-09-11T23:16:11.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- 172.21.15.94:0/255133714 >> 172.21.15.94:0/255133714 conn(0x7f70240b1f90 msgr2=0x7f70240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:11.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- 172.21.15.94:0/255133714 shutdown_connections 2024-09-11T23:16:11.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- 172.21.15.94:0/255133714 wait complete. 2024-09-11T23:16:11.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 Processor -- start 2024-09-11T23:16:11.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- start start 2024-09-11T23:16:11.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7010003f40 0x7f7024154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70241507a0 0x7f702409d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7024071f10 0x7f7024072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7024073770 con 0x7f70241507a0 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7024073490 con 0x7f7024071f10 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.023+0000 7f702c61e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7024073a50 con 0x7f7010003f40 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70241507a0 0x7f702409d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70241507a0 0x7f702409d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42784/0 (socket says 172.21.15.94:42784) 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 -- 172.21.15.94:0/2940630028 learned_addr learned my addr 172.21.15.94:0/2940630028 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f702abbb640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7024071f10 0x7f7024072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f702a3ba640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7010003f40 0x7f7024154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 -- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7010003f40 msgr2=0x7f7024154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7010003f40 0x7f7024154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 -- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7024071f10 msgr2=0x7f7024072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7024071f10 0x7f7024072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 -- 172.21.15.94:0/2940630028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702409e080 con 0x7f70241507a0 2024-09-11T23:16:11.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f7029bb9640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70241507a0 0x7f702409d770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f701401c860 tx=0x7f7010005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:11.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f701affd640 1 -- 172.21.15.94:0/2940630028 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140ba030 con 0x7f70241507a0 2024-09-11T23:16:11.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f701affd640 1 -- 172.21.15.94:0/2940630028 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701400f000 con 0x7f70241507a0 2024-09-11T23:16:11.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702409a520 con 0x7f70241507a0 2024-09-11T23:16:11.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f701affd640 1 -- 172.21.15.94:0/2940630028 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140b2040 con 0x7f70241507a0 2024-09-11T23:16:11.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702409aae0 con 0x7f70241507a0 2024-09-11T23:16:11.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70240728d0 con 0x7f70241507a0 2024-09-11T23:16:11.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f701affd640 1 -- 172.21.15.94:0/2940630028 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70140bd070 con 0x7f70241507a0 2024-09-11T23:16:11.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f701affd640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70080678c0 0x7f7008069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f701affd640 1 -- 172.21.15.94:0/2940630028 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f701411f570 con 0x7f70241507a0 2024-09-11T23:16:11.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f702a3ba640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70080678c0 0x7f7008069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.027+0000 7f702a3ba640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70080678c0 0x7f7008069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70200098b0 tx=0x7f7020008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:11.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.031+0000 7f701affd640 1 -- 172.21.15.94:0/2940630028 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f70140167a0 con 0x7f70241507a0 2024-09-11T23:16:11.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.183+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7024073d30 con 0x7f70241507a0 2024-09-11T23:16:11.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.183+0000 7f701affd640 1 -- 172.21.15.94:0/2940630028 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f70140f0270 con 0x7f70241507a0 2024-09-11T23:16:11.189 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:11.189 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:16:11.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:11.190 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:16:11.190 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:16:11.190 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:11.190 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:16:11.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70080678c0 msgr2=0x7f7008069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70080678c0 0x7f7008069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70200098b0 tx=0x7f7020008040 comp rx=0 tx=0).stop 2024-09-11T23:16:11.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70241507a0 msgr2=0x7f702409d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70241507a0 0x7f702409d770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f701401c860 tx=0x7f7010005840 comp rx=0 tx=0).stop 2024-09-11T23:16:11.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 shutdown_connections 2024-09-11T23:16:11.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7024071f10 0x7f7024072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70080678c0 0x7f7008069d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70241507a0 0x7f702409d770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 --2- 172.21.15.94:0/2940630028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7010003f40 0x7f7024154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 >> 172.21.15.94:0/2940630028 conn(0x7f70240b1f90 msgr2=0x7f70240ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:11.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 shutdown_connections 2024-09-11T23:16:11.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.187+0000 7f702c61e640 1 -- 172.21.15.94:0/2940630028 wait complete. 2024-09-11T23:16:11.207 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:16:11.207 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:16:11.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.327+0000 7fcfc2a05640 1 Processor -- start 2024-09-11T23:16:11.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.327+0000 7fcfc2a05640 1 -- start start 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfc2a05640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcfbc0d3060 0x7fcfbc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfc2a05640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc0d0300 con 0x7fcfbc161a60 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfc2a05640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc0b0f60 con 0x7fcfbc0cf450 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfc2a05640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcfbc0cfd40 con 0x7fcfbc0d3060 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcfbc161a60 0x7fcfbc0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59532/0 (socket says 172.21.15.94:59532) 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 -- 172.21.15.94:0/4039653458 learned_addr learned my addr 172.21.15.94:0/4039653458 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315414293 0 0) 0x7fcfac001120 con 0x7fcfbc161a60 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfa8003530 con 0x7fcfbc161a60 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfb37fe640 1 --2- 172.21.15.94:0/4039653458 >> v2:172.21.15.155:3300/0 conn(0x7fcfbc0d3060 0x7fcfbc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2711249411 0 0) 0x7fcfa8003530 con 0x7fcfbc161a60 2024-09-11T23:16:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 >> v2:172.21.15.155:3300/0 conn(0x7fcfbc0d3060 msgr2=0x7fcfbc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 --2- 172.21.15.94:0/4039653458 >> v2:172.21.15.155:3300/0 conn(0x7fcfbc0d3060 0x7fcfbc0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 >> v1:172.21.15.155:6789/0 conn(0x7fcfbc0cf450 legacy=0x7fcfbc06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc0d0020 con 0x7fcfbc161a60 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fcfac001850 con 0x7fcfbc161a60 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 >> v1:172.21.15.94:6789/0 conn(0x7fcfbc161a60 legacy=0x7fcfbc0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfa80039c0 0x7fcfa8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8004810 0x7fcfa8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa80051d0 0x7fcfa800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0cfd40 con 0x7fcfa80039c0 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa800c170 con 0x7fcfa80051d0 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa800c370 con 0x7fcfa8004810 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfa80039c0 0x7fcfa8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 -- 172.21.15.94:0/4039653458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8004810 msgr2=0x7fcfa8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:11.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8004810 0x7fcfa8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 -- 172.21.15.94:0/4039653458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa80051d0 msgr2=0x7fcfa800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa80051d0 0x7fcfa800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 -- 172.21.15.94:0/4039653458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa8003530 con 0x7fcfa80039c0 2024-09-11T23:16:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfc0fa2640 1 -- 172.21.15.94:0/4039653458 reap_dead start 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbbfff640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfa80039c0 0x7fcfa8003de0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c4c0 tx=0x7fcfac01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894968203fb65d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00c0e0 con 0x7fcfa80039c0 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac0a9070 con 0x7fcfa80039c0 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.331+0000 7fcfbb7fe640 1 -- 172.21.15.94:0/4039653458 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0a5dd0 con 0x7fcfa80039c0 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- 172.21.15.94:0/4039653458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfa80039c0 msgr2=0x7fcfa8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfa80039c0 0x7fcfa8003de0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c4c0 tx=0x7fcfac01cc50 comp rx=0 tx=0).stop 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- 172.21.15.94:0/4039653458 shutdown_connections 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/4039653458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfa80039c0 0x7fcfa8003de0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- 172.21.15.94:0/4039653458 >> 172.21.15.94:0/4039653458 conn(0x7fcfbc08bf90 msgr2=0x7fcfbc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- 172.21.15.94:0/4039653458 shutdown_connections 2024-09-11T23:16:11.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- 172.21.15.94:0/4039653458 wait complete. 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 Processor -- start 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- start start 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80039c0 0x7fcfbc1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfbc0ce220 0x7fcfbc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfbc15ea30 0x7fcfbc0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0d2ce0 con 0x7fcfbc15ea30 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0d2b60 con 0x7fcfbc0ce220 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc0d2e60 con 0x7fcfa80039c0 2024-09-11T23:16:11.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfbc15ea30 0x7fcfbc0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfbc15ea30 0x7fcfbc0cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42794/0 (socket says 172.21.15.94:42794) 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 -- 172.21.15.94:0/760832618 learned_addr learned my addr 172.21.15.94:0/760832618 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfbbfff640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80039c0 0x7fcfbc1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 -- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80039c0 msgr2=0x7fcfbc1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80039c0 0x7fcfbc1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 -- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfbc0ce220 msgr2=0x7fcfbc15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfb37fe640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfbc0ce220 0x7fcfbc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfbc0ce220 0x7fcfbc15e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 -- 172.21.15.94:0/760832618 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc15c000 con 0x7fcfbc15ea30 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfb37fe640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfbc0ce220 0x7fcfbc15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc0fa2640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfbc15ea30 0x7fcfbc0cbfc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc08dd40 tx=0x7fcfb400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfb97fa640 1 -- 172.21.15.94:0/760832618 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4017070 con 0x7fcfbc15ea30 2024-09-11T23:16:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfb97fa640 1 -- 172.21.15.94:0/760832618 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4007070 con 0x7fcfbc15ea30 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc160030 con 0x7fcfbc15ea30 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfb97fa640 1 -- 172.21.15.94:0/760832618 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007460 con 0x7fcfbc15ea30 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.335+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc0cb4e0 con 0x7fcfbc15ea30 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.339+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc0d1220 con 0x7fcfbc15ea30 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.339+0000 7fcfb97fa640 1 -- 172.21.15.94:0/760832618 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfb401a070 con 0x7fcfbc15ea30 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.339+0000 7fcfb97fa640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcf9c0678f0 0x7fcf9c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.339+0000 7fcfb97fa640 1 -- 172.21.15.94:0/760832618 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fcfb4084ca0 con 0x7fcfbc15ea30 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.339+0000 7fcfbbfff640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcf9c0678f0 0x7fcf9c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.339+0000 7fcfbbfff640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcf9c0678f0 0x7fcf9c069db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0ab000 tx=0x7fcfac0b0040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:11.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.343+0000 7fcfb97fa640 1 -- 172.21.15.94:0/760832618 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcfb40559a0 con 0x7fcfbc15ea30 2024-09-11T23:16:11.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:11.503+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcfbc06e250 con 0x7fcfbc15ea30 2024-09-11T23:16:12.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.283+0000 7fcfb97fa640 1 -- 172.21.15.94:0/760832618 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7fcfb40552a0 con 0x7fcfbc15ea30 2024-09-11T23:16:12.287 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:16:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcf9c0678f0 msgr2=0x7fcf9c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcf9c0678f0 0x7fcf9c069db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0ab000 tx=0x7fcfac0b0040 comp rx=0 tx=0).stop 2024-09-11T23:16:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfbc15ea30 msgr2=0x7fcfbc0cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfbc15ea30 0x7fcfbc0cbfc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc08dd40 tx=0x7fcfb400c960 comp rx=0 tx=0).stop 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 shutdown_connections 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcf9c0678f0 0x7fcf9c069db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfbc15ea30 0x7fcfbc0cbfc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfbc0ce220 0x7fcfbc15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 --2- 172.21.15.94:0/760832618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80039c0 0x7fcfbc1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 >> 172.21.15.94:0/760832618 conn(0x7fcfbc08bf90 msgr2=0x7fcfbc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 shutdown_connections 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.287+0000 7fcfc2a05640 1 -- 172.21.15.94:0/760832618 wait complete. 2024-09-11T23:16:12.316 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:16:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113c097640 1 Processor -- start 2024-09-11T23:16:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113c097640 1 -- start start 2024-09-11T23:16:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113c097640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 0x7f1134169240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113c097640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11340d0fc0 con 0x7f113415e3f0 2024-09-11T23:16:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113c097640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f113409bbf0 con 0x7f1134070e80 2024-09-11T23:16:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113c097640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f113415f7e0 con 0x7f11340d0b30 2024-09-11T23:16:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139e33640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f113415e3f0 0x7f113409b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59544/0 (socket says 172.21.15.94:59544) 2024-09-11T23:16:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139e33640 1 -- 172.21.15.94:0/3204635120 learned_addr learned my addr 172.21.15.94:0/3204635120 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:12.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693797188 0 0) 0x7f11340d0fc0 con 0x7f113415e3f0 2024-09-11T23:16:12.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1120003530 con 0x7f113415e3f0 2024-09-11T23:16:12.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113a634640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 0x7f1134169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3480245592 0 0) 0x7f1120003530 con 0x7f113415e3f0 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 msgr2=0x7f1134169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 0x7f1134169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 >> v1:172.21.15.155:6789/0 conn(0x7f1134070e80 legacy=0x7f11340d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11340700c0 con 0x7f113415e3f0 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f112c001a00 con 0x7f113415e3f0 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 >> v1:172.21.15.94:6789/0 conn(0x7f113415e3f0 legacy=0x7f113409b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 0x7f11200039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1120003f70 0x7f1120004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1120004d50 0x7f11200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f113415f7e0 con 0x7f1120003f70 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f112000bb40 con 0x7f1120004d50 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f112000bd40 con 0x7f11340d0b30 2024-09-11T23:16:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139632640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1120003f70 0x7f1120004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113a634640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1120004d50 0x7f11200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139e33640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 0x7f11200039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139632640 1 -- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 msgr2=0x7f11200039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139632640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11340d0b30 0x7f11200039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139632640 1 -- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1120004d50 msgr2=0x7f11200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139632640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1120004d50 0x7f11200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f1139632640 1 -- 172.21.15.94:0/3204635120 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1120003530 con 0x7f1120003f70 2024-09-11T23:16:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.447+0000 7f113a634640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1120004d50 0x7f11200051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f1139632640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1120003f70 0x7f1120004810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1124001780 tx=0x7f112401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2426315e7e4e4932 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240013a0 con 0x7f1120003f70 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11240a9070 con 0x7f1120003f70 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f1138e31640 1 -- 172.21.15.94:0/3204635120 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124003600 con 0x7f1120003f70 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 -- 172.21.15.94:0/3204635120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1120003f70 msgr2=0x7f1120004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 --2- 172.21.15.94:0/3204635120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1120003f70 0x7f1120004810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1124001780 tx=0x7f112401c420 comp rx=0 tx=0).stop 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113a634640 1 -- 172.21.15.94:0/3204635120 reap_dead start 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 -- 172.21.15.94:0/3204635120 shutdown_connections 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 -- 172.21.15.94:0/3204635120 >> 172.21.15.94:0/3204635120 conn(0x7f11340d21d0 msgr2=0x7f11340d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 -- 172.21.15.94:0/3204635120 shutdown_connections 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 -- 172.21.15.94:0/3204635120 wait complete. 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 Processor -- start 2024-09-11T23:16:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.451+0000 7f113c097640 1 -- start start 2024-09-11T23:16:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1120003f70 0x7f1134158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11341550d0 0x7f113415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11340b0050 0x7f11340b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1134070680 con 0x7f11341550d0 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f11340709f0 con 0x7f11340b0050 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f11340712d0 con 0x7f1120003f70 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11341550d0 0x7f113415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11341550d0 0x7f113415a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42820/0 (socket says 172.21.15.94:42820) 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 -- 172.21.15.94:0/639638969 learned_addr learned my addr 172.21.15.94:0/639638969 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139e33640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1120003f70 0x7f1134158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113a634640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11340b0050 0x7f11340b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 -- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1120003f70 msgr2=0x7f1134158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1120003f70 0x7f1134158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 -- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11340b0050 msgr2=0x7f11340b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11340b0050 0x7f11340b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 -- 172.21.15.94:0/639638969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1134159230 con 0x7f11341550d0 2024-09-11T23:16:12.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f1139632640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11341550d0 0x7f113415a270 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1124005040 tx=0x7f1120005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:12.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f112a7fc640 1 -- 172.21.15.94:0/639638969 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240b2040 con 0x7f11341550d0 2024-09-11T23:16:12.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f112a7fc640 1 -- 172.21.15.94:0/639638969 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11240bd070 con 0x7f11341550d0 2024-09-11T23:16:12.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113415be60 con 0x7f11341550d0 2024-09-11T23:16:12.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f112a7fc640 1 -- 172.21.15.94:0/639638969 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124007a40 con 0x7f11341550d0 2024-09-11T23:16:12.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113415c100 con 0x7f11341550d0 2024-09-11T23:16:12.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11340d0420 con 0x7f11341550d0 2024-09-11T23:16:12.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f112a7fc640 1 -- 172.21.15.94:0/639638969 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f11240ab070 con 0x7f11341550d0 2024-09-11T23:16:12.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.455+0000 7f112a7fc640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11180678f0 0x7f1118069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:12.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.459+0000 7f112a7fc640 1 -- 172.21.15.94:0/639638969 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f1124120730 con 0x7f11341550d0 2024-09-11T23:16:12.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.459+0000 7f1139e33640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11180678f0 0x7f1118069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:12.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.459+0000 7f1139e33640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11180678f0 0x7f1118069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f112c005d40 tx=0x7f112c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:12.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.463+0000 7f112a7fc640 1 -- 172.21.15.94:0/639638969 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1124016130 con 0x7f11341550d0 2024-09-11T23:16:12.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:12.611+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f11340b8150 con 0x7f11341550d0 2024-09-11T23:16:13.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.287+0000 7f112a7fc640 1 -- 172.21.15.94:0/639638969 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f1124007670 con 0x7f11341550d0 2024-09-11T23:16:13.291 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:16:13.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11180678f0 msgr2=0x7f1118069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11180678f0 0x7f1118069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f112c005d40 tx=0x7f112c009040 comp rx=0 tx=0).stop 2024-09-11T23:16:13.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11341550d0 msgr2=0x7f113415a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11341550d0 0x7f113415a270 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1124005040 tx=0x7f1120005840 comp rx=0 tx=0).stop 2024-09-11T23:16:13.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 shutdown_connections 2024-09-11T23:16:13.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11340b0050 0x7f11340b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11180678f0 0x7f1118069db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11341550d0 0x7f113415a270 secure :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1124005040 tx=0x7f1120005840 comp rx=0 tx=0).stop 2024-09-11T23:16:13.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 --2- 172.21.15.94:0/639638969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1120003f70 0x7f1134158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 >> 172.21.15.94:0/639638969 conn(0x7f11340d21d0 msgr2=0x7f11340cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:13.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 shutdown_connections 2024-09-11T23:16:13.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.291+0000 7f113c097640 1 -- 172.21.15.94:0/639638969 wait complete. 2024-09-11T23:16:13.324 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:16:13.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6119519640 1 Processor -- start 2024-09-11T23:16:13.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6119519640 1 -- start start 2024-09-11T23:16:13.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6119519640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f61140ce9d0 0x7f61140cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6119519640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61140d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6119519640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f611406d9c0 con 0x7f611415e5f0 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6119519640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f611406d7a0 con 0x7f61140ce9d0 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6119519640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f611406dca0 con 0x7f61140cf920 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61127fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f61140ce9d0 0x7f61140cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6112ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f611415e5f0 0x7f611406d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59556/0 (socket says 172.21.15.94:59556) 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61127fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f61140ce9d0 0x7f61140cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42824/0 (socket says 172.21.15.94:42824) 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6112ffd640 1 -- 172.21.15.94:0/299974531 learned_addr learned my addr 172.21.15.94:0/299974531 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61137fe640 1 --2- 172.21.15.94:0/299974531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61140d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61127fc640 1 -- 172.21.15.94:0/299974531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 msgr2=0x7f61140d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61127fc640 1 --2- 172.21.15.94:0/299974531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61140d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61127fc640 1 -- 172.21.15.94:0/299974531 >> v1:172.21.15.94:6789/0 conn(0x7f611415e5f0 legacy=0x7f611406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f6111ffb640 1 -- 172.21.15.94:0/299974531 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1594499424 0 0) 0x7f611406d9c0 con 0x7f611415e5f0 2024-09-11T23:16:13.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61127fc640 1 -- 172.21.15.94:0/299974531 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611406df80 con 0x7f61140ce9d0 2024-09-11T23:16:13.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.447+0000 7f61137fe640 1 --2- 172.21.15.94:0/299974531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61140d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:13.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f61127fc640 1 --2- 172.21.15.94:0/299974531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140ce9d0 0x7f61140cf3e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f61080097c0 tx=0x7f610801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e197581ba81b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6111ffb640 1 -- 172.21.15.94:0/299974531 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080b1070 con 0x7f61140ce9d0 2024-09-11T23:16:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6111ffb640 1 -- 172.21.15.94:0/299974531 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61080ac410 con 0x7f61140ce9d0 2024-09-11T23:16:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6111ffb640 1 -- 172.21.15.94:0/299974531 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080ac7e0 con 0x7f61140ce9d0 2024-09-11T23:16:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 -- 172.21.15.94:0/299974531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140ce9d0 msgr2=0x7f61140cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 --2- 172.21.15.94:0/299974531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140ce9d0 0x7f61140cf3e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f61080097c0 tx=0x7f610801c4a0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 -- 172.21.15.94:0/299974531 shutdown_connections 2024-09-11T23:16:13.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 --2- 172.21.15.94:0/299974531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61140d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 --2- 172.21.15.94:0/299974531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140ce9d0 0x7f61140cf3e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 -- 172.21.15.94:0/299974531 >> 172.21.15.94:0/299974531 conn(0x7f6114074030 msgr2=0x7f611409d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:13.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 -- 172.21.15.94:0/299974531 shutdown_connections 2024-09-11T23:16:13.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 -- 172.21.15.94:0/299974531 wait complete. 2024-09-11T23:16:13.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 Processor -- start 2024-09-11T23:16:13.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.451+0000 7f6119519640 1 -- start start 2024-09-11T23:16:13.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61141561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61140c9290 0x7f61140b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140b2650 0x7f6114157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f61140d3c80 con 0x7f61140b2650 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61140d3b00 con 0x7f61140c9290 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61140cfd30 con 0x7f61140cf920 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140b2650 0x7f6114157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140b2650 0x7f6114157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42834/0 (socket says 172.21.15.94:42834) 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 -- 172.21.15.94:0/2890751548 learned_addr learned my addr 172.21.15.94:0/2890751548 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6112ffd640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61141561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61127fc640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61140c9290 0x7f61140b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 -- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 msgr2=0x7f61141561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61141561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 -- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61140c9290 msgr2=0x7f61140b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61140c9290 0x7f61140b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 -- 172.21.15.94:0/2890751548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61140c81f0 con 0x7f61140b2650 2024-09-11T23:16:13.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f61137fe640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140b2650 0x7f6114157370 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f610c00cea0 tx=0x7f610c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:13.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f60fb7fe640 1 -- 172.21.15.94:0/2890751548 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c01a070 con 0x7f61140b2650 2024-09-11T23:16:13.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f60fb7fe640 1 -- 172.21.15.94:0/2890751548 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c00d840 con 0x7f61140b2650 2024-09-11T23:16:13.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f60fb7fe640 1 -- 172.21.15.94:0/2890751548 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c00dc30 con 0x7f61140b2650 2024-09-11T23:16:13.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61140c84d0 con 0x7f61140b2650 2024-09-11T23:16:13.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61140c8a90 con 0x7f61140b2650 2024-09-11T23:16:13.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61140d2e00 con 0x7f61140b2650 2024-09-11T23:16:13.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f60fb7fe640 1 -- 172.21.15.94:0/2890751548 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f610c01d070 con 0x7f61140b2650 2024-09-11T23:16:13.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f60fb7fe640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61000678c0 0x7f6100069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f60fb7fe640 1 -- 172.21.15.94:0/2890751548 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f610c086590 con 0x7f61140b2650 2024-09-11T23:16:13.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.455+0000 7f6112ffd640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61000678c0 0x7f6100069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.459+0000 7f6112ffd640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61000678c0 0x7f6100069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6104000f70 tx=0x7f6104007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:13.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.459+0000 7f60fb7fe640 1 -- 172.21.15.94:0/2890751548 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f610c056f90 con 0x7f61140b2650 2024-09-11T23:16:13.497 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:13.499 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:13.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:13.659+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f61140b58a0 con 0x7f61140b2650 2024-09-11T23:16:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.327+0000 7f60fb7fe640 1 -- 172.21.15.94:0/2890751548 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f610c056890 con 0x7f61140b2650 2024-09-11T23:16:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 5 and data pool 6 2024-09-11T23:16:14.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61000678c0 msgr2=0x7f6100069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61000678c0 0x7f6100069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6104000f70 tx=0x7f6104007b80 comp rx=0 tx=0).stop 2024-09-11T23:16:14.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140b2650 msgr2=0x7f6114157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140b2650 0x7f6114157370 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f610c00cea0 tx=0x7f610c00cf90 comp rx=0 tx=0).stop 2024-09-11T23:16:14.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 shutdown_connections 2024-09-11T23:16:14.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61000678c0 0x7f6100069d80 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6104000f70 tx=0x7f6104007b80 comp rx=0 tx=0).stop 2024-09-11T23:16:14.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61140b2650 0x7f6114157370 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61140c9290 0x7f61140b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 --2- 172.21.15.94:0/2890751548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61140cf920 0x7f61141561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 >> 172.21.15.94:0/2890751548 conn(0x7f61140ce9d0 msgr2=0x7f61140b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:14.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 shutdown_connections 2024-09-11T23:16:14.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.331+0000 7f6119519640 1 -- 172.21.15.94:0/2890751548 wait complete. 2024-09-11T23:16:14.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:14.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f445594c640 1 Processor -- start 2024-09-11T23:16:14.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f445594c640 1 -- start start 2024-09-11T23:16:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f445594c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f445015bec0 0x7f44500ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f445594c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f44500af470 0x7f445006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f445594c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44500b3290 con 0x7f445015c2a0 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f445594c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f44500b3570 con 0x7f44500af470 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f445594c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f44500b3850 con 0x7f445015bec0 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f44500af470 0x7f445006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f44500af470 0x7f445006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42836/0 (socket says 172.21.15.94:42836) 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444e7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f445015c2a0 0x7f44500aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59564/0 (socket says 172.21.15.94:59564) 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444f7fe640 1 -- 172.21.15.94:0/132314666 learned_addr learned my addr 172.21.15.94:0/132314666 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444effd640 1 --2- 172.21.15.94:0/132314666 >> v2:172.21.15.155:3300/0 conn(0x7f445015bec0 0x7f44500ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444f7fe640 1 -- 172.21.15.94:0/132314666 >> v2:172.21.15.155:3300/0 conn(0x7f445015bec0 msgr2=0x7f44500ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444f7fe640 1 --2- 172.21.15.94:0/132314666 >> v2:172.21.15.155:3300/0 conn(0x7f445015bec0 0x7f44500ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444f7fe640 1 -- 172.21.15.94:0/132314666 >> v1:172.21.15.94:6789/0 conn(0x7f445015c2a0 legacy=0x7f44500aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.491+0000 7f444f7fe640 1 -- 172.21.15.94:0/132314666 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44500b3b30 con 0x7f44500af470 2024-09-11T23:16:14.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f444f7fe640 1 --2- 172.21.15.94:0/132314666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44500af470 0x7f445006e000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4450071710 tx=0x7f444801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48f163069bb0883 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:14.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f444dffb640 1 -- 172.21.15.94:0/132314666 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44480a5880 con 0x7f44500af470 2024-09-11T23:16:14.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f444dffb640 1 -- 172.21.15.94:0/132314666 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44480a5a20 con 0x7f44500af470 2024-09-11T23:16:14.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f444dffb640 1 -- 172.21.15.94:0/132314666 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44480a5df0 con 0x7f44500af470 2024-09-11T23:16:14.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- 172.21.15.94:0/132314666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44500af470 msgr2=0x7f445006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 --2- 172.21.15.94:0/132314666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44500af470 0x7f445006e000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4450071710 tx=0x7f444801c9c0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- 172.21.15.94:0/132314666 shutdown_connections 2024-09-11T23:16:14.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 --2- 172.21.15.94:0/132314666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44500af470 0x7f445006e000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 --2- 172.21.15.94:0/132314666 >> v2:172.21.15.155:3300/0 conn(0x7f445015bec0 0x7f44500ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- 172.21.15.94:0/132314666 >> 172.21.15.94:0/132314666 conn(0x7f44500b1f90 msgr2=0x7f44500b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:14.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- 172.21.15.94:0/132314666 shutdown_connections 2024-09-11T23:16:14.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- 172.21.15.94:0/132314666 wait complete. 2024-09-11T23:16:14.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 Processor -- start 2024-09-11T23:16:14.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- start start 2024-09-11T23:16:14.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44500af470 0x7f4450099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445015bec0 0x7f445015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f445015c2a0 0x7f445015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f445006ed50 con 0x7f445015c2a0 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f44500ad740 con 0x7f445015bec0 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f445594c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f445006eed0 con 0x7f44500af470 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f444f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f445015c2a0 0x7f445015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f444f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f445015c2a0 0x7f445015a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42844/0 (socket says 172.21.15.94:42844) 2024-09-11T23:16:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.495+0000 7f444f7fe640 1 -- 172.21.15.94:0/1121844745 learned_addr learned my addr 172.21.15.94:0/1121844745 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444e7fc640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445015bec0 0x7f445015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444effd640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44500af470 0x7f4450099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444f7fe640 1 -- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44500af470 msgr2=0x7f4450099940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444f7fe640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44500af470 0x7f4450099940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444f7fe640 1 -- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445015bec0 msgr2=0x7f445015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444f7fe640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445015bec0 0x7f445015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444f7fe640 1 -- 172.21.15.94:0/1121844745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4450099e80 con 0x7f445015c2a0 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444f7fe640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f445015c2a0 0x7f445015a940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f444801a5f0 tx=0x7f4448019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f4437fff640 1 -- 172.21.15.94:0/1121844745 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44480bc020 con 0x7f445015c2a0 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f4437fff640 1 -- 172.21.15.94:0/1121844745 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44480b8690 con 0x7f445015c2a0 2024-09-11T23:16:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4450166020 con 0x7f445015c2a0 2024-09-11T23:16:14.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f4437fff640 1 -- 172.21.15.94:0/1121844745 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44480b8a80 con 0x7f445015c2a0 2024-09-11T23:16:14.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44501665e0 con 0x7f445015c2a0 2024-09-11T23:16:14.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445006f260 con 0x7f445015c2a0 2024-09-11T23:16:14.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f4437fff640 1 -- 172.21.15.94:0/1121844745 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44480bf020 con 0x7f445015c2a0 2024-09-11T23:16:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f4437fff640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f443c0678c0 0x7f443c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f4437fff640 1 -- 172.21.15.94:0/1121844745 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4448121060 con 0x7f445015c2a0 2024-09-11T23:16:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444effd640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f443c0678c0 0x7f443c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.499+0000 7f444effd640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f443c0678c0 0x7f443c069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f444400b9d0 tx=0x7f4444008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:14.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.503+0000 7f4437fff640 1 -- 172.21.15.94:0/1121844745 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f44480c6030 con 0x7f445015c2a0 2024-09-11T23:16:14.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.655+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f445006fcd0 con 0x7f445015c2a0 2024-09-11T23:16:14.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f4437fff640 1 -- 172.21.15.94:0/1121844745 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17039 (secure 0 0 0) 0x7f44480165e0 con 0x7f445015c2a0 2024-09-11T23:16:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:14.661 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":38,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:16:13.663597+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.543946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:12.651996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:14.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f443c0678c0 msgr2=0x7f443c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f443c0678c0 0x7f443c069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f444400b9d0 tx=0x7f4444008040 comp rx=0 tx=0).stop 2024-09-11T23:16:14.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f445015c2a0 msgr2=0x7f445015a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f445015c2a0 0x7f445015a940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f444801a5f0 tx=0x7f4448019760 comp rx=0 tx=0).stop 2024-09-11T23:16:14.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 shutdown_connections 2024-09-11T23:16:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f443c0678c0 0x7f443c069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f445015c2a0 0x7f445015a940 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445015bec0 0x7f445015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 --2- 172.21.15.94:0/1121844745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44500af470 0x7f4450099940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 >> 172.21.15.94:0/1121844745 conn(0x7f44500b1f90 msgr2=0x7f44500cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 shutdown_connections 2024-09-11T23:16:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.659+0000 7f445594c640 1 -- 172.21.15.94:0/1121844745 wait complete. 2024-09-11T23:16:14.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:14.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.795+0000 7f765d12b640 1 Processor -- start 2024-09-11T23:16:14.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.795+0000 7f765d12b640 1 -- start start 2024-09-11T23:16:14.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765d12b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7658070020 0x7f765815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765d12b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76580aede0 con 0x7f76581520a0 2024-09-11T23:16:14.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765d12b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f765815fa10 con 0x7f765815f1d0 2024-09-11T23:16:14.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765d12b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7658152480 con 0x7f7658070020 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7658070020 0x7f765815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f7656d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f76581520a0 0x7f765806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59568/0 (socket says 172.21.15.94:59568) 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7658070020 0x7f765815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42852/0 (socket says 172.21.15.94:42852) 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f7656d9d640 1 -- 172.21.15.94:0/2241625195 learned_addr learned my addr 172.21.15.94:0/2241625195 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765659c640 1 -- 172.21.15.94:0/2241625195 >> v1:172.21.15.155:6789/0 conn(0x7f765815f1d0 legacy=0x7f76580adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765659c640 1 -- 172.21.15.94:0/2241625195 >> v1:172.21.15.94:6789/0 conn(0x7f76581520a0 legacy=0x7f765806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f7655d9b640 1 -- 172.21.15.94:0/2241625195 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969896906 0 0) 0x7f76580aede0 con 0x7f76581520a0 2024-09-11T23:16:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765659c640 1 -- 172.21.15.94:0/2241625195 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7658074250 con 0x7f7658070020 2024-09-11T23:16:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f765659c640 1 --2- 172.21.15.94:0/2241625195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7658070020 0x7f765815ec90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f764c00ba60 tx=0x7f764c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca1d38c360a88bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f7655d9b640 1 -- 172.21.15.94:0/2241625195 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c0b4070 con 0x7f7658070020 2024-09-11T23:16:14.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f7655d9b640 1 -- 172.21.15.94:0/2241625195 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c0a7c10 con 0x7f7658070020 2024-09-11T23:16:14.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.799+0000 7f7655d9b640 1 -- 172.21.15.94:0/2241625195 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76580aeba0 con 0x7f7658070020 2024-09-11T23:16:14.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/2241625195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7658070020 msgr2=0x7f765815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 --2- 172.21.15.94:0/2241625195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7658070020 0x7f765815ec90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f764c00ba60 tx=0x7f764c01eb40 comp rx=0 tx=0).stop 2024-09-11T23:16:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/2241625195 shutdown_connections 2024-09-11T23:16:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 --2- 172.21.15.94:0/2241625195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7658070020 0x7f765815ec90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/2241625195 >> 172.21.15.94:0/2241625195 conn(0x7f76580b1f90 msgr2=0x7f76580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/2241625195 shutdown_connections 2024-09-11T23:16:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/2241625195 wait complete. 2024-09-11T23:16:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 Processor -- start 2024-09-11T23:16:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- start start 2024-09-11T23:16:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658070020 0x7f76581467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76581520a0 0x7f765814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f765815f1d0 0x7f7658152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f765815f600 con 0x7f765815f1d0 2024-09-11T23:16:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7658073d30 con 0x7f76581520a0 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f765815f780 con 0x7f7658070020 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f765815f1d0 0x7f7658152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f765815f1d0 0x7f7658152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42868/0 (socket says 172.21.15.94:42868) 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 -- 172.21.15.94:0/3095948191 learned_addr learned my addr 172.21.15.94:0/3095948191 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 -- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658070020 msgr2=0x7f76581467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658070020 0x7f76581467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 -- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76581520a0 msgr2=0x7f765814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765659c640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76581520a0 0x7f765814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76581520a0 0x7f765814c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 -- 172.21.15.94:0/3095948191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765815b070 con 0x7f765815f1d0 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765759e640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f765815f1d0 0x7f7658152610 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f765000c7a0 tx=0x7f765000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f763f7fe640 1 -- 172.21.15.94:0/3095948191 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650003b80 con 0x7f765815f1d0 2024-09-11T23:16:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f763f7fe640 1 -- 172.21.15.94:0/3095948191 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7650003d20 con 0x7f765815f1d0 2024-09-11T23:16:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7658154930 con 0x7f765815f1d0 2024-09-11T23:16:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f763f7fe640 1 -- 172.21.15.94:0/3095948191 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765000aa90 con 0x7f765815f1d0 2024-09-11T23:16:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7658154ef0 con 0x7f765815f1d0 2024-09-11T23:16:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.803+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765815ec90 con 0x7f765815f1d0 2024-09-11T23:16:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.807+0000 7f763f7fe640 1 -- 172.21.15.94:0/3095948191 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f765000ac30 con 0x7f765815f1d0 2024-09-11T23:16:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.807+0000 7f763f7fe640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76440678c0 0x7f7644069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.807+0000 7f763f7fe640 1 -- 172.21.15.94:0/3095948191 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f7650085d60 con 0x7f765815f1d0 2024-09-11T23:16:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.807+0000 7f7656d9d640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76440678c0 0x7f7644069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.807+0000 7f7656d9d640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76440678c0 0x7f7644069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7648000c10 tx=0x7f7648007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.811+0000 7f763f7fe640 1 -- 172.21.15.94:0/3095948191 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f765815b070 con 0x7f765815f1d0 2024-09-11T23:16:14.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.975+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f765814d5f0 con 0x7f765815f1d0 2024-09-11T23:16:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.975+0000 7f763f7fe640 1 -- 172.21.15.94:0/3095948191 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17039 (secure 0 0 0) 0x7f7650056710 con 0x7f765815f1d0 2024-09-11T23:16:14.980 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:14.980 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":38,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:16:13.663597+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.543946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:12.651996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76440678c0 msgr2=0x7f7644069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76440678c0 0x7f7644069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7648000c10 tx=0x7f7648007910 comp rx=0 tx=0).stop 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f765815f1d0 msgr2=0x7f7658152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f765815f1d0 0x7f7658152610 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f765000c7a0 tx=0x7f765000cc60 comp rx=0 tx=0).stop 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 shutdown_connections 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76440678c0 0x7f7644069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f765815f1d0 0x7f7658152610 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76581520a0 0x7f765814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 --2- 172.21.15.94:0/3095948191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658070020 0x7f76581467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 >> 172.21.15.94:0/3095948191 conn(0x7f76580b1f90 msgr2=0x7f765806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 shutdown_connections 2024-09-11T23:16:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:14.979+0000 7f765d12b640 1 -- 172.21.15.94:0/3095948191 wait complete. 2024-09-11T23:16:15.001 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:16:15.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f743ac15640 1 Processor -- start 2024-09-11T23:16:15.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f743ac15640 1 -- start start 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f743ac15640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 0x7f7434166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f743ac15640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74340b3290 con 0x7f743415c2a0 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f743ac15640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74340b3570 con 0x7f743415bec0 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f743ac15640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74340b3850 con 0x7f743406f010 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f7433fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f743415c2a0 0x7f74340aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59576/0 (socket says 172.21.15.94:59576) 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f7433fff640 1 -- 172.21.15.94:0/1241905462 learned_addr learned my addr 172.21.15.94:0/1241905462 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74391b2640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 0x7f7434166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675091479 0 0) 0x7f74340b3290 con 0x7f743415c2a0 2024-09-11T23:16:15.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f741c003530 con 0x7f743415c2a0 2024-09-11T23:16:15.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1245543877 0 0) 0x7f741c003530 con 0x7f743415c2a0 2024-09-11T23:16:15.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 msgr2=0x7f7434166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:15.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 0x7f7434166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 >> v1:172.21.15.155:6789/0 conn(0x7f743415bec0 legacy=0x7f74340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74340b3b30 con 0x7f743415c2a0 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7428001680 con 0x7f743415c2a0 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 >> v1:172.21.15.94:6789/0 conn(0x7f743415c2a0 legacy=0x7f74340aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 0x7f741c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c003f70 0x7f741c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f74340b3850 con 0x7f741c004d50 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f741c00bab0 con 0x7f741c003f70 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f741c00bcb0 con 0x7f743406f010 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74391b2640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f7433fff640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c003f70 0x7f741c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74389b1640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 0x7f741c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74391b2640 1 -- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 msgr2=0x7f741c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:15.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74391b2640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 0x7f741c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74391b2640 1 -- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c003f70 msgr2=0x7f741c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:15.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74391b2640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c003f70 0x7f741c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74391b2640 1 -- 172.21.15.94:0/1241905462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c003530 con 0x7f741c004d50 2024-09-11T23:16:15.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.119+0000 7f74389b1640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f743406f010 0x7f741c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:15.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f74391b2640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f742c009f70 tx=0x7f742c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f255b45de82fee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:15.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c0b2070 con 0x7f741c004d50 2024-09-11T23:16:15.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c0a5cf0 con 0x7f741c004d50 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f74337fe640 1 -- 172.21.15.94:0/1241905462 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c009bf0 con 0x7f741c004d50 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 -- 172.21.15.94:0/1241905462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 msgr2=0x7f741c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 --2- 172.21.15.94:0/1241905462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f742c009f70 tx=0x7f742c01cc20 comp rx=0 tx=0).stop 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f74391b2640 1 -- 172.21.15.94:0/1241905462 reap_dead start 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 -- 172.21.15.94:0/1241905462 shutdown_connections 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 -- 172.21.15.94:0/1241905462 >> 172.21.15.94:0/1241905462 conn(0x7f74340b1f90 msgr2=0x7f74340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 -- 172.21.15.94:0/1241905462 shutdown_connections 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 -- 172.21.15.94:0/1241905462 wait complete. 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 Processor -- start 2024-09-11T23:16:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.123+0000 7f743ac15640 1 -- start start 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f743414f720 0x7f74341508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f743415e990 0x7f7434156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7434157360 0x7f743415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f74340afc90 con 0x7f743415e990 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74340b40f0 con 0x7f743414f720 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74340af470 con 0x7f7434157360 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f743415e990 0x7f7434156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f743415e990 0x7f7434156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42880/0 (socket says 172.21.15.94:42880) 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 -- 172.21.15.94:0/4187235976 learned_addr learned my addr 172.21.15.94:0/4187235976 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 -- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7434157360 msgr2=0x7f743415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74391b2640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7434157360 0x7f743415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74389b1640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f743414f720 0x7f74341508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7434157360 0x7f743415c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 -- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f743414f720 msgr2=0x7f74341508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f743414f720 0x7f74341508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 -- 172.21.15.94:0/4187235976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743414fb00 con 0x7f743415e990 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f7433fff640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f743415e990 0x7f7434156e20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f742800ea70 tx=0x7f742800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74317fa640 1 -- 172.21.15.94:0/4187235976 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742800c870 con 0x7f743415e990 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74317fa640 1 -- 172.21.15.94:0/4187235976 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428018070 con 0x7f743415e990 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74317fa640 1 -- 172.21.15.94:0/4187235976 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742800cc50 con 0x7f743415e990 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7434150ed0 con 0x7f743415e990 2024-09-11T23:16:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7434151490 con 0x7f743415e990 2024-09-11T23:16:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7434157770 con 0x7f743415e990 2024-09-11T23:16:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74317fa640 1 -- 172.21.15.94:0/4187235976 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f742801d460 con 0x7f743415e990 2024-09-11T23:16:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74317fa640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74200678c0 0x7f7420069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74317fa640 1 -- 172.21.15.94:0/4187235976 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f7428085d50 con 0x7f743415e990 2024-09-11T23:16:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.127+0000 7f74389b1640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74200678c0 0x7f7420069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.131+0000 7f74389b1640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74200678c0 0x7f7420069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f743415e460 tx=0x7f7424009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.131+0000 7f74317fa640 1 -- 172.21.15.94:0/4187235976 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7434157770 con 0x7f743415e990 2024-09-11T23:16:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.319+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f74340aed60 con 0x7f743415e990 2024-09-11T23:16:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.359+0000 7f74317fa640 1 -- 172.21.15.94:0/4187235976 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f7428089030 con 0x7f743415e990 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74200678c0 msgr2=0x7f7420069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74200678c0 0x7f7420069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f743415e460 tx=0x7f7424009040 comp rx=0 tx=0).stop 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f743415e990 msgr2=0x7f7434156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f743415e990 0x7f7434156e20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f742800ea70 tx=0x7f742800ef30 comp rx=0 tx=0).stop 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 shutdown_connections 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7434157360 0x7f743415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74200678c0 0x7f7420069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f743415e990 0x7f7434156e20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 --2- 172.21.15.94:0/4187235976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f743414f720 0x7f74341508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 >> 172.21.15.94:0/4187235976 conn(0x7f74340b1f90 msgr2=0x7f74340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 shutdown_connections 2024-09-11T23:16:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.363+0000 7f743ac15640 1 -- 172.21.15.94:0/4187235976 wait complete. 2024-09-11T23:16:15.381 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:16:15.381 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:16:15.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.491+0000 7f1d081d5640 1 Processor -- start 2024-09-11T23:16:15.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.491+0000 7f1d081d5640 1 -- start start 2024-09-11T23:16:15.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d081d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d001520a0 0x7f1d0006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d081d5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d0006fe50 0x7f1d0015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d081d5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d00070250 con 0x7f1d0015f1d0 2024-09-11T23:16:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d081d5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1d00152480 con 0x7f1d0006fe50 2024-09-11T23:16:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d081d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d000aede0 con 0x7f1d001520a0 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05770640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d0006fe50 0x7f1d0015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05f71640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d001520a0 0x7f1d0006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05f71640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d001520a0 0x7f1d0006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49000/0 (socket says 172.21.15.94:49000) 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d06772640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1d0015f1d0 0x7f1d00071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:42034/0 (socket says 172.21.15.94:42034) 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05770640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d0006fe50 0x7f1d0015ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:57390/0 (socket says 172.21.15.94:57390) 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05f71640 1 -- 172.21.15.94:0/2875568894 learned_addr learned my addr 172.21.15.94:0/2875568894 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05770640 1 -- 172.21.15.94:0/2875568894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d001520a0 msgr2=0x7f1d0006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05770640 1 --2- 172.21.15.94:0/2875568894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d001520a0 0x7f1d0006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05770640 1 -- 172.21.15.94:0/2875568894 >> v1:172.21.15.155:6789/0 conn(0x7f1d0015f1d0 legacy=0x7f1d00071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.495+0000 7f1d05770640 1 -- 172.21.15.94:0/2875568894 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0015fa10 con 0x7f1d0006fe50 2024-09-11T23:16:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05770640 1 --2- 172.21.15.94:0/2875568894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0006fe50 0x7f1d0015ec90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097c0 tx=0x7f1cf001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b8296e72708cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d04f6f640 1 -- 172.21.15.94:0/2875568894 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00b1070 con 0x7f1d0006fe50 2024-09-11T23:16:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d04f6f640 1 -- 172.21.15.94:0/2875568894 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf00ac600 con 0x7f1d0006fe50 2024-09-11T23:16:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d04f6f640 1 -- 172.21.15.94:0/2875568894 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00ac9d0 con 0x7f1d0006fe50 2024-09-11T23:16:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- 172.21.15.94:0/2875568894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0006fe50 msgr2=0x7f1d0015ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 --2- 172.21.15.94:0/2875568894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0006fe50 0x7f1d0015ec90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097c0 tx=0x7f1cf001c480 comp rx=0 tx=0).stop 2024-09-11T23:16:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- 172.21.15.94:0/2875568894 shutdown_connections 2024-09-11T23:16:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 --2- 172.21.15.94:0/2875568894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0006fe50 0x7f1d0015ec90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 --2- 172.21.15.94:0/2875568894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d001520a0 0x7f1d0006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- 172.21.15.94:0/2875568894 >> 172.21.15.94:0/2875568894 conn(0x7f1d000b1f90 msgr2=0x7f1d000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- 172.21.15.94:0/2875568894 shutdown_connections 2024-09-11T23:16:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- 172.21.15.94:0/2875568894 wait complete. 2024-09-11T23:16:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 Processor -- start 2024-09-11T23:16:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- start start 2024-09-11T23:16:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d0006fe50 0x7f1d000cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d001520a0 0x7f1d000cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d0015f1d0 0x7f1d000ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00073d30 con 0x7f1d0006fe50 2024-09-11T23:16:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00073a50 con 0x7f1d001520a0 2024-09-11T23:16:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d0015f600 con 0x7f1d0015f1d0 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d0006fe50 0x7f1d000cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d0006fe50 0x7f1d000cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42888/0 (socket says 172.21.15.94:42888) 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 -- 172.21.15.94:0/715599128 learned_addr learned my addr 172.21.15.94:0/715599128 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d06772640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d0015f1d0 0x7f1d000ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05770640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d001520a0 0x7f1d000cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 -- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d0015f1d0 msgr2=0x7f1d000ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d0015f1d0 0x7f1d000ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 -- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d001520a0 msgr2=0x7f1d000cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d001520a0 0x7f1d000cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 -- 172.21.15.94:0/715599128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d00148a60 con 0x7f1d0006fe50 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05770640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d001520a0 0x7f1d000cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d05f71640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d0006fe50 0x7f1d000cf940 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e890 tx=0x7f1cfc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1cf67fc640 1 -- 172.21.15.94:0/715599128 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc017070 con 0x7f1d0006fe50 2024-09-11T23:16:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1cf67fc640 1 -- 172.21.15.94:0/715599128 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00c940 con 0x7f1d0006fe50 2024-09-11T23:16:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d00148d40 con 0x7f1d0006fe50 2024-09-11T23:16:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1cf67fc640 1 -- 172.21.15.94:0/715599128 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00cd30 con 0x7f1d0006fe50 2024-09-11T23:16:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.499+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d00149300 con 0x7f1d0006fe50 2024-09-11T23:16:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.503+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d0015ec90 con 0x7f1d0006fe50 2024-09-11T23:16:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.503+0000 7f1cf67fc640 1 -- 172.21.15.94:0/715599128 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1cfc01a070 con 0x7f1d0006fe50 2024-09-11T23:16:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.503+0000 7f1cf67fc640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1ce40678c0 0x7f1ce4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.503+0000 7f1cf67fc640 1 -- 172.21.15.94:0/715599128 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1cfc086580 con 0x7f1d0006fe50 2024-09-11T23:16:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.503+0000 7f1d05770640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1ce40678c0 0x7f1ce4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.503+0000 7f1d05770640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1ce40678c0 0x7f1ce4069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00ae000 tx=0x7f1cf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:15.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.507+0000 7f1cf67fc640 1 -- 172.21.15.94:0/715599128 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1cfc056f30 con 0x7f1d0006fe50 2024-09-11T23:16:15.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:15.695+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1d0006e540 con 0x7f1d0006fe50 2024-09-11T23:16:16.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.371+0000 7f1cf67fc640 1 -- 172.21.15.94:0/715599128 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f1cfc056830 con 0x7f1d0006fe50 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1ce40678c0 msgr2=0x7f1ce4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1ce40678c0 0x7f1ce4069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00ae000 tx=0x7f1cf0008040 comp rx=0 tx=0).stop 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d0006fe50 msgr2=0x7f1d000cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d0006fe50 0x7f1d000cf940 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e890 tx=0x7f1cfc00ed50 comp rx=0 tx=0).stop 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 shutdown_connections 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d0015f1d0 0x7f1d000ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d001520a0 0x7f1d000cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1ce40678c0 0x7f1ce4069d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 --2- 172.21.15.94:0/715599128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d0006fe50 0x7f1d000cf940 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 >> 172.21.15.94:0/715599128 conn(0x7f1d000b1f90 msgr2=0x7f1d000b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 shutdown_connections 2024-09-11T23:16:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.375+0000 7f1d081d5640 1 -- 172.21.15.94:0/715599128 wait complete. 2024-09-11T23:16:16.399 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:16:16.399 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:16.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.519+0000 7fe4b9b32640 1 Processor -- start 2024-09-11T23:16:16.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.519+0000 7fe4b9b32640 1 -- start start 2024-09-11T23:16:16.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b9b32640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe4b41520a0 0x7fe4b406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b9b32640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b4070250 con 0x7fe4b415f3a0 2024-09-11T23:16:16.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b9b32640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b40aede0 con 0x7fe4b406fe50 2024-09-11T23:16:16.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b9b32640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b4152480 con 0x7fe4b41520a0 2024-09-11T23:16:16.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b37fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe4b41520a0 0x7fe4b406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b3fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe4b415f3a0 0x7fe4b40adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59578/0 (socket says 172.21.15.94:59578) 2024-09-11T23:16:16.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b3fff640 1 -- 172.21.15.94:0/3405797155 learned_addr learned my addr 172.21.15.94:0/3405797155 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:16.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b37fe640 1 -- 172.21.15.94:0/3405797155 >> v1:172.21.15.155:6789/0 conn(0x7fe4b406fe50 legacy=0x7fe4b415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:16.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b37fe640 1 -- 172.21.15.94:0/3405797155 >> v1:172.21.15.94:6789/0 conn(0x7fe4b415f3a0 legacy=0x7fe4b40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b37fe640 1 -- 172.21.15.94:0/3405797155 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b415fa10 con 0x7fe4b41520a0 2024-09-11T23:16:16.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b27fc640 1 -- 172.21.15.94:0/3405797155 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2302488212 0 0) 0x7fe4b4070250 con 0x7fe4b415f3a0 2024-09-11T23:16:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b37fe640 1 --2- 172.21.15.94:0/3405797155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b41520a0 0x7fe4b406f910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40097c0 tx=0x7fe4a401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b881ed8cd2209c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b27fc640 1 -- 172.21.15.94:0/3405797155 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40b0070 con 0x7fe4b41520a0 2024-09-11T23:16:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b27fc640 1 -- 172.21.15.94:0/3405797155 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a4004230 con 0x7fe4b41520a0 2024-09-11T23:16:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.523+0000 7fe4b27fc640 1 -- 172.21.15.94:0/3405797155 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40aeba0 con 0x7fe4b41520a0 2024-09-11T23:16:16.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/3405797155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b41520a0 msgr2=0x7fe4b406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/3405797155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b41520a0 0x7fe4b406f910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40097c0 tx=0x7fe4a401c460 comp rx=0 tx=0).stop 2024-09-11T23:16:16.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/3405797155 shutdown_connections 2024-09-11T23:16:16.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/3405797155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b41520a0 0x7fe4b406f910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/3405797155 >> 172.21.15.94:0/3405797155 conn(0x7fe4b40b1f90 msgr2=0x7fe4b40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:16.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/3405797155 shutdown_connections 2024-09-11T23:16:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/3405797155 wait complete. 2024-09-11T23:16:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 Processor -- start 2024-09-11T23:16:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- start start 2024-09-11T23:16:16.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b406fe50 0x7fe4b406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b41520a0 0x7fe4b4151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b415f3a0 0x7fe4b4151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b4073d30 con 0x7fe4b415f3a0 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b4073a50 con 0x7fe4b41520a0 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b4168f20 con 0x7fe4b406fe50 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b415f3a0 0x7fe4b4151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b415f3a0 0x7fe4b4151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42906/0 (socket says 172.21.15.94:42906) 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 -- 172.21.15.94:0/790030364 learned_addr learned my addr 172.21.15.94:0/790030364 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b2ffd640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b41520a0 0x7fe4b4151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 -- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b406fe50 msgr2=0x7fe4b406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b406fe50 0x7fe4b406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 -- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b41520a0 msgr2=0x7fe4b4151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b41520a0 0x7fe4b4151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 -- 172.21.15.94:0/790030364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b41449f0 con 0x7fe4b415f3a0 2024-09-11T23:16:16.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b2ffd640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b41520a0 0x7fe4b4151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:16.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b3fff640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b415f3a0 0x7fe4b4151aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c7d0 tx=0x7fe4ac00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe49bfff640 1 -- 172.21.15.94:0/790030364 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac018070 con 0x7fe4b415f3a0 2024-09-11T23:16:16.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe49bfff640 1 -- 172.21.15.94:0/790030364 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ac00a5e0 con 0x7fe4b415f3a0 2024-09-11T23:16:16.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe49bfff640 1 -- 172.21.15.94:0/790030364 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00aa10 con 0x7fe4b415f3a0 2024-09-11T23:16:16.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b4144cd0 con 0x7fe4b415f3a0 2024-09-11T23:16:16.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b4145290 con 0x7fe4b415f3a0 2024-09-11T23:16:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.527+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b406f910 con 0x7fe4b415f3a0 2024-09-11T23:16:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.531+0000 7fe49bfff640 1 -- 172.21.15.94:0/790030364 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4ac00abb0 con 0x7fe4b415f3a0 2024-09-11T23:16:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.531+0000 7fe49bfff640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe4a00678c0 0x7fe4a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.531+0000 7fe49bfff640 1 -- 172.21.15.94:0/790030364 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe4ac0854b0 con 0x7fe4b415f3a0 2024-09-11T23:16:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.531+0000 7fe4b37fe640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe4a00678c0 0x7fe4a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.531+0000 7fe4b37fe640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe4a00678c0 0x7fe4a0069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40ad000 tx=0x7fe4a4004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.535+0000 7fe49bfff640 1 -- 172.21.15.94:0/790030364 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4ac055dd0 con 0x7fe4b415f3a0 2024-09-11T23:16:16.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.723+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4b40cca10 con 0x7fe4b415f3a0 2024-09-11T23:16:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.723+0000 7fe49bfff640 1 -- 172.21.15.94:0/790030364 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7fe4ac0556d0 con 0x7fe4b415f3a0 2024-09-11T23:16:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:16.729 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe4a00678c0 msgr2=0x7fe4a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe4a00678c0 0x7fe4a0069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40ad000 tx=0x7fe4a4004740 comp rx=0 tx=0).stop 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b415f3a0 msgr2=0x7fe4b4151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b415f3a0 0x7fe4b4151aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c7d0 tx=0x7fe4ac00cc90 comp rx=0 tx=0).stop 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 shutdown_connections 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe4a00678c0 0x7fe4a0069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4b415f3a0 0x7fe4b4151aa0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b41520a0 0x7fe4b4151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 --2- 172.21.15.94:0/790030364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b406fe50 0x7fe4b406ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 >> 172.21.15.94:0/790030364 conn(0x7fe4b40b1f90 msgr2=0x7fe4b414ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:16.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 shutdown_connections 2024-09-11T23:16:16.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.727+0000 7fe4b9b32640 1 -- 172.21.15.94:0/790030364 wait complete. 2024-09-11T23:16:16.746 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:16.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbf049640 1 Processor -- start 2024-09-11T23:16:16.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbf049640 1 -- start start 2024-09-11T23:16:16.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbf049640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbfb815bec0 0x7fbfb80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbf049640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbfb815c2a0 0x7fbfb80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbf049640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb80b3290 con 0x7fbfb80af2a0 2024-09-11T23:16:16.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbf049640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb80b3570 con 0x7fbfb815bec0 2024-09-11T23:16:16.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbf049640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb80b3850 con 0x7fbfb815c2a0 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbcde5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbfb815bec0 0x7fbfb80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbcde5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbfb815bec0 0x7fbfb80ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42922/0 (socket says 172.21.15.94:42922) 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbd5e6640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbfb80af2a0 0x7fbfb815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59584/0 (socket says 172.21.15.94:59584) 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.859+0000 7fbfbcde5640 1 -- 172.21.15.94:0/3645950168 learned_addr learned my addr 172.21.15.94:0/3645950168 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfb7fff640 1 --2- 172.21.15.94:0/3645950168 >> v2:172.21.15.155:3300/0 conn(0x7fbfb815c2a0 0x7fbfb80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbcde5640 1 -- 172.21.15.94:0/3645950168 >> v2:172.21.15.155:3300/0 conn(0x7fbfb815c2a0 msgr2=0x7fbfb80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbcde5640 1 --2- 172.21.15.94:0/3645950168 >> v2:172.21.15.155:3300/0 conn(0x7fbfb815c2a0 0x7fbfb80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbcde5640 1 -- 172.21.15.94:0/3645950168 >> v1:172.21.15.94:6789/0 conn(0x7fbfb80af2a0 legacy=0x7fbfb815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbcde5640 1 -- 172.21.15.94:0/3645950168 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb80b3b30 con 0x7fbfb815bec0 2024-09-11T23:16:16.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfb7fff640 1 --2- 172.21.15.94:0/3645950168 >> v2:172.21.15.155:3300/0 conn(0x7fbfb815c2a0 0x7fbfb80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbcde5640 1 --2- 172.21.15.94:0/3645950168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815bec0 0x7fbfb80ad200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80ae510 tx=0x7fbfac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dcfeed2856b8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfb77fe640 1 -- 172.21.15.94:0/3645950168 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0aa650 con 0x7fbfb815bec0 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfb77fe640 1 -- 172.21.15.94:0/3645950168 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfac0af070 con 0x7fbfb815bec0 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfb77fe640 1 -- 172.21.15.94:0/3645950168 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0aaa10 con 0x7fbfb815bec0 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 -- 172.21.15.94:0/3645950168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815bec0 msgr2=0x7fbfb80ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 --2- 172.21.15.94:0/3645950168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815bec0 0x7fbfb80ad200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80ae510 tx=0x7fbfac01c4f0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 -- 172.21.15.94:0/3645950168 shutdown_connections 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 --2- 172.21.15.94:0/3645950168 >> v2:172.21.15.155:3300/0 conn(0x7fbfb815c2a0 0x7fbfb80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 --2- 172.21.15.94:0/3645950168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815bec0 0x7fbfb80ad200 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 -- 172.21.15.94:0/3645950168 >> 172.21.15.94:0/3645950168 conn(0x7fbfb80b1f90 msgr2=0x7fbfb80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:16.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 -- 172.21.15.94:0/3645950168 shutdown_connections 2024-09-11T23:16:16.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.863+0000 7fbfbf049640 1 -- 172.21.15.94:0/3645950168 wait complete. 2024-09-11T23:16:16.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 Processor -- start 2024-09-11T23:16:16.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 -- start start 2024-09-11T23:16:16.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb80af2a0 0x7fbfb81525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb815bec0 0x7fbfb8145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815c2a0 0x7fbfb81537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb80af6b0 con 0x7fbfb815c2a0 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb80ad740 con 0x7fbfb80af2a0 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb8169000 con 0x7fbfb815bec0 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815c2a0 0x7fbfb81537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815c2a0 0x7fbfb81537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42926/0 (socket says 172.21.15.94:42926) 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 -- 172.21.15.94:0/1809517619 learned_addr learned my addr 172.21.15.94:0/1809517619 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbcde5640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb80af2a0 0x7fbfb81525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfb7fff640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb815bec0 0x7fbfb8145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 -- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb815bec0 msgr2=0x7fbfb8145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb815bec0 0x7fbfb8145680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 -- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb80af2a0 msgr2=0x7fbfb81525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb80af2a0 0x7fbfb81525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 -- 172.21.15.94:0/1809517619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb8145bc0 con 0x7fbfb815c2a0 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbcde5640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb80af2a0 0x7fbfb81525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbd5e6640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815c2a0 0x7fbfb81537c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c7a0 tx=0x7fbfb000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfb57fa640 1 -- 172.21.15.94:0/1809517619 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0017070 con 0x7fbfb815c2a0 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfb57fa640 1 -- 172.21.15.94:0/1809517619 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb000a640 con 0x7fbfb815c2a0 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb81fb520 con 0x7fbfb815c2a0 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfb57fa640 1 -- 172.21.15.94:0/1809517619 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000a9f0 con 0x7fbfb815c2a0 2024-09-11T23:16:16.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb81fa760 con 0x7fbfb815c2a0 2024-09-11T23:16:16.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb80ad200 con 0x7fbfb815c2a0 2024-09-11T23:16:16.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfb57fa640 1 -- 172.21.15.94:0/1809517619 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbfb001a070 con 0x7fbfb815c2a0 2024-09-11T23:16:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.867+0000 7fbfb57fa640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbfa40678c0 0x7fbfa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.871+0000 7fbfb57fa640 1 -- 172.21.15.94:0/1809517619 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbfb00853b0 con 0x7fbfb815c2a0 2024-09-11T23:16:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.871+0000 7fbfbcde5640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbfa40678c0 0x7fbfa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.871+0000 7fbfbcde5640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbfa40678c0 0x7fbfa4069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ae000 tx=0x7fbfac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:16.875+0000 7fbfb57fa640 1 -- 172.21.15.94:0/1809517619 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbfb0055710 con 0x7fbfb815c2a0 2024-09-11T23:16:17.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.035+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfb806fcd0 con 0x7fbfb815c2a0 2024-09-11T23:16:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfb57fa640 1 -- 172.21.15.94:0/1809517619 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17026 (secure 0 0 0) 0x7fbfb0059a10 con 0x7fbfb815c2a0 2024-09-11T23:16:17.042 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:17.042 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":39,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:16:15.330651+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.543946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:12.651996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbfa40678c0 msgr2=0x7fbfa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbfa40678c0 0x7fbfa4069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ae000 tx=0x7fbfac008040 comp rx=0 tx=0).stop 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815c2a0 msgr2=0x7fbfb81537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815c2a0 0x7fbfb81537c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c7a0 tx=0x7fbfb000cc60 comp rx=0 tx=0).stop 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 shutdown_connections 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbfa40678c0 0x7fbfa4069d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb815c2a0 0x7fbfb81537c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb815bec0 0x7fbfb8145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 --2- 172.21.15.94:0/1809517619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb80af2a0 0x7fbfb81525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 >> 172.21.15.94:0/1809517619 conn(0x7fbfb80b1f90 msgr2=0x7fbfb80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 shutdown_connections 2024-09-11T23:16:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.039+0000 7fbfbf049640 1 -- 172.21.15.94:0/1809517619 wait complete. 2024-09-11T23:16:17.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:16:17.061 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:16:17.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.163+0000 7fe5de4f2640 1 Processor -- start 2024-09-11T23:16:17.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.163+0000 7fe5de4f2640 1 -- start start 2024-09-11T23:16:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe5d815bec0 0x7fe5d80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815c2a0 0x7fe5d80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe5d80af2a0 0x7fe5d815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d80b3290 con 0x7fe5d815bec0 2024-09-11T23:16:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d80b3570 con 0x7fe5d80af2a0 2024-09-11T23:16:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d80b3850 con 0x7fe5d815c2a0 2024-09-11T23:16:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe5d815bec0 0x7fe5d80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe5d815bec0 0x7fe5d80ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42942/0 (socket says 172.21.15.94:42942) 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 -- 172.21.15.94:0/2832835199 learned_addr learned my addr 172.21.15.94:0/2832835199 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 -- 172.21.15.94:0/2832835199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815c2a0 msgr2=0x7fe5d80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 --2- 172.21.15.94:0/2832835199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815c2a0 0x7fe5d80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 -- 172.21.15.94:0/2832835199 >> v2:172.21.15.155:3300/0 conn(0x7fe5d80af2a0 msgr2=0x7fe5d815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5dca8f640 1 --2- 172.21.15.94:0/2832835199 >> v2:172.21.15.155:3300/0 conn(0x7fe5d80af2a0 0x7fe5d815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 --2- 172.21.15.94:0/2832835199 >> v2:172.21.15.155:3300/0 conn(0x7fe5d80af2a0 0x7fe5d815fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 -- 172.21.15.94:0/2832835199 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d80b3b30 con 0x7fe5d815bec0 2024-09-11T23:16:17.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d7fff640 1 --2- 172.21.15.94:0/2832835199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d815bec0 0x7fe5d80ad200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5d806dc90 tx=0x7fe5d001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa864095fe0316e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d6ffd640 1 -- 172.21.15.94:0/2832835199 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00a5580 con 0x7fe5d815bec0 2024-09-11T23:16:17.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d6ffd640 1 -- 172.21.15.94:0/2832835199 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d00a5720 con 0x7fe5d815bec0 2024-09-11T23:16:17.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5d6ffd640 1 -- 172.21.15.94:0/2832835199 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00a5af0 con 0x7fe5d815bec0 2024-09-11T23:16:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 -- 172.21.15.94:0/2832835199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d815bec0 msgr2=0x7fe5d80ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/2832835199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d815bec0 0x7fe5d80ad200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5d806dc90 tx=0x7fe5d001c700 comp rx=0 tx=0).stop 2024-09-11T23:16:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 -- 172.21.15.94:0/2832835199 shutdown_connections 2024-09-11T23:16:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/2832835199 >> v2:172.21.15.155:3300/0 conn(0x7fe5d80af2a0 0x7fe5d815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/2832835199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815c2a0 0x7fe5d80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/2832835199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d815bec0 0x7fe5d80ad200 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.167+0000 7fe5de4f2640 1 -- 172.21.15.94:0/2832835199 >> 172.21.15.94:0/2832835199 conn(0x7fe5d80b1f90 msgr2=0x7fe5d80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- 172.21.15.94:0/2832835199 shutdown_connections 2024-09-11T23:16:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- 172.21.15.94:0/2832835199 wait complete. 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 Processor -- start 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- start start 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d80af2a0 0x7fe5d81436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815bec0 0x7fe5d815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d815c2a0 0x7fe5d8159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80af6b0 con 0x7fe5d80af2a0 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80ad740 con 0x7fe5d815c2a0 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d806e000 con 0x7fe5d815bec0 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d80af2a0 0x7fe5d81436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d80af2a0 0x7fe5d81436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42954/0 (socket says 172.21.15.94:42954) 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 -- 172.21.15.94:0/4292841517 learned_addr learned my addr 172.21.15.94:0/4292841517 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 -- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815bec0 msgr2=0x7fe5d815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815bec0 0x7fe5d815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 -- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d815c2a0 msgr2=0x7fe5d8159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d815c2a0 0x7fe5d8159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 -- 172.21.15.94:0/4292841517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d809cba0 con 0x7fe5d80af2a0 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d7fff640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d80af2a0 0x7fe5d81436d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00af040 tx=0x7fe5d00194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d4ff9640 1 -- 172.21.15.94:0/4292841517 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00b8670 con 0x7fe5d80af2a0 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d4ff9640 1 -- 172.21.15.94:0/4292841517 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d00be070 con 0x7fe5d80af2a0 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5d4ff9640 1 -- 172.21.15.94:0/4292841517 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00b8a70 con 0x7fe5d80af2a0 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d81525b0 con 0x7fe5d80af2a0 2024-09-11T23:16:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d809ce40 con 0x7fe5d80af2a0 2024-09-11T23:16:17.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.171+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d80ad200 con 0x7fe5d80af2a0 2024-09-11T23:16:17.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.175+0000 7fe5d4ff9640 1 -- 172.21.15.94:0/4292841517 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5d00b8c10 con 0x7fe5d80af2a0 2024-09-11T23:16:17.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.175+0000 7fe5d4ff9640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5b80678c0 0x7fe5b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.175+0000 7fe5d4ff9640 1 -- 172.21.15.94:0/4292841517 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe5d0120fa0 con 0x7fe5d80af2a0 2024-09-11T23:16:17.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.175+0000 7fe5d77fe640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5b80678c0 0x7fe5b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.175+0000 7fe5d77fe640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5b80678c0 0x7fe5b8069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80d09e0 tx=0x7fe5c0006c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.179+0000 7fe5d4ff9640 1 -- 172.21.15.94:0/4292841517 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe5d00165e0 con 0x7fe5d80af2a0 2024-09-11T23:16:17.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.331+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5d80d0730 con 0x7fe5b80678c0 2024-09-11T23:16:17.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.347+0000 7fe5d4ff9640 1 -- 172.21.15.94:0/4292841517 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237197 (secure 0 0 0) 0x7fe5d80d0730 con 0x7fe5b80678c0 2024-09-11T23:16:17.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:17.355 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:16:17.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5b80678c0 msgr2=0x7fe5b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5b80678c0 0x7fe5b8069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80d09e0 tx=0x7fe5c0006c00 comp rx=0 tx=0).stop 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d80af2a0 msgr2=0x7fe5d81436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d80af2a0 0x7fe5d81436d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00af040 tx=0x7fe5d00194a0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 shutdown_connections 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d815c2a0 0x7fe5d8159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5d815bec0 0x7fe5d815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5b80678c0 0x7fe5b8069d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 --2- 172.21.15.94:0/4292841517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5d80af2a0 0x7fe5d81436d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 >> 172.21.15.94:0/4292841517 conn(0x7fe5d80b1f90 msgr2=0x7fe5d80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 shutdown_connections 2024-09-11T23:16:17.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.351+0000 7fe5de4f2640 1 -- 172.21.15.94:0/4292841517 wait complete. 2024-09-11T23:16:17.371 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-11T23:16:15.988967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237240,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737480,"statfs":{"total":773094113280,"available":772851179520,"internally_reserved":0,"allocated":4399104,"data_stored":2545832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001231"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T23:16:08.288404+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:16:08.288404+0000","last_peered":"2024-09-11T23:16:08.288404+0000","last_clean":"2024-09-11T23:16:08.288404+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:16:08.288404+0000","last_undegraded":"2024-09-11T23:16:08.288404+0000","last_fullsized":"2024-09-11T23:16:08.288404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":995328,"data_stored":761005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31588,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":761005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:16:17.376 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:16:17.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb3dac640 1 Processor -- start 2024-09-11T23:16:17.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb3dac640 1 -- start start 2024-09-11T23:16:17.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb3dac640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8fac0b39a0 0x7f8fac06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb3dac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac06e4b0 0x7f8fac072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb3dac640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fac06ec60 con 0x7f8fac1587a0 2024-09-11T23:16:17.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb3dac640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8fac06f870 con 0x7f8fac0b39a0 2024-09-11T23:16:17.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb3dac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8fac06ef40 con 0x7f8fac06e4b0 2024-09-11T23:16:17.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb1b48640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8fac1587a0 0x7f8fac0b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59600/0 (socket says 172.21.15.94:59600) 2024-09-11T23:16:17.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb1b48640 1 -- 172.21.15.94:0/3478871175 learned_addr learned my addr 172.21.15.94:0/3478871175 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:17.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb1347640 1 --2- 172.21.15.94:0/3478871175 >> v2:172.21.15.94:3300/0 conn(0x7f8fac0b39a0 0x7f8fac06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb2349640 1 --2- 172.21.15.94:0/3478871175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac06e4b0 0x7f8fac072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb1347640 1 -- 172.21.15.94:0/3478871175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac06e4b0 msgr2=0x7f8fac072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:17.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb1347640 1 --2- 172.21.15.94:0/3478871175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac06e4b0 0x7f8fac072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb1347640 1 -- 172.21.15.94:0/3478871175 >> v1:172.21.15.94:6789/0 conn(0x7f8fac1587a0 legacy=0x7f8fac0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb1347640 1 -- 172.21.15.94:0/3478871175 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fac06f220 con 0x7f8fac0b39a0 2024-09-11T23:16:17.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.523+0000 7f8fb0b46640 1 -- 172.21.15.94:0/3478871175 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485008606 0 0) 0x7f8fac06ec60 con 0x7f8fac1587a0 2024-09-11T23:16:17.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 --2- 172.21.15.94:0/3478871175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac06df70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097c0 tx=0x7f8f9c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8172dd6932bd41e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb0b46640 1 -- 172.21.15.94:0/3478871175 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0b2070 con 0x7f8fac0b39a0 2024-09-11T23:16:17.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb0b46640 1 -- 172.21.15.94:0/3478871175 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0ad640 con 0x7f8fac0b39a0 2024-09-11T23:16:17.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb0b46640 1 -- 172.21.15.94:0/3478871175 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0ada10 con 0x7f8fac0b39a0 2024-09-11T23:16:17.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- 172.21.15.94:0/3478871175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 msgr2=0x7f8fac06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/3478871175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac06df70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097c0 tx=0x7f8f9c01c470 comp rx=0 tx=0).stop 2024-09-11T23:16:17.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- 172.21.15.94:0/3478871175 shutdown_connections 2024-09-11T23:16:17.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/3478871175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac06e4b0 0x7f8fac072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/3478871175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac06df70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- 172.21.15.94:0/3478871175 >> 172.21.15.94:0/3478871175 conn(0x7f8fac0b1f90 msgr2=0x7f8fac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:17.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- 172.21.15.94:0/3478871175 shutdown_connections 2024-09-11T23:16:17.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- 172.21.15.94:0/3478871175 wait complete. 2024-09-11T23:16:17.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 Processor -- start 2024-09-11T23:16:17.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- start start 2024-09-11T23:16:17.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fac06e4b0 0x7f8fac146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac1587a0 0x7f8fac151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac073030 con 0x7f8fac0b39a0 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac072eb0 con 0x7f8fac06e4b0 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8fac0731b0 con 0x7f8fac1587a0 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42970/0 (socket says 172.21.15.94:42970) 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 -- 172.21.15.94:0/1608959772 learned_addr learned my addr 172.21.15.94:0/1608959772 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1b48640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fac06e4b0 0x7f8fac146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb2349640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac1587a0 0x7f8fac151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 -- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac1587a0 msgr2=0x7f8fac151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac1587a0 0x7f8fac151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 -- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fac06e4b0 msgr2=0x7f8fac146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fac06e4b0 0x7f8fac146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 -- 172.21.15.94:0/1608959772 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fac152600 con 0x7f8fac0b39a0 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1b48640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fac06e4b0 0x7f8fac146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb1347640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac154230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097c0 tx=0x7f8f9c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fa27fc640 1 -- 172.21.15.94:0/1608959772 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0bd070 con 0x7f8fac0b39a0 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fa27fc640 1 -- 172.21.15.94:0/1608959772 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c004230 con 0x7f8fac0b39a0 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fac1528e0 con 0x7f8fac0b39a0 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fa27fc640 1 -- 172.21.15.94:0/1608959772 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0b2040 con 0x7f8fac0b39a0 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.527+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fac153d10 con 0x7f8fac0b39a0 2024-09-11T23:16:17.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.531+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fac153b30 con 0x7f8fac0b39a0 2024-09-11T23:16:17.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.531+0000 7f8fa27fc640 1 -- 172.21.15.94:0/1608959772 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f9c0c0070 con 0x7f8fac0b39a0 2024-09-11T23:16:17.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.531+0000 7f8fa27fc640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8f900678c0 0x7f8f90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.531+0000 7f8fa27fc640 1 -- 172.21.15.94:0/1608959772 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8f9c11f600 con 0x7f8fac0b39a0 2024-09-11T23:16:17.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.531+0000 7f8fb1b48640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8f900678c0 0x7f8f90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.531+0000 7f8fb1b48640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8f900678c0 0x7f8f90069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8007fd0 tx=0x7f8fa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.535+0000 7f8fa27fc640 1 -- 172.21.15.94:0/1608959772 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8fac153b30 con 0x7f8fac0b39a0 2024-09-11T23:16:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.679+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fac09df10 con 0x7f8f900678c0 2024-09-11T23:16:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fa27fc640 1 -- 172.21.15.94:0/1608959772 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237197 (secure 0 0 0) 0x7f8fac09df10 con 0x7f8f900678c0 2024-09-11T23:16:17.704 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8f900678c0 msgr2=0x7f8f90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8f900678c0 0x7f8f90069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8007fd0 tx=0x7f8fa8009040 comp rx=0 tx=0).stop 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 msgr2=0x7f8fac154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac154230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097c0 tx=0x7f8f9c019210 comp rx=0 tx=0).stop 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 shutdown_connections 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fac1587a0 0x7f8fac151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8f900678c0 0x7f8f90069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8fac0b39a0 0x7f8fac154230 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 --2- 172.21.15.94:0/1608959772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fac06e4b0 0x7f8fac146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 >> 172.21.15.94:0/1608959772 conn(0x7f8fac0b1f90 msgr2=0x7f8fac15fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 shutdown_connections 2024-09-11T23:16:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.699+0000 7f8fb3dac640 1 -- 172.21.15.94:0/1608959772 wait complete. 2024-09-11T23:16:17.720 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-11T23:16:15.988967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237240,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737480,"statfs":{"total":773094113280,"available":772851179520,"internally_reserved":0,"allocated":4399104,"data_stored":2545832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001231"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:13.287649+0000","last_change":"2024-09-11T23:16:13.287649+0000","last_active":"2024-09-11T23:16:13.287649+0000","last_peered":"2024-09-11T23:16:13.287649+0000","last_clean":"2024-09-11T23:16:13.287649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:13.287649+0000","last_undegraded":"2024-09-11T23:16:13.287649+0000","last_fullsized":"2024-09-11T23:16:13.287649+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:16:12.278851+0000","last_change":"2024-09-11T23:16:12.278851+0000","last_active":"2024-09-11T23:16:12.278851+0000","last_peered":"2024-09-11T23:16:12.278851+0000","last_clean":"2024-09-11T23:16:12.278851+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:16:12.278851+0000","last_undegraded":"2024-09-11T23:16:12.278851+0000","last_fullsized":"2024-09-11T23:16:12.278851+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T23:16:08.288404+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:16:08.288404+0000","last_peered":"2024-09-11T23:16:08.288404+0000","last_clean":"2024-09-11T23:16:08.288404+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:16:08.288404+0000","last_undegraded":"2024-09-11T23:16:08.288404+0000","last_fullsized":"2024-09-11T23:16:08.288404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":995328,"data_stored":761005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31588,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":401408,"data_stored":170637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":761005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:16:17.724 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:16:17.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff89ba39640 1 Processor -- start 2024-09-11T23:16:17.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff89ba39640 1 -- start start 2024-09-11T23:16:17.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff89ba39640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff89406fef0 0x7ff89406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff89ba39640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8940b3d50 0x7ff8940b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff89ba39640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89406ee50 con 0x7ff894073e60 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff89ba39640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff8940b46c0 con 0x7ff8940b3d50 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff89ba39640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff89406f130 con 0x7ff89406fef0 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff894073e60 0x7ff89415b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59606/0 (socket says 172.21.15.94:59606) 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 -- 172.21.15.94:0/2772336651 learned_addr learned my addr 172.21.15.94:0/2772336651 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff899fd6640 1 --2- 172.21.15.94:0/2772336651 >> v2:172.21.15.155:3300/0 conn(0x7ff8940b3d50 0x7ff8940b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175628150 0 0) 0x7ff89406ee50 con 0x7ff894073e60 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff898fd4640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff89406fef0 0x7ff89406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff87c004640 con 0x7ff894073e60 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1190761492 0 0) 0x7ff87c004640 con 0x7ff894073e60 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff89406fef0 msgr2=0x7ff89406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff89406fef0 0x7ff89406e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 >> v2:172.21.15.155:3300/0 conn(0x7ff8940b3d50 msgr2=0x7ff8940b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 --2- 172.21.15.94:0/2772336651 >> v2:172.21.15.155:3300/0 conn(0x7ff8940b3d50 0x7ff8940b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89406f410 con 0x7ff894073e60 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7ff884001a00 con 0x7ff894073e60 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 >> v1:172.21.15.94:6789/0 conn(0x7ff894073e60 legacy=0x7ff89415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87c004ad0 0x7ff87c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff89406fef0 0x7ff87c005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff87c005e60 0x7ff87c0062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940b46c0 con 0x7ff87c004ad0 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff89406f130 con 0x7ff87c005e60 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff87c00cb90 con 0x7ff89406fef0 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87c004ad0 0x7ff87c004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 -- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff89406fef0 msgr2=0x7ff87c005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:17.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff89406fef0 0x7ff87c005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 -- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff87c005e60 msgr2=0x7ff87c0062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:17.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff87c005e60 0x7ff87c0062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.871+0000 7ff8997d5640 1 -- 172.21.15.94:0/2772336651 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c004640 con 0x7ff87c004ad0 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff8997d5640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87c004ad0 0x7ff87c004ef0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8840013e0 tx=0x7ff88401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ca8586a4e3e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88400a410 con 0x7ff87c004ad0 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8840ad630 con 0x7ff87c004ad0 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff893fff640 1 -- 172.21.15.94:0/2772336651 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840ada20 con 0x7ff87c004ad0 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- 172.21.15.94:0/2772336651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87c004ad0 msgr2=0x7ff87c004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 --2- 172.21.15.94:0/2772336651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87c004ad0 0x7ff87c004ef0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8840013e0 tx=0x7ff88401d2e0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 -- 172.21.15.94:0/2772336651 reap_dead start 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- 172.21.15.94:0/2772336651 shutdown_connections 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- 172.21.15.94:0/2772336651 >> 172.21.15.94:0/2772336651 conn(0x7ff8940b1f90 msgr2=0x7ff8940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- 172.21.15.94:0/2772336651 shutdown_connections 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- 172.21.15.94:0/2772336651 wait complete. 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 Processor -- start 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- start start 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff87c004ad0 0x7ff89414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff894155430 0x7ff89414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff89414d1f0 0x7ff8940ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff89406eb10 con 0x7ff89414d1f0 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff89406e990 con 0x7ff894155430 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff89ba39640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff894072610 con 0x7ff87c004ad0 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff89414d1f0 0x7ff8940ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff89414d1f0 0x7ff8940ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42992/0 (socket says 172.21.15.94:42992) 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 -- 172.21.15.94:0/3985517414 learned_addr learned my addr 172.21.15.94:0/3985517414 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff898fd4640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff894155430 0x7ff89414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff8997d5640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff87c004ad0 0x7ff89414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 -- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff87c004ad0 msgr2=0x7ff89414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff87c004ad0 0x7ff89414a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 -- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff894155430 msgr2=0x7ff89414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff894155430 0x7ff89414ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.875+0000 7ff899fd6640 1 -- 172.21.15.94:0/3985517414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8941f4980 con 0x7ff89414d1f0 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff899fd6640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff89414d1f0 0x7ff8940ae260 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8940b3be0 tx=0x7ff88c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff891ffb640 1 -- 172.21.15.94:0/3985517414 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c017070 con 0x7ff89414d1f0 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff891ffb640 1 -- 172.21.15.94:0/3985517414 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c00c6b0 con 0x7ff89414d1f0 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8941f4c60 con 0x7ff89414d1f0 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff891ffb640 1 -- 172.21.15.94:0/3985517414 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00ca80 con 0x7ff89414d1f0 2024-09-11T23:16:17.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941f5220 con 0x7ff89414d1f0 2024-09-11T23:16:17.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89415df20 con 0x7ff89414d1f0 2024-09-11T23:16:17.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff891ffb640 1 -- 172.21.15.94:0/3985517414 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff88c01a070 con 0x7ff89414d1f0 2024-09-11T23:16:17.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff891ffb640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff8800678c0 0x7ff880069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:17.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff891ffb640 1 -- 172.21.15.94:0/3985517414 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff88c0858d0 con 0x7ff89414d1f0 2024-09-11T23:16:17.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff8997d5640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff8800678c0 0x7ff880069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:17.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.879+0000 7ff8997d5640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff8800678c0 0x7ff880069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8840ad000 tx=0x7ff884001d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:17.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:17.883+0000 7ff891ffb640 1 -- 172.21.15.94:0/3985517414 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff88c056310 con 0x7ff89414d1f0 2024-09-11T23:16:18.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.027+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8941f4730 con 0x7ff8800678c0 2024-09-11T23:16:18.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.047+0000 7ff891ffb640 1 -- 172.21.15.94:0/3985517414 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251966 (secure 0 0 0) 0x7ff8941f4730 con 0x7ff8800678c0 2024-09-11T23:16:18.053 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:18.054 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:16:18.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff8800678c0 msgr2=0x7ff880069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff8800678c0 0x7ff880069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8840ad000 tx=0x7ff884001d00 comp rx=0 tx=0).stop 2024-09-11T23:16:18.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff89414d1f0 msgr2=0x7ff8940ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff89414d1f0 0x7ff8940ae260 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8940b3be0 tx=0x7ff88c00ec00 comp rx=0 tx=0).stop 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 shutdown_connections 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff8800678c0 0x7ff880069d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff89414d1f0 0x7ff8940ae260 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff894155430 0x7ff89414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 --2- 172.21.15.94:0/3985517414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff87c004ad0 0x7ff89414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 >> 172.21.15.94:0/3985517414 conn(0x7ff8940b1f90 msgr2=0x7ff8940736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 shutdown_connections 2024-09-11T23:16:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.051+0000 7ff89ba39640 1 -- 172.21.15.94:0/3985517414 wait complete. 2024-09-11T23:16:18.069 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-11T23:16:17.989589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237632,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737088,"statfs":{"total":773094113280,"available":772850778112,"internally_reserved":0,"allocated":4857856,"data_stored":2764532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698219"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336108+0000","last_change":"2024-09-11T23:16:14.351224+0000","last_active":"2024-09-11T23:16:15.336108+0000","last_peered":"2024-09-11T23:16:15.336108+0000","last_clean":"2024-09-11T23:16:15.336108+0000","last_became_active":"2024-09-11T23:16:14.350919+0000","last_became_peered":"2024-09-11T23:16:14.350919+0000","last_unstale":"2024-09-11T23:16:15.336108+0000","last_undegraded":"2024-09-11T23:16:15.336108+0000","last_fullsized":"2024-09-11T23:16:15.336108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.121063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335787+0000","last_change":"2024-09-11T23:16:14.346180+0000","last_active":"2024-09-11T23:16:15.335787+0000","last_peered":"2024-09-11T23:16:15.335787+0000","last_clean":"2024-09-11T23:16:15.335787+0000","last_became_active":"2024-09-11T23:16:14.345960+0000","last_became_peered":"2024-09-11T23:16:14.345960+0000","last_unstale":"2024-09-11T23:16:15.335787+0000","last_undegraded":"2024-09-11T23:16:15.335787+0000","last_fullsized":"2024-09-11T23:16:15.335787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:19.495390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549220+0000","last_change":"2024-09-11T23:16:14.391735+0000","last_active":"2024-09-11T23:16:15.549220+0000","last_peered":"2024-09-11T23:16:15.549220+0000","last_clean":"2024-09-11T23:16:15.549220+0000","last_became_active":"2024-09-11T23:16:14.391421+0000","last_became_peered":"2024-09-11T23:16:14.391421+0000","last_unstale":"2024-09-11T23:16:15.549220+0000","last_undegraded":"2024-09-11T23:16:15.549220+0000","last_fullsized":"2024-09-11T23:16:15.549220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550862+0000","last_change":"2024-09-11T23:16:14.379388+0000","last_active":"2024-09-11T23:16:15.550862+0000","last_peered":"2024-09-11T23:16:15.550862+0000","last_clean":"2024-09-11T23:16:15.550862+0000","last_became_active":"2024-09-11T23:16:14.378820+0000","last_became_peered":"2024-09-11T23:16:14.378820+0000","last_unstale":"2024-09-11T23:16:15.550862+0000","last_undegraded":"2024-09-11T23:16:15.550862+0000","last_fullsized":"2024-09-11T23:16:15.550862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:49.157268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550730+0000","last_change":"2024-09-11T23:16:14.379022+0000","last_active":"2024-09-11T23:16:15.550730+0000","last_peered":"2024-09-11T23:16:15.550730+0000","last_clean":"2024-09-11T23:16:15.550730+0000","last_became_active":"2024-09-11T23:16:14.378677+0000","last_became_peered":"2024-09-11T23:16:14.378677+0000","last_unstale":"2024-09-11T23:16:15.550730+0000","last_undegraded":"2024-09-11T23:16:15.550730+0000","last_fullsized":"2024-09-11T23:16:15.550730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:18.990320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549969+0000","last_change":"2024-09-11T23:16:14.344975+0000","last_active":"2024-09-11T23:16:15.549969+0000","last_peered":"2024-09-11T23:16:15.549969+0000","last_clean":"2024-09-11T23:16:15.549969+0000","last_became_active":"2024-09-11T23:16:14.344686+0000","last_became_peered":"2024-09-11T23:16:14.344686+0000","last_unstale":"2024-09-11T23:16:15.549969+0000","last_undegraded":"2024-09-11T23:16:15.549969+0000","last_fullsized":"2024-09-11T23:16:15.549969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551296+0000","last_change":"2024-09-11T23:16:14.392025+0000","last_active":"2024-09-11T23:16:15.551296+0000","last_peered":"2024-09-11T23:16:15.551296+0000","last_clean":"2024-09-11T23:16:15.551296+0000","last_became_active":"2024-09-11T23:16:14.391463+0000","last_became_peered":"2024-09-11T23:16:14.391463+0000","last_unstale":"2024-09-11T23:16:15.551296+0000","last_undegraded":"2024-09-11T23:16:15.551296+0000","last_fullsized":"2024-09-11T23:16:15.551296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335567+0000","last_change":"2024-09-11T23:16:14.384841+0000","last_active":"2024-09-11T23:16:15.335567+0000","last_peered":"2024-09-11T23:16:15.335567+0000","last_clean":"2024-09-11T23:16:15.335567+0000","last_became_active":"2024-09-11T23:16:14.384567+0000","last_became_peered":"2024-09-11T23:16:14.384567+0000","last_unstale":"2024-09-11T23:16:15.335567+0000","last_undegraded":"2024-09-11T23:16:15.335567+0000","last_fullsized":"2024-09-11T23:16:15.335567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:38.937876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549555+0000","last_change":"2024-09-11T23:16:14.397836+0000","last_active":"2024-09-11T23:16:15.549555+0000","last_peered":"2024-09-11T23:16:15.549555+0000","last_clean":"2024-09-11T23:16:15.549555+0000","last_became_active":"2024-09-11T23:16:14.397599+0000","last_became_peered":"2024-09-11T23:16:14.397599+0000","last_unstale":"2024-09-11T23:16:15.549555+0000","last_undegraded":"2024-09-11T23:16:15.549555+0000","last_fullsized":"2024-09-11T23:16:15.549555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552699+0000","last_change":"2024-09-11T23:16:14.392407+0000","last_active":"2024-09-11T23:16:15.552699+0000","last_peered":"2024-09-11T23:16:15.552699+0000","last_clean":"2024-09-11T23:16:15.552699+0000","last_became_active":"2024-09-11T23:16:14.385747+0000","last_became_peered":"2024-09-11T23:16:14.385747+0000","last_unstale":"2024-09-11T23:16:15.552699+0000","last_undegraded":"2024-09-11T23:16:15.552699+0000","last_fullsized":"2024-09-11T23:16:15.552699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:38.937876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552499+0000","last_change":"2024-09-11T23:16:14.390867+0000","last_active":"2024-09-11T23:16:15.552499+0000","last_peered":"2024-09-11T23:16:15.552499+0000","last_clean":"2024-09-11T23:16:15.552499+0000","last_became_active":"2024-09-11T23:16:14.390269+0000","last_became_peered":"2024-09-11T23:16:14.390269+0000","last_unstale":"2024-09-11T23:16:15.552499+0000","last_undegraded":"2024-09-11T23:16:15.552499+0000","last_fullsized":"2024-09-11T23:16:15.552499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:26.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549142+0000","last_change":"2024-09-11T23:16:14.350382+0000","last_active":"2024-09-11T23:16:15.549142+0000","last_peered":"2024-09-11T23:16:15.549142+0000","last_clean":"2024-09-11T23:16:15.549142+0000","last_became_active":"2024-09-11T23:16:14.350088+0000","last_became_peered":"2024-09-11T23:16:14.350088+0000","last_unstale":"2024-09-11T23:16:15.549142+0000","last_undegraded":"2024-09-11T23:16:15.549142+0000","last_fullsized":"2024-09-11T23:16:15.549142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551582+0000","last_change":"2024-09-11T23:16:14.395687+0000","last_active":"2024-09-11T23:16:15.551582+0000","last_peered":"2024-09-11T23:16:15.551582+0000","last_clean":"2024-09-11T23:16:15.551582+0000","last_became_active":"2024-09-11T23:16:14.392287+0000","last_became_peered":"2024-09-11T23:16:14.392287+0000","last_unstale":"2024-09-11T23:16:15.551582+0000","last_undegraded":"2024-09-11T23:16:15.551582+0000","last_fullsized":"2024-09-11T23:16:15.551582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.907854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338672+0000","last_change":"2024-09-11T23:16:14.396261+0000","last_active":"2024-09-11T23:16:15.338672+0000","last_peered":"2024-09-11T23:16:15.338672+0000","last_clean":"2024-09-11T23:16:15.338672+0000","last_became_active":"2024-09-11T23:16:14.387510+0000","last_became_peered":"2024-09-11T23:16:14.387510+0000","last_unstale":"2024-09-11T23:16:15.338672+0000","last_undegraded":"2024-09-11T23:16:15.338672+0000","last_fullsized":"2024-09-11T23:16:15.338672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551470+0000","last_change":"2024-09-11T23:16:14.391001+0000","last_active":"2024-09-11T23:16:15.551470+0000","last_peered":"2024-09-11T23:16:15.551470+0000","last_clean":"2024-09-11T23:16:15.551470+0000","last_became_active":"2024-09-11T23:16:14.390379+0000","last_became_peered":"2024-09-11T23:16:14.390379+0000","last_unstale":"2024-09-11T23:16:15.551470+0000","last_undegraded":"2024-09-11T23:16:15.551470+0000","last_fullsized":"2024-09-11T23:16:15.551470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:20.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551795+0000","last_change":"2024-09-11T23:16:14.390401+0000","last_active":"2024-09-11T23:16:15.551795+0000","last_peered":"2024-09-11T23:16:15.551795+0000","last_clean":"2024-09-11T23:16:15.551795+0000","last_became_active":"2024-09-11T23:16:14.389777+0000","last_became_peered":"2024-09-11T23:16:14.389777+0000","last_unstale":"2024-09-11T23:16:15.551795+0000","last_undegraded":"2024-09-11T23:16:15.551795+0000","last_fullsized":"2024-09-11T23:16:15.551795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.554175+0000","last_change":"2024-09-11T23:16:14.398192+0000","last_active":"2024-09-11T23:16:15.554175+0000","last_peered":"2024-09-11T23:16:15.554175+0000","last_clean":"2024-09-11T23:16:15.554175+0000","last_became_active":"2024-09-11T23:16:14.397734+0000","last_became_peered":"2024-09-11T23:16:14.397734+0000","last_unstale":"2024-09-11T23:16:15.554175+0000","last_undegraded":"2024-09-11T23:16:15.554175+0000","last_fullsized":"2024-09-11T23:16:15.554175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339372+0000","last_change":"2024-09-11T23:16:14.403372+0000","last_active":"2024-09-11T23:16:15.339372+0000","last_peered":"2024-09-11T23:16:15.339372+0000","last_clean":"2024-09-11T23:16:15.339372+0000","last_became_active":"2024-09-11T23:16:14.402828+0000","last_became_peered":"2024-09-11T23:16:14.402828+0000","last_unstale":"2024-09-11T23:16:15.339372+0000","last_undegraded":"2024-09-11T23:16:15.339372+0000","last_fullsized":"2024-09-11T23:16:15.339372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:47.839047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550929+0000","last_change":"2024-09-11T23:16:14.348099+0000","last_active":"2024-09-11T23:16:15.550929+0000","last_peered":"2024-09-11T23:16:15.550929+0000","last_clean":"2024-09-11T23:16:15.550929+0000","last_became_active":"2024-09-11T23:16:14.347397+0000","last_became_peered":"2024-09-11T23:16:14.347397+0000","last_unstale":"2024-09-11T23:16:15.550929+0000","last_undegraded":"2024-09-11T23:16:15.550929+0000","last_fullsized":"2024-09-11T23:16:15.550929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:14.367835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339019+0000","last_change":"2024-09-11T23:16:14.403249+0000","last_active":"2024-09-11T23:16:15.339019+0000","last_peered":"2024-09-11T23:16:15.339019+0000","last_clean":"2024-09-11T23:16:15.339019+0000","last_became_active":"2024-09-11T23:16:14.402699+0000","last_became_peered":"2024-09-11T23:16:14.402699+0000","last_unstale":"2024-09-11T23:16:15.339019+0000","last_undegraded":"2024-09-11T23:16:15.339019+0000","last_fullsized":"2024-09-11T23:16:15.339019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:23.274577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551976+0000","last_change":"2024-09-11T23:16:14.385579+0000","last_active":"2024-09-11T23:16:15.551976+0000","last_peered":"2024-09-11T23:16:15.551976+0000","last_clean":"2024-09-11T23:16:15.551976+0000","last_became_active":"2024-09-11T23:16:14.383893+0000","last_became_peered":"2024-09-11T23:16:14.383893+0000","last_unstale":"2024-09-11T23:16:15.551976+0000","last_undegraded":"2024-09-11T23:16:15.551976+0000","last_fullsized":"2024-09-11T23:16:15.551976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.448095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340596+0000","last_change":"2024-09-11T23:16:14.386167+0000","last_active":"2024-09-11T23:16:15.340596+0000","last_peered":"2024-09-11T23:16:15.340596+0000","last_clean":"2024-09-11T23:16:15.340596+0000","last_became_active":"2024-09-11T23:16:14.377425+0000","last_became_peered":"2024-09-11T23:16:14.377425+0000","last_unstale":"2024-09-11T23:16:15.340596+0000","last_undegraded":"2024-09-11T23:16:15.340596+0000","last_fullsized":"2024-09-11T23:16:15.340596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551610+0000","last_change":"2024-09-11T23:16:14.360520+0000","last_active":"2024-09-11T23:16:15.551610+0000","last_peered":"2024-09-11T23:16:15.551610+0000","last_clean":"2024-09-11T23:16:15.551610+0000","last_became_active":"2024-09-11T23:16:14.358873+0000","last_became_peered":"2024-09-11T23:16:14.358873+0000","last_unstale":"2024-09-11T23:16:15.551610+0000","last_undegraded":"2024-09-11T23:16:15.551610+0000","last_fullsized":"2024-09-11T23:16:15.551610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.299783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550559+0000","last_change":"2024-09-11T23:16:14.352656+0000","last_active":"2024-09-11T23:16:15.550559+0000","last_peered":"2024-09-11T23:16:15.550559+0000","last_clean":"2024-09-11T23:16:15.550559+0000","last_became_active":"2024-09-11T23:16:14.352350+0000","last_became_peered":"2024-09-11T23:16:14.352350+0000","last_unstale":"2024-09-11T23:16:15.550559+0000","last_undegraded":"2024-09-11T23:16:15.550559+0000","last_fullsized":"2024-09-11T23:16:15.550559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:08.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339259+0000","last_change":"2024-09-11T23:16:14.383033+0000","last_active":"2024-09-11T23:16:15.339259+0000","last_peered":"2024-09-11T23:16:15.339259+0000","last_clean":"2024-09-11T23:16:15.339259+0000","last_became_active":"2024-09-11T23:16:14.382285+0000","last_became_peered":"2024-09-11T23:16:14.382285+0000","last_unstale":"2024-09-11T23:16:15.339259+0000","last_undegraded":"2024-09-11T23:16:15.339259+0000","last_fullsized":"2024-09-11T23:16:15.339259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:38.144000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549727+0000","last_change":"2024-09-11T23:16:14.396300+0000","last_active":"2024-09-11T23:16:15.549727+0000","last_peered":"2024-09-11T23:16:15.549727+0000","last_clean":"2024-09-11T23:16:15.549727+0000","last_became_active":"2024-09-11T23:16:14.396009+0000","last_became_peered":"2024-09-11T23:16:14.396009+0000","last_unstale":"2024-09-11T23:16:15.549727+0000","last_undegraded":"2024-09-11T23:16:15.549727+0000","last_fullsized":"2024-09-11T23:16:15.549727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339521+0000","last_change":"2024-09-11T23:16:14.379376+0000","last_active":"2024-09-11T23:16:15.339521+0000","last_peered":"2024-09-11T23:16:15.339521+0000","last_clean":"2024-09-11T23:16:15.339521+0000","last_became_active":"2024-09-11T23:16:14.369960+0000","last_became_peered":"2024-09-11T23:16:14.369960+0000","last_unstale":"2024-09-11T23:16:15.339521+0000","last_undegraded":"2024-09-11T23:16:15.339521+0000","last_fullsized":"2024-09-11T23:16:15.339521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:58.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552279+0000","last_change":"2024-09-11T23:16:14.367982+0000","last_active":"2024-09-11T23:16:15.552279+0000","last_peered":"2024-09-11T23:16:15.552279+0000","last_clean":"2024-09-11T23:16:15.552279+0000","last_became_active":"2024-09-11T23:16:14.356651+0000","last_became_peered":"2024-09-11T23:16:14.356651+0000","last_unstale":"2024-09-11T23:16:15.552279+0000","last_undegraded":"2024-09-11T23:16:15.552279+0000","last_fullsized":"2024-09-11T23:16:15.552279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.974140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339193+0000","last_change":"2024-09-11T23:16:14.379577+0000","last_active":"2024-09-11T23:16:15.339193+0000","last_peered":"2024-09-11T23:16:15.339193+0000","last_clean":"2024-09-11T23:16:15.339193+0000","last_became_active":"2024-09-11T23:16:14.368714+0000","last_became_peered":"2024-09-11T23:16:14.368714+0000","last_unstale":"2024-09-11T23:16:15.339193+0000","last_undegraded":"2024-09-11T23:16:15.339193+0000","last_fullsized":"2024-09-11T23:16:15.339193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:08.485908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338174+0000","last_change":"2024-09-11T23:16:14.378832+0000","last_active":"2024-09-11T23:16:15.338174+0000","last_peered":"2024-09-11T23:16:15.338174+0000","last_clean":"2024-09-11T23:16:15.338174+0000","last_became_active":"2024-09-11T23:16:14.368984+0000","last_became_peered":"2024-09-11T23:16:14.368984+0000","last_unstale":"2024-09-11T23:16:15.338174+0000","last_undegraded":"2024-09-11T23:16:15.338174+0000","last_fullsized":"2024-09-11T23:16:15.338174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:09.606832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551997+0000","last_change":"2024-09-11T23:16:14.360602+0000","last_active":"2024-09-11T23:16:15.551997+0000","last_peered":"2024-09-11T23:16:15.551997+0000","last_clean":"2024-09-11T23:16:15.551997+0000","last_became_active":"2024-09-11T23:16:14.359801+0000","last_became_peered":"2024-09-11T23:16:14.359801+0000","last_unstale":"2024-09-11T23:16:15.551997+0000","last_undegraded":"2024-09-11T23:16:15.551997+0000","last_fullsized":"2024-09-11T23:16:15.551997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550502+0000","last_change":"2024-09-11T23:16:14.345415+0000","last_active":"2024-09-11T23:16:15.550502+0000","last_peered":"2024-09-11T23:16:15.550502+0000","last_clean":"2024-09-11T23:16:15.550502+0000","last_became_active":"2024-09-11T23:16:14.345049+0000","last_became_peered":"2024-09-11T23:16:14.345049+0000","last_unstale":"2024-09-11T23:16:15.550502+0000","last_undegraded":"2024-09-11T23:16:15.550502+0000","last_fullsized":"2024-09-11T23:16:15.550502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553850+0000","last_change":"2024-09-11T23:16:14.392265+0000","last_active":"2024-09-11T23:16:15.553850+0000","last_peered":"2024-09-11T23:16:15.553850+0000","last_clean":"2024-09-11T23:16:15.553850+0000","last_became_active":"2024-09-11T23:16:14.391643+0000","last_became_peered":"2024-09-11T23:16:14.391643+0000","last_unstale":"2024-09-11T23:16:15.553850+0000","last_undegraded":"2024-09-11T23:16:15.553850+0000","last_fullsized":"2024-09-11T23:16:15.553850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339289+0000","last_change":"2024-09-11T23:16:13.337352+0000","last_active":"2024-09-11T23:16:15.339289+0000","last_peered":"2024-09-11T23:16:15.339289+0000","last_clean":"2024-09-11T23:16:15.339289+0000","last_became_active":"2024-09-11T23:16:13.335783+0000","last_became_peered":"2024-09-11T23:16:13.335783+0000","last_unstale":"2024-09-11T23:16:15.339289+0000","last_undegraded":"2024-09-11T23:16:15.339289+0000","last_fullsized":"2024-09-11T23:16:15.339289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.484510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550029+0000","last_change":"2024-09-11T23:16:14.392711+0000","last_active":"2024-09-11T23:16:15.550029+0000","last_peered":"2024-09-11T23:16:15.550029+0000","last_clean":"2024-09-11T23:16:15.550029+0000","last_became_active":"2024-09-11T23:16:14.392452+0000","last_became_peered":"2024-09-11T23:16:14.392452+0000","last_unstale":"2024-09-11T23:16:15.550029+0000","last_undegraded":"2024-09-11T23:16:15.550029+0000","last_fullsized":"2024-09-11T23:16:15.550029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549354+0000","last_change":"2024-09-11T23:16:13.331310+0000","last_active":"2024-09-11T23:16:15.549354+0000","last_peered":"2024-09-11T23:16:15.549354+0000","last_clean":"2024-09-11T23:16:15.549354+0000","last_became_active":"2024-09-11T23:16:13.330554+0000","last_became_peered":"2024-09-11T23:16:13.330554+0000","last_unstale":"2024-09-11T23:16:15.549354+0000","last_undegraded":"2024-09-11T23:16:15.549354+0000","last_fullsized":"2024-09-11T23:16:15.549354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.970882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340957+0000","last_change":"2024-09-11T23:16:14.394809+0000","last_active":"2024-09-11T23:16:15.340957+0000","last_peered":"2024-09-11T23:16:15.340957+0000","last_clean":"2024-09-11T23:16:15.340957+0000","last_became_active":"2024-09-11T23:16:14.394245+0000","last_became_peered":"2024-09-11T23:16:14.394245+0000","last_unstale":"2024-09-11T23:16:15.340957+0000","last_undegraded":"2024-09-11T23:16:15.340957+0000","last_fullsized":"2024-09-11T23:16:15.340957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550231+0000","last_change":"2024-09-11T23:16:13.314070+0000","last_active":"2024-09-11T23:16:15.550231+0000","last_peered":"2024-09-11T23:16:15.550231+0000","last_clean":"2024-09-11T23:16:15.550231+0000","last_became_active":"2024-09-11T23:16:13.313270+0000","last_became_peered":"2024-09-11T23:16:13.313270+0000","last_unstale":"2024-09-11T23:16:15.550231+0000","last_undegraded":"2024-09-11T23:16:15.550231+0000","last_fullsized":"2024-09-11T23:16:15.550231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336259+0000","last_change":"2024-09-11T23:16:14.384382+0000","last_active":"2024-09-11T23:16:15.336259+0000","last_peered":"2024-09-11T23:16:15.336259+0000","last_clean":"2024-09-11T23:16:15.336259+0000","last_became_active":"2024-09-11T23:16:14.384118+0000","last_became_peered":"2024-09-11T23:16:14.384118+0000","last_unstale":"2024-09-11T23:16:15.336259+0000","last_undegraded":"2024-09-11T23:16:15.336259+0000","last_fullsized":"2024-09-11T23:16:15.336259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:22.535507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340460+0000","last_change":"2024-09-11T23:16:13.325773+0000","last_active":"2024-09-11T23:16:15.340460+0000","last_peered":"2024-09-11T23:16:15.340460+0000","last_clean":"2024-09-11T23:16:15.340460+0000","last_became_active":"2024-09-11T23:16:13.325043+0000","last_became_peered":"2024-09-11T23:16:13.325043+0000","last_unstale":"2024-09-11T23:16:15.340460+0000","last_undegraded":"2024-09-11T23:16:15.340460+0000","last_fullsized":"2024-09-11T23:16:15.340460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548715+0000","last_change":"2024-09-11T23:16:14.348345+0000","last_active":"2024-09-11T23:16:15.548715+0000","last_peered":"2024-09-11T23:16:15.548715+0000","last_clean":"2024-09-11T23:16:15.548715+0000","last_became_active":"2024-09-11T23:16:14.347664+0000","last_became_peered":"2024-09-11T23:16:14.347664+0000","last_unstale":"2024-09-11T23:16:15.548715+0000","last_undegraded":"2024-09-11T23:16:15.548715+0000","last_fullsized":"2024-09-11T23:16:15.548715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:58.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553338+0000","last_change":"2024-09-11T23:16:13.339890+0000","last_active":"2024-09-11T23:16:15.553338+0000","last_peered":"2024-09-11T23:16:15.553338+0000","last_clean":"2024-09-11T23:16:15.553338+0000","last_became_active":"2024-09-11T23:16:13.339166+0000","last_became_peered":"2024-09-11T23:16:13.339166+0000","last_unstale":"2024-09-11T23:16:15.553338+0000","last_undegraded":"2024-09-11T23:16:15.553338+0000","last_fullsized":"2024-09-11T23:16:15.553338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:37.135203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551697+0000","last_change":"2024-09-11T23:16:14.385350+0000","last_active":"2024-09-11T23:16:15.551697+0000","last_peered":"2024-09-11T23:16:15.551697+0000","last_clean":"2024-09-11T23:16:15.551697+0000","last_became_active":"2024-09-11T23:16:14.383898+0000","last_became_peered":"2024-09-11T23:16:14.383898+0000","last_unstale":"2024-09-11T23:16:15.551697+0000","last_undegraded":"2024-09-11T23:16:15.551697+0000","last_fullsized":"2024-09-11T23:16:15.551697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:36.520699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553018+0000","last_change":"2024-09-11T23:16:13.331962+0000","last_active":"2024-09-11T23:16:15.553018+0000","last_peered":"2024-09-11T23:16:15.553018+0000","last_clean":"2024-09-11T23:16:15.553018+0000","last_became_active":"2024-09-11T23:16:13.330403+0000","last_became_peered":"2024-09-11T23:16:13.330403+0000","last_unstale":"2024-09-11T23:16:15.553018+0000","last_undegraded":"2024-09-11T23:16:15.553018+0000","last_fullsized":"2024-09-11T23:16:15.553018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.970882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340241+0000","last_change":"2024-09-11T23:16:14.400908+0000","last_active":"2024-09-11T23:16:15.340241+0000","last_peered":"2024-09-11T23:16:15.340241+0000","last_clean":"2024-09-11T23:16:15.340241+0000","last_became_active":"2024-09-11T23:16:14.399921+0000","last_became_peered":"2024-09-11T23:16:14.399921+0000","last_unstale":"2024-09-11T23:16:15.340241+0000","last_undegraded":"2024-09-11T23:16:15.340241+0000","last_fullsized":"2024-09-11T23:16:15.340241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549820+0000","last_change":"2024-09-11T23:16:13.323646+0000","last_active":"2024-09-11T23:16:15.549820+0000","last_peered":"2024-09-11T23:16:15.549820+0000","last_clean":"2024-09-11T23:16:15.549820+0000","last_became_active":"2024-09-11T23:16:13.323118+0000","last_became_peered":"2024-09-11T23:16:13.323118+0000","last_unstale":"2024-09-11T23:16:15.549820+0000","last_undegraded":"2024-09-11T23:16:15.549820+0000","last_fullsized":"2024-09-11T23:16:15.549820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335539+0000","last_change":"2024-09-11T23:16:14.367792+0000","last_active":"2024-09-11T23:16:15.335539+0000","last_peered":"2024-09-11T23:16:15.335539+0000","last_clean":"2024-09-11T23:16:15.335539+0000","last_became_active":"2024-09-11T23:16:14.367519+0000","last_became_peered":"2024-09-11T23:16:14.367519+0000","last_unstale":"2024-09-11T23:16:15.335539+0000","last_undegraded":"2024-09-11T23:16:15.335539+0000","last_fullsized":"2024-09-11T23:16:15.335539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:16.533562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338511+0000","last_change":"2024-09-11T23:16:13.336803+0000","last_active":"2024-09-11T23:16:15.338511+0000","last_peered":"2024-09-11T23:16:15.338511+0000","last_clean":"2024-09-11T23:16:15.338511+0000","last_became_active":"2024-09-11T23:16:13.336017+0000","last_became_peered":"2024-09-11T23:16:13.336017+0000","last_unstale":"2024-09-11T23:16:15.338511+0000","last_undegraded":"2024-09-11T23:16:15.338511+0000","last_fullsized":"2024-09-11T23:16:15.338511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551023+0000","last_change":"2024-09-11T23:16:14.375304+0000","last_active":"2024-09-11T23:16:15.551023+0000","last_peered":"2024-09-11T23:16:15.551023+0000","last_clean":"2024-09-11T23:16:15.551023+0000","last_became_active":"2024-09-11T23:16:14.375038+0000","last_became_peered":"2024-09-11T23:16:14.375038+0000","last_unstale":"2024-09-11T23:16:15.551023+0000","last_undegraded":"2024-09-11T23:16:15.551023+0000","last_fullsized":"2024-09-11T23:16:15.551023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:31.194287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336232+0000","last_change":"2024-09-11T23:16:13.326933+0000","last_active":"2024-09-11T23:16:15.336232+0000","last_peered":"2024-09-11T23:16:15.336232+0000","last_clean":"2024-09-11T23:16:15.336232+0000","last_became_active":"2024-09-11T23:16:13.326399+0000","last_became_peered":"2024-09-11T23:16:13.326399+0000","last_unstale":"2024-09-11T23:16:15.336232+0000","last_undegraded":"2024-09-11T23:16:15.336232+0000","last_fullsized":"2024-09-11T23:16:15.336232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:36.491647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553992+0000","last_change":"2024-09-11T23:16:14.388668+0000","last_active":"2024-09-11T23:16:15.553992+0000","last_peered":"2024-09-11T23:16:15.553992+0000","last_clean":"2024-09-11T23:16:15.553992+0000","last_became_active":"2024-09-11T23:16:14.388024+0000","last_became_peered":"2024-09-11T23:16:14.388024+0000","last_unstale":"2024-09-11T23:16:15.553992+0000","last_undegraded":"2024-09-11T23:16:15.553992+0000","last_fullsized":"2024-09-11T23:16:15.553992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553042+0000","last_change":"2024-09-11T23:16:13.324368+0000","last_active":"2024-09-11T23:16:15.553042+0000","last_peered":"2024-09-11T23:16:15.553042+0000","last_clean":"2024-09-11T23:16:15.553042+0000","last_became_active":"2024-09-11T23:16:13.323655+0000","last_became_peered":"2024-09-11T23:16:13.323655+0000","last_unstale":"2024-09-11T23:16:15.553042+0000","last_undegraded":"2024-09-11T23:16:15.553042+0000","last_fullsized":"2024-09-11T23:16:15.553042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549223+0000","last_change":"2024-09-11T23:16:14.368439+0000","last_active":"2024-09-11T23:16:15.549223+0000","last_peered":"2024-09-11T23:16:15.549223+0000","last_clean":"2024-09-11T23:16:15.549223+0000","last_became_active":"2024-09-11T23:16:14.368086+0000","last_became_peered":"2024-09-11T23:16:14.368086+0000","last_unstale":"2024-09-11T23:16:15.549223+0000","last_undegraded":"2024-09-11T23:16:15.549223+0000","last_fullsized":"2024-09-11T23:16:15.549223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553050+0000","last_change":"2024-09-11T23:16:13.321064+0000","last_active":"2024-09-11T23:16:15.553050+0000","last_peered":"2024-09-11T23:16:15.553050+0000","last_clean":"2024-09-11T23:16:15.553050+0000","last_became_active":"2024-09-11T23:16:13.320359+0000","last_became_peered":"2024-09-11T23:16:13.320359+0000","last_unstale":"2024-09-11T23:16:15.553050+0000","last_undegraded":"2024-09-11T23:16:15.553050+0000","last_fullsized":"2024-09-11T23:16:15.553050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:22.265779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340905+0000","last_change":"2024-09-11T23:16:14.394639+0000","last_active":"2024-09-11T23:16:15.340905+0000","last_peered":"2024-09-11T23:16:15.340905+0000","last_clean":"2024-09-11T23:16:15.340905+0000","last_became_active":"2024-09-11T23:16:14.383803+0000","last_became_peered":"2024-09-11T23:16:14.383803+0000","last_unstale":"2024-09-11T23:16:15.340905+0000","last_undegraded":"2024-09-11T23:16:15.340905+0000","last_fullsized":"2024-09-11T23:16:15.340905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335722+0000","last_change":"2024-09-11T23:16:13.332747+0000","last_active":"2024-09-11T23:16:15.335722+0000","last_peered":"2024-09-11T23:16:15.335722+0000","last_clean":"2024-09-11T23:16:15.335722+0000","last_became_active":"2024-09-11T23:16:13.332104+0000","last_became_peered":"2024-09-11T23:16:13.332104+0000","last_unstale":"2024-09-11T23:16:15.335722+0000","last_undegraded":"2024-09-11T23:16:15.335722+0000","last_fullsized":"2024-09-11T23:16:15.335722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:40.527548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548725+0000","last_change":"2024-09-11T23:16:14.392414+0000","last_active":"2024-09-11T23:16:15.548725+0000","last_peered":"2024-09-11T23:16:15.548725+0000","last_clean":"2024-09-11T23:16:15.548725+0000","last_became_active":"2024-09-11T23:16:14.392099+0000","last_became_peered":"2024-09-11T23:16:14.392099+0000","last_unstale":"2024-09-11T23:16:15.548725+0000","last_undegraded":"2024-09-11T23:16:15.548725+0000","last_fullsized":"2024-09-11T23:16:15.548725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.299783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335672+0000","last_change":"2024-09-11T23:16:13.336911+0000","last_active":"2024-09-11T23:16:15.335672+0000","last_peered":"2024-09-11T23:16:15.335672+0000","last_clean":"2024-09-11T23:16:15.335672+0000","last_became_active":"2024-09-11T23:16:13.336363+0000","last_became_peered":"2024-09-11T23:16:13.336363+0000","last_unstale":"2024-09-11T23:16:15.335672+0000","last_undegraded":"2024-09-11T23:16:15.335672+0000","last_fullsized":"2024-09-11T23:16:15.335672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:01.564513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335320+0000","last_change":"2024-09-11T23:16:14.351542+0000","last_active":"2024-09-11T23:16:15.335320+0000","last_peered":"2024-09-11T23:16:15.335320+0000","last_clean":"2024-09-11T23:16:15.335320+0000","last_became_active":"2024-09-11T23:16:14.351059+0000","last_became_peered":"2024-09-11T23:16:14.351059+0000","last_unstale":"2024-09-11T23:16:15.335320+0000","last_undegraded":"2024-09-11T23:16:15.335320+0000","last_fullsized":"2024-09-11T23:16:15.335320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550057+0000","last_change":"2024-09-11T23:16:13.324038+0000","last_active":"2024-09-11T23:16:15.550057+0000","last_peered":"2024-09-11T23:16:15.550057+0000","last_clean":"2024-09-11T23:16:15.550057+0000","last_became_active":"2024-09-11T23:16:13.323374+0000","last_became_peered":"2024-09-11T23:16:13.323374+0000","last_unstale":"2024-09-11T23:16:15.550057+0000","last_undegraded":"2024-09-11T23:16:15.550057+0000","last_fullsized":"2024-09-11T23:16:15.550057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.674238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552750+0000","last_change":"2024-09-11T23:16:14.360868+0000","last_active":"2024-09-11T23:16:15.552750+0000","last_peered":"2024-09-11T23:16:15.552750+0000","last_clean":"2024-09-11T23:16:15.552750+0000","last_became_active":"2024-09-11T23:16:14.360164+0000","last_became_peered":"2024-09-11T23:16:14.360164+0000","last_unstale":"2024-09-11T23:16:15.552750+0000","last_undegraded":"2024-09-11T23:16:15.552750+0000","last_fullsized":"2024-09-11T23:16:15.552750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.337942+0000","last_change":"2024-09-11T23:16:13.331248+0000","last_active":"2024-09-11T23:16:15.337942+0000","last_peered":"2024-09-11T23:16:15.337942+0000","last_clean":"2024-09-11T23:16:15.337942+0000","last_became_active":"2024-09-11T23:16:13.330516+0000","last_became_peered":"2024-09-11T23:16:13.330516+0000","last_unstale":"2024-09-11T23:16:15.337942+0000","last_undegraded":"2024-09-11T23:16:15.337942+0000","last_fullsized":"2024-09-11T23:16:15.337942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:47.577588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335559+0000","last_change":"2024-09-11T23:16:14.352083+0000","last_active":"2024-09-11T23:16:15.335559+0000","last_peered":"2024-09-11T23:16:15.335559+0000","last_clean":"2024-09-11T23:16:15.335559+0000","last_became_active":"2024-09-11T23:16:14.351725+0000","last_became_peered":"2024-09-11T23:16:14.351725+0000","last_unstale":"2024-09-11T23:16:15.335559+0000","last_undegraded":"2024-09-11T23:16:15.335559+0000","last_fullsized":"2024-09-11T23:16:15.335559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:10.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552073+0000","last_change":"2024-09-11T23:16:13.326807+0000","last_active":"2024-09-11T23:16:15.552073+0000","last_peered":"2024-09-11T23:16:15.552073+0000","last_clean":"2024-09-11T23:16:15.552073+0000","last_became_active":"2024-09-11T23:16:13.325592+0000","last_became_peered":"2024-09-11T23:16:13.325592+0000","last_unstale":"2024-09-11T23:16:15.552073+0000","last_undegraded":"2024-09-11T23:16:15.552073+0000","last_fullsized":"2024-09-11T23:16:15.552073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:07.478372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335641+0000","last_change":"2024-09-11T23:16:14.365792+0000","last_active":"2024-09-11T23:16:15.335641+0000","last_peered":"2024-09-11T23:16:15.335641+0000","last_clean":"2024-09-11T23:16:15.335641+0000","last_became_active":"2024-09-11T23:16:14.365526+0000","last_became_peered":"2024-09-11T23:16:14.365526+0000","last_unstale":"2024-09-11T23:16:15.335641+0000","last_undegraded":"2024-09-11T23:16:15.335641+0000","last_fullsized":"2024-09-11T23:16:15.335641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:07.629887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552995+0000","last_change":"2024-09-11T23:16:13.321790+0000","last_active":"2024-09-11T23:16:15.552995+0000","last_peered":"2024-09-11T23:16:15.552995+0000","last_clean":"2024-09-11T23:16:15.552995+0000","last_became_active":"2024-09-11T23:16:13.320995+0000","last_became_peered":"2024-09-11T23:16:13.320995+0000","last_unstale":"2024-09-11T23:16:15.552995+0000","last_undegraded":"2024-09-11T23:16:15.552995+0000","last_fullsized":"2024-09-11T23:16:15.552995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552889+0000","last_change":"2024-09-11T23:16:14.356529+0000","last_active":"2024-09-11T23:16:15.552889+0000","last_peered":"2024-09-11T23:16:15.552889+0000","last_clean":"2024-09-11T23:16:15.552889+0000","last_became_active":"2024-09-11T23:16:14.355812+0000","last_became_peered":"2024-09-11T23:16:14.355812+0000","last_unstale":"2024-09-11T23:16:15.552889+0000","last_undegraded":"2024-09-11T23:16:15.552889+0000","last_fullsized":"2024-09-11T23:16:15.552889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:16.533562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.341153+0000","last_change":"2024-09-11T23:16:13.328848+0000","last_active":"2024-09-11T23:16:15.341153+0000","last_peered":"2024-09-11T23:16:15.341153+0000","last_clean":"2024-09-11T23:16:15.341153+0000","last_became_active":"2024-09-11T23:16:13.328075+0000","last_became_peered":"2024-09-11T23:16:13.328075+0000","last_unstale":"2024-09-11T23:16:15.341153+0000","last_undegraded":"2024-09-11T23:16:15.341153+0000","last_fullsized":"2024-09-11T23:16:15.341153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.674238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340956+0000","last_change":"2024-09-11T23:16:14.396065+0000","last_active":"2024-09-11T23:16:15.340956+0000","last_peered":"2024-09-11T23:16:15.340956+0000","last_clean":"2024-09-11T23:16:15.340956+0000","last_became_active":"2024-09-11T23:16:14.393989+0000","last_became_peered":"2024-09-11T23:16:14.393989+0000","last_unstale":"2024-09-11T23:16:15.340956+0000","last_undegraded":"2024-09-11T23:16:15.340956+0000","last_fullsized":"2024-09-11T23:16:15.340956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550924+0000","last_change":"2024-09-11T23:16:13.325992+0000","last_active":"2024-09-11T23:16:15.550924+0000","last_peered":"2024-09-11T23:16:15.550924+0000","last_clean":"2024-09-11T23:16:15.550924+0000","last_became_active":"2024-09-11T23:16:13.325437+0000","last_became_peered":"2024-09-11T23:16:13.325437+0000","last_unstale":"2024-09-11T23:16:15.550924+0000","last_undegraded":"2024-09-11T23:16:15.550924+0000","last_fullsized":"2024-09-11T23:16:15.550924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:36.843321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551022+0000","last_change":"2024-09-11T23:16:14.349053+0000","last_active":"2024-09-11T23:16:15.551022+0000","last_peered":"2024-09-11T23:16:15.551022+0000","last_clean":"2024-09-11T23:16:15.551022+0000","last_became_active":"2024-09-11T23:16:14.347635+0000","last_became_peered":"2024-09-11T23:16:14.347635+0000","last_unstale":"2024-09-11T23:16:15.551022+0000","last_undegraded":"2024-09-11T23:16:15.551022+0000","last_fullsized":"2024-09-11T23:16:15.551022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:41.939962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550282+0000","last_change":"2024-09-11T23:16:13.313108+0000","last_active":"2024-09-11T23:16:15.550282+0000","last_peered":"2024-09-11T23:16:15.550282+0000","last_clean":"2024-09-11T23:16:15.550282+0000","last_became_active":"2024-09-11T23:16:13.312767+0000","last_became_peered":"2024-09-11T23:16:13.312767+0000","last_unstale":"2024-09-11T23:16:15.550282+0000","last_undegraded":"2024-09-11T23:16:15.550282+0000","last_fullsized":"2024-09-11T23:16:15.550282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552473+0000","last_change":"2024-09-11T23:16:14.376574+0000","last_active":"2024-09-11T23:16:15.552473+0000","last_peered":"2024-09-11T23:16:15.552473+0000","last_clean":"2024-09-11T23:16:15.552473+0000","last_became_active":"2024-09-11T23:16:14.375783+0000","last_became_peered":"2024-09-11T23:16:14.375783+0000","last_unstale":"2024-09-11T23:16:15.552473+0000","last_undegraded":"2024-09-11T23:16:15.552473+0000","last_fullsized":"2024-09-11T23:16:15.552473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550794+0000","last_change":"2024-09-11T23:16:13.331941+0000","last_active":"2024-09-11T23:16:15.550794+0000","last_peered":"2024-09-11T23:16:15.550794+0000","last_clean":"2024-09-11T23:16:15.550794+0000","last_became_active":"2024-09-11T23:16:13.331461+0000","last_became_peered":"2024-09-11T23:16:13.331461+0000","last_unstale":"2024-09-11T23:16:15.550794+0000","last_undegraded":"2024-09-11T23:16:15.550794+0000","last_fullsized":"2024-09-11T23:16:15.550794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:40.816040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549124+0000","last_change":"2024-09-11T23:16:14.368440+0000","last_active":"2024-09-11T23:16:15.549124+0000","last_peered":"2024-09-11T23:16:15.549124+0000","last_clean":"2024-09-11T23:16:15.549124+0000","last_became_active":"2024-09-11T23:16:14.368127+0000","last_became_peered":"2024-09-11T23:16:14.368127+0000","last_unstale":"2024-09-11T23:16:15.549124+0000","last_undegraded":"2024-09-11T23:16:15.549124+0000","last_fullsized":"2024-09-11T23:16:15.549124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550700+0000","last_change":"2024-09-11T23:16:13.314568+0000","last_active":"2024-09-11T23:16:15.550700+0000","last_peered":"2024-09-11T23:16:15.550700+0000","last_clean":"2024-09-11T23:16:15.550700+0000","last_became_active":"2024-09-11T23:16:13.313778+0000","last_became_peered":"2024-09-11T23:16:13.313778+0000","last_unstale":"2024-09-11T23:16:15.550700+0000","last_undegraded":"2024-09-11T23:16:15.550700+0000","last_fullsized":"2024-09-11T23:16:15.550700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:47.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552311+0000","last_change":"2024-09-11T23:16:14.390039+0000","last_active":"2024-09-11T23:16:15.552311+0000","last_peered":"2024-09-11T23:16:15.552311+0000","last_clean":"2024-09-11T23:16:15.552311+0000","last_became_active":"2024-09-11T23:16:14.384231+0000","last_became_peered":"2024-09-11T23:16:14.384231+0000","last_unstale":"2024-09-11T23:16:15.552311+0000","last_undegraded":"2024-09-11T23:16:15.552311+0000","last_fullsized":"2024-09-11T23:16:15.552311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.738356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552245+0000","last_change":"2024-09-11T23:16:13.337708+0000","last_active":"2024-09-11T23:16:15.552245+0000","last_peered":"2024-09-11T23:16:15.552245+0000","last_clean":"2024-09-11T23:16:15.552245+0000","last_became_active":"2024-09-11T23:16:13.336542+0000","last_became_peered":"2024-09-11T23:16:13.336542+0000","last_unstale":"2024-09-11T23:16:15.552245+0000","last_undegraded":"2024-09-11T23:16:15.552245+0000","last_fullsized":"2024-09-11T23:16:15.552245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:39.826972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335794+0000","last_change":"2024-09-11T23:16:14.367904+0000","last_active":"2024-09-11T23:16:15.335794+0000","last_peered":"2024-09-11T23:16:15.335794+0000","last_clean":"2024-09-11T23:16:15.335794+0000","last_became_active":"2024-09-11T23:16:14.367555+0000","last_became_peered":"2024-09-11T23:16:14.367555+0000","last_unstale":"2024-09-11T23:16:15.335794+0000","last_undegraded":"2024-09-11T23:16:15.335794+0000","last_fullsized":"2024-09-11T23:16:15.335794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:26.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550662+0000","last_change":"2024-09-11T23:16:13.320538+0000","last_active":"2024-09-11T23:16:15.550662+0000","last_peered":"2024-09-11T23:16:15.550662+0000","last_clean":"2024-09-11T23:16:15.550662+0000","last_became_active":"2024-09-11T23:16:13.319967+0000","last_became_peered":"2024-09-11T23:16:13.319967+0000","last_unstale":"2024-09-11T23:16:15.550662+0000","last_undegraded":"2024-09-11T23:16:15.550662+0000","last_fullsized":"2024-09-11T23:16:15.550662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:56.435370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550189+0000","last_change":"2024-09-11T23:16:14.391199+0000","last_active":"2024-09-11T23:16:15.550189+0000","last_peered":"2024-09-11T23:16:15.550189+0000","last_clean":"2024-09-11T23:16:15.550189+0000","last_became_active":"2024-09-11T23:16:14.390831+0000","last_became_peered":"2024-09-11T23:16:14.390831+0000","last_unstale":"2024-09-11T23:16:15.550189+0000","last_undegraded":"2024-09-11T23:16:15.550189+0000","last_fullsized":"2024-09-11T23:16:15.550189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553324+0000","last_change":"2024-09-11T23:16:13.314156+0000","last_active":"2024-09-11T23:16:15.553324+0000","last_peered":"2024-09-11T23:16:15.553324+0000","last_clean":"2024-09-11T23:16:15.553324+0000","last_became_active":"2024-09-11T23:16:13.313469+0000","last_became_peered":"2024-09-11T23:16:13.313469+0000","last_unstale":"2024-09-11T23:16:15.553324+0000","last_undegraded":"2024-09-11T23:16:15.553324+0000","last_fullsized":"2024-09-11T23:16:15.553324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.554343+0000","last_change":"2024-09-11T23:16:14.383181+0000","last_active":"2024-09-11T23:16:15.554343+0000","last_peered":"2024-09-11T23:16:15.554343+0000","last_clean":"2024-09-11T23:16:15.554343+0000","last_became_active":"2024-09-11T23:16:14.382438+0000","last_became_peered":"2024-09-11T23:16:14.382438+0000","last_unstale":"2024-09-11T23:16:15.554343+0000","last_undegraded":"2024-09-11T23:16:15.554343+0000","last_fullsized":"2024-09-11T23:16:15.554343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:20.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:16.339823+0000","last_change":"2024-09-11T23:16:13.318752+0000","last_active":"2024-09-11T23:16:16.339823+0000","last_peered":"2024-09-11T23:16:16.339823+0000","last_clean":"2024-09-11T23:16:16.339823+0000","last_became_active":"2024-09-11T23:16:13.318281+0000","last_became_peered":"2024-09-11T23:16:13.318281+0000","last_unstale":"2024-09-11T23:16:16.339823+0000","last_undegraded":"2024-09-11T23:16:16.339823+0000","last_fullsized":"2024-09-11T23:16:16.339823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:02.168475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335782+0000","last_change":"2024-09-11T23:16:14.394370+0000","last_active":"2024-09-11T23:16:15.335782+0000","last_peered":"2024-09-11T23:16:15.335782+0000","last_clean":"2024-09-11T23:16:15.335782+0000","last_became_active":"2024-09-11T23:16:14.394093+0000","last_became_peered":"2024-09-11T23:16:14.394093+0000","last_unstale":"2024-09-11T23:16:15.335782+0000","last_undegraded":"2024-09-11T23:16:15.335782+0000","last_fullsized":"2024-09-11T23:16:15.335782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:04.079303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549320+0000","last_change":"2024-09-11T23:16:13.328838+0000","last_active":"2024-09-11T23:16:15.549320+0000","last_peered":"2024-09-11T23:16:15.549320+0000","last_clean":"2024-09-11T23:16:15.549320+0000","last_became_active":"2024-09-11T23:16:13.328158+0000","last_became_peered":"2024-09-11T23:16:13.328158+0000","last_unstale":"2024-09-11T23:16:15.549320+0000","last_undegraded":"2024-09-11T23:16:15.549320+0000","last_fullsized":"2024-09-11T23:16:15.549320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:59.824592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548977+0000","last_change":"2024-09-11T23:16:14.348026+0000","last_active":"2024-09-11T23:16:15.548977+0000","last_peered":"2024-09-11T23:16:15.548977+0000","last_clean":"2024-09-11T23:16:15.548977+0000","last_became_active":"2024-09-11T23:16:14.347188+0000","last_became_peered":"2024-09-11T23:16:14.347188+0000","last_unstale":"2024-09-11T23:16:15.548977+0000","last_undegraded":"2024-09-11T23:16:15.548977+0000","last_fullsized":"2024-09-11T23:16:15.548977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549286+0000","last_change":"2024-09-11T23:16:13.331042+0000","last_active":"2024-09-11T23:16:15.549286+0000","last_peered":"2024-09-11T23:16:15.549286+0000","last_clean":"2024-09-11T23:16:15.549286+0000","last_became_active":"2024-09-11T23:16:13.330758+0000","last_became_peered":"2024-09-11T23:16:13.330758+0000","last_unstale":"2024-09-11T23:16:15.549286+0000","last_undegraded":"2024-09-11T23:16:15.549286+0000","last_fullsized":"2024-09-11T23:16:15.549286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:39.826972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549730+0000","last_change":"2024-09-11T23:16:14.365909+0000","last_active":"2024-09-11T23:16:15.549730+0000","last_peered":"2024-09-11T23:16:15.549730+0000","last_clean":"2024-09-11T23:16:15.549730+0000","last_became_active":"2024-09-11T23:16:14.365541+0000","last_became_peered":"2024-09-11T23:16:14.365541+0000","last_unstale":"2024-09-11T23:16:15.549730+0000","last_undegraded":"2024-09-11T23:16:15.549730+0000","last_fullsized":"2024-09-11T23:16:15.549730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338562+0000","last_change":"2024-09-11T23:16:13.337806+0000","last_active":"2024-09-11T23:16:15.338562+0000","last_peered":"2024-09-11T23:16:15.338562+0000","last_clean":"2024-09-11T23:16:15.338562+0000","last_became_active":"2024-09-11T23:16:13.336910+0000","last_became_peered":"2024-09-11T23:16:13.336910+0000","last_unstale":"2024-09-11T23:16:15.338562+0000","last_undegraded":"2024-09-11T23:16:15.338562+0000","last_fullsized":"2024-09-11T23:16:15.338562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:07.478372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340008+0000","last_change":"2024-09-11T23:16:14.395926+0000","last_active":"2024-09-11T23:16:15.340008+0000","last_peered":"2024-09-11T23:16:15.340008+0000","last_clean":"2024-09-11T23:16:15.340008+0000","last_became_active":"2024-09-11T23:16:14.386827+0000","last_became_peered":"2024-09-11T23:16:14.386827+0000","last_unstale":"2024-09-11T23:16:15.340008+0000","last_undegraded":"2024-09-11T23:16:15.340008+0000","last_fullsized":"2024-09-11T23:16:15.340008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338678+0000","last_change":"2024-09-11T23:16:13.325942+0000","last_active":"2024-09-11T23:16:15.338678+0000","last_peered":"2024-09-11T23:16:15.338678+0000","last_clean":"2024-09-11T23:16:15.338678+0000","last_became_active":"2024-09-11T23:16:13.325227+0000","last_became_peered":"2024-09-11T23:16:13.325227+0000","last_unstale":"2024-09-11T23:16:15.338678+0000","last_undegraded":"2024-09-11T23:16:15.338678+0000","last_fullsized":"2024-09-11T23:16:15.338678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553768+0000","last_change":"2024-09-11T23:16:14.381319+0000","last_active":"2024-09-11T23:16:15.553768+0000","last_peered":"2024-09-11T23:16:15.553768+0000","last_clean":"2024-09-11T23:16:15.553768+0000","last_became_active":"2024-09-11T23:16:14.380780+0000","last_became_peered":"2024-09-11T23:16:14.380780+0000","last_unstale":"2024-09-11T23:16:15.553768+0000","last_undegraded":"2024-09-11T23:16:15.553768+0000","last_fullsized":"2024-09-11T23:16:15.553768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335287+0000","last_change":"2024-09-11T23:16:13.316966+0000","last_active":"2024-09-11T23:16:15.335287+0000","last_peered":"2024-09-11T23:16:15.335287+0000","last_clean":"2024-09-11T23:16:15.335287+0000","last_became_active":"2024-09-11T23:16:13.316659+0000","last_became_peered":"2024-09-11T23:16:13.316659+0000","last_unstale":"2024-09-11T23:16:15.335287+0000","last_undegraded":"2024-09-11T23:16:15.335287+0000","last_fullsized":"2024-09-11T23:16:15.335287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:32.170087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552509+0000","last_change":"2024-09-11T23:16:14.396436+0000","last_active":"2024-09-11T23:16:15.552509+0000","last_peered":"2024-09-11T23:16:15.552509+0000","last_clean":"2024-09-11T23:16:15.552509+0000","last_became_active":"2024-09-11T23:16:14.395334+0000","last_became_peered":"2024-09-11T23:16:14.395334+0000","last_unstale":"2024-09-11T23:16:15.552509+0000","last_undegraded":"2024-09-11T23:16:15.552509+0000","last_fullsized":"2024-09-11T23:16:15.552509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553813+0000","last_change":"2024-09-11T23:16:13.332441+0000","last_active":"2024-09-11T23:16:15.553813+0000","last_peered":"2024-09-11T23:16:15.553813+0000","last_clean":"2024-09-11T23:16:15.553813+0000","last_became_active":"2024-09-11T23:16:13.331267+0000","last_became_peered":"2024-09-11T23:16:13.331267+0000","last_unstale":"2024-09-11T23:16:15.553813+0000","last_undegraded":"2024-09-11T23:16:15.553813+0000","last_fullsized":"2024-09-11T23:16:15.553813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.484510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":206,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552614+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:16:15.552614+0000","last_peered":"2024-09-11T23:16:15.552614+0000","last_clean":"2024-09-11T23:16:15.552614+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:16:15.552614+0000","last_undegraded":"2024-09-11T23:16:15.552614+0000","last_fullsized":"2024-09-11T23:16:15.552614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":789422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":454656,"data_stored":197954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":197484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":197976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":466944,"data_stored":199018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":197442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":197462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1048576,"data_stored":787774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:16:18.074 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:16:18.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd6bac640 1 Processor -- start 2024-09-11T23:16:18.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd6bac640 1 -- start start 2024-09-11T23:16:18.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd6bac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd0161a60 0x7f3fd00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd6bac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fd00cf620 0x7f3fd006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd6bac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd00d32b0 con 0x7f3fd00d2e90 2024-09-11T23:16:18.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd6bac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd00d0300 con 0x7f3fd00cf620 2024-09-11T23:16:18.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd6bac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd00b0f60 con 0x7f3fd0161a60 2024-09-11T23:16:18.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd4948640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd0161a60 0x7f3fd00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd4948640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd0161a60 0x7f3fd00d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49106/0 (socket says 172.21.15.94:49106) 2024-09-11T23:16:18.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd5149640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fd00cf620 0x7f3fd006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.215+0000 7f3fd4948640 1 -- 172.21.15.94:0/3823377247 learned_addr learned my addr 172.21.15.94:0/3823377247 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:18.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd4948640 1 -- 172.21.15.94:0/3823377247 >> v2:172.21.15.155:3300/0 conn(0x7f3fd00cf620 msgr2=0x7f3fd006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:18.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd4948640 1 --2- 172.21.15.94:0/3823377247 >> v2:172.21.15.155:3300/0 conn(0x7f3fd00cf620 0x7f3fd006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd4948640 1 -- 172.21.15.94:0/3823377247 >> v1:172.21.15.155:6789/0 conn(0x7f3fd00d2e90 legacy=0x7f3fd00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd4948640 1 -- 172.21.15.94:0/3823377247 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd00cfad0 con 0x7f3fd0161a60 2024-09-11T23:16:18.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd5149640 1 --2- 172.21.15.94:0/3823377247 >> v2:172.21.15.155:3300/0 conn(0x7f3fd00cf620 0x7f3fd006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:18.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd4948640 1 --2- 172.21.15.94:0/3823377247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd0161a60 0x7f3fd00d2950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009870 tx=0x7f3fc001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=784203db0b0ff1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:18.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fcf7fe640 1 -- 172.21.15.94:0/3823377247 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00aa600 con 0x7f3fd0161a60 2024-09-11T23:16:18.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fcf7fe640 1 -- 172.21.15.94:0/3823377247 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc00af070 con 0x7f3fd0161a60 2024-09-11T23:16:18.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fcf7fe640 1 -- 172.21.15.94:0/3823377247 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00aa9c0 con 0x7f3fd0161a60 2024-09-11T23:16:18.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3823377247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd0161a60 msgr2=0x7f3fd00d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3823377247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd0161a60 0x7f3fd00d2950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009870 tx=0x7f3fc001c4a0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3823377247 shutdown_connections 2024-09-11T23:16:18.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3823377247 >> v2:172.21.15.155:3300/0 conn(0x7f3fd00cf620 0x7f3fd006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3823377247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd0161a60 0x7f3fd00d2950 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.219+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3823377247 >> 172.21.15.94:0/3823377247 conn(0x7f3fd008bf90 msgr2=0x7f3fd009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:18.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3823377247 shutdown_connections 2024-09-11T23:16:18.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3823377247 wait complete. 2024-09-11T23:16:18.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 Processor -- start 2024-09-11T23:16:18.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- start start 2024-09-11T23:16:18.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd00cf620 0x7f3fd0151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd00d2e90 0x7f3fd0154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fd0161a60 0x7f3fd00cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd006e400 con 0x7f3fd0161a60 2024-09-11T23:16:18.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd006d190 con 0x7f3fd00cf620 2024-09-11T23:16:18.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd006e580 con 0x7f3fd00d2e90 2024-09-11T23:16:18.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fd0161a60 0x7f3fd00cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd00d2e90 0x7f3fd0154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd4948640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd00cf620 0x7f3fd0151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fd0161a60 0x7f3fd00cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42996/0 (socket says 172.21.15.94:42996) 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd00d2e90 0x7f3fd0154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49120/0 (socket says 172.21.15.94:49120) 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 -- 172.21.15.94:0/3275621825 learned_addr learned my addr 172.21.15.94:0/3275621825 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 -- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd00d2e90 msgr2=0x7f3fd0154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd00d2e90 0x7f3fd0154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 -- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd00cf620 msgr2=0x7f3fd0151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd00cf620 0x7f3fd0151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 -- 172.21.15.94:0/3275621825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01612e0 con 0x7f3fd0161a60 2024-09-11T23:16:18.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd5149640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fd0161a60 0x7f3fd00cc9e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009e60 tx=0x7f3fc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:18.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fcd7fa640 1 -- 172.21.15.94:0/3275621825 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8018030 con 0x7f3fd0161a60 2024-09-11T23:16:18.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fcd7fa640 1 -- 172.21.15.94:0/3275621825 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc800cdf0 con 0x7f3fd0161a60 2024-09-11T23:16:18.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd0154c10 con 0x7f3fd0161a60 2024-09-11T23:16:18.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fcd7fa640 1 -- 172.21.15.94:0/3275621825 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8003bc0 con 0x7f3fd0161a60 2024-09-11T23:16:18.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.223+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd01551d0 con 0x7f3fd0161a60 2024-09-11T23:16:18.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.227+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd006d6b0 con 0x7f3fd0161a60 2024-09-11T23:16:18.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.227+0000 7f3fcd7fa640 1 -- 172.21.15.94:0/3275621825 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fc801b070 con 0x7f3fd0161a60 2024-09-11T23:16:18.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.227+0000 7f3fcd7fa640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fbc0678f0 0x7f3fbc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.227+0000 7f3fcd7fa640 1 -- 172.21.15.94:0/3275621825 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3fc8086750 con 0x7f3fd0161a60 2024-09-11T23:16:18.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.227+0000 7f3fd4948640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fbc0678f0 0x7f3fbc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.227+0000 7f3fd4948640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fbc0678f0 0x7f3fbc069db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00ae000 tx=0x7f3fc00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:18.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.231+0000 7f3fcd7fa640 1 -- 172.21.15.94:0/3275621825 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3fc8010040 con 0x7f3fd0161a60 2024-09-11T23:16:18.264 INFO:tasks.ceph.mds.c.smithi094.stderr:2024-09-11T23:16:18.259+0000 7f3c9645d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:16:18.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3fd00b37a0 con 0x7f3fd0161a60 2024-09-11T23:16:18.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fcd7fa640 1 -- 172.21.15.94:0/3275621825 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1473 (secure 0 0 0) 0x7f3fc80569a0 con 0x7f3fd0161a60 2024-09-11T23:16:18.450 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:18.451 INFO:teuthology.orchestra.run.smithi094.stdout:{"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":89,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096501,"num_in_osds":8,"osd_in_since":1726096491,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":243335168,"bytes_avail":772850778112,"bytes_total":773094113280,"write_bytes_sec":2515,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4902}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-11T23:16:03.985373+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:16:18.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fbc0678f0 msgr2=0x7f3fbc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fbc0678f0 0x7f3fbc069db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00ae000 tx=0x7f3fc00a7000 comp rx=0 tx=0).stop 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fd0161a60 msgr2=0x7f3fd00cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fd0161a60 0x7f3fd00cc9e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009e60 tx=0x7f3fc800c490 comp rx=0 tx=0).stop 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 shutdown_connections 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fbc0678f0 0x7f3fbc069db0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fd0161a60 0x7f3fd00cc9e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd00d2e90 0x7f3fd0154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 --2- 172.21.15.94:0/3275621825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd00cf620 0x7f3fd0151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 >> 172.21.15.94:0/3275621825 conn(0x7f3fd008bf90 msgr2=0x7f3fd00b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 shutdown_connections 2024-09-11T23:16:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.447+0000 7f3fd6bac640 1 -- 172.21.15.94:0/3275621825 wait complete. 2024-09-11T23:16:18.468 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:16:18.468 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:16:18.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.567+0000 7ff3fa739640 1 Processor -- start 2024-09-11T23:16:18.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.567+0000 7ff3fa739640 1 -- start start 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3fa739640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 0x7ff3f40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3fa739640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f40b3290 con 0x7ff3f415c2a0 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3fa739640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f40b3570 con 0x7ff3f40af470 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3fa739640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f40b3850 con 0x7ff3f415bec0 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f37fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff3f415c2a0 0x7ff3f40aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59618/0 (socket says 172.21.15.94:59618) 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f37fe640 1 -- 172.21.15.94:0/1572242938 learned_addr learned my addr 172.21.15.94:0/1572242938 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191793083 0 0) 0x7ff3f40b3290 con 0x7ff3f415c2a0 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 0x7ff3f40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3dc003530 con 0x7ff3f415c2a0 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3037254305 0 0) 0x7ff3dc003530 con 0x7ff3f415c2a0 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 msgr2=0x7ff3f40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 0x7ff3f40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 >> v1:172.21.15.155:6789/0 conn(0x7ff3f40af470 legacy=0x7ff3f406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f40b3b30 con 0x7ff3f415c2a0 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7ff3e8001680 con 0x7ff3f415c2a0 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 >> v1:172.21.15.94:6789/0 conn(0x7ff3f415c2a0 legacy=0x7ff3f40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3dc0039f0 0x7ff3dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 0x7ff3dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc004d50 0x7ff3dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40b3850 con 0x7ff3dc0039f0 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc00bb60 con 0x7ff3dc004d50 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc00bd30 con 0x7ff3f415bec0 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3dc0039f0 0x7ff3dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 -- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 msgr2=0x7ff3dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f37fe640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 0x7ff3dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f8cd6640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc004d50 0x7ff3dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f415bec0 0x7ff3dc004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 -- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc004d50 msgr2=0x7ff3dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:18.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc004d50 0x7ff3dc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 -- 172.21.15.94:0/1572242938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc003530 con 0x7ff3dc0039f0 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3dc0039f0 0x7ff3dc003e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400ba60 tx=0x7ff3e401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c506bb9f65f7f38c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400b600 con 0x7ff3dc0039f0 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e40b0070 con 0x7ff3dc0039f0 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.571+0000 7ff3f2ffd640 1 -- 172.21.15.94:0/1572242938 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e40ab880 con 0x7ff3dc0039f0 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- 172.21.15.94:0/1572242938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3dc0039f0 msgr2=0x7ff3dc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 --2- 172.21.15.94:0/1572242938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3dc0039f0 0x7ff3dc003e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400ba60 tx=0x7ff3e401c650 comp rx=0 tx=0).stop 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 -- 172.21.15.94:0/1572242938 reap_dead start 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- 172.21.15.94:0/1572242938 shutdown_connections 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- 172.21.15.94:0/1572242938 >> 172.21.15.94:0/1572242938 conn(0x7ff3f40b1f90 msgr2=0x7ff3f40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- 172.21.15.94:0/1572242938 shutdown_connections 2024-09-11T23:16:18.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- 172.21.15.94:0/1572242938 wait complete. 2024-09-11T23:16:18.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 Processor -- start 2024-09-11T23:16:18.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- start start 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc0039f0 0x7ff3f41e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f41f5d30 0x7ff3f409de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3f4154d30 0x7ff3f415f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40ad790 con 0x7ff3f4154d30 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40ad610 con 0x7ff3dc0039f0 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f406ef20 con 0x7ff3f41f5d30 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3f4154d30 0x7ff3f415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3f4154d30 0x7ff3f415f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43016/0 (socket says 172.21.15.94:43016) 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 -- 172.21.15.94:0/2630978873 learned_addr learned my addr 172.21.15.94:0/2630978873 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f37fe640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f41f5d30 0x7ff3f409de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc0039f0 0x7ff3f41e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 -- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f41f5d30 msgr2=0x7ff3f409de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f41f5d30 0x7ff3f409de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 -- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc0039f0 msgr2=0x7ff3f41e7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc0039f0 0x7ff3f41e7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 -- 172.21.15.94:0/2630978873 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f409e3b0 con 0x7ff3f4154d30 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f8cd6640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3f4154d30 0x7ff3f415f740 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40af930 tx=0x7ff3ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f0ff9640 1 -- 172.21.15.94:0/2630978873 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec018070 con 0x7ff3f4154d30 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f0ff9640 1 -- 172.21.15.94:0/2630978873 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec003b80 con 0x7ff3f4154d30 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3f0ff9640 1 -- 172.21.15.94:0/2630978873 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec005070 con 0x7ff3f4154d30 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f41f9310 con 0x7ff3f4154d30 2024-09-11T23:16:18.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.575+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f41f5530 con 0x7ff3f4154d30 2024-09-11T23:16:18.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.579+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f406e000 con 0x7ff3f4154d30 2024-09-11T23:16:18.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.579+0000 7ff3f0ff9640 1 -- 172.21.15.94:0/2630978873 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3ec01b070 con 0x7ff3f4154d30 2024-09-11T23:16:18.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.579+0000 7ff3f0ff9640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff3e00678f0 0x7ff3e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:18.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.579+0000 7ff3f0ff9640 1 -- 172.21.15.94:0/2630978873 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff3ec0855e0 con 0x7ff3f4154d30 2024-09-11T23:16:18.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.579+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff3e00678f0 0x7ff3e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:18.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.579+0000 7ff3f3fff640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff3e00678f0 0x7ff3e0069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40af000 tx=0x7ff3e40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:18.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.583+0000 7ff3f0ff9640 1 -- 172.21.15.94:0/2630978873 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3ec056020 con 0x7ff3f4154d30 2024-09-11T23:16:18.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.727+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3f40cfcb0 con 0x7ff3e00678f0 2024-09-11T23:16:18.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.747+0000 7ff3f0ff9640 1 -- 172.21.15.94:0/2630978873 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251966 (secure 0 0 0) 0x7ff3f40cfcb0 con 0x7ff3e00678f0 2024-09-11T23:16:18.753 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:18.754 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:16:18.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.747+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff3e00678f0 msgr2=0x7ff3e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff3e00678f0 0x7ff3e0069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40af000 tx=0x7ff3e40046d0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3f4154d30 msgr2=0x7ff3f415f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3f4154d30 0x7ff3f415f740 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40af930 tx=0x7ff3ec00dc00 comp rx=0 tx=0).stop 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 shutdown_connections 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff3e00678f0 0x7ff3e0069db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3f4154d30 0x7ff3f415f740 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f41f5d30 0x7ff3f409de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 --2- 172.21.15.94:0/2630978873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3dc0039f0 0x7ff3f41e7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 >> 172.21.15.94:0/2630978873 conn(0x7ff3f40b1f90 msgr2=0x7ff3f406f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 shutdown_connections 2024-09-11T23:16:18.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:18.751+0000 7ff3fa739640 1 -- 172.21.15.94:0/2630978873 wait complete. 2024-09-11T23:16:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-11T23:16:17.989589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237632,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737088,"statfs":{"total":773094113280,"available":772850778112,"internally_reserved":0,"allocated":4857856,"data_stored":2764532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698219"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336108+0000","last_change":"2024-09-11T23:16:14.351224+0000","last_active":"2024-09-11T23:16:15.336108+0000","last_peered":"2024-09-11T23:16:15.336108+0000","last_clean":"2024-09-11T23:16:15.336108+0000","last_became_active":"2024-09-11T23:16:14.350919+0000","last_became_peered":"2024-09-11T23:16:14.350919+0000","last_unstale":"2024-09-11T23:16:15.336108+0000","last_undegraded":"2024-09-11T23:16:15.336108+0000","last_fullsized":"2024-09-11T23:16:15.336108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.121063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335787+0000","last_change":"2024-09-11T23:16:14.346180+0000","last_active":"2024-09-11T23:16:15.335787+0000","last_peered":"2024-09-11T23:16:15.335787+0000","last_clean":"2024-09-11T23:16:15.335787+0000","last_became_active":"2024-09-11T23:16:14.345960+0000","last_became_peered":"2024-09-11T23:16:14.345960+0000","last_unstale":"2024-09-11T23:16:15.335787+0000","last_undegraded":"2024-09-11T23:16:15.335787+0000","last_fullsized":"2024-09-11T23:16:15.335787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:19.495390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549220+0000","last_change":"2024-09-11T23:16:14.391735+0000","last_active":"2024-09-11T23:16:15.549220+0000","last_peered":"2024-09-11T23:16:15.549220+0000","last_clean":"2024-09-11T23:16:15.549220+0000","last_became_active":"2024-09-11T23:16:14.391421+0000","last_became_peered":"2024-09-11T23:16:14.391421+0000","last_unstale":"2024-09-11T23:16:15.549220+0000","last_undegraded":"2024-09-11T23:16:15.549220+0000","last_fullsized":"2024-09-11T23:16:15.549220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550862+0000","last_change":"2024-09-11T23:16:14.379388+0000","last_active":"2024-09-11T23:16:15.550862+0000","last_peered":"2024-09-11T23:16:15.550862+0000","last_clean":"2024-09-11T23:16:15.550862+0000","last_became_active":"2024-09-11T23:16:14.378820+0000","last_became_peered":"2024-09-11T23:16:14.378820+0000","last_unstale":"2024-09-11T23:16:15.550862+0000","last_undegraded":"2024-09-11T23:16:15.550862+0000","last_fullsized":"2024-09-11T23:16:15.550862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:49.157268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550730+0000","last_change":"2024-09-11T23:16:14.379022+0000","last_active":"2024-09-11T23:16:15.550730+0000","last_peered":"2024-09-11T23:16:15.550730+0000","last_clean":"2024-09-11T23:16:15.550730+0000","last_became_active":"2024-09-11T23:16:14.378677+0000","last_became_peered":"2024-09-11T23:16:14.378677+0000","last_unstale":"2024-09-11T23:16:15.550730+0000","last_undegraded":"2024-09-11T23:16:15.550730+0000","last_fullsized":"2024-09-11T23:16:15.550730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:18.990320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549969+0000","last_change":"2024-09-11T23:16:14.344975+0000","last_active":"2024-09-11T23:16:15.549969+0000","last_peered":"2024-09-11T23:16:15.549969+0000","last_clean":"2024-09-11T23:16:15.549969+0000","last_became_active":"2024-09-11T23:16:14.344686+0000","last_became_peered":"2024-09-11T23:16:14.344686+0000","last_unstale":"2024-09-11T23:16:15.549969+0000","last_undegraded":"2024-09-11T23:16:15.549969+0000","last_fullsized":"2024-09-11T23:16:15.549969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551296+0000","last_change":"2024-09-11T23:16:14.392025+0000","last_active":"2024-09-11T23:16:15.551296+0000","last_peered":"2024-09-11T23:16:15.551296+0000","last_clean":"2024-09-11T23:16:15.551296+0000","last_became_active":"2024-09-11T23:16:14.391463+0000","last_became_peered":"2024-09-11T23:16:14.391463+0000","last_unstale":"2024-09-11T23:16:15.551296+0000","last_undegraded":"2024-09-11T23:16:15.551296+0000","last_fullsized":"2024-09-11T23:16:15.551296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335567+0000","last_change":"2024-09-11T23:16:14.384841+0000","last_active":"2024-09-11T23:16:15.335567+0000","last_peered":"2024-09-11T23:16:15.335567+0000","last_clean":"2024-09-11T23:16:15.335567+0000","last_became_active":"2024-09-11T23:16:14.384567+0000","last_became_peered":"2024-09-11T23:16:14.384567+0000","last_unstale":"2024-09-11T23:16:15.335567+0000","last_undegraded":"2024-09-11T23:16:15.335567+0000","last_fullsized":"2024-09-11T23:16:15.335567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:38.937876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549555+0000","last_change":"2024-09-11T23:16:14.397836+0000","last_active":"2024-09-11T23:16:15.549555+0000","last_peered":"2024-09-11T23:16:15.549555+0000","last_clean":"2024-09-11T23:16:15.549555+0000","last_became_active":"2024-09-11T23:16:14.397599+0000","last_became_peered":"2024-09-11T23:16:14.397599+0000","last_unstale":"2024-09-11T23:16:15.549555+0000","last_undegraded":"2024-09-11T23:16:15.549555+0000","last_fullsized":"2024-09-11T23:16:15.549555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552699+0000","last_change":"2024-09-11T23:16:14.392407+0000","last_active":"2024-09-11T23:16:15.552699+0000","last_peered":"2024-09-11T23:16:15.552699+0000","last_clean":"2024-09-11T23:16:15.552699+0000","last_became_active":"2024-09-11T23:16:14.385747+0000","last_became_peered":"2024-09-11T23:16:14.385747+0000","last_unstale":"2024-09-11T23:16:15.552699+0000","last_undegraded":"2024-09-11T23:16:15.552699+0000","last_fullsized":"2024-09-11T23:16:15.552699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:38.937876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552499+0000","last_change":"2024-09-11T23:16:14.390867+0000","last_active":"2024-09-11T23:16:15.552499+0000","last_peered":"2024-09-11T23:16:15.552499+0000","last_clean":"2024-09-11T23:16:15.552499+0000","last_became_active":"2024-09-11T23:16:14.390269+0000","last_became_peered":"2024-09-11T23:16:14.390269+0000","last_unstale":"2024-09-11T23:16:15.552499+0000","last_undegraded":"2024-09-11T23:16:15.552499+0000","last_fullsized":"2024-09-11T23:16:15.552499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:26.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549142+0000","last_change":"2024-09-11T23:16:14.350382+0000","last_active":"2024-09-11T23:16:15.549142+0000","last_peered":"2024-09-11T23:16:15.549142+0000","last_clean":"2024-09-11T23:16:15.549142+0000","last_became_active":"2024-09-11T23:16:14.350088+0000","last_became_peered":"2024-09-11T23:16:14.350088+0000","last_unstale":"2024-09-11T23:16:15.549142+0000","last_undegraded":"2024-09-11T23:16:15.549142+0000","last_fullsized":"2024-09-11T23:16:15.549142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551582+0000","last_change":"2024-09-11T23:16:14.395687+0000","last_active":"2024-09-11T23:16:15.551582+0000","last_peered":"2024-09-11T23:16:15.551582+0000","last_clean":"2024-09-11T23:16:15.551582+0000","last_became_active":"2024-09-11T23:16:14.392287+0000","last_became_peered":"2024-09-11T23:16:14.392287+0000","last_unstale":"2024-09-11T23:16:15.551582+0000","last_undegraded":"2024-09-11T23:16:15.551582+0000","last_fullsized":"2024-09-11T23:16:15.551582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.907854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338672+0000","last_change":"2024-09-11T23:16:14.396261+0000","last_active":"2024-09-11T23:16:15.338672+0000","last_peered":"2024-09-11T23:16:15.338672+0000","last_clean":"2024-09-11T23:16:15.338672+0000","last_became_active":"2024-09-11T23:16:14.387510+0000","last_became_peered":"2024-09-11T23:16:14.387510+0000","last_unstale":"2024-09-11T23:16:15.338672+0000","last_undegraded":"2024-09-11T23:16:15.338672+0000","last_fullsized":"2024-09-11T23:16:15.338672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551470+0000","last_change":"2024-09-11T23:16:14.391001+0000","last_active":"2024-09-11T23:16:15.551470+0000","last_peered":"2024-09-11T23:16:15.551470+0000","last_clean":"2024-09-11T23:16:15.551470+0000","last_became_active":"2024-09-11T23:16:14.390379+0000","last_became_peered":"2024-09-11T23:16:14.390379+0000","last_unstale":"2024-09-11T23:16:15.551470+0000","last_undegraded":"2024-09-11T23:16:15.551470+0000","last_fullsized":"2024-09-11T23:16:15.551470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:20.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551795+0000","last_change":"2024-09-11T23:16:14.390401+0000","last_active":"2024-09-11T23:16:15.551795+0000","last_peered":"2024-09-11T23:16:15.551795+0000","last_clean":"2024-09-11T23:16:15.551795+0000","last_became_active":"2024-09-11T23:16:14.389777+0000","last_became_peered":"2024-09-11T23:16:14.389777+0000","last_unstale":"2024-09-11T23:16:15.551795+0000","last_undegraded":"2024-09-11T23:16:15.551795+0000","last_fullsized":"2024-09-11T23:16:15.551795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.554175+0000","last_change":"2024-09-11T23:16:14.398192+0000","last_active":"2024-09-11T23:16:15.554175+0000","last_peered":"2024-09-11T23:16:15.554175+0000","last_clean":"2024-09-11T23:16:15.554175+0000","last_became_active":"2024-09-11T23:16:14.397734+0000","last_became_peered":"2024-09-11T23:16:14.397734+0000","last_unstale":"2024-09-11T23:16:15.554175+0000","last_undegraded":"2024-09-11T23:16:15.554175+0000","last_fullsized":"2024-09-11T23:16:15.554175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339372+0000","last_change":"2024-09-11T23:16:14.403372+0000","last_active":"2024-09-11T23:16:15.339372+0000","last_peered":"2024-09-11T23:16:15.339372+0000","last_clean":"2024-09-11T23:16:15.339372+0000","last_became_active":"2024-09-11T23:16:14.402828+0000","last_became_peered":"2024-09-11T23:16:14.402828+0000","last_unstale":"2024-09-11T23:16:15.339372+0000","last_undegraded":"2024-09-11T23:16:15.339372+0000","last_fullsized":"2024-09-11T23:16:15.339372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:47.839047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550929+0000","last_change":"2024-09-11T23:16:14.348099+0000","last_active":"2024-09-11T23:16:15.550929+0000","last_peered":"2024-09-11T23:16:15.550929+0000","last_clean":"2024-09-11T23:16:15.550929+0000","last_became_active":"2024-09-11T23:16:14.347397+0000","last_became_peered":"2024-09-11T23:16:14.347397+0000","last_unstale":"2024-09-11T23:16:15.550929+0000","last_undegraded":"2024-09-11T23:16:15.550929+0000","last_fullsized":"2024-09-11T23:16:15.550929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:14.367835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339019+0000","last_change":"2024-09-11T23:16:14.403249+0000","last_active":"2024-09-11T23:16:15.339019+0000","last_peered":"2024-09-11T23:16:15.339019+0000","last_clean":"2024-09-11T23:16:15.339019+0000","last_became_active":"2024-09-11T23:16:14.402699+0000","last_became_peered":"2024-09-11T23:16:14.402699+0000","last_unstale":"2024-09-11T23:16:15.339019+0000","last_undegraded":"2024-09-11T23:16:15.339019+0000","last_fullsized":"2024-09-11T23:16:15.339019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:23.274577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551976+0000","last_change":"2024-09-11T23:16:14.385579+0000","last_active":"2024-09-11T23:16:15.551976+0000","last_peered":"2024-09-11T23:16:15.551976+0000","last_clean":"2024-09-11T23:16:15.551976+0000","last_became_active":"2024-09-11T23:16:14.383893+0000","last_became_peered":"2024-09-11T23:16:14.383893+0000","last_unstale":"2024-09-11T23:16:15.551976+0000","last_undegraded":"2024-09-11T23:16:15.551976+0000","last_fullsized":"2024-09-11T23:16:15.551976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.448095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340596+0000","last_change":"2024-09-11T23:16:14.386167+0000","last_active":"2024-09-11T23:16:15.340596+0000","last_peered":"2024-09-11T23:16:15.340596+0000","last_clean":"2024-09-11T23:16:15.340596+0000","last_became_active":"2024-09-11T23:16:14.377425+0000","last_became_peered":"2024-09-11T23:16:14.377425+0000","last_unstale":"2024-09-11T23:16:15.340596+0000","last_undegraded":"2024-09-11T23:16:15.340596+0000","last_fullsized":"2024-09-11T23:16:15.340596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551610+0000","last_change":"2024-09-11T23:16:14.360520+0000","last_active":"2024-09-11T23:16:15.551610+0000","last_peered":"2024-09-11T23:16:15.551610+0000","last_clean":"2024-09-11T23:16:15.551610+0000","last_became_active":"2024-09-11T23:16:14.358873+0000","last_became_peered":"2024-09-11T23:16:14.358873+0000","last_unstale":"2024-09-11T23:16:15.551610+0000","last_undegraded":"2024-09-11T23:16:15.551610+0000","last_fullsized":"2024-09-11T23:16:15.551610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.299783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550559+0000","last_change":"2024-09-11T23:16:14.352656+0000","last_active":"2024-09-11T23:16:15.550559+0000","last_peered":"2024-09-11T23:16:15.550559+0000","last_clean":"2024-09-11T23:16:15.550559+0000","last_became_active":"2024-09-11T23:16:14.352350+0000","last_became_peered":"2024-09-11T23:16:14.352350+0000","last_unstale":"2024-09-11T23:16:15.550559+0000","last_undegraded":"2024-09-11T23:16:15.550559+0000","last_fullsized":"2024-09-11T23:16:15.550559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:08.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339259+0000","last_change":"2024-09-11T23:16:14.383033+0000","last_active":"2024-09-11T23:16:15.339259+0000","last_peered":"2024-09-11T23:16:15.339259+0000","last_clean":"2024-09-11T23:16:15.339259+0000","last_became_active":"2024-09-11T23:16:14.382285+0000","last_became_peered":"2024-09-11T23:16:14.382285+0000","last_unstale":"2024-09-11T23:16:15.339259+0000","last_undegraded":"2024-09-11T23:16:15.339259+0000","last_fullsized":"2024-09-11T23:16:15.339259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:38.144000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549727+0000","last_change":"2024-09-11T23:16:14.396300+0000","last_active":"2024-09-11T23:16:15.549727+0000","last_peered":"2024-09-11T23:16:15.549727+0000","last_clean":"2024-09-11T23:16:15.549727+0000","last_became_active":"2024-09-11T23:16:14.396009+0000","last_became_peered":"2024-09-11T23:16:14.396009+0000","last_unstale":"2024-09-11T23:16:15.549727+0000","last_undegraded":"2024-09-11T23:16:15.549727+0000","last_fullsized":"2024-09-11T23:16:15.549727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339521+0000","last_change":"2024-09-11T23:16:14.379376+0000","last_active":"2024-09-11T23:16:15.339521+0000","last_peered":"2024-09-11T23:16:15.339521+0000","last_clean":"2024-09-11T23:16:15.339521+0000","last_became_active":"2024-09-11T23:16:14.369960+0000","last_became_peered":"2024-09-11T23:16:14.369960+0000","last_unstale":"2024-09-11T23:16:15.339521+0000","last_undegraded":"2024-09-11T23:16:15.339521+0000","last_fullsized":"2024-09-11T23:16:15.339521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:58.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552279+0000","last_change":"2024-09-11T23:16:14.367982+0000","last_active":"2024-09-11T23:16:15.552279+0000","last_peered":"2024-09-11T23:16:15.552279+0000","last_clean":"2024-09-11T23:16:15.552279+0000","last_became_active":"2024-09-11T23:16:14.356651+0000","last_became_peered":"2024-09-11T23:16:14.356651+0000","last_unstale":"2024-09-11T23:16:15.552279+0000","last_undegraded":"2024-09-11T23:16:15.552279+0000","last_fullsized":"2024-09-11T23:16:15.552279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.974140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339193+0000","last_change":"2024-09-11T23:16:14.379577+0000","last_active":"2024-09-11T23:16:15.339193+0000","last_peered":"2024-09-11T23:16:15.339193+0000","last_clean":"2024-09-11T23:16:15.339193+0000","last_became_active":"2024-09-11T23:16:14.368714+0000","last_became_peered":"2024-09-11T23:16:14.368714+0000","last_unstale":"2024-09-11T23:16:15.339193+0000","last_undegraded":"2024-09-11T23:16:15.339193+0000","last_fullsized":"2024-09-11T23:16:15.339193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:08.485908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338174+0000","last_change":"2024-09-11T23:16:14.378832+0000","last_active":"2024-09-11T23:16:15.338174+0000","last_peered":"2024-09-11T23:16:15.338174+0000","last_clean":"2024-09-11T23:16:15.338174+0000","last_became_active":"2024-09-11T23:16:14.368984+0000","last_became_peered":"2024-09-11T23:16:14.368984+0000","last_unstale":"2024-09-11T23:16:15.338174+0000","last_undegraded":"2024-09-11T23:16:15.338174+0000","last_fullsized":"2024-09-11T23:16:15.338174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:09.606832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551997+0000","last_change":"2024-09-11T23:16:14.360602+0000","last_active":"2024-09-11T23:16:15.551997+0000","last_peered":"2024-09-11T23:16:15.551997+0000","last_clean":"2024-09-11T23:16:15.551997+0000","last_became_active":"2024-09-11T23:16:14.359801+0000","last_became_peered":"2024-09-11T23:16:14.359801+0000","last_unstale":"2024-09-11T23:16:15.551997+0000","last_undegraded":"2024-09-11T23:16:15.551997+0000","last_fullsized":"2024-09-11T23:16:15.551997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550502+0000","last_change":"2024-09-11T23:16:14.345415+0000","last_active":"2024-09-11T23:16:15.550502+0000","last_peered":"2024-09-11T23:16:15.550502+0000","last_clean":"2024-09-11T23:16:15.550502+0000","last_became_active":"2024-09-11T23:16:14.345049+0000","last_became_peered":"2024-09-11T23:16:14.345049+0000","last_unstale":"2024-09-11T23:16:15.550502+0000","last_undegraded":"2024-09-11T23:16:15.550502+0000","last_fullsized":"2024-09-11T23:16:15.550502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553850+0000","last_change":"2024-09-11T23:16:14.392265+0000","last_active":"2024-09-11T23:16:15.553850+0000","last_peered":"2024-09-11T23:16:15.553850+0000","last_clean":"2024-09-11T23:16:15.553850+0000","last_became_active":"2024-09-11T23:16:14.391643+0000","last_became_peered":"2024-09-11T23:16:14.391643+0000","last_unstale":"2024-09-11T23:16:15.553850+0000","last_undegraded":"2024-09-11T23:16:15.553850+0000","last_fullsized":"2024-09-11T23:16:15.553850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339289+0000","last_change":"2024-09-11T23:16:13.337352+0000","last_active":"2024-09-11T23:16:15.339289+0000","last_peered":"2024-09-11T23:16:15.339289+0000","last_clean":"2024-09-11T23:16:15.339289+0000","last_became_active":"2024-09-11T23:16:13.335783+0000","last_became_peered":"2024-09-11T23:16:13.335783+0000","last_unstale":"2024-09-11T23:16:15.339289+0000","last_undegraded":"2024-09-11T23:16:15.339289+0000","last_fullsized":"2024-09-11T23:16:15.339289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.484510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550029+0000","last_change":"2024-09-11T23:16:14.392711+0000","last_active":"2024-09-11T23:16:15.550029+0000","last_peered":"2024-09-11T23:16:15.550029+0000","last_clean":"2024-09-11T23:16:15.550029+0000","last_became_active":"2024-09-11T23:16:14.392452+0000","last_became_peered":"2024-09-11T23:16:14.392452+0000","last_unstale":"2024-09-11T23:16:15.550029+0000","last_undegraded":"2024-09-11T23:16:15.550029+0000","last_fullsized":"2024-09-11T23:16:15.550029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549354+0000","last_change":"2024-09-11T23:16:13.331310+0000","last_active":"2024-09-11T23:16:15.549354+0000","last_peered":"2024-09-11T23:16:15.549354+0000","last_clean":"2024-09-11T23:16:15.549354+0000","last_became_active":"2024-09-11T23:16:13.330554+0000","last_became_peered":"2024-09-11T23:16:13.330554+0000","last_unstale":"2024-09-11T23:16:15.549354+0000","last_undegraded":"2024-09-11T23:16:15.549354+0000","last_fullsized":"2024-09-11T23:16:15.549354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.970882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340957+0000","last_change":"2024-09-11T23:16:14.394809+0000","last_active":"2024-09-11T23:16:15.340957+0000","last_peered":"2024-09-11T23:16:15.340957+0000","last_clean":"2024-09-11T23:16:15.340957+0000","last_became_active":"2024-09-11T23:16:14.394245+0000","last_became_peered":"2024-09-11T23:16:14.394245+0000","last_unstale":"2024-09-11T23:16:15.340957+0000","last_undegraded":"2024-09-11T23:16:15.340957+0000","last_fullsized":"2024-09-11T23:16:15.340957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550231+0000","last_change":"2024-09-11T23:16:13.314070+0000","last_active":"2024-09-11T23:16:15.550231+0000","last_peered":"2024-09-11T23:16:15.550231+0000","last_clean":"2024-09-11T23:16:15.550231+0000","last_became_active":"2024-09-11T23:16:13.313270+0000","last_became_peered":"2024-09-11T23:16:13.313270+0000","last_unstale":"2024-09-11T23:16:15.550231+0000","last_undegraded":"2024-09-11T23:16:15.550231+0000","last_fullsized":"2024-09-11T23:16:15.550231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336259+0000","last_change":"2024-09-11T23:16:14.384382+0000","last_active":"2024-09-11T23:16:15.336259+0000","last_peered":"2024-09-11T23:16:15.336259+0000","last_clean":"2024-09-11T23:16:15.336259+0000","last_became_active":"2024-09-11T23:16:14.384118+0000","last_became_peered":"2024-09-11T23:16:14.384118+0000","last_unstale":"2024-09-11T23:16:15.336259+0000","last_undegraded":"2024-09-11T23:16:15.336259+0000","last_fullsized":"2024-09-11T23:16:15.336259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:22.535507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340460+0000","last_change":"2024-09-11T23:16:13.325773+0000","last_active":"2024-09-11T23:16:15.340460+0000","last_peered":"2024-09-11T23:16:15.340460+0000","last_clean":"2024-09-11T23:16:15.340460+0000","last_became_active":"2024-09-11T23:16:13.325043+0000","last_became_peered":"2024-09-11T23:16:13.325043+0000","last_unstale":"2024-09-11T23:16:15.340460+0000","last_undegraded":"2024-09-11T23:16:15.340460+0000","last_fullsized":"2024-09-11T23:16:15.340460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548715+0000","last_change":"2024-09-11T23:16:14.348345+0000","last_active":"2024-09-11T23:16:15.548715+0000","last_peered":"2024-09-11T23:16:15.548715+0000","last_clean":"2024-09-11T23:16:15.548715+0000","last_became_active":"2024-09-11T23:16:14.347664+0000","last_became_peered":"2024-09-11T23:16:14.347664+0000","last_unstale":"2024-09-11T23:16:15.548715+0000","last_undegraded":"2024-09-11T23:16:15.548715+0000","last_fullsized":"2024-09-11T23:16:15.548715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:58.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553338+0000","last_change":"2024-09-11T23:16:13.339890+0000","last_active":"2024-09-11T23:16:15.553338+0000","last_peered":"2024-09-11T23:16:15.553338+0000","last_clean":"2024-09-11T23:16:15.553338+0000","last_became_active":"2024-09-11T23:16:13.339166+0000","last_became_peered":"2024-09-11T23:16:13.339166+0000","last_unstale":"2024-09-11T23:16:15.553338+0000","last_undegraded":"2024-09-11T23:16:15.553338+0000","last_fullsized":"2024-09-11T23:16:15.553338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:37.135203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551697+0000","last_change":"2024-09-11T23:16:14.385350+0000","last_active":"2024-09-11T23:16:15.551697+0000","last_peered":"2024-09-11T23:16:15.551697+0000","last_clean":"2024-09-11T23:16:15.551697+0000","last_became_active":"2024-09-11T23:16:14.383898+0000","last_became_peered":"2024-09-11T23:16:14.383898+0000","last_unstale":"2024-09-11T23:16:15.551697+0000","last_undegraded":"2024-09-11T23:16:15.551697+0000","last_fullsized":"2024-09-11T23:16:15.551697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:36.520699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553018+0000","last_change":"2024-09-11T23:16:13.331962+0000","last_active":"2024-09-11T23:16:15.553018+0000","last_peered":"2024-09-11T23:16:15.553018+0000","last_clean":"2024-09-11T23:16:15.553018+0000","last_became_active":"2024-09-11T23:16:13.330403+0000","last_became_peered":"2024-09-11T23:16:13.330403+0000","last_unstale":"2024-09-11T23:16:15.553018+0000","last_undegraded":"2024-09-11T23:16:15.553018+0000","last_fullsized":"2024-09-11T23:16:15.553018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.970882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340241+0000","last_change":"2024-09-11T23:16:14.400908+0000","last_active":"2024-09-11T23:16:15.340241+0000","last_peered":"2024-09-11T23:16:15.340241+0000","last_clean":"2024-09-11T23:16:15.340241+0000","last_became_active":"2024-09-11T23:16:14.399921+0000","last_became_peered":"2024-09-11T23:16:14.399921+0000","last_unstale":"2024-09-11T23:16:15.340241+0000","last_undegraded":"2024-09-11T23:16:15.340241+0000","last_fullsized":"2024-09-11T23:16:15.340241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549820+0000","last_change":"2024-09-11T23:16:13.323646+0000","last_active":"2024-09-11T23:16:15.549820+0000","last_peered":"2024-09-11T23:16:15.549820+0000","last_clean":"2024-09-11T23:16:15.549820+0000","last_became_active":"2024-09-11T23:16:13.323118+0000","last_became_peered":"2024-09-11T23:16:13.323118+0000","last_unstale":"2024-09-11T23:16:15.549820+0000","last_undegraded":"2024-09-11T23:16:15.549820+0000","last_fullsized":"2024-09-11T23:16:15.549820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335539+0000","last_change":"2024-09-11T23:16:14.367792+0000","last_active":"2024-09-11T23:16:15.335539+0000","last_peered":"2024-09-11T23:16:15.335539+0000","last_clean":"2024-09-11T23:16:15.335539+0000","last_became_active":"2024-09-11T23:16:14.367519+0000","last_became_peered":"2024-09-11T23:16:14.367519+0000","last_unstale":"2024-09-11T23:16:15.335539+0000","last_undegraded":"2024-09-11T23:16:15.335539+0000","last_fullsized":"2024-09-11T23:16:15.335539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:16.533562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338511+0000","last_change":"2024-09-11T23:16:13.336803+0000","last_active":"2024-09-11T23:16:15.338511+0000","last_peered":"2024-09-11T23:16:15.338511+0000","last_clean":"2024-09-11T23:16:15.338511+0000","last_became_active":"2024-09-11T23:16:13.336017+0000","last_became_peered":"2024-09-11T23:16:13.336017+0000","last_unstale":"2024-09-11T23:16:15.338511+0000","last_undegraded":"2024-09-11T23:16:15.338511+0000","last_fullsized":"2024-09-11T23:16:15.338511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551023+0000","last_change":"2024-09-11T23:16:14.375304+0000","last_active":"2024-09-11T23:16:15.551023+0000","last_peered":"2024-09-11T23:16:15.551023+0000","last_clean":"2024-09-11T23:16:15.551023+0000","last_became_active":"2024-09-11T23:16:14.375038+0000","last_became_peered":"2024-09-11T23:16:14.375038+0000","last_unstale":"2024-09-11T23:16:15.551023+0000","last_undegraded":"2024-09-11T23:16:15.551023+0000","last_fullsized":"2024-09-11T23:16:15.551023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:31.194287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336232+0000","last_change":"2024-09-11T23:16:13.326933+0000","last_active":"2024-09-11T23:16:15.336232+0000","last_peered":"2024-09-11T23:16:15.336232+0000","last_clean":"2024-09-11T23:16:15.336232+0000","last_became_active":"2024-09-11T23:16:13.326399+0000","last_became_peered":"2024-09-11T23:16:13.326399+0000","last_unstale":"2024-09-11T23:16:15.336232+0000","last_undegraded":"2024-09-11T23:16:15.336232+0000","last_fullsized":"2024-09-11T23:16:15.336232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:36.491647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553992+0000","last_change":"2024-09-11T23:16:14.388668+0000","last_active":"2024-09-11T23:16:15.553992+0000","last_peered":"2024-09-11T23:16:15.553992+0000","last_clean":"2024-09-11T23:16:15.553992+0000","last_became_active":"2024-09-11T23:16:14.388024+0000","last_became_peered":"2024-09-11T23:16:14.388024+0000","last_unstale":"2024-09-11T23:16:15.553992+0000","last_undegraded":"2024-09-11T23:16:15.553992+0000","last_fullsized":"2024-09-11T23:16:15.553992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553042+0000","last_change":"2024-09-11T23:16:13.324368+0000","last_active":"2024-09-11T23:16:15.553042+0000","last_peered":"2024-09-11T23:16:15.553042+0000","last_clean":"2024-09-11T23:16:15.553042+0000","last_became_active":"2024-09-11T23:16:13.323655+0000","last_became_peered":"2024-09-11T23:16:13.323655+0000","last_unstale":"2024-09-11T23:16:15.553042+0000","last_undegraded":"2024-09-11T23:16:15.553042+0000","last_fullsized":"2024-09-11T23:16:15.553042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549223+0000","last_change":"2024-09-11T23:16:14.368439+0000","last_active":"2024-09-11T23:16:15.549223+0000","last_peered":"2024-09-11T23:16:15.549223+0000","last_clean":"2024-09-11T23:16:15.549223+0000","last_became_active":"2024-09-11T23:16:14.368086+0000","last_became_peered":"2024-09-11T23:16:14.368086+0000","last_unstale":"2024-09-11T23:16:15.549223+0000","last_undegraded":"2024-09-11T23:16:15.549223+0000","last_fullsized":"2024-09-11T23:16:15.549223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553050+0000","last_change":"2024-09-11T23:16:13.321064+0000","last_active":"2024-09-11T23:16:15.553050+0000","last_peered":"2024-09-11T23:16:15.553050+0000","last_clean":"2024-09-11T23:16:15.553050+0000","last_became_active":"2024-09-11T23:16:13.320359+0000","last_became_peered":"2024-09-11T23:16:13.320359+0000","last_unstale":"2024-09-11T23:16:15.553050+0000","last_undegraded":"2024-09-11T23:16:15.553050+0000","last_fullsized":"2024-09-11T23:16:15.553050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:22.265779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340905+0000","last_change":"2024-09-11T23:16:14.394639+0000","last_active":"2024-09-11T23:16:15.340905+0000","last_peered":"2024-09-11T23:16:15.340905+0000","last_clean":"2024-09-11T23:16:15.340905+0000","last_became_active":"2024-09-11T23:16:14.383803+0000","last_became_peered":"2024-09-11T23:16:14.383803+0000","last_unstale":"2024-09-11T23:16:15.340905+0000","last_undegraded":"2024-09-11T23:16:15.340905+0000","last_fullsized":"2024-09-11T23:16:15.340905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335722+0000","last_change":"2024-09-11T23:16:13.332747+0000","last_active":"2024-09-11T23:16:15.335722+0000","last_peered":"2024-09-11T23:16:15.335722+0000","last_clean":"2024-09-11T23:16:15.335722+0000","last_became_active":"2024-09-11T23:16:13.332104+0000","last_became_peered":"2024-09-11T23:16:13.332104+0000","last_unstale":"2024-09-11T23:16:15.335722+0000","last_undegraded":"2024-09-11T23:16:15.335722+0000","last_fullsized":"2024-09-11T23:16:15.335722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:40.527548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548725+0000","last_change":"2024-09-11T23:16:14.392414+0000","last_active":"2024-09-11T23:16:15.548725+0000","last_peered":"2024-09-11T23:16:15.548725+0000","last_clean":"2024-09-11T23:16:15.548725+0000","last_became_active":"2024-09-11T23:16:14.392099+0000","last_became_peered":"2024-09-11T23:16:14.392099+0000","last_unstale":"2024-09-11T23:16:15.548725+0000","last_undegraded":"2024-09-11T23:16:15.548725+0000","last_fullsized":"2024-09-11T23:16:15.548725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.299783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335672+0000","last_change":"2024-09-11T23:16:13.336911+0000","last_active":"2024-09-11T23:16:15.335672+0000","last_peered":"2024-09-11T23:16:15.335672+0000","last_clean":"2024-09-11T23:16:15.335672+0000","last_became_active":"2024-09-11T23:16:13.336363+0000","last_became_peered":"2024-09-11T23:16:13.336363+0000","last_unstale":"2024-09-11T23:16:15.335672+0000","last_undegraded":"2024-09-11T23:16:15.335672+0000","last_fullsized":"2024-09-11T23:16:15.335672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:01.564513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335320+0000","last_change":"2024-09-11T23:16:14.351542+0000","last_active":"2024-09-11T23:16:15.335320+0000","last_peered":"2024-09-11T23:16:15.335320+0000","last_clean":"2024-09-11T23:16:15.335320+0000","last_became_active":"2024-09-11T23:16:14.351059+0000","last_became_peered":"2024-09-11T23:16:14.351059+0000","last_unstale":"2024-09-11T23:16:15.335320+0000","last_undegraded":"2024-09-11T23:16:15.335320+0000","last_fullsized":"2024-09-11T23:16:15.335320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550057+0000","last_change":"2024-09-11T23:16:13.324038+0000","last_active":"2024-09-11T23:16:15.550057+0000","last_peered":"2024-09-11T23:16:15.550057+0000","last_clean":"2024-09-11T23:16:15.550057+0000","last_became_active":"2024-09-11T23:16:13.323374+0000","last_became_peered":"2024-09-11T23:16:13.323374+0000","last_unstale":"2024-09-11T23:16:15.550057+0000","last_undegraded":"2024-09-11T23:16:15.550057+0000","last_fullsized":"2024-09-11T23:16:15.550057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.674238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552750+0000","last_change":"2024-09-11T23:16:14.360868+0000","last_active":"2024-09-11T23:16:15.552750+0000","last_peered":"2024-09-11T23:16:15.552750+0000","last_clean":"2024-09-11T23:16:15.552750+0000","last_became_active":"2024-09-11T23:16:14.360164+0000","last_became_peered":"2024-09-11T23:16:14.360164+0000","last_unstale":"2024-09-11T23:16:15.552750+0000","last_undegraded":"2024-09-11T23:16:15.552750+0000","last_fullsized":"2024-09-11T23:16:15.552750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.337942+0000","last_change":"2024-09-11T23:16:13.331248+0000","last_active":"2024-09-11T23:16:15.337942+0000","last_peered":"2024-09-11T23:16:15.337942+0000","last_clean":"2024-09-11T23:16:15.337942+0000","last_became_active":"2024-09-11T23:16:13.330516+0000","last_became_peered":"2024-09-11T23:16:13.330516+0000","last_unstale":"2024-09-11T23:16:15.337942+0000","last_undegraded":"2024-09-11T23:16:15.337942+0000","last_fullsized":"2024-09-11T23:16:15.337942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:47.577588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335559+0000","last_change":"2024-09-11T23:16:14.352083+0000","last_active":"2024-09-11T23:16:15.335559+0000","last_peered":"2024-09-11T23:16:15.335559+0000","last_clean":"2024-09-11T23:16:15.335559+0000","last_became_active":"2024-09-11T23:16:14.351725+0000","last_became_peered":"2024-09-11T23:16:14.351725+0000","last_unstale":"2024-09-11T23:16:15.335559+0000","last_undegraded":"2024-09-11T23:16:15.335559+0000","last_fullsized":"2024-09-11T23:16:15.335559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:10.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552073+0000","last_change":"2024-09-11T23:16:13.326807+0000","last_active":"2024-09-11T23:16:15.552073+0000","last_peered":"2024-09-11T23:16:15.552073+0000","last_clean":"2024-09-11T23:16:15.552073+0000","last_became_active":"2024-09-11T23:16:13.325592+0000","last_became_peered":"2024-09-11T23:16:13.325592+0000","last_unstale":"2024-09-11T23:16:15.552073+0000","last_undegraded":"2024-09-11T23:16:15.552073+0000","last_fullsized":"2024-09-11T23:16:15.552073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:07.478372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335641+0000","last_change":"2024-09-11T23:16:14.365792+0000","last_active":"2024-09-11T23:16:15.335641+0000","last_peered":"2024-09-11T23:16:15.335641+0000","last_clean":"2024-09-11T23:16:15.335641+0000","last_became_active":"2024-09-11T23:16:14.365526+0000","last_became_peered":"2024-09-11T23:16:14.365526+0000","last_unstale":"2024-09-11T23:16:15.335641+0000","last_undegraded":"2024-09-11T23:16:15.335641+0000","last_fullsized":"2024-09-11T23:16:15.335641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:07.629887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552995+0000","last_change":"2024-09-11T23:16:13.321790+0000","last_active":"2024-09-11T23:16:15.552995+0000","last_peered":"2024-09-11T23:16:15.552995+0000","last_clean":"2024-09-11T23:16:15.552995+0000","last_became_active":"2024-09-11T23:16:13.320995+0000","last_became_peered":"2024-09-11T23:16:13.320995+0000","last_unstale":"2024-09-11T23:16:15.552995+0000","last_undegraded":"2024-09-11T23:16:15.552995+0000","last_fullsized":"2024-09-11T23:16:15.552995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552889+0000","last_change":"2024-09-11T23:16:14.356529+0000","last_active":"2024-09-11T23:16:15.552889+0000","last_peered":"2024-09-11T23:16:15.552889+0000","last_clean":"2024-09-11T23:16:15.552889+0000","last_became_active":"2024-09-11T23:16:14.355812+0000","last_became_peered":"2024-09-11T23:16:14.355812+0000","last_unstale":"2024-09-11T23:16:15.552889+0000","last_undegraded":"2024-09-11T23:16:15.552889+0000","last_fullsized":"2024-09-11T23:16:15.552889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:16.533562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.341153+0000","last_change":"2024-09-11T23:16:13.328848+0000","last_active":"2024-09-11T23:16:15.341153+0000","last_peered":"2024-09-11T23:16:15.341153+0000","last_clean":"2024-09-11T23:16:15.341153+0000","last_became_active":"2024-09-11T23:16:13.328075+0000","last_became_peered":"2024-09-11T23:16:13.328075+0000","last_unstale":"2024-09-11T23:16:15.341153+0000","last_undegraded":"2024-09-11T23:16:15.341153+0000","last_fullsized":"2024-09-11T23:16:15.341153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.674238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340956+0000","last_change":"2024-09-11T23:16:14.396065+0000","last_active":"2024-09-11T23:16:15.340956+0000","last_peered":"2024-09-11T23:16:15.340956+0000","last_clean":"2024-09-11T23:16:15.340956+0000","last_became_active":"2024-09-11T23:16:14.393989+0000","last_became_peered":"2024-09-11T23:16:14.393989+0000","last_unstale":"2024-09-11T23:16:15.340956+0000","last_undegraded":"2024-09-11T23:16:15.340956+0000","last_fullsized":"2024-09-11T23:16:15.340956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550924+0000","last_change":"2024-09-11T23:16:13.325992+0000","last_active":"2024-09-11T23:16:15.550924+0000","last_peered":"2024-09-11T23:16:15.550924+0000","last_clean":"2024-09-11T23:16:15.550924+0000","last_became_active":"2024-09-11T23:16:13.325437+0000","last_became_peered":"2024-09-11T23:16:13.325437+0000","last_unstale":"2024-09-11T23:16:15.550924+0000","last_undegraded":"2024-09-11T23:16:15.550924+0000","last_fullsized":"2024-09-11T23:16:15.550924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:36.843321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551022+0000","last_change":"2024-09-11T23:16:14.349053+0000","last_active":"2024-09-11T23:16:15.551022+0000","last_peered":"2024-09-11T23:16:15.551022+0000","last_clean":"2024-09-11T23:16:15.551022+0000","last_became_active":"2024-09-11T23:16:14.347635+0000","last_became_peered":"2024-09-11T23:16:14.347635+0000","last_unstale":"2024-09-11T23:16:15.551022+0000","last_undegraded":"2024-09-11T23:16:15.551022+0000","last_fullsized":"2024-09-11T23:16:15.551022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:41.939962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550282+0000","last_change":"2024-09-11T23:16:13.313108+0000","last_active":"2024-09-11T23:16:15.550282+0000","last_peered":"2024-09-11T23:16:15.550282+0000","last_clean":"2024-09-11T23:16:15.550282+0000","last_became_active":"2024-09-11T23:16:13.312767+0000","last_became_peered":"2024-09-11T23:16:13.312767+0000","last_unstale":"2024-09-11T23:16:15.550282+0000","last_undegraded":"2024-09-11T23:16:15.550282+0000","last_fullsized":"2024-09-11T23:16:15.550282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552473+0000","last_change":"2024-09-11T23:16:14.376574+0000","last_active":"2024-09-11T23:16:15.552473+0000","last_peered":"2024-09-11T23:16:15.552473+0000","last_clean":"2024-09-11T23:16:15.552473+0000","last_became_active":"2024-09-11T23:16:14.375783+0000","last_became_peered":"2024-09-11T23:16:14.375783+0000","last_unstale":"2024-09-11T23:16:15.552473+0000","last_undegraded":"2024-09-11T23:16:15.552473+0000","last_fullsized":"2024-09-11T23:16:15.552473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550794+0000","last_change":"2024-09-11T23:16:13.331941+0000","last_active":"2024-09-11T23:16:15.550794+0000","last_peered":"2024-09-11T23:16:15.550794+0000","last_clean":"2024-09-11T23:16:15.550794+0000","last_became_active":"2024-09-11T23:16:13.331461+0000","last_became_peered":"2024-09-11T23:16:13.331461+0000","last_unstale":"2024-09-11T23:16:15.550794+0000","last_undegraded":"2024-09-11T23:16:15.550794+0000","last_fullsized":"2024-09-11T23:16:15.550794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:40.816040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549124+0000","last_change":"2024-09-11T23:16:14.368440+0000","last_active":"2024-09-11T23:16:15.549124+0000","last_peered":"2024-09-11T23:16:15.549124+0000","last_clean":"2024-09-11T23:16:15.549124+0000","last_became_active":"2024-09-11T23:16:14.368127+0000","last_became_peered":"2024-09-11T23:16:14.368127+0000","last_unstale":"2024-09-11T23:16:15.549124+0000","last_undegraded":"2024-09-11T23:16:15.549124+0000","last_fullsized":"2024-09-11T23:16:15.549124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550700+0000","last_change":"2024-09-11T23:16:13.314568+0000","last_active":"2024-09-11T23:16:15.550700+0000","last_peered":"2024-09-11T23:16:15.550700+0000","last_clean":"2024-09-11T23:16:15.550700+0000","last_became_active":"2024-09-11T23:16:13.313778+0000","last_became_peered":"2024-09-11T23:16:13.313778+0000","last_unstale":"2024-09-11T23:16:15.550700+0000","last_undegraded":"2024-09-11T23:16:15.550700+0000","last_fullsized":"2024-09-11T23:16:15.550700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:47.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552311+0000","last_change":"2024-09-11T23:16:14.390039+0000","last_active":"2024-09-11T23:16:15.552311+0000","last_peered":"2024-09-11T23:16:15.552311+0000","last_clean":"2024-09-11T23:16:15.552311+0000","last_became_active":"2024-09-11T23:16:14.384231+0000","last_became_peered":"2024-09-11T23:16:14.384231+0000","last_unstale":"2024-09-11T23:16:15.552311+0000","last_undegraded":"2024-09-11T23:16:15.552311+0000","last_fullsized":"2024-09-11T23:16:15.552311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.738356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552245+0000","last_change":"2024-09-11T23:16:13.337708+0000","last_active":"2024-09-11T23:16:15.552245+0000","last_peered":"2024-09-11T23:16:15.552245+0000","last_clean":"2024-09-11T23:16:15.552245+0000","last_became_active":"2024-09-11T23:16:13.336542+0000","last_became_peered":"2024-09-11T23:16:13.336542+0000","last_unstale":"2024-09-11T23:16:15.552245+0000","last_undegraded":"2024-09-11T23:16:15.552245+0000","last_fullsized":"2024-09-11T23:16:15.552245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:39.826972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335794+0000","last_change":"2024-09-11T23:16:14.367904+0000","last_active":"2024-09-11T23:16:15.335794+0000","last_peered":"2024-09-11T23:16:15.335794+0000","last_clean":"2024-09-11T23:16:15.335794+0000","last_became_active":"2024-09-11T23:16:14.367555+0000","last_became_peered":"2024-09-11T23:16:14.367555+0000","last_unstale":"2024-09-11T23:16:15.335794+0000","last_undegraded":"2024-09-11T23:16:15.335794+0000","last_fullsized":"2024-09-11T23:16:15.335794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:26.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550662+0000","last_change":"2024-09-11T23:16:13.320538+0000","last_active":"2024-09-11T23:16:15.550662+0000","last_peered":"2024-09-11T23:16:15.550662+0000","last_clean":"2024-09-11T23:16:15.550662+0000","last_became_active":"2024-09-11T23:16:13.319967+0000","last_became_peered":"2024-09-11T23:16:13.319967+0000","last_unstale":"2024-09-11T23:16:15.550662+0000","last_undegraded":"2024-09-11T23:16:15.550662+0000","last_fullsized":"2024-09-11T23:16:15.550662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:56.435370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550189+0000","last_change":"2024-09-11T23:16:14.391199+0000","last_active":"2024-09-11T23:16:15.550189+0000","last_peered":"2024-09-11T23:16:15.550189+0000","last_clean":"2024-09-11T23:16:15.550189+0000","last_became_active":"2024-09-11T23:16:14.390831+0000","last_became_peered":"2024-09-11T23:16:14.390831+0000","last_unstale":"2024-09-11T23:16:15.550189+0000","last_undegraded":"2024-09-11T23:16:15.550189+0000","last_fullsized":"2024-09-11T23:16:15.550189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553324+0000","last_change":"2024-09-11T23:16:13.314156+0000","last_active":"2024-09-11T23:16:15.553324+0000","last_peered":"2024-09-11T23:16:15.553324+0000","last_clean":"2024-09-11T23:16:15.553324+0000","last_became_active":"2024-09-11T23:16:13.313469+0000","last_became_peered":"2024-09-11T23:16:13.313469+0000","last_unstale":"2024-09-11T23:16:15.553324+0000","last_undegraded":"2024-09-11T23:16:15.553324+0000","last_fullsized":"2024-09-11T23:16:15.553324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.554343+0000","last_change":"2024-09-11T23:16:14.383181+0000","last_active":"2024-09-11T23:16:15.554343+0000","last_peered":"2024-09-11T23:16:15.554343+0000","last_clean":"2024-09-11T23:16:15.554343+0000","last_became_active":"2024-09-11T23:16:14.382438+0000","last_became_peered":"2024-09-11T23:16:14.382438+0000","last_unstale":"2024-09-11T23:16:15.554343+0000","last_undegraded":"2024-09-11T23:16:15.554343+0000","last_fullsized":"2024-09-11T23:16:15.554343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:20.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:16.339823+0000","last_change":"2024-09-11T23:16:13.318752+0000","last_active":"2024-09-11T23:16:16.339823+0000","last_peered":"2024-09-11T23:16:16.339823+0000","last_clean":"2024-09-11T23:16:16.339823+0000","last_became_active":"2024-09-11T23:16:13.318281+0000","last_became_peered":"2024-09-11T23:16:13.318281+0000","last_unstale":"2024-09-11T23:16:16.339823+0000","last_undegraded":"2024-09-11T23:16:16.339823+0000","last_fullsized":"2024-09-11T23:16:16.339823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:02.168475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335782+0000","last_change":"2024-09-11T23:16:14.394370+0000","last_active":"2024-09-11T23:16:15.335782+0000","last_peered":"2024-09-11T23:16:15.335782+0000","last_clean":"2024-09-11T23:16:15.335782+0000","last_became_active":"2024-09-11T23:16:14.394093+0000","last_became_peered":"2024-09-11T23:16:14.394093+0000","last_unstale":"2024-09-11T23:16:15.335782+0000","last_undegraded":"2024-09-11T23:16:15.335782+0000","last_fullsized":"2024-09-11T23:16:15.335782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:04.079303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549320+0000","last_change":"2024-09-11T23:16:13.328838+0000","last_active":"2024-09-11T23:16:15.549320+0000","last_peered":"2024-09-11T23:16:15.549320+0000","last_clean":"2024-09-11T23:16:15.549320+0000","last_became_active":"2024-09-11T23:16:13.328158+0000","last_became_peered":"2024-09-11T23:16:13.328158+0000","last_unstale":"2024-09-11T23:16:15.549320+0000","last_undegraded":"2024-09-11T23:16:15.549320+0000","last_fullsized":"2024-09-11T23:16:15.549320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:59.824592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548977+0000","last_change":"2024-09-11T23:16:14.348026+0000","last_active":"2024-09-11T23:16:15.548977+0000","last_peered":"2024-09-11T23:16:15.548977+0000","last_clean":"2024-09-11T23:16:15.548977+0000","last_became_active":"2024-09-11T23:16:14.347188+0000","last_became_peered":"2024-09-11T23:16:14.347188+0000","last_unstale":"2024-09-11T23:16:15.548977+0000","last_undegraded":"2024-09-11T23:16:15.548977+0000","last_fullsized":"2024-09-11T23:16:15.548977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549286+0000","last_change":"2024-09-11T23:16:13.331042+0000","last_active":"2024-09-11T23:16:15.549286+0000","last_peered":"2024-09-11T23:16:15.549286+0000","last_clean":"2024-09-11T23:16:15.549286+0000","last_became_active":"2024-09-11T23:16:13.330758+0000","last_became_peered":"2024-09-11T23:16:13.330758+0000","last_unstale":"2024-09-11T23:16:15.549286+0000","last_undegraded":"2024-09-11T23:16:15.549286+0000","last_fullsized":"2024-09-11T23:16:15.549286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:39.826972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549730+0000","last_change":"2024-09-11T23:16:14.365909+0000","last_active":"2024-09-11T23:16:15.549730+0000","last_peered":"2024-09-11T23:16:15.549730+0000","last_clean":"2024-09-11T23:16:15.549730+0000","last_became_active":"2024-09-11T23:16:14.365541+0000","last_became_peered":"2024-09-11T23:16:14.365541+0000","last_unstale":"2024-09-11T23:16:15.549730+0000","last_undegraded":"2024-09-11T23:16:15.549730+0000","last_fullsized":"2024-09-11T23:16:15.549730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338562+0000","last_change":"2024-09-11T23:16:13.337806+0000","last_active":"2024-09-11T23:16:15.338562+0000","last_peered":"2024-09-11T23:16:15.338562+0000","last_clean":"2024-09-11T23:16:15.338562+0000","last_became_active":"2024-09-11T23:16:13.336910+0000","last_became_peered":"2024-09-11T23:16:13.336910+0000","last_unstale":"2024-09-11T23:16:15.338562+0000","last_undegraded":"2024-09-11T23:16:15.338562+0000","last_fullsized":"2024-09-11T23:16:15.338562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:07.478372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340008+0000","last_change":"2024-09-11T23:16:14.395926+0000","last_active":"2024-09-11T23:16:15.340008+0000","last_peered":"2024-09-11T23:16:15.340008+0000","last_clean":"2024-09-11T23:16:15.340008+0000","last_became_active":"2024-09-11T23:16:14.386827+0000","last_became_peered":"2024-09-11T23:16:14.386827+0000","last_unstale":"2024-09-11T23:16:15.340008+0000","last_undegraded":"2024-09-11T23:16:15.340008+0000","last_fullsized":"2024-09-11T23:16:15.340008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338678+0000","last_change":"2024-09-11T23:16:13.325942+0000","last_active":"2024-09-11T23:16:15.338678+0000","last_peered":"2024-09-11T23:16:15.338678+0000","last_clean":"2024-09-11T23:16:15.338678+0000","last_became_active":"2024-09-11T23:16:13.325227+0000","last_became_peered":"2024-09-11T23:16:13.325227+0000","last_unstale":"2024-09-11T23:16:15.338678+0000","last_undegraded":"2024-09-11T23:16:15.338678+0000","last_fullsized":"2024-09-11T23:16:15.338678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553768+0000","last_change":"2024-09-11T23:16:14.381319+0000","last_active":"2024-09-11T23:16:15.553768+0000","last_peered":"2024-09-11T23:16:15.553768+0000","last_clean":"2024-09-11T23:16:15.553768+0000","last_became_active":"2024-09-11T23:16:14.380780+0000","last_became_peered":"2024-09-11T23:16:14.380780+0000","last_unstale":"2024-09-11T23:16:15.553768+0000","last_undegraded":"2024-09-11T23:16:15.553768+0000","last_fullsized":"2024-09-11T23:16:15.553768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335287+0000","last_change":"2024-09-11T23:16:13.316966+0000","last_active":"2024-09-11T23:16:15.335287+0000","last_peered":"2024-09-11T23:16:15.335287+0000","last_clean":"2024-09-11T23:16:15.335287+0000","last_became_active":"2024-09-11T23:16:13.316659+0000","last_became_peered":"2024-09-11T23:16:13.316659+0000","last_unstale":"2024-09-11T23:16:15.335287+0000","last_undegraded":"2024-09-11T23:16:15.335287+0000","last_fullsized":"2024-09-11T23:16:15.335287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:32.170087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552509+0000","last_change":"2024-09-11T23:16:14.396436+0000","last_active":"2024-09-11T23:16:15.552509+0000","last_peered":"2024-09-11T23:16:15.552509+0000","last_clean":"2024-09-11T23:16:15.552509+0000","last_became_active":"2024-09-11T23:16:14.395334+0000","last_became_peered":"2024-09-11T23:16:14.395334+0000","last_unstale":"2024-09-11T23:16:15.552509+0000","last_undegraded":"2024-09-11T23:16:15.552509+0000","last_fullsized":"2024-09-11T23:16:15.552509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553813+0000","last_change":"2024-09-11T23:16:13.332441+0000","last_active":"2024-09-11T23:16:15.553813+0000","last_peered":"2024-09-11T23:16:15.553813+0000","last_clean":"2024-09-11T23:16:15.553813+0000","last_became_active":"2024-09-11T23:16:13.331267+0000","last_became_peered":"2024-09-11T23:16:13.331267+0000","last_unstale":"2024-09-11T23:16:15.553813+0000","last_undegraded":"2024-09-11T23:16:15.553813+0000","last_fullsized":"2024-09-11T23:16:15.553813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.484510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":206,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552614+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:16:15.552614+0000","last_peered":"2024-09-11T23:16:15.552614+0000","last_clean":"2024-09-11T23:16:15.552614+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:16:15.552614+0000","last_undegraded":"2024-09-11T23:16:15.552614+0000","last_fullsized":"2024-09-11T23:16:15.552614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":789422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":454656,"data_stored":197954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":197484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":197976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":466944,"data_stored":199018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":197442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":197462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1048576,"data_stored":787774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:16:21.776 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:16:21.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.903+0000 7fa831fcc640 1 Processor -- start 2024-09-11T23:16:21.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.903+0000 7fa831fcc640 1 -- start start 2024-09-11T23:16:21.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa831fcc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa82c1587a0 0x7fa82c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa831fcc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa82c06e680 0x7fa82c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa831fcc640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c06ec60 con 0x7fa82c0b37d0 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa831fcc640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c0b3c40 con 0x7fa82c1587a0 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa831fcc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c06f870 con 0x7fa82c06e680 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa82c1587a0 0x7fa82c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82affd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa82c0b37d0 0x7fa82c06df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:54428/0 (socket says 172.21.15.94:54428) 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82affd640 1 -- 172.21.15.94:0/2500758906 learned_addr learned my addr 172.21.15.94:0/2500758906 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa82c1587a0 0x7fa82c0b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47956/0 (socket says 172.21.15.94:47956) 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82bfff640 1 --2- 172.21.15.94:0/2500758906 >> v2:172.21.15.155:3300/0 conn(0x7fa82c06e680 0x7fa82c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82b7fe640 1 -- 172.21.15.94:0/2500758906 >> v2:172.21.15.155:3300/0 conn(0x7fa82c06e680 msgr2=0x7fa82c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82b7fe640 1 --2- 172.21.15.94:0/2500758906 >> v2:172.21.15.155:3300/0 conn(0x7fa82c06e680 0x7fa82c072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82b7fe640 1 -- 172.21.15.94:0/2500758906 >> v1:172.21.15.94:6789/0 conn(0x7fa82c0b37d0 legacy=0x7fa82c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82a7fc640 1 -- 172.21.15.94:0/2500758906 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554953899 0 0) 0x7fa82c06ec60 con 0x7fa82c0b37d0 2024-09-11T23:16:21.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82b7fe640 1 -- 172.21.15.94:0/2500758906 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c06ef40 con 0x7fa82c1587a0 2024-09-11T23:16:21.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82b7fe640 1 --2- 172.21.15.94:0/2500758906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c1587a0 0x7fa82c0b3290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0af930 tx=0x7fa81c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f598ac7a21c4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:21.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82a7fc640 1 -- 172.21.15.94:0/2500758906 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0b2070 con 0x7fa82c1587a0 2024-09-11T23:16:21.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82a7fc640 1 -- 172.21.15.94:0/2500758906 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81c0a58d0 con 0x7fa82c1587a0 2024-09-11T23:16:21.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.907+0000 7fa82a7fc640 1 -- 172.21.15.94:0/2500758906 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0a5ca0 con 0x7fa82c1587a0 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- 172.21.15.94:0/2500758906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c1587a0 msgr2=0x7fa82c0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 --2- 172.21.15.94:0/2500758906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c1587a0 0x7fa82c0b3290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0af930 tx=0x7fa81c01c900 comp rx=0 tx=0).stop 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- 172.21.15.94:0/2500758906 shutdown_connections 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 --2- 172.21.15.94:0/2500758906 >> v2:172.21.15.155:3300/0 conn(0x7fa82c06e680 0x7fa82c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 --2- 172.21.15.94:0/2500758906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c1587a0 0x7fa82c0b3290 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- 172.21.15.94:0/2500758906 >> 172.21.15.94:0/2500758906 conn(0x7fa82c0b1f90 msgr2=0x7fa82c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- 172.21.15.94:0/2500758906 shutdown_connections 2024-09-11T23:16:21.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- 172.21.15.94:0/2500758906 wait complete. 2024-09-11T23:16:21.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 Processor -- start 2024-09-11T23:16:21.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- start start 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c06e680 0x7fa82c1476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa82c0b37d0 0x7fa82c1462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82c1587a0 0x7fa82c1fa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c073030 con 0x7fa82c06e680 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c072eb0 con 0x7fa82c0b37d0 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c0731b0 con 0x7fa82c1587a0 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c06e680 0x7fa82c1476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c06e680 0x7fa82c1476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47970/0 (socket says 172.21.15.94:47970) 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 -- 172.21.15.94:0/739111464 learned_addr learned my addr 172.21.15.94:0/739111464 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82affd640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa82c0b37d0 0x7fa82c1462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82bfff640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82c1587a0 0x7fa82c1fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 -- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82c1587a0 msgr2=0x7fa82c1fa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82c1587a0 0x7fa82c1fa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 -- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa82c0b37d0 msgr2=0x7fa82c1462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa82c0b37d0 0x7fa82c1462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 -- 172.21.15.94:0/739111464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c154b60 con 0x7fa82c06e680 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa82b7fe640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c06e680 0x7fa82c1476a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa81c019510 tx=0x7fa81c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa823fff640 1 -- 172.21.15.94:0/739111464 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0b2050 con 0x7fa82c06e680 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa823fff640 1 -- 172.21.15.94:0/739111464 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81c0be070 con 0x7fa82c06e680 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c152d20 con 0x7fa82c06e680 2024-09-11T23:16:21.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa823fff640 1 -- 172.21.15.94:0/739111464 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0ada70 con 0x7fa82c06e680 2024-09-11T23:16:21.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.911+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c147be0 con 0x7fa82c06e680 2024-09-11T23:16:21.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.915+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c072160 con 0x7fa82c06e680 2024-09-11T23:16:21.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.915+0000 7fa823fff640 1 -- 172.21.15.94:0/739111464 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa81c0adc10 con 0x7fa82c06e680 2024-09-11T23:16:21.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.915+0000 7fa823fff640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa80c0678c0 0x7fa80c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.915+0000 7fa823fff640 1 -- 172.21.15.94:0/739111464 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa81c121030 con 0x7fa82c06e680 2024-09-11T23:16:21.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.915+0000 7fa82affd640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa80c0678c0 0x7fa80c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.915+0000 7fa82affd640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa80c0678c0 0x7fa80c069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa82c1fa540 tx=0x7fa814007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:21.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:21.919+0000 7fa823fff640 1 -- 172.21.15.94:0/739111464 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa81c016520 con 0x7fa82c06e680 2024-09-11T23:16:22.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.079+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa82c070080 con 0x7fa80c0678c0 2024-09-11T23:16:22.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.095+0000 7fa823fff640 1 -- 172.21.15.94:0/739111464 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251966 (secure 0 0 0) 0x7fa82c070080 con 0x7fa80c0678c0 2024-09-11T23:16:22.102 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:22.103 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:16:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa80c0678c0 msgr2=0x7fa80c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa80c0678c0 0x7fa80c069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa82c1fa540 tx=0x7fa814007d60 comp rx=0 tx=0).stop 2024-09-11T23:16:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c06e680 msgr2=0x7fa82c1476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c06e680 0x7fa82c1476a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa81c019510 tx=0x7fa81c0196a0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 shutdown_connections 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82c1587a0 0x7fa82c1fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa82c0b37d0 0x7fa82c1462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa80c0678c0 0x7fa80c069d80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 --2- 172.21.15.94:0/739111464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa82c06e680 0x7fa82c1476a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 >> 172.21.15.94:0/739111464 conn(0x7fa82c0b1f90 msgr2=0x7fa82c15f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 shutdown_connections 2024-09-11T23:16:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.099+0000 7fa831fcc640 1 -- 172.21.15.94:0/739111464 wait complete. 2024-09-11T23:16:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-09-11T23:16:21.990971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237632,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737088,"statfs":{"total":773094113280,"available":772850778112,"internally_reserved":0,"allocated":4857856,"data_stored":2764532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002644"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336108+0000","last_change":"2024-09-11T23:16:14.351224+0000","last_active":"2024-09-11T23:16:15.336108+0000","last_peered":"2024-09-11T23:16:15.336108+0000","last_clean":"2024-09-11T23:16:15.336108+0000","last_became_active":"2024-09-11T23:16:14.350919+0000","last_became_peered":"2024-09-11T23:16:14.350919+0000","last_unstale":"2024-09-11T23:16:15.336108+0000","last_undegraded":"2024-09-11T23:16:15.336108+0000","last_fullsized":"2024-09-11T23:16:15.336108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.121063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335787+0000","last_change":"2024-09-11T23:16:14.346180+0000","last_active":"2024-09-11T23:16:15.335787+0000","last_peered":"2024-09-11T23:16:15.335787+0000","last_clean":"2024-09-11T23:16:15.335787+0000","last_became_active":"2024-09-11T23:16:14.345960+0000","last_became_peered":"2024-09-11T23:16:14.345960+0000","last_unstale":"2024-09-11T23:16:15.335787+0000","last_undegraded":"2024-09-11T23:16:15.335787+0000","last_fullsized":"2024-09-11T23:16:15.335787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:19.495390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549220+0000","last_change":"2024-09-11T23:16:14.391735+0000","last_active":"2024-09-11T23:16:15.549220+0000","last_peered":"2024-09-11T23:16:15.549220+0000","last_clean":"2024-09-11T23:16:15.549220+0000","last_became_active":"2024-09-11T23:16:14.391421+0000","last_became_peered":"2024-09-11T23:16:14.391421+0000","last_unstale":"2024-09-11T23:16:15.549220+0000","last_undegraded":"2024-09-11T23:16:15.549220+0000","last_fullsized":"2024-09-11T23:16:15.549220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550862+0000","last_change":"2024-09-11T23:16:14.379388+0000","last_active":"2024-09-11T23:16:15.550862+0000","last_peered":"2024-09-11T23:16:15.550862+0000","last_clean":"2024-09-11T23:16:15.550862+0000","last_became_active":"2024-09-11T23:16:14.378820+0000","last_became_peered":"2024-09-11T23:16:14.378820+0000","last_unstale":"2024-09-11T23:16:15.550862+0000","last_undegraded":"2024-09-11T23:16:15.550862+0000","last_fullsized":"2024-09-11T23:16:15.550862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:49.157268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550730+0000","last_change":"2024-09-11T23:16:14.379022+0000","last_active":"2024-09-11T23:16:15.550730+0000","last_peered":"2024-09-11T23:16:15.550730+0000","last_clean":"2024-09-11T23:16:15.550730+0000","last_became_active":"2024-09-11T23:16:14.378677+0000","last_became_peered":"2024-09-11T23:16:14.378677+0000","last_unstale":"2024-09-11T23:16:15.550730+0000","last_undegraded":"2024-09-11T23:16:15.550730+0000","last_fullsized":"2024-09-11T23:16:15.550730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:18.990320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549969+0000","last_change":"2024-09-11T23:16:14.344975+0000","last_active":"2024-09-11T23:16:15.549969+0000","last_peered":"2024-09-11T23:16:15.549969+0000","last_clean":"2024-09-11T23:16:15.549969+0000","last_became_active":"2024-09-11T23:16:14.344686+0000","last_became_peered":"2024-09-11T23:16:14.344686+0000","last_unstale":"2024-09-11T23:16:15.549969+0000","last_undegraded":"2024-09-11T23:16:15.549969+0000","last_fullsized":"2024-09-11T23:16:15.549969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551296+0000","last_change":"2024-09-11T23:16:14.392025+0000","last_active":"2024-09-11T23:16:15.551296+0000","last_peered":"2024-09-11T23:16:15.551296+0000","last_clean":"2024-09-11T23:16:15.551296+0000","last_became_active":"2024-09-11T23:16:14.391463+0000","last_became_peered":"2024-09-11T23:16:14.391463+0000","last_unstale":"2024-09-11T23:16:15.551296+0000","last_undegraded":"2024-09-11T23:16:15.551296+0000","last_fullsized":"2024-09-11T23:16:15.551296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335567+0000","last_change":"2024-09-11T23:16:14.384841+0000","last_active":"2024-09-11T23:16:15.335567+0000","last_peered":"2024-09-11T23:16:15.335567+0000","last_clean":"2024-09-11T23:16:15.335567+0000","last_became_active":"2024-09-11T23:16:14.384567+0000","last_became_peered":"2024-09-11T23:16:14.384567+0000","last_unstale":"2024-09-11T23:16:15.335567+0000","last_undegraded":"2024-09-11T23:16:15.335567+0000","last_fullsized":"2024-09-11T23:16:15.335567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:38.937876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549555+0000","last_change":"2024-09-11T23:16:14.397836+0000","last_active":"2024-09-11T23:16:15.549555+0000","last_peered":"2024-09-11T23:16:15.549555+0000","last_clean":"2024-09-11T23:16:15.549555+0000","last_became_active":"2024-09-11T23:16:14.397599+0000","last_became_peered":"2024-09-11T23:16:14.397599+0000","last_unstale":"2024-09-11T23:16:15.549555+0000","last_undegraded":"2024-09-11T23:16:15.549555+0000","last_fullsized":"2024-09-11T23:16:15.549555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552699+0000","last_change":"2024-09-11T23:16:14.392407+0000","last_active":"2024-09-11T23:16:15.552699+0000","last_peered":"2024-09-11T23:16:15.552699+0000","last_clean":"2024-09-11T23:16:15.552699+0000","last_became_active":"2024-09-11T23:16:14.385747+0000","last_became_peered":"2024-09-11T23:16:14.385747+0000","last_unstale":"2024-09-11T23:16:15.552699+0000","last_undegraded":"2024-09-11T23:16:15.552699+0000","last_fullsized":"2024-09-11T23:16:15.552699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:38.937876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552499+0000","last_change":"2024-09-11T23:16:14.390867+0000","last_active":"2024-09-11T23:16:15.552499+0000","last_peered":"2024-09-11T23:16:15.552499+0000","last_clean":"2024-09-11T23:16:15.552499+0000","last_became_active":"2024-09-11T23:16:14.390269+0000","last_became_peered":"2024-09-11T23:16:14.390269+0000","last_unstale":"2024-09-11T23:16:15.552499+0000","last_undegraded":"2024-09-11T23:16:15.552499+0000","last_fullsized":"2024-09-11T23:16:15.552499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:26.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549142+0000","last_change":"2024-09-11T23:16:14.350382+0000","last_active":"2024-09-11T23:16:15.549142+0000","last_peered":"2024-09-11T23:16:15.549142+0000","last_clean":"2024-09-11T23:16:15.549142+0000","last_became_active":"2024-09-11T23:16:14.350088+0000","last_became_peered":"2024-09-11T23:16:14.350088+0000","last_unstale":"2024-09-11T23:16:15.549142+0000","last_undegraded":"2024-09-11T23:16:15.549142+0000","last_fullsized":"2024-09-11T23:16:15.549142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551582+0000","last_change":"2024-09-11T23:16:14.395687+0000","last_active":"2024-09-11T23:16:15.551582+0000","last_peered":"2024-09-11T23:16:15.551582+0000","last_clean":"2024-09-11T23:16:15.551582+0000","last_became_active":"2024-09-11T23:16:14.392287+0000","last_became_peered":"2024-09-11T23:16:14.392287+0000","last_unstale":"2024-09-11T23:16:15.551582+0000","last_undegraded":"2024-09-11T23:16:15.551582+0000","last_fullsized":"2024-09-11T23:16:15.551582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.907854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338672+0000","last_change":"2024-09-11T23:16:14.396261+0000","last_active":"2024-09-11T23:16:15.338672+0000","last_peered":"2024-09-11T23:16:15.338672+0000","last_clean":"2024-09-11T23:16:15.338672+0000","last_became_active":"2024-09-11T23:16:14.387510+0000","last_became_peered":"2024-09-11T23:16:14.387510+0000","last_unstale":"2024-09-11T23:16:15.338672+0000","last_undegraded":"2024-09-11T23:16:15.338672+0000","last_fullsized":"2024-09-11T23:16:15.338672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551470+0000","last_change":"2024-09-11T23:16:14.391001+0000","last_active":"2024-09-11T23:16:15.551470+0000","last_peered":"2024-09-11T23:16:15.551470+0000","last_clean":"2024-09-11T23:16:15.551470+0000","last_became_active":"2024-09-11T23:16:14.390379+0000","last_became_peered":"2024-09-11T23:16:14.390379+0000","last_unstale":"2024-09-11T23:16:15.551470+0000","last_undegraded":"2024-09-11T23:16:15.551470+0000","last_fullsized":"2024-09-11T23:16:15.551470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:20.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551795+0000","last_change":"2024-09-11T23:16:14.390401+0000","last_active":"2024-09-11T23:16:15.551795+0000","last_peered":"2024-09-11T23:16:15.551795+0000","last_clean":"2024-09-11T23:16:15.551795+0000","last_became_active":"2024-09-11T23:16:14.389777+0000","last_became_peered":"2024-09-11T23:16:14.389777+0000","last_unstale":"2024-09-11T23:16:15.551795+0000","last_undegraded":"2024-09-11T23:16:15.551795+0000","last_fullsized":"2024-09-11T23:16:15.551795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.554175+0000","last_change":"2024-09-11T23:16:14.398192+0000","last_active":"2024-09-11T23:16:15.554175+0000","last_peered":"2024-09-11T23:16:15.554175+0000","last_clean":"2024-09-11T23:16:15.554175+0000","last_became_active":"2024-09-11T23:16:14.397734+0000","last_became_peered":"2024-09-11T23:16:14.397734+0000","last_unstale":"2024-09-11T23:16:15.554175+0000","last_undegraded":"2024-09-11T23:16:15.554175+0000","last_fullsized":"2024-09-11T23:16:15.554175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339372+0000","last_change":"2024-09-11T23:16:14.403372+0000","last_active":"2024-09-11T23:16:15.339372+0000","last_peered":"2024-09-11T23:16:15.339372+0000","last_clean":"2024-09-11T23:16:15.339372+0000","last_became_active":"2024-09-11T23:16:14.402828+0000","last_became_peered":"2024-09-11T23:16:14.402828+0000","last_unstale":"2024-09-11T23:16:15.339372+0000","last_undegraded":"2024-09-11T23:16:15.339372+0000","last_fullsized":"2024-09-11T23:16:15.339372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:47.839047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550929+0000","last_change":"2024-09-11T23:16:14.348099+0000","last_active":"2024-09-11T23:16:15.550929+0000","last_peered":"2024-09-11T23:16:15.550929+0000","last_clean":"2024-09-11T23:16:15.550929+0000","last_became_active":"2024-09-11T23:16:14.347397+0000","last_became_peered":"2024-09-11T23:16:14.347397+0000","last_unstale":"2024-09-11T23:16:15.550929+0000","last_undegraded":"2024-09-11T23:16:15.550929+0000","last_fullsized":"2024-09-11T23:16:15.550929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:14.367835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339019+0000","last_change":"2024-09-11T23:16:14.403249+0000","last_active":"2024-09-11T23:16:15.339019+0000","last_peered":"2024-09-11T23:16:15.339019+0000","last_clean":"2024-09-11T23:16:15.339019+0000","last_became_active":"2024-09-11T23:16:14.402699+0000","last_became_peered":"2024-09-11T23:16:14.402699+0000","last_unstale":"2024-09-11T23:16:15.339019+0000","last_undegraded":"2024-09-11T23:16:15.339019+0000","last_fullsized":"2024-09-11T23:16:15.339019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:23.274577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551976+0000","last_change":"2024-09-11T23:16:14.385579+0000","last_active":"2024-09-11T23:16:15.551976+0000","last_peered":"2024-09-11T23:16:15.551976+0000","last_clean":"2024-09-11T23:16:15.551976+0000","last_became_active":"2024-09-11T23:16:14.383893+0000","last_became_peered":"2024-09-11T23:16:14.383893+0000","last_unstale":"2024-09-11T23:16:15.551976+0000","last_undegraded":"2024-09-11T23:16:15.551976+0000","last_fullsized":"2024-09-11T23:16:15.551976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.448095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340596+0000","last_change":"2024-09-11T23:16:14.386167+0000","last_active":"2024-09-11T23:16:15.340596+0000","last_peered":"2024-09-11T23:16:15.340596+0000","last_clean":"2024-09-11T23:16:15.340596+0000","last_became_active":"2024-09-11T23:16:14.377425+0000","last_became_peered":"2024-09-11T23:16:14.377425+0000","last_unstale":"2024-09-11T23:16:15.340596+0000","last_undegraded":"2024-09-11T23:16:15.340596+0000","last_fullsized":"2024-09-11T23:16:15.340596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551610+0000","last_change":"2024-09-11T23:16:14.360520+0000","last_active":"2024-09-11T23:16:15.551610+0000","last_peered":"2024-09-11T23:16:15.551610+0000","last_clean":"2024-09-11T23:16:15.551610+0000","last_became_active":"2024-09-11T23:16:14.358873+0000","last_became_peered":"2024-09-11T23:16:14.358873+0000","last_unstale":"2024-09-11T23:16:15.551610+0000","last_undegraded":"2024-09-11T23:16:15.551610+0000","last_fullsized":"2024-09-11T23:16:15.551610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.299783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550559+0000","last_change":"2024-09-11T23:16:14.352656+0000","last_active":"2024-09-11T23:16:15.550559+0000","last_peered":"2024-09-11T23:16:15.550559+0000","last_clean":"2024-09-11T23:16:15.550559+0000","last_became_active":"2024-09-11T23:16:14.352350+0000","last_became_peered":"2024-09-11T23:16:14.352350+0000","last_unstale":"2024-09-11T23:16:15.550559+0000","last_undegraded":"2024-09-11T23:16:15.550559+0000","last_fullsized":"2024-09-11T23:16:15.550559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:08.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339259+0000","last_change":"2024-09-11T23:16:14.383033+0000","last_active":"2024-09-11T23:16:15.339259+0000","last_peered":"2024-09-11T23:16:15.339259+0000","last_clean":"2024-09-11T23:16:15.339259+0000","last_became_active":"2024-09-11T23:16:14.382285+0000","last_became_peered":"2024-09-11T23:16:14.382285+0000","last_unstale":"2024-09-11T23:16:15.339259+0000","last_undegraded":"2024-09-11T23:16:15.339259+0000","last_fullsized":"2024-09-11T23:16:15.339259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:38.144000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549727+0000","last_change":"2024-09-11T23:16:14.396300+0000","last_active":"2024-09-11T23:16:15.549727+0000","last_peered":"2024-09-11T23:16:15.549727+0000","last_clean":"2024-09-11T23:16:15.549727+0000","last_became_active":"2024-09-11T23:16:14.396009+0000","last_became_peered":"2024-09-11T23:16:14.396009+0000","last_unstale":"2024-09-11T23:16:15.549727+0000","last_undegraded":"2024-09-11T23:16:15.549727+0000","last_fullsized":"2024-09-11T23:16:15.549727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339521+0000","last_change":"2024-09-11T23:16:14.379376+0000","last_active":"2024-09-11T23:16:15.339521+0000","last_peered":"2024-09-11T23:16:15.339521+0000","last_clean":"2024-09-11T23:16:15.339521+0000","last_became_active":"2024-09-11T23:16:14.369960+0000","last_became_peered":"2024-09-11T23:16:14.369960+0000","last_unstale":"2024-09-11T23:16:15.339521+0000","last_undegraded":"2024-09-11T23:16:15.339521+0000","last_fullsized":"2024-09-11T23:16:15.339521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:58.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552279+0000","last_change":"2024-09-11T23:16:14.367982+0000","last_active":"2024-09-11T23:16:15.552279+0000","last_peered":"2024-09-11T23:16:15.552279+0000","last_clean":"2024-09-11T23:16:15.552279+0000","last_became_active":"2024-09-11T23:16:14.356651+0000","last_became_peered":"2024-09-11T23:16:14.356651+0000","last_unstale":"2024-09-11T23:16:15.552279+0000","last_undegraded":"2024-09-11T23:16:15.552279+0000","last_fullsized":"2024-09-11T23:16:15.552279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:07.974140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339193+0000","last_change":"2024-09-11T23:16:14.379577+0000","last_active":"2024-09-11T23:16:15.339193+0000","last_peered":"2024-09-11T23:16:15.339193+0000","last_clean":"2024-09-11T23:16:15.339193+0000","last_became_active":"2024-09-11T23:16:14.368714+0000","last_became_peered":"2024-09-11T23:16:14.368714+0000","last_unstale":"2024-09-11T23:16:15.339193+0000","last_undegraded":"2024-09-11T23:16:15.339193+0000","last_fullsized":"2024-09-11T23:16:15.339193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:08.485908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338174+0000","last_change":"2024-09-11T23:16:14.378832+0000","last_active":"2024-09-11T23:16:15.338174+0000","last_peered":"2024-09-11T23:16:15.338174+0000","last_clean":"2024-09-11T23:16:15.338174+0000","last_became_active":"2024-09-11T23:16:14.368984+0000","last_became_peered":"2024-09-11T23:16:14.368984+0000","last_unstale":"2024-09-11T23:16:15.338174+0000","last_undegraded":"2024-09-11T23:16:15.338174+0000","last_fullsized":"2024-09-11T23:16:15.338174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:09.606832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551997+0000","last_change":"2024-09-11T23:16:14.360602+0000","last_active":"2024-09-11T23:16:15.551997+0000","last_peered":"2024-09-11T23:16:15.551997+0000","last_clean":"2024-09-11T23:16:15.551997+0000","last_became_active":"2024-09-11T23:16:14.359801+0000","last_became_peered":"2024-09-11T23:16:14.359801+0000","last_unstale":"2024-09-11T23:16:15.551997+0000","last_undegraded":"2024-09-11T23:16:15.551997+0000","last_fullsized":"2024-09-11T23:16:15.551997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550502+0000","last_change":"2024-09-11T23:16:14.345415+0000","last_active":"2024-09-11T23:16:15.550502+0000","last_peered":"2024-09-11T23:16:15.550502+0000","last_clean":"2024-09-11T23:16:15.550502+0000","last_became_active":"2024-09-11T23:16:14.345049+0000","last_became_peered":"2024-09-11T23:16:14.345049+0000","last_unstale":"2024-09-11T23:16:15.550502+0000","last_undegraded":"2024-09-11T23:16:15.550502+0000","last_fullsized":"2024-09-11T23:16:15.550502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553850+0000","last_change":"2024-09-11T23:16:14.392265+0000","last_active":"2024-09-11T23:16:15.553850+0000","last_peered":"2024-09-11T23:16:15.553850+0000","last_clean":"2024-09-11T23:16:15.553850+0000","last_became_active":"2024-09-11T23:16:14.391643+0000","last_became_peered":"2024-09-11T23:16:14.391643+0000","last_unstale":"2024-09-11T23:16:15.553850+0000","last_undegraded":"2024-09-11T23:16:15.553850+0000","last_fullsized":"2024-09-11T23:16:15.553850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.339289+0000","last_change":"2024-09-11T23:16:13.337352+0000","last_active":"2024-09-11T23:16:15.339289+0000","last_peered":"2024-09-11T23:16:15.339289+0000","last_clean":"2024-09-11T23:16:15.339289+0000","last_became_active":"2024-09-11T23:16:13.335783+0000","last_became_peered":"2024-09-11T23:16:13.335783+0000","last_unstale":"2024-09-11T23:16:15.339289+0000","last_undegraded":"2024-09-11T23:16:15.339289+0000","last_fullsized":"2024-09-11T23:16:15.339289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.484510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550029+0000","last_change":"2024-09-11T23:16:14.392711+0000","last_active":"2024-09-11T23:16:15.550029+0000","last_peered":"2024-09-11T23:16:15.550029+0000","last_clean":"2024-09-11T23:16:15.550029+0000","last_became_active":"2024-09-11T23:16:14.392452+0000","last_became_peered":"2024-09-11T23:16:14.392452+0000","last_unstale":"2024-09-11T23:16:15.550029+0000","last_undegraded":"2024-09-11T23:16:15.550029+0000","last_fullsized":"2024-09-11T23:16:15.550029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549354+0000","last_change":"2024-09-11T23:16:13.331310+0000","last_active":"2024-09-11T23:16:15.549354+0000","last_peered":"2024-09-11T23:16:15.549354+0000","last_clean":"2024-09-11T23:16:15.549354+0000","last_became_active":"2024-09-11T23:16:13.330554+0000","last_became_peered":"2024-09-11T23:16:13.330554+0000","last_unstale":"2024-09-11T23:16:15.549354+0000","last_undegraded":"2024-09-11T23:16:15.549354+0000","last_fullsized":"2024-09-11T23:16:15.549354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.970882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340957+0000","last_change":"2024-09-11T23:16:14.394809+0000","last_active":"2024-09-11T23:16:15.340957+0000","last_peered":"2024-09-11T23:16:15.340957+0000","last_clean":"2024-09-11T23:16:15.340957+0000","last_became_active":"2024-09-11T23:16:14.394245+0000","last_became_peered":"2024-09-11T23:16:14.394245+0000","last_unstale":"2024-09-11T23:16:15.340957+0000","last_undegraded":"2024-09-11T23:16:15.340957+0000","last_fullsized":"2024-09-11T23:16:15.340957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:07.868406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550231+0000","last_change":"2024-09-11T23:16:13.314070+0000","last_active":"2024-09-11T23:16:15.550231+0000","last_peered":"2024-09-11T23:16:15.550231+0000","last_clean":"2024-09-11T23:16:15.550231+0000","last_became_active":"2024-09-11T23:16:13.313270+0000","last_became_peered":"2024-09-11T23:16:13.313270+0000","last_unstale":"2024-09-11T23:16:15.550231+0000","last_undegraded":"2024-09-11T23:16:15.550231+0000","last_fullsized":"2024-09-11T23:16:15.550231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336259+0000","last_change":"2024-09-11T23:16:14.384382+0000","last_active":"2024-09-11T23:16:15.336259+0000","last_peered":"2024-09-11T23:16:15.336259+0000","last_clean":"2024-09-11T23:16:15.336259+0000","last_became_active":"2024-09-11T23:16:14.384118+0000","last_became_peered":"2024-09-11T23:16:14.384118+0000","last_unstale":"2024-09-11T23:16:15.336259+0000","last_undegraded":"2024-09-11T23:16:15.336259+0000","last_fullsized":"2024-09-11T23:16:15.336259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:22.535507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340460+0000","last_change":"2024-09-11T23:16:13.325773+0000","last_active":"2024-09-11T23:16:15.340460+0000","last_peered":"2024-09-11T23:16:15.340460+0000","last_clean":"2024-09-11T23:16:15.340460+0000","last_became_active":"2024-09-11T23:16:13.325043+0000","last_became_peered":"2024-09-11T23:16:13.325043+0000","last_unstale":"2024-09-11T23:16:15.340460+0000","last_undegraded":"2024-09-11T23:16:15.340460+0000","last_fullsized":"2024-09-11T23:16:15.340460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548715+0000","last_change":"2024-09-11T23:16:14.348345+0000","last_active":"2024-09-11T23:16:15.548715+0000","last_peered":"2024-09-11T23:16:15.548715+0000","last_clean":"2024-09-11T23:16:15.548715+0000","last_became_active":"2024-09-11T23:16:14.347664+0000","last_became_peered":"2024-09-11T23:16:14.347664+0000","last_unstale":"2024-09-11T23:16:15.548715+0000","last_undegraded":"2024-09-11T23:16:15.548715+0000","last_fullsized":"2024-09-11T23:16:15.548715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:58.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553338+0000","last_change":"2024-09-11T23:16:13.339890+0000","last_active":"2024-09-11T23:16:15.553338+0000","last_peered":"2024-09-11T23:16:15.553338+0000","last_clean":"2024-09-11T23:16:15.553338+0000","last_became_active":"2024-09-11T23:16:13.339166+0000","last_became_peered":"2024-09-11T23:16:13.339166+0000","last_unstale":"2024-09-11T23:16:15.553338+0000","last_undegraded":"2024-09-11T23:16:15.553338+0000","last_fullsized":"2024-09-11T23:16:15.553338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:37.135203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551697+0000","last_change":"2024-09-11T23:16:14.385350+0000","last_active":"2024-09-11T23:16:15.551697+0000","last_peered":"2024-09-11T23:16:15.551697+0000","last_clean":"2024-09-11T23:16:15.551697+0000","last_became_active":"2024-09-11T23:16:14.383898+0000","last_became_peered":"2024-09-11T23:16:14.383898+0000","last_unstale":"2024-09-11T23:16:15.551697+0000","last_undegraded":"2024-09-11T23:16:15.551697+0000","last_fullsized":"2024-09-11T23:16:15.551697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:36.520699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553018+0000","last_change":"2024-09-11T23:16:13.331962+0000","last_active":"2024-09-11T23:16:15.553018+0000","last_peered":"2024-09-11T23:16:15.553018+0000","last_clean":"2024-09-11T23:16:15.553018+0000","last_became_active":"2024-09-11T23:16:13.330403+0000","last_became_peered":"2024-09-11T23:16:13.330403+0000","last_unstale":"2024-09-11T23:16:15.553018+0000","last_undegraded":"2024-09-11T23:16:15.553018+0000","last_fullsized":"2024-09-11T23:16:15.553018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.970882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340241+0000","last_change":"2024-09-11T23:16:14.400908+0000","last_active":"2024-09-11T23:16:15.340241+0000","last_peered":"2024-09-11T23:16:15.340241+0000","last_clean":"2024-09-11T23:16:15.340241+0000","last_became_active":"2024-09-11T23:16:14.399921+0000","last_became_peered":"2024-09-11T23:16:14.399921+0000","last_unstale":"2024-09-11T23:16:15.340241+0000","last_undegraded":"2024-09-11T23:16:15.340241+0000","last_fullsized":"2024-09-11T23:16:15.340241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549820+0000","last_change":"2024-09-11T23:16:13.323646+0000","last_active":"2024-09-11T23:16:15.549820+0000","last_peered":"2024-09-11T23:16:15.549820+0000","last_clean":"2024-09-11T23:16:15.549820+0000","last_became_active":"2024-09-11T23:16:13.323118+0000","last_became_peered":"2024-09-11T23:16:13.323118+0000","last_unstale":"2024-09-11T23:16:15.549820+0000","last_undegraded":"2024-09-11T23:16:15.549820+0000","last_fullsized":"2024-09-11T23:16:15.549820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335539+0000","last_change":"2024-09-11T23:16:14.367792+0000","last_active":"2024-09-11T23:16:15.335539+0000","last_peered":"2024-09-11T23:16:15.335539+0000","last_clean":"2024-09-11T23:16:15.335539+0000","last_became_active":"2024-09-11T23:16:14.367519+0000","last_became_peered":"2024-09-11T23:16:14.367519+0000","last_unstale":"2024-09-11T23:16:15.335539+0000","last_undegraded":"2024-09-11T23:16:15.335539+0000","last_fullsized":"2024-09-11T23:16:15.335539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:16.533562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338511+0000","last_change":"2024-09-11T23:16:13.336803+0000","last_active":"2024-09-11T23:16:15.338511+0000","last_peered":"2024-09-11T23:16:15.338511+0000","last_clean":"2024-09-11T23:16:15.338511+0000","last_became_active":"2024-09-11T23:16:13.336017+0000","last_became_peered":"2024-09-11T23:16:13.336017+0000","last_unstale":"2024-09-11T23:16:15.338511+0000","last_undegraded":"2024-09-11T23:16:15.338511+0000","last_fullsized":"2024-09-11T23:16:15.338511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551023+0000","last_change":"2024-09-11T23:16:14.375304+0000","last_active":"2024-09-11T23:16:15.551023+0000","last_peered":"2024-09-11T23:16:15.551023+0000","last_clean":"2024-09-11T23:16:15.551023+0000","last_became_active":"2024-09-11T23:16:14.375038+0000","last_became_peered":"2024-09-11T23:16:14.375038+0000","last_unstale":"2024-09-11T23:16:15.551023+0000","last_undegraded":"2024-09-11T23:16:15.551023+0000","last_fullsized":"2024-09-11T23:16:15.551023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:31.194287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.336232+0000","last_change":"2024-09-11T23:16:13.326933+0000","last_active":"2024-09-11T23:16:15.336232+0000","last_peered":"2024-09-11T23:16:15.336232+0000","last_clean":"2024-09-11T23:16:15.336232+0000","last_became_active":"2024-09-11T23:16:13.326399+0000","last_became_peered":"2024-09-11T23:16:13.326399+0000","last_unstale":"2024-09-11T23:16:15.336232+0000","last_undegraded":"2024-09-11T23:16:15.336232+0000","last_fullsized":"2024-09-11T23:16:15.336232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:36.491647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553992+0000","last_change":"2024-09-11T23:16:14.388668+0000","last_active":"2024-09-11T23:16:15.553992+0000","last_peered":"2024-09-11T23:16:15.553992+0000","last_clean":"2024-09-11T23:16:15.553992+0000","last_became_active":"2024-09-11T23:16:14.388024+0000","last_became_peered":"2024-09-11T23:16:14.388024+0000","last_unstale":"2024-09-11T23:16:15.553992+0000","last_undegraded":"2024-09-11T23:16:15.553992+0000","last_fullsized":"2024-09-11T23:16:15.553992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553042+0000","last_change":"2024-09-11T23:16:13.324368+0000","last_active":"2024-09-11T23:16:15.553042+0000","last_peered":"2024-09-11T23:16:15.553042+0000","last_clean":"2024-09-11T23:16:15.553042+0000","last_became_active":"2024-09-11T23:16:13.323655+0000","last_became_peered":"2024-09-11T23:16:13.323655+0000","last_unstale":"2024-09-11T23:16:15.553042+0000","last_undegraded":"2024-09-11T23:16:15.553042+0000","last_fullsized":"2024-09-11T23:16:15.553042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549223+0000","last_change":"2024-09-11T23:16:14.368439+0000","last_active":"2024-09-11T23:16:15.549223+0000","last_peered":"2024-09-11T23:16:15.549223+0000","last_clean":"2024-09-11T23:16:15.549223+0000","last_became_active":"2024-09-11T23:16:14.368086+0000","last_became_peered":"2024-09-11T23:16:14.368086+0000","last_unstale":"2024-09-11T23:16:15.549223+0000","last_undegraded":"2024-09-11T23:16:15.549223+0000","last_fullsized":"2024-09-11T23:16:15.549223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553050+0000","last_change":"2024-09-11T23:16:13.321064+0000","last_active":"2024-09-11T23:16:15.553050+0000","last_peered":"2024-09-11T23:16:15.553050+0000","last_clean":"2024-09-11T23:16:15.553050+0000","last_became_active":"2024-09-11T23:16:13.320359+0000","last_became_peered":"2024-09-11T23:16:13.320359+0000","last_unstale":"2024-09-11T23:16:15.553050+0000","last_undegraded":"2024-09-11T23:16:15.553050+0000","last_fullsized":"2024-09-11T23:16:15.553050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:22.265779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340905+0000","last_change":"2024-09-11T23:16:14.394639+0000","last_active":"2024-09-11T23:16:15.340905+0000","last_peered":"2024-09-11T23:16:15.340905+0000","last_clean":"2024-09-11T23:16:15.340905+0000","last_became_active":"2024-09-11T23:16:14.383803+0000","last_became_peered":"2024-09-11T23:16:14.383803+0000","last_unstale":"2024-09-11T23:16:15.340905+0000","last_undegraded":"2024-09-11T23:16:15.340905+0000","last_fullsized":"2024-09-11T23:16:15.340905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.671858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335722+0000","last_change":"2024-09-11T23:16:13.332747+0000","last_active":"2024-09-11T23:16:15.335722+0000","last_peered":"2024-09-11T23:16:15.335722+0000","last_clean":"2024-09-11T23:16:15.335722+0000","last_became_active":"2024-09-11T23:16:13.332104+0000","last_became_peered":"2024-09-11T23:16:13.332104+0000","last_unstale":"2024-09-11T23:16:15.335722+0000","last_undegraded":"2024-09-11T23:16:15.335722+0000","last_fullsized":"2024-09-11T23:16:15.335722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:40.527548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548725+0000","last_change":"2024-09-11T23:16:14.392414+0000","last_active":"2024-09-11T23:16:15.548725+0000","last_peered":"2024-09-11T23:16:15.548725+0000","last_clean":"2024-09-11T23:16:15.548725+0000","last_became_active":"2024-09-11T23:16:14.392099+0000","last_became_peered":"2024-09-11T23:16:14.392099+0000","last_unstale":"2024-09-11T23:16:15.548725+0000","last_undegraded":"2024-09-11T23:16:15.548725+0000","last_fullsized":"2024-09-11T23:16:15.548725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.299783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335672+0000","last_change":"2024-09-11T23:16:13.336911+0000","last_active":"2024-09-11T23:16:15.335672+0000","last_peered":"2024-09-11T23:16:15.335672+0000","last_clean":"2024-09-11T23:16:15.335672+0000","last_became_active":"2024-09-11T23:16:13.336363+0000","last_became_peered":"2024-09-11T23:16:13.336363+0000","last_unstale":"2024-09-11T23:16:15.335672+0000","last_undegraded":"2024-09-11T23:16:15.335672+0000","last_fullsized":"2024-09-11T23:16:15.335672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:01.564513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335320+0000","last_change":"2024-09-11T23:16:14.351542+0000","last_active":"2024-09-11T23:16:15.335320+0000","last_peered":"2024-09-11T23:16:15.335320+0000","last_clean":"2024-09-11T23:16:15.335320+0000","last_became_active":"2024-09-11T23:16:14.351059+0000","last_became_peered":"2024-09-11T23:16:14.351059+0000","last_unstale":"2024-09-11T23:16:15.335320+0000","last_undegraded":"2024-09-11T23:16:15.335320+0000","last_fullsized":"2024-09-11T23:16:15.335320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550057+0000","last_change":"2024-09-11T23:16:13.324038+0000","last_active":"2024-09-11T23:16:15.550057+0000","last_peered":"2024-09-11T23:16:15.550057+0000","last_clean":"2024-09-11T23:16:15.550057+0000","last_became_active":"2024-09-11T23:16:13.323374+0000","last_became_peered":"2024-09-11T23:16:13.323374+0000","last_unstale":"2024-09-11T23:16:15.550057+0000","last_undegraded":"2024-09-11T23:16:15.550057+0000","last_fullsized":"2024-09-11T23:16:15.550057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.674238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552750+0000","last_change":"2024-09-11T23:16:14.360868+0000","last_active":"2024-09-11T23:16:15.552750+0000","last_peered":"2024-09-11T23:16:15.552750+0000","last_clean":"2024-09-11T23:16:15.552750+0000","last_became_active":"2024-09-11T23:16:14.360164+0000","last_became_peered":"2024-09-11T23:16:14.360164+0000","last_unstale":"2024-09-11T23:16:15.552750+0000","last_undegraded":"2024-09-11T23:16:15.552750+0000","last_fullsized":"2024-09-11T23:16:15.552750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:37.500444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.337942+0000","last_change":"2024-09-11T23:16:13.331248+0000","last_active":"2024-09-11T23:16:15.337942+0000","last_peered":"2024-09-11T23:16:15.337942+0000","last_clean":"2024-09-11T23:16:15.337942+0000","last_became_active":"2024-09-11T23:16:13.330516+0000","last_became_peered":"2024-09-11T23:16:13.330516+0000","last_unstale":"2024-09-11T23:16:15.337942+0000","last_undegraded":"2024-09-11T23:16:15.337942+0000","last_fullsized":"2024-09-11T23:16:15.337942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:47.577588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335559+0000","last_change":"2024-09-11T23:16:14.352083+0000","last_active":"2024-09-11T23:16:15.335559+0000","last_peered":"2024-09-11T23:16:15.335559+0000","last_clean":"2024-09-11T23:16:15.335559+0000","last_became_active":"2024-09-11T23:16:14.351725+0000","last_became_peered":"2024-09-11T23:16:14.351725+0000","last_unstale":"2024-09-11T23:16:15.335559+0000","last_undegraded":"2024-09-11T23:16:15.335559+0000","last_fullsized":"2024-09-11T23:16:15.335559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:10.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552073+0000","last_change":"2024-09-11T23:16:13.326807+0000","last_active":"2024-09-11T23:16:15.552073+0000","last_peered":"2024-09-11T23:16:15.552073+0000","last_clean":"2024-09-11T23:16:15.552073+0000","last_became_active":"2024-09-11T23:16:13.325592+0000","last_became_peered":"2024-09-11T23:16:13.325592+0000","last_unstale":"2024-09-11T23:16:15.552073+0000","last_undegraded":"2024-09-11T23:16:15.552073+0000","last_fullsized":"2024-09-11T23:16:15.552073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:07.478372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335641+0000","last_change":"2024-09-11T23:16:14.365792+0000","last_active":"2024-09-11T23:16:15.335641+0000","last_peered":"2024-09-11T23:16:15.335641+0000","last_clean":"2024-09-11T23:16:15.335641+0000","last_became_active":"2024-09-11T23:16:14.365526+0000","last_became_peered":"2024-09-11T23:16:14.365526+0000","last_unstale":"2024-09-11T23:16:15.335641+0000","last_undegraded":"2024-09-11T23:16:15.335641+0000","last_fullsized":"2024-09-11T23:16:15.335641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:07.629887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552995+0000","last_change":"2024-09-11T23:16:13.321790+0000","last_active":"2024-09-11T23:16:15.552995+0000","last_peered":"2024-09-11T23:16:15.552995+0000","last_clean":"2024-09-11T23:16:15.552995+0000","last_became_active":"2024-09-11T23:16:13.320995+0000","last_became_peered":"2024-09-11T23:16:13.320995+0000","last_unstale":"2024-09-11T23:16:15.552995+0000","last_undegraded":"2024-09-11T23:16:15.552995+0000","last_fullsized":"2024-09-11T23:16:15.552995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:23.320611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552889+0000","last_change":"2024-09-11T23:16:14.356529+0000","last_active":"2024-09-11T23:16:15.552889+0000","last_peered":"2024-09-11T23:16:15.552889+0000","last_clean":"2024-09-11T23:16:15.552889+0000","last_became_active":"2024-09-11T23:16:14.355812+0000","last_became_peered":"2024-09-11T23:16:14.355812+0000","last_unstale":"2024-09-11T23:16:15.552889+0000","last_undegraded":"2024-09-11T23:16:15.552889+0000","last_fullsized":"2024-09-11T23:16:15.552889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:16.533562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.341153+0000","last_change":"2024-09-11T23:16:13.328848+0000","last_active":"2024-09-11T23:16:15.341153+0000","last_peered":"2024-09-11T23:16:15.341153+0000","last_clean":"2024-09-11T23:16:15.341153+0000","last_became_active":"2024-09-11T23:16:13.328075+0000","last_became_peered":"2024-09-11T23:16:13.328075+0000","last_unstale":"2024-09-11T23:16:15.341153+0000","last_undegraded":"2024-09-11T23:16:15.341153+0000","last_fullsized":"2024-09-11T23:16:15.341153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.674238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340956+0000","last_change":"2024-09-11T23:16:14.396065+0000","last_active":"2024-09-11T23:16:15.340956+0000","last_peered":"2024-09-11T23:16:15.340956+0000","last_clean":"2024-09-11T23:16:15.340956+0000","last_became_active":"2024-09-11T23:16:14.393989+0000","last_became_peered":"2024-09-11T23:16:14.393989+0000","last_unstale":"2024-09-11T23:16:15.340956+0000","last_undegraded":"2024-09-11T23:16:15.340956+0000","last_fullsized":"2024-09-11T23:16:15.340956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550924+0000","last_change":"2024-09-11T23:16:13.325992+0000","last_active":"2024-09-11T23:16:15.550924+0000","last_peered":"2024-09-11T23:16:15.550924+0000","last_clean":"2024-09-11T23:16:15.550924+0000","last_became_active":"2024-09-11T23:16:13.325437+0000","last_became_peered":"2024-09-11T23:16:13.325437+0000","last_unstale":"2024-09-11T23:16:15.550924+0000","last_undegraded":"2024-09-11T23:16:15.550924+0000","last_fullsized":"2024-09-11T23:16:15.550924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:36.843321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.551022+0000","last_change":"2024-09-11T23:16:14.349053+0000","last_active":"2024-09-11T23:16:15.551022+0000","last_peered":"2024-09-11T23:16:15.551022+0000","last_clean":"2024-09-11T23:16:15.551022+0000","last_became_active":"2024-09-11T23:16:14.347635+0000","last_became_peered":"2024-09-11T23:16:14.347635+0000","last_unstale":"2024-09-11T23:16:15.551022+0000","last_undegraded":"2024-09-11T23:16:15.551022+0000","last_fullsized":"2024-09-11T23:16:15.551022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:41.939962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550282+0000","last_change":"2024-09-11T23:16:13.313108+0000","last_active":"2024-09-11T23:16:15.550282+0000","last_peered":"2024-09-11T23:16:15.550282+0000","last_clean":"2024-09-11T23:16:15.550282+0000","last_became_active":"2024-09-11T23:16:13.312767+0000","last_became_peered":"2024-09-11T23:16:13.312767+0000","last_unstale":"2024-09-11T23:16:15.550282+0000","last_undegraded":"2024-09-11T23:16:15.550282+0000","last_fullsized":"2024-09-11T23:16:15.550282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552473+0000","last_change":"2024-09-11T23:16:14.376574+0000","last_active":"2024-09-11T23:16:15.552473+0000","last_peered":"2024-09-11T23:16:15.552473+0000","last_clean":"2024-09-11T23:16:15.552473+0000","last_became_active":"2024-09-11T23:16:14.375783+0000","last_became_peered":"2024-09-11T23:16:14.375783+0000","last_unstale":"2024-09-11T23:16:15.552473+0000","last_undegraded":"2024-09-11T23:16:15.552473+0000","last_fullsized":"2024-09-11T23:16:15.552473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550794+0000","last_change":"2024-09-11T23:16:13.331941+0000","last_active":"2024-09-11T23:16:15.550794+0000","last_peered":"2024-09-11T23:16:15.550794+0000","last_clean":"2024-09-11T23:16:15.550794+0000","last_became_active":"2024-09-11T23:16:13.331461+0000","last_became_peered":"2024-09-11T23:16:13.331461+0000","last_unstale":"2024-09-11T23:16:15.550794+0000","last_undegraded":"2024-09-11T23:16:15.550794+0000","last_fullsized":"2024-09-11T23:16:15.550794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:40.816040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549124+0000","last_change":"2024-09-11T23:16:14.368440+0000","last_active":"2024-09-11T23:16:15.549124+0000","last_peered":"2024-09-11T23:16:15.549124+0000","last_clean":"2024-09-11T23:16:15.549124+0000","last_became_active":"2024-09-11T23:16:14.368127+0000","last_became_peered":"2024-09-11T23:16:14.368127+0000","last_unstale":"2024-09-11T23:16:15.549124+0000","last_undegraded":"2024-09-11T23:16:15.549124+0000","last_fullsized":"2024-09-11T23:16:15.549124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550700+0000","last_change":"2024-09-11T23:16:13.314568+0000","last_active":"2024-09-11T23:16:15.550700+0000","last_peered":"2024-09-11T23:16:15.550700+0000","last_clean":"2024-09-11T23:16:15.550700+0000","last_became_active":"2024-09-11T23:16:13.313778+0000","last_became_peered":"2024-09-11T23:16:13.313778+0000","last_unstale":"2024-09-11T23:16:15.550700+0000","last_undegraded":"2024-09-11T23:16:15.550700+0000","last_fullsized":"2024-09-11T23:16:15.550700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:47.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552311+0000","last_change":"2024-09-11T23:16:14.390039+0000","last_active":"2024-09-11T23:16:15.552311+0000","last_peered":"2024-09-11T23:16:15.552311+0000","last_clean":"2024-09-11T23:16:15.552311+0000","last_became_active":"2024-09-11T23:16:14.384231+0000","last_became_peered":"2024-09-11T23:16:14.384231+0000","last_unstale":"2024-09-11T23:16:15.552311+0000","last_undegraded":"2024-09-11T23:16:15.552311+0000","last_fullsized":"2024-09-11T23:16:15.552311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.738356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552245+0000","last_change":"2024-09-11T23:16:13.337708+0000","last_active":"2024-09-11T23:16:15.552245+0000","last_peered":"2024-09-11T23:16:15.552245+0000","last_clean":"2024-09-11T23:16:15.552245+0000","last_became_active":"2024-09-11T23:16:13.336542+0000","last_became_peered":"2024-09-11T23:16:13.336542+0000","last_unstale":"2024-09-11T23:16:15.552245+0000","last_undegraded":"2024-09-11T23:16:15.552245+0000","last_fullsized":"2024-09-11T23:16:15.552245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:39.826972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335794+0000","last_change":"2024-09-11T23:16:14.367904+0000","last_active":"2024-09-11T23:16:15.335794+0000","last_peered":"2024-09-11T23:16:15.335794+0000","last_clean":"2024-09-11T23:16:15.335794+0000","last_became_active":"2024-09-11T23:16:14.367555+0000","last_became_peered":"2024-09-11T23:16:14.367555+0000","last_unstale":"2024-09-11T23:16:15.335794+0000","last_undegraded":"2024-09-11T23:16:15.335794+0000","last_fullsized":"2024-09-11T23:16:15.335794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:26.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550662+0000","last_change":"2024-09-11T23:16:13.320538+0000","last_active":"2024-09-11T23:16:15.550662+0000","last_peered":"2024-09-11T23:16:15.550662+0000","last_clean":"2024-09-11T23:16:15.550662+0000","last_became_active":"2024-09-11T23:16:13.319967+0000","last_became_peered":"2024-09-11T23:16:13.319967+0000","last_unstale":"2024-09-11T23:16:15.550662+0000","last_undegraded":"2024-09-11T23:16:15.550662+0000","last_fullsized":"2024-09-11T23:16:15.550662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:56.435370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.550189+0000","last_change":"2024-09-11T23:16:14.391199+0000","last_active":"2024-09-11T23:16:15.550189+0000","last_peered":"2024-09-11T23:16:15.550189+0000","last_clean":"2024-09-11T23:16:15.550189+0000","last_became_active":"2024-09-11T23:16:14.390831+0000","last_became_peered":"2024-09-11T23:16:14.390831+0000","last_unstale":"2024-09-11T23:16:15.550189+0000","last_undegraded":"2024-09-11T23:16:15.550189+0000","last_fullsized":"2024-09-11T23:16:15.550189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553324+0000","last_change":"2024-09-11T23:16:13.314156+0000","last_active":"2024-09-11T23:16:15.553324+0000","last_peered":"2024-09-11T23:16:15.553324+0000","last_clean":"2024-09-11T23:16:15.553324+0000","last_became_active":"2024-09-11T23:16:13.313469+0000","last_became_peered":"2024-09-11T23:16:13.313469+0000","last_unstale":"2024-09-11T23:16:15.553324+0000","last_undegraded":"2024-09-11T23:16:15.553324+0000","last_fullsized":"2024-09-11T23:16:15.553324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:08.598034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.554343+0000","last_change":"2024-09-11T23:16:14.383181+0000","last_active":"2024-09-11T23:16:15.554343+0000","last_peered":"2024-09-11T23:16:15.554343+0000","last_clean":"2024-09-11T23:16:15.554343+0000","last_became_active":"2024-09-11T23:16:14.382438+0000","last_became_peered":"2024-09-11T23:16:14.382438+0000","last_unstale":"2024-09-11T23:16:15.554343+0000","last_undegraded":"2024-09-11T23:16:15.554343+0000","last_fullsized":"2024-09-11T23:16:15.554343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:20.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:16.339823+0000","last_change":"2024-09-11T23:16:13.318752+0000","last_active":"2024-09-11T23:16:16.339823+0000","last_peered":"2024-09-11T23:16:16.339823+0000","last_clean":"2024-09-11T23:16:16.339823+0000","last_became_active":"2024-09-11T23:16:13.318281+0000","last_became_peered":"2024-09-11T23:16:13.318281+0000","last_unstale":"2024-09-11T23:16:16.339823+0000","last_undegraded":"2024-09-11T23:16:16.339823+0000","last_fullsized":"2024-09-11T23:16:16.339823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:02.168475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335782+0000","last_change":"2024-09-11T23:16:14.394370+0000","last_active":"2024-09-11T23:16:15.335782+0000","last_peered":"2024-09-11T23:16:15.335782+0000","last_clean":"2024-09-11T23:16:15.335782+0000","last_became_active":"2024-09-11T23:16:14.394093+0000","last_became_peered":"2024-09-11T23:16:14.394093+0000","last_unstale":"2024-09-11T23:16:15.335782+0000","last_undegraded":"2024-09-11T23:16:15.335782+0000","last_fullsized":"2024-09-11T23:16:15.335782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:04.079303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549320+0000","last_change":"2024-09-11T23:16:13.328838+0000","last_active":"2024-09-11T23:16:15.549320+0000","last_peered":"2024-09-11T23:16:15.549320+0000","last_clean":"2024-09-11T23:16:15.549320+0000","last_became_active":"2024-09-11T23:16:13.328158+0000","last_became_peered":"2024-09-11T23:16:13.328158+0000","last_unstale":"2024-09-11T23:16:15.549320+0000","last_undegraded":"2024-09-11T23:16:15.549320+0000","last_fullsized":"2024-09-11T23:16:15.549320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:59.824592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.548977+0000","last_change":"2024-09-11T23:16:14.348026+0000","last_active":"2024-09-11T23:16:15.548977+0000","last_peered":"2024-09-11T23:16:15.548977+0000","last_clean":"2024-09-11T23:16:15.548977+0000","last_became_active":"2024-09-11T23:16:14.347188+0000","last_became_peered":"2024-09-11T23:16:14.347188+0000","last_unstale":"2024-09-11T23:16:15.548977+0000","last_undegraded":"2024-09-11T23:16:15.548977+0000","last_fullsized":"2024-09-11T23:16:15.548977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:02.573311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549286+0000","last_change":"2024-09-11T23:16:13.331042+0000","last_active":"2024-09-11T23:16:15.549286+0000","last_peered":"2024-09-11T23:16:15.549286+0000","last_clean":"2024-09-11T23:16:15.549286+0000","last_became_active":"2024-09-11T23:16:13.330758+0000","last_became_peered":"2024-09-11T23:16:13.330758+0000","last_unstale":"2024-09-11T23:16:15.549286+0000","last_undegraded":"2024-09-11T23:16:15.549286+0000","last_fullsized":"2024-09-11T23:16:15.549286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:39.826972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.549730+0000","last_change":"2024-09-11T23:16:14.365909+0000","last_active":"2024-09-11T23:16:15.549730+0000","last_peered":"2024-09-11T23:16:15.549730+0000","last_clean":"2024-09-11T23:16:15.549730+0000","last_became_active":"2024-09-11T23:16:14.365541+0000","last_became_peered":"2024-09-11T23:16:14.365541+0000","last_unstale":"2024-09-11T23:16:15.549730+0000","last_undegraded":"2024-09-11T23:16:15.549730+0000","last_fullsized":"2024-09-11T23:16:15.549730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:33.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338562+0000","last_change":"2024-09-11T23:16:13.337806+0000","last_active":"2024-09-11T23:16:15.338562+0000","last_peered":"2024-09-11T23:16:15.338562+0000","last_clean":"2024-09-11T23:16:15.338562+0000","last_became_active":"2024-09-11T23:16:13.336910+0000","last_became_peered":"2024-09-11T23:16:13.336910+0000","last_unstale":"2024-09-11T23:16:15.338562+0000","last_undegraded":"2024-09-11T23:16:15.338562+0000","last_fullsized":"2024-09-11T23:16:15.338562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:07.478372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.340008+0000","last_change":"2024-09-11T23:16:14.395926+0000","last_active":"2024-09-11T23:16:15.340008+0000","last_peered":"2024-09-11T23:16:15.340008+0000","last_clean":"2024-09-11T23:16:15.340008+0000","last_became_active":"2024-09-11T23:16:14.386827+0000","last_became_peered":"2024-09-11T23:16:14.386827+0000","last_unstale":"2024-09-11T23:16:15.340008+0000","last_undegraded":"2024-09-11T23:16:15.340008+0000","last_fullsized":"2024-09-11T23:16:15.340008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.536346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.338678+0000","last_change":"2024-09-11T23:16:13.325942+0000","last_active":"2024-09-11T23:16:15.338678+0000","last_peered":"2024-09-11T23:16:15.338678+0000","last_clean":"2024-09-11T23:16:15.338678+0000","last_became_active":"2024-09-11T23:16:13.325227+0000","last_became_peered":"2024-09-11T23:16:13.325227+0000","last_unstale":"2024-09-11T23:16:15.338678+0000","last_undegraded":"2024-09-11T23:16:15.338678+0000","last_fullsized":"2024-09-11T23:16:15.338678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:24.144354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553768+0000","last_change":"2024-09-11T23:16:14.381319+0000","last_active":"2024-09-11T23:16:15.553768+0000","last_peered":"2024-09-11T23:16:15.553768+0000","last_clean":"2024-09-11T23:16:15.553768+0000","last_became_active":"2024-09-11T23:16:14.380780+0000","last_became_peered":"2024-09-11T23:16:14.380780+0000","last_unstale":"2024-09-11T23:16:15.553768+0000","last_undegraded":"2024-09-11T23:16:15.553768+0000","last_fullsized":"2024-09-11T23:16:15.553768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.165756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.335287+0000","last_change":"2024-09-11T23:16:13.316966+0000","last_active":"2024-09-11T23:16:15.335287+0000","last_peered":"2024-09-11T23:16:15.335287+0000","last_clean":"2024-09-11T23:16:15.335287+0000","last_became_active":"2024-09-11T23:16:13.316659+0000","last_became_peered":"2024-09-11T23:16:13.316659+0000","last_unstale":"2024-09-11T23:16:15.335287+0000","last_undegraded":"2024-09-11T23:16:15.335287+0000","last_fullsized":"2024-09-11T23:16:15.335287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:32.170087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552509+0000","last_change":"2024-09-11T23:16:14.396436+0000","last_active":"2024-09-11T23:16:15.552509+0000","last_peered":"2024-09-11T23:16:15.552509+0000","last_clean":"2024-09-11T23:16:15.552509+0000","last_became_active":"2024-09-11T23:16:14.395334+0000","last_became_peered":"2024-09-11T23:16:14.395334+0000","last_unstale":"2024-09-11T23:16:15.552509+0000","last_undegraded":"2024-09-11T23:16:15.552509+0000","last_fullsized":"2024-09-11T23:16:15.552509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:13.287649+0000","last_clean_scrub_stamp":"2024-09-11T23:16:13.287649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.553813+0000","last_change":"2024-09-11T23:16:13.332441+0000","last_active":"2024-09-11T23:16:15.553813+0000","last_peered":"2024-09-11T23:16:15.553813+0000","last_clean":"2024-09-11T23:16:15.553813+0000","last_became_active":"2024-09-11T23:16:13.331267+0000","last_became_peered":"2024-09-11T23:16:13.331267+0000","last_unstale":"2024-09-11T23:16:15.553813+0000","last_undegraded":"2024-09-11T23:16:15.553813+0000","last_fullsized":"2024-09-11T23:16:15.553813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:12.278851+0000","last_clean_scrub_stamp":"2024-09-11T23:16:12.278851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.484510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":206,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:16:15.552614+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:16:15.552614+0000","last_peered":"2024-09-11T23:16:15.552614+0000","last_clean":"2024-09-11T23:16:15.552614+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:16:15.552614+0000","last_undegraded":"2024-09-11T23:16:15.552614+0000","last_fullsized":"2024-09-11T23:16:15.552614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":789422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":454656,"data_stored":197954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":197484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":197976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":466944,"data_stored":199018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":197442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":197462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1048576,"data_stored":787774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:16:22.124 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:16:22.124 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:16:22.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca2d19640 1 Processor -- start 2024-09-11T23:16:22.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca2d19640 1 -- start start 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca2d19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c15e4f0 0x7efc9c0d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca2d19640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc9c0d4e20 0x7efc9c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca2d19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c0d0350 con 0x7efc9c162070 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca2d19640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7efc9c0cf070 con 0x7efc9c0d4e20 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca2d19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c0d1c20 con 0x7efc9c15e4f0 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efc93fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc9c0d4e20 0x7efc9c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efc93fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc9c0d4e20 0x7efc9c0cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47982/0 (socket says 172.21.15.94:47982) 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efc93fff640 1 -- 172.21.15.94:0/341099921 learned_addr learned my addr 172.21.15.94:0/341099921 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:22.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efca0ab5640 1 --2- 172.21.15.94:0/341099921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c15e4f0 0x7efc9c0d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efc93fff640 1 -- 172.21.15.94:0/341099921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c15e4f0 msgr2=0x7efc9c0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:22.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.291+0000 7efc93fff640 1 --2- 172.21.15.94:0/341099921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c15e4f0 0x7efc9c0d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efc93fff640 1 -- 172.21.15.94:0/341099921 >> v1:172.21.15.155:6789/0 conn(0x7efc9c162070 legacy=0x7efc9c0b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efc93fff640 1 -- 172.21.15.94:0/341099921 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c0cf330 con 0x7efc9c0d4e20 2024-09-11T23:16:22.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca0ab5640 1 --2- 172.21.15.94:0/341099921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c15e4f0 0x7efc9c0d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:22.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efc93fff640 1 --2- 172.21.15.94:0/341099921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c0d4e20 0x7efc9c0cfe10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009870 tx=0x7efc8c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800cb692851c0cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:22.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efc937fe640 1 -- 172.21.15.94:0/341099921 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0b5070 con 0x7efc9c0d4e20 2024-09-11T23:16:22.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efc937fe640 1 -- 172.21.15.94:0/341099921 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c0a8a50 con 0x7efc9c0d4e20 2024-09-11T23:16:22.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efc937fe640 1 -- 172.21.15.94:0/341099921 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0a8e20 con 0x7efc9c0d4e20 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 -- 172.21.15.94:0/341099921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c0d4e20 msgr2=0x7efc9c0cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 --2- 172.21.15.94:0/341099921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c0d4e20 0x7efc9c0cfe10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009870 tx=0x7efc8c01ed50 comp rx=0 tx=0).stop 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 -- 172.21.15.94:0/341099921 shutdown_connections 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 --2- 172.21.15.94:0/341099921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c0d4e20 0x7efc9c0cfe10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 --2- 172.21.15.94:0/341099921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c15e4f0 0x7efc9c0d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 -- 172.21.15.94:0/341099921 >> 172.21.15.94:0/341099921 conn(0x7efc9c08bf90 msgr2=0x7efc9c0d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 -- 172.21.15.94:0/341099921 shutdown_connections 2024-09-11T23:16:22.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.295+0000 7efca2d19640 1 -- 172.21.15.94:0/341099921 wait complete. 2024-09-11T23:16:22.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 Processor -- start 2024-09-11T23:16:22.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 -- start start 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c0d4e20 0x7efc9c15fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc9c15e4f0 0x7efc9c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c162070 0x7efc9c0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c15e8d0 con 0x7efc9c162070 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c0cf8f0 con 0x7efc9c15e4f0 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c0d5240 con 0x7efc9c0d4e20 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c162070 0x7efc9c0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c162070 0x7efc9c0cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47994/0 (socket says 172.21.15.94:47994) 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 -- 172.21.15.94:0/2569882378 learned_addr learned my addr 172.21.15.94:0/2569882378 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:22.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca0ab5640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c0d4e20 0x7efc9c15fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efc93fff640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc9c15e4f0 0x7efc9c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 -- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c0d4e20 msgr2=0x7efc9c15fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c0d4e20 0x7efc9c15fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 -- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc9c15e4f0 msgr2=0x7efc9c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc9c15e4f0 0x7efc9c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 -- 172.21.15.94:0/2569882378 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c1603b0 con 0x7efc9c162070 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efc93fff640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc9c15e4f0 0x7efc9c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca12b6640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c162070 0x7efc9c0cba20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc9400c6f0 tx=0x7efc9400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efc917fa640 1 -- 172.21.15.94:0/2569882378 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94003980 con 0x7efc9c162070 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efc917fa640 1 -- 172.21.15.94:0/2569882378 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc94003b20 con 0x7efc9c162070 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c160690 con 0x7efc9c162070 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efc917fa640 1 -- 172.21.15.94:0/2569882378 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9400a850 con 0x7efc9c162070 2024-09-11T23:16:22.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9c160c50 con 0x7efc9c162070 2024-09-11T23:16:22.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.299+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9c0cfe10 con 0x7efc9c162070 2024-09-11T23:16:22.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.303+0000 7efc917fa640 1 -- 172.21.15.94:0/2569882378 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc9400a9f0 con 0x7efc9c162070 2024-09-11T23:16:22.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.303+0000 7efc917fa640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc880678c0 0x7efc88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.303+0000 7efc917fa640 1 -- 172.21.15.94:0/2569882378 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7efc94085ca0 con 0x7efc9c162070 2024-09-11T23:16:22.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.303+0000 7efca0ab5640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc880678c0 0x7efc88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.303+0000 7efca0ab5640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc880678c0 0x7efc88069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc98006fd0 tx=0x7efc98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:22.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.307+0000 7efc917fa640 1 -- 172.21.15.94:0/2569882378 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc94056650 con 0x7efc9c162070 2024-09-11T23:16:22.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.531+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efc9c0d4b20 con 0x7efc9c162070 2024-09-11T23:16:22.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efc917fa640 1 -- 172.21.15.94:0/2569882378 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7efc94055f50 con 0x7efc9c162070 2024-09-11T23:16:22.538 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:16:22.538 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:16:22.539 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2024-09-11T23:16:22.539 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2024-09-11T23:16:22.539 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:16:22.539 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2024-09-11T23:16:22.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc880678c0 msgr2=0x7efc88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc880678c0 0x7efc88069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc98006fd0 tx=0x7efc98008040 comp rx=0 tx=0).stop 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c162070 msgr2=0x7efc9c0cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c162070 0x7efc9c0cba20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc9400c6f0 tx=0x7efc9400cbb0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 shutdown_connections 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc880678c0 0x7efc88069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc9c162070 0x7efc9c0cba20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc9c15e4f0 0x7efc9c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 --2- 172.21.15.94:0/2569882378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9c0d4e20 0x7efc9c15fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 >> 172.21.15.94:0/2569882378 conn(0x7efc9c08bf90 msgr2=0x7efc9c0b78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 shutdown_connections 2024-09-11T23:16:22.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.535+0000 7efca2d19640 1 -- 172.21.15.94:0/2569882378 wait complete. 2024-09-11T23:16:22.556 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:22.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe587ab0640 1 Processor -- start 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe587ab0640 1 -- start start 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe587ab0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe58015e5f0 0x7fe58006d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe587ab0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe5800ce9d0 0x7fe5800cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe587ab0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe58006d9c0 con 0x7fe5800cf920 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe587ab0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe5800cfd90 con 0x7fe5800ce9d0 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe587ab0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe58006dca0 con 0x7fe58015e5f0 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58504b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe5800ce9d0 0x7fe5800cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58504b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe5800ce9d0 0x7fe5800cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48000/0 (socket says 172.21.15.94:48000) 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58504b640 1 -- 172.21.15.94:0/4254837562 learned_addr learned my addr 172.21.15.94:0/4254837562 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:22.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58584c640 1 --2- 172.21.15.94:0/4254837562 >> v2:172.21.15.155:3300/0 conn(0x7fe58015e5f0 0x7fe58006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58504b640 1 -- 172.21.15.94:0/4254837562 >> v2:172.21.15.155:3300/0 conn(0x7fe58015e5f0 msgr2=0x7fe58006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:22.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58504b640 1 --2- 172.21.15.94:0/4254837562 >> v2:172.21.15.155:3300/0 conn(0x7fe58015e5f0 0x7fe58006d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58504b640 1 -- 172.21.15.94:0/4254837562 >> v1:172.21.15.155:6789/0 conn(0x7fe5800cf920 legacy=0x7fe5800d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:22.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58504b640 1 -- 172.21.15.94:0/4254837562 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58006df80 con 0x7fe5800ce9d0 2024-09-11T23:16:22.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.671+0000 7fe58584c640 1 --2- 172.21.15.94:0/4254837562 >> v2:172.21.15.155:3300/0 conn(0x7fe58015e5f0 0x7fe58006d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:22.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 --2- 172.21.15.94:0/4254837562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5800ce9d0 0x7fe5800cf3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe58008e380 tx=0x7fe57c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bded724d683e700 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:22.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58484a640 1 -- 172.21.15.94:0/4254837562 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0b1070 con 0x7fe5800ce9d0 2024-09-11T23:16:22.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58484a640 1 -- 172.21.15.94:0/4254837562 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0ac640 con 0x7fe5800ce9d0 2024-09-11T23:16:22.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58484a640 1 -- 172.21.15.94:0/4254837562 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0aca10 con 0x7fe5800ce9d0 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- 172.21.15.94:0/4254837562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5800ce9d0 msgr2=0x7fe5800cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 --2- 172.21.15.94:0/4254837562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5800ce9d0 0x7fe5800cf3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe58008e380 tx=0x7fe57c01c4e0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- 172.21.15.94:0/4254837562 shutdown_connections 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 --2- 172.21.15.94:0/4254837562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5800ce9d0 0x7fe5800cf3e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 --2- 172.21.15.94:0/4254837562 >> v2:172.21.15.155:3300/0 conn(0x7fe58015e5f0 0x7fe58006d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- 172.21.15.94:0/4254837562 >> 172.21.15.94:0/4254837562 conn(0x7fe580074030 msgr2=0x7fe58009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- 172.21.15.94:0/4254837562 shutdown_connections 2024-09-11T23:16:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- 172.21.15.94:0/4254837562 wait complete. 2024-09-11T23:16:22.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 Processor -- start 2024-09-11T23:16:22.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- start start 2024-09-11T23:16:22.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5800cf920 0x7fe5800caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe580155720 0x7fe5800b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58015ef00 0x7fe58015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe58016b120 con 0x7fe580155720 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe58016afa0 con 0x7fe58015ef00 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe587ab0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe58016b2a0 con 0x7fe5800cf920 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe580155720 0x7fe5800b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe580155720 0x7fe5800b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48006/0 (socket says 172.21.15.94:48006) 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 -- 172.21.15.94:0/1932989496 learned_addr learned my addr 172.21.15.94:0/1932989496 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58604d640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58015ef00 0x7fe58015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58584c640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5800cf920 0x7fe5800caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 -- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5800cf920 msgr2=0x7fe5800caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5800cf920 0x7fe5800caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 -- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58015ef00 msgr2=0x7fe58015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58015ef00 0x7fe58015f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.675+0000 7fe58504b640 1 -- 172.21.15.94:0/1932989496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5800c9ce0 con 0x7fe580155720 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe58504b640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe580155720 0x7fe5800b2350 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe57c01a110 tx=0x7fe57c019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe5767fc640 1 -- 172.21.15.94:0/1932989496 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0b1040 con 0x7fe580155720 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe5767fc640 1 -- 172.21.15.94:0/1932989496 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0ba070 con 0x7fe580155720 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5800c9fc0 con 0x7fe580155720 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe5767fc640 1 -- 172.21.15.94:0/1932989496 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0b5880 con 0x7fe580155720 2024-09-11T23:16:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5800ca580 con 0x7fe580155720 2024-09-11T23:16:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58006d0f0 con 0x7fe580155720 2024-09-11T23:16:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe5767fc640 1 -- 172.21.15.94:0/1932989496 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe57c0ac500 con 0x7fe580155720 2024-09-11T23:16:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe5767fc640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5640678f0 0x7fe564069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe5767fc640 1 -- 172.21.15.94:0/1932989496 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe57c11fb30 con 0x7fe580155720 2024-09-11T23:16:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe58584c640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5640678f0 0x7fe564069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:22.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.679+0000 7fe58584c640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5640678f0 0x7fe564069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe570006fd0 tx=0x7fe570008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:22.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.683+0000 7fe5767fc640 1 -- 172.21.15.94:0/1932989496 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe57c0160d0 con 0x7fe580155720 2024-09-11T23:16:22.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.875+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe58006bcc0 con 0x7fe580155720 2024-09-11T23:16:22.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.875+0000 7fe5767fc640 1 -- 172.21.15.94:0/1932989496 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7fe57c0f0600 con 0x7fe580155720 2024-09-11T23:16:22.881 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:22.881 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:22.881 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5640678f0 msgr2=0x7fe564069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5640678f0 0x7fe564069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe570006fd0 tx=0x7fe570008040 comp rx=0 tx=0).stop 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe580155720 msgr2=0x7fe5800b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe580155720 0x7fe5800b2350 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe57c01a110 tx=0x7fe57c019280 comp rx=0 tx=0).stop 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 shutdown_connections 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58015ef00 0x7fe58015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe5640678f0 0x7fe564069db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe580155720 0x7fe5800b2350 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 --2- 172.21.15.94:0/1932989496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5800cf920 0x7fe5800caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 >> 172.21.15.94:0/1932989496 conn(0x7fe5800ce9d0 msgr2=0x7fe5800d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 shutdown_connections 2024-09-11T23:16:22.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:22.879+0000 7fe587ab0640 1 -- 172.21.15.94:0/1932989496 wait complete. 2024-09-11T23:16:23.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:16:13.663917+0000', 'modified': '2024-09-11T23:16:15.700106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4902}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4902': {'gid': 4902, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6835/2889518527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 2889518527}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 2889518527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4902, 'qdb_cluster': [4902]} 2024-09-11T23:16:23.302 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:16:23.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:16:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5e61da640 1 Processor -- start 2024-09-11T23:16:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5e61da640 1 -- start start 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5e61da640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5e00b3330 0x7fa5e00b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5e61da640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa5e015bc80 0x7fa5e00b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5e61da640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e00b3c50 con 0x7fa5e00b51b0 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5e61da640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e00d0b80 con 0x7fa5e015bc80 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5e61da640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e00d0e60 con 0x7fa5e00b3330 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa5e015bc80 0x7fa5e00b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa5e015bc80 0x7fa5e00b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48010/0 (socket says 172.21.15.94:48010) 2024-09-11T23:16:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 -- 172.21.15.94:0/2622987413 learned_addr learned my addr 172.21.15.94:0/2622987413 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:23.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 -- 172.21.15.94:0/2622987413 >> v2:172.21.15.155:3300/0 conn(0x7fa5e00b3330 msgr2=0x7fa5e00b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/2622987413 >> v2:172.21.15.155:3300/0 conn(0x7fa5e00b3330 0x7fa5e00b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 --2- 172.21.15.94:0/2622987413 >> v2:172.21.15.155:3300/0 conn(0x7fa5e00b3330 0x7fa5e00b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 -- 172.21.15.94:0/2622987413 >> v1:172.21.15.155:6789/0 conn(0x7fa5e00b51b0 legacy=0x7fa5e015b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 -- 172.21.15.94:0/2622987413 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e00b46d0 con 0x7fa5e015bc80 2024-09-11T23:16:23.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.431+0000 7fa5dffff640 1 --2- 172.21.15.94:0/2622987413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e00b55d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0073cc0 tx=0x7fa5d801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c28bb64dbc8644 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5de7fc640 1 -- 172.21.15.94:0/2622987413 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80a5760 con 0x7fa5e015bc80 2024-09-11T23:16:23.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5de7fc640 1 -- 172.21.15.94:0/2622987413 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d80a5900 con 0x7fa5e015bc80 2024-09-11T23:16:23.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5de7fc640 1 -- 172.21.15.94:0/2622987413 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80a5cd0 con 0x7fa5e015bc80 2024-09-11T23:16:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- 172.21.15.94:0/2622987413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 msgr2=0x7fa5e00b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 --2- 172.21.15.94:0/2622987413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e00b55d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0073cc0 tx=0x7fa5d801c9b0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- 172.21.15.94:0/2622987413 shutdown_connections 2024-09-11T23:16:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 --2- 172.21.15.94:0/2622987413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e00b55d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 --2- 172.21.15.94:0/2622987413 >> v2:172.21.15.155:3300/0 conn(0x7fa5e00b3330 0x7fa5e00b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- 172.21.15.94:0/2622987413 >> 172.21.15.94:0/2622987413 conn(0x7fa5e00b6870 msgr2=0x7fa5e00b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- 172.21.15.94:0/2622987413 shutdown_connections 2024-09-11T23:16:23.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- 172.21.15.94:0/2622987413 wait complete. 2024-09-11T23:16:23.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 Processor -- start 2024-09-11T23:16:23.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- start start 2024-09-11T23:16:23.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5e00b3330 0x7fa5e015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5e00b51b0 0x7fa5e013bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e013c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e00d05f0 con 0x7fa5e015bc80 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0144f10 con 0x7fa5e00b51b0 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e00d0770 con 0x7fa5e00b3330 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e013c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e013c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48024/0 (socket says 172.21.15.94:48024) 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 -- 172.21.15.94:0/3725684800 learned_addr learned my addr 172.21.15.94:0/3725684800 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5deffd640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5e00b51b0 0x7fa5e013bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5e00b3330 0x7fa5e015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 -- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5e00b3330 msgr2=0x7fa5e015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5e00b3330 0x7fa5e015a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 -- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5e00b51b0 msgr2=0x7fa5e013bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5e00b51b0 0x7fa5e013bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 -- 172.21.15.94:0/3725684800 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e015a670 con 0x7fa5e015bc80 2024-09-11T23:16:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5e00b3330 0x7fa5e015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5dffff640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e013c530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa5d801a5e0 tx=0x7fa5d8019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5c7fff640 1 -- 172.21.15.94:0/3725684800 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80bc020 con 0x7fa5e015bc80 2024-09-11T23:16:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5c7fff640 1 -- 172.21.15.94:0/3725684800 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d80b8690 con 0x7fa5e015bc80 2024-09-11T23:16:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e0140360 con 0x7fa5e015bc80 2024-09-11T23:16:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5c7fff640 1 -- 172.21.15.94:0/3725684800 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80b8a80 con 0x7fa5e015bc80 2024-09-11T23:16:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.435+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e0140920 con 0x7fa5e015bc80 2024-09-11T23:16:23.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5c7fff640 1 -- 172.21.15.94:0/3725684800 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5d80bf020 con 0x7fa5e015bc80 2024-09-11T23:16:23.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5c7fff640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5cc0678c0 0x7fa5cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5c7fff640 1 -- 172.21.15.94:0/3725684800 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa5d81210b0 con 0x7fa5e015bc80 2024-09-11T23:16:23.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5cc0678c0 0x7fa5cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 Processor -- start 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 -- start start 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5cc0678c0 0x7fa5cc069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0006fd0 tx=0x7fa5d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d845cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d8412d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8413290 0x5625d8413670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5625d82fab60 con 0x5625d845cb20 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5625d8261c70 con 0x5625d845d440 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5625d8207ed0 con 0x5625d8413290 2024-09-11T23:16:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d845cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d845cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48032/0 (socket says 172.21.15.94:48032) 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 -- 172.21.15.94:0/3399488552 learned_addr learned my addr 172.21.15.94:0/3399488552 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5deffd640 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d8412d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5dffff640 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8413290 0x5625d8413670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 -- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8413290 msgr2=0x5625d8413670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8413290 0x5625d8413670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 -- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 msgr2=0x5625d8412d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d8412d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 -- 172.21.15.94:0/3399488552 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d8219e50 con 0x5625d845cb20 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5deffd640 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d8412d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.439+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d845cf00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000db60 tx=0x7fa5d0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5731f1f54341f181 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5c57fa640 1 -- 172.21.15.94:0/3399488552 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d001a040 con 0x5625d845cb20 2024-09-11T23:16:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5c57fa640 1 -- 172.21.15.94:0/3399488552 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d0023070 con 0x5625d845cb20 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5c57fa640 1 -- 172.21.15.94:0/3399488552 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0014a30 con 0x5625d845cb20 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/3399488552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 msgr2=0x5625d845cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d845cf00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000db60 tx=0x7fa5d0010000 comp rx=0 tx=0).stop 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/3399488552 shutdown_connections 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8413290 0x5625d8413670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d8412d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- 172.21.15.94:0/3399488552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d845cf00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/3399488552 >> 172.21.15.94:0/3399488552 conn(0x5625d8419600 msgr2=0x5625d8411630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/3399488552 shutdown_connections 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/3399488552 wait complete. 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- start start 2024-09-11T23:16:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 Processor -- start 2024-09-11T23:16:23.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d8417e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d841dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d841e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5625d82c3b00 con 0x5625d845cb20 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5625d823c360 con 0x5625d845d440 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5625d82392d0 con 0x5625d8418390 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 10 client.0 _ll_register_callbacks cb 0x5625d83fe820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d8417e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d8417e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48040/0 (socket says 172.21.15.94:48040) 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 -- 172.21.15.94:0/640394950 learned_addr learned my addr 172.21.15.94:0/640394950 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5deffd640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d841dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5dffff640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d841e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 -- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 msgr2=0x5625d841e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d841e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 -- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 msgr2=0x5625d841dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d841dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 -- 172.21.15.94:0/640394950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d8208120 con 0x5625d845cb20 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5dffff640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d841e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d8417e50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0020040 tx=0x7fa5d0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a6dbca38b5888b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5be7fc640 1 -- 172.21.15.94:0/640394950 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0012640 con 0x5625d845cb20 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5be7fc640 1 -- 172.21.15.94:0/640394950 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa5d0032c30 con 0x5625d845cb20 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5d0023070 con 0x5625d845cb20 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5be7fc640 1 -- 172.21.15.94:0/640394950 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fa5d00127e0 con 0x5625d845cb20 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 10 client.5094 fetch_fsmap learned FSMap version 15 2024-09-11T23:16:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5625d8201450 con 0x5625d845cb20 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5be7fc640 1 -- 172.21.15.94:0/640394950 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d0023070 con 0x5625d845cb20 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5be7fc640 1 -- 172.21.15.94:0/640394950 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fa5d0039050 con 0x5625d845cb20 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 10 client.5094 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 10 client.5094 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 20 client.5094 populate_metadata read hostname 'smithi094' 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d846b280 0x5625d846d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 4 client.5094 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 --> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625d81fbc00 con 0x5625d846b280 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.443+0000 7fa5deffd640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d846b280 0x5625d846d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5be7fc640 10 client.5094 ms_handle_connect on v2:172.21.15.94:6834/2889518527 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5deffd640 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d846b280 0x5625d846d670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e936d0e278291c server_cookie=a03414eaf5c4bccd in_seq=0 out_seq=0 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5be7fc640 1 -- 172.21.15.94:0/640394950 <== mds.0 v2:172.21.15.94:6834/2889518527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625d81fbc00 con 0x5625d846b280 2024-09-11T23:16:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5be7fc640 10 client.5094 handle_command_reply: tid=0 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 client.5094 shutdown 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 msgr2=0x5625d8417e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d8417e50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0020040 tx=0x7fa5d0004740 comp rx=0 tx=0).stop 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 shutdown_connections 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d846b280 0x5625d846d670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d841e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d845d440 0x5625d841dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 --2- 172.21.15.94:0/640394950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d8417e50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 >> 172.21.15.94:0/640394950 conn(0x5625d8413290 msgr2=0x5625d8411d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5be7fc640 0 client.5094 ms_handle_reset on v2:172.21.15.94:6834/2889518527 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 shutdown_connections 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 1 -- 172.21.15.94:0/640394950 wait complete. 2024-09-11T23:16:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.447+0000 7fa5e9296000 20 client.5094 trim_cache size 0 max 16384 2024-09-11T23:16:23.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 Processor -- start 2024-09-11T23:16:23.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 -- start start 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d845bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d8418390 0x5625d845c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d845cb20 0x5625d846d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0200a10 con 0x5625d8418390 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0136fa0 con 0x5625d8413290 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e02004f0 con 0x5625d845cb20 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d8418390 0x5625d845c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d8418390 0x5625d845c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48046/0 (socket says 172.21.15.94:48046) 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 -- 172.21.15.94:0/786359851 learned_addr learned my addr 172.21.15.94:0/786359851 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d845bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 -- 172.21.15.94:0/786359851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d845cb20 msgr2=0x5625d846d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d845cb20 0x5625d846d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 -- 172.21.15.94:0/786359851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 msgr2=0x5625d845bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d845bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 -- 172.21.15.94:0/786359851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d81e8fd0 con 0x5625d8418390 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.463+0000 7fa5deffd640 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d8418390 0x5625d845c1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4007e70 tx=0x7fa5d4004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6c12e598e98958 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5c4ff9640 1 -- 172.21.15.94:0/786359851 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4018940 con 0x5625d8418390 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5c4ff9640 1 -- 172.21.15.94:0/786359851 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d4018ae0 con 0x5625d8418390 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5c4ff9640 1 -- 172.21.15.94:0/786359851 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4018cd0 con 0x5625d8418390 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/786359851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d8418390 msgr2=0x5625d845c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d8418390 0x5625d845c1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4007e70 tx=0x7fa5d4004da0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/786359851 shutdown_connections 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d845cb20 0x5625d846d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d8418390 0x5625d845c1d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- 172.21.15.94:0/786359851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d845bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/786359851 >> 172.21.15.94:0/786359851 conn(0x5625d8468270 msgr2=0x5625d8417650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/786359851 shutdown_connections 2024-09-11T23:16:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/786359851 wait complete. 2024-09-11T23:16:23.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- start start 2024-09-11T23:16:23.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 Processor -- start 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d8470120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d8494170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d84946b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5625d8260f80 con 0x5625d845cb20 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5625d8219ca0 con 0x5625d8413290 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5625d82662a0 con 0x5625d8418390 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 10 client.0 _ll_register_callbacks cb 0x7fa5d000da60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d84946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d84946b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48062/0 (socket says 172.21.15.94:48062) 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 -- 172.21.15.94:0/1080486921 learned_addr learned my addr 172.21.15.94:0/1080486921 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5deffd640 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d8494170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d8470120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 -- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 msgr2=0x5625d8494170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d8494170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 -- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 msgr2=0x5625d8470120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d8470120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 -- 172.21.15.94:0/1080486921 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d82e4750 con 0x5625d845cb20 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5dffff640 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d84946b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa5d801cf20 tx=0x7fa5d80ace40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e25e3f3ba9b381d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 1 -- 172.21.15.94:0/1080486921 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80f18d0 con 0x5625d845cb20 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 1 -- 172.21.15.94:0/1080486921 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa5d80f9bc0 con 0x5625d845cb20 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5d4018ae0 con 0x5625d845cb20 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 1 -- 172.21.15.94:0/1080486921 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fa5d811f050 con 0x5625d845cb20 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 10 client.5100 fetch_fsmap learned FSMap version 15 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5625d81efa30 con 0x5625d845cb20 2024-09-11T23:16:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 1 -- 172.21.15.94:0/1080486921 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d4018ae0 con 0x5625d845cb20 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 1 -- 172.21.15.94:0/1080486921 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fa5d81091d0 con 0x5625d845cb20 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 10 client.5100 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 10 client.5100 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 20 client.5100 populate_metadata read hostname 'smithi094' 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d845d440 0x5625d8494bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 4 client.5100 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 --> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] -- command(tid 0: {"prefix": "status"}) -- 0x5625d826f3a0 con 0x5625d845d440 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d845d440 0x5625d8494bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5df7fe640 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d845d440 0x5625d8494bf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9882217caceee70 server_cookie=a9c06ea48a40e45d in_seq=0 out_seq=0 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 10 client.5100 ms_handle_connect on v2:172.21.15.94:6834/2889518527 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 1 -- 172.21.15.94:0/1080486921 <== mds.0 v2:172.21.15.94:6834/2889518527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5625d826f3a0 con 0x5625d845d440 2024-09-11T23:16:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5be7fc640 10 client.5100 handle_command_reply: tid=0 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.467+0000 7fa5e9296000 1 client.5100 shutdown 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 msgr2=0x5625d84946b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d84946b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa5d801cf20 tx=0x7fa5d80ace40 comp rx=0 tx=0).stop 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 shutdown_connections 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:6834/2889518527,v1:172.21.15.94:6835/2889518527] conn(0x5625d845d440 0x5625d8494bf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5625d845cb20 0x5625d84946b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5625d8418390 0x5625d8494170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5be7fc640 0 client.5100 ms_handle_reset on v2:172.21.15.94:6834/2889518527 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 --2- 172.21.15.94:0/1080486921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625d8413290 0x5625d8470120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 >> 172.21.15.94:0/1080486921 conn(0x5625d8468270 msgr2=0x5625d845ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 shutdown_connections 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 1 -- 172.21.15.94:0/1080486921 wait complete. 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e9296000 20 client.5100 trim_cache size 0 max 16384 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4902, 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:16:23.480 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:16:23.481 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 9.1422704160000006, 2024-09-11T23:16:23.481 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 15, 2024-09-11T23:16:23.481 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 39, 2024-09-11T23:16:23.481 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 39, 2024-09-11T23:16:23.481 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 16.069202085000001 2024-09-11T23:16:23.481 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5cc0678c0 msgr2=0x7fa5cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5cc0678c0 0x7fa5cc069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0006fd0 tx=0x7fa5d0008040 comp rx=0 tx=0).stop 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 msgr2=0x7fa5e013c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e013c530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa5d801a5e0 tx=0x7fa5d8019750 comp rx=0 tx=0).stop 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 shutdown_connections 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5cc0678c0 0x7fa5cc069d80 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0006fd0 tx=0x7fa5d0008040 comp rx=0 tx=0).stop 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e015bc80 0x7fa5e013c530 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5e00b51b0 0x7fa5e013bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 --2- 172.21.15.94:0/3725684800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5e00b3330 0x7fa5e015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 >> 172.21.15.94:0/3725684800 conn(0x7fa5e00b6870 msgr2=0x7fa5e00b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 shutdown_connections 2024-09-11T23:16:23.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.471+0000 7fa5e61da640 1 -- 172.21.15.94:0/3725684800 wait complete. 2024-09-11T23:16:23.489 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:16:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2ab90640 1 Processor -- start 2024-09-11T23:16:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2ab90640 1 -- start start 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2ab90640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e2406f010 0x7f0e24166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2ab90640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e240b3290 con 0x7f0e2415bec0 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2ab90640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e240b3570 con 0x7f0e2415c2a0 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2ab90640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0e240b3850 con 0x7f0e2406f010 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2892c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0e2415bec0 0x7f0e240ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:54430/0 (socket says 172.21.15.94:54430) 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2892c640 1 -- 172.21.15.94:0/634133380 learned_addr learned my addr 172.21.15.94:0/634133380 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2912d640 1 --2- 172.21.15.94:0/634133380 >> v2:172.21.15.94:3300/0 conn(0x7f0e2406f010 0x7f0e24166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e237fe640 1 -- 172.21.15.94:0/634133380 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700995816 0 0) 0x7f0e240b3290 con 0x7f0e2415bec0 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e237fe640 1 -- 172.21.15.94:0/634133380 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e10003530 con 0x7f0e2415bec0 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2912d640 1 -- 172.21.15.94:0/634133380 >> v1:172.21.15.155:6789/0 conn(0x7f0e2415c2a0 legacy=0x7f0e240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2912d640 1 -- 172.21.15.94:0/634133380 >> v1:172.21.15.94:6789/0 conn(0x7f0e2415bec0 legacy=0x7f0e240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2912d640 1 -- 172.21.15.94:0/634133380 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e240b3b30 con 0x7f0e2406f010 2024-09-11T23:16:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.591+0000 7f0e2912d640 1 --2- 172.21.15.94:0/634133380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e24166ff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009d90 tx=0x7f0e1c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb38a7101be19019 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e237fe640 1 -- 172.21.15.94:0/634133380 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0b2070 con 0x7f0e2406f010 2024-09-11T23:16:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e237fe640 1 -- 172.21.15.94:0/634133380 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1c0a5910 con 0x7f0e2406f010 2024-09-11T23:16:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e237fe640 1 -- 172.21.15.94:0/634133380 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0a5cc0 con 0x7f0e2406f010 2024-09-11T23:16:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- 172.21.15.94:0/634133380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 msgr2=0x7f0e24166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/634133380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e24166ff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009d90 tx=0x7f0e1c01c940 comp rx=0 tx=0).stop 2024-09-11T23:16:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- 172.21.15.94:0/634133380 shutdown_connections 2024-09-11T23:16:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/634133380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e24166ff0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- 172.21.15.94:0/634133380 >> 172.21.15.94:0/634133380 conn(0x7f0e240b1f90 msgr2=0x7f0e240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- 172.21.15.94:0/634133380 shutdown_connections 2024-09-11T23:16:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- 172.21.15.94:0/634133380 wait complete. 2024-09-11T23:16:23.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 Processor -- start 2024-09-11T23:16:23.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- start start 2024-09-11T23:16:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e2414c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e2415bec0 0x7f0e24152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e2415c2a0 0x7f0e241526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24169ed0 con 0x7f0e2406f010 2024-09-11T23:16:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24169d50 con 0x7f0e2415c2a0 2024-09-11T23:16:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2416a050 con 0x7f0e2415bec0 2024-09-11T23:16:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e2414c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e2414c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48078/0 (socket says 172.21.15.94:48078) 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 -- 172.21.15.94:0/2858410118 learned_addr learned my addr 172.21.15.94:0/2858410118 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2912d640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e2415c2a0 0x7f0e241526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e23fff640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e2415bec0 0x7f0e24152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 -- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e2415bec0 msgr2=0x7f0e24152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e2415bec0 0x7f0e24152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 -- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e2415c2a0 msgr2=0x7f0e241526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e2415c2a0 0x7f0e241526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 -- 172.21.15.94:0/2858410118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e24150620 con 0x7f0e2406f010 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2912d640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e2415c2a0 0x7f0e241526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2892c640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e2414c280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c4d0 tx=0x7f0e1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e217fa640 1 -- 172.21.15.94:0/2858410118 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14017070 con 0x7f0e2406f010 2024-09-11T23:16:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e217fa640 1 -- 172.21.15.94:0/2858410118 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e14005cf0 con 0x7f0e2406f010 2024-09-11T23:16:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e24150900 con 0x7f0e2406f010 2024-09-11T23:16:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e217fa640 1 -- 172.21.15.94:0/2858410118 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14007270 con 0x7f0e2406f010 2024-09-11T23:16:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.595+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2414c7c0 con 0x7f0e2406f010 2024-09-11T23:16:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.599+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e240b3290 con 0x7f0e2406f010 2024-09-11T23:16:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.599+0000 7f0e217fa640 1 -- 172.21.15.94:0/2858410118 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e1401a070 con 0x7f0e2406f010 2024-09-11T23:16:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.599+0000 7f0e217fa640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e040678c0 0x7f0e04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.599+0000 7f0e217fa640 1 -- 172.21.15.94:0/2858410118 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0e140850f0 con 0x7f0e2406f010 2024-09-11T23:16:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.599+0000 7f0e23fff640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e040678c0 0x7f0e04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.599+0000 7f0e23fff640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e040678c0 0x7f0e04069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c007fd0 tx=0x7f0e0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:23.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.603+0000 7f0e217fa640 1 -- 172.21.15.94:0/2858410118 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e140554e0 con 0x7f0e2406f010 2024-09-11T23:16:23.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.787+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0e2406fcd0 con 0x7f0e2406f010 2024-09-11T23:16:23.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.787+0000 7f0e217fa640 1 -- 172.21.15.94:0/2858410118 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f0e140597e0 con 0x7f0e2406f010 2024-09-11T23:16:23.791 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e040678c0 msgr2=0x7f0e04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e040678c0 0x7f0e04069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c007fd0 tx=0x7f0e0c009040 comp rx=0 tx=0).stop 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 msgr2=0x7f0e2414c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e2414c280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c4d0 tx=0x7f0e1400c990 comp rx=0 tx=0).stop 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 shutdown_connections 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e2415c2a0 0x7f0e241526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e2415bec0 0x7f0e24152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e040678c0 0x7f0e04069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 --2- 172.21.15.94:0/2858410118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2406f010 0x7f0e2414c280 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 >> 172.21.15.94:0/2858410118 conn(0x7f0e240b1f90 msgr2=0x7f0e240b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 shutdown_connections 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:23.791+0000 7f0e2ab90640 1 -- 172.21.15.94:0/2858410118 wait complete. 2024-09-11T23:16:23.809 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:16:23.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:16:23.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:16:23.812 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:16:23.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:23.812 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:16:23.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:16:23.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:16:23.812 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:16:23.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:23.813 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:16:23.819 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:16:23.819 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:16:23.819 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:16:23.819 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.819 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:23.820 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:16:23.821 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:16:23.822 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:16:23.822 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.822 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:16:23.822 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:16:23.822 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:16:23.822 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:23.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:23.823 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:16:23.869 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:16:23.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:23.871 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:16:23.921 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:16:23.923 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:16:23.923 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:16:23.923 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:16:23.923 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:16:23.923 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:16:23.923 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:16:24.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:16:24.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:24.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:24.042 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:16:24.090 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:16:24.090 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:16:24.090 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:16:24.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:24.090 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:16:24.146 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:16:24.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:16:24.146 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:24.193 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:16:24.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:16:24.194 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:24.241 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:16:24.299 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:16:24.350 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:16:24.351 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:16:24.352 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:16:24.353 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:16:24.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:24.354 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:16:24.402 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:16:24.402 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:16:24.451 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:16:24.465 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:16:24.514 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:16:24.515 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:16:24.516 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:16:24.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:24.517 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:16:24.531 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:16:24.527+0000 7f4ec65c2580 -1 init, newargv = 0x564fca0478f0 newargc=15 2024-09-11T23:16:24.531 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[38160]: starting ceph client 2024-09-11T23:16:24.536 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[38160]: starting fuse 2024-09-11T23:16:25.636 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:16:25.652 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:16:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:16:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:16:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:16:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:16:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:16:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:16:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:16:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:16:25.701 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:25.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:25.702 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:16:25.750 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:16:25.750 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:16:25.750 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:16:25.750 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:16:25.751 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:16:25.752 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:16:25.874 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.38160.asok 2024-09-11T23:16:25.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:25.886 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38160.asok 2024-09-11T23:16:25.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:25.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38160.asok status 2024-09-11T23:16:26.035 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:16:26.035 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:16:26.035 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:16:26.035 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:16:26.035 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:16:26.035 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "38160", 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5115, 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:16:26.036 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 5115 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2934871548 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:16:26.037 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2934871548 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.5115 192.168.0.1:0/2934871548", 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/2934871548", 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 15, 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 39, 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:16:26.038 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:16:26.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:26.049 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:16:26.049 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:26.056 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:16:26.056 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:26.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:26.057 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> subdir = "delete_me" 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> size = 1024 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> file_count = 1000 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> os.mkdir(os.path.join(mountpoint, subdir)) 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> for i in range(0, file_count): 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> filename = "{0}_{1}.bin".format(i, size) 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> with open(os.path.join(mountpoint, subdir, filename), '"'"'w'"'"') as f: 2024-09-11T23:16:26.110 DEBUG:teuthology.orchestra.run.smithi094:> f.write(size * '"'"'x'"'"') 2024-09-11T23:16:26.111 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:16:28.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:28.124 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:28.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.266+0000 7f546b15c640 1 Processor -- start 2024-09-11T23:16:28.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.266+0000 7f546b15c640 1 -- start start 2024-09-11T23:16:28.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f546b15c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54641520a0 0x7f546406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:28.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f546b15c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 0x7f546415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f546b15c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5464070250 con 0x7f546415f1d0 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f546b15c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f5464152480 con 0x7f54641520a0 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f546b15c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f54640aede0 con 0x7f546406fe50 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54641520a0 0x7f546406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54641520a0 0x7f546406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48084/0 (socket says 172.21.15.94:48084) 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 -- 172.21.15.94:0/1249929013 learned_addr learned my addr 172.21.15.94:0/1249929013 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5463fff640 1 --2- 172.21.15.94:0/1249929013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 0x7f546415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 -- 172.21.15.94:0/1249929013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 msgr2=0x7f546415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 --2- 172.21.15.94:0/1249929013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 0x7f546415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 -- 172.21.15.94:0/1249929013 >> v1:172.21.15.155:6789/0 conn(0x7f546415f1d0 legacy=0x7f5464071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:28.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 -- 172.21.15.94:0/1249929013 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546415fa10 con 0x7f54641520a0 2024-09-11T23:16:28.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f5468ef8640 1 --2- 172.21.15.94:0/1249929013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54641520a0 0x7f546406f910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5454009870 tx=0x7f545401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a19fe2958acf77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:28.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f54637fe640 1 -- 172.21.15.94:0/1249929013 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54540b1070 con 0x7f54641520a0 2024-09-11T23:16:28.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f54637fe640 1 -- 172.21.15.94:0/1249929013 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54540a8050 con 0x7f54641520a0 2024-09-11T23:16:28.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.270+0000 7f54637fe640 1 -- 172.21.15.94:0/1249929013 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54540ac860 con 0x7f54641520a0 2024-09-11T23:16:28.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/1249929013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54641520a0 msgr2=0x7f546406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:28.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 --2- 172.21.15.94:0/1249929013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54641520a0 0x7f546406f910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5454009870 tx=0x7f545401c500 comp rx=0 tx=0).stop 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/1249929013 shutdown_connections 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 --2- 172.21.15.94:0/1249929013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 0x7f546415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 --2- 172.21.15.94:0/1249929013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54641520a0 0x7f546406f910 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/1249929013 >> 172.21.15.94:0/1249929013 conn(0x7f54640b1f90 msgr2=0x7f54640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/1249929013 shutdown_connections 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/1249929013 wait complete. 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 Processor -- start 2024-09-11T23:16:28.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- start start 2024-09-11T23:16:28.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 0x7f5464146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:28.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54641520a0 0x7f54641f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:28.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546415f1d0 0x7f54640cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:28.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5464073d30 con 0x7f546415f1d0 2024-09-11T23:16:28.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5464073a50 con 0x7f54641520a0 2024-09-11T23:16:28.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f546415f680 con 0x7f546406fe50 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546415f1d0 0x7f54640cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546415f1d0 0x7f54640cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48098/0 (socket says 172.21.15.94:48098) 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 -- 172.21.15.94:0/2314073050 learned_addr learned my addr 172.21.15.94:0/2314073050 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 -- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 msgr2=0x7f5464146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f5463fff640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54641520a0 0x7f54641f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 0x7f5464146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 -- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54641520a0 msgr2=0x7f54641f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54641520a0 0x7f54641f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 -- 172.21.15.94:0/2314073050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54640cca60 con 0x7f546415f1d0 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54696f9640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546415f1d0 0x7f54640cf680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c780 tx=0x7f545c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54617fa640 1 -- 172.21.15.94:0/2314073050 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c004b70 con 0x7f546415f1d0 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54617fa640 1 -- 172.21.15.94:0/2314073050 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c004d10 con 0x7f546415f1d0 2024-09-11T23:16:28.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54641f5f60 con 0x7f546415f1d0 2024-09-11T23:16:28.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f54617fa640 1 -- 172.21.15.94:0/2314073050 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c00aa90 con 0x7f546415f1d0 2024-09-11T23:16:28.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546414a9c0 con 0x7f546415f1d0 2024-09-11T23:16:28.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.274+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546415ec90 con 0x7f546415f1d0 2024-09-11T23:16:28.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.278+0000 7f54617fa640 1 -- 172.21.15.94:0/2314073050 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f545c00ac30 con 0x7f546415f1d0 2024-09-11T23:16:28.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.278+0000 7f54617fa640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f54500678c0 0x7f5450069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:28.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.278+0000 7f54617fa640 1 -- 172.21.15.94:0/2314073050 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f545c0860b0 con 0x7f546415f1d0 2024-09-11T23:16:28.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.278+0000 7f5468ef8640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f54500678c0 0x7f5450069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:28.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.278+0000 7f5468ef8640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f54500678c0 0x7f5450069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f54540ae000 tx=0x7f5454004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:28.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.282+0000 7f54617fa640 1 -- 172.21.15.94:0/2314073050 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f545c020070 con 0x7f546415f1d0 2024-09-11T23:16:28.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.466+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f546406e540 con 0x7f546415f1d0 2024-09-11T23:16:28.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.466+0000 7f54617fa640 1 -- 172.21.15.94:0/2314073050 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f545c056a50 con 0x7f546415f1d0 2024-09-11T23:16:28.471 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:28.471 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:28.471 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f54500678c0 msgr2=0x7f5450069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f54500678c0 0x7f5450069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f54540ae000 tx=0x7f5454004740 comp rx=0 tx=0).stop 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546415f1d0 msgr2=0x7f54640cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546415f1d0 0x7f54640cf680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c780 tx=0x7f545c00cc40 comp rx=0 tx=0).stop 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 shutdown_connections 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f54500678c0 0x7f5450069d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546415f1d0 0x7f54640cf680 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54641520a0 0x7f54641f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 --2- 172.21.15.94:0/2314073050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f546406fe50 0x7f5464146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 >> 172.21.15.94:0/2314073050 conn(0x7f54640b1f90 msgr2=0x7f54640adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 shutdown_connections 2024-09-11T23:16:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28.470+0000 7f546b15c640 1 -- 172.21.15.94:0/2314073050 wait complete. 2024-09-11T23:16:28.488 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-11T23:16:28.942 INFO:teuthology.orchestra.run.smithi094.stdout:{"message":"","return_code":0} 2024-09-11T23:16:28.942 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T23:16:28.943 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:16:28.943 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:16:28.943 DEBUG:teuthology.orchestra.run.smithi094:> import stat 2024-09-11T23:16:28.943 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:16:28.943 DEBUG:teuthology.orchestra.run.smithi094:> print(os.stat("/home/ubuntu/cephtest/mnt.0/delete_me").st_ino) 2024-09-11T23:16:28.943 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:16:28.994 INFO:teuthology.orchestra.run.smithi094.stdout:1099511627776 2024-09-11T23:16:28.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:29.002 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-09-11T23:16:29.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.074+0000 7f0c59de7080 1 Processor -- start 2024-09-11T23:16:29.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.074+0000 7f0c59de7080 1 -- start start 2024-09-11T23:16:29.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c44003100 0x55f0ab1e4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab1c8910 0x55f0ab1ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0ab25b430 0x55f0ab25b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f0ab1e8930 con 0x55f0ab25b430 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0ab0ef1b0 con 0x55f0ab1c8910 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f0ab276c90 con 0x7f0c44003100 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0ab25b430 0x55f0ab25b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0ab25b430 0x55f0ab25b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48112/0 (socket says 172.21.15.94:48112) 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/3858076222 learned_addr learned my addr 172.21.15.94:0/3858076222 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c570f9640 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab1c8910 0x55f0ab1ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c578fa640 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c44003100 0x55f0ab1e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c44003100 msgr2=0x55f0ab1e4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c44003100 0x55f0ab1e4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab1c8910 msgr2=0x55f0ab1ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab1c8910 0x55f0ab1ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/3858076222 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0ab276f30 con 0x55f0ab25b430 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0ab25b430 0x55f0ab25b810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55f0ab18d0f0 tx=0x7f0c48001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccee6775bbde6b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c560f7640 1 -- 172.21.15.94:0/3858076222 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800eab0 con 0x55f0ab25b430 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c560f7640 1 -- 172.21.15.94:0/3858076222 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c48015020 con 0x55f0ab25b430 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c560f7640 1 -- 172.21.15.94:0/3858076222 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48010400 con 0x55f0ab25b430 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- 172.21.15.94:0/3858076222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0ab25b430 msgr2=0x55f0ab25b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0ab25b430 0x55f0ab25b810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55f0ab18d0f0 tx=0x7f0c48001800 comp rx=0 tx=0).stop 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- 172.21.15.94:0/3858076222 shutdown_connections 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0ab25b430 0x55f0ab25b810 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab1c8910 0x55f0ab1ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- 172.21.15.94:0/3858076222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c44003100 0x55f0ab1e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- 172.21.15.94:0/3858076222 >> 172.21.15.94:0/3858076222 conn(0x55f0ab1c9220 msgr2=0x55f0ab1e4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- 172.21.15.94:0/3858076222 shutdown_connections 2024-09-11T23:16:29.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- 172.21.15.94:0/3858076222 wait complete. 2024-09-11T23:16:29.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 Processor -- start 2024-09-11T23:16:29.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- start start 2024-09-11T23:16:29.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f0ab1c8910 0x55f0ab1c0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab25b430 0x55f0ab1e4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c44003100 0x55f0ab1e2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f0ab277470 con 0x7f0c44003100 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0ab2771d0 con 0x55f0ab25b430 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f0ab25bd50 con 0x55f0ab1c8910 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c44003100 0x55f0ab1e2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c44003100 0x55f0ab1e2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48124/0 (socket says 172.21.15.94:48124) 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/2718920247 learned_addr learned my addr 172.21.15.94:0/2718920247 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c570f9640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab25b430 0x55f0ab1e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c578fa640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f0ab1c8910 0x55f0ab1c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f0ab1c8910 msgr2=0x55f0ab1c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f0ab1c8910 0x55f0ab1c0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab25b430 msgr2=0x55f0ab1e4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:29.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0ab25b430 0x55f0ab1e4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 -- 172.21.15.94:0/2718920247 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0ab25a4c0 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c580fb640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c44003100 0x55f0ab1e2880 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55f0ab18a060 tx=0x7f0c48001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c550f5640 1 -- 172.21.15.94:0/2718920247 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48014040 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c550f5640 1 -- 172.21.15.94:0/2718920247 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4801a460 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0ab25a760 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c550f5640 1 -- 172.21.15.94:0/2718920247 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4801a830 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.078+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0ab25aca0 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c550f5640 1 -- 172.21.15.94:0/2718920247 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c4801a9d0 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c550f5640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0c380662a0 0x7f0c38068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c550f5640 1 -- 172.21.15.94:0/2718920247 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0c48089770 con 0x7f0c44003100 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x55f0ab1e2dc0 0x55f0ab30fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 --> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) -- 0x55f0ab2593a0 con 0x55f0ab1e2dc0 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c578fa640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0c380662a0 0x7f0c38068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c570f9640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x55f0ab1e2dc0 0x55f0ab30fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:29.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c578fa640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0c380662a0 0x7f0c38068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000a0d0 tx=0x7f0c5000a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:29.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c570f9640 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x55f0ab1e2dc0 0x55f0ab30fd10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:29.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c570f9640 1 -- 172.21.15.94:0/2718920247 <== osd.7 v2:172.21.15.155:6816/4208392943 1 ==== osd_op_reply(1 10000000000.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x7f0c400a9620 con 0x55f0ab1e2dc0 2024-09-11T23:16:29.091 INFO:teuthology.orchestra.run.smithi094.stdout:cephfs_metadata/10000000000.00000000 mtime 2024-09-11T23:16:28.000000+0000, size 0 2024-09-11T23:16:29.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x55f0ab1e2dc0 msgr2=0x55f0ab30fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:29.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x55f0ab1e2dc0 0x55f0ab30fd10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:29.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0c380662a0 msgr2=0x7f0c38068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0c380662a0 0x7f0c38068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000a0d0 tx=0x7f0c5000a040 comp rx=0 tx=0).stop 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c44003100 msgr2=0x55f0ab1e2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 --2- 172.21.15.94:0/2718920247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c44003100 0x55f0ab1e2880 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55f0ab18a060 tx=0x7f0c48001a50 comp rx=0 tx=0).stop 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c580fb640 1 -- 172.21.15.94:0/2718920247 reap_dead start 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 shutdown_connections 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.082+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 >> 172.21.15.94:0/2718920247 conn(0x55f0ab1c9220 msgr2=0x55f0ab1c9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.086+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 shutdown_connections 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:29.086+0000 7f0c59de7080 1 -- 172.21.15.94:0/2718920247 wait complete. 2024-09-11T23:16:29.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:29.093 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf delete_me) 2024-09-11T23:16:31.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:32.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c4381640 1 Processor -- start 2024-09-11T23:16:32.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c4381640 1 -- start start 2024-09-11T23:16:32.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c4381640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 0x7f29bc168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c4381640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29bc0d0300 con 0x7f29bc161a60 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c4381640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29bc0cfab0 con 0x7f29bc0d3060 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c4381640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29bc06e6c0 con 0x7f29bc0cf620 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c211d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f29bc161a60 0x7f29bc0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:38846/0 (socket says 172.21.15.94:38846) 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c211d640 1 -- 172.21.15.94:0/301897787 learned_addr learned my addr 172.21.15.94:0/301897787 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154629786 0 0) 0x7f29ac001120 con 0x7f29bc161a60 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a8003530 con 0x7f29bc161a60 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c291e640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 0x7f29bc168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 713941473 0 0) 0x7f29a8003530 con 0x7f29bc161a60 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 msgr2=0x7f29bc168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 0x7f29bc168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 >> v1:172.21.15.155:6789/0 conn(0x7f29bc0d3060 legacy=0x7f29bc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29bc0b0f60 con 0x7f29bc161a60 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f29ac001850 con 0x7f29bc161a60 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 >> v1:172.21.15.94:6789/0 conn(0x7f29bc161a60 legacy=0x7f29bc0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29a80039f0 0x7f29a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 0x7f29a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc06e6c0 con 0x7f29a8004810 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8005530 con 0x7f29a80039f0 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29a800bf10 con 0x7f29bc0cf620 2024-09-11T23:16:32.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c191c640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c211d640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29a80039f0 0x7f29a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c291e640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 0x7f29a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c191c640 1 -- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 msgr2=0x7f29a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:32.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c191c640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc0cf620 0x7f29a800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c191c640 1 -- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29a80039f0 msgr2=0x7f29a8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:32.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c191c640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29a80039f0 0x7f29a8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.034+0000 7f29c191c640 1 -- 172.21.15.94:0/301897787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a8003530 con 0x7f29a8004810 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c191c640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29a8004c90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f29b8001780 tx=0x7f29b801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91f881405c24c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80013a0 con 0x7f29a8004810 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b80052f0 con 0x7f29a8004810 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c111b640 1 -- 172.21.15.94:0/301897787 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8003840 con 0x7f29a8004810 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- 172.21.15.94:0/301897787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 msgr2=0x7f29a8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 --2- 172.21.15.94:0/301897787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29a8004c90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f29b8001780 tx=0x7f29b801c3f0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c291e640 1 -- 172.21.15.94:0/301897787 reap_dead start 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- 172.21.15.94:0/301897787 shutdown_connections 2024-09-11T23:16:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- 172.21.15.94:0/301897787 >> 172.21.15.94:0/301897787 conn(0x7f29bc08bf90 msgr2=0x7f29bc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- 172.21.15.94:0/301897787 shutdown_connections 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- 172.21.15.94:0/301897787 wait complete. 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 Processor -- start 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- start start 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29bc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29bc15efd0 0x7f29bc15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc15ba30 0x7f29bc0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc169720 con 0x7f29a8004810 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc06d190 con 0x7f29bc15efd0 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c4381640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29bc1698a0 con 0x7f29bc15ba30 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29bc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29bc0cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34438/0 (socket says 172.21.15.94:34438) 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 -- 172.21.15.94:0/1641180175 learned_addr learned my addr 172.21.15.94:0/1641180175 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:32.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c191c640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29bc15efd0 0x7f29bc15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c291e640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc15ba30 0x7f29bc0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 -- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc15ba30 msgr2=0x7f29bc0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc15ba30 0x7f29bc0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 -- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29bc15efd0 msgr2=0x7f29bc15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29bc15efd0 0x7f29bc15b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c211d640 1 -- 172.21.15.94:0/1641180175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29bc0b8040 con 0x7f29a8004810 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c191c640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29bc15efd0 0x7f29bc15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:32.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.038+0000 7f29c291e640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc15ba30 0x7f29bc0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:32.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29c211d640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29bc0cd1b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f29ac007360 tx=0x7f29ac007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29b2ffd640 1 -- 172.21.15.94:0/1641180175 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00e6e0 con 0x7f29a8004810 2024-09-11T23:16:32.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29b2ffd640 1 -- 172.21.15.94:0/1641180175 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac018070 con 0x7f29a8004810 2024-09-11T23:16:32.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29bc0b8320 con 0x7f29a8004810 2024-09-11T23:16:32.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29b2ffd640 1 -- 172.21.15.94:0/1641180175 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00eac0 con 0x7f29a8004810 2024-09-11T23:16:32.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29bc0b88e0 con 0x7f29a8004810 2024-09-11T23:16:32.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29bc0cef10 con 0x7f29a8004810 2024-09-11T23:16:32.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29b2ffd640 1 -- 172.21.15.94:0/1641180175 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29ac00ec60 con 0x7f29a8004810 2024-09-11T23:16:32.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29b2ffd640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29a00678c0 0x7f29a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29b2ffd640 1 -- 172.21.15.94:0/1641180175 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f29ac086870 con 0x7f29a8004810 2024-09-11T23:16:32.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29c191c640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29a00678c0 0x7f29a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.042+0000 7f29c191c640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29a00678c0 0x7f29a0069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29b8001750 tx=0x7f29b80011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.046+0000 7f29b2ffd640 1 -- 172.21.15.94:0/1641180175 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29bc0d0300 con 0x7f29a8004810 2024-09-11T23:16:32.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.230+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29bc15be10 con 0x7f29a8004810 2024-09-11T23:16:32.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.230+0000 7f29b2ffd640 1 -- 172.21.15.94:0/1641180175 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f29ac057300 con 0x7f29a8004810 2024-09-11T23:16:32.235 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:32.235 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:32.236 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:32.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29a00678c0 msgr2=0x7f29a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29a00678c0 0x7f29a0069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29b8001750 tx=0x7f29b80011a0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 msgr2=0x7f29bc0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29bc0cd1b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f29ac007360 tx=0x7f29ac007820 comp rx=0 tx=0).stop 2024-09-11T23:16:32.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 shutdown_connections 2024-09-11T23:16:32.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29bc15ba30 0x7f29bc0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29bc15efd0 0x7f29bc15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29a00678c0 0x7f29a0069d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 --2- 172.21.15.94:0/1641180175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29a8004810 0x7f29bc0cd1b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 >> 172.21.15.94:0/1641180175 conn(0x7f29bc08bf90 msgr2=0x7f29bc0b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:32.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 shutdown_connections 2024-09-11T23:16:32.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.234+0000 7f29c4381640 1 -- 172.21.15.94:0/1641180175 wait complete. 2024-09-11T23:16:32.253 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-11T23:16:32.609 INFO:teuthology.orchestra.run.smithi094.stdout:{"message":"","return_code":0} 2024-09-11T23:16:32.609 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T23:16:32.609 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:32.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.714+0000 7f4c24059640 1 Processor -- start 2024-09-11T23:16:32.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.714+0000 7f4c24059640 1 -- start start 2024-09-11T23:16:32.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c24059640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c1c15bec0 0x7f4c1c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c24059640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c1c15c2a0 0x7f4c1c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c24059640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c0af2a0 0x7f4c1c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c24059640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4c1c0b3290 con 0x7f4c1c15bec0 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c24059640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4c1c0b3570 con 0x7f4c1c15c2a0 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c24059640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1c0b3850 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c1c15bec0 0x7f4c1c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c1c15bec0 0x7f4c1c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34452/0 (socket says 172.21.15.94:34452) 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 -- 172.21.15.94:0/61095393 learned_addr learned my addr 172.21.15.94:0/61095393 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c225f6640 1 --2- 172.21.15.94:0/61095393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c0af2a0 0x7f4c1c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c215f4640 1 --2- 172.21.15.94:0/61095393 >> v2:172.21.15.155:3300/0 conn(0x7f4c1c15c2a0 0x7f4c1c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 -- 172.21.15.94:0/61095393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c0af2a0 msgr2=0x7f4c1c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 --2- 172.21.15.94:0/61095393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c0af2a0 0x7f4c1c15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 -- 172.21.15.94:0/61095393 >> v2:172.21.15.155:3300/0 conn(0x7f4c1c15c2a0 msgr2=0x7f4c1c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 --2- 172.21.15.94:0/61095393 >> v2:172.21.15.155:3300/0 conn(0x7f4c1c15c2a0 0x7f4c1c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 -- 172.21.15.94:0/61095393 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c0b3b30 con 0x7f4c1c15bec0 2024-09-11T23:16:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c215f4640 1 --2- 172.21.15.94:0/61095393 >> v2:172.21.15.155:3300/0 conn(0x7f4c1c15c2a0 0x7f4c1c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.718+0000 7f4c21df5640 1 --2- 172.21.15.94:0/61095393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c15bec0 0x7f4c1c0ad200 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0ae510 tx=0x7f4c1801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a03122cf752f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c20df3640 1 -- 172.21.15.94:0/61095393 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c180b0070 con 0x7f4c1c15bec0 2024-09-11T23:16:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c20df3640 1 -- 172.21.15.94:0/61095393 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c180ab600 con 0x7f4c1c15bec0 2024-09-11T23:16:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c20df3640 1 -- 172.21.15.94:0/61095393 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c180ab9d0 con 0x7f4c1c15bec0 2024-09-11T23:16:32.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- 172.21.15.94:0/61095393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c15bec0 msgr2=0x7f4c1c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 --2- 172.21.15.94:0/61095393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c15bec0 0x7f4c1c0ad200 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0ae510 tx=0x7f4c1801c230 comp rx=0 tx=0).stop 2024-09-11T23:16:32.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- 172.21.15.94:0/61095393 shutdown_connections 2024-09-11T23:16:32.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 --2- 172.21.15.94:0/61095393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c0af2a0 0x7f4c1c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 --2- 172.21.15.94:0/61095393 >> v2:172.21.15.155:3300/0 conn(0x7f4c1c15c2a0 0x7f4c1c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 --2- 172.21.15.94:0/61095393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c15bec0 0x7f4c1c0ad200 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- 172.21.15.94:0/61095393 >> 172.21.15.94:0/61095393 conn(0x7f4c1c0b1f90 msgr2=0x7f4c1c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:32.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- 172.21.15.94:0/61095393 shutdown_connections 2024-09-11T23:16:32.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- 172.21.15.94:0/61095393 wait complete. 2024-09-11T23:16:32.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 Processor -- start 2024-09-11T23:16:32.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- start start 2024-09-11T23:16:32.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c0af2a0 0x7f4c1c153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c15bec0 0x7f4c1c1480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c1c15c2a0 0x7f4c1c14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c0af6b0 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c0ad740 con 0x7f4c1c15c2a0 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1c06e000 con 0x7f4c1c15bec0 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c0af2a0 0x7f4c1c153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c0af2a0 0x7f4c1c153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34456/0 (socket says 172.21.15.94:34456) 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 -- 172.21.15.94:0/1242888912 learned_addr learned my addr 172.21.15.94:0/1242888912 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c215f4640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c15bec0 0x7f4c1c1480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c225f6640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c1c15c2a0 0x7f4c1c14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 -- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c15bec0 msgr2=0x7f4c1c1480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c15bec0 0x7f4c1c1480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 -- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c1c15c2a0 msgr2=0x7f4c1c14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c1c15c2a0 0x7f4c1c14e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 -- 172.21.15.94:0/1242888912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c148950 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c225f6640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c1c15c2a0 0x7f4c1c14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c21df5640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c0af2a0 0x7f4c1c153de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4c180ae040 tx=0x7f4c1801aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c127fc640 1 -- 172.21.15.94:0/1242888912 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c180ba020 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c127fc640 1 -- 172.21.15.94:0/1242888912 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c180b6620 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1c148c30 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c127fc640 1 -- 172.21.15.94:0/1242888912 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c180b0040 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.722+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1c1491f0 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.726+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1c0ad200 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.726+0000 7f4c127fc640 1 -- 172.21.15.94:0/1242888912 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c180bd020 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.726+0000 7f4c127fc640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c000678c0 0x7f4c00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.726+0000 7f4c127fc640 1 -- 172.21.15.94:0/1242888912 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4c18120150 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.726+0000 7f4c215f4640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c000678c0 0x7f4c00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.726+0000 7f4c215f4640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c000678c0 0x7f4c00069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c006fd0 tx=0x7f4c0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.730+0000 7f4c127fc640 1 -- 172.21.15.94:0/1242888912 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c180c4030 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.926+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c1c06fcd0 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.926+0000 7f4c127fc640 1 -- 172.21.15.94:0/1242888912 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f4c18016110 con 0x7f4c1c0af2a0 2024-09-11T23:16:32.931 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:32.931 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:32.932 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c000678c0 msgr2=0x7f4c00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c000678c0 0x7f4c00069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c006fd0 tx=0x7f4c0c008040 comp rx=0 tx=0).stop 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c0af2a0 msgr2=0x7f4c1c153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c0af2a0 0x7f4c1c153de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4c180ae040 tx=0x7f4c1801aa70 comp rx=0 tx=0).stop 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 shutdown_connections 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c1c15c2a0 0x7f4c1c14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c1c15bec0 0x7f4c1c1480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c000678c0 0x7f4c00069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 --2- 172.21.15.94:0/1242888912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c1c0af2a0 0x7f4c1c153de0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 >> 172.21.15.94:0/1242888912 conn(0x7f4c1c0b1f90 msgr2=0x7f4c1c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:32.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 shutdown_connections 2024-09-11T23:16:32.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:32.930+0000 7f4c24059640 1 -- 172.21.15.94:0/1242888912 wait complete. 2024-09-11T23:16:32.950 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache strays_created 2024-09-11T23:16:33.089 INFO:teuthology.orchestra.run.smithi094.stdout:{"mds_cache":{"strays_created":1001}} 2024-09-11T23:16:33.089 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_created": 1001 } } 2024-09-11T23:16:33.090 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:33.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbdb08a640 1 Processor -- start 2024-09-11T23:16:33.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbdb08a640 1 -- start start 2024-09-11T23:16:33.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbdb08a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffbd415c2a0 0x7ffbd40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:33.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbdb08a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffbd40af2a0 0x7ffbd406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:33.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbdb08a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd40b3290 con 0x7ffbd415bec0 2024-09-11T23:16:33.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbdb08a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd40b3570 con 0x7ffbd40af2a0 2024-09-11T23:16:33.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbdb08a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd40b3850 con 0x7ffbd415c2a0 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd9627640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffbd40af2a0 0x7ffbd406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd9627640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffbd40af2a0 0x7ffbd406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34466/0 (socket says 172.21.15.94:34466) 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd9627640 1 -- 172.21.15.94:0/50641080 learned_addr learned my addr 172.21.15.94:0/50641080 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd3fff640 1 --2- 172.21.15.94:0/50641080 >> v2:172.21.15.155:3300/0 conn(0x7ffbd415c2a0 0x7ffbd40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd9627640 1 -- 172.21.15.94:0/50641080 >> v2:172.21.15.155:3300/0 conn(0x7ffbd415c2a0 msgr2=0x7ffbd40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd9627640 1 --2- 172.21.15.94:0/50641080 >> v2:172.21.15.155:3300/0 conn(0x7ffbd415c2a0 0x7ffbd40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd9627640 1 -- 172.21.15.94:0/50641080 >> v1:172.21.15.155:6789/0 conn(0x7ffbd415bec0 legacy=0x7ffbd40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:33.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.206+0000 7ffbd9627640 1 -- 172.21.15.94:0/50641080 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd40b3b30 con 0x7ffbd40af2a0 2024-09-11T23:16:33.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd9627640 1 --2- 172.21.15.94:0/50641080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd40af2a0 0x7ffbd406e000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40ae510 tx=0x7ffbcc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6b4a763c2201e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:33.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd37fe640 1 -- 172.21.15.94:0/50641080 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0a5880 con 0x7ffbd40af2a0 2024-09-11T23:16:33.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd37fe640 1 -- 172.21.15.94:0/50641080 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0a5a20 con 0x7ffbd40af2a0 2024-09-11T23:16:33.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd37fe640 1 -- 172.21.15.94:0/50641080 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0a5df0 con 0x7ffbd40af2a0 2024-09-11T23:16:33.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- 172.21.15.94:0/50641080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd40af2a0 msgr2=0x7ffbd406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/50641080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd40af2a0 0x7ffbd406e000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40ae510 tx=0x7ffbcc01c9c0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- 172.21.15.94:0/50641080 shutdown_connections 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/50641080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd40af2a0 0x7ffbd406e000 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/50641080 >> v2:172.21.15.155:3300/0 conn(0x7ffbd415c2a0 0x7ffbd40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- 172.21.15.94:0/50641080 >> 172.21.15.94:0/50641080 conn(0x7ffbd40b1f90 msgr2=0x7ffbd40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- 172.21.15.94:0/50641080 shutdown_connections 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- 172.21.15.94:0/50641080 wait complete. 2024-09-11T23:16:33.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 Processor -- start 2024-09-11T23:16:33.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- start start 2024-09-11T23:16:33.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbd40af2a0 0x7ffbd414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd415bec0 0x7ffbd4163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbd415c2a0 0x7ffbd4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd406ed50 con 0x7ffbd415bec0 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd40af710 con 0x7ffbd40af2a0 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbdb08a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd406eed0 con 0x7ffbd415c2a0 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd415bec0 0x7ffbd4163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd415bec0 0x7ffbd4163fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34468/0 (socket says 172.21.15.94:34468) 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 -- 172.21.15.94:0/1787624086 learned_addr learned my addr 172.21.15.94:0/1787624086 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd8e26640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbd40af2a0 0x7ffbd414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 -- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbd415c2a0 msgr2=0x7ffbd4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd9627640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbd415c2a0 0x7ffbd4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbd415c2a0 0x7ffbd4155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 -- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbd40af2a0 msgr2=0x7ffbd414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbd40af2a0 0x7ffbd414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 -- 172.21.15.94:0/1787624086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd4156480 con 0x7ffbd415bec0 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd8e26640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbd40af2a0 0x7ffbd414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.210+0000 7ffbd3fff640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd415bec0 0x7ffbd4163fe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800d7d0 tx=0x7ffbc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd17fa640 1 -- 172.21.15.94:0/1787624086 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800b6c0 con 0x7ffbd415bec0 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd17fa640 1 -- 172.21.15.94:0/1787624086 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc8019070 con 0x7ffbd415bec0 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd4157ad0 con 0x7ffbd415bec0 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd17fa640 1 -- 172.21.15.94:0/1787624086 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800ba80 con 0x7ffbd415bec0 2024-09-11T23:16:33.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd4158090 con 0x7ffbd415bec0 2024-09-11T23:16:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd406f260 con 0x7ffbd415bec0 2024-09-11T23:16:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd17fa640 1 -- 172.21.15.94:0/1787624086 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffbc800bc20 con 0x7ffbd415bec0 2024-09-11T23:16:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd17fa640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffbc00678c0 0x7ffbc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd17fa640 1 -- 172.21.15.94:0/1787624086 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ffbc80861b0 con 0x7ffbd415bec0 2024-09-11T23:16:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd8e26640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffbc00678c0 0x7ffbc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:33.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.214+0000 7ffbd8e26640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffbc00678c0 0x7ffbc0069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40016f0 tx=0x7ffbc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:33.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.218+0000 7ffbd17fa640 1 -- 172.21.15.94:0/1787624086 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffbc8056bf0 con 0x7ffbd415bec0 2024-09-11T23:16:33.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.454+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbd406fcd0 con 0x7ffbd415bec0 2024-09-11T23:16:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:33.463 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:33.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.458+0000 7ffbd17fa640 1 -- 172.21.15.94:0/1787624086 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7ffbc80564f0 con 0x7ffbd415bec0 2024-09-11T23:16:33.464 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffbc00678c0 msgr2=0x7ffbc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffbc00678c0 0x7ffbc0069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40016f0 tx=0x7ffbc4009040 comp rx=0 tx=0).stop 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd415bec0 msgr2=0x7ffbd4163fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd415bec0 0x7ffbd4163fe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800d7d0 tx=0x7ffbc800dc90 comp rx=0 tx=0).stop 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 shutdown_connections 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbd415c2a0 0x7ffbd4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffbc00678c0 0x7ffbc0069d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffbd415bec0 0x7ffbd4163fe0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 --2- 172.21.15.94:0/1787624086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbd40af2a0 0x7ffbd414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:33.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 >> 172.21.15.94:0/1787624086 conn(0x7ffbd40b1f90 msgr2=0x7ffbd41599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:33.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 shutdown_connections 2024-09-11T23:16:33.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:33.462+0000 7ffbdb08a640 1 -- 172.21.15.94:0/1787624086 wait complete. 2024-09-11T23:16:33.496 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache strays_enqueued 2024-09-11T23:16:33.631 INFO:teuthology.orchestra.run.smithi094.stdout:{"mds_cache":{"strays_enqueued":427}} 2024-09-11T23:16:33.631 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 427 } } 2024-09-11T23:16:33.632 DEBUG:tasks.ceph_test_case:wait_until_equal: 427 != 1001, waiting (timeout=600)... 2024-09-11T23:16:38.633 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f96883640 1 Processor -- start 2024-09-11T23:16:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f96883640 1 -- start start 2024-09-11T23:16:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f96883640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f96883640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f9006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f96883640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f900b3290 con 0x7f4f9015c2a0 2024-09-11T23:16:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f96883640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4f900b3570 con 0x7f4f9015bec0 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f96883640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f900b3850 con 0x7f4f900af470 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f8ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f8ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34484/0 (socket says 172.21.15.94:34484) 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f8ffff640 1 -- 172.21.15.94:0/806483894 learned_addr learned my addr 172.21.15.94:0/806483894 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f94e20640 1 --2- 172.21.15.94:0/806483894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f9006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f8ffff640 1 -- 172.21.15.94:0/806483894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 msgr2=0x7f4f9006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f8ffff640 1 --2- 172.21.15.94:0/806483894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f9006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f8ffff640 1 -- 172.21.15.94:0/806483894 >> v1:172.21.15.155:6789/0 conn(0x7f4f9015c2a0 legacy=0x7f4f900aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.758+0000 7f4f8ffff640 1 -- 172.21.15.94:0/806483894 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f900b3b30 con 0x7f4f9015bec0 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f8ffff640 1 --2- 172.21.15.94:0/806483894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015bec0 0x7f4f900ad200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009870 tx=0x7f4f8001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f02f138985f5e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f8effd640 1 -- 172.21.15.94:0/806483894 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f800ab620 con 0x7f4f9015bec0 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f8effd640 1 -- 172.21.15.94:0/806483894 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f800b0070 con 0x7f4f9015bec0 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f8effd640 1 -- 172.21.15.94:0/806483894 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f800ab9e0 con 0x7f4f9015bec0 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- 172.21.15.94:0/806483894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015bec0 msgr2=0x7f4f900ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 --2- 172.21.15.94:0/806483894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015bec0 0x7f4f900ad200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009870 tx=0x7f4f8001c460 comp rx=0 tx=0).stop 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- 172.21.15.94:0/806483894 shutdown_connections 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 --2- 172.21.15.94:0/806483894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f9006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 --2- 172.21.15.94:0/806483894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- 172.21.15.94:0/806483894 >> 172.21.15.94:0/806483894 conn(0x7f4f900b1f90 msgr2=0x7f4f900b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- 172.21.15.94:0/806483894 shutdown_connections 2024-09-11T23:16:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- 172.21.15.94:0/806483894 wait complete. 2024-09-11T23:16:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 Processor -- start 2024-09-11T23:16:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- start start 2024-09-11T23:16:38.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f901559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9015bec0 0x7f4f90149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015c2a0 0x7f4f90150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9006ed50 con 0x7f4f9015c2a0 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f900ad740 con 0x7f4f9015bec0 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f96883640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9006eed0 con 0x7f4f900af470 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f94e20640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015c2a0 0x7f4f90150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f94e20640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015c2a0 0x7f4f90150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34492/0 (socket says 172.21.15.94:34492) 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.762+0000 7f4f94e20640 1 -- 172.21.15.94:0/2704361558 learned_addr learned my addr 172.21.15.94:0/2704361558 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8f7fe640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9015bec0 0x7f4f90149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8ffff640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f901559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f94e20640 1 -- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 msgr2=0x7f4f901559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f94e20640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f901559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f94e20640 1 -- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9015bec0 msgr2=0x7f4f90149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f94e20640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9015bec0 0x7f4f90149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f94e20640 1 -- 172.21.15.94:0/2704361558 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9014a8e0 con 0x7f4f9015c2a0 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8ffff640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f901559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f94e20640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015c2a0 0x7f4f90150570 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800cda0 tx=0x7f4f8800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8cff9640 1 -- 172.21.15.94:0/2704361558 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88003ba0 con 0x7f4f9015c2a0 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8cff9640 1 -- 172.21.15.94:0/2704361558 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f88003d40 con 0x7f4f9015c2a0 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9014abc0 con 0x7f4f9015c2a0 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8cff9640 1 -- 172.21.15.94:0/2704361558 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88004240 con 0x7f4f9015c2a0 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9014b180 con 0x7f4f9015c2a0 2024-09-11T23:16:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9006e000 con 0x7f4f9015c2a0 2024-09-11T23:16:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8cff9640 1 -- 172.21.15.94:0/2704361558 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f880043e0 con 0x7f4f9015c2a0 2024-09-11T23:16:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8cff9640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8cff9640 1 -- 172.21.15.94:0/2704361558 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4f88086920 con 0x7f4f9015c2a0 2024-09-11T23:16:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8ffff640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.766+0000 7f4f8ffff640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f7c0678c0 0x7f4f7c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f800af000 tx=0x7f4f80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.770+0000 7f4f8cff9640 1 -- 172.21.15.94:0/2704361558 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f880572d0 con 0x7f4f9015c2a0 2024-09-11T23:16:38.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.966+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f9006fcd0 con 0x7f4f9015c2a0 2024-09-11T23:16:38.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f8cff9640 1 -- 172.21.15.94:0/2704361558 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f4f88056bd0 con 0x7f4f9015c2a0 2024-09-11T23:16:38.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:38.973 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:38.974 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:38.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f7c0678c0 msgr2=0x7f4f7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f7c0678c0 0x7f4f7c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f800af000 tx=0x7f4f80008040 comp rx=0 tx=0).stop 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015c2a0 msgr2=0x7f4f90150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015c2a0 0x7f4f90150570 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800cda0 tx=0x7f4f8800a660 comp rx=0 tx=0).stop 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 shutdown_connections 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f9015c2a0 0x7f4f90150570 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9015bec0 0x7f4f90149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 --2- 172.21.15.94:0/2704361558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f900af470 0x7f4f901559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 >> 172.21.15.94:0/2704361558 conn(0x7f4f900b1f90 msgr2=0x7f4f90074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 shutdown_connections 2024-09-11T23:16:38.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:38.970+0000 7f4f96883640 1 -- 172.21.15.94:0/2704361558 wait complete. 2024-09-11T23:16:38.993 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache strays_enqueued 2024-09-11T23:16:39.132 INFO:teuthology.orchestra.run.smithi094.stdout:{"mds_cache":{"strays_enqueued":1001}} 2024-09-11T23:16:39.132 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 1001 } } 2024-09-11T23:16:39.133 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:39.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f5644a33640 1 Processor -- start 2024-09-11T23:16:39.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f5644a33640 1 -- start start 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f5644a33640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f56400cf620 0x7f5640168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f5644a33640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56400d0300 con 0x7f56400d3060 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f5644a33640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f564006e6c0 con 0x7f5640161a60 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f5644a33640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f56400cfa90 con 0x7f56400cf620 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563dd9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f56400d3060 0x7f56400cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:38854/0 (socket says 172.21.15.94:38854) 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563dd9b640 1 -- 172.21.15.94:0/4168104395 learned_addr learned my addr 172.21.15.94:0/4168104395 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563ed9d640 1 --2- 172.21.15.94:0/4168104395 >> v2:172.21.15.94:3300/0 conn(0x7f56400cf620 0x7f5640168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563d59a640 1 -- 172.21.15.94:0/4168104395 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282861882 0 0) 0x7f5634001120 con 0x7f56400d3060 2024-09-11T23:16:39.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563d59a640 1 -- 172.21.15.94:0/4168104395 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5628003530 con 0x7f56400d3060 2024-09-11T23:16:39.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563ed9d640 1 -- 172.21.15.94:0/4168104395 >> v1:172.21.15.155:6789/0 conn(0x7f5640161a60 legacy=0x7f56400d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563ed9d640 1 -- 172.21.15.94:0/4168104395 >> v1:172.21.15.94:6789/0 conn(0x7f56400d3060 legacy=0x7f56400cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563ed9d640 1 -- 172.21.15.94:0/4168104395 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56400b0f60 con 0x7f56400cf620 2024-09-11T23:16:39.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.246+0000 7f563ed9d640 1 --2- 172.21.15.94:0/4168104395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640168f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5638009d90 tx=0x7f563801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506955d4255fa45c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563d59a640 1 -- 172.21.15.94:0/4168104395 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380b2070 con 0x7f56400cf620 2024-09-11T23:16:39.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563d59a640 1 -- 172.21.15.94:0/4168104395 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56380a5970 con 0x7f56400cf620 2024-09-11T23:16:39.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563d59a640 1 -- 172.21.15.94:0/4168104395 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380a5d20 con 0x7f56400cf620 2024-09-11T23:16:39.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- 172.21.15.94:0/4168104395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 msgr2=0x7f5640168f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 --2- 172.21.15.94:0/4168104395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640168f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5638009d90 tx=0x7f563801c8b0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- 172.21.15.94:0/4168104395 shutdown_connections 2024-09-11T23:16:39.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 --2- 172.21.15.94:0/4168104395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640168f10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- 172.21.15.94:0/4168104395 >> 172.21.15.94:0/4168104395 conn(0x7f564008bf90 msgr2=0x7f564009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:39.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- 172.21.15.94:0/4168104395 shutdown_connections 2024-09-11T23:16:39.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- 172.21.15.94:0/4168104395 wait complete. 2024-09-11T23:16:39.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 Processor -- start 2024-09-11T23:16:39.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- start start 2024-09-11T23:16:39.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56400d3060 0x7f56400cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5640161a60 0x7f56400cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f564016bc70 con 0x7f56400cf620 2024-09-11T23:16:39.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f564006d190 con 0x7f5640161a60 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f564016bdf0 con 0x7f56400d3060 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34500/0 (socket says 172.21.15.94:34500) 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 -- 172.21.15.94:0/2275673563 learned_addr learned my addr 172.21.15.94:0/2275673563 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563ed9d640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5640161a60 0x7f56400cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563dd9b640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56400d3060 0x7f56400cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 -- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56400d3060 msgr2=0x7f56400cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56400d3060 0x7f56400cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 -- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5640161a60 msgr2=0x7f56400cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5640161a60 0x7f56400cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 -- 172.21.15.94:0/2275673563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5640157e20 con 0x7f56400cf620 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f563e59c640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640149890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f563000c370 tx=0x7f563000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f562effd640 1 -- 172.21.15.94:0/2275673563 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300052d0 con 0x7f56400cf620 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f562effd640 1 -- 172.21.15.94:0/2275673563 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630005470 con 0x7f56400cf620 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5640158100 con 0x7f56400cf620 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f562effd640 1 -- 172.21.15.94:0/2275673563 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630007260 con 0x7f56400cf620 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.250+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56401586c0 con 0x7f56400cf620 2024-09-11T23:16:39.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.254+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56400cef10 con 0x7f56400cf620 2024-09-11T23:16:39.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.254+0000 7f562effd640 1 -- 172.21.15.94:0/2275673563 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5630007400 con 0x7f56400cf620 2024-09-11T23:16:39.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.254+0000 7f562effd640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56200678c0 0x7f5620069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.254+0000 7f562effd640 1 -- 172.21.15.94:0/2275673563 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f56300852a0 con 0x7f56400cf620 2024-09-11T23:16:39.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.254+0000 7f563dd9b640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56200678c0 0x7f5620069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.254+0000 7f563dd9b640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56200678c0 0x7f5620069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56340012c0 tx=0x7f5634009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.258+0000 7f562effd640 1 -- 172.21.15.94:0/2275673563 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5630055c50 con 0x7f56400cf620 2024-09-11T23:16:39.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.450+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56400d24e0 con 0x7f56400cf620 2024-09-11T23:16:39.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.450+0000 7f562effd640 1 -- 172.21.15.94:0/2275673563 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f56300850c0 con 0x7f56400cf620 2024-09-11T23:16:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:39.456 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:39.456 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56200678c0 msgr2=0x7f5620069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56200678c0 0x7f5620069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56340012c0 tx=0x7f5634009040 comp rx=0 tx=0).stop 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 msgr2=0x7f5640149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640149890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f563000c370 tx=0x7f563000c830 comp rx=0 tx=0).stop 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 shutdown_connections 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5640161a60 0x7f56400cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56400d3060 0x7f56400cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56200678c0 0x7f5620069d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 --2- 172.21.15.94:0/2275673563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400cf620 0x7f5640149890 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 >> 172.21.15.94:0/2275673563 conn(0x7f564008bf90 msgr2=0x7f56400d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:39.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 shutdown_connections 2024-09-11T23:16:39.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.454+0000 7f5644a33640 1 -- 172.21.15.94:0/2275673563 wait complete. 2024-09-11T23:16:39.474 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump purge_queue pq_executed 2024-09-11T23:16:39.606 INFO:teuthology.orchestra.run.smithi094.stdout:{"purge_queue":{"pq_executed":1001}} 2024-09-11T23:16:39.606 DEBUG:tasks.cephfs.filesystem:_json_asok output { "purge_queue": { "pq_executed": 1001 } } 2024-09-11T23:16:39.607 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-09-11T23:16:39.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 Processor -- start 2024-09-11T23:16:39.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- start start 2024-09-11T23:16:39.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 0x560df7793510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7705dd0 0x560df778e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7790bb0 0x560df783f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x560df7706550 con 0x560df7790bb0 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560df76241b0 con 0x560df7705dd0 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x560df77067f0 con 0x560df76d31d0 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7790bb0 0x560df783f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7790bb0 0x560df783f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34508/0 (socket says 172.21.15.94:34508) 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 -- 172.21.15.94:0/1901346818 learned_addr learned my addr 172.21.15.94:0/1901346818 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a1fad640 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7705dd0 0x560df778e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a27ae640 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 0x560df7793510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 -- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 msgr2=0x560df7793510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 0x560df7793510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 -- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7705dd0 msgr2=0x560df778e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7705dd0 0x560df778e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 -- 172.21.15.94:0/1901346818 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df76f8dc0 con 0x560df7790bb0 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a1fad640 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7705dd0 0x560df778e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a2faf640 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7790bb0 0x560df783f470 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1194001700 tx=0x7f1194001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881c51f1d6209b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a0fab640 1 -- 172.21.15.94:0/1901346818 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194004530 con 0x560df7790bb0 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a0fab640 1 -- 172.21.15.94:0/1901346818 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11940046d0 con 0x560df7790bb0 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a0fab640 1 -- 172.21.15.94:0/1901346818 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194004a80 con 0x560df7790bb0 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1901346818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7790bb0 msgr2=0x560df783f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7790bb0 0x560df783f470 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1194001700 tx=0x7f1194001bc0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1901346818 shutdown_connections 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7790bb0 0x560df783f470 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7705dd0 0x560df778e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1901346818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 0x560df7793510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1901346818 >> 172.21.15.94:0/1901346818 conn(0x560df76d3dc0 msgr2=0x560df7792e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:39.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1901346818 shutdown_connections 2024-09-11T23:16:39.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.638+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1901346818 wait complete. 2024-09-11T23:16:39.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 Processor -- start 2024-09-11T23:16:39.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 -- start start 2024-09-11T23:16:39.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 0x560df783e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7705dd0 0x560df778d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7790bb0 0x560df77a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x560df7790080 con 0x560df7705dd0 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560df778fde0 con 0x560df7790bb0 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x560df778ed30 con 0x560df76d31d0 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7705dd0 0x560df778d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7705dd0 0x560df778d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34510/0 (socket says 172.21.15.94:34510) 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 -- 172.21.15.94:0/1519844314 learned_addr learned my addr 172.21.15.94:0/1519844314 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a2faf640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7790bb0 0x560df77a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a27ae640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 0x560df783e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 -- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 msgr2=0x560df783e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560df76d31d0 0x560df783e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 -- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7790bb0 msgr2=0x560df77a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560df7790bb0 0x560df77a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 -- 172.21.15.94:0/1519844314 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df783ed60 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a1fad640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7705dd0 0x560df778d740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f118c0089e0 tx=0x7f118c008ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f119b7fe640 1 -- 172.21.15.94:0/1519844314 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c006e70 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f119b7fe640 1 -- 172.21.15.94:0/1519844314 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118c019070 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560df76fa610 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f119b7fe640 1 -- 172.21.15.94:0/1519844314 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c014630 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df76fab50 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f119b7fe640 1 -- 172.21.15.94:0/1519844314 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f118c0147d0 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f119b7fe640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11840662d0 0x7f1184068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.642+0000 7f119b7fe640 1 -- 172.21.15.94:0/1519844314 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f118c085280 con 0x560df7705dd0 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x560df778dc80 0x560df76fddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 --> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) -- 0x560df76fe310 con 0x560df778dc80 2024-09-11T23:16:39.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a27ae640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11840662d0 0x7f1184068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a2faf640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x560df778dc80 0x560df76fddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a27ae640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11840662d0 0x7f1184068790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f119c0ac000 tx=0x7f119c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a2faf640 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x560df778dc80 0x560df76fddd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a2faf640 1 -- 172.21.15.94:0/1519844314 <== osd.7 v2:172.21.15.155:6816/4208392943 1 ==== osd_op_reply(1 10000000000.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f119401b040 con 0x560df778dc80 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr: error stat-ing cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x560df778dc80 msgr2=0x560df76fddd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x560df778dc80 0x560df76fddd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11840662d0 msgr2=0x7f1184068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11840662d0 0x7f1184068790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f119c0ac000 tx=0x7f119c0a5000 comp rx=0 tx=0).stop 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7705dd0 msgr2=0x560df778d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 --2- 172.21.15.94:0/1519844314 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560df7705dd0 0x560df778d740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f118c0089e0 tx=0x7f118c008ea0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a2faf640 1 -- 172.21.15.94:0/1519844314 reap_dead start 2024-09-11T23:16:39.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 shutdown_connections 2024-09-11T23:16:39.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 >> 172.21.15.94:0/1519844314 conn(0x560df76d3dc0 msgr2=0x560df778f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:39.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 shutdown_connections 2024-09-11T23:16:39.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.646+0000 7f11a4c9b080 1 -- 172.21.15.94:0/1519844314 wait complete. 2024-09-11T23:16:39.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:16:39.656 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-11T23:16:39.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.806+0000 7fd5300d3640 1 Processor -- start 2024-09-11T23:16:39.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.806+0000 7fd5300d3640 1 -- start start 2024-09-11T23:16:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd5300d3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd52806f010 0x7fd528166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd5300d3640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5280b3290 con 0x7fd52815bec0 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd5300d3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5280b3570 con 0x7fd52815c2a0 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd5300d3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd5280b3850 con 0x7fd52806f010 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52de6f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd52815bec0 0x7fd5280ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:38858/0 (socket says 172.21.15.94:38858) 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52de6f640 1 -- 172.21.15.94:0/2957603146 learned_addr learned my addr 172.21.15.94:0/2957603146 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52e670640 1 --2- 172.21.15.94:0/2957603146 >> v2:172.21.15.94:3300/0 conn(0x7fd52806f010 0x7fd528166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52ce6d640 1 -- 172.21.15.94:0/2957603146 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869260829 0 0) 0x7fd5280b3290 con 0x7fd52815bec0 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52ce6d640 1 -- 172.21.15.94:0/2957603146 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd514003530 con 0x7fd52815bec0 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52e670640 1 -- 172.21.15.94:0/2957603146 >> v1:172.21.15.155:6789/0 conn(0x7fd52815c2a0 legacy=0x7fd5280aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52e670640 1 -- 172.21.15.94:0/2957603146 >> v1:172.21.15.94:6789/0 conn(0x7fd52815bec0 legacy=0x7fd5280ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52e670640 1 -- 172.21.15.94:0/2957603146 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5280b3b30 con 0x7fd52806f010 2024-09-11T23:16:39.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52e670640 1 --2- 172.21.15.94:0/2957603146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528166ff0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd520009d90 tx=0x7fd52001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be13d10a15b59cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52ce6d640 1 -- 172.21.15.94:0/2957603146 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5200b2070 con 0x7fd52806f010 2024-09-11T23:16:39.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52ce6d640 1 -- 172.21.15.94:0/2957603146 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5200a5910 con 0x7fd52806f010 2024-09-11T23:16:39.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.810+0000 7fd52ce6d640 1 -- 172.21.15.94:0/2957603146 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5200a5cc0 con 0x7fd52806f010 2024-09-11T23:16:39.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2957603146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 msgr2=0x7fd528166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2957603146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528166ff0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd520009d90 tx=0x7fd52001c940 comp rx=0 tx=0).stop 2024-09-11T23:16:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2957603146 shutdown_connections 2024-09-11T23:16:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2957603146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528166ff0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2957603146 >> 172.21.15.94:0/2957603146 conn(0x7fd5280b1f90 msgr2=0x7fd5280b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2957603146 shutdown_connections 2024-09-11T23:16:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2957603146 wait complete. 2024-09-11T23:16:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 Processor -- start 2024-09-11T23:16:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- start start 2024-09-11T23:16:39.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd52815bec0 0x7fd5281522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd52815c2a0 0x7fd52815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd528169ed0 con 0x7fd52806f010 2024-09-11T23:16:39.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd528169d50 con 0x7fd52815c2a0 2024-09-11T23:16:39.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd52816a050 con 0x7fd52815bec0 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34530/0 (socket says 172.21.15.94:34530) 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 -- 172.21.15.94:0/2282246273 learned_addr learned my addr 172.21.15.94:0/2282246273 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52e670640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd52815c2a0 0x7fd52815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 -- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd52815bec0 msgr2=0x7fd5281522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52d66e640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd52815bec0 0x7fd5281522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd52815bec0 0x7fd5281522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 -- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd52815c2a0 msgr2=0x7fd52815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd52815c2a0 0x7fd52815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 -- 172.21.15.94:0/2282246273 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5281555e0 con 0x7fd52806f010 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52e670640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd52815c2a0 0x7fd52815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd52de6f640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528152a90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c4d0 tx=0x7fd51800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd51e7fc640 1 -- 172.21.15.94:0/2282246273 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518017070 con 0x7fd52806f010 2024-09-11T23:16:39.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd51e7fc640 1 -- 172.21.15.94:0/2282246273 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd518005cf0 con 0x7fd52806f010 2024-09-11T23:16:39.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5281580b0 con 0x7fd52806f010 2024-09-11T23:16:39.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd51e7fc640 1 -- 172.21.15.94:0/2282246273 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518007270 con 0x7fd52806f010 2024-09-11T23:16:39.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd528158670 con 0x7fd52806f010 2024-09-11T23:16:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.814+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5280b3290 con 0x7fd52806f010 2024-09-11T23:16:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.818+0000 7fd51e7fc640 1 -- 172.21.15.94:0/2282246273 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd51801a070 con 0x7fd52806f010 2024-09-11T23:16:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.818+0000 7fd51e7fc640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd50c0678c0 0x7fd50c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.818+0000 7fd51e7fc640 1 -- 172.21.15.94:0/2282246273 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd518085110 con 0x7fd52806f010 2024-09-11T23:16:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.818+0000 7fd52d66e640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd50c0678c0 0x7fd50c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.818+0000 7fd52d66e640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd50c0678c0 0x7fd50c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd524007fd0 tx=0x7fd524009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:39.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:39.822+0000 7fd51e7fc640 1 -- 172.21.15.94:0/2282246273 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd518055470 con 0x7fd52806f010 2024-09-11T23:16:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7fd528167270 con 0x7fd52806f010 2024-09-11T23:16:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd51e7fc640 1 -- 172.21.15.94:0/2282246273 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1658 (secure 0 0 0) 0x7fd518059770 con 0x7fd52806f010 2024-09-11T23:16:40.043 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:40.043 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:16:40.043 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_bytes": 773094113280, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_avail_bytes": 772810481664, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_bytes": 283631616, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_bytes": 283631616, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_ratio": 0.00036687852116301656, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "num_osds": 8, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "num_per_pool_osds": 8, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "num_per_pool_omap_osds": 8 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "stats_by_class": { 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "ssd": { 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_bytes": 773094113280, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_avail_bytes": 772810481664, 2024-09-11T23:16:40.044 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_bytes": 283631616, 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_bytes": 283631616, 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_ratio": 0.00036687852116301656 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "pools": [ 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "name": ".mgr", 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 1, 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "stored": 590368, 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "objects": 2, 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "kb_used": 1160, 2024-09-11T23:16:40.045 INFO:teuthology.orchestra.run.smithi094.stdout: "bytes_used": 1187840, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "percent_used": 1.6180497368623037e-06, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "max_avail": 367058583552 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cephfs_metadata", 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "stored": 3141055, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "objects": 23, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "kb_used": 6192, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "bytes_used": 6340608, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "percent_used": 8.6369773271144368e-06, 2024-09-11T23:16:40.046 INFO:teuthology.orchestra.run.smithi094.stdout: "max_avail": 367058583552 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cephfs_data", 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6, 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "stored": 0, 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "objects": 0, 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "kb_used": 0, 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "bytes_used": 0, 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "percent_used": 0, 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: "max_avail": 367058583552 2024-09-11T23:16:40.047 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:40.048 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:40.048 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:16:40.048 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd50c0678c0 msgr2=0x7fd50c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd50c0678c0 0x7fd50c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd524007fd0 tx=0x7fd524009040 comp rx=0 tx=0).stop 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 msgr2=0x7fd528152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528152a90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c4d0 tx=0x7fd51800c990 comp rx=0 tx=0).stop 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 shutdown_connections 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd52815c2a0 0x7fd52815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd52815bec0 0x7fd5281522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd50c0678c0 0x7fd50c069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 --2- 172.21.15.94:0/2282246273 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd52806f010 0x7fd528152a90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 >> 172.21.15.94:0/2282246273 conn(0x7fd5280b1f90 msgr2=0x7fd52815a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 shutdown_connections 2024-09-11T23:16:40.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.038+0000 7fd5300d3640 1 -- 172.21.15.94:0/2282246273 wait complete. 2024-09-11T23:16:40.060 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-11T23:16:40.060 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:16:40.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:16:40.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:16:40.138 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:16:40.138 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:16:40.138 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:16:40.138 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:40.145 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:16:40.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.306+0000 7ffa9cb6b640 1 Processor -- start 2024-09-11T23:16:40.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.306+0000 7ffa9cb6b640 1 -- start start 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9cb6b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa9815bec0 0x7ffa980ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9cb6b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa9815c2a0 0x7ffa980aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9cb6b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa980b3290 con 0x7ffa980af2a0 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9cb6b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ffa980b3570 con 0x7ffa9815c2a0 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9cb6b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffa980b3850 con 0x7ffa9815bec0 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa9815c2a0 0x7ffa980aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa9815c2a0 0x7ffa980aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39028/0 (socket says 172.21.15.94:39028) 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 -- 172.21.15.94:0/2854721688 learned_addr learned my addr 172.21.15.94:0/2854721688 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9659c640 1 --2- 172.21.15.94:0/2854721688 >> v2:172.21.15.155:3300/0 conn(0x7ffa9815bec0 0x7ffa980ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 -- 172.21.15.94:0/2854721688 >> v2:172.21.15.155:3300/0 conn(0x7ffa9815bec0 msgr2=0x7ffa980ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 --2- 172.21.15.94:0/2854721688 >> v2:172.21.15.155:3300/0 conn(0x7ffa9815bec0 0x7ffa980ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 -- 172.21.15.94:0/2854721688 >> v1:172.21.15.155:6789/0 conn(0x7ffa980af2a0 legacy=0x7ffa9815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 -- 172.21.15.94:0/2854721688 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa980b3b30 con 0x7ffa9815c2a0 2024-09-11T23:16:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa95d9b640 1 --2- 172.21.15.94:0/2854721688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815c2a0 0x7ffa980aed60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffa98071710 tx=0x7ffa8c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951d468d1592f041 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9559a640 1 -- 172.21.15.94:0/2854721688 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0aa610 con 0x7ffa9815c2a0 2024-09-11T23:16:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9559a640 1 -- 172.21.15.94:0/2854721688 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0af070 con 0x7ffa9815c2a0 2024-09-11T23:16:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.310+0000 7ffa9559a640 1 -- 172.21.15.94:0/2854721688 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0aa9d0 con 0x7ffa9815c2a0 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/2854721688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815c2a0 msgr2=0x7ffa980aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/2854721688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815c2a0 0x7ffa980aed60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffa98071710 tx=0x7ffa8c01c4b0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/2854721688 shutdown_connections 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/2854721688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815c2a0 0x7ffa980aed60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/2854721688 >> v2:172.21.15.155:3300/0 conn(0x7ffa9815bec0 0x7ffa980ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/2854721688 >> 172.21.15.94:0/2854721688 conn(0x7ffa980b1f90 msgr2=0x7ffa980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/2854721688 shutdown_connections 2024-09-11T23:16:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/2854721688 wait complete. 2024-09-11T23:16:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 Processor -- start 2024-09-11T23:16:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- start start 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa980af2a0 0x7ffa9814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815bec0 0x7ffa98149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa9815c2a0 0x7ffa9815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffa980ad740 con 0x7ffa9815bec0 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa980af710 con 0x7ffa9815c2a0 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa98169000 con 0x7ffa980af2a0 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815bec0 0x7ffa98149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815bec0 0x7ffa98149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39036/0 (socket says 172.21.15.94:39036) 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 -- 172.21.15.94:0/3803462521 learned_addr learned my addr 172.21.15.94:0/3803462521 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9659c640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa980af2a0 0x7ffa9814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 -- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa980af2a0 msgr2=0x7ffa9814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa96d9d640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa9815c2a0 0x7ffa9815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa980af2a0 0x7ffa9814e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 -- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa9815c2a0 msgr2=0x7ffa9815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa9815c2a0 0x7ffa9815d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 -- 172.21.15.94:0/3803462521 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9815ac80 con 0x7ffa9815bec0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa95d9b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815bec0 0x7ffa98149040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c01a0e0 tx=0x7ffa8c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa86ffd640 1 -- 172.21.15.94:0/3803462521 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0b4610 con 0x7ffa9815bec0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa86ffd640 1 -- 172.21.15.94:0/3803462521 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0b47b0 con 0x7ffa9815bec0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa86ffd640 1 -- 172.21.15.94:0/3803462521 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0b4b80 con 0x7ffa9815bec0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9815e460 con 0x7ffa9815bec0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.314+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9815ea20 con 0x7ffa9815bec0 2024-09-11T23:16:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.318+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9815ec60 con 0x7ffa9815bec0 2024-09-11T23:16:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.318+0000 7ffa86ffd640 1 -- 172.21.15.94:0/3803462521 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa8c0bc020 con 0x7ffa9815bec0 2024-09-11T23:16:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.318+0000 7ffa86ffd640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa780678c0 0x7ffa78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.318+0000 7ffa86ffd640 1 -- 172.21.15.94:0/3803462521 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ffa8c120690 con 0x7ffa9815bec0 2024-09-11T23:16:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.318+0000 7ffa9659c640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa780678c0 0x7ffa78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.318+0000 7ffa9659c640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa780678c0 0x7ffa78069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa9815c760 tx=0x7ffa88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.322+0000 7ffa86ffd640 1 -- 172.21.15.94:0/3803462521 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa9815ec60 con 0x7ffa9815bec0 2024-09-11T23:16:40.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.482+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffa98149760 con 0x7ffa9815bec0 2024-09-11T23:16:40.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.482+0000 7ffa86ffd640 1 -- 172.21.15.94:0/3803462521 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7ffa8c0c3060 con 0x7ffa9815bec0 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa780678c0 msgr2=0x7ffa78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa780678c0 0x7ffa78069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa9815c760 tx=0x7ffa88008040 comp rx=0 tx=0).stop 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815bec0 msgr2=0x7ffa98149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815bec0 0x7ffa98149040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c01a0e0 tx=0x7ffa8c019250 comp rx=0 tx=0).stop 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 shutdown_connections 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa9815c2a0 0x7ffa9815d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa780678c0 0x7ffa78069d80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9815bec0 0x7ffa98149040 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 --2- 172.21.15.94:0/3803462521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa980af2a0 0x7ffa9814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 >> 172.21.15.94:0/3803462521 conn(0x7ffa980b1f90 msgr2=0x7ffa980b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 shutdown_connections 2024-09-11T23:16:40.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.486+0000 7ffa9cb6b640 1 -- 172.21.15.94:0/3803462521 wait complete. 2024-09-11T23:16:40.505 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:16:40.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:40.505 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:16:40.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[38160]: fuse finished with error 0 and tester_r 0 2024-09-11T23:16:40.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:16:40.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:40.518 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:16:40.683 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:16:40.684 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:16:40.684 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:40.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:16:40.690 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:16:40.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:40.691 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:16:40.736 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T23:16:40.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:16:40.737 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:16:40.737 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:16:40.737 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:40.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:16:40.744 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:16:40.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:40.744 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:16:40.793 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T23:16:40.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:16:40.794 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:16:40.794 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:16:40.794 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:40.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:16:40.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:16:40.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:40.800 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:16:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T23:16:40.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:16:40.850 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:40.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 Processor -- start 2024-09-11T23:16:40.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 -- start start 2024-09-11T23:16:40.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb741630c0 0x7feb7406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feb7406df70 0x7feb741634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb740b3290 0x7feb740b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7feb7406e470 con 0x7feb741630c0 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7feb7406e750 con 0x7feb7406df70 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb79aa6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb7406ea30 con 0x7feb740b3290 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb741630c0 0x7feb7406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb741630c0 0x7feb7406f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39044/0 (socket says 172.21.15.94:39044) 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb72ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feb7406df70 0x7feb741634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 -- 172.21.15.94:0/1226982875 learned_addr learned my addr 172.21.15.94:0/1226982875 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb73fff640 1 --2- 172.21.15.94:0/1226982875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb740b3290 0x7feb740b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 -- 172.21.15.94:0/1226982875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb740b3290 msgr2=0x7feb740b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 --2- 172.21.15.94:0/1226982875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb740b3290 0x7feb740b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 -- 172.21.15.94:0/1226982875 >> v2:172.21.15.155:3300/0 conn(0x7feb7406df70 msgr2=0x7feb741634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 --2- 172.21.15.94:0/1226982875 >> v2:172.21.15.155:3300/0 conn(0x7feb7406df70 0x7feb741634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.970+0000 7feb737fe640 1 -- 172.21.15.94:0/1226982875 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7406ed10 con 0x7feb741630c0 2024-09-11T23:16:40.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb737fe640 1 --2- 172.21.15.94:0/1226982875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb741630c0 0x7feb7406f510 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feb740cc950 tx=0x7feb6401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c10c5fd527752 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb727fc640 1 -- 172.21.15.94:0/1226982875 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640b0070 con 0x7feb741630c0 2024-09-11T23:16:40.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb727fc640 1 -- 172.21.15.94:0/1226982875 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb640ab600 con 0x7feb741630c0 2024-09-11T23:16:40.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb727fc640 1 -- 172.21.15.94:0/1226982875 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640ab9d0 con 0x7feb741630c0 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- 172.21.15.94:0/1226982875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb741630c0 msgr2=0x7feb7406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 --2- 172.21.15.94:0/1226982875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb741630c0 0x7feb7406f510 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feb740cc950 tx=0x7feb6401c520 comp rx=0 tx=0).stop 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- 172.21.15.94:0/1226982875 shutdown_connections 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 --2- 172.21.15.94:0/1226982875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb740b3290 0x7feb740b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 --2- 172.21.15.94:0/1226982875 >> v2:172.21.15.155:3300/0 conn(0x7feb7406df70 0x7feb741634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 --2- 172.21.15.94:0/1226982875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb741630c0 0x7feb7406f510 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- 172.21.15.94:0/1226982875 >> 172.21.15.94:0/1226982875 conn(0x7feb740b1f90 msgr2=0x7feb740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- 172.21.15.94:0/1226982875 shutdown_connections 2024-09-11T23:16:40.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- 172.21.15.94:0/1226982875 wait complete. 2024-09-11T23:16:40.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 Processor -- start 2024-09-11T23:16:40.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- start start 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7406df70 0x7feb7415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740b3290 0x7feb74164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741630c0 0x7feb741651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7feb74166250 con 0x7feb7406df70 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb7406fc60 con 0x7feb740b3290 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb79aa6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb741663d0 con 0x7feb741630c0 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7406df70 0x7feb7415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7406df70 0x7feb7415a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39058/0 (socket says 172.21.15.94:39058) 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.974+0000 7feb737fe640 1 -- 172.21.15.94:0/602379128 learned_addr learned my addr 172.21.15.94:0/602379128 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb737fe640 1 -- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741630c0 msgr2=0x7feb741651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb737fe640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741630c0 0x7feb741651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb737fe640 1 -- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740b3290 msgr2=0x7feb74164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb737fe640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740b3290 0x7feb74164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb737fe640 1 -- 172.21.15.94:0/602379128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7415e2c0 con 0x7feb7406df70 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb737fe640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7406df70 0x7feb7415a8d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb640ae040 tx=0x7feb6401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb5bfff640 1 -- 172.21.15.94:0/602379128 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640b0040 con 0x7feb7406df70 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb5bfff640 1 -- 172.21.15.94:0/602379128 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb640bc070 con 0x7feb7406df70 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7415d500 con 0x7feb7406df70 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb5bfff640 1 -- 172.21.15.94:0/602379128 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640b6680 con 0x7feb7406df70 2024-09-11T23:16:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7415dac0 con 0x7feb7406df70 2024-09-11T23:16:40.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb740b3720 con 0x7feb7406df70 2024-09-11T23:16:40.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb5bfff640 1 -- 172.21.15.94:0/602379128 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb640b6820 con 0x7feb7406df70 2024-09-11T23:16:40.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb5bfff640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb600678f0 0x7feb60069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb5bfff640 1 -- 172.21.15.94:0/602379128 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7feb64120070 con 0x7feb7406df70 2024-09-11T23:16:40.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb72ffd640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb600678f0 0x7feb60069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.978+0000 7feb72ffd640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb600678f0 0x7feb60069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb741fec30 tx=0x7feb68009520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:40.982+0000 7feb5bfff640 1 -- 172.21.15.94:0/602379128 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb64016110 con 0x7feb7406df70 2024-09-11T23:16:41.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.182+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb740ae290 con 0x7feb7406df70 2024-09-11T23:16:41.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.182+0000 7feb5bfff640 1 -- 172.21.15.94:0/602379128 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7feb640f0a20 con 0x7feb7406df70 2024-09-11T23:16:41.188 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:41.189 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:41.189 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb600678f0 msgr2=0x7feb60069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb600678f0 0x7feb60069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb741fec30 tx=0x7feb68009520 comp rx=0 tx=0).stop 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7406df70 msgr2=0x7feb7415a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7406df70 0x7feb7415a8d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb640ae040 tx=0x7feb6401ad60 comp rx=0 tx=0).stop 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 shutdown_connections 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741630c0 0x7feb741651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740b3290 0x7feb74164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feb600678f0 0x7feb60069db0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 --2- 172.21.15.94:0/602379128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7406df70 0x7feb7415a8d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 >> 172.21.15.94:0/602379128 conn(0x7feb740b1f90 msgr2=0x7feb740723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 shutdown_connections 2024-09-11T23:16:41.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.186+0000 7feb79aa6640 1 -- 172.21.15.94:0/602379128 wait complete. 2024-09-11T23:16:41.208 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:41.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.322+0000 7f7d88972640 1 Processor -- start 2024-09-11T23:16:41.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.322+0000 7f7d88972640 1 -- start start 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d88972640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7d840cdb00 0x7f7d840b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d88972640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d840b3ba0 con 0x7f7d840b3280 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d88972640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d840ce140 con 0x7f7d840cf1e0 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d88972640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7d840ce420 con 0x7f7d840cdb00 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d81d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7d840cdb00 0x7f7d840b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d81d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7d840cdb00 0x7f7d840b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39064/0 (socket says 172.21.15.94:39064) 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d81d9b640 1 -- 172.21.15.94:0/1387168669 learned_addr learned my addr 172.21.15.94:0/1387168669 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d81d9b640 1 -- 172.21.15.94:0/1387168669 >> v1:172.21.15.155:6789/0 conn(0x7f7d840cf1e0 legacy=0x7f7d8415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:41.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d8159a640 1 -- 172.21.15.94:0/1387168669 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296663885 0 0) 0x7f7d840b3ba0 con 0x7f7d840b3280 2024-09-11T23:16:41.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d81d9b640 1 -- 172.21.15.94:0/1387168669 >> v1:172.21.15.94:6789/0 conn(0x7f7d840b3280 legacy=0x7f7d8415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d81d9b640 1 -- 172.21.15.94:0/1387168669 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d840ce700 con 0x7f7d840cdb00 2024-09-11T23:16:41.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d81d9b640 1 --2- 172.21.15.94:0/1387168669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d840b3660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009870 tx=0x7f7d7401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b846b38f72552031 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d8159a640 1 -- 172.21.15.94:0/1387168669 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740b2070 con 0x7f7d840cdb00 2024-09-11T23:16:41.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d8159a640 1 -- 172.21.15.94:0/1387168669 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d740ad680 con 0x7f7d840cdb00 2024-09-11T23:16:41.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.326+0000 7f7d8159a640 1 -- 172.21.15.94:0/1387168669 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740ada50 con 0x7f7d840cdb00 2024-09-11T23:16:41.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- 172.21.15.94:0/1387168669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 msgr2=0x7f7d840b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 --2- 172.21.15.94:0/1387168669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d840b3660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009870 tx=0x7f7d7401c490 comp rx=0 tx=0).stop 2024-09-11T23:16:41.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- 172.21.15.94:0/1387168669 shutdown_connections 2024-09-11T23:16:41.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 --2- 172.21.15.94:0/1387168669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d840b3660 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- 172.21.15.94:0/1387168669 >> 172.21.15.94:0/1387168669 conn(0x7f7d840b6870 msgr2=0x7f7d840b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:41.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- 172.21.15.94:0/1387168669 shutdown_connections 2024-09-11T23:16:41.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- 172.21.15.94:0/1387168669 wait complete. 2024-09-11T23:16:41.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 Processor -- start 2024-09-11T23:16:41.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- start start 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d840b3280 0x7f7d8413a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d8414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d840cf1e0 0x7f7d840b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8415a060 con 0x7f7d840cdb00 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84159ee0 con 0x7f7d840b3280 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8416a4b0 con 0x7f7d840cf1e0 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d8414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d8414a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39080/0 (socket says 172.21.15.94:39080) 2024-09-11T23:16:41.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 -- 172.21.15.94:0/3317794532 learned_addr learned my addr 172.21.15.94:0/3317794532 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d8259c640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d840b3280 0x7f7d8413a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d82d9d640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d840cf1e0 0x7f7d840b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 -- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d840cf1e0 msgr2=0x7f7d840b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d840cf1e0 0x7f7d840b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 -- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d840b3280 msgr2=0x7f7d8413a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d840b3280 0x7f7d8413a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 -- 172.21.15.94:0/3317794532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8414b400 con 0x7f7d840cdb00 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d8259c640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d840b3280 0x7f7d8413a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d81d9b640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d8414a9d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7d740190a0 tx=0x7f7d7401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d72ffd640 1 -- 172.21.15.94:0/3317794532 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740bc020 con 0x7f7d840cdb00 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d72ffd640 1 -- 172.21.15.94:0/3317794532 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d740add80 con 0x7f7d840cdb00 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8414b6e0 con 0x7f7d840cdb00 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d72ffd640 1 -- 172.21.15.94:0/3317794532 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740b2040 con 0x7f7d840cdb00 2024-09-11T23:16:41.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.330+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8414bca0 con 0x7f7d840cdb00 2024-09-11T23:16:41.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.334+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d840b3660 con 0x7f7d840cdb00 2024-09-11T23:16:41.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.334+0000 7f7d72ffd640 1 -- 172.21.15.94:0/3317794532 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d740bf020 con 0x7f7d840cdb00 2024-09-11T23:16:41.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.334+0000 7f7d72ffd640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7d640678c0 0x7f7d64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.334+0000 7f7d72ffd640 1 -- 172.21.15.94:0/3317794532 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7d74120160 con 0x7f7d840cdb00 2024-09-11T23:16:41.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.334+0000 7f7d8259c640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7d640678c0 0x7f7d64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.334+0000 7f7d8259c640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7d640678c0 0x7f7d64069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7d8406d7d0 tx=0x7f7d78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.338+0000 7f7d72ffd640 1 -- 172.21.15.94:0/3317794532 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7d740c6030 con 0x7f7d840cdb00 2024-09-11T23:16:41.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.518+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d840b6df0 con 0x7f7d840cdb00 2024-09-11T23:16:41.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.518+0000 7f7d72ffd640 1 -- 172.21.15.94:0/3317794532 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f7d74016110 con 0x7f7d840cdb00 2024-09-11T23:16:41.525 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:41.525 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:41.526 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:41.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7d640678c0 msgr2=0x7f7d64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7d640678c0 0x7f7d64069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7d8406d7d0 tx=0x7f7d78009040 comp rx=0 tx=0).stop 2024-09-11T23:16:41.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 msgr2=0x7f7d8414a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d8414a9d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7d740190a0 tx=0x7f7d7401acd0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 shutdown_connections 2024-09-11T23:16:41.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d840cf1e0 0x7f7d840b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7d640678c0 0x7f7d64069d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d840cdb00 0x7f7d8414a9d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 --2- 172.21.15.94:0/3317794532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d840b3280 0x7f7d8413a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 >> 172.21.15.94:0/3317794532 conn(0x7f7d840b6870 msgr2=0x7f7d8406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:41.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 shutdown_connections 2024-09-11T23:16:41.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.522+0000 7f7d88972640 1 -- 172.21.15.94:0/3317794532 wait complete. 2024-09-11T23:16:41.542 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.642+0000 7f65874b1640 1 Processor -- start 2024-09-11T23:16:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.642+0000 7f65874b1640 1 -- start start 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f658015bec0 0x7f65800ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65800af2a0 0x7f658015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f65800b3290 con 0x7f65800af2a0 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f65800b3570 con 0x7f658015bec0 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65800b3850 con 0x7f658015c2a0 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65800af2a0 0x7f658015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65800af2a0 0x7f658015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39090/0 (socket says 172.21.15.94:39090) 2024-09-11T23:16:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 -- 172.21.15.94:0/72613228 learned_addr learned my addr 172.21.15.94:0/72613228 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f658524d640 1 --2- 172.21.15.94:0/72613228 >> v2:172.21.15.155:3300/0 conn(0x7f658015bec0 0x7f65800ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6584a4c640 1 --2- 172.21.15.94:0/72613228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 -- 172.21.15.94:0/72613228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 msgr2=0x7f65800aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 --2- 172.21.15.94:0/72613228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 -- 172.21.15.94:0/72613228 >> v2:172.21.15.155:3300/0 conn(0x7f658015bec0 msgr2=0x7f65800ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 --2- 172.21.15.94:0/72613228 >> v2:172.21.15.155:3300/0 conn(0x7f658015bec0 0x7f65800ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 -- 172.21.15.94:0/72613228 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65800b3b30 con 0x7f65800af2a0 2024-09-11T23:16:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f658524d640 1 --2- 172.21.15.94:0/72613228 >> v2:172.21.15.155:3300/0 conn(0x7f658015bec0 0x7f65800ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6585a4e640 1 --2- 172.21.15.94:0/72613228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65800af2a0 0x7f658015fc60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6580071710 tx=0x7f657801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef34d5dcaeb96ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6577fff640 1 -- 172.21.15.94:0/72613228 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780a5580 con 0x7f65800af2a0 2024-09-11T23:16:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6577fff640 1 -- 172.21.15.94:0/72613228 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780a5720 con 0x7f65800af2a0 2024-09-11T23:16:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f6577fff640 1 -- 172.21.15.94:0/72613228 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780a5af0 con 0x7f65800af2a0 2024-09-11T23:16:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- 172.21.15.94:0/72613228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65800af2a0 msgr2=0x7f658015fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 --2- 172.21.15.94:0/72613228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65800af2a0 0x7f658015fc60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6580071710 tx=0x7f657801c700 comp rx=0 tx=0).stop 2024-09-11T23:16:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- 172.21.15.94:0/72613228 shutdown_connections 2024-09-11T23:16:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 --2- 172.21.15.94:0/72613228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65800af2a0 0x7f658015fc60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 --2- 172.21.15.94:0/72613228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 --2- 172.21.15.94:0/72613228 >> v2:172.21.15.155:3300/0 conn(0x7f658015bec0 0x7f65800ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- 172.21.15.94:0/72613228 >> 172.21.15.94:0/72613228 conn(0x7f65800b1f90 msgr2=0x7f65800b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:41.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- 172.21.15.94:0/72613228 shutdown_connections 2024-09-11T23:16:41.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.646+0000 7f65874b1640 1 -- 172.21.15.94:0/72613228 wait complete. 2024-09-11T23:16:41.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 Processor -- start 2024-09-11T23:16:41.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 -- start start 2024-09-11T23:16:41.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65800af2a0 0x7f6580152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f658015bec0 0x7f6580147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65800ad740 con 0x7f658015bec0 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65800afc90 con 0x7f65800af2a0 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f658006e000 con 0x7f658015c2a0 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f658015bec0 0x7f6580147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f658015bec0 0x7f6580147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39096/0 (socket says 172.21.15.94:39096) 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 -- 172.21.15.94:0/1536937339 learned_addr learned my addr 172.21.15.94:0/1536937339 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6585a4e640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 -- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 msgr2=0x7f65800afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 -- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65800af2a0 msgr2=0x7f6580152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f658524d640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65800af2a0 0x7f6580152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65800af2a0 0x7f6580152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 -- 172.21.15.94:0/1536937339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6580149580 con 0x7f658015bec0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6585a4e640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f658524d640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65800af2a0 0x7f6580152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6584a4c640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f658015bec0 0x7f6580147a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f657c00d620 tx=0x7f657c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6575ffb640 1 -- 172.21.15.94:0/1536937339 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c00b620 con 0x7f658015bec0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6575ffb640 1 -- 172.21.15.94:0/1536937339 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657c019070 con 0x7f658015bec0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6580148200 con 0x7f658015bec0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6575ffb640 1 -- 172.21.15.94:0/1536937339 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c00b9e0 con 0x7f658015bec0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65801487c0 con 0x7f658015bec0 2024-09-11T23:16:41.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65800ad200 con 0x7f658015bec0 2024-09-11T23:16:41.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.650+0000 7f6575ffb640 1 -- 172.21.15.94:0/1536937339 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f657c00bb80 con 0x7f658015bec0 2024-09-11T23:16:41.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.654+0000 7f6575ffb640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65640678c0 0x7f6564069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.654+0000 7f6575ffb640 1 -- 172.21.15.94:0/1536937339 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f657c0861c0 con 0x7f658015bec0 2024-09-11T23:16:41.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.654+0000 7f658524d640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65640678c0 0x7f6564069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.654+0000 7f658524d640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65640678c0 0x7f6564069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6570009980 tx=0x7f6570008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.658+0000 7f6575ffb640 1 -- 172.21.15.94:0/1536937339 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6580149580 con 0x7f658015bec0 2024-09-11T23:16:41.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.806+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f658006fcd0 con 0x7f658015bec0 2024-09-11T23:16:41.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.806+0000 7f6575ffb640 1 -- 172.21.15.94:0/1536937339 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17026 (secure 0 0 0) 0x7f657c056b70 con 0x7f658015bec0 2024-09-11T23:16:41.814 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:41.814 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":39,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:16:15.330651+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.543946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:12.651996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:41.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65640678c0 msgr2=0x7f6564069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65640678c0 0x7f6564069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6570009980 tx=0x7f6570008040 comp rx=0 tx=0).stop 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f658015bec0 msgr2=0x7f6580147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f658015bec0 0x7f6580147a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f657c00d620 tx=0x7f657c00dae0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 shutdown_connections 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f658015c2a0 0x7f65800afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65640678c0 0x7f6564069d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f658015bec0 0x7f6580147a30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 --2- 172.21.15.94:0/1536937339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65800af2a0 0x7f6580152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 >> 172.21.15.94:0/1536937339 conn(0x7f65800b1f90 msgr2=0x7f6580159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 shutdown_connections 2024-09-11T23:16:41.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.810+0000 7f65874b1640 1 -- 172.21.15.94:0/1536937339 wait complete. 2024-09-11T23:16:41.831 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:16:41.832 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.942+0000 7f614dd59640 1 Processor -- start 2024-09-11T23:16:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f614dd59640 1 -- start start 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f614dd59640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6148161a60 0x7f61480d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f614dd59640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61480d2e90 0x7f61480cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f614dd59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480cf450 0x7f61480d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f614dd59640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f61480d32b0 con 0x7f6148161a60 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f614dd59640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f61480d0300 con 0x7f61480d2e90 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f614dd59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61480b0f60 con 0x7f61480cf450 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6148161a60 0x7f61480d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6148161a60 0x7f61480d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39106/0 (socket says 172.21.15.94:39106) 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 -- 172.21.15.94:0/4138827084 learned_addr learned my addr 172.21.15.94:0/4138827084 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f6146ffd640 1 --2- 172.21.15.94:0/4138827084 >> v2:172.21.15.155:3300/0 conn(0x7f61480d2e90 0x7f61480cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f6147fff640 1 --2- 172.21.15.94:0/4138827084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480cf450 0x7f61480d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 -- 172.21.15.94:0/4138827084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480cf450 msgr2=0x7f61480d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 --2- 172.21.15.94:0/4138827084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480cf450 0x7f61480d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 -- 172.21.15.94:0/4138827084 >> v2:172.21.15.155:3300/0 conn(0x7f61480d2e90 msgr2=0x7f61480cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 --2- 172.21.15.94:0/4138827084 >> v2:172.21.15.155:3300/0 conn(0x7f61480d2e90 0x7f61480cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 -- 172.21.15.94:0/4138827084 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61480cfd40 con 0x7f6148161a60 2024-09-11T23:16:41.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61477fe640 1 --2- 172.21.15.94:0/4138827084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f61480d2950 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f614808d850 tx=0x7f613801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6563c9ad6048ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61467fc640 1 -- 172.21.15.94:0/4138827084 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61380ab620 con 0x7f6148161a60 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.946+0000 7f61467fc640 1 -- 172.21.15.94:0/4138827084 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61380b0070 con 0x7f6148161a60 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f61467fc640 1 -- 172.21.15.94:0/4138827084 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61380ab9e0 con 0x7f6148161a60 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- 172.21.15.94:0/4138827084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 msgr2=0x7f61480d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 --2- 172.21.15.94:0/4138827084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f61480d2950 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f614808d850 tx=0x7f613801c460 comp rx=0 tx=0).stop 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- 172.21.15.94:0/4138827084 shutdown_connections 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 --2- 172.21.15.94:0/4138827084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480cf450 0x7f61480d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 --2- 172.21.15.94:0/4138827084 >> v2:172.21.15.155:3300/0 conn(0x7f61480d2e90 0x7f61480cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 --2- 172.21.15.94:0/4138827084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f61480d2950 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- 172.21.15.94:0/4138827084 >> 172.21.15.94:0/4138827084 conn(0x7f614808bf90 msgr2=0x7f614809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:41.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- 172.21.15.94:0/4138827084 shutdown_connections 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- 172.21.15.94:0/4138827084 wait complete. 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 Processor -- start 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- start start 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61480cf450 0x7f61480b9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480d2e90 0x7f614815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f6148156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f614806d830 con 0x7f6148161a60 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f614806d6b0 con 0x7f61480cf450 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f614806d9b0 con 0x7f61480d2e90 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f6148156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f6148156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39122/0 (socket says 172.21.15.94:39122) 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 -- 172.21.15.94:0/2018577475 learned_addr learned my addr 172.21.15.94:0/2018577475 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:41.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6146ffd640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480d2e90 0x7f614815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f61477fe640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61480cf450 0x7f61480b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 -- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480d2e90 msgr2=0x7f614815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480d2e90 0x7f614815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 -- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61480cf450 msgr2=0x7f61480b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61480cf450 0x7f61480b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 -- 172.21.15.94:0/2018577475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614815afd0 con 0x7f6148161a60 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f61477fe640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61480cf450 0x7f61480b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f6147fff640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f6148156120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6140007e60 tx=0x7f614000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f612ffff640 1 -- 172.21.15.94:0/2018577475 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140014620 con 0x7f6148161a60 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f612ffff640 1 -- 172.21.15.94:0/2018577475 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6140019070 con 0x7f6148161a60 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f612ffff640 1 -- 172.21.15.94:0/2018577475 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140014a20 con 0x7f6148161a60 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614815b2b0 con 0x7f6148161a60 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.950+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614815b870 con 0x7f6148161a60 2024-09-11T23:16:41.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.954+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61480cef10 con 0x7f6148161a60 2024-09-11T23:16:41.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.954+0000 7f612ffff640 1 -- 172.21.15.94:0/2018577475 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6140014bc0 con 0x7f6148161a60 2024-09-11T23:16:41.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.954+0000 7f612ffff640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:41.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.954+0000 7f612ffff640 1 -- 172.21.15.94:0/2018577475 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6140086600 con 0x7f6148161a60 2024-09-11T23:16:41.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.954+0000 7f61477fe640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:41.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.954+0000 7f61477fe640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61340678c0 0x7f6134069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f61380af000 tx=0x7f6138008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:41.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:41.958+0000 7f612ffff640 1 -- 172.21.15.94:0/2018577475 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6140057040 con 0x7f6148161a60 2024-09-11T23:16:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.154+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6148075780 con 0x7f6148161a60 2024-09-11T23:16:42.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.154+0000 7f612ffff640 1 -- 172.21.15.94:0/2018577475 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f6140056940 con 0x7f6148161a60 2024-09-11T23:16:42.160 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:42.160 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:42.160 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61340678c0 msgr2=0x7f6134069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61340678c0 0x7f6134069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f61380af000 tx=0x7f6138008040 comp rx=0 tx=0).stop 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 msgr2=0x7f6148156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f6148156120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6140007e60 tx=0x7f614000e4b0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 shutdown_connections 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6148161a60 0x7f6148156120 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61480d2e90 0x7f614815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 --2- 172.21.15.94:0/2018577475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61480cf450 0x7f61480b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 >> 172.21.15.94:0/2018577475 conn(0x7f614808bf90 msgr2=0x7f61480b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 shutdown_connections 2024-09-11T23:16:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.158+0000 7f614dd59640 1 -- 172.21.15.94:0/2018577475 wait complete. 2024-09-11T23:16:42.178 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:42.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.290+0000 7f770739f640 1 Processor -- start 2024-09-11T23:16:42.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.290+0000 7f770739f640 1 -- start start 2024-09-11T23:16:42.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770739f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77001520a0 0x7f770006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770739f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770739f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7700070250 con 0x7f770006fe50 2024-09-11T23:16:42.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770739f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7700152480 con 0x7f77001520a0 2024-09-11T23:16:42.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770739f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77000aede0 con 0x7f770015f3a0 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770513b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77001520a0 0x7f770006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770593c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770493a640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f770006fe50 0x7f770015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:59356/0 (socket says 172.21.15.94:59356) 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770493a640 1 -- 172.21.15.94:0/1965360591 learned_addr learned my addr 172.21.15.94:0/1965360591 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770593c640 1 -- 172.21.15.94:0/1965360591 >> v2:172.21.15.155:3300/0 conn(0x7f77001520a0 msgr2=0x7f770006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770593c640 1 --2- 172.21.15.94:0/1965360591 >> v2:172.21.15.155:3300/0 conn(0x7f77001520a0 0x7f770006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770593c640 1 -- 172.21.15.94:0/1965360591 >> v1:172.21.15.155:6789/0 conn(0x7f770006fe50 legacy=0x7f770015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.294+0000 7f770593c640 1 -- 172.21.15.94:0/1965360591 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770015fa10 con 0x7f770015f3a0 2024-09-11T23:16:42.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770593c640 1 --2- 172.21.15.94:0/1965360591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000adc80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009d90 tx=0x7f76f801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ef2d4f59548bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f76f7fff640 1 -- 172.21.15.94:0/1965360591 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f80b2070 con 0x7f770015f3a0 2024-09-11T23:16:42.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f76f7fff640 1 -- 172.21.15.94:0/1965360591 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f80a5920 con 0x7f770015f3a0 2024-09-11T23:16:42.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f76f7fff640 1 -- 172.21.15.94:0/1965360591 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f80a5cf0 con 0x7f770015f3a0 2024-09-11T23:16:42.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- 172.21.15.94:0/1965360591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 msgr2=0x7f77000adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 --2- 172.21.15.94:0/1965360591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000adc80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009d90 tx=0x7f76f801c970 comp rx=0 tx=0).stop 2024-09-11T23:16:42.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- 172.21.15.94:0/1965360591 shutdown_connections 2024-09-11T23:16:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 --2- 172.21.15.94:0/1965360591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000adc80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 --2- 172.21.15.94:0/1965360591 >> v2:172.21.15.155:3300/0 conn(0x7f77001520a0 0x7f770006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- 172.21.15.94:0/1965360591 >> 172.21.15.94:0/1965360591 conn(0x7f77000b1f90 msgr2=0x7f77000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- 172.21.15.94:0/1965360591 shutdown_connections 2024-09-11T23:16:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- 172.21.15.94:0/1965360591 wait complete. 2024-09-11T23:16:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 Processor -- start 2024-09-11T23:16:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- start start 2024-09-11T23:16:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f770006fe50 0x7f77000b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77001520a0 0x7f77000b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7700073d30 con 0x7f77001520a0 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7700073a50 con 0x7f770006fe50 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770739f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f770006e800 con 0x7f770015f3a0 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77001520a0 0x7f77000b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77001520a0 0x7f77000b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39124/0 (socket says 172.21.15.94:39124) 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 -- 172.21.15.94:0/553827645 learned_addr learned my addr 172.21.15.94:0/553827645 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770513b640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f770006fe50 0x7f77000b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770593c640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 -- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 msgr2=0x7f77000cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 -- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f770006fe50 msgr2=0x7f77000b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f770006fe50 0x7f77000b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 -- 172.21.15.94:0/553827645 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7700151b20 con 0x7f77001520a0 2024-09-11T23:16:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.298+0000 7f770493a640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77001520a0 0x7f77000b1390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f76f000c3a0 tx=0x7f76f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f76f5ffb640 1 -- 172.21.15.94:0/553827645 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0017070 con 0x7f77001520a0 2024-09-11T23:16:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f76f5ffb640 1 -- 172.21.15.94:0/553827645 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f0005cf0 con 0x7f77001520a0 2024-09-11T23:16:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770014d6b0 con 0x7f77001520a0 2024-09-11T23:16:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f76f5ffb640 1 -- 172.21.15.94:0/553827645 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f00072f0 con 0x7f77001520a0 2024-09-11T23:16:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7700151e00 con 0x7f77001520a0 2024-09-11T23:16:42.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77000adc80 con 0x7f77001520a0 2024-09-11T23:16:42.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f76f5ffb640 1 -- 172.21.15.94:0/553827645 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76f001a070 con 0x7f77001520a0 2024-09-11T23:16:42.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f76f5ffb640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76e40678f0 0x7f76e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f76f5ffb640 1 -- 172.21.15.94:0/553827645 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f76f0085220 con 0x7f77001520a0 2024-09-11T23:16:42.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f770513b640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76e40678f0 0x7f76e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.302+0000 7f770513b640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76e40678f0 0x7f76e4069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009af0 tx=0x7f76fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.306+0000 7f76f5ffb640 1 -- 172.21.15.94:0/553827645 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f76f0055b30 con 0x7f77001520a0 2024-09-11T23:16:42.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.486+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f770015b030 con 0x7f77001520a0 2024-09-11T23:16:42.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.486+0000 7f76f5ffb640 1 -- 172.21.15.94:0/553827645 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f76f0055430 con 0x7f77001520a0 2024-09-11T23:16:42.493 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:42.493 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"btime":"2024-09-11T23:16:16:364962+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:13.663917+0000","modified":"2024-09-11T23:16:15.700106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2889518527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2889518527},{"type":"v1","addr":"172.21.15.94:6835","nonce":2889518527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-11T23:16:42.493 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2024-09-11T23:16:42.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76e40678f0 msgr2=0x7f76e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76e40678f0 0x7f76e4069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009af0 tx=0x7f76fc008040 comp rx=0 tx=0).stop 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77001520a0 msgr2=0x7f77000b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77001520a0 0x7f77000b1390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f76f000c3a0 tx=0x7f76f000c860 comp rx=0 tx=0).stop 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 shutdown_connections 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015f3a0 0x7f77000cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f76e40678f0 0x7f76e4069db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77001520a0 0x7f77000b1390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 --2- 172.21.15.94:0/553827645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f770006fe50 0x7f77000b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 >> 172.21.15.94:0/553827645 conn(0x7f77000b1f90 msgr2=0x7f770014afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 shutdown_connections 2024-09-11T23:16:42.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.490+0000 7f770739f640 1 -- 172.21.15.94:0/553827645 wait complete. 2024-09-11T23:16:42.512 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:42.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bcafda640 1 Processor -- start 2024-09-11T23:16:42.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bcafda640 1 -- start start 2024-09-11T23:16:42.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bcafda640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6bc415bec0 0x7f6bc40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bcafda640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6bc40af470 0x7f6bc406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bcafda640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc40b3290 con 0x7f6bc415c2a0 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bcafda640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc40b3570 con 0x7f6bc415bec0 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bcafda640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc40b3850 con 0x7f6bc40af470 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc8d76640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6bc415bec0 0x7f6bc40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc8d76640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6bc415bec0 0x7f6bc40ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39132/0 (socket says 172.21.15.94:39132) 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc8d76640 1 -- 172.21.15.94:0/1167440844 learned_addr learned my addr 172.21.15.94:0/1167440844 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc9577640 1 --2- 172.21.15.94:0/1167440844 >> v2:172.21.15.155:3300/0 conn(0x7f6bc40af470 0x7f6bc406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc8d76640 1 -- 172.21.15.94:0/1167440844 >> v2:172.21.15.155:3300/0 conn(0x7f6bc40af470 msgr2=0x7f6bc406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc8d76640 1 --2- 172.21.15.94:0/1167440844 >> v2:172.21.15.155:3300/0 conn(0x7f6bc40af470 0x7f6bc406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc8d76640 1 -- 172.21.15.94:0/1167440844 >> v1:172.21.15.155:6789/0 conn(0x7f6bc415c2a0 legacy=0x7f6bc40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:42.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.622+0000 7f6bc8d76640 1 -- 172.21.15.94:0/1167440844 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc40b3b30 con 0x7f6bc415bec0 2024-09-11T23:16:42.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc8d76640 1 --2- 172.21.15.94:0/1167440844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc40ad200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40b2fb0 tx=0x7f6bb801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6886fa514947d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc37fe640 1 -- 172.21.15.94:0/1167440844 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80b1070 con 0x7f6bc415bec0 2024-09-11T23:16:42.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc37fe640 1 -- 172.21.15.94:0/1167440844 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb80ac620 con 0x7f6bc415bec0 2024-09-11T23:16:42.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc37fe640 1 -- 172.21.15.94:0/1167440844 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80ac9f0 con 0x7f6bc415bec0 2024-09-11T23:16:42.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- 172.21.15.94:0/1167440844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 msgr2=0x7f6bc40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1167440844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc40ad200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40b2fb0 tx=0x7f6bb801c4b0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- 172.21.15.94:0/1167440844 shutdown_connections 2024-09-11T23:16:42.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1167440844 >> v2:172.21.15.155:3300/0 conn(0x7f6bc40af470 0x7f6bc406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1167440844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc40ad200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- 172.21.15.94:0/1167440844 >> 172.21.15.94:0/1167440844 conn(0x7f6bc40b1f90 msgr2=0x7f6bc40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- 172.21.15.94:0/1167440844 shutdown_connections 2024-09-11T23:16:42.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- 172.21.15.94:0/1167440844 wait complete. 2024-09-11T23:16:42.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 Processor -- start 2024-09-11T23:16:42.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- start start 2024-09-11T23:16:42.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc40af470 0x7f6bc4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc415c2a0 0x7f6bc414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc406ed50 con 0x7f6bc415bec0 2024-09-11T23:16:42.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc40ad740 con 0x7f6bc40af470 2024-09-11T23:16:42.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bcafda640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc406eed0 con 0x7f6bc415c2a0 2024-09-11T23:16:42.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39142/0 (socket says 172.21.15.94:39142) 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 -- 172.21.15.94:0/1112843860 learned_addr learned my addr 172.21.15.94:0/1112843860 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc8d76640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc40af470 0x7f6bc4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc9577640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc415c2a0 0x7f6bc414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 -- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc415c2a0 msgr2=0x7f6bc414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc415c2a0 0x7f6bc414ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 -- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc40af470 msgr2=0x7f6bc4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc40af470 0x7f6bc4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 -- 172.21.15.94:0/1112843860 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc4150960 con 0x7f6bc415bec0 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc8d76640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc40af470 0x7f6bc4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:42.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.626+0000 7f6bc3fff640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc414a850 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000b3e0 tx=0x7f6bb000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc17fa640 1 -- 172.21.15.94:0/1112843860 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0015020 con 0x7f6bc415bec0 2024-09-11T23:16:42.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc17fa640 1 -- 172.21.15.94:0/1112843860 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb0011830 con 0x7f6bc415bec0 2024-09-11T23:16:42.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc41568e0 con 0x7f6bc415bec0 2024-09-11T23:16:42.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc17fa640 1 -- 172.21.15.94:0/1112843860 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0011c60 con 0x7f6bc415bec0 2024-09-11T23:16:42.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc4156ea0 con 0x7f6bc415bec0 2024-09-11T23:16:42.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc406e000 con 0x7f6bc415bec0 2024-09-11T23:16:42.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc17fa640 1 -- 172.21.15.94:0/1112843860 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6bb0018020 con 0x7f6bc415bec0 2024-09-11T23:16:42.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc17fa640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6ba80678c0 0x7f6ba8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc17fa640 1 -- 172.21.15.94:0/1112843860 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6bb0085a50 con 0x7f6bc415bec0 2024-09-11T23:16:42.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc8d76640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6ba80678c0 0x7f6ba8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.630+0000 7f6bc8d76640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6ba80678c0 0x7f6ba8069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80ae000 tx=0x7f6bb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.634+0000 7f6bc17fa640 1 -- 172.21.15.94:0/1112843860 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6bb001f030 con 0x7f6bc415bec0 2024-09-11T23:16:42.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.794+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bc406fcd0 con 0x7f6bc415bec0 2024-09-11T23:16:42.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.794+0000 7f6bc17fa640 1 -- 172.21.15.94:0/1112843860 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17026 (secure 0 0 0) 0x7f6bb00172c0 con 0x7f6bc415bec0 2024-09-11T23:16:42.800 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:42.801 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":39,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:16:15.330651+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.543946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:12.651996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6ba80678c0 msgr2=0x7f6ba8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6ba80678c0 0x7f6ba8069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80ae000 tx=0x7f6bb8008040 comp rx=0 tx=0).stop 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 msgr2=0x7f6bc414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc414a850 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000b3e0 tx=0x7f6bb000b8a0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 shutdown_connections 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc415c2a0 0x7f6bc414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6ba80678c0 0x7f6ba8069d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc415bec0 0x7f6bc414a850 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 --2- 172.21.15.94:0/1112843860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc40af470 0x7f6bc4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 >> 172.21.15.94:0/1112843860 conn(0x7f6bc40b1f90 msgr2=0x7f6bc4159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 shutdown_connections 2024-09-11T23:16:42.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.798+0000 7f6bcafda640 1 -- 172.21.15.94:0/1112843860 wait complete. 2024-09-11T23:16:42.819 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:16:42.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f90ff640 1 Processor -- start 2024-09-11T23:16:42.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f90ff640 1 -- start start 2024-09-11T23:16:42.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f90ff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f415bec0 0x7fb7f40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f90ff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7f415c2a0 0x7fb7f40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f90ff640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f40b3290 con 0x7fb7f40af2a0 2024-09-11T23:16:42.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f90ff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f40b3570 con 0x7fb7f415c2a0 2024-09-11T23:16:42.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f90ff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f40b3850 con 0x7fb7f415bec0 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7f415c2a0 0x7fb7f40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7f415c2a0 0x7fb7f40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39158/0 (socket says 172.21.15.94:39158) 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f259c640 1 -- 172.21.15.94:0/3793730702 learned_addr learned my addr 172.21.15.94:0/3793730702 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f359e640 1 --1- 172.21.15.94:0/3793730702 >> v1:172.21.15.94:6789/0 conn(0x7fb7f40af2a0 0x7fb7f415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46124/0 (socket says 172.21.15.94:46124) 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f2d9d640 1 --2- 172.21.15.94:0/3793730702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f415bec0 0x7fb7f40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f259c640 1 -- 172.21.15.94:0/3793730702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f415bec0 msgr2=0x7fb7f40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f259c640 1 --2- 172.21.15.94:0/3793730702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f415bec0 0x7fb7f40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f259c640 1 -- 172.21.15.94:0/3793730702 >> v1:172.21.15.94:6789/0 conn(0x7fb7f40af2a0 legacy=0x7fb7f415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f259c640 1 -- 172.21.15.94:0/3793730702 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f40b3b30 con 0x7fb7f415c2a0 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f1d9b640 1 -- 172.21.15.94:0/3793730702 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219519156 0 0) 0x7fb7f40b3290 con 0x7fb7f40af2a0 2024-09-11T23:16:42.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.934+0000 7fb7f2d9d640 1 --2- 172.21.15.94:0/3793730702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f415bec0 0x7fb7f40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:42.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 --2- 172.21.15.94:0/3793730702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415c2a0 0x7fb7f40aed60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009870 tx=0x7fb7e401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d43b149f94e871 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f1d9b640 1 -- 172.21.15.94:0/3793730702 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40a95f0 con 0x7fb7f415c2a0 2024-09-11T23:16:42.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f1d9b640 1 -- 172.21.15.94:0/3793730702 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e40a9790 con 0x7fb7f415c2a0 2024-09-11T23:16:42.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f1d9b640 1 -- 172.21.15.94:0/3793730702 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40a9b60 con 0x7fb7f415c2a0 2024-09-11T23:16:42.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3793730702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415c2a0 msgr2=0x7fb7f40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3793730702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415c2a0 0x7fb7f40aed60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009870 tx=0x7fb7e401c530 comp rx=0 tx=0).stop 2024-09-11T23:16:42.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3793730702 shutdown_connections 2024-09-11T23:16:42.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3793730702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415c2a0 0x7fb7f40aed60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3793730702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f415bec0 0x7fb7f40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3793730702 >> 172.21.15.94:0/3793730702 conn(0x7fb7f40b1f90 msgr2=0x7fb7f40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3793730702 shutdown_connections 2024-09-11T23:16:42.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3793730702 wait complete. 2024-09-11T23:16:42.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 Processor -- start 2024-09-11T23:16:42.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- start start 2024-09-11T23:16:42.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f40af2a0 0x7fb7f415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415bec0 0x7fb7f4073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7f415c2a0 0x7fb7f4152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f40af6f0 con 0x7fb7f415bec0 2024-09-11T23:16:42.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f40ad740 con 0x7fb7f415c2a0 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f4169000 con 0x7fb7f40af2a0 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415bec0 0x7fb7f4073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415bec0 0x7fb7f4073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39164/0 (socket says 172.21.15.94:39164) 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 -- 172.21.15.94:0/3770056125 learned_addr learned my addr 172.21.15.94:0/3770056125 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f359e640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7f415c2a0 0x7fb7f4152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f2d9d640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f40af2a0 0x7fb7f415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 -- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f40af2a0 msgr2=0x7fb7f415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f40af2a0 0x7fb7f415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 -- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7f415c2a0 msgr2=0x7fb7f4152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7f415c2a0 0x7fb7f4152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 -- 172.21.15.94:0/3770056125 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f4072f90 con 0x7fb7f415bec0 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f359e640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7f415c2a0 0x7fb7f4152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:42.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f259c640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415bec0 0x7fb7f4073a70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb7e401abe0 tx=0x7fb7e40192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7db7fe640 1 -- 172.21.15.94:0/3770056125 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40b1800 con 0x7fb7f415bec0 2024-09-11T23:16:42.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7db7fe640 1 -- 172.21.15.94:0/3770056125 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e40b19c0 con 0x7fb7f415bec0 2024-09-11T23:16:42.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f4071f10 con 0x7fb7f415bec0 2024-09-11T23:16:42.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7db7fe640 1 -- 172.21.15.94:0/3770056125 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40b1db0 con 0x7fb7f415bec0 2024-09-11T23:16:42.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.938+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f40724b0 con 0x7fb7f415bec0 2024-09-11T23:16:42.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.942+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f40ad200 con 0x7fb7f415bec0 2024-09-11T23:16:42.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.942+0000 7fb7db7fe640 1 -- 172.21.15.94:0/3770056125 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7e40ba3e0 con 0x7fb7f415bec0 2024-09-11T23:16:42.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.942+0000 7fb7db7fe640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7e00678c0 0x7fb7e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.942+0000 7fb7db7fe640 1 -- 172.21.15.94:0/3770056125 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb7e41207e0 con 0x7fb7f415bec0 2024-09-11T23:16:42.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.942+0000 7fb7f2d9d640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7e00678c0 0x7fb7e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.942+0000 7fb7f2d9d640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7e00678c0 0x7fb7e0069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb7f41fa770 tx=0x7fb7e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:42.946+0000 7fb7db7fe640 1 -- 172.21.15.94:0/3770056125 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7e40c1060 con 0x7fb7f415bec0 2024-09-11T23:16:43.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.138+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb7f406fcd0 con 0x7fb7f415bec0 2024-09-11T23:16:43.143 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:16:43.138+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:16:43.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.142+0000 7fb7db7fe640 1 -- 172.21.15.94:0/3770056125 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fb7e40ad020 con 0x7fb7f415bec0 2024-09-11T23:16:43.146 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:16:43.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.142+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7e00678c0 msgr2=0x7fb7e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:43.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.142+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7e00678c0 0x7fb7e0069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb7f41fa770 tx=0x7fb7e8008040 comp rx=0 tx=0).stop 2024-09-11T23:16:43.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.142+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415bec0 msgr2=0x7fb7f4073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:43.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.142+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415bec0 0x7fb7f4073a70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb7e401abe0 tx=0x7fb7e40192d0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 shutdown_connections 2024-09-11T23:16:43.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7f415c2a0 0x7fb7f4152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7e00678c0 0x7fb7e0069d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7f415bec0 0x7fb7f4073a70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 --2- 172.21.15.94:0/3770056125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7f40af2a0 0x7fb7f415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 >> 172.21.15.94:0/3770056125 conn(0x7fb7f40b1f90 msgr2=0x7fb7f4165780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:43.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 shutdown_connections 2024-09-11T23:16:43.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.146+0000 7fb7f90ff640 1 -- 172.21.15.94:0/3770056125 wait complete. 2024-09-11T23:16:43.166 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:16:43.202 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:16:43.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023d009640 1 Processor -- start 2024-09-11T23:16:43.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023d009640 1 -- start start 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023d009640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0238156720 0x7f02380b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023d009640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02381412e0 0x7f02380b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023d009640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023813fb30 con 0x7f02380b5b50 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023d009640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0238140740 con 0x7f02381412e0 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023d009640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f023813fe10 con 0x7f0238156720 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.270+0000 7f023759e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02381412e0 0x7f02380b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023759e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02381412e0 0x7f02380b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39212/0 (socket says 172.21.15.94:39212) 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023659c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f02380b5b50 0x7f0238140bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46138/0 (socket says 172.21.15.94:46138) 2024-09-11T23:16:43.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023759e640 1 -- 172.21.15.94:0/3962698868 learned_addr learned my addr 172.21.15.94:0/3962698868 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:43.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f0236d9d640 1 --2- 172.21.15.94:0/3962698868 >> v2:172.21.15.155:3300/0 conn(0x7f0238156720 0x7f02380b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:43.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023759e640 1 -- 172.21.15.94:0/3962698868 >> v2:172.21.15.155:3300/0 conn(0x7f0238156720 msgr2=0x7f02380b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:43.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023759e640 1 --2- 172.21.15.94:0/3962698868 >> v2:172.21.15.155:3300/0 conn(0x7f0238156720 0x7f02380b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023759e640 1 -- 172.21.15.94:0/3962698868 >> v1:172.21.15.94:6789/0 conn(0x7f02380b5b50 legacy=0x7f0238140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:43.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023759e640 1 -- 172.21.15.94:0/3962698868 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02381400f0 con 0x7f02381412e0 2024-09-11T23:16:43.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f0235d9b640 1 -- 172.21.15.94:0/3962698868 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652120047 0 0) 0x7f023813fb30 con 0x7f02380b5b50 2024-09-11T23:16:43.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023759e640 1 --2- 172.21.15.94:0/3962698868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f02380b4410 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02381408c0 tx=0x7f022801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80815517d3efeea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:43.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f0235d9b640 1 -- 172.21.15.94:0/3962698868 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02280a56c0 con 0x7f02381412e0 2024-09-11T23:16:43.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f0235d9b640 1 -- 172.21.15.94:0/3962698868 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02280a5860 con 0x7f02381412e0 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f0235d9b640 1 -- 172.21.15.94:0/3962698868 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02280a5c30 con 0x7f02381412e0 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 -- 172.21.15.94:0/3962698868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 msgr2=0x7f02380b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 --2- 172.21.15.94:0/3962698868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f02380b4410 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02381408c0 tx=0x7f022801c9f0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 -- 172.21.15.94:0/3962698868 shutdown_connections 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 --2- 172.21.15.94:0/3962698868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f02380b4410 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 --2- 172.21.15.94:0/3962698868 >> v2:172.21.15.155:3300/0 conn(0x7f0238156720 0x7f02380b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 -- 172.21.15.94:0/3962698868 >> 172.21.15.94:0/3962698868 conn(0x7f023806c0c0 msgr2=0x7f023806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 -- 172.21.15.94:0/3962698868 shutdown_connections 2024-09-11T23:16:43.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.274+0000 7f023d009640 1 -- 172.21.15.94:0/3962698868 wait complete. 2024-09-11T23:16:43.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 Processor -- start 2024-09-11T23:16:43.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 -- start start 2024-09-11T23:16:43.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02380b5b50 0x7f023813c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:43.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f0238154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:43.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0238156720 0x7f0238154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:43.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f023815cba0 con 0x7f02381412e0 2024-09-11T23:16:43.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f023815ca20 con 0x7f0238156720 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f023815cd20 con 0x7f02380b5b50 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f0238154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f0238154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39222/0 (socket says 172.21.15.94:39222) 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 -- 172.21.15.94:0/1873015634 learned_addr learned my addr 172.21.15.94:0/1873015634 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f0236d9d640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02380b5b50 0x7f023813c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023759e640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0238156720 0x7f0238154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 -- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02380b5b50 msgr2=0x7f023813c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02380b5b50 0x7f023813c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 -- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0238156720 msgr2=0x7f0238154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0238156720 0x7f0238154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:43.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 -- 172.21.15.94:0/1873015634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0238159650 con 0x7f02381412e0 2024-09-11T23:16:43.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023659c640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f0238154050 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c4b0 tx=0x7f022c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:43.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f021f7fe640 1 -- 172.21.15.94:0/1873015634 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c018070 con 0x7f02381412e0 2024-09-11T23:16:43.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f021f7fe640 1 -- 172.21.15.94:0/1873015634 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022c007500 con 0x7f02381412e0 2024-09-11T23:16:43.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f021f7fe640 1 -- 172.21.15.94:0/1873015634 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c004a30 con 0x7f02381412e0 2024-09-11T23:16:43.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0238159930 con 0x7f02381412e0 2024-09-11T23:16:43.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0238155d40 con 0x7f02381412e0 2024-09-11T23:16:43.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0238069170 con 0x7f02381412e0 2024-09-11T23:16:43.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f021f7fe640 1 -- 172.21.15.94:0/1873015634 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f022c01b070 con 0x7f02381412e0 2024-09-11T23:16:43.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f021f7fe640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02240678c0 0x7f0224069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:43.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.278+0000 7f021f7fe640 1 -- 172.21.15.94:0/1873015634 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f022c085280 con 0x7f02381412e0 2024-09-11T23:16:43.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.282+0000 7f0236d9d640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02240678c0 0x7f0224069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:43.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.282+0000 7f0236d9d640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02240678c0 0x7f0224069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f023000b930 tx=0x7f0230008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:43.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.286+0000 7f021f7fe640 1 -- 172.21.15.94:0/1873015634 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f022c055c10 con 0x7f02381412e0 2024-09-11T23:16:43.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:43.466+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f02380d00e0 con 0x7f02381412e0 2024-09-11T23:16:43.606 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:43.610 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:44.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.142+0000 7f021f7fe640 1 -- 172.21.15.94:0/1873015634 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f022c055510 con 0x7f02381412e0 2024-09-11T23:16:44.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02240678c0 msgr2=0x7f0224069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02240678c0 0x7f0224069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f023000b930 tx=0x7f0230008040 comp rx=0 tx=0).stop 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 msgr2=0x7f0238154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f0238154050 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c4b0 tx=0x7f022c00c970 comp rx=0 tx=0).stop 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 shutdown_connections 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0238156720 0x7f0238154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02240678c0 0x7f0224069d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02381412e0 0x7f0238154050 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 --2- 172.21.15.94:0/1873015634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02380b5b50 0x7f023813c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 >> 172.21.15.94:0/1873015634 conn(0x7f023806c0c0 msgr2=0x7f023813ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 shutdown_connections 2024-09-11T23:16:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.146+0000 7f023d009640 1 -- 172.21.15.94:0/1873015634 wait complete. 2024-09-11T23:16:44.172 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:16:44.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd2c54640 1 Processor -- start 2024-09-11T23:16:44.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd2c54640 1 -- start start 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd2c54640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4dcc1520a0 0x7f4dcc06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd2c54640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4dcc06fe50 0x7f4dcc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd2c54640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dcc070250 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd2c54640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4dcc152480 con 0x7f4dcc06fe50 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd2c54640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4dcc0aede0 con 0x7f4dcc1520a0 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dc3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4dcc06fe50 0x7f4dcc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dc3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4dcc06fe50 0x7f4dcc15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39236/0 (socket says 172.21.15.94:39236) 2024-09-11T23:16:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dc3fff640 1 -- 172.21.15.94:0/3767921906 learned_addr learned my addr 172.21.15.94:0/3767921906 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:44.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd09f0640 1 --2- 172.21.15.94:0/3767921906 >> v2:172.21.15.155:3300/0 conn(0x7f4dcc1520a0 0x7f4dcc06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:44.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dc3fff640 1 -- 172.21.15.94:0/3767921906 >> v2:172.21.15.155:3300/0 conn(0x7f4dcc1520a0 msgr2=0x7f4dcc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:44.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dc3fff640 1 --2- 172.21.15.94:0/3767921906 >> v2:172.21.15.155:3300/0 conn(0x7f4dcc1520a0 0x7f4dcc06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dc3fff640 1 -- 172.21.15.94:0/3767921906 >> v1:172.21.15.155:6789/0 conn(0x7f4dcc15f1d0 legacy=0x7f4dcc071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:44.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dc3fff640 1 -- 172.21.15.94:0/3767921906 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc15fa10 con 0x7f4dcc06fe50 2024-09-11T23:16:44.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.290+0000 7f4dd09f0640 1 --2- 172.21.15.94:0/3767921906 >> v2:172.21.15.155:3300/0 conn(0x7f4dcc1520a0 0x7f4dcc06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:44.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dc3fff640 1 --2- 172.21.15.94:0/3767921906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc06fe50 0x7f4dcc15ec90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc071710 tx=0x7f4dbc01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a086f953789c3cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:44.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dc37fe640 1 -- 172.21.15.94:0/3767921906 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0b4070 con 0x7f4dcc06fe50 2024-09-11T23:16:44.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dc37fe640 1 -- 172.21.15.94:0/3767921906 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc0a7bc0 con 0x7f4dcc06fe50 2024-09-11T23:16:44.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dc37fe640 1 -- 172.21.15.94:0/3767921906 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0af440 con 0x7f4dcc06fe50 2024-09-11T23:16:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 -- 172.21.15.94:0/3767921906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc06fe50 msgr2=0x7f4dcc15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/3767921906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc06fe50 0x7f4dcc15ec90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc071710 tx=0x7f4dbc01ebd0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 -- 172.21.15.94:0/3767921906 shutdown_connections 2024-09-11T23:16:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/3767921906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc06fe50 0x7f4dcc15ec90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/3767921906 >> v2:172.21.15.155:3300/0 conn(0x7f4dcc1520a0 0x7f4dcc06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 -- 172.21.15.94:0/3767921906 >> 172.21.15.94:0/3767921906 conn(0x7f4dcc0b1f90 msgr2=0x7f4dcc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 -- 172.21.15.94:0/3767921906 shutdown_connections 2024-09-11T23:16:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.294+0000 7f4dd2c54640 1 -- 172.21.15.94:0/3767921906 wait complete. 2024-09-11T23:16:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 Processor -- start 2024-09-11T23:16:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 -- start start 2024-09-11T23:16:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dcc06fe50 0x7f4dcc145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dcc1520a0 0x7f4dcc14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc15f1d0 0x7f4dcc0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc073d30 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc073a50 con 0x7f4dcc1520a0 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4dcc15f5e0 con 0x7f4dcc06fe50 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc15f1d0 0x7f4dcc0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc15f1d0 0x7f4dcc0adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39250/0 (socket says 172.21.15.94:39250) 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 -- 172.21.15.94:0/976619450 learned_addr learned my addr 172.21.15.94:0/976619450 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc3fff640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dcc1520a0 0x7f4dcc14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 -- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dcc06fe50 msgr2=0x7f4dcc145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dcc06fe50 0x7f4dcc145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 -- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dcc1520a0 msgr2=0x7f4dcc14d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dcc1520a0 0x7f4dcc14d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 -- 172.21.15.94:0/976619450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc14ded0 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc3fff640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dcc1520a0 0x7f4dcc14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd11f1640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc15f1d0 0x7f4dcc0adc40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c770 tx=0x7f4dc400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc17fa640 1 -- 172.21.15.94:0/976619450 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4003b80 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc17fa640 1 -- 172.21.15.94:0/976619450 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc4003d20 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dcc14e210 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc17fa640 1 -- 172.21.15.94:0/976619450 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400aa90 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dcc14ea50 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dcc15ec90 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc17fa640 1 -- 172.21.15.94:0/976619450 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4dc400ac30 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc17fa640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4db80678c0 0x7f4db8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dc17fa640 1 -- 172.21.15.94:0/976619450 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f4dc4085df0 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.298+0000 7f4dd09f0640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4db80678c0 0x7f4db8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.302+0000 7f4dd09f0640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4db80678c0 0x7f4db8069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8006f10 tx=0x7f4dc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:44.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.302+0000 7f4dc17fa640 1 -- 172.21.15.94:0/976619450 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4dcc14e210 con 0x7f4dcc15f1d0 2024-09-11T23:16:44.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:44.466+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4dcc06e540 con 0x7f4dcc15f1d0 2024-09-11T23:16:45.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dc17fa640 1 -- 172.21.15.94:0/976619450 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) ==== 181+0+0 (secure 0 0 0) 0x7f4dc4056750 con 0x7f4dcc15f1d0 2024-09-11T23:16:45.158 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:16:45.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4db80678c0 msgr2=0x7f4db8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:45.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4db80678c0 0x7f4db8069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8006f10 tx=0x7f4dc8008040 comp rx=0 tx=0).stop 2024-09-11T23:16:45.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc15f1d0 msgr2=0x7f4dcc0adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:45.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc15f1d0 0x7f4dcc0adc40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c770 tx=0x7f4dc400cc30 comp rx=0 tx=0).stop 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 shutdown_connections 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4db80678c0 0x7f4db8069d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4dcc15f1d0 0x7f4dcc0adc40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dcc1520a0 0x7f4dcc14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 --2- 172.21.15.94:0/976619450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dcc06fe50 0x7f4dcc145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 >> 172.21.15.94:0/976619450 conn(0x7f4dcc0b1f90 msgr2=0x7f4dcc0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 shutdown_connections 2024-09-11T23:16:45.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.154+0000 7f4dd2c54640 1 -- 172.21.15.94:0/976619450 wait complete. 2024-09-11T23:16:45.183 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:16:45.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.306+0000 7ff6f308e640 1 Processor -- start 2024-09-11T23:16:45.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.306+0000 7ff6f308e640 1 -- start start 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f308e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff6ec06f010 0x7ff6ec166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f308e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ec0b3290 con 0x7ff6ec15c2a0 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f308e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ec0b3570 con 0x7ff6ec15bec0 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f308e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ec0b3850 con 0x7ff6ec06f010 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff6ec15c2a0 0x7ff6ec0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46152/0 (socket says 172.21.15.94:46152) 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 -- 172.21.15.94:0/1995084081 learned_addr learned my addr 172.21.15.94:0/1995084081 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f162b640 1 --2- 172.21.15.94:0/1995084081 >> v2:172.21.15.155:3300/0 conn(0x7ff6ec06f010 0x7ff6ec166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844465452 0 0) 0x7ff6ec0b3290 con 0x7ff6ec15c2a0 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d4003530 con 0x7ff6ec15c2a0 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1623846810 0 0) 0x7ff6d4003530 con 0x7ff6ec15c2a0 2024-09-11T23:16:45.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 >> v2:172.21.15.155:3300/0 conn(0x7ff6ec06f010 msgr2=0x7ff6ec166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 --2- 172.21.15.94:0/1995084081 >> v2:172.21.15.155:3300/0 conn(0x7ff6ec06f010 0x7ff6ec166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 >> v1:172.21.15.155:6789/0 conn(0x7ff6ec15bec0 legacy=0x7ff6ec0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec0b3b30 con 0x7ff6ec15c2a0 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7ff6e0001680 con 0x7ff6ec15c2a0 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f162b640 1 --2- 172.21.15.94:0/1995084081 >> v2:172.21.15.155:3300/0 conn(0x7ff6ec06f010 0x7ff6ec166ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 >> v1:172.21.15.94:6789/0 conn(0x7ff6ec15c2a0 legacy=0x7ff6ec0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6d40039c0 0x7ff6d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6d4004810 0x7ff6d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d40051d0 0x7ff6d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0b3850 con 0x7ff6d4004810 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d400c120 con 0x7ff6d40051d0 2024-09-11T23:16:45.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d400c320 con 0x7ff6d40039c0 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6d4004810 0x7ff6d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f0e2a640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6d40039c0 0x7ff6d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f162b640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d40051d0 0x7ff6d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 -- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6d40039c0 msgr2=0x7ff6d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6d40039c0 0x7ff6d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 -- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d40051d0 msgr2=0x7ff6d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d40051d0 0x7ff6d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6ebfff640 1 -- 172.21.15.94:0/1995084081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d4003530 con 0x7ff6d4004810 2024-09-11T23:16:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.310+0000 7ff6f162b640 1 -- 172.21.15.94:0/1995084081 reap_dead start 2024-09-11T23:16:45.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6d4004810 0x7ff6d4004c90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c190 tx=0x7ff6e001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3806eef3be48ab4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0007d00 con 0x7ff6d4004810 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e0005b00 con 0x7ff6d4004810 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6eb7fe640 1 -- 172.21.15.94:0/1995084081 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0007070 con 0x7ff6d4004810 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- 172.21.15.94:0/1995084081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6d4004810 msgr2=0x7ff6d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6d4004810 0x7ff6d4004c90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c190 tx=0x7ff6e001f390 comp rx=0 tx=0).stop 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- 172.21.15.94:0/1995084081 shutdown_connections 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 --2- 172.21.15.94:0/1995084081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6d4004810 0x7ff6d4004c90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- 172.21.15.94:0/1995084081 >> 172.21.15.94:0/1995084081 conn(0x7ff6ec0b1f90 msgr2=0x7ff6ec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- 172.21.15.94:0/1995084081 shutdown_connections 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- 172.21.15.94:0/1995084081 wait complete. 2024-09-11T23:16:45.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 Processor -- start 2024-09-11T23:16:45.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- start start 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d4004810 0x7ff6ec14d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6ec14f060 0x7ff6ec0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6ec071f10 0x7ff6ec1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0afc90 con 0x7ff6ec14f060 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0b40f0 con 0x7ff6d4004810 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f308e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ec0ad200 con 0x7ff6ec071f10 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6ec14f060 0x7ff6ec0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6ec14f060 0x7ff6ec0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39272/0 (socket says 172.21.15.94:39272) 2024-09-11T23:16:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 -- 172.21.15.94:0/3261014542 learned_addr learned my addr 172.21.15.94:0/3261014542 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6f0e2a640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d4004810 0x7ff6ec14d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 -- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6ec071f10 msgr2=0x7ff6ec1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6ec071f10 0x7ff6ec1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 -- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d4004810 msgr2=0x7ff6ec14d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d4004810 0x7ff6ec14d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.314+0000 7ff6ebfff640 1 -- 172.21.15.94:0/3261014542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec0cf190 con 0x7ff6ec14f060 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6ebfff640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6ec14f060 0x7ff6ec0cec50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c190 tx=0x7ff6d4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6e97fa640 1 -- 172.21.15.94:0/3261014542 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0007d00 con 0x7ff6ec14f060 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6e97fa640 1 -- 172.21.15.94:0/3261014542 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e0000ee0 con 0x7ff6ec14f060 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec151940 con 0x7ff6ec14f060 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6e97fa640 1 -- 172.21.15.94:0/3261014542 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0001480 con 0x7ff6ec14f060 2024-09-11T23:16:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec151f00 con 0x7ff6ec14f060 2024-09-11T23:16:45.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec0ad530 con 0x7ff6ec14f060 2024-09-11T23:16:45.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6e97fa640 1 -- 172.21.15.94:0/3261014542 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff6e00047f0 con 0x7ff6ec14f060 2024-09-11T23:16:45.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6e97fa640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6d80678f0 0x7ff6d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:45.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6e97fa640 1 -- 172.21.15.94:0/3261014542 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5749+0+0 (secure 0 0 0) 0x7ff6e01231c0 con 0x7ff6ec14f060 2024-09-11T23:16:45.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6f0e2a640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6d80678f0 0x7ff6d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:45.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.318+0000 7ff6f0e2a640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6d80678f0 0x7ff6d8069db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000f90 tx=0x7ff6dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:45.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.322+0000 7ff6e97fa640 1 -- 172.21.15.94:0/3261014542 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff6ec0cf190 con 0x7ff6ec14f060 2024-09-11T23:16:45.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:45.486+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff6ec06fcd0 con 0x7ff6ec14f060 2024-09-11T23:16:46.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.162+0000 7ff6e97fa640 1 -- 172.21.15.94:0/3261014542 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) ==== 169+0+0 (secure 0 0 0) 0x7ff6e00190a0 con 0x7ff6ec14f060 2024-09-11T23:16:46.169 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:16:46.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6d80678f0 msgr2=0x7ff6d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6d80678f0 0x7ff6d8069db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000f90 tx=0x7ff6dc009040 comp rx=0 tx=0).stop 2024-09-11T23:16:46.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6ec14f060 msgr2=0x7ff6ec0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6ec14f060 0x7ff6ec0cec50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c190 tx=0x7ff6d4005840 comp rx=0 tx=0).stop 2024-09-11T23:16:46.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 shutdown_connections 2024-09-11T23:16:46.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6ec071f10 0x7ff6ec1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6d80678f0 0x7ff6d8069db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6ec14f060 0x7ff6ec0cec50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 --2- 172.21.15.94:0/3261014542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6d4004810 0x7ff6ec14d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 >> 172.21.15.94:0/3261014542 conn(0x7ff6ec0b1f90 msgr2=0x7ff6ec0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:46.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.166+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 shutdown_connections 2024-09-11T23:16:46.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.170+0000 7ff6f308e640 1 -- 172.21.15.94:0/3261014542 wait complete. 2024-09-11T23:16:46.199 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:16:46.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.318+0000 7f8cfe085640 1 Processor -- start 2024-09-11T23:16:46.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.318+0000 7f8cfe085640 1 -- start start 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8cf80b39a0 0x7f8cf806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf806e4b0 0x7f8cf8072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf806ec60 con 0x7f8cf81587a0 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf806f870 con 0x7f8cf80b39a0 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf806ef40 con 0x7f8cf806e4b0 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf77fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8cf81587a0 0x7f8cf80b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46162/0 (socket says 172.21.15.94:46162) 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8cf80b39a0 0x7f8cf806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf77fe640 1 -- 172.21.15.94:0/2981014733 learned_addr learned my addr 172.21.15.94:0/2981014733 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf7fff640 1 --2- 172.21.15.94:0/2981014733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf806e4b0 0x7f8cf8072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf6ffd640 1 -- 172.21.15.94:0/2981014733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf806e4b0 msgr2=0x7f8cf8072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf6ffd640 1 --2- 172.21.15.94:0/2981014733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf806e4b0 0x7f8cf8072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf6ffd640 1 -- 172.21.15.94:0/2981014733 >> v1:172.21.15.94:6789/0 conn(0x7f8cf81587a0 legacy=0x7f8cf80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf6ffd640 1 -- 172.21.15.94:0/2981014733 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf806f220 con 0x7f8cf80b39a0 2024-09-11T23:16:46.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf7fff640 1 --2- 172.21.15.94:0/2981014733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf806e4b0 0x7f8cf8072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:46.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf6ffd640 1 --2- 172.21.15.94:0/2981014733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf80b39a0 0x7f8cf806df70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009d90 tx=0x7f8ce001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d83f7cceff5e4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:46.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf67fc640 1 -- 172.21.15.94:0/2981014733 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00b2070 con 0x7f8cf80b39a0 2024-09-11T23:16:46.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf67fc640 1 -- 172.21.15.94:0/2981014733 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce00a5920 con 0x7f8cf80b39a0 2024-09-11T23:16:46.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cf67fc640 1 -- 172.21.15.94:0/2981014733 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00a5cf0 con 0x7f8cf80b39a0 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- 172.21.15.94:0/2981014733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf80b39a0 msgr2=0x7f8cf806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 --2- 172.21.15.94:0/2981014733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf80b39a0 0x7f8cf806df70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009d90 tx=0x7f8ce001c940 comp rx=0 tx=0).stop 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- 172.21.15.94:0/2981014733 shutdown_connections 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 --2- 172.21.15.94:0/2981014733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf806e4b0 0x7f8cf8072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 --2- 172.21.15.94:0/2981014733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf80b39a0 0x7f8cf806df70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- 172.21.15.94:0/2981014733 >> 172.21.15.94:0/2981014733 conn(0x7f8cf80b1f90 msgr2=0x7f8cf80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- 172.21.15.94:0/2981014733 shutdown_connections 2024-09-11T23:16:46.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.322+0000 7f8cfe085640 1 -- 172.21.15.94:0/2981014733 wait complete. 2024-09-11T23:16:46.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 Processor -- start 2024-09-11T23:16:46.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 -- start start 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cf806e4b0 0x7f8cf809de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf80b39a0 0x7f8cf809c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf81587a0 0x7f8cf81465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8073030 con 0x7f8cf81587a0 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8072eb0 con 0x7f8cf806e4b0 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf80731b0 con 0x7f8cf80b39a0 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf81587a0 0x7f8cf81465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf81587a0 0x7f8cf81465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39292/0 (socket says 172.21.15.94:39292) 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 -- 172.21.15.94:0/1837248208 learned_addr learned my addr 172.21.15.94:0/1837248208 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf6ffd640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf80b39a0 0x7f8cf809c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf77fe640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cf806e4b0 0x7f8cf809de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 -- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf80b39a0 msgr2=0x7f8cf809c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf80b39a0 0x7f8cf809c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 -- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cf806e4b0 msgr2=0x7f8cf809de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cf806e4b0 0x7f8cf809de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 -- 172.21.15.94:0/1837248208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf80d0bc0 con 0x7f8cf81587a0 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf6ffd640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf80b39a0 0x7f8cf809c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cf7fff640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf81587a0 0x7f8cf81465a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c820 tx=0x7f8cf000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8ceffff640 1 -- 172.21.15.94:0/1837248208 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0015070 con 0x7f8cf81587a0 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8ceffff640 1 -- 172.21.15.94:0/1837248208 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0007a70 con 0x7f8cf81587a0 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf80d0ea0 con 0x7f8cf81587a0 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8ceffff640 1 -- 172.21.15.94:0/1837248208 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0007e60 con 0x7f8cf81587a0 2024-09-11T23:16:46.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf809c5d0 con 0x7f8cf81587a0 2024-09-11T23:16:46.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.326+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf8072160 con 0x7f8cf81587a0 2024-09-11T23:16:46.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.330+0000 7f8ceffff640 1 -- 172.21.15.94:0/1837248208 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8cf0018070 con 0x7f8cf81587a0 2024-09-11T23:16:46.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.330+0000 7f8ceffff640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8cd80678c0 0x7f8cd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.330+0000 7f8ceffff640 1 -- 172.21.15.94:0/1837248208 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f8cf0085a30 con 0x7f8cf81587a0 2024-09-11T23:16:46.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.330+0000 7f8cf77fe640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8cd80678c0 0x7f8cd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.330+0000 7f8cf77fe640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8cd80678c0 0x7f8cd8069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8158530 tx=0x7f8ce8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:46.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.334+0000 7f8ceffff640 1 -- 172.21.15.94:0/1837248208 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8cf0056770 con 0x7f8cf81587a0 2024-09-11T23:16:46.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.502+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8cf8070080 con 0x7f8cf81587a0 2024-09-11T23:16:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.506+0000 7f8ceffff640 1 -- 172.21.15.94:0/1837248208 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f8cf0056070 con 0x7f8cf81587a0 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8cd80678c0 msgr2=0x7f8cd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8cd80678c0 0x7f8cd8069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8158530 tx=0x7f8ce8009040 comp rx=0 tx=0).stop 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf81587a0 msgr2=0x7f8cf81465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf81587a0 0x7f8cf81465a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c820 tx=0x7f8cf000cce0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 shutdown_connections 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8cd80678c0 0x7f8cd8069d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cf81587a0 0x7f8cf81465a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cf80b39a0 0x7f8cf809c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 --2- 172.21.15.94:0/1837248208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cf806e4b0 0x7f8cf809de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 >> 172.21.15.94:0/1837248208 conn(0x7f8cf80b1f90 msgr2=0x7f8cf80b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:46.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 shutdown_connections 2024-09-11T23:16:46.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.510+0000 7f8cfe085640 1 -- 172.21.15.94:0/1837248208 wait complete. 2024-09-11T23:16:46.531 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2024-09-11T23:16:46.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e598b6640 1 Processor -- start 2024-09-11T23:16:46.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e598b6640 1 -- start start 2024-09-11T23:16:46.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e598b6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0e54161a60 0x7f0e540d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e598b6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e540d32b0 con 0x7f0e540d2e90 2024-09-11T23:16:46.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e598b6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e540d0300 con 0x7f0e540cf620 2024-09-11T23:16:46.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e598b6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0e540cfa90 con 0x7f0e54161a60 2024-09-11T23:16:46.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e527fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0e540d2e90 0x7f0e540cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46168/0 (socket says 172.21.15.94:46168) 2024-09-11T23:16:46.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e527fc640 1 -- 172.21.15.94:0/3823630293 learned_addr learned my addr 172.21.15.94:0/3823630293 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:46.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/3823630293 >> v2:172.21.15.155:3300/0 conn(0x7f0e54161a60 0x7f0e540d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 999489987 0 0) 0x7f0e540d32b0 con 0x7f0e540d2e90 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e40003530 con 0x7f0e540d2e90 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4088044115 0 0) 0x7f0e40003530 con 0x7f0e540d2e90 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 >> v2:172.21.15.155:3300/0 conn(0x7f0e54161a60 msgr2=0x7f0e540d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 --2- 172.21.15.94:0/3823630293 >> v2:172.21.15.155:3300/0 conn(0x7f0e54161a60 0x7f0e540d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 >> v1:172.21.15.155:6789/0 conn(0x7f0e540cf620 legacy=0x7f0e5406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e540b0f60 con 0x7f0e540d2e90 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f0e44001680 con 0x7f0e540d2e90 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 >> v1:172.21.15.94:6789/0 conn(0x7f0e540d2e90 legacy=0x7f0e540cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e40004810 0x7f0e40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e400051d0 0x7f0e4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0e540cfa90 con 0x7f0e400039c0 2024-09-11T23:16:46.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4000c170 con 0x7f0e400051d0 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e4000c370 con 0x7f0e40004810 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e52ffd640 1 -- 172.21.15.94:0/3823630293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e40004810 msgr2=0x7f0e40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e40004810 0x7f0e40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e52ffd640 1 -- 172.21.15.94:0/3823630293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e400051d0 msgr2=0x7f0e4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e400051d0 0x7f0e4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e52ffd640 1 -- 172.21.15.94:0/3823630293 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e40003530 con 0x7f0e400039c0 2024-09-11T23:16:46.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.646+0000 7f0e537fe640 1 -- 172.21.15.94:0/3823630293 reap_dead start 2024-09-11T23:16:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e40003de0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009ac0 tx=0x7f0e3c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a2ad5f9dc001bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0b2070 con 0x7f0e400039c0 2024-09-11T23:16:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0a5540 con 0x7f0e400039c0 2024-09-11T23:16:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e51ffb640 1 -- 172.21.15.94:0/3823630293 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c009690 con 0x7f0e400039c0 2024-09-11T23:16:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 -- 172.21.15.94:0/3823630293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 msgr2=0x7f0e40003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e40003de0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009ac0 tx=0x7f0e3c01ca60 comp rx=0 tx=0).stop 2024-09-11T23:16:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 -- 172.21.15.94:0/3823630293 shutdown_connections 2024-09-11T23:16:46.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 --2- 172.21.15.94:0/3823630293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e40003de0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 -- 172.21.15.94:0/3823630293 >> 172.21.15.94:0/3823630293 conn(0x7f0e5408bf90 msgr2=0x7f0e5409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:46.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 -- 172.21.15.94:0/3823630293 shutdown_connections 2024-09-11T23:16:46.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 -- 172.21.15.94:0/3823630293 wait complete. 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 Processor -- start 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.650+0000 7f0e598b6640 1 -- start start 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e5415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e540c9180 0x7f0e540cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e5409e070 0x7f0e540b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0e540cf320 con 0x7f0e400039c0 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5406d190 con 0x7f0e540c9180 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e540cf4a0 con 0x7f0e5409e070 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e5415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e5415dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39308/0 (socket says 172.21.15.94:39308) 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 -- 172.21.15.94:0/2641701968 learned_addr learned my addr 172.21.15.94:0/2641701968 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e527fc640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e540c9180 0x7f0e540cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 -- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e5409e070 msgr2=0x7f0e540b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e537fe640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e5409e070 0x7f0e540b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e5409e070 0x7f0e540b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 -- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e540c9180 msgr2=0x7f0e540cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e540c9180 0x7f0e540cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 -- 172.21.15.94:0/2641701968 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e540cc0e0 con 0x7f0e400039c0 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e52ffd640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e5415dc90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009ac0 tx=0x7f0e40005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e4bfff640 1 -- 172.21.15.94:0/2641701968 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0bc070 con 0x7f0e400039c0 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e4bfff640 1 -- 172.21.15.94:0/2641701968 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0b7460 con 0x7f0e400039c0 2024-09-11T23:16:46.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e540cc380 con 0x7f0e400039c0 2024-09-11T23:16:46.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e4bfff640 1 -- 172.21.15.94:0/2641701968 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0b2040 con 0x7f0e400039c0 2024-09-11T23:16:46.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e540c9be0 con 0x7f0e400039c0 2024-09-11T23:16:46.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e540d12b0 con 0x7f0e400039c0 2024-09-11T23:16:46.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e4bfff640 1 -- 172.21.15.94:0/2641701968 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e3c0b5070 con 0x7f0e400039c0 2024-09-11T23:16:46.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e4bfff640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e340678c0 0x7f0e34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:46.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e4bfff640 1 -- 172.21.15.94:0/2641701968 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f0e3c11fcc0 con 0x7f0e400039c0 2024-09-11T23:16:46.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.654+0000 7f0e527fc640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e340678c0 0x7f0e34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:46.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.658+0000 7f0e527fc640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e340678c0 0x7f0e34069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e440017f0 tx=0x7f0e440016a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:46.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.658+0000 7f0e4bfff640 1 -- 172.21.15.94:0/2641701968 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e3c126080 con 0x7f0e400039c0 2024-09-11T23:16:46.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:46.886+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) -- 0x7f0e540c7c20 con 0x7f0e400039c0 2024-09-11T23:16:47.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.166+0000 7f0e4bfff640 1 -- 172.21.15.94:0/2641701968 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v104) ==== 132+0+0 (secure 0 0 0) 0x7f0e3c0c6020 con 0x7f0e400039c0 2024-09-11T23:16:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e340678c0 msgr2=0x7f0e34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e340678c0 0x7f0e34069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e440017f0 tx=0x7f0e440016a0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 msgr2=0x7f0e5415dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e5415dc90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009ac0 tx=0x7f0e40005840 comp rx=0 tx=0).stop 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 shutdown_connections 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e5409e070 0x7f0e540b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e540c9180 0x7f0e540cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e340678c0 0x7f0e34069d80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 --2- 172.21.15.94:0/2641701968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e400039c0 0x7f0e5415dc90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 >> 172.21.15.94:0/2641701968 conn(0x7f0e5408bf90 msgr2=0x7f0e54160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 shutdown_connections 2024-09-11T23:16:47.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.170+0000 7f0e598b6640 1 -- 172.21.15.94:0/2641701968 wait complete. 2024-09-11T23:16:47.196 INFO:tasks.cephfs_test_runner:That when deleting a bunch of dentries and the containing ... ok 2024-09-11T23:16:47.197 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). 2024-09-11T23:16:47.197 INFO:tasks.cephfs_test_runner:test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:16:47.197 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:16:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f137179b640 1 Processor -- start 2024-09-11T23:16:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f137179b640 1 -- start start 2024-09-11T23:16:47.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f137179b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f136c06f010 0x7f136c166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f137179b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f136c0b3290 con 0x7f136c15c2a0 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f137179b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f136c0b3570 con 0x7f136c15bec0 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f137179b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f136c0b3850 con 0x7f136c06f010 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f136c15c2a0 0x7f136c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46172/0 (socket says 172.21.15.94:46172) 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 -- 172.21.15.94:0/1143741033 learned_addr learned my addr 172.21.15.94:0/1143741033 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136b7fe640 1 --2- 172.21.15.94:0/1143741033 >> v2:172.21.15.155:3300/0 conn(0x7f136c06f010 0x7f136c166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340355215 0 0) 0x7f136c0b3290 con 0x7f136c15c2a0 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f134c003530 con 0x7f136c15c2a0 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1847668289 0 0) 0x7f134c003530 con 0x7f136c15c2a0 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 >> v2:172.21.15.155:3300/0 conn(0x7f136c06f010 msgr2=0x7f136c166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 --2- 172.21.15.94:0/1143741033 >> v2:172.21.15.155:3300/0 conn(0x7f136c06f010 0x7f136c166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 >> v1:172.21.15.155:6789/0 conn(0x7f136c15bec0 legacy=0x7f136c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c0b3b30 con 0x7f136c15c2a0 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f135c001a00 con 0x7f136c15c2a0 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 >> v1:172.21.15.94:6789/0 conn(0x7f136c15c2a0 legacy=0x7f136c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c0039c0 0x7f134c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f134c004810 0x7f134c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f134c0051d0 0x7f134c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0b3850 con 0x7f134c004810 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f134c00c070 con 0x7f134c0051d0 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f134c00c270 con 0x7f134c0039c0 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f134c004810 0x7f134c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136affd640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c0039c0 0x7f134c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136b7fe640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f134c0051d0 0x7f134c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 -- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c0039c0 msgr2=0x7f134c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c0039c0 0x7f134c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 -- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f134c0051d0 msgr2=0x7f134c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:47.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f134c0051d0 0x7f134c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136a7fc640 1 -- 172.21.15.94:0/1143741033 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c003530 con 0x7f134c004810 2024-09-11T23:16:47.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136b7fe640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f134c0051d0 0x7f134c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:47.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.318+0000 7f136b7fe640 1 -- 172.21.15.94:0/1143741033 reap_dead start 2024-09-11T23:16:47.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f136a7fc640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f134c004810 0x7f134c004c90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f135c00a810 tx=0x7f135c01fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63daac31c38e3ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c00a460 con 0x7f134c004810 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c0aa670 con 0x7f134c004810 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f1369ffb640 1 -- 172.21.15.94:0/1143741033 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c0aaaa0 con 0x7f134c004810 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f137179b640 1 -- 172.21.15.94:0/1143741033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f134c004810 msgr2=0x7f134c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f137179b640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f134c004810 0x7f134c004c90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f135c00a810 tx=0x7f135c01fa20 comp rx=0 tx=0).stop 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f137179b640 1 -- 172.21.15.94:0/1143741033 shutdown_connections 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f137179b640 1 --2- 172.21.15.94:0/1143741033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f134c004810 0x7f134c004c90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f137179b640 1 -- 172.21.15.94:0/1143741033 >> 172.21.15.94:0/1143741033 conn(0x7f136c0b1f90 msgr2=0x7f136c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f137179b640 1 -- 172.21.15.94:0/1143741033 shutdown_connections 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.322+0000 7f137179b640 1 -- 172.21.15.94:0/1143741033 wait complete. 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 Processor -- start 2024-09-11T23:16:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 -- start start 2024-09-11T23:16:47.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c004810 0x7f136c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f136c099ab0 0x7f136c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f136c154de0 0x7f136c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0afc90 con 0x7f136c154de0 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0b40f0 con 0x7f136c099ab0 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f136c0ad200 con 0x7f134c004810 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f136c154de0 0x7f136c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f136c154de0 0x7f136c0b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39330/0 (socket says 172.21.15.94:39330) 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 -- 172.21.15.94:0/1032572777 learned_addr learned my addr 172.21.15.94:0/1032572777 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136a7fc640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f136c099ab0 0x7f136c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136affd640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c004810 0x7f136c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 -- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c004810 msgr2=0x7f136c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c004810 0x7f136c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 -- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f136c099ab0 msgr2=0x7f136c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f136c099ab0 0x7f136c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 -- 172.21.15.94:0/1032572777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c155340 con 0x7f136c154de0 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136a7fc640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f136c099ab0 0x7f136c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136affd640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c004810 0x7f136c1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f136b7fe640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f136c154de0 0x7f136c0b0be0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f136c06f460 tx=0x7f1354010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f13637fe640 1 -- 172.21.15.94:0/1032572777 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135400f040 con 0x7f136c154de0 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f13637fe640 1 -- 172.21.15.94:0/1032572777 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135401c070 con 0x7f136c154de0 2024-09-11T23:16:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136c155620 con 0x7f136c154de0 2024-09-11T23:16:47.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f13637fe640 1 -- 172.21.15.94:0/1032572777 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135400ea70 con 0x7f136c154de0 2024-09-11T23:16:47.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136c155be0 con 0x7f136c154de0 2024-09-11T23:16:47.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136c099e90 con 0x7f136c154de0 2024-09-11T23:16:47.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.326+0000 7f13637fe640 1 -- 172.21.15.94:0/1032572777 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f135400ec10 con 0x7f136c154de0 2024-09-11T23:16:47.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.330+0000 7f13637fe640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13500678f0 0x7f1350069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.330+0000 7f13637fe640 1 -- 172.21.15.94:0/1032572777 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f1354085670 con 0x7f136c154de0 2024-09-11T23:16:47.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.330+0000 7f136affd640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13500678f0 0x7f1350069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.330+0000 7f136affd640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13500678f0 0x7f1350069db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1364000c10 tx=0x7f1364009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.334+0000 7f13637fe640 1 -- 172.21.15.94:0/1032572777 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f136c099e90 con 0x7f136c154de0 2024-09-11T23:16:47.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.494+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f136c0ad530 con 0x7f136c154de0 2024-09-11T23:16:47.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f13637fe640 1 -- 172.21.15.94:0/1032572777 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+13329 (secure 0 0 0) 0x7f1354026020 con 0x7f136c154de0 2024-09-11T23:16:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:47.502 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":42,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:16:46.158751+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.94:6835/2889518527":"2024-09-12T23:16:43.144105+0000","172.21.15.94:6834/2889518527":"2024-09-12T23:16:43.144105+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:47.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13500678f0 msgr2=0x7f1350069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13500678f0 0x7f1350069db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1364000c10 tx=0x7f1364009040 comp rx=0 tx=0).stop 2024-09-11T23:16:47.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f136c154de0 msgr2=0x7f136c0b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f136c154de0 0x7f136c0b0be0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f136c06f460 tx=0x7f1354010c20 comp rx=0 tx=0).stop 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 shutdown_connections 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13500678f0 0x7f1350069db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f136c154de0 0x7f136c0b0be0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f136c099ab0 0x7f136c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 --2- 172.21.15.94:0/1032572777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f134c004810 0x7f136c1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 >> 172.21.15.94:0/1032572777 conn(0x7f136c0b1f90 msgr2=0x7f136c15aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 shutdown_connections 2024-09-11T23:16:47.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.498+0000 7f137179b640 1 -- 172.21.15.94:0/1032572777 wait complete. 2024-09-11T23:16:47.521 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:15:02.040073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:16:47.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:16:47.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.646+0000 7fc416e75640 1 Processor -- start 2024-09-11T23:16:47.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.646+0000 7fc416e75640 1 -- start start 2024-09-11T23:16:47.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc416e75640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 0x7fc41006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc416e75640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006ee50 con 0x7fc41006fef0 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc416e75640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006f130 con 0x7fc4100b3d50 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc416e75640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc41006f410 con 0x7fc410073e60 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc41006fef0 0x7fc41015b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46176/0 (socket says 172.21.15.94:46176) 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40ffff640 1 -- 172.21.15.94:0/980024923 learned_addr learned my addr 172.21.15.94:0/980024923 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc414c11640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 0x7fc41006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599063031 0 0) 0x7fc41006ee50 con 0x7fc41006fef0 2024-09-11T23:16:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc003530 con 0x7fc41006fef0 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 581745352 0 0) 0x7fc3fc003530 con 0x7fc41006fef0 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 msgr2=0x7fc41006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 0x7fc41006e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 >> v1:172.21.15.155:6789/0 conn(0x7fc4100b3d50 legacy=0x7fc410072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41006f6f0 con 0x7fc41006fef0 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fc3f8001680 con 0x7fc41006fef0 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 >> v1:172.21.15.94:6789/0 conn(0x7fc41006fef0 legacy=0x7fc41015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 0x7fc3fc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc003f30 0x7fc3fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3fc004d50 0x7fc3fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc41006f410 con 0x7fc3fc004d50 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc00bae0 con 0x7fc3fc003f30 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc00bce0 con 0x7fc410073e60 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc415412640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3fc004d50 0x7fc3fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40ffff640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc003f30 0x7fc3fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc414c11640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 0x7fc3fc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc415412640 1 -- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 msgr2=0x7fc3fc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc415412640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc410073e60 0x7fc3fc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc415412640 1 -- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc003f30 msgr2=0x7fc3fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc415412640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc003f30 0x7fc3fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc415412640 1 -- 172.21.15.94:0/980024923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc003530 con 0x7fc3fc004d50 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc415412640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3fc004d50 0x7fc3fc0051d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc408001f60 tx=0x7fc40801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f4497f083cf498 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408001b60 con 0x7fc3fc004d50 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4080a9670 con 0x7fc3fc004d50 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.650+0000 7fc40f7fe640 1 -- 172.21.15.94:0/980024923 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080a9aa0 con 0x7fc3fc004d50 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- 172.21.15.94:0/980024923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3fc004d50 msgr2=0x7fc3fc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 --2- 172.21.15.94:0/980024923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3fc004d50 0x7fc3fc0051d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc408001f60 tx=0x7fc40801c880 comp rx=0 tx=0).stop 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc415412640 1 -- 172.21.15.94:0/980024923 reap_dead start 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- 172.21.15.94:0/980024923 shutdown_connections 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- 172.21.15.94:0/980024923 >> 172.21.15.94:0/980024923 conn(0x7fc4100b1f90 msgr2=0x7fc4100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- 172.21.15.94:0/980024923 shutdown_connections 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- 172.21.15.94:0/980024923 wait complete. 2024-09-11T23:16:47.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 Processor -- start 2024-09-11T23:16:47.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- start start 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc004d50 0x7fc410098ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc410099840 0x7fc410099220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41014a840 0x7fc41014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc41006e300 con 0x7fc410099840 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc41006e180 con 0x7fc3fc004d50 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc41006e480 con 0x7fc41014a840 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc410099840 0x7fc410099220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc410099840 0x7fc410099220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39340/0 (socket says 172.21.15.94:39340) 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 -- 172.21.15.94:0/2510291778 learned_addr learned my addr 172.21.15.94:0/2510291778 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:47.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc414c11640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc004d50 0x7fc410098ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc415412640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41014a840 0x7fc41014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 -- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41014a840 msgr2=0x7fc41014acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41014a840 0x7fc41014acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 -- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc004d50 msgr2=0x7fc410098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc004d50 0x7fc410098ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 -- 172.21.15.94:0/2510291778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc410154e20 con 0x7fc410099840 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40ffff640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc410099840 0x7fc410099220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800e7e0 tx=0x7fc3f800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40d7fa640 1 -- 172.21.15.94:0/2510291778 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800c660 con 0x7fc410099840 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40d7fa640 1 -- 172.21.15.94:0/2510291778 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f8018070 con 0x7fc410099840 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41014f730 con 0x7fc410099840 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc40d7fa640 1 -- 172.21.15.94:0/2510291778 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800ca60 con 0x7fc410099840 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.654+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4100af420 con 0x7fc410099840 2024-09-11T23:16:47.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.658+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41006edb0 con 0x7fc410099840 2024-09-11T23:16:47.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.658+0000 7fc40d7fa640 1 -- 172.21.15.94:0/2510291778 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3f800cc00 con 0x7fc410099840 2024-09-11T23:16:47.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.658+0000 7fc40d7fa640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3f00678f0 0x7fc3f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.658+0000 7fc40d7fa640 1 -- 172.21.15.94:0/2510291778 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7fc3f8085500 con 0x7fc410099840 2024-09-11T23:16:47.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.658+0000 7fc414c11640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3f00678f0 0x7fc3f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.658+0000 7fc414c11640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3f00678f0 0x7fc3f0069db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc41015b8a0 tx=0x7fc400008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.662+0000 7fc40d7fa640 1 -- 172.21.15.94:0/2510291778 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc410154e20 con 0x7fc410099840 2024-09-11T23:16:47.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.826+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc41015b5f0 con 0x7fc410099840 2024-09-11T23:16:47.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.826+0000 7fc40d7fa640 1 -- 172.21.15.94:0/2510291778 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7fc3f8056240 con 0x7fc410099840 2024-09-11T23:16:47.831 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-09-11T23:16:47.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.826+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3f00678f0 msgr2=0x7fc3f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.826+0000 7fc416e75640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3f00678f0 0x7fc3f0069db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc41015b8a0 tx=0x7fc400008040 comp rx=0 tx=0).stop 2024-09-11T23:16:47.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.826+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc410099840 msgr2=0x7fc410099220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc410099840 0x7fc410099220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800e7e0 tx=0x7fc3f800eca0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 shutdown_connections 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41014a840 0x7fc41014acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3f00678f0 0x7fc3f0069db0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc410099840 0x7fc410099220 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 --2- 172.21.15.94:0/2510291778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc004d50 0x7fc410098ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 >> 172.21.15.94:0/2510291778 conn(0x7fc4100b1f90 msgr2=0x7fc410074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 shutdown_connections 2024-09-11T23:16:47.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.830+0000 7fc416e75640 1 -- 172.21.15.94:0/2510291778 wait complete. 2024-09-11T23:16:47.850 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2024-09-11T23:16:47.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c5145a640 1 Processor -- start 2024-09-11T23:16:47.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c5145a640 1 -- start start 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c5145a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c4c161a60 0x7f8c4c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c5145a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c4c0cf620 0x7f8c4c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c5145a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4c0d32b0 con 0x7f8c4c0d2e90 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c5145a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4c0d0300 con 0x7f8c4c0cf620 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c5145a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4c0cfa90 con 0x7f8c4c161a60 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c4c0cf620 0x7f8c4c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4a7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8c4c0d2e90 0x7f8c4c0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46190/0 (socket says 172.21.15.94:46190) 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4a7fc640 1 -- 172.21.15.94:0/3193862561 learned_addr learned my addr 172.21.15.94:0/3193862561 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4affd640 1 --2- 172.21.15.94:0/3193862561 >> v2:172.21.15.155:3300/0 conn(0x7f8c4c161a60 0x7f8c4c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4b7fe640 1 -- 172.21.15.94:0/3193862561 >> v2:172.21.15.155:3300/0 conn(0x7f8c4c161a60 msgr2=0x7f8c4c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4b7fe640 1 --2- 172.21.15.94:0/3193862561 >> v2:172.21.15.155:3300/0 conn(0x7f8c4c161a60 0x7f8c4c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4b7fe640 1 -- 172.21.15.94:0/3193862561 >> v1:172.21.15.94:6789/0 conn(0x7f8c4c0d2e90 legacy=0x7f8c4c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.962+0000 7f8c4b7fe640 1 -- 172.21.15.94:0/3193862561 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c0b0f60 con 0x7f8c4c0cf620 2024-09-11T23:16:47.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4b7fe640 1 --2- 172.21.15.94:0/3193862561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c06d6b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c08e010 tx=0x7f8c4401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e65e7098eb05ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c49ffb640 1 -- 172.21.15.94:0/3193862561 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440b2070 con 0x7f8c4c0cf620 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c49ffb640 1 -- 172.21.15.94:0/3193862561 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c440a5930 con 0x7f8c4c0cf620 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c49ffb640 1 -- 172.21.15.94:0/3193862561 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440a5d00 con 0x7f8c4c0cf620 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- 172.21.15.94:0/3193862561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 msgr2=0x7f8c4c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 --2- 172.21.15.94:0/3193862561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c06d6b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c08e010 tx=0x7f8c4401c870 comp rx=0 tx=0).stop 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- 172.21.15.94:0/3193862561 shutdown_connections 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 --2- 172.21.15.94:0/3193862561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c06d6b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 --2- 172.21.15.94:0/3193862561 >> v2:172.21.15.155:3300/0 conn(0x7f8c4c161a60 0x7f8c4c0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- 172.21.15.94:0/3193862561 >> 172.21.15.94:0/3193862561 conn(0x7f8c4c08bf90 msgr2=0x7f8c4c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- 172.21.15.94:0/3193862561 shutdown_connections 2024-09-11T23:16:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- 172.21.15.94:0/3193862561 wait complete. 2024-09-11T23:16:47.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 Processor -- start 2024-09-11T23:16:47.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- start start 2024-09-11T23:16:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4c0d2e90 0x7f8c4c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c4c161a60 0x7f8c4c1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c06e400 con 0x7f8c4c0cf620 2024-09-11T23:16:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c06d190 con 0x7f8c4c161a60 2024-09-11T23:16:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c5145a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4c06e580 con 0x7f8c4c0d2e90 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c1528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39356/0 (socket says 172.21.15.94:39356) 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 -- 172.21.15.94:0/2446843773 learned_addr learned my addr 172.21.15.94:0/2446843773 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4a7fc640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4c0d2e90 0x7f8c4c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4b7fe640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c4c161a60 0x7f8c4c1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 -- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4c0d2e90 msgr2=0x7f8c4c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4c0d2e90 0x7f8c4c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 -- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c4c161a60 msgr2=0x7f8c4c1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c4c161a60 0x7f8c4c1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.966+0000 7f8c4affd640 1 -- 172.21.15.94:0/2446843773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c151840 con 0x7f8c4c0cf620 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c4affd640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c1528e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d830 tx=0x7f8c3c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c337fe640 1 -- 172.21.15.94:0/2446843773 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00b6c0 con 0x7f8c4c0cf620 2024-09-11T23:16:47.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c337fe640 1 -- 172.21.15.94:0/2446843773 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c019070 con 0x7f8c4c0cf620 2024-09-11T23:16:47.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4c151b20 con 0x7f8c4c0cf620 2024-09-11T23:16:47.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c337fe640 1 -- 172.21.15.94:0/2446843773 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00ba60 con 0x7f8c4c0cf620 2024-09-11T23:16:47.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4c1520e0 con 0x7f8c4c0cf620 2024-09-11T23:16:47.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4c06d6b0 con 0x7f8c4c0cf620 2024-09-11T23:16:47.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c337fe640 1 -- 172.21.15.94:0/2446843773 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c3c01e460 con 0x7f8c4c0cf620 2024-09-11T23:16:47.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c337fe640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c380678c0 0x7f8c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:47.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c337fe640 1 -- 172.21.15.94:0/2446843773 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f8c3c086350 con 0x7f8c4c0cf620 2024-09-11T23:16:47.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c4a7fc640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c380678c0 0x7f8c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:47.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.970+0000 7f8c4a7fc640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c380678c0 0x7f8c38069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c1fa480 tx=0x7f8c40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:47.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:47.974+0000 7f8c337fe640 1 -- 172.21.15.94:0/2446843773 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c3c056f60 con 0x7f8c4c0cf620 2024-09-11T23:16:48.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:48.190+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) -- 0x7f8c4c0b4370 con 0x7f8c4c0cf620 2024-09-11T23:16:49.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.178+0000 7f8c337fe640 1 -- 172.21.15.94:0/2446843773 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v106) ==== 136+0+0 (secure 0 0 0) 0x7f8c3c056860 con 0x7f8c4c0cf620 2024-09-11T23:16:49.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c380678c0 msgr2=0x7f8c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c380678c0 0x7f8c38069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c1fa480 tx=0x7f8c40009040 comp rx=0 tx=0).stop 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 msgr2=0x7f8c4c1528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c1528e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d830 tx=0x7f8c3c00dcf0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 shutdown_connections 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c4c161a60 0x7f8c4c1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4c0d2e90 0x7f8c4c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c380678c0 0x7f8c38069d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 --2- 172.21.15.94:0/2446843773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c4c0cf620 0x7f8c4c1528e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 >> 172.21.15.94:0/2446843773 conn(0x7f8c4c08bf90 msgr2=0x7f8c4c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:49.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 shutdown_connections 2024-09-11T23:16:49.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.182+0000 7f8c5145a640 1 -- 172.21.15.94:0/2446843773 wait complete. 2024-09-11T23:16:49.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:16:49.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5579899640 1 Processor -- start 2024-09-11T23:16:49.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5579899640 1 -- start start 2024-09-11T23:16:49.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5579899640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409b040 0x7f557409ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5579899640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55740af730 0x7f557415d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5579899640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55740afd80 con 0x7f557409ac60 2024-09-11T23:16:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5579899640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f55740b0060 con 0x7f55740af730 2024-09-11T23:16:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5579899640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f55740b0340 con 0x7f557409b040 2024-09-11T23:16:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55727fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409b040 0x7f557409ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55737fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55740af730 0x7f557415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55737fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55740af730 0x7f557415d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:59104/0 (socket says 172.21.15.94:59104) 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55737fe640 1 -- 172.21.15.94:0/1411493681 learned_addr learned my addr 172.21.15.94:0/1411493681 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f5572ffd640 1 --1- 172.21.15.94:0/1411493681 >> v1:172.21.15.155:6789/0 conn(0x7f557409ac60 0x7f55740b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:59414/0 (socket says 172.21.15.94:59414) 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55737fe640 1 -- 172.21.15.94:0/1411493681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409b040 msgr2=0x7f557409ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55737fe640 1 --2- 172.21.15.94:0/1411493681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409b040 0x7f557409ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55737fe640 1 -- 172.21.15.94:0/1411493681 >> v1:172.21.15.155:6789/0 conn(0x7f557409ac60 legacy=0x7f55740b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.338+0000 7f55737fe640 1 -- 172.21.15.94:0/1411493681 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55740b0620 con 0x7f55740af730 2024-09-11T23:16:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f55737fe640 1 --2- 172.21.15.94:0/1411493681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 0x7f557415d010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f556c009e50 tx=0x7f556c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7884ba82c209631 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5571ffb640 1 -- 172.21.15.94:0/1411493681 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c0a5770 con 0x7f55740af730 2024-09-11T23:16:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5571ffb640 1 -- 172.21.15.94:0/1411493681 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556c0a5910 con 0x7f55740af730 2024-09-11T23:16:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5571ffb640 1 -- 172.21.15.94:0/1411493681 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c0a5ce0 con 0x7f55740af730 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 -- 172.21.15.94:0/1411493681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 msgr2=0x7f557415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 --2- 172.21.15.94:0/1411493681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 0x7f557415d010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f556c009e50 tx=0x7f556c01c9a0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 -- 172.21.15.94:0/1411493681 shutdown_connections 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 --2- 172.21.15.94:0/1411493681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 0x7f557415d010 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 --2- 172.21.15.94:0/1411493681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409b040 0x7f557409ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 -- 172.21.15.94:0/1411493681 >> 172.21.15.94:0/1411493681 conn(0x7f55740b78d0 msgr2=0x7f55740b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 -- 172.21.15.94:0/1411493681 shutdown_connections 2024-09-11T23:16:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.342+0000 7f5579899640 1 -- 172.21.15.94:0/1411493681 wait complete. 2024-09-11T23:16:49.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 Processor -- start 2024-09-11T23:16:49.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 -- start start 2024-09-11T23:16:49.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409ac60 0x7f557414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f557409b040 0x7f557414ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 0x7f557415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f55740b2540 con 0x7f557409b040 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55740b23c0 con 0x7f55740af730 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5574168d70 con 0x7f557409ac60 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f557409b040 0x7f557414ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f557409b040 0x7f557414ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39372/0 (socket says 172.21.15.94:39372) 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 -- 172.21.15.94:0/972384757 learned_addr learned my addr 172.21.15.94:0/972384757 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55737fe640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 0x7f557415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5572ffd640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409ac60 0x7f557414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 -- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409ac60 msgr2=0x7f557414c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409ac60 0x7f557414c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 -- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 msgr2=0x7f557415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 0x7f557415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 -- 172.21.15.94:0/972384757 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557414bcf0 con 0x7f557409b040 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5572ffd640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409ac60 0x7f557414c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f55727fc640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f557409b040 0x7f557414ac20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f556800e980 tx=0x7f556800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f555bfff640 1 -- 172.21.15.94:0/972384757 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568017070 con 0x7f557409b040 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5574150330 con 0x7f557409b040 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f555bfff640 1 -- 172.21.15.94:0/972384757 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556800ca00 con 0x7f557409b040 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f555bfff640 1 -- 172.21.15.94:0/972384757 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556800cdd0 con 0x7f557409b040 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557414c490 con 0x7f557409b040 2024-09-11T23:16:49.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5574071c60 con 0x7f557409b040 2024-09-11T23:16:49.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.346+0000 7f555bfff640 1 -- 172.21.15.94:0/972384757 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5568013470 con 0x7f557409b040 2024-09-11T23:16:49.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.350+0000 7f555bfff640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f55600678c0 0x7f5560069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.350+0000 7f555bfff640 1 -- 172.21.15.94:0/972384757 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f55680857c0 con 0x7f557409b040 2024-09-11T23:16:49.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.350+0000 7f5572ffd640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f55600678c0 0x7f5560069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.350+0000 7f5572ffd640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f55600678c0 0x7f5560069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5564000f70 tx=0x7f5564009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.354+0000 7f555bfff640 1 -- 172.21.15.94:0/972384757 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f557414bcf0 con 0x7f557409b040 2024-09-11T23:16:49.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.514+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f557409b980 con 0x7f557409b040 2024-09-11T23:16:49.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.518+0000 7f555bfff640 1 -- 172.21.15.94:0/972384757 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f5568056480 con 0x7f557409b040 2024-09-11T23:16:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f55600678c0 msgr2=0x7f5560069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f55600678c0 0x7f5560069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5564000f70 tx=0x7f5564009040 comp rx=0 tx=0).stop 2024-09-11T23:16:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f557409b040 msgr2=0x7f557414ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f557409b040 0x7f557414ac20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f556800e980 tx=0x7f556800ee40 comp rx=0 tx=0).stop 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 shutdown_connections 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55740af730 0x7f557415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f55600678c0 0x7f5560069d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f557409b040 0x7f557414ac20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 --2- 172.21.15.94:0/972384757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f557409ac60 0x7f557414c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 >> 172.21.15.94:0/972384757 conn(0x7f55740b78d0 msgr2=0x7f5574071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 shutdown_connections 2024-09-11T23:16:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.522+0000 7f5579899640 1 -- 172.21.15.94:0/972384757 wait complete. 2024-09-11T23:16:49.545 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:16:49.545 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:16:49.603 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:16:49.650 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:16:49.650 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:16:49.650 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:49.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:16:49.656 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:16:49.656 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:49.662 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:16:49.662 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:16:49.662 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:49.702 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:16:49.703 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:16:49.703 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:49.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:16:49.708 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:16:49.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:16:49.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.866+0000 7ff698fc5640 1 Processor -- start 2024-09-11T23:16:49.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.866+0000 7ff698fc5640 1 -- start start 2024-09-11T23:16:49.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff698fc5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff69415c2a0 0x7ff6940aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff698fc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6940af2a0 0x7ff69406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff698fc5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6940b3290 con 0x7ff69415bec0 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff698fc5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff6940b3570 con 0x7ff69415c2a0 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff698fc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6940b3850 con 0x7ff6940af2a0 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff69415c2a0 0x7ff6940aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff69415c2a0 0x7ff6940aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40020/0 (socket says 172.21.15.94:40020) 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 -- 172.21.15.94:0/4126455634 learned_addr learned my addr 172.21.15.94:0/4126455634 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 -- 172.21.15.94:0/4126455634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6940af2a0 msgr2=0x7ff69406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff692d9d640 1 --2- 172.21.15.94:0/4126455634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6940af2a0 0x7ff69406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 --2- 172.21.15.94:0/4126455634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6940af2a0 0x7ff69406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 -- 172.21.15.94:0/4126455634 >> v1:172.21.15.155:6789/0 conn(0x7ff69415bec0 legacy=0x7ff6940ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 -- 172.21.15.94:0/4126455634 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6940b3b30 con 0x7ff69415c2a0 2024-09-11T23:16:49.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff691d9b640 1 --2- 172.21.15.94:0/4126455634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff6940aed60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff684009870 tx=0x7ff68401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee13e224feb64a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff69159a640 1 -- 172.21.15.94:0/4126455634 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6840a95f0 con 0x7ff69415c2a0 2024-09-11T23:16:49.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff69159a640 1 -- 172.21.15.94:0/4126455634 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6840a9790 con 0x7ff69415c2a0 2024-09-11T23:16:49.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.870+0000 7ff69159a640 1 -- 172.21.15.94:0/4126455634 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6840a9b60 con 0x7ff69415c2a0 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- 172.21.15.94:0/4126455634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 msgr2=0x7ff6940aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 --2- 172.21.15.94:0/4126455634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff6940aed60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff684009870 tx=0x7ff68401c530 comp rx=0 tx=0).stop 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- 172.21.15.94:0/4126455634 shutdown_connections 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 --2- 172.21.15.94:0/4126455634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6940af2a0 0x7ff69406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 --2- 172.21.15.94:0/4126455634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff6940aed60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- 172.21.15.94:0/4126455634 >> 172.21.15.94:0/4126455634 conn(0x7ff6940b1f90 msgr2=0x7ff6940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- 172.21.15.94:0/4126455634 shutdown_connections 2024-09-11T23:16:49.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- 172.21.15.94:0/4126455634 wait complete. 2024-09-11T23:16:49.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 Processor -- start 2024-09-11T23:16:49.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- start start 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6940af2a0 0x7ff69414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff69415bec0 0x7ff694148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff694152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff69406ed50 con 0x7ff69415c2a0 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff6940af6b0 con 0x7ff6940af2a0 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff69406eed0 con 0x7ff69415bec0 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff694152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff694152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40028/0 (socket says 172.21.15.94:40028) 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 -- 172.21.15.94:0/1208695834 learned_addr learned my addr 172.21.15.94:0/1208695834 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff691d9b640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff69415bec0 0x7ff694148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff69259c640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6940af2a0 0x7ff69414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 -- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff69415bec0 msgr2=0x7ff694148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff69415bec0 0x7ff694148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 -- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6940af2a0 msgr2=0x7ff69414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6940af2a0 0x7ff69414a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 -- 172.21.15.94:0/1208695834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6941496a0 con 0x7ff69415c2a0 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff692d9d640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff694152e10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00cda0 tx=0x7ff68c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff68affd640 1 -- 172.21.15.94:0/1208695834 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c003ba0 con 0x7ff69415c2a0 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff68affd640 1 -- 172.21.15.94:0/1208695834 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c003d40 con 0x7ff69415c2a0 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff694149980 con 0x7ff69415c2a0 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff68affd640 1 -- 172.21.15.94:0/1208695834 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c004240 con 0x7ff69415c2a0 2024-09-11T23:16:49.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.874+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff694149f40 con 0x7ff69415c2a0 2024-09-11T23:16:49.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.878+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69406e000 con 0x7ff69415c2a0 2024-09-11T23:16:49.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.878+0000 7ff68affd640 1 -- 172.21.15.94:0/1208695834 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff68c0043e0 con 0x7ff69415c2a0 2024-09-11T23:16:49.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.878+0000 7ff68affd640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6740678f0 0x7ff674069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.878+0000 7ff68affd640 1 -- 172.21.15.94:0/1208695834 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7ff68c086550 con 0x7ff69415c2a0 2024-09-11T23:16:49.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.878+0000 7ff69259c640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6740678f0 0x7ff674069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.878+0000 7ff69259c640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6740678f0 0x7ff674069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff69415a120 tx=0x7ff67c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:49.882+0000 7ff68affd640 1 -- 172.21.15.94:0/1208695834 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff68c057290 con 0x7ff69415c2a0 2024-09-11T23:16:50.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.078+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff69406fcd0 con 0x7ff69415c2a0 2024-09-11T23:16:50.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff68affd640 1 -- 172.21.15.94:0/1208695834 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3914 (secure 0 0 0) 0x7ff68c056b90 con 0x7ff69415c2a0 2024-09-11T23:16:50.085 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:50.085 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":17,"btime":"2024-09-11T23:16:44:146784+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1155310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1155310400},{"type":"v1","addr":"172.21.15.155:6837","nonce":1155310400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1606654445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1606654445},{"type":"v1","addr":"172.21.15.155:6836","nonce":1606654445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/1536318323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":1536318323},{"type":"v1","addr":"172.21.15.94:6833","nonce":1536318323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/553095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":553095783},{"type":"v1","addr":"172.21.15.94:6835","nonce":553095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-11T23:16:50.086 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 17 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6740678f0 msgr2=0x7ff674069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6740678f0 0x7ff674069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff69415a120 tx=0x7ff67c009040 comp rx=0 tx=0).stop 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 msgr2=0x7ff694152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff694152e10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00cda0 tx=0x7ff68c00a660 comp rx=0 tx=0).stop 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 shutdown_connections 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6740678f0 0x7ff674069db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff69415c2a0 0x7ff694152e10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff69415bec0 0x7ff694148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 --2- 172.21.15.94:0/1208695834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6940af2a0 0x7ff69414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 >> 172.21.15.94:0/1208695834 conn(0x7ff6940b1f90 msgr2=0x7ff6941597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 shutdown_connections 2024-09-11T23:16:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:50.082+0000 7ff698fc5640 1 -- 172.21.15.94:0/1208695834 wait complete. 2024-09-11T23:16:50.105 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:16:50.106 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:16:50.106 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:16:50.106 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:50.106 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:16:50.106 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:16:50.107 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:16:50.107 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:50.107 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:16:50.107 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:16:50.107 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:16:50.107 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:50.108 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:16:50.108 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:16:50.108 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:16:50.108 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:50.120 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:16:50.120 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:16:50.132 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:16:50.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:16:50.133 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:16:50.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:16:50.166 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:16:50.166 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:50.177 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:16:50.178 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:50.178 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:16:50.178 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:50.234 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:16:50.253 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:16:50.253 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:16:50.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-11T23:16:56.120 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:16:56.120 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:16:56.123 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:16:56.123 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:56.124 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:16:56.199 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:16:56.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f174711b640 1 Processor -- start 2024-09-11T23:16:56.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f174711b640 1 -- start start 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f174711b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160520 0x7f1740071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f174711b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1740160900 0x7f1740071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f174711b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17400d0d70 con 0x7f174015c5f0 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f174711b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f174015d170 con 0x7f1740160900 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f174711b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f17400d1640 con 0x7f1740160520 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1740160900 0x7f1740071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1740160900 0x7f1740071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40062/0 (socket says 172.21.15.94:40062) 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 -- 172.21.15.94:0/38041190 learned_addr learned my addr 172.21.15.94:0/38041190 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f1744eb7640 1 --2- 172.21.15.94:0/38041190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160520 0x7f1740071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 -- 172.21.15.94:0/38041190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160520 msgr2=0x7f1740071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 --2- 172.21.15.94:0/38041190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160520 0x7f1740071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:56.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 -- 172.21.15.94:0/38041190 >> v1:172.21.15.155:6789/0 conn(0x7f174015c5f0 legacy=0x7f174015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:56.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 -- 172.21.15.94:0/38041190 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174015d390 con 0x7f1740160900 2024-09-11T23:16:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173ffff640 1 --2- 172.21.15.94:0/38041190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1740160900 0x7f1740071c90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1734009870 tx=0x7f173401c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4059e1a49a14ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.246+0000 7f173f7fe640 1 -- 172.21.15.94:0/38041190 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340b0070 con 0x7f1740160900 2024-09-11T23:16:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f173f7fe640 1 -- 172.21.15.94:0/38041190 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17340ab600 con 0x7f1740160900 2024-09-11T23:16:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f173f7fe640 1 -- 172.21.15.94:0/38041190 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340ab9d0 con 0x7f1740160900 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- 172.21.15.94:0/38041190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1740160900 msgr2=0x7f1740071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 --2- 172.21.15.94:0/38041190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1740160900 0x7f1740071c90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1734009870 tx=0x7f173401c2b0 comp rx=0 tx=0).stop 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- 172.21.15.94:0/38041190 shutdown_connections 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 --2- 172.21.15.94:0/38041190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1740160900 0x7f1740071c90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 --2- 172.21.15.94:0/38041190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160520 0x7f1740071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- 172.21.15.94:0/38041190 >> 172.21.15.94:0/38041190 conn(0x7f174006c0c0 msgr2=0x7f174006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- 172.21.15.94:0/38041190 shutdown_connections 2024-09-11T23:16:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- 172.21.15.94:0/38041190 wait complete. 2024-09-11T23:16:56.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 Processor -- start 2024-09-11T23:16:56.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- start start 2024-09-11T23:16:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f174015c5f0 0x7f174013ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740160520 0x7f1740142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160900 0x7f174013e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1740141190 con 0x7f174015c5f0 2024-09-11T23:16:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17400d2ae0 con 0x7f1740160520 2024-09-11T23:16:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1740141310 con 0x7f1740160900 2024-09-11T23:16:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f174015c5f0 0x7f174013ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f174015c5f0 0x7f174013ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40072/0 (socket says 172.21.15.94:40072) 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 -- 172.21.15.94:0/2347200802 learned_addr learned my addr 172.21.15.94:0/2347200802 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f173ffff640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740160520 0x7f1740142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f17456b8640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160900 0x7f174013e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 -- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160900 msgr2=0x7f174013e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160900 0x7f174013e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 -- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740160520 msgr2=0x7f1740142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740160520 0x7f1740142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 -- 172.21.15.94:0/2347200802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174006e020 con 0x7f174015c5f0 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f17456b8640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160900 0x7f174013e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f1744eb7640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f174015c5f0 0x7f174013ce00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f173000c820 tx=0x7f173000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f173d7fa640 1 -- 172.21.15.94:0/2347200802 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730015070 con 0x7f174015c5f0 2024-09-11T23:16:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f173d7fa640 1 -- 172.21.15.94:0/2347200802 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1730004240 con 0x7f174015c5f0 2024-09-11T23:16:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174006e300 con 0x7f174015c5f0 2024-09-11T23:16:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f173d7fa640 1 -- 172.21.15.94:0/2347200802 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173000ce10 con 0x7f174015c5f0 2024-09-11T23:16:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.250+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174006e950 con 0x7f174015c5f0 2024-09-11T23:16:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.254+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174015ca60 con 0x7f174015c5f0 2024-09-11T23:16:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.254+0000 7f173d7fa640 1 -- 172.21.15.94:0/2347200802 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1730007830 con 0x7f174015c5f0 2024-09-11T23:16:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.254+0000 7f173d7fa640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f172c0678c0 0x7f172c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.254+0000 7f173d7fa640 1 -- 172.21.15.94:0/2347200802 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f1730085960 con 0x7f174015c5f0 2024-09-11T23:16:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.254+0000 7f173ffff640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f172c0678c0 0x7f172c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.254+0000 7f173ffff640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f172c0678c0 0x7f172c069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f17340ad000 tx=0x7f17340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:56.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.258+0000 7f173d7fa640 1 -- 172.21.15.94:0/2347200802 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17300566a0 con 0x7f174015c5f0 2024-09-11T23:16:56.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:56.426+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f174015aab0 con 0x7f174015c5f0 2024-09-11T23:16:57.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-11T23:16:58.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.210+0000 7f173d7fa640 1 -- 172.21.15.94:0/2347200802 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) ==== 97+0+0 (secure 0 0 0) 0x7f1730055fa0 con 0x7f174015c5f0 2024-09-11T23:16:58.215 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2024-09-11T23:16:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f172c0678c0 msgr2=0x7f172c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f172c0678c0 0x7f172c069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f17340ad000 tx=0x7f17340a6000 comp rx=0 tx=0).stop 2024-09-11T23:16:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f174015c5f0 msgr2=0x7f174013ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f174015c5f0 0x7f174013ce00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f173000c820 tx=0x7f173000cce0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 shutdown_connections 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1740160900 0x7f174013e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740160520 0x7f1740142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f172c0678c0 0x7f172c069d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 --2- 172.21.15.94:0/2347200802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f174015c5f0 0x7f174013ce00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 >> 172.21.15.94:0/2347200802 conn(0x7f174006c0c0 msgr2=0x7f174015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 shutdown_connections 2024-09-11T23:16:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.214+0000 7f174711b640 1 -- 172.21.15.94:0/2347200802 wait complete. 2024-09-11T23:16:58.241 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:16:58.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff479876640 1 Processor -- start 2024-09-11T23:16:58.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff479876640 1 -- start start 2024-09-11T23:16:58.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff479876640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff4741520a0 0x7ff47406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff479876640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff47406fe50 0x7ff47415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff479876640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff474070250 con 0x7ff47415f1d0 2024-09-11T23:16:58.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff479876640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff474152480 con 0x7ff4741520a0 2024-09-11T23:16:58.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff479876640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff4740aede0 con 0x7ff47406fe50 2024-09-11T23:16:58.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff472ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff4741520a0 0x7ff47406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff4737fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff47415f1d0 0x7ff474071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33928/0 (socket says 172.21.15.94:33928) 2024-09-11T23:16:58.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff4737fe640 1 -- 172.21.15.94:0/4209564935 learned_addr learned my addr 172.21.15.94:0/4209564935 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:58.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff46bfff640 1 --2- 172.21.15.94:0/4209564935 >> v2:172.21.15.155:3300/0 conn(0x7ff47406fe50 0x7ff47415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff472ffd640 1 -- 172.21.15.94:0/4209564935 >> v2:172.21.15.155:3300/0 conn(0x7ff47406fe50 msgr2=0x7ff47415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:58.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff472ffd640 1 --2- 172.21.15.94:0/4209564935 >> v2:172.21.15.155:3300/0 conn(0x7ff47406fe50 0x7ff47415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff472ffd640 1 -- 172.21.15.94:0/4209564935 >> v1:172.21.15.94:6789/0 conn(0x7ff47415f1d0 legacy=0x7ff474071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff4727fc640 1 -- 172.21.15.94:0/4209564935 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731298769 0 0) 0x7ff474070250 con 0x7ff47415f1d0 2024-09-11T23:16:58.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff472ffd640 1 -- 172.21.15.94:0/4209564935 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47415fa10 con 0x7ff4741520a0 2024-09-11T23:16:58.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff46bfff640 1 --2- 172.21.15.94:0/4209564935 >> v2:172.21.15.155:3300/0 conn(0x7ff47406fe50 0x7ff47415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:58.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff472ffd640 1 --2- 172.21.15.94:0/4209564935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47406f910 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff47406e510 tx=0x7ff46401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cdeb01cecb9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:58.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff4727fc640 1 -- 172.21.15.94:0/4209564935 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640b2070 con 0x7ff4741520a0 2024-09-11T23:16:58.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff4727fc640 1 -- 172.21.15.94:0/4209564935 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4640ad680 con 0x7ff4741520a0 2024-09-11T23:16:58.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.358+0000 7ff4727fc640 1 -- 172.21.15.94:0/4209564935 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640ada50 con 0x7ff4741520a0 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- 172.21.15.94:0/4209564935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 msgr2=0x7ff47406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 --2- 172.21.15.94:0/4209564935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47406f910 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff47406e510 tx=0x7ff46401c460 comp rx=0 tx=0).stop 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- 172.21.15.94:0/4209564935 shutdown_connections 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 --2- 172.21.15.94:0/4209564935 >> v2:172.21.15.155:3300/0 conn(0x7ff47406fe50 0x7ff47415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 --2- 172.21.15.94:0/4209564935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47406f910 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- 172.21.15.94:0/4209564935 >> 172.21.15.94:0/4209564935 conn(0x7ff4740b1f90 msgr2=0x7ff4740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- 172.21.15.94:0/4209564935 shutdown_connections 2024-09-11T23:16:58.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- 172.21.15.94:0/4209564935 wait complete. 2024-09-11T23:16:58.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 Processor -- start 2024-09-11T23:16:58.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- start start 2024-09-11T23:16:58.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff47406fe50 0x7ff4741491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff47415f1d0 0x7ff47414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff474073d30 con 0x7ff4741520a0 2024-09-11T23:16:58.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff474073a50 con 0x7ff47415f1d0 2024-09-11T23:16:58.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff47415f620 con 0x7ff47406fe50 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47414cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40080/0 (socket says 172.21.15.94:40080) 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 -- 172.21.15.94:0/3746871792 learned_addr learned my addr 172.21.15.94:0/3746871792 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff4737fe640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff47415f1d0 0x7ff47414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff472ffd640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff47406fe50 0x7ff4741491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 -- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff47406fe50 msgr2=0x7ff4741491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff47406fe50 0x7ff4741491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 -- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff47415f1d0 msgr2=0x7ff47414d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff47415f1d0 0x7ff47414d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 -- 172.21.15.94:0/3746871792 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47414f0f0 con 0x7ff4741520a0 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff4737fe640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff47415f1d0 0x7ff47414d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff46bfff640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47414cbc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00c7f0 tx=0x7ff45c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff470ff9640 1 -- 172.21.15.94:0/3746871792 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c015070 con 0x7ff4741520a0 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff470ff9640 1 -- 172.21.15.94:0/3746871792 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c007820 con 0x7ff4741520a0 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47414f390 con 0x7ff4741520a0 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff470ff9640 1 -- 172.21.15.94:0/3746871792 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c007c10 con 0x7ff4741520a0 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.362+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4741526b0 con 0x7ff4741520a0 2024-09-11T23:16:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.366+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47415ec90 con 0x7ff4741520a0 2024-09-11T23:16:58.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.366+0000 7ff470ff9640 1 -- 172.21.15.94:0/3746871792 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff45c018070 con 0x7ff4741520a0 2024-09-11T23:16:58.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.366+0000 7ff470ff9640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff4540678c0 0x7ff454069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.366+0000 7ff470ff9640 1 -- 172.21.15.94:0/3746871792 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7ff45c085c20 con 0x7ff4741520a0 2024-09-11T23:16:58.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.366+0000 7ff472ffd640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff4540678c0 0x7ff454069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.366+0000 7ff472ffd640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff4540678c0 0x7ff454069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4640af000 tx=0x7ff464008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.370+0000 7ff470ff9640 1 -- 172.21.15.94:0/3746871792 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff45c056920 con 0x7ff4741520a0 2024-09-11T23:16:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.582+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff47406e540 con 0x7ff4741520a0 2024-09-11T23:16:58.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.582+0000 7ff470ff9640 1 -- 172.21.15.94:0/3746871792 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7ff45c056220 con 0x7ff4741520a0 2024-09-11T23:16:58.588 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg==", 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ==", 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ==", 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.591 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg==", 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ==", 2024-09-11T23:16:58.592 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g==", 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.593 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow==", 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.594 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA==", 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw==", 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.595 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g==", 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA==", 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA==", 2024-09-11T23:16:58.597 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ==", 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow r", 2024-09-11T23:16:58.598 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw==", 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ==", 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw==", 2024-09-11T23:16:58.600 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmAziHChAAz9c8+z77RX+g6eeV2hnBGA==", 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:16:58.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA==", 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg==", 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:16:58.603 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:16:58.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff4540678c0 msgr2=0x7ff454069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff4540678c0 0x7ff454069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4640af000 tx=0x7ff464008040 comp rx=0 tx=0).stop 2024-09-11T23:16:58.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 msgr2=0x7ff47414cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47414cbc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00c7f0 tx=0x7ff45c00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 shutdown_connections 2024-09-11T23:16:58.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff47415f1d0 0x7ff47414d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff4540678c0 0x7ff454069d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4741520a0 0x7ff47414cbc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 --2- 172.21.15.94:0/3746871792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff47406fe50 0x7ff4741491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 >> 172.21.15.94:0/3746871792 conn(0x7ff4740b1f90 msgr2=0x7ff474071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:58.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 shutdown_connections 2024-09-11T23:16:58.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.586+0000 7ff479876640 1 -- 172.21.15.94:0/3746871792 wait complete. 2024-09-11T23:16:58.608 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:16:58.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2abc110640 1 Processor -- start 2024-09-11T23:16:58.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2abc110640 1 -- start start 2024-09-11T23:16:58.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2abc110640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2ab415bec0 0x7f2ab40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2abc110640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415c2a0 0x7f2ab40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2abc110640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab40b3290 con 0x7f2ab40af2a0 2024-09-11T23:16:58.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2abc110640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab40b3570 con 0x7f2ab415bec0 2024-09-11T23:16:58.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2abc110640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab40b3850 con 0x7f2ab415c2a0 2024-09-11T23:16:58.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab9eac640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2ab415bec0 0x7f2ab40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2aba6ad640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2ab40af2a0 0x7f2ab415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33936/0 (socket says 172.21.15.94:33936) 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2aba6ad640 1 -- 172.21.15.94:0/2928480165 learned_addr learned my addr 172.21.15.94:0/2928480165 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab96ab640 1 --2- 172.21.15.94:0/2928480165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415c2a0 0x7f2ab40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab9eac640 1 -- 172.21.15.94:0/2928480165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415c2a0 msgr2=0x7f2ab40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab9eac640 1 --2- 172.21.15.94:0/2928480165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415c2a0 0x7f2ab40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab9eac640 1 -- 172.21.15.94:0/2928480165 >> v1:172.21.15.94:6789/0 conn(0x7f2ab40af2a0 legacy=0x7f2ab415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab9eac640 1 -- 172.21.15.94:0/2928480165 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab40b3b30 con 0x7f2ab415bec0 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab8eaa640 1 -- 172.21.15.94:0/2928480165 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642398594 0 0) 0x7f2ab40b3290 con 0x7f2ab40af2a0 2024-09-11T23:16:58.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab96ab640 1 --2- 172.21.15.94:0/2928480165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415c2a0 0x7f2ab40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:58.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab9eac640 1 --2- 172.21.15.94:0/2928480165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab415bec0 0x7f2ab40ad200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0f4ee645d098de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:58.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab8eaa640 1 -- 172.21.15.94:0/2928480165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40a7070 con 0x7f2ab415bec0 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab8eaa640 1 -- 172.21.15.94:0/2928480165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa40b0070 con 0x7f2ab415bec0 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.718+0000 7f2ab8eaa640 1 -- 172.21.15.94:0/2928480165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40ab890 con 0x7f2ab415bec0 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- 172.21.15.94:0/2928480165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab415bec0 msgr2=0x7f2ab40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 --2- 172.21.15.94:0/2928480165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab415bec0 0x7f2ab40ad200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401c470 comp rx=0 tx=0).stop 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- 172.21.15.94:0/2928480165 shutdown_connections 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 --2- 172.21.15.94:0/2928480165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415c2a0 0x7f2ab40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 --2- 172.21.15.94:0/2928480165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab415bec0 0x7f2ab40ad200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- 172.21.15.94:0/2928480165 >> 172.21.15.94:0/2928480165 conn(0x7f2ab40b1f90 msgr2=0x7f2ab40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- 172.21.15.94:0/2928480165 shutdown_connections 2024-09-11T23:16:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- 172.21.15.94:0/2928480165 wait complete. 2024-09-11T23:16:58.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 Processor -- start 2024-09-11T23:16:58.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- start start 2024-09-11T23:16:58.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab40af2a0 0x7f2ab4165a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415bec0 0x7f2ab4155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ab415c2a0 0x7f2ab4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab40af6f0 con 0x7f2ab40af2a0 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab40ad740 con 0x7f2ab415c2a0 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab4169000 con 0x7f2ab415bec0 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab40af2a0 0x7f2ab4165a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab40af2a0 0x7f2ab4165a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40110/0 (socket says 172.21.15.94:40110) 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 -- 172.21.15.94:0/2112509394 learned_addr learned my addr 172.21.15.94:0/2112509394 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab96ab640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415bec0 0x7f2ab4155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2aba6ad640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ab415c2a0 0x7f2ab4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 -- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415bec0 msgr2=0x7f2ab4155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415bec0 0x7f2ab4155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 -- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ab415c2a0 msgr2=0x7f2ab4152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ab415c2a0 0x7f2ab4152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 -- 172.21.15.94:0/2112509394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab415f720 con 0x7f2ab40af2a0 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2ab9eac640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab40af2a0 0x7f2ab4165a90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2aaa7fc640 1 -- 172.21.15.94:0/2112509394 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4004220 con 0x7f2ab40af2a0 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2aaa7fc640 1 -- 172.21.15.94:0/2112509394 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa40043c0 con 0x7f2ab40af2a0 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab415c8f0 con 0x7f2ab40af2a0 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2aaa7fc640 1 -- 172.21.15.94:0/2112509394 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4003820 con 0x7f2ab40af2a0 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.722+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab4155850 con 0x7f2ab40af2a0 2024-09-11T23:16:58.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.726+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab40ad200 con 0x7f2ab40af2a0 2024-09-11T23:16:58.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.726+0000 7f2aaa7fc640 1 -- 172.21.15.94:0/2112509394 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2aa40039c0 con 0x7f2ab40af2a0 2024-09-11T23:16:58.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.726+0000 7f2aaa7fc640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2a980678c0 0x7f2a98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:58.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.726+0000 7f2aaa7fc640 1 -- 172.21.15.94:0/2112509394 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f2aa4120ba0 con 0x7f2ab40af2a0 2024-09-11T23:16:58.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.726+0000 7f2ab96ab640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2a980678c0 0x7f2a98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:58.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.726+0000 7f2ab96ab640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2a980678c0 0x7f2a98069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007510 tx=0x7f2ab00074a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:58.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.730+0000 7f2aaa7fc640 1 -- 172.21.15.94:0/2112509394 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2aa4120e20 con 0x7f2ab40af2a0 2024-09-11T23:16:58.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.878+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2ab4072ab0 con 0x7f2ab40af2a0 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.878+0000 7f2aaa7fc640 1 -- 172.21.15.94:0/2112509394 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7f2aa4016090 con 0x7f2ab40af2a0 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:16:58.885 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:16:58.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2a980678c0 msgr2=0x7f2a98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2a980678c0 0x7f2a98069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007510 tx=0x7f2ab00074a0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab40af2a0 msgr2=0x7f2ab4165a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:58.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab40af2a0 0x7f2ab4165a90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401acb0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 shutdown_connections 2024-09-11T23:16:58.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ab415c2a0 0x7f2ab4152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ab415bec0 0x7f2ab4155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2a980678c0 0x7f2a98069d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 --2- 172.21.15.94:0/2112509394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ab40af2a0 0x7f2ab4165a90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:58.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 >> 172.21.15.94:0/2112509394 conn(0x7f2ab40b1f90 msgr2=0x7f2ab40b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:58.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 shutdown_connections 2024-09-11T23:16:58.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:58.882+0000 7f2abc110640 1 -- 172.21.15.94:0/2112509394 wait complete. 2024-09-11T23:16:58.903 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:16:58.904 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:16:59.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 Processor -- start 2024-09-11T23:16:59.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 -- start start 2024-09-11T23:16:59.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87441520a0 0x7f874406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f874406fe50 0x7f874415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f874415f1d0 0x7f8744071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8744152480 con 0x7f874406fe50 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8744070250 con 0x7f874415f1d0 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f874b4a5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f87440aede0 con 0x7f87441520a0 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f874406fe50 0x7f874415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f874406fe50 0x7f874415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40112/0 (socket says 172.21.15.94:40112) 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 -- 172.21.15.94:0/1211273118 learned_addr learned my addr 172.21.15.94:0/1211273118 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8749a42640 1 --2- 172.21.15.94:0/1211273118 >> v2:172.21.15.155:3300/0 conn(0x7f874415f1d0 0x7f8744071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 -- 172.21.15.94:0/1211273118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87441520a0 msgr2=0x7f874406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8749241640 1 --2- 172.21.15.94:0/1211273118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87441520a0 0x7f874406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 --2- 172.21.15.94:0/1211273118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87441520a0 0x7f874406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 -- 172.21.15.94:0/1211273118 >> v2:172.21.15.155:3300/0 conn(0x7f874415f1d0 msgr2=0x7f8744071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 --2- 172.21.15.94:0/1211273118 >> v2:172.21.15.155:3300/0 conn(0x7f874415f1d0 0x7f8744071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8748a40640 1 -- 172.21.15.94:0/1211273118 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874415fa10 con 0x7f874406fe50 2024-09-11T23:16:59.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.022+0000 7f8749a42640 1 --2- 172.21.15.94:0/1211273118 >> v2:172.21.15.155:3300/0 conn(0x7f874415f1d0 0x7f8744071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:59.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f8748a40640 1 --2- 172.21.15.94:0/1211273118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f874406fe50 0x7f874415ec90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f874406e250 tx=0x7f873401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cbc2ed87a9ae63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f873bfff640 1 -- 172.21.15.94:0/1211273118 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340b0070 con 0x7f874406fe50 2024-09-11T23:16:59.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f873bfff640 1 -- 172.21.15.94:0/1211273118 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87340ab600 con 0x7f874406fe50 2024-09-11T23:16:59.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f873bfff640 1 -- 172.21.15.94:0/1211273118 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340ab9d0 con 0x7f874406fe50 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 -- 172.21.15.94:0/1211273118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f874406fe50 msgr2=0x7f874415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 --2- 172.21.15.94:0/1211273118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f874406fe50 0x7f874415ec90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f874406e250 tx=0x7f873401c240 comp rx=0 tx=0).stop 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 -- 172.21.15.94:0/1211273118 shutdown_connections 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 --2- 172.21.15.94:0/1211273118 >> v2:172.21.15.155:3300/0 conn(0x7f874415f1d0 0x7f8744071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 --2- 172.21.15.94:0/1211273118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f874406fe50 0x7f874415ec90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 --2- 172.21.15.94:0/1211273118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87441520a0 0x7f874406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 -- 172.21.15.94:0/1211273118 >> 172.21.15.94:0/1211273118 conn(0x7f87440b1f90 msgr2=0x7f87440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 -- 172.21.15.94:0/1211273118 shutdown_connections 2024-09-11T23:16:59.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.026+0000 7f874b4a5640 1 -- 172.21.15.94:0/1211273118 wait complete. 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 Processor -- start 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 -- start start 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f874406fe50 0x7f874414b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87441520a0 0x7f874415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f874415f1d0 0x7f874414ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8744073d30 con 0x7f87441520a0 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8744073a50 con 0x7f874415f1d0 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f874415f5e0 con 0x7f874406fe50 2024-09-11T23:16:59.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87441520a0 0x7f874415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87441520a0 0x7f874415d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40122/0 (socket says 172.21.15.94:40122) 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 -- 172.21.15.94:0/3896707636 learned_addr learned my addr 172.21.15.94:0/3896707636 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8749a42640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f874415f1d0 0x7f874414ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8749241640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f874406fe50 0x7f874414b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 -- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f874406fe50 msgr2=0x7f874414b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f874406fe50 0x7f874414b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 -- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f874415f1d0 msgr2=0x7f874414ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f874415f1d0 0x7f874414ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 -- 172.21.15.94:0/3896707636 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874415d940 con 0x7f87441520a0 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8748a40640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87441520a0 0x7f874415d260 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f873401a8f0 tx=0x7f8734018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8739ffb640 1 -- 172.21.15.94:0/3896707636 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340b9070 con 0x7f87441520a0 2024-09-11T23:16:59.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8739ffb640 1 -- 172.21.15.94:0/3896707636 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87340b4600 con 0x7f87441520a0 2024-09-11T23:16:59.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8739ffb640 1 -- 172.21.15.94:0/3896707636 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340b0040 con 0x7f87441520a0 2024-09-11T23:16:59.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874415dc20 con 0x7f87441520a0 2024-09-11T23:16:59.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441643b0 con 0x7f87441520a0 2024-09-11T23:16:59.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874406f910 con 0x7f87441520a0 2024-09-11T23:16:59.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.030+0000 7f8739ffb640 1 -- 172.21.15.94:0/3896707636 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87340bc070 con 0x7f87441520a0 2024-09-11T23:16:59.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.034+0000 7f8739ffb640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87280678c0 0x7f8728069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.034+0000 7f8739ffb640 1 -- 172.21.15.94:0/3896707636 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f873411eb60 con 0x7f87441520a0 2024-09-11T23:16:59.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.034+0000 7f8749241640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87280678c0 0x7f8728069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.038+0000 7f8749241640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87280678c0 0x7f8728069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8740006fd0 tx=0x7f8740008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.038+0000 7f8739ffb640 1 -- 172.21.15.94:0/3896707636 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f87340160f0 con 0x7f87441520a0 2024-09-11T23:16:59.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.202+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f874406e540 con 0x7f87441520a0 2024-09-11T23:16:59.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.294+0000 7f8739ffb640 1 -- 172.21.15.94:0/3896707636 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7f87340ef860 con 0x7f87441520a0 2024-09-11T23:16:59.297 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:16:59.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87280678c0 msgr2=0x7f8728069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87280678c0 0x7f8728069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8740006fd0 tx=0x7f8740008040 comp rx=0 tx=0).stop 2024-09-11T23:16:59.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87441520a0 msgr2=0x7f874415d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87441520a0 0x7f874415d260 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f873401a8f0 tx=0x7f8734018fe0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 shutdown_connections 2024-09-11T23:16:59.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f874415f1d0 0x7f874414ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87280678c0 0x7f8728069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87441520a0 0x7f874415d260 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 --2- 172.21.15.94:0/3896707636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f874406fe50 0x7f874414b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 >> 172.21.15.94:0/3896707636 conn(0x7f87440b1f90 msgr2=0x7f874415bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:59.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 shutdown_connections 2024-09-11T23:16:59.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.298+0000 7f874b4a5640 1 -- 172.21.15.94:0/3896707636 wait complete. 2024-09-11T23:16:59.327 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:16:59.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.450+0000 7f4c54c96640 1 Processor -- start 2024-09-11T23:16:59.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.450+0000 7f4c54c96640 1 -- start start 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.450+0000 7f4c54c96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500cc870 0x7f4c500cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.450+0000 7f4c54c96640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c500cdfd0 0x7f4c5006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.450+0000 7f4c54c96640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c500ce8d0 con 0x7f4c50073100 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.450+0000 7f4c54c96640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4c500cebb0 con 0x7f4c500cdfd0 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.450+0000 7f4c54c96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500cee90 con 0x7f4c500cc870 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4c50073100 0x7f4c500ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33950/0 (socket says 172.21.15.94:33950) 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 -- 172.21.15.94:0/929927294 learned_addr learned my addr 172.21.15.94:0/929927294 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4e59c640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500cc870 0x7f4c500cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903101849 0 0) 0x7f4c500ce8d0 con 0x7f4c50073100 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c3c003530 con 0x7f4c50073100 2024-09-11T23:16:59.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4ed9d640 1 --2- 172.21.15.94:0/929927294 >> v2:172.21.15.155:3300/0 conn(0x7f4c500cdfd0 0x7f4c5006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3700597201 0 0) 0x7f4c3c003530 con 0x7f4c50073100 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500cc870 msgr2=0x7f4c500cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500cc870 0x7f4c500cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 >> v2:172.21.15.155:3300/0 conn(0x7f4c500cdfd0 msgr2=0x7f4c5006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 --2- 172.21.15.94:0/929927294 >> v2:172.21.15.155:3300/0 conn(0x7f4c500cdfd0 0x7f4c5006de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500cf170 con 0x7f4c50073100 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f4c38001680 con 0x7f4c50073100 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 >> v1:172.21.15.94:6789/0 conn(0x7f4c50073100 legacy=0x7f4c500ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3c0039c0 0x7f4c3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500cc870 0x7f4c3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500cebb0 con 0x7f4c3c004810 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500cee90 con 0x7f4c3c0039c0 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c3c00b9d0 con 0x7f4c500cc870 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4e59c640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3c0039c0 0x7f4c3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 -- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500cc870 msgr2=0x7f4c3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500cc870 0x7f4c3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 -- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3c0039c0 msgr2=0x7f4c3c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3c0039c0 0x7f4c3c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 -- 172.21.15.94:0/929927294 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3c003530 con 0x7f4c3c004810 2024-09-11T23:16:59.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c47fff640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4c5009e2b0 tx=0x7f4c3801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5999254a445b498a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38007d40 con 0x7f4c3c004810 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c380ac020 con 0x7f4c3c004810 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.454+0000 7f4c4dd9b640 1 -- 172.21.15.94:0/929927294 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c380058e0 con 0x7f4c3c004810 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- 172.21.15.94:0/929927294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 msgr2=0x7f4c3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 --2- 172.21.15.94:0/929927294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4c5009e2b0 tx=0x7f4c3801f3b0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4ed9d640 1 -- 172.21.15.94:0/929927294 reap_dead start 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- 172.21.15.94:0/929927294 shutdown_connections 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- 172.21.15.94:0/929927294 >> 172.21.15.94:0/929927294 conn(0x7f4c500b1c80 msgr2=0x7f4c500b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:59.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- 172.21.15.94:0/929927294 shutdown_connections 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- 172.21.15.94:0/929927294 wait complete. 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 Processor -- start 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- start start 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c5015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500b3080 0x7f4c500aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c500c9300 0x7f4c500c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50145fd0 con 0x7f4c3c004810 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50145e50 con 0x7f4c500c9300 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500ce480 con 0x7f4c500b3080 2024-09-11T23:16:59.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c5015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c5015b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40146/0 (socket says 172.21.15.94:40146) 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 -- 172.21.15.94:0/192446200 learned_addr learned my addr 172.21.15.94:0/192446200 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4ed9d640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c500c9300 0x7f4c500c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 -- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500b3080 msgr2=0x7f4c500aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500b3080 0x7f4c500aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 -- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c500c9300 msgr2=0x7f4c500c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c500c9300 0x7f4c500c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 -- 172.21.15.94:0/192446200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c501f4ae0 con 0x7f4c3c004810 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4ed9d640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c500c9300 0x7f4c500c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c4e59c640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c5015b8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4c40011a00 tx=0x7f4c40011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c46ffd640 1 -- 172.21.15.94:0/192446200 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000faf0 con 0x7f4c3c004810 2024-09-11T23:16:59.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c46ffd640 1 -- 172.21.15.94:0/192446200 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4000fc90 con 0x7f4c3c004810 2024-09-11T23:16:59.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c501f4dc0 con 0x7f4c3c004810 2024-09-11T23:16:59.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c46ffd640 1 -- 172.21.15.94:0/192446200 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40014440 con 0x7f4c3c004810 2024-09-11T23:16:59.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.458+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c501f5380 con 0x7f4c3c004810 2024-09-11T23:16:59.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.462+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c500cf970 con 0x7f4c3c004810 2024-09-11T23:16:59.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.462+0000 7f4c46ffd640 1 -- 172.21.15.94:0/192446200 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c40012040 con 0x7f4c3c004810 2024-09-11T23:16:59.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.462+0000 7f4c46ffd640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c300678c0 0x7f4c30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.462+0000 7f4c46ffd640 1 -- 172.21.15.94:0/192446200 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5619+0+0 (secure 0 0 0) 0x7f4c400861f0 con 0x7f4c3c004810 2024-09-11T23:16:59.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.462+0000 7f4c47fff640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c300678c0 0x7f4c30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.462+0000 7f4c47fff640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c300678c0 0x7f4c30069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c380ad000 tx=0x7f4c500cf340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.466+0000 7f4c46ffd640 1 -- 172.21.15.94:0/192446200 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c40019030 con 0x7f4c3c004810 2024-09-11T23:16:59.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:16:59.630+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4c501e7bc0 con 0x7f4c3c004810 2024-09-11T23:17:00.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c46ffd640 1 -- 172.21.15.94:0/192446200 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7f4c40056e40 con 0x7f4c3c004810 2024-09-11T23:17:00.307 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:17:00.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c300678c0 msgr2=0x7f4c30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:00.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c54c96640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c300678c0 0x7f4c30069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c380ad000 tx=0x7f4c500cf340 comp rx=0 tx=0).stop 2024-09-11T23:17:00.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 msgr2=0x7f4c5015b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:00.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c54c96640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c5015b8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4c40011a00 tx=0x7f4c40011ec0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 shutdown_connections 2024-09-11T23:17:00.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c54c96640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c500c9300 0x7f4c500c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.302+0000 7f4c54c96640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c500b3080 0x7f4c500aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.306+0000 7f4c54c96640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c300678c0 0x7f4c30069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.306+0000 7f4c54c96640 1 --2- 172.21.15.94:0/192446200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c3c004810 0x7f4c5015b8f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.306+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 >> 172.21.15.94:0/192446200 conn(0x7f4c500b1c80 msgr2=0x7f4c50073540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:00.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.306+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 shutdown_connections 2024-09-11T23:17:00.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.306+0000 7f4c54c96640 1 -- 172.21.15.94:0/192446200 wait complete. 2024-09-11T23:17:00.341 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:17:00.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f675b525640 1 Processor -- start 2024-09-11T23:17:00.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f675b525640 1 -- start start 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f675b525640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6754148d00 0x7f67540b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f675b525640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f67540d04f0 0x7f675406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f675b525640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67540d1fe0 con 0x7f67540b4340 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f675b525640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f67540b47a0 con 0x7f67540d04f0 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f675b525640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f67540d22c0 con 0x7f6754148d00 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f6759ac2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f67540d04f0 0x7f675406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f6759ac2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f67540d04f0 0x7f675406d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55526/0 (socket says 172.21.15.94:55526) 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f6759ac2640 1 -- 172.21.15.94:0/3194164388 learned_addr learned my addr 172.21.15.94:0/3194164388 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f67592c1640 1 --2- 172.21.15.94:0/3194164388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6754148d00 0x7f67540b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f6759ac2640 1 -- 172.21.15.94:0/3194164388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6754148d00 msgr2=0x7f67540b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f6759ac2640 1 --2- 172.21.15.94:0/3194164388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6754148d00 0x7f67540b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f6759ac2640 1 -- 172.21.15.94:0/3194164388 >> v1:172.21.15.155:6789/0 conn(0x7f67540b4340 legacy=0x7f67540cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:00.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.458+0000 7f6759ac2640 1 -- 172.21.15.94:0/3194164388 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67540d25a0 con 0x7f67540d04f0 2024-09-11T23:17:00.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f6759ac2640 1 --2- 172.21.15.94:0/3194164388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540d04f0 0x7f675406d1d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f674c009e50 tx=0x7f674c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895013402b01a8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:00.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f674bfff640 1 -- 172.21.15.94:0/3194164388 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c0a5760 con 0x7f67540d04f0 2024-09-11T23:17:00.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f674bfff640 1 -- 172.21.15.94:0/3194164388 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674c0a5900 con 0x7f67540d04f0 2024-09-11T23:17:00.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f674bfff640 1 -- 172.21.15.94:0/3194164388 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c0a5cd0 con 0x7f67540d04f0 2024-09-11T23:17:00.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- 172.21.15.94:0/3194164388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540d04f0 msgr2=0x7f675406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 --2- 172.21.15.94:0/3194164388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540d04f0 0x7f675406d1d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f674c009e50 tx=0x7f674c01c9f0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- 172.21.15.94:0/3194164388 shutdown_connections 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 --2- 172.21.15.94:0/3194164388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540d04f0 0x7f675406d1d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 --2- 172.21.15.94:0/3194164388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6754148d00 0x7f67540b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- 172.21.15.94:0/3194164388 >> 172.21.15.94:0/3194164388 conn(0x7f675406bcc0 msgr2=0x7f675406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- 172.21.15.94:0/3194164388 shutdown_connections 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- 172.21.15.94:0/3194164388 wait complete. 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 Processor -- start 2024-09-11T23:17:00.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- start start 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540b4340 0x7f67541414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67540d04f0 0x7f675413e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6754148d00 0x7f6754164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f675406df20 con 0x7f67540b4340 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f67541490e0 con 0x7f6754148d00 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f675b525640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f675406e0a0 con 0x7f67540d04f0 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f67592c1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540b4340 0x7f67541414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f67592c1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540b4340 0x7f67541414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55542/0 (socket says 172.21.15.94:55542) 2024-09-11T23:17:00.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f67592c1640 1 -- 172.21.15.94:0/3111609261 learned_addr learned my addr 172.21.15.94:0/3111609261 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f6758ac0640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67540d04f0 0x7f675413e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f6759ac2640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6754148d00 0x7f6754164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f67592c1640 1 -- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67540d04f0 msgr2=0x7f675413e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.462+0000 7f67592c1640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67540d04f0 0x7f675413e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f67592c1640 1 -- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6754148d00 msgr2=0x7f6754164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f67592c1640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6754148d00 0x7f6754164cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f67592c1640 1 -- 172.21.15.94:0/3111609261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675413f170 con 0x7f67540b4340 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6758ac0640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67540d04f0 0x7f675413e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6759ac2640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6754148d00 0x7f6754164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f67592c1640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540b4340 0x7f67541414d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f674400d620 tx=0x7f674400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6749ffb640 1 -- 172.21.15.94:0/3111609261 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674400b620 con 0x7f67540b4340 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6749ffb640 1 -- 172.21.15.94:0/3111609261 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6744019070 con 0x7f67540b4340 2024-09-11T23:17:00.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67540ce750 con 0x7f67540b4340 2024-09-11T23:17:00.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6749ffb640 1 -- 172.21.15.94:0/3111609261 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674400b9e0 con 0x7f67540b4340 2024-09-11T23:17:00.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675415d030 con 0x7f67540b4340 2024-09-11T23:17:00.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f675406d1d0 con 0x7f67540b4340 2024-09-11T23:17:00.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6749ffb640 1 -- 172.21.15.94:0/3111609261 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f674400bb80 con 0x7f67540b4340 2024-09-11T23:17:00.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6749ffb640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f67380678c0 0x7f6738069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:00.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6749ffb640 1 -- 172.21.15.94:0/3111609261 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6001+0+0 (secure 0 0 0) 0x7f6744086130 con 0x7f67540b4340 2024-09-11T23:17:00.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6758ac0640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f67380678c0 0x7f6738069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:00.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.466+0000 7f6758ac0640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f67380678c0 0x7f6738069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6750003e40 tx=0x7f6750009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:00.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.470+0000 7f6749ffb640 1 -- 172.21.15.94:0/3111609261 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6744056bd0 con 0x7f67540b4340 2024-09-11T23:17:00.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:00.670+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f675415ca90 con 0x7f67540b4340 2024-09-11T23:17:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.306+0000 7f6749ffb640 1 -- 172.21.15.94:0/3111609261 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) ==== 172+0+0 (secure 0 0 0) 0x7f67440564d0 con 0x7f67540b4340 2024-09-11T23:17:01.311 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 7 and data pool 8 2024-09-11T23:17:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f67380678c0 msgr2=0x7f6738069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f67380678c0 0x7f6738069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6750003e40 tx=0x7f6750009040 comp rx=0 tx=0).stop 2024-09-11T23:17:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540b4340 msgr2=0x7f67541414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540b4340 0x7f67541414d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f674400d620 tx=0x7f674400dae0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 shutdown_connections 2024-09-11T23:17:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6754148d00 0x7f6754164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67540d04f0 0x7f675413e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f67380678c0 0x7f6738069d80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 --2- 172.21.15.94:0/3111609261 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67540b4340 0x7f67541414d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 >> 172.21.15.94:0/3111609261 conn(0x7f675406bcc0 msgr2=0x7f6754145830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 shutdown_connections 2024-09-11T23:17:01.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.310+0000 7f675b525640 1 -- 172.21.15.94:0/3111609261 wait complete. 2024-09-11T23:17:01.343 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:01.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.454+0000 7fcfcd596640 1 Processor -- start 2024-09-11T23:17:01.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.454+0000 7fcfcd596640 1 -- start start 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcfc815bec0 0x7fcfc80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc80af470 0x7fcfc806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc80b3290 con 0x7fcfc815c2a0 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc80b3570 con 0x7fcfc815bec0 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc80b3850 con 0x7fcfc80af470 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcfc815bec0 0x7fcfc80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcfc815bec0 0x7fcfc80ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55544/0 (socket says 172.21.15.94:55544) 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 -- 172.21.15.94:0/905197191 learned_addr learned my addr 172.21.15.94:0/905197191 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 -- 172.21.15.94:0/905197191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc80af470 msgr2=0x7fcfc806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:01.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 --2- 172.21.15.94:0/905197191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc80af470 0x7fcfc806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 -- 172.21.15.94:0/905197191 >> v1:172.21.15.155:6789/0 conn(0x7fcfc815c2a0 legacy=0x7fcfc80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:01.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 -- 172.21.15.94:0/905197191 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc80b3b30 con 0x7fcfc815bec0 2024-09-11T23:17:01.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc6ffd640 1 --2- 172.21.15.94:0/905197191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc80ad200 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009870 tx=0x7fcfb801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0baa02b1617f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc5ffb640 1 -- 172.21.15.94:0/905197191 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80ab620 con 0x7fcfc815bec0 2024-09-11T23:17:01.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc5ffb640 1 -- 172.21.15.94:0/905197191 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb80b0070 con 0x7fcfc815bec0 2024-09-11T23:17:01.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfc5ffb640 1 -- 172.21.15.94:0/905197191 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80ab9e0 con 0x7fcfc815bec0 2024-09-11T23:17:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 -- 172.21.15.94:0/905197191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 msgr2=0x7fcfc80ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 --2- 172.21.15.94:0/905197191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc80ad200 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009870 tx=0x7fcfb801c460 comp rx=0 tx=0).stop 2024-09-11T23:17:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 -- 172.21.15.94:0/905197191 shutdown_connections 2024-09-11T23:17:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 --2- 172.21.15.94:0/905197191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc80af470 0x7fcfc806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 --2- 172.21.15.94:0/905197191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc80ad200 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.458+0000 7fcfcd596640 1 -- 172.21.15.94:0/905197191 >> 172.21.15.94:0/905197191 conn(0x7fcfc80b1f90 msgr2=0x7fcfc80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- 172.21.15.94:0/905197191 shutdown_connections 2024-09-11T23:17:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- 172.21.15.94:0/905197191 wait complete. 2024-09-11T23:17:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 Processor -- start 2024-09-11T23:17:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- start start 2024-09-11T23:17:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfc80af470 0x7fcfc81498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc8150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc815c2a0 0x7fcfc8150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc806ed50 con 0x7fcfc815bec0 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80ad740 con 0x7fcfc80af470 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc806eed0 con 0x7fcfc815c2a0 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc8150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc8150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55550/0 (socket says 172.21.15.94:55550) 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 -- 172.21.15.94:0/1812337669 learned_addr learned my addr 172.21.15.94:0/1812337669 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc6ffd640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfc80af470 0x7fcfc81498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 -- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc815c2a0 msgr2=0x7fcfc8150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc815c2a0 0x7fcfc8150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 -- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfc80af470 msgr2=0x7fcfc81498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfc80af470 0x7fcfc81498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 -- 172.21.15.94:0/1812337669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc81576c0 con 0x7fcfc815bec0 2024-09-11T23:17:01.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc6ffd640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfc80af470 0x7fcfc81498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:01.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfc67fc640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc8150030 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b410 tx=0x7fcfbc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfaf7fe640 1 -- 172.21.15.94:0/1812337669 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc015020 con 0x7fcfc815bec0 2024-09-11T23:17:01.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfaf7fe640 1 -- 172.21.15.94:0/1812337669 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc011850 con 0x7fcfc815bec0 2024-09-11T23:17:01.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc81579a0 con 0x7fcfc815bec0 2024-09-11T23:17:01.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfaf7fe640 1 -- 172.21.15.94:0/1812337669 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc011c40 con 0x7fcfc815bec0 2024-09-11T23:17:01.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc8157f60 con 0x7fcfc815bec0 2024-09-11T23:17:01.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.462+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc806e000 con 0x7fcfc815bec0 2024-09-11T23:17:01.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.466+0000 7fcfaf7fe640 1 -- 172.21.15.94:0/1812337669 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfbc018020 con 0x7fcfc815bec0 2024-09-11T23:17:01.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.466+0000 7fcfaf7fe640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcfb40678c0 0x7fcfb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.466+0000 7fcfaf7fe640 1 -- 172.21.15.94:0/1812337669 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fcfbc0862b0 con 0x7fcfc815bec0 2024-09-11T23:17:01.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.466+0000 7fcfc6ffd640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcfb40678c0 0x7fcfb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.466+0000 7fcfc6ffd640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcfb40678c0 0x7fcfb4069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80af000 tx=0x7fcfb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.470+0000 7fcfaf7fe640 1 -- 172.21.15.94:0/1812337669 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcfbc01f020 con 0x7fcfc815bec0 2024-09-11T23:17:01.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.634+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfc806fcd0 con 0x7fcfc815bec0 2024-09-11T23:17:01.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfaf7fe640 1 -- 172.21.15.94:0/1812337669 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+17039 (secure 0 0 0) 0x7fcfbc00f2e0 con 0x7fcfc815bec0 2024-09-11T23:17:01.641 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:01.642 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":50,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:00.676336+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:59.244408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:59.671966+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcfb40678c0 msgr2=0x7fcfb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcfb40678c0 0x7fcfb4069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80af000 tx=0x7fcfb8008040 comp rx=0 tx=0).stop 2024-09-11T23:17:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 msgr2=0x7fcfc8150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc8150030 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b410 tx=0x7fcfbc00b8d0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 shutdown_connections 2024-09-11T23:17:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfc815c2a0 0x7fcfc8150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcfb40678c0 0x7fcfb4069d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfc815bec0 0x7fcfc8150030 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 --2- 172.21.15.94:0/1812337669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfc80af470 0x7fcfc81498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 >> 172.21.15.94:0/1812337669 conn(0x7fcfc80b1f90 msgr2=0x7fcfc80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 shutdown_connections 2024-09-11T23:17:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.638+0000 7fcfcd596640 1 -- 172.21.15.94:0/1812337669 wait complete. 2024-09-11T23:17:01.661 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:01.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef91a36640 1 Processor -- start 2024-09-11T23:17:01.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef91a36640 1 -- start start 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef91a36640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef8c0d3060 0x7fef8c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef91a36640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c0cf450 0x7fef8c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef91a36640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8c0d0300 con 0x7fef8c161a60 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef91a36640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fef8c0b0f60 con 0x7fef8c0d3060 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef91a36640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef8c0cfd40 con 0x7fef8c0cf450 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c0cf450 0x7fef8c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8a7fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef8c0d3060 0x7fef8c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c0cf450 0x7fef8c06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:41046/0 (socket says 172.21.15.94:41046) 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8b7fe640 1 -- 172.21.15.94:0/543184473 learned_addr learned my addr 172.21.15.94:0/543184473 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:01.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8affd640 1 --1- 172.21.15.94:0/543184473 >> v1:172.21.15.155:6789/0 conn(0x7fef8c161a60 0x7fef8c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:35116/0 (socket says 172.21.15.94:35116) 2024-09-11T23:17:01.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef89ffb640 1 -- 172.21.15.94:0/543184473 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496748761 0 0) 0x7fef7c001120 con 0x7fef8c161a60 2024-09-11T23:17:01.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8b7fe640 1 -- 172.21.15.94:0/543184473 >> v2:172.21.15.155:3300/0 conn(0x7fef8c0d3060 msgr2=0x7fef8c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:01.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8b7fe640 1 --2- 172.21.15.94:0/543184473 >> v2:172.21.15.155:3300/0 conn(0x7fef8c0d3060 0x7fef8c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8b7fe640 1 -- 172.21.15.94:0/543184473 >> v1:172.21.15.155:6789/0 conn(0x7fef8c161a60 legacy=0x7fef8c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8b7fe640 1 -- 172.21.15.94:0/543184473 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c0d0020 con 0x7fef8c0cf450 2024-09-11T23:17:01.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.782+0000 7fef8a7fc640 1 --2- 172.21.15.94:0/543184473 >> v2:172.21.15.155:3300/0 conn(0x7fef8c0d3060 0x7fef8c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:01.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef8b7fe640 1 --2- 172.21.15.94:0/543184473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c0cf450 0x7fef8c06d6b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef84009e50 tx=0x7fef8401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37dd2bd4d35d672c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef89ffb640 1 -- 172.21.15.94:0/543184473 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840a5830 con 0x7fef8c0cf450 2024-09-11T23:17:01.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef89ffb640 1 -- 172.21.15.94:0/543184473 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef840a59d0 con 0x7fef8c0cf450 2024-09-11T23:17:01.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef89ffb640 1 -- 172.21.15.94:0/543184473 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840a5da0 con 0x7fef8c0cf450 2024-09-11T23:17:01.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 -- 172.21.15.94:0/543184473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c0cf450 msgr2=0x7fef8c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 --2- 172.21.15.94:0/543184473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c0cf450 0x7fef8c06d6b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef84009e50 tx=0x7fef8401c970 comp rx=0 tx=0).stop 2024-09-11T23:17:01.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 -- 172.21.15.94:0/543184473 shutdown_connections 2024-09-11T23:17:01.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 --2- 172.21.15.94:0/543184473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c0cf450 0x7fef8c06d6b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 --2- 172.21.15.94:0/543184473 >> v2:172.21.15.155:3300/0 conn(0x7fef8c0d3060 0x7fef8c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 -- 172.21.15.94:0/543184473 >> 172.21.15.94:0/543184473 conn(0x7fef8c08bf90 msgr2=0x7fef8c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:01.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 -- 172.21.15.94:0/543184473 shutdown_connections 2024-09-11T23:17:01.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 -- 172.21.15.94:0/543184473 wait complete. 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 Processor -- start 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 -- start start 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c0cf450 0x7fef8c0b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.786+0000 7fef91a36640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c0d3060 0x7fef8c150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef91a36640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c161a60 0x7fef8c0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef91a36640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c06e580 con 0x7fef8c0d3060 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef91a36640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c06e400 con 0x7fef8c0cf450 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef91a36640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef8c06e700 con 0x7fef8c161a60 2024-09-11T23:17:01.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c0d3060 0x7fef8c150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c0d3060 0x7fef8c150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55564/0 (socket says 172.21.15.94:55564) 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 -- 172.21.15.94:0/2001575949 learned_addr learned my addr 172.21.15.94:0/2001575949 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8affd640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c0cf450 0x7fef8c0b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8b7fe640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c161a60 0x7fef8c0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 -- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c161a60 msgr2=0x7fef8c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c161a60 0x7fef8c0b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 -- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c0cf450 msgr2=0x7fef8c0b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c0cf450 0x7fef8c0b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 -- 172.21.15.94:0/2001575949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c0cc900 con 0x7fef8c0d3060 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8b7fe640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c161a60 0x7fef8c0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8a7fc640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c0d3060 0x7fef8c150a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e9b0 tx=0x7fef8000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef73fff640 1 -- 172.21.15.94:0/2001575949 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80017070 con 0x7fef8c0d3060 2024-09-11T23:17:01.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef73fff640 1 -- 172.21.15.94:0/2001575949 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8000ca00 con 0x7fef8c0d3060 2024-09-11T23:17:01.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c0ccbe0 con 0x7fef8c0d3060 2024-09-11T23:17:01.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef73fff640 1 -- 172.21.15.94:0/2001575949 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8000cdd0 con 0x7fef8c0d3060 2024-09-11T23:17:01.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c0cd1a0 con 0x7fef8c0d3060 2024-09-11T23:17:01.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef8c06d6b0 con 0x7fef8c0d3060 2024-09-11T23:17:01.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef73fff640 1 -- 172.21.15.94:0/2001575949 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef8001a070 con 0x7fef8c0d3060 2024-09-11T23:17:01.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef73fff640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef780678c0 0x7fef78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef73fff640 1 -- 172.21.15.94:0/2001575949 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fef80086190 con 0x7fef8c0d3060 2024-09-11T23:17:01.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.790+0000 7fef8affd640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef780678c0 0x7fef78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.794+0000 7fef8affd640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef780678c0 0x7fef78069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.794+0000 7fef73fff640 1 -- 172.21.15.94:0/2001575949 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef80056aa0 con 0x7fef8c0d3060 2024-09-11T23:17:01.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.962+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef8c0008e0 con 0x7fef8c0d3060 2024-09-11T23:17:01.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.966+0000 7fef73fff640 1 -- 172.21.15.94:0/2001575949 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+17039 (secure 0 0 0) 0x7fef800563a0 con 0x7fef8c0d3060 2024-09-11T23:17:01.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:01.972 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":50,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:00.676336+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:59.244408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:59.671966+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:01.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef780678c0 msgr2=0x7fef78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef780678c0 0x7fef78069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c007980 comp rx=0 tx=0).stop 2024-09-11T23:17:01.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c0d3060 msgr2=0x7fef8c150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c0d3060 0x7fef8c150a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e9b0 tx=0x7fef8000ee70 comp rx=0 tx=0).stop 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 shutdown_connections 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef8c161a60 0x7fef8c0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef780678c0 0x7fef78069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c0d3060 0x7fef8c150a70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 --2- 172.21.15.94:0/2001575949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c0cf450 0x7fef8c0b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 >> 172.21.15.94:0/2001575949 conn(0x7fef8c08bf90 msgr2=0x7fef8c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 shutdown_connections 2024-09-11T23:17:01.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:01.970+0000 7fef91a36640 1 -- 172.21.15.94:0/2001575949 wait complete. 2024-09-11T23:17:01.990 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:17:02.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bf2d3640 1 Processor -- start 2024-09-11T23:17:02.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bf2d3640 1 -- start start 2024-09-11T23:17:02.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bf2d3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:02.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bf2d3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f08b80b51b0 0x7f08b80b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bf2d3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b80b3c50 con 0x7f08b815b570 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bf2d3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f08b80d0b80 con 0x7f08b80b51b0 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bf2d3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f08b80d0e60 con 0x7f08b80b3330 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bc86e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f08b80b51b0 0x7f08b80b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bc86e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f08b80b51b0 0x7f08b80b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55568/0 (socket says 172.21.15.94:55568) 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bc86e640 1 -- 172.21.15.94:0/3229463744 learned_addr learned my addr 172.21.15.94:0/3229463744 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bd06f640 1 --2- 172.21.15.94:0/3229463744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bc86e640 1 -- 172.21.15.94:0/3229463744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 msgr2=0x7f08b80b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bc86e640 1 --2- 172.21.15.94:0/3229463744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b80b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bc86e640 1 -- 172.21.15.94:0/3229463744 >> v1:172.21.15.155:6789/0 conn(0x7f08b815b570 legacy=0x7f08b80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:02.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.110+0000 7f08bc86e640 1 -- 172.21.15.94:0/3229463744 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b80b46d0 con 0x7f08b80b51b0 2024-09-11T23:17:02.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bc86e640 1 --2- 172.21.15.94:0/3229463744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b80b51b0 0x7f08b80b55d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4f8dbd8e8a545d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:02.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08affff640 1 -- 172.21.15.94:0/3229463744 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a80b0070 con 0x7f08b80b51b0 2024-09-11T23:17:02.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08affff640 1 -- 172.21.15.94:0/3229463744 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80ab600 con 0x7f08b80b51b0 2024-09-11T23:17:02.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08affff640 1 -- 172.21.15.94:0/3229463744 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a80ab9d0 con 0x7f08b80b51b0 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 -- 172.21.15.94:0/3229463744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b80b51b0 msgr2=0x7f08b80b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/3229463744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b80b51b0 0x7f08b80b55d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a801c4d0 comp rx=0 tx=0).stop 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 -- 172.21.15.94:0/3229463744 shutdown_connections 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/3229463744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b80b51b0 0x7f08b80b55d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/3229463744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b80b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 -- 172.21.15.94:0/3229463744 >> 172.21.15.94:0/3229463744 conn(0x7f08b80b6870 msgr2=0x7f08b80b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 -- 172.21.15.94:0/3229463744 shutdown_connections 2024-09-11T23:17:02.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 -- 172.21.15.94:0/3229463744 wait complete. 2024-09-11T23:17:02.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 Processor -- start 2024-09-11T23:17:02.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.114+0000 7f08bf2d3640 1 -- start start 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b815aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08b80b51b0 0x7f08b80cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b815b570 0x7f08b806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8144e80 con 0x7f08b815b570 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8144d00 con 0x7f08b80b51b0 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f08b8168350 con 0x7f08b80b3330 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b815b570 0x7f08b806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b815b570 0x7f08b806ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55584/0 (socket says 172.21.15.94:55584) 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 -- 172.21.15.94:0/1053640875 learned_addr learned my addr 172.21.15.94:0/1053640875 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:02.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bc86e640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08b80b51b0 0x7f08b80cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd06f640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b815aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 -- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 msgr2=0x7f08b815aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b815aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 -- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08b80b51b0 msgr2=0x7f08b80cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08b80b51b0 0x7f08b80cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 -- 172.21.15.94:0/1053640875 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b80cc8e0 con 0x7f08b815b570 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd870640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b815b570 0x7f08b806ee20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c340 tx=0x7f08b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08adffb640 1 -- 172.21.15.94:0/1053640875 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4005220 con 0x7f08b815b570 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08adffb640 1 -- 172.21.15.94:0/1053640875 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b40053c0 con 0x7f08b815b570 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08adffb640 1 -- 172.21.15.94:0/1053640875 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4007270 con 0x7f08b815b570 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b80ccbc0 con 0x7f08b815b570 2024-09-11T23:17:02.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b80cd180 con 0x7f08b815b570 2024-09-11T23:17:02.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b80b3710 con 0x7f08b815b570 2024-09-11T23:17:02.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08adffb640 1 -- 172.21.15.94:0/1053640875 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08b4019020 con 0x7f08b815b570 2024-09-11T23:17:02.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08adffb640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f089c0678f0 0x7f089c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:02.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08adffb640 1 -- 172.21.15.94:0/1053640875 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f08b4085080 con 0x7f08b815b570 2024-09-11T23:17:02.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.118+0000 7f08bd06f640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f089c0678f0 0x7f089c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:02.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.122+0000 7f08bd06f640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f089c0678f0 0x7f089c069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08b0003fd0 tx=0x7f08b00039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:02.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.122+0000 7f08adffb640 1 -- 172.21.15.94:0/1053640875 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f08b40559a0 con 0x7f08b815b570 2024-09-11T23:17:02.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:02.326+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f08b80cd6a0 con 0x7f08b815b570 2024-09-11T23:17:03.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.314+0000 7f08adffb640 1 -- 172.21.15.94:0/1053640875 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f08b40552a0 con 0x7f08b815b570 2024-09-11T23:17:03.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f089c0678f0 msgr2=0x7f089c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f089c0678f0 0x7f089c069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08b0003fd0 tx=0x7f08b00039a0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b815b570 msgr2=0x7f08b806ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b815b570 0x7f08b806ee20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c340 tx=0x7f08b400c800 comp rx=0 tx=0).stop 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 shutdown_connections 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f089c0678f0 0x7f089c069db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08b815b570 0x7f08b806ee20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08b80b51b0 0x7f08b80cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 --2- 172.21.15.94:0/1053640875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08b80b3330 0x7f08b815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 >> 172.21.15.94:0/1053640875 conn(0x7f08b80b6870 msgr2=0x7f08b80b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 shutdown_connections 2024-09-11T23:17:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.318+0000 7f08bf2d3640 1 -- 172.21.15.94:0/1053640875 wait complete. 2024-09-11T23:17:03.346 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:17:03.346 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:17:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38b5e30640 1 Processor -- start 2024-09-11T23:17:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38b5e30640 1 -- start start 2024-09-11T23:17:03.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38b5e30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b0073e60 0x7f38b006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38b5e30640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f38b006fef0 0x7f38b015b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38b5e30640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b015bda0 con 0x7f38b00b3d50 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38b5e30640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f38b006ee50 con 0x7f38b006fef0 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38b5e30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f38b006f130 con 0x7f38b0073e60 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38a6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f38b006fef0 0x7f38b015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38a6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f38b006fef0 0x7f38b015b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55586/0 (socket says 172.21.15.94:55586) 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38a6ffd640 1 -- 172.21.15.94:0/2935279449 learned_addr learned my addr 172.21.15.94:0/2935279449 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38a6ffd640 1 -- 172.21.15.94:0/2935279449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b0073e60 msgr2=0x7f38b006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38a6ffd640 1 --2- 172.21.15.94:0/2935279449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b0073e60 0x7f38b006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38a6ffd640 1 -- 172.21.15.94:0/2935279449 >> v1:172.21.15.155:6789/0 conn(0x7f38b00b3d50 legacy=0x7f38b00b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.470+0000 7f38a6ffd640 1 -- 172.21.15.94:0/2935279449 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b006f410 con 0x7f38b006fef0 2024-09-11T23:17:03.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38a6ffd640 1 --2- 172.21.15.94:0/2935279449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b015b860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3898009870 tx=0x7f389801d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3d1289d426b8c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:03.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38aeffd640 1 -- 172.21.15.94:0/2935279449 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980b3070 con 0x7f38b006fef0 2024-09-11T23:17:03.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38aeffd640 1 -- 172.21.15.94:0/2935279449 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38980ae680 con 0x7f38b006fef0 2024-09-11T23:17:03.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38aeffd640 1 -- 172.21.15.94:0/2935279449 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980aea50 con 0x7f38b006fef0 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- 172.21.15.94:0/2935279449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 msgr2=0x7f38b015b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2935279449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b015b860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3898009870 tx=0x7f389801d5a0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- 172.21.15.94:0/2935279449 shutdown_connections 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2935279449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b015b860 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2935279449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b0073e60 0x7f38b006e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- 172.21.15.94:0/2935279449 >> 172.21.15.94:0/2935279449 conn(0x7f38b00b1f90 msgr2=0x7f38b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- 172.21.15.94:0/2935279449 shutdown_connections 2024-09-11T23:17:03.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- 172.21.15.94:0/2935279449 wait complete. 2024-09-11T23:17:03.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 Processor -- start 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- start start 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b014aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38b0073e60 0x7f38b0153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b00b3d50 0x7f38b0159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f38b00729e0 con 0x7f38b006fef0 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f38b0072860 con 0x7f38b0073e60 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f38b0072b60 con 0x7f38b00b3d50 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b014aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b014aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55590/0 (socket says 172.21.15.94:55590) 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 -- 172.21.15.94:0/2892818517 learned_addr learned my addr 172.21.15.94:0/2892818517 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 -- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b00b3d50 msgr2=0x7f38b0159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b00b3d50 0x7f38b0159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 -- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38b0073e60 msgr2=0x7f38b0153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38b0073e60 0x7f38b0153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 -- 172.21.15.94:0/2892818517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b0154380 con 0x7f38b006fef0 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38af7fe640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b014aad0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b580 tx=0x7f38a000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38acff9640 1 -- 172.21.15.94:0/2892818517 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0014070 con 0x7f38b006fef0 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b0154660 con 0x7f38b006fef0 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b014ea40 con 0x7f38b006fef0 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38acff9640 1 -- 172.21.15.94:0/2892818517 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a0010870 con 0x7f38b006fef0 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.474+0000 7f38acff9640 1 -- 172.21.15.94:0/2892818517 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a001e060 con 0x7f38b006fef0 2024-09-11T23:17:03.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.478+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b015b860 con 0x7f38b006fef0 2024-09-11T23:17:03.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.478+0000 7f38acff9640 1 -- 172.21.15.94:0/2892818517 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38a0017070 con 0x7f38b006fef0 2024-09-11T23:17:03.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.478+0000 7f38acff9640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38900678c0 0x7f3890069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.478+0000 7f38acff9640 1 -- 172.21.15.94:0/2892818517 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f38a0085ff0 con 0x7f38b006fef0 2024-09-11T23:17:03.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.478+0000 7f38a6ffd640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38900678c0 0x7f3890069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:03.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.478+0000 7f38a6ffd640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38900678c0 0x7f3890069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38980b0000 tx=0x7f3898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.482+0000 7f38acff9640 1 -- 172.21.15.94:0/2892818517 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f38a00569b0 con 0x7f38b006fef0 2024-09-11T23:17:03.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:03.682+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f38b0073860 con 0x7f38b006fef0 2024-09-11T23:17:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.322+0000 7f38acff9640 1 -- 172.21.15.94:0/2892818517 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f38a00562b0 con 0x7f38b006fef0 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38900678c0 msgr2=0x7f3890069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38900678c0 0x7f3890069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38980b0000 tx=0x7f3898008040 comp rx=0 tx=0).stop 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 msgr2=0x7f38b014aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b014aad0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b580 tx=0x7f38a000ba40 comp rx=0 tx=0).stop 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 shutdown_connections 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38b00b3d50 0x7f38b0159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38b0073e60 0x7f38b0153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f38900678c0 0x7f3890069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 --2- 172.21.15.94:0/2892818517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38b006fef0 0x7f38b014aad0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 >> 172.21.15.94:0/2892818517 conn(0x7f38b00b1f90 msgr2=0x7f38b00b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:04.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 shutdown_connections 2024-09-11T23:17:04.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.330+0000 7f38b5e30640 1 -- 172.21.15.94:0/2892818517 wait complete. 2024-09-11T23:17:04.354 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:17:04.355 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.466+0000 7f7b10f47640 1 Processor -- start 2024-09-11T23:17:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.466+0000 7f7b10f47640 1 -- start start 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b10f47640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b0c15c2a0 0x7f7b0c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b10f47640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b0c0b3290 con 0x7f7b0c0af2a0 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b10f47640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b0c0b3570 con 0x7f7b0c15bec0 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b10f47640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7b0c0b3850 con 0x7f7b0c15c2a0 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0ad9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7b0c0af2a0 0x7f7b0c06e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55144/0 (socket says 172.21.15.94:55144) 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0ad9d640 1 -- 172.21.15.94:0/2885233378 learned_addr learned my addr 172.21.15.94:0/2885233378 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/2885233378 >> v2:172.21.15.155:3300/0 conn(0x7f7b0c15c2a0 0x7f7b0c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256012804 0 0) 0x7f7b0c0b3290 con 0x7f7b0c0af2a0 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7af4003530 con 0x7f7b0c0af2a0 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2413812727 0 0) 0x7f7af4003530 con 0x7f7b0c0af2a0 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 >> v2:172.21.15.155:3300/0 conn(0x7f7b0c15c2a0 msgr2=0x7f7b0c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 --2- 172.21.15.94:0/2885233378 >> v2:172.21.15.155:3300/0 conn(0x7f7b0c15c2a0 0x7f7b0c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 >> v1:172.21.15.155:6789/0 conn(0x7f7b0c15bec0 legacy=0x7f7b0c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0c0b3b30 con 0x7f7b0c0af2a0 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7afc001680 con 0x7f7b0c0af2a0 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 >> v1:172.21.15.94:6789/0 conn(0x7f7b0c0af2a0 legacy=0x7f7b0c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7af40039c0 0x7f7af4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7af4004810 0x7f7af4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af40051d0 0x7f7af400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c0b3850 con 0x7f7af4004810 2024-09-11T23:17:04.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7af400c070 con 0x7f7af40051d0 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7af400c270 con 0x7f7af40039c0 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7af4004810 0x7f7af4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0ad9d640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af40051d0 0x7f7af400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 -- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7af40039c0 msgr2=0x7f7af4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7af40039c0 0x7f7af4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 -- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af40051d0 msgr2=0x7f7af400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af40051d0 0x7f7af400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 -- 172.21.15.94:0/2885233378 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af4003530 con 0x7f7af4004810 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0ad9d640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af40051d0 0x7f7af400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:04.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0ad9d640 1 -- 172.21.15.94:0/2885233378 reap_dead start 2024-09-11T23:17:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7af4004810 0x7f7af4004c90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009ab0 tx=0x7f7b0001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e82d7aee66837c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b000b2070 con 0x7f7af4004810 2024-09-11T23:17:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b000a5640 con 0x7f7af4004810 2024-09-11T23:17:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.470+0000 7f7b0959a640 1 -- 172.21.15.94:0/2885233378 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b000096b0 con 0x7f7af4004810 2024-09-11T23:17:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- 172.21.15.94:0/2885233378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7af4004810 msgr2=0x7f7af4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7af4004810 0x7f7af4004c90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009ab0 tx=0x7f7b0001ca50 comp rx=0 tx=0).stop 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- 172.21.15.94:0/2885233378 shutdown_connections 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 --2- 172.21.15.94:0/2885233378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7af4004810 0x7f7af4004c90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- 172.21.15.94:0/2885233378 >> 172.21.15.94:0/2885233378 conn(0x7f7b0c0b1f90 msgr2=0x7f7b0c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- 172.21.15.94:0/2885233378 shutdown_connections 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- 172.21.15.94:0/2885233378 wait complete. 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 Processor -- start 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- start start 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af4004810 0x7f7b0c1e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b0c157130 0x7f7b0c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b0c15c6e0 0x7f7b0c15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c0afc90 con 0x7f7b0c157130 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c0b40f0 con 0x7f7af4004810 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0c0af710 con 0x7f7b0c15c6e0 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b0c157130 0x7f7b0c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b0c157130 0x7f7b0c157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55614/0 (socket says 172.21.15.94:55614) 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 -- 172.21.15.94:0/4133343667 learned_addr learned my addr 172.21.15.94:0/4133343667 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 -- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b0c15c6e0 msgr2=0x7f7b0c15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b0ad9d640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b0c15c6e0 0x7f7b0c15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b0c15c6e0 0x7f7b0c15cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 -- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af4004810 msgr2=0x7f7b0c1e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b0a59c640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af4004810 0x7f7b0c1e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af4004810 0x7f7b0c1e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 -- 172.21.15.94:0/4133343667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0c15eb20 con 0x7f7b0c157130 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b0ad9d640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b0c15c6e0 0x7f7b0c15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b09d9b640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b0c157130 0x7f7b0c157590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7b0001c880 tx=0x7f7b000197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7afaffd640 1 -- 172.21.15.94:0/4133343667 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b000b2040 con 0x7f7b0c157130 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7afaffd640 1 -- 172.21.15.94:0/4133343667 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0000f000 con 0x7f7b0c157130 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0c15ee00 con 0x7f7b0c157130 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7afaffd640 1 -- 172.21.15.94:0/4133343667 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b000096b0 con 0x7f7b0c157130 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.474+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0c15f3c0 con 0x7f7b0c157130 2024-09-11T23:17:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.478+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b0c1594d0 con 0x7f7b0c157130 2024-09-11T23:17:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.478+0000 7f7afaffd640 1 -- 172.21.15.94:0/4133343667 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b000bf030 con 0x7f7b0c157130 2024-09-11T23:17:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.478+0000 7f7afaffd640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7aec0678c0 0x7f7aec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.478+0000 7f7afaffd640 1 -- 172.21.15.94:0/4133343667 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f7b0011fb80 con 0x7f7b0c157130 2024-09-11T23:17:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.478+0000 7f7b0a59c640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7aec0678c0 0x7f7aec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.478+0000 7f7b0a59c640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7aec0678c0 0x7f7aec069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7b04001d60 tx=0x7f7b04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.482+0000 7f7afaffd640 1 -- 172.21.15.94:0/4133343667 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b000c6060 con 0x7f7b0c157130 2024-09-11T23:17:04.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.678+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b0c06fcd0 con 0x7f7b0c157130 2024-09-11T23:17:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7afaffd640 1 -- 172.21.15.94:0/4133343667 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7f7b00016760 con 0x7f7b0c157130 2024-09-11T23:17:04.686 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:04.686 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"btime":"2024-09-11T23:17:04:322465+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2442107241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2442107241},{"type":"v1","addr":"172.21.15.155:6837","nonce":2442107241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1638163040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1638163040},{"type":"v1","addr":"172.21.15.155:6836","nonce":1638163040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2826826443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2826826443},{"type":"v1","addr":"172.21.15.94:6833","nonce":2826826443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:00.676836+0000","modified":"2024-09-11T23:17:03.687833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2087871065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2087871065},{"type":"v1","addr":"172.21.15.94:6835","nonce":2087871065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-11T23:17:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 24 2024-09-11T23:17:04.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7aec0678c0 msgr2=0x7f7aec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7aec0678c0 0x7f7aec069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7b04001d60 tx=0x7f7b04009040 comp rx=0 tx=0).stop 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b0c157130 msgr2=0x7f7b0c157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b0c157130 0x7f7b0c157590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7b0001c880 tx=0x7f7b000197f0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 shutdown_connections 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b0c15c6e0 0x7f7b0c15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7aec0678c0 0x7f7aec069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b0c157130 0x7f7b0c157590 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 --2- 172.21.15.94:0/4133343667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af4004810 0x7f7b0c1e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 >> 172.21.15.94:0/4133343667 conn(0x7f7b0c0b1f90 msgr2=0x7f7b0c0b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 shutdown_connections 2024-09-11T23:17:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.682+0000 7f7b10f47640 1 -- 172.21.15.94:0/4133343667 wait complete. 2024-09-11T23:17:04.704 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:04.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb77355b640 1 Processor -- start 2024-09-11T23:17:04.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb77355b640 1 -- start start 2024-09-11T23:17:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb77355b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb76c0b4460 0x7fb76c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb77355b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76c06ee50 con 0x7fb76c073e60 2024-09-11T23:17:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb77355b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76c06f130 con 0x7fb76c06fef0 2024-09-11T23:17:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb77355b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb76c06f410 con 0x7fb76c0b4460 2024-09-11T23:17:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb7712f7640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb76c073e60 0x7fb76c15b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55148/0 (socket says 172.21.15.94:55148) 2024-09-11T23:17:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb7712f7640 1 -- 172.21.15.94:0/4228852116 learned_addr learned my addr 172.21.15.94:0/4228852116 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758554417 0 0) 0x7fb76c06ee50 con 0x7fb76c073e60 2024-09-11T23:17:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb771af8640 1 --2- 172.21.15.94:0/4228852116 >> v2:172.21.15.155:3300/0 conn(0x7fb76c0b4460 0x7fb76c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb758003530 con 0x7fb76c073e60 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 228773380 0 0) 0x7fb758003530 con 0x7fb76c073e60 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 >> v2:172.21.15.155:3300/0 conn(0x7fb76c0b4460 msgr2=0x7fb76c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 --2- 172.21.15.94:0/4228852116 >> v2:172.21.15.155:3300/0 conn(0x7fb76c0b4460 0x7fb76c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 >> v1:172.21.15.155:6789/0 conn(0x7fb76c06fef0 legacy=0x7fb76c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c06f6f0 con 0x7fb76c073e60 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fb768001680 con 0x7fb76c073e60 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 >> v1:172.21.15.94:6789/0 conn(0x7fb76c073e60 legacy=0x7fb76c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7580039c0 0x7fb758003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb758004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7580052f0 0x7fb75800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c06f410 con 0x7fb758004810 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb75800c1c0 con 0x7fb7580039c0 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb75800c3c0 con 0x7fb7580052f0 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb770af6640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb758004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb7712f7640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7580039c0 0x7fb758003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb770af6640 1 -- 172.21.15.94:0/4228852116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7580052f0 msgr2=0x7fb75800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb770af6640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7580052f0 0x7fb75800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb770af6640 1 -- 172.21.15.94:0/4228852116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7580039c0 msgr2=0x7fb758003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb770af6640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7580039c0 0x7fb758003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb770af6640 1 -- 172.21.15.94:0/4228852116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb758003530 con 0x7fb758004810 2024-09-11T23:17:04.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.810+0000 7fb771af8640 1 -- 172.21.15.94:0/4228852116 reap_dead start 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb770af6640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb758004c90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb760001750 tx=0x7fb76001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389e3ec6d7deb7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7600013a0 con 0x7fb758004810 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7600052f0 con 0x7fb758004810 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb75ffff640 1 -- 172.21.15.94:0/4228852116 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760003840 con 0x7fb758004810 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- 172.21.15.94:0/4228852116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 msgr2=0x7fb758004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb758004c90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb760001750 tx=0x7fb76001c3a0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- 172.21.15.94:0/4228852116 shutdown_connections 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 --2- 172.21.15.94:0/4228852116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb758004c90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- 172.21.15.94:0/4228852116 >> 172.21.15.94:0/4228852116 conn(0x7fb76c0b1f90 msgr2=0x7fb76c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- 172.21.15.94:0/4228852116 shutdown_connections 2024-09-11T23:17:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- 172.21.15.94:0/4228852116 wait complete. 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 Processor -- start 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- start start 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb76c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76c151a20 0x7fb76c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76c149d10 0x7fb76c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c06e900 con 0x7fb758004810 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c06e780 con 0x7fb76c149d10 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c06ea80 con 0x7fb76c151a20 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb76c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb76c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55636/0 (socket says 172.21.15.94:55636) 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 -- 172.21.15.94:0/2869233090 learned_addr learned my addr 172.21.15.94:0/2869233090 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb771af8640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76c149d10 0x7fb76c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 -- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76c151a20 msgr2=0x7fb76c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76c151a20 0x7fb76c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 -- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76c149d10 msgr2=0x7fb76c14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76c149d10 0x7fb76c14a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 -- 172.21.15.94:0/2869233090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c099e60 con 0x7fb758004810 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb7712f7640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb76c159840 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb76800d800 tx=0x7fb76800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb75dffb640 1 -- 172.21.15.94:0/2869233090 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768019070 con 0x7fb758004810 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb75dffb640 1 -- 172.21.15.94:0/2869233090 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7680074e0 con 0x7fb758004810 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c099b80 con 0x7fb758004810 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb75dffb640 1 -- 172.21.15.94:0/2869233090 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7680049f0 con 0x7fb758004810 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.814+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c14a6d0 con 0x7fb758004810 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.818+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c15e400 con 0x7fb758004810 2024-09-11T23:17:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.818+0000 7fb75dffb640 1 -- 172.21.15.94:0/2869233090 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb76801c070 con 0x7fb758004810 2024-09-11T23:17:04.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.818+0000 7fb75dffb640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7500678f0 0x7fb750069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:04.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.818+0000 7fb75dffb640 1 -- 172.21.15.94:0/2869233090 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fb7680857c0 con 0x7fb758004810 2024-09-11T23:17:04.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.818+0000 7fb770af6640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7500678f0 0x7fb750069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:04.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.818+0000 7fb770af6640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7500678f0 0x7fb750069db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb758004790 tx=0x7fb760001130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:04.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.822+0000 7fb75dffb640 1 -- 172.21.15.94:0/2869233090 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb768056200 con 0x7fb758004810 2024-09-11T23:17:04.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.982+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb76c0723f0 con 0x7fb758004810 2024-09-11T23:17:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.982+0000 7fb75dffb640 1 -- 172.21.15.94:0/2869233090 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17026 (secure 0 0 0) 0x7fb768055b00 con 0x7fb758004810 2024-09-11T23:17:04.988 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:04.988 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":51,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:02.251694+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:59.244408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:59.671966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:04.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7500678f0 msgr2=0x7fb750069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7500678f0 0x7fb750069db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb758004790 tx=0x7fb760001130 comp rx=0 tx=0).stop 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 msgr2=0x7fb76c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb76c159840 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb76800d800 tx=0x7fb76800dcc0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 shutdown_connections 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76c149d10 0x7fb76c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76c151a20 0x7fb76c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7500678f0 0x7fb750069db0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 --2- 172.21.15.94:0/2869233090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb758004810 0x7fb76c159840 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 >> 172.21.15.94:0/2869233090 conn(0x7fb76c0b1f90 msgr2=0x7fb76c072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 shutdown_connections 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:04.986+0000 7fb77355b640 1 -- 172.21.15.94:0/2869233090 wait complete. 2024-09-11T23:17:05.007 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:17:05.008 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:17:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a5a859640 1 Processor -- start 2024-09-11T23:17:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a5a859640 1 -- start start 2024-09-11T23:17:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a5a859640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a54145080 0x7f1a540b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a5a859640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145680 0x7f1a5406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a5a859640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a54145460 con 0x7f1a54145bd0 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a5a859640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1a540afa10 con 0x7f1a54145080 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a5a859640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5406c990 con 0x7f1a54145680 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a53fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a54145080 0x7f1a540b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a58df6640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1a54145bd0 0x7f1a540afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55158/0 (socket says 172.21.15.94:55158) 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a58df6640 1 -- 172.21.15.94:0/3727153945 learned_addr learned my addr 172.21.15.94:0/3727153945 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a53fff640 1 -- 172.21.15.94:0/3727153945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145680 msgr2=0x7f1a5406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a53fff640 1 --2- 172.21.15.94:0/3727153945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145680 0x7f1a5406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a53fff640 1 -- 172.21.15.94:0/3727153945 >> v1:172.21.15.94:6789/0 conn(0x7f1a54145bd0 legacy=0x7f1a540afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a53fff640 1 -- 172.21.15.94:0/3727153945 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a541607c0 con 0x7f1a54145080 2024-09-11T23:17:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.114+0000 7f1a53fff640 1 --2- 172.21.15.94:0/3727153945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a540b4020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097c0 tx=0x7f1a3c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6b9073ce0597f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a537fe640 1 -- 172.21.15.94:0/3727153945 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0b0070 con 0x7f1a54145080 2024-09-11T23:17:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a537fe640 1 -- 172.21.15.94:0/3727153945 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0ab600 con 0x7f1a54145080 2024-09-11T23:17:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a537fe640 1 -- 172.21.15.94:0/3727153945 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0ab9d0 con 0x7f1a54145080 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- 172.21.15.94:0/3727153945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 msgr2=0x7f1a540b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 --2- 172.21.15.94:0/3727153945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a540b4020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097c0 tx=0x7f1a3c01c330 comp rx=0 tx=0).stop 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- 172.21.15.94:0/3727153945 shutdown_connections 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 --2- 172.21.15.94:0/3727153945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145680 0x7f1a5406bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 --2- 172.21.15.94:0/3727153945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a540b4020 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- 172.21.15.94:0/3727153945 >> 172.21.15.94:0/3727153945 conn(0x7f1a5409aa00 msgr2=0x7f1a540b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- 172.21.15.94:0/3727153945 shutdown_connections 2024-09-11T23:17:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- 172.21.15.94:0/3727153945 wait complete. 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 Processor -- start 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- start start 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a5415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a54145680 0x7f1a541f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145bd0 0x7f1a5415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1a540b05b0 con 0x7f1a54145080 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a540ae290 con 0x7f1a54145680 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1a540b0730 con 0x7f1a54145bd0 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a5415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a5415bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55646/0 (socket says 172.21.15.94:55646) 2024-09-11T23:17:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 -- 172.21.15.94:0/2085214168 learned_addr learned my addr 172.21.15.94:0/2085214168 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 -- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145bd0 msgr2=0x7f1a5415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145bd0 0x7f1a5415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 -- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a54145680 msgr2=0x7f1a541f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a54145680 0x7f1a541f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 -- 172.21.15.94:0/2085214168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5415c980 con 0x7f1a54145080 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a53fff640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a5415bbe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0ae040 tx=0x7f1a3c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a517fa640 1 -- 172.21.15.94:0/2085214168 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0b0050 con 0x7f1a54145080 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a517fa640 1 -- 172.21.15.94:0/2085214168 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0bc070 con 0x7f1a54145080 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5415cc60 con 0x7f1a54145080 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a5415d220 con 0x7f1a54145080 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.118+0000 7f1a517fa640 1 -- 172.21.15.94:0/2085214168 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0aac20 con 0x7f1a54145080 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.122+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a540b51a0 con 0x7f1a54145080 2024-09-11T23:17:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.122+0000 7f1a517fa640 1 -- 172.21.15.94:0/2085214168 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a3c0c1460 con 0x7f1a54145080 2024-09-11T23:17:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.122+0000 7f1a517fa640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1a380678c0 0x7f1a38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.122+0000 7f1a517fa640 1 -- 172.21.15.94:0/2085214168 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f1a3c120bb0 con 0x7f1a54145080 2024-09-11T23:17:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.122+0000 7f1a4bfff640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1a380678c0 0x7f1a38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.122+0000 7f1a4bfff640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1a380678c0 0x7f1a38069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a541445a0 tx=0x7f1a44006ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.126+0000 7f1a517fa640 1 -- 172.21.15.94:0/2085214168 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1a3c015fb0 con 0x7f1a54145080 2024-09-11T23:17:05.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.274+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a5415c730 con 0x7f1a380678c0 2024-09-11T23:17:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.294+0000 7f1a517fa640 1 -- 172.21.15.94:0/2085214168 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7f1a5415c730 con 0x7f1a380678c0 2024-09-11T23:17:05.302 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1a380678c0 msgr2=0x7f1a38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1a380678c0 0x7f1a38069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a541445a0 tx=0x7f1a44006ca0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 msgr2=0x7f1a5415bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a5415bbe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0ae040 tx=0x7f1a3c01ab70 comp rx=0 tx=0).stop 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 shutdown_connections 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a54145bd0 0x7f1a5415da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a54145680 0x7f1a541f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1a380678c0 0x7f1a38069d80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 --2- 172.21.15.94:0/2085214168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a54145080 0x7f1a5415bbe0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 >> 172.21.15.94:0/2085214168 conn(0x7f1a5409aa00 msgr2=0x7f1a540b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 shutdown_connections 2024-09-11T23:17:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.298+0000 7f1a5a859640 1 -- 172.21.15.94:0/2085214168 wait complete. 2024-09-11T23:17:05.318 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-11T23:17:04.004521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271988,"kb_used_data":5816,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754702732,"statfs":{"total":773094113280,"available":772815597568,"internally_reserved":0,"allocated":5955584,"data_stored":3280620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.704696"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290011+0000","last_change":"2024-09-11T23:17:01.284867+0000","last_active":"2024-09-11T23:17:01.290011+0000","last_peered":"2024-09-11T23:17:01.290011+0000","last_clean":"2024-09-11T23:17:01.290011+0000","last_became_active":"2024-09-11T23:17:01.283940+0000","last_became_peered":"2024-09-11T23:17:01.283940+0000","last_unstale":"2024-09-11T23:17:01.290011+0000","last_undegraded":"2024-09-11T23:17:01.290011+0000","last_fullsized":"2024-09-11T23:17:01.290011+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:40.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302782+0000","last_change":"2024-09-11T23:17:01.299418+0000","last_active":"2024-09-11T23:17:01.302782+0000","last_peered":"2024-09-11T23:17:01.302782+0000","last_clean":"2024-09-11T23:17:01.302782+0000","last_became_active":"2024-09-11T23:17:01.291838+0000","last_became_peered":"2024-09-11T23:17:01.291838+0000","last_unstale":"2024-09-11T23:17:01.302782+0000","last_undegraded":"2024-09-11T23:17:01.302782+0000","last_fullsized":"2024-09-11T23:17:01.302782+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.703259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.306484+0000","last_change":"2024-09-11T23:17:01.291777+0000","last_active":"2024-09-11T23:17:01.306484+0000","last_peered":"2024-09-11T23:17:01.306484+0000","last_clean":"2024-09-11T23:17:01.306484+0000","last_became_active":"2024-09-11T23:17:01.291019+0000","last_became_peered":"2024-09-11T23:17:01.291019+0000","last_unstale":"2024-09-11T23:17:01.306484+0000","last_undegraded":"2024-09-11T23:17:01.306484+0000","last_fullsized":"2024-09-11T23:17:01.306484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.908267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296221+0000","last_change":"2024-09-11T23:17:01.291589+0000","last_active":"2024-09-11T23:17:01.296221+0000","last_peered":"2024-09-11T23:17:01.296221+0000","last_clean":"2024-09-11T23:17:01.296221+0000","last_became_active":"2024-09-11T23:17:01.290703+0000","last_became_peered":"2024-09-11T23:17:01.290703+0000","last_unstale":"2024-09-11T23:17:01.296221+0000","last_undegraded":"2024-09-11T23:17:01.296221+0000","last_fullsized":"2024-09-11T23:17:01.296221+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.187428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296461+0000","last_change":"2024-09-11T23:17:01.288834+0000","last_active":"2024-09-11T23:17:01.296461+0000","last_peered":"2024-09-11T23:17:01.296461+0000","last_clean":"2024-09-11T23:17:01.296461+0000","last_became_active":"2024-09-11T23:17:01.287210+0000","last_became_peered":"2024-09-11T23:17:01.287210+0000","last_unstale":"2024-09-11T23:17:01.296461+0000","last_undegraded":"2024-09-11T23:17:01.296461+0000","last_fullsized":"2024-09-11T23:17:01.296461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:40.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.313246+0000","last_change":"2024-09-11T23:17:01.309596+0000","last_active":"2024-09-11T23:17:01.313246+0000","last_peered":"2024-09-11T23:17:01.313246+0000","last_clean":"2024-09-11T23:17:01.313246+0000","last_became_active":"2024-09-11T23:17:01.308970+0000","last_became_peered":"2024-09-11T23:17:01.308970+0000","last_unstale":"2024-09-11T23:17:01.313246+0000","last_undegraded":"2024-09-11T23:17:01.313246+0000","last_fullsized":"2024-09-11T23:17:01.313246+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305259+0000","last_change":"2024-09-11T23:17:01.287768+0000","last_active":"2024-09-11T23:17:01.305259+0000","last_peered":"2024-09-11T23:17:01.305259+0000","last_clean":"2024-09-11T23:17:01.305259+0000","last_became_active":"2024-09-11T23:17:01.286983+0000","last_became_peered":"2024-09-11T23:17:01.286983+0000","last_unstale":"2024-09-11T23:17:01.305259+0000","last_undegraded":"2024-09-11T23:17:01.305259+0000","last_fullsized":"2024-09-11T23:17:01.305259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.703259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301482+0000","last_change":"2024-09-11T23:17:01.295059+0000","last_active":"2024-09-11T23:17:01.301482+0000","last_peered":"2024-09-11T23:17:01.301482+0000","last_clean":"2024-09-11T23:17:01.301482+0000","last_became_active":"2024-09-11T23:17:01.294375+0000","last_became_peered":"2024-09-11T23:17:01.294375+0000","last_unstale":"2024-09-11T23:17:01.301482+0000","last_undegraded":"2024-09-11T23:17:01.301482+0000","last_fullsized":"2024-09-11T23:17:01.301482+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:21.846816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301559+0000","last_change":"2024-09-11T23:17:01.293855+0000","last_active":"2024-09-11T23:17:01.301559+0000","last_peered":"2024-09-11T23:17:01.301559+0000","last_clean":"2024-09-11T23:17:01.301559+0000","last_became_active":"2024-09-11T23:17:01.292873+0000","last_became_peered":"2024-09-11T23:17:01.292873+0000","last_unstale":"2024-09-11T23:17:01.301559+0000","last_undegraded":"2024-09-11T23:17:01.301559+0000","last_fullsized":"2024-09-11T23:17:01.301559+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:29.084820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.307847+0000","last_change":"2024-09-11T23:17:01.293509+0000","last_active":"2024-09-11T23:17:01.307847+0000","last_peered":"2024-09-11T23:17:01.307847+0000","last_clean":"2024-09-11T23:17:01.307847+0000","last_became_active":"2024-09-11T23:17:01.292831+0000","last_became_peered":"2024-09-11T23:17:01.292831+0000","last_unstale":"2024-09-11T23:17:01.307847+0000","last_undegraded":"2024-09-11T23:17:01.307847+0000","last_fullsized":"2024-09-11T23:17:01.307847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:02.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302453+0000","last_change":"2024-09-11T23:17:01.297843+0000","last_active":"2024-09-11T23:17:01.302453+0000","last_peered":"2024-09-11T23:17:01.302453+0000","last_clean":"2024-09-11T23:17:01.302453+0000","last_became_active":"2024-09-11T23:17:01.297164+0000","last_became_peered":"2024-09-11T23:17:01.297164+0000","last_unstale":"2024-09-11T23:17:01.302453+0000","last_undegraded":"2024-09-11T23:17:01.302453+0000","last_fullsized":"2024-09-11T23:17:01.302453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:00.310665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290181+0000","last_change":"2024-09-11T23:17:01.282714+0000","last_active":"2024-09-11T23:17:01.290181+0000","last_peered":"2024-09-11T23:17:01.290181+0000","last_clean":"2024-09-11T23:17:01.290181+0000","last_became_active":"2024-09-11T23:17:01.281954+0000","last_became_peered":"2024-09-11T23:17:01.281954+0000","last_unstale":"2024-09-11T23:17:01.290181+0000","last_undegraded":"2024-09-11T23:17:01.290181+0000","last_fullsized":"2024-09-11T23:17:01.290181+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:13.539857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.308057+0000","last_change":"2024-09-11T23:17:01.293767+0000","last_active":"2024-09-11T23:17:01.308057+0000","last_peered":"2024-09-11T23:17:01.308057+0000","last_clean":"2024-09-11T23:17:01.308057+0000","last_became_active":"2024-09-11T23:17:01.292987+0000","last_became_peered":"2024-09-11T23:17:01.292987+0000","last_unstale":"2024-09-11T23:17:01.308057+0000","last_undegraded":"2024-09-11T23:17:01.308057+0000","last_fullsized":"2024-09-11T23:17:01.308057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.543014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305783+0000","last_change":"2024-09-11T23:17:01.292248+0000","last_active":"2024-09-11T23:17:01.305783+0000","last_peered":"2024-09-11T23:17:01.305783+0000","last_clean":"2024-09-11T23:17:01.305783+0000","last_became_active":"2024-09-11T23:17:01.291541+0000","last_became_peered":"2024-09-11T23:17:01.291541+0000","last_unstale":"2024-09-11T23:17:01.305783+0000","last_undegraded":"2024-09-11T23:17:01.305783+0000","last_fullsized":"2024-09-11T23:17:01.305783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:39.451942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296471+0000","last_change":"2024-09-11T23:17:01.291754+0000","last_active":"2024-09-11T23:17:01.296471+0000","last_peered":"2024-09-11T23:17:01.296471+0000","last_clean":"2024-09-11T23:17:01.296471+0000","last_became_active":"2024-09-11T23:17:01.290908+0000","last_became_peered":"2024-09-11T23:17:01.290908+0000","last_unstale":"2024-09-11T23:17:01.296471+0000","last_undegraded":"2024-09-11T23:17:01.296471+0000","last_fullsized":"2024-09-11T23:17:01.296471+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:34.047760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.284208+0000","last_change":"2024-09-11T23:17:01.278966+0000","last_active":"2024-09-11T23:17:01.284208+0000","last_peered":"2024-09-11T23:17:01.284208+0000","last_clean":"2024-09-11T23:17:01.284208+0000","last_became_active":"2024-09-11T23:17:01.278219+0000","last_became_peered":"2024-09-11T23:17:01.278219+0000","last_unstale":"2024-09-11T23:17:01.284208+0000","last_undegraded":"2024-09-11T23:17:01.284208+0000","last_fullsized":"2024-09-11T23:17:01.284208+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.414874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.309017+0000","last_change":"2024-09-11T23:17:01.304663+0000","last_active":"2024-09-11T23:17:01.309017+0000","last_peered":"2024-09-11T23:17:01.309017+0000","last_clean":"2024-09-11T23:17:01.309017+0000","last_became_active":"2024-09-11T23:17:01.299596+0000","last_became_peered":"2024-09-11T23:17:01.299596+0000","last_unstale":"2024-09-11T23:17:01.309017+0000","last_undegraded":"2024-09-11T23:17:01.309017+0000","last_fullsized":"2024-09-11T23:17:01.309017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:59.444407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305706+0000","last_change":"2024-09-11T23:17:01.301041+0000","last_active":"2024-09-11T23:17:01.305706+0000","last_peered":"2024-09-11T23:17:01.305706+0000","last_clean":"2024-09-11T23:17:01.305706+0000","last_became_active":"2024-09-11T23:17:01.300313+0000","last_became_peered":"2024-09-11T23:17:01.300313+0000","last_unstale":"2024-09-11T23:17:01.305706+0000","last_undegraded":"2024-09-11T23:17:01.305706+0000","last_fullsized":"2024-09-11T23:17:01.305706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.001235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.310348+0000","last_change":"2024-09-11T23:17:01.306190+0000","last_active":"2024-09-11T23:17:01.310348+0000","last_peered":"2024-09-11T23:17:01.310348+0000","last_clean":"2024-09-11T23:17:01.310348+0000","last_became_active":"2024-09-11T23:17:01.305422+0000","last_became_peered":"2024-09-11T23:17:01.305422+0000","last_unstale":"2024-09-11T23:17:01.310348+0000","last_undegraded":"2024-09-11T23:17:01.310348+0000","last_fullsized":"2024-09-11T23:17:01.310348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:19.836942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302641+0000","last_change":"2024-09-11T23:17:01.298066+0000","last_active":"2024-09-11T23:17:01.302641+0000","last_peered":"2024-09-11T23:17:01.302641+0000","last_clean":"2024-09-11T23:17:01.302641+0000","last_became_active":"2024-09-11T23:17:01.297366+0000","last_became_peered":"2024-09-11T23:17:01.297366+0000","last_unstale":"2024-09-11T23:17:01.302641+0000","last_undegraded":"2024-09-11T23:17:01.302641+0000","last_fullsized":"2024-09-11T23:17:01.302641+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:02.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.303644+0000","last_change":"2024-09-11T23:17:01.298059+0000","last_active":"2024-09-11T23:17:01.303644+0000","last_peered":"2024-09-11T23:17:01.303644+0000","last_clean":"2024-09-11T23:17:01.303644+0000","last_became_active":"2024-09-11T23:17:01.297335+0000","last_became_peered":"2024-09-11T23:17:01.297335+0000","last_unstale":"2024-09-11T23:17:01.303644+0000","last_undegraded":"2024-09-11T23:17:01.303644+0000","last_fullsized":"2024-09-11T23:17:01.303644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:02.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301299+0000","last_change":"2024-09-11T23:17:01.293883+0000","last_active":"2024-09-11T23:17:01.301299+0000","last_peered":"2024-09-11T23:17:01.301299+0000","last_clean":"2024-09-11T23:17:01.301299+0000","last_became_active":"2024-09-11T23:17:01.293132+0000","last_became_peered":"2024-09-11T23:17:01.293132+0000","last_unstale":"2024-09-11T23:17:01.301299+0000","last_undegraded":"2024-09-11T23:17:01.301299+0000","last_fullsized":"2024-09-11T23:17:01.301299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:15.373270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.303526+0000","last_change":"2024-09-11T23:17:01.299863+0000","last_active":"2024-09-11T23:17:01.303526+0000","last_peered":"2024-09-11T23:17:01.303526+0000","last_clean":"2024-09-11T23:17:01.303526+0000","last_became_active":"2024-09-11T23:17:01.298991+0000","last_became_peered":"2024-09-11T23:17:01.298991+0000","last_unstale":"2024-09-11T23:17:01.303526+0000","last_undegraded":"2024-09-11T23:17:01.303526+0000","last_fullsized":"2024-09-11T23:17:01.303526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:49.584193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.309337+0000","last_change":"2024-09-11T23:17:01.299461+0000","last_active":"2024-09-11T23:17:01.309337+0000","last_peered":"2024-09-11T23:17:01.309337+0000","last_clean":"2024-09-11T23:17:01.309337+0000","last_became_active":"2024-09-11T23:17:01.298583+0000","last_became_peered":"2024-09-11T23:17:01.298583+0000","last_unstale":"2024-09-11T23:17:01.309337+0000","last_undegraded":"2024-09-11T23:17:01.309337+0000","last_fullsized":"2024-09-11T23:17:01.309337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:05.102169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305111+0000","last_change":"2024-09-11T23:17:01.292219+0000","last_active":"2024-09-11T23:17:01.305111+0000","last_peered":"2024-09-11T23:17:01.305111+0000","last_clean":"2024-09-11T23:17:01.305111+0000","last_became_active":"2024-09-11T23:17:01.291421+0000","last_became_peered":"2024-09-11T23:17:01.291421+0000","last_unstale":"2024-09-11T23:17:01.305111+0000","last_undegraded":"2024-09-11T23:17:01.305111+0000","last_fullsized":"2024-09-11T23:17:01.305111+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:39.389730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301938+0000","last_change":"2024-09-11T23:17:01.297127+0000","last_active":"2024-09-11T23:17:01.301938+0000","last_peered":"2024-09-11T23:17:01.301938+0000","last_clean":"2024-09-11T23:17:01.301938+0000","last_became_active":"2024-09-11T23:17:01.295969+0000","last_became_peered":"2024-09-11T23:17:01.295969+0000","last_unstale":"2024-09-11T23:17:01.301938+0000","last_undegraded":"2024-09-11T23:17:01.301938+0000","last_fullsized":"2024-09-11T23:17:01.301938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:12.592842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.312624+0000","last_change":"2024-09-11T23:17:01.308165+0000","last_active":"2024-09-11T23:17:01.312624+0000","last_peered":"2024-09-11T23:17:01.312624+0000","last_clean":"2024-09-11T23:17:01.312624+0000","last_became_active":"2024-09-11T23:17:01.307437+0000","last_became_peered":"2024-09-11T23:17:01.307437+0000","last_unstale":"2024-09-11T23:17:01.312624+0000","last_undegraded":"2024-09-11T23:17:01.312624+0000","last_fullsized":"2024-09-11T23:17:01.312624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:24.083053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.289825+0000","last_change":"2024-09-11T23:17:01.287441+0000","last_active":"2024-09-11T23:17:01.289825+0000","last_peered":"2024-09-11T23:17:01.289825+0000","last_clean":"2024-09-11T23:17:01.289825+0000","last_became_active":"2024-09-11T23:17:01.286705+0000","last_became_peered":"2024-09-11T23:17:01.286705+0000","last_unstale":"2024-09-11T23:17:01.289825+0000","last_undegraded":"2024-09-11T23:17:01.289825+0000","last_fullsized":"2024-09-11T23:17:01.289825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:40.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.308925+0000","last_change":"2024-09-11T23:17:01.299541+0000","last_active":"2024-09-11T23:17:01.308925+0000","last_peered":"2024-09-11T23:17:01.308925+0000","last_clean":"2024-09-11T23:17:01.308925+0000","last_became_active":"2024-09-11T23:17:01.291810+0000","last_became_peered":"2024-09-11T23:17:01.291810+0000","last_unstale":"2024-09-11T23:17:01.308925+0000","last_undegraded":"2024-09-11T23:17:01.308925+0000","last_fullsized":"2024-09-11T23:17:01.308925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:22.748203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302250+0000","last_change":"2024-09-11T23:17:01.294962+0000","last_active":"2024-09-11T23:17:01.302250+0000","last_peered":"2024-09-11T23:17:01.302250+0000","last_clean":"2024-09-11T23:17:01.302250+0000","last_became_active":"2024-09-11T23:17:01.293432+0000","last_became_peered":"2024-09-11T23:17:01.293432+0000","last_unstale":"2024-09-11T23:17:01.302250+0000","last_undegraded":"2024-09-11T23:17:01.302250+0000","last_fullsized":"2024-09-11T23:17:01.302250+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305302+0000","last_change":"2024-09-11T23:17:01.291931+0000","last_active":"2024-09-11T23:17:01.305302+0000","last_peered":"2024-09-11T23:17:01.305302+0000","last_clean":"2024-09-11T23:17:01.305302+0000","last_became_active":"2024-09-11T23:17:01.291102+0000","last_became_peered":"2024-09-11T23:17:01.291102+0000","last_unstale":"2024-09-11T23:17:01.305302+0000","last_undegraded":"2024-09-11T23:17:01.305302+0000","last_fullsized":"2024-09-11T23:17:01.305302+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.001235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.292299+0000","last_change":"2024-09-11T23:17:01.283925+0000","last_active":"2024-09-11T23:17:01.292299+0000","last_peered":"2024-09-11T23:17:01.292299+0000","last_clean":"2024-09-11T23:17:01.292299+0000","last_became_active":"2024-09-11T23:17:01.283226+0000","last_became_peered":"2024-09-11T23:17:01.283226+0000","last_unstale":"2024-09-11T23:17:01.292299+0000","last_undegraded":"2024-09-11T23:17:01.292299+0000","last_fullsized":"2024-09-11T23:17:01.292299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.703259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296412+0000","last_change":"2024-09-11T23:17:01.291818+0000","last_active":"2024-09-11T23:17:01.296412+0000","last_peered":"2024-09-11T23:17:01.296412+0000","last_clean":"2024-09-11T23:17:01.296412+0000","last_became_active":"2024-09-11T23:17:01.290861+0000","last_became_peered":"2024-09-11T23:17:01.290861+0000","last_unstale":"2024-09-11T23:17:01.296412+0000","last_undegraded":"2024-09-11T23:17:01.296412+0000","last_fullsized":"2024-09-11T23:17:01.296412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:24.083053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332523+0000","last_change":"2024-09-11T23:17:00.335603+0000","last_active":"2024-09-11T23:17:01.332523+0000","last_peered":"2024-09-11T23:17:01.332523+0000","last_clean":"2024-09-11T23:17:01.332523+0000","last_became_active":"2024-09-11T23:17:00.334917+0000","last_became_peered":"2024-09-11T23:17:00.334917+0000","last_unstale":"2024-09-11T23:17:01.332523+0000","last_undegraded":"2024-09-11T23:17:01.332523+0000","last_fullsized":"2024-09-11T23:17:01.332523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:15.489292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.291858+0000","last_change":"2024-09-11T23:17:01.286652+0000","last_active":"2024-09-11T23:17:01.291858+0000","last_peered":"2024-09-11T23:17:01.291858+0000","last_clean":"2024-09-11T23:17:01.291858+0000","last_became_active":"2024-09-11T23:17:01.285876+0000","last_became_peered":"2024-09-11T23:17:01.285876+0000","last_unstale":"2024-09-11T23:17:01.291858+0000","last_undegraded":"2024-09-11T23:17:01.291858+0000","last_fullsized":"2024-09-11T23:17:01.291858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:06.462014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.330391+0000","last_change":"2024-09-11T23:17:00.344713+0000","last_active":"2024-09-11T23:17:01.330391+0000","last_peered":"2024-09-11T23:17:01.330391+0000","last_clean":"2024-09-11T23:17:01.330391+0000","last_became_active":"2024-09-11T23:17:00.340054+0000","last_became_peered":"2024-09-11T23:17:00.340054+0000","last_unstale":"2024-09-11T23:17:01.330391+0000","last_undegraded":"2024-09-11T23:17:01.330391+0000","last_fullsized":"2024-09-11T23:17:01.330391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:56.326296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302731+0000","last_change":"2024-09-11T23:17:01.300219+0000","last_active":"2024-09-11T23:17:01.302731+0000","last_peered":"2024-09-11T23:17:01.302731+0000","last_clean":"2024-09-11T23:17:01.302731+0000","last_became_active":"2024-09-11T23:17:01.299541+0000","last_became_peered":"2024-09-11T23:17:01.299541+0000","last_unstale":"2024-09-11T23:17:01.302731+0000","last_undegraded":"2024-09-11T23:17:01.302731+0000","last_fullsized":"2024-09-11T23:17:01.302731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.187428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.331582+0000","last_change":"2024-09-11T23:17:00.344393+0000","last_active":"2024-09-11T23:17:01.331582+0000","last_peered":"2024-09-11T23:17:01.331582+0000","last_clean":"2024-09-11T23:17:01.331582+0000","last_became_active":"2024-09-11T23:17:00.343855+0000","last_became_peered":"2024-09-11T23:17:00.343855+0000","last_unstale":"2024-09-11T23:17:01.331582+0000","last_undegraded":"2024-09-11T23:17:01.331582+0000","last_fullsized":"2024-09-11T23:17:01.331582+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.398813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290458+0000","last_change":"2024-09-11T23:17:01.287989+0000","last_active":"2024-09-11T23:17:01.290458+0000","last_peered":"2024-09-11T23:17:01.290458+0000","last_clean":"2024-09-11T23:17:01.290458+0000","last_became_active":"2024-09-11T23:17:01.287297+0000","last_became_peered":"2024-09-11T23:17:01.287297+0000","last_unstale":"2024-09-11T23:17:01.290458+0000","last_undegraded":"2024-09-11T23:17:01.290458+0000","last_fullsized":"2024-09-11T23:17:01.290458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:05.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332029+0000","last_change":"2024-09-11T23:17:00.325681+0000","last_active":"2024-09-11T23:17:01.332029+0000","last_peered":"2024-09-11T23:17:01.332029+0000","last_clean":"2024-09-11T23:17:01.332029+0000","last_became_active":"2024-09-11T23:17:00.324956+0000","last_became_peered":"2024-09-11T23:17:00.324956+0000","last_unstale":"2024-09-11T23:17:01.332029+0000","last_undegraded":"2024-09-11T23:17:01.332029+0000","last_fullsized":"2024-09-11T23:17:01.332029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:23.079146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.310261+0000","last_change":"2024-09-11T23:17:01.307697+0000","last_active":"2024-09-11T23:17:01.310261+0000","last_peered":"2024-09-11T23:17:01.310261+0000","last_clean":"2024-09-11T23:17:01.310261+0000","last_became_active":"2024-09-11T23:17:01.305902+0000","last_became_peered":"2024-09-11T23:17:01.305902+0000","last_unstale":"2024-09-11T23:17:01.310261+0000","last_undegraded":"2024-09-11T23:17:01.310261+0000","last_fullsized":"2024-09-11T23:17:01.310261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.543014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.328537+0000","last_change":"2024-09-11T23:17:00.339952+0000","last_active":"2024-09-11T23:17:01.328537+0000","last_peered":"2024-09-11T23:17:01.328537+0000","last_clean":"2024-09-11T23:17:01.328537+0000","last_became_active":"2024-09-11T23:17:00.339683+0000","last_became_peered":"2024-09-11T23:17:00.339683+0000","last_unstale":"2024-09-11T23:17:01.328537+0000","last_undegraded":"2024-09-11T23:17:01.328537+0000","last_fullsized":"2024-09-11T23:17:01.328537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.305414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301450+0000","last_change":"2024-09-11T23:17:01.294963+0000","last_active":"2024-09-11T23:17:01.301450+0000","last_peered":"2024-09-11T23:17:01.301450+0000","last_clean":"2024-09-11T23:17:01.301450+0000","last_became_active":"2024-09-11T23:17:01.293500+0000","last_became_peered":"2024-09-11T23:17:01.293500+0000","last_unstale":"2024-09-11T23:17:01.301450+0000","last_undegraded":"2024-09-11T23:17:01.301450+0000","last_fullsized":"2024-09-11T23:17:01.301450+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.301589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.325639+0000","last_change":"2024-09-11T23:17:00.334691+0000","last_active":"2024-09-11T23:17:01.325639+0000","last_peered":"2024-09-11T23:17:01.325639+0000","last_clean":"2024-09-11T23:17:01.325639+0000","last_became_active":"2024-09-11T23:17:00.334417+0000","last_became_peered":"2024-09-11T23:17:00.334417+0000","last_unstale":"2024-09-11T23:17:01.325639+0000","last_undegraded":"2024-09-11T23:17:01.325639+0000","last_fullsized":"2024-09-11T23:17:01.325639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:41.414178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301852+0000","last_change":"2024-09-11T23:17:01.296627+0000","last_active":"2024-09-11T23:17:01.301852+0000","last_peered":"2024-09-11T23:17:01.301852+0000","last_clean":"2024-09-11T23:17:01.301852+0000","last_became_active":"2024-09-11T23:17:01.295783+0000","last_became_peered":"2024-09-11T23:17:01.295783+0000","last_unstale":"2024-09-11T23:17:01.301852+0000","last_undegraded":"2024-09-11T23:17:01.301852+0000","last_fullsized":"2024-09-11T23:17:01.301852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:12.404923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.277401+0000","last_change":"2024-09-11T23:17:00.347240+0000","last_active":"2024-09-11T23:17:01.277401+0000","last_peered":"2024-09-11T23:17:01.277401+0000","last_clean":"2024-09-11T23:17:01.277401+0000","last_became_active":"2024-09-11T23:17:00.346554+0000","last_became_peered":"2024-09-11T23:17:00.346554+0000","last_unstale":"2024-09-11T23:17:01.277401+0000","last_undegraded":"2024-09-11T23:17:01.277401+0000","last_fullsized":"2024-09-11T23:17:01.277401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.542481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.310530+0000","last_change":"2024-09-11T23:17:01.307045+0000","last_active":"2024-09-11T23:17:01.310530+0000","last_peered":"2024-09-11T23:17:01.310530+0000","last_clean":"2024-09-11T23:17:01.310530+0000","last_became_active":"2024-09-11T23:17:01.306696+0000","last_became_peered":"2024-09-11T23:17:01.306696+0000","last_unstale":"2024-09-11T23:17:01.310530+0000","last_undegraded":"2024-09-11T23:17:01.310530+0000","last_fullsized":"2024-09-11T23:17:01.310530+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:06.462014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.279472+0000","last_change":"2024-09-11T23:17:00.325371+0000","last_active":"2024-09-11T23:17:01.279472+0000","last_peered":"2024-09-11T23:17:01.279472+0000","last_clean":"2024-09-11T23:17:01.279472+0000","last_became_active":"2024-09-11T23:17:00.324870+0000","last_became_peered":"2024-09-11T23:17:00.324870+0000","last_unstale":"2024-09-11T23:17:01.279472+0000","last_undegraded":"2024-09-11T23:17:01.279472+0000","last_fullsized":"2024-09-11T23:17:01.279472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:33.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296389+0000","last_change":"2024-09-11T23:17:01.284771+0000","last_active":"2024-09-11T23:17:01.296389+0000","last_peered":"2024-09-11T23:17:01.296389+0000","last_clean":"2024-09-11T23:17:01.296389+0000","last_became_active":"2024-09-11T23:17:01.283645+0000","last_became_peered":"2024-09-11T23:17:01.283645+0000","last_unstale":"2024-09-11T23:17:01.296389+0000","last_undegraded":"2024-09-11T23:17:01.296389+0000","last_fullsized":"2024-09-11T23:17:01.296389+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.414874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.271190+0000","last_change":"2024-09-11T23:17:00.349194+0000","last_active":"2024-09-11T23:17:01.271190+0000","last_peered":"2024-09-11T23:17:01.271190+0000","last_clean":"2024-09-11T23:17:01.271190+0000","last_became_active":"2024-09-11T23:17:00.348386+0000","last_became_peered":"2024-09-11T23:17:00.348386+0000","last_unstale":"2024-09-11T23:17:01.271190+0000","last_undegraded":"2024-09-11T23:17:01.271190+0000","last_fullsized":"2024-09-11T23:17:01.271190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.659664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.288513+0000","last_change":"2024-09-11T23:17:01.277828+0000","last_active":"2024-09-11T23:17:01.288513+0000","last_peered":"2024-09-11T23:17:01.288513+0000","last_clean":"2024-09-11T23:17:01.288513+0000","last_became_active":"2024-09-11T23:17:01.277064+0000","last_became_peered":"2024-09-11T23:17:01.277064+0000","last_unstale":"2024-09-11T23:17:01.288513+0000","last_undegraded":"2024-09-11T23:17:01.288513+0000","last_fullsized":"2024-09-11T23:17:01.288513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.258619+0000","last_change":"2024-09-11T23:17:00.335570+0000","last_active":"2024-09-11T23:17:01.258619+0000","last_peered":"2024-09-11T23:17:01.258619+0000","last_clean":"2024-09-11T23:17:01.258619+0000","last_became_active":"2024-09-11T23:17:00.334757+0000","last_became_peered":"2024-09-11T23:17:00.334757+0000","last_unstale":"2024-09-11T23:17:01.258619+0000","last_undegraded":"2024-09-11T23:17:01.258619+0000","last_fullsized":"2024-09-11T23:17:01.258619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.040670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305903+0000","last_change":"2024-09-11T23:17:01.298505+0000","last_active":"2024-09-11T23:17:01.305903+0000","last_peered":"2024-09-11T23:17:01.305903+0000","last_clean":"2024-09-11T23:17:01.305903+0000","last_became_active":"2024-09-11T23:17:01.297673+0000","last_became_peered":"2024-09-11T23:17:01.297673+0000","last_unstale":"2024-09-11T23:17:01.305903+0000","last_undegraded":"2024-09-11T23:17:01.305903+0000","last_fullsized":"2024-09-11T23:17:01.305903+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:19.502289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.328597+0000","last_change":"2024-09-11T23:17:00.347798+0000","last_active":"2024-09-11T23:17:01.328597+0000","last_peered":"2024-09-11T23:17:01.328597+0000","last_clean":"2024-09-11T23:17:01.328597+0000","last_became_active":"2024-09-11T23:17:00.347288+0000","last_became_peered":"2024-09-11T23:17:00.347288+0000","last_unstale":"2024-09-11T23:17:01.328597+0000","last_undegraded":"2024-09-11T23:17:01.328597+0000","last_fullsized":"2024-09-11T23:17:01.328597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:39.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296513+0000","last_change":"2024-09-11T23:17:01.291554+0000","last_active":"2024-09-11T23:17:01.296513+0000","last_peered":"2024-09-11T23:17:01.296513+0000","last_clean":"2024-09-11T23:17:01.296513+0000","last_became_active":"2024-09-11T23:17:01.288175+0000","last_became_peered":"2024-09-11T23:17:01.288175+0000","last_unstale":"2024-09-11T23:17:01.296513+0000","last_undegraded":"2024-09-11T23:17:01.296513+0000","last_fullsized":"2024-09-11T23:17:01.296513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:02.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332735+0000","last_change":"2024-09-11T23:17:00.333832+0000","last_active":"2024-09-11T23:17:01.332735+0000","last_peered":"2024-09-11T23:17:01.332735+0000","last_clean":"2024-09-11T23:17:01.332735+0000","last_became_active":"2024-09-11T23:17:00.333601+0000","last_became_peered":"2024-09-11T23:17:00.333601+0000","last_unstale":"2024-09-11T23:17:01.332735+0000","last_undegraded":"2024-09-11T23:17:01.332735+0000","last_fullsized":"2024-09-11T23:17:01.332735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:04.098262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296523+0000","last_change":"2024-09-11T23:17:01.294525+0000","last_active":"2024-09-11T23:17:01.296523+0000","last_peered":"2024-09-11T23:17:01.296523+0000","last_clean":"2024-09-11T23:17:01.296523+0000","last_became_active":"2024-09-11T23:17:01.293720+0000","last_became_peered":"2024-09-11T23:17:01.293720+0000","last_unstale":"2024-09-11T23:17:01.296523+0000","last_undegraded":"2024-09-11T23:17:01.296523+0000","last_fullsized":"2024-09-11T23:17:01.296523+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:39.451942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.329337+0000","last_change":"2024-09-11T23:17:00.332442+0000","last_active":"2024-09-11T23:17:01.329337+0000","last_peered":"2024-09-11T23:17:01.329337+0000","last_clean":"2024-09-11T23:17:01.329337+0000","last_became_active":"2024-09-11T23:17:00.332133+0000","last_became_peered":"2024-09-11T23:17:00.332133+0000","last_unstale":"2024-09-11T23:17:01.329337+0000","last_undegraded":"2024-09-11T23:17:01.329337+0000","last_fullsized":"2024-09-11T23:17:01.329337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:03.539107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305183+0000","last_change":"2024-09-11T23:17:01.284152+0000","last_active":"2024-09-11T23:17:01.305183+0000","last_peered":"2024-09-11T23:17:01.305183+0000","last_clean":"2024-09-11T23:17:01.305183+0000","last_became_active":"2024-09-11T23:17:01.283448+0000","last_became_peered":"2024-09-11T23:17:01.283448+0000","last_unstale":"2024-09-11T23:17:01.305183+0000","last_undegraded":"2024-09-11T23:17:01.305183+0000","last_fullsized":"2024-09-11T23:17:01.305183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.301589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.277805+0000","last_change":"2024-09-11T23:17:00.341453+0000","last_active":"2024-09-11T23:17:01.277805+0000","last_peered":"2024-09-11T23:17:01.277805+0000","last_clean":"2024-09-11T23:17:01.277805+0000","last_became_active":"2024-09-11T23:17:00.340833+0000","last_became_peered":"2024-09-11T23:17:00.340833+0000","last_unstale":"2024-09-11T23:17:01.277805+0000","last_undegraded":"2024-09-11T23:17:01.277805+0000","last_fullsized":"2024-09-11T23:17:01.277805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:56.326296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301898+0000","last_change":"2024-09-11T23:17:01.296625+0000","last_active":"2024-09-11T23:17:01.301898+0000","last_peered":"2024-09-11T23:17:01.301898+0000","last_clean":"2024-09-11T23:17:01.301898+0000","last_became_active":"2024-09-11T23:17:01.295236+0000","last_became_peered":"2024-09-11T23:17:01.295236+0000","last_unstale":"2024-09-11T23:17:01.301898+0000","last_undegraded":"2024-09-11T23:17:01.301898+0000","last_fullsized":"2024-09-11T23:17:01.301898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:03.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.271987+0000","last_change":"2024-09-11T23:17:00.350826+0000","last_active":"2024-09-11T23:17:01.271987+0000","last_peered":"2024-09-11T23:17:01.271987+0000","last_clean":"2024-09-11T23:17:01.271987+0000","last_became_active":"2024-09-11T23:17:00.350547+0000","last_became_peered":"2024-09-11T23:17:00.350547+0000","last_unstale":"2024-09-11T23:17:01.271987+0000","last_undegraded":"2024-09-11T23:17:01.271987+0000","last_fullsized":"2024-09-11T23:17:01.271987+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:03.539107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.309066+0000","last_change":"2024-09-11T23:17:01.304773+0000","last_active":"2024-09-11T23:17:01.309066+0000","last_peered":"2024-09-11T23:17:01.309066+0000","last_clean":"2024-09-11T23:17:01.309066+0000","last_became_active":"2024-09-11T23:17:01.299340+0000","last_became_peered":"2024-09-11T23:17:01.299340+0000","last_unstale":"2024-09-11T23:17:01.309066+0000","last_undegraded":"2024-09-11T23:17:01.309066+0000","last_fullsized":"2024-09-11T23:17:01.309066+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:13.539857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.330996+0000","last_change":"2024-09-11T23:17:00.333456+0000","last_active":"2024-09-11T23:17:01.330996+0000","last_peered":"2024-09-11T23:17:01.330996+0000","last_clean":"2024-09-11T23:17:01.330996+0000","last_became_active":"2024-09-11T23:17:00.333175+0000","last_became_peered":"2024-09-11T23:17:00.333175+0000","last_unstale":"2024-09-11T23:17:01.330996+0000","last_undegraded":"2024-09-11T23:17:01.330996+0000","last_fullsized":"2024-09-11T23:17:01.330996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:08.371031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.281743+0000","last_change":"2024-09-11T23:17:01.270681+0000","last_active":"2024-09-11T23:17:01.281743+0000","last_peered":"2024-09-11T23:17:01.281743+0000","last_clean":"2024-09-11T23:17:01.281743+0000","last_became_active":"2024-09-11T23:17:01.269941+0000","last_became_peered":"2024-09-11T23:17:01.269941+0000","last_unstale":"2024-09-11T23:17:01.281743+0000","last_undegraded":"2024-09-11T23:17:01.281743+0000","last_fullsized":"2024-09-11T23:17:01.281743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.908267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.330913+0000","last_change":"2024-09-11T23:17:00.326317+0000","last_active":"2024-09-11T23:17:01.330913+0000","last_peered":"2024-09-11T23:17:01.330913+0000","last_clean":"2024-09-11T23:17:01.330913+0000","last_became_active":"2024-09-11T23:17:00.325675+0000","last_became_peered":"2024-09-11T23:17:00.325675+0000","last_unstale":"2024-09-11T23:17:01.330913+0000","last_undegraded":"2024-09-11T23:17:01.330913+0000","last_fullsized":"2024-09-11T23:17:01.330913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:50.183520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.312489+0000","last_change":"2024-09-11T23:17:01.307977+0000","last_active":"2024-09-11T23:17:01.312489+0000","last_peered":"2024-09-11T23:17:01.312489+0000","last_clean":"2024-09-11T23:17:01.312489+0000","last_became_active":"2024-09-11T23:17:01.307332+0000","last_became_peered":"2024-09-11T23:17:01.307332+0000","last_unstale":"2024-09-11T23:17:01.312489+0000","last_undegraded":"2024-09-11T23:17:01.312489+0000","last_fullsized":"2024-09-11T23:17:01.312489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:34.047760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.331977+0000","last_change":"2024-09-11T23:17:00.333170+0000","last_active":"2024-09-11T23:17:01.331977+0000","last_peered":"2024-09-11T23:17:01.331977+0000","last_clean":"2024-09-11T23:17:01.331977+0000","last_became_active":"2024-09-11T23:17:00.332853+0000","last_became_peered":"2024-09-11T23:17:00.332853+0000","last_unstale":"2024-09-11T23:17:01.331977+0000","last_undegraded":"2024-09-11T23:17:01.331977+0000","last_fullsized":"2024-09-11T23:17:01.331977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:44.382506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.307485+0000","last_change":"2024-09-11T23:17:01.306285+0000","last_active":"2024-09-11T23:17:01.307485+0000","last_peered":"2024-09-11T23:17:01.307485+0000","last_clean":"2024-09-11T23:17:01.307485+0000","last_became_active":"2024-09-11T23:17:01.305534+0000","last_became_peered":"2024-09-11T23:17:01.305534+0000","last_unstale":"2024-09-11T23:17:01.307485+0000","last_undegraded":"2024-09-11T23:17:01.307485+0000","last_fullsized":"2024-09-11T23:17:01.307485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:02.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.328836+0000","last_change":"2024-09-11T23:17:00.348671+0000","last_active":"2024-09-11T23:17:01.328836+0000","last_peered":"2024-09-11T23:17:01.328836+0000","last_clean":"2024-09-11T23:17:01.328836+0000","last_became_active":"2024-09-11T23:17:00.348003+0000","last_became_peered":"2024-09-11T23:17:00.348003+0000","last_unstale":"2024-09-11T23:17:01.328836+0000","last_undegraded":"2024-09-11T23:17:01.328836+0000","last_fullsized":"2024-09-11T23:17:01.328836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.398813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.277598+0000","last_change":"2024-09-11T23:17:01.274605+0000","last_active":"2024-09-11T23:17:01.277598+0000","last_peered":"2024-09-11T23:17:01.277598+0000","last_clean":"2024-09-11T23:17:01.277598+0000","last_became_active":"2024-09-11T23:17:01.273871+0000","last_became_peered":"2024-09-11T23:17:01.273871+0000","last_unstale":"2024-09-11T23:17:01.277598+0000","last_undegraded":"2024-09-11T23:17:01.277598+0000","last_fullsized":"2024-09-11T23:17:01.277598+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:42.418086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.279467+0000","last_change":"2024-09-11T23:17:00.325871+0000","last_active":"2024-09-11T23:17:01.279467+0000","last_peered":"2024-09-11T23:17:01.279467+0000","last_clean":"2024-09-11T23:17:01.279467+0000","last_became_active":"2024-09-11T23:17:00.325604+0000","last_became_peered":"2024-09-11T23:17:00.325604+0000","last_unstale":"2024-09-11T23:17:01.279467+0000","last_undegraded":"2024-09-11T23:17:01.279467+0000","last_fullsized":"2024-09-11T23:17:01.279467+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:41.414178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.291720+0000","last_change":"2024-09-11T23:17:01.284583+0000","last_active":"2024-09-11T23:17:01.291720+0000","last_peered":"2024-09-11T23:17:01.291720+0000","last_clean":"2024-09-11T23:17:01.291720+0000","last_became_active":"2024-09-11T23:17:01.283910+0000","last_became_peered":"2024-09-11T23:17:01.283910+0000","last_unstale":"2024-09-11T23:17:01.291720+0000","last_undegraded":"2024-09-11T23:17:01.291720+0000","last_fullsized":"2024-09-11T23:17:01.291720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.001235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332174+0000","last_change":"2024-09-11T23:17:00.339884+0000","last_active":"2024-09-11T23:17:01.332174+0000","last_peered":"2024-09-11T23:17:01.332174+0000","last_clean":"2024-09-11T23:17:01.332174+0000","last_became_active":"2024-09-11T23:17:00.339609+0000","last_became_peered":"2024-09-11T23:17:00.339609+0000","last_unstale":"2024-09-11T23:17:01.332174+0000","last_undegraded":"2024-09-11T23:17:01.332174+0000","last_fullsized":"2024-09-11T23:17:01.332174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.040670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302702+0000","last_change":"2024-09-11T23:17:01.298257+0000","last_active":"2024-09-11T23:17:01.302702+0000","last_peered":"2024-09-11T23:17:01.302702+0000","last_clean":"2024-09-11T23:17:01.302702+0000","last_became_active":"2024-09-11T23:17:01.297559+0000","last_became_peered":"2024-09-11T23:17:01.297559+0000","last_unstale":"2024-09-11T23:17:01.302702+0000","last_undegraded":"2024-09-11T23:17:01.302702+0000","last_fullsized":"2024-09-11T23:17:01.302702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.543014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.255588+0000","last_change":"2024-09-11T23:17:00.334702+0000","last_active":"2024-09-11T23:17:01.255588+0000","last_peered":"2024-09-11T23:17:01.255588+0000","last_clean":"2024-09-11T23:17:01.255588+0000","last_became_active":"2024-09-11T23:17:00.334412+0000","last_became_peered":"2024-09-11T23:17:00.334412+0000","last_unstale":"2024-09-11T23:17:01.255588+0000","last_undegraded":"2024-09-11T23:17:01.255588+0000","last_fullsized":"2024-09-11T23:17:01.255588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:38.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.299105+0000","last_change":"2024-09-11T23:17:01.283378+0000","last_active":"2024-09-11T23:17:01.299105+0000","last_peered":"2024-09-11T23:17:01.299105+0000","last_clean":"2024-09-11T23:17:01.299105+0000","last_became_active":"2024-09-11T23:17:01.282679+0000","last_became_peered":"2024-09-11T23:17:01.282679+0000","last_unstale":"2024-09-11T23:17:01.299105+0000","last_undegraded":"2024-09-11T23:17:01.299105+0000","last_fullsized":"2024-09-11T23:17:01.299105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.264391+0000","last_change":"2024-09-11T23:17:00.328692+0000","last_active":"2024-09-11T23:17:01.264391+0000","last_peered":"2024-09-11T23:17:01.264391+0000","last_clean":"2024-09-11T23:17:01.264391+0000","last_became_active":"2024-09-11T23:17:00.328364+0000","last_became_peered":"2024-09-11T23:17:00.328364+0000","last_unstale":"2024-09-11T23:17:01.264391+0000","last_undegraded":"2024-09-11T23:17:01.264391+0000","last_fullsized":"2024-09-11T23:17:01.264391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:39.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.308950+0000","last_change":"2024-09-11T23:17:01.307681+0000","last_active":"2024-09-11T23:17:01.308950+0000","last_peered":"2024-09-11T23:17:01.308950+0000","last_clean":"2024-09-11T23:17:01.308950+0000","last_became_active":"2024-09-11T23:17:01.306915+0000","last_became_peered":"2024-09-11T23:17:01.306915+0000","last_unstale":"2024-09-11T23:17:01.308950+0000","last_undegraded":"2024-09-11T23:17:01.308950+0000","last_fullsized":"2024-09-11T23:17:01.308950+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.187428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.266999+0000","last_change":"2024-09-11T23:17:00.339034+0000","last_active":"2024-09-11T23:17:01.266999+0000","last_peered":"2024-09-11T23:17:01.266999+0000","last_clean":"2024-09-11T23:17:01.266999+0000","last_became_active":"2024-09-11T23:17:00.338748+0000","last_became_peered":"2024-09-11T23:17:00.338748+0000","last_unstale":"2024-09-11T23:17:01.266999+0000","last_undegraded":"2024-09-11T23:17:01.266999+0000","last_fullsized":"2024-09-11T23:17:01.266999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:33.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.292243+0000","last_change":"2024-09-11T23:17:01.283740+0000","last_active":"2024-09-11T23:17:01.292243+0000","last_peered":"2024-09-11T23:17:01.292243+0000","last_clean":"2024-09-11T23:17:01.292243+0000","last_became_active":"2024-09-11T23:17:01.283031+0000","last_became_peered":"2024-09-11T23:17:01.283031+0000","last_unstale":"2024-09-11T23:17:01.292243+0000","last_undegraded":"2024-09-11T23:17:01.292243+0000","last_fullsized":"2024-09-11T23:17:01.292243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.301589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.329648+0000","last_change":"2024-09-11T23:17:00.341317+0000","last_active":"2024-09-11T23:17:01.329648+0000","last_peered":"2024-09-11T23:17:01.329648+0000","last_clean":"2024-09-11T23:17:01.329648+0000","last_became_active":"2024-09-11T23:17:00.340715+0000","last_became_peered":"2024-09-11T23:17:00.340715+0000","last_unstale":"2024-09-11T23:17:01.329648+0000","last_undegraded":"2024-09-11T23:17:01.329648+0000","last_fullsized":"2024-09-11T23:17:01.329648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.040670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.289890+0000","last_change":"2024-09-11T23:17:01.288473+0000","last_active":"2024-09-11T23:17:01.289890+0000","last_peered":"2024-09-11T23:17:01.289890+0000","last_clean":"2024-09-11T23:17:01.289890+0000","last_became_active":"2024-09-11T23:17:01.287362+0000","last_became_peered":"2024-09-11T23:17:01.287362+0000","last_unstale":"2024-09-11T23:17:01.289890+0000","last_undegraded":"2024-09-11T23:17:01.289890+0000","last_fullsized":"2024-09-11T23:17:01.289890+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:02.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.271041+0000","last_change":"2024-09-11T23:17:00.348580+0000","last_active":"2024-09-11T23:17:01.271041+0000","last_peered":"2024-09-11T23:17:01.271041+0000","last_clean":"2024-09-11T23:17:01.271041+0000","last_became_active":"2024-09-11T23:17:00.348143+0000","last_became_peered":"2024-09-11T23:17:00.348143+0000","last_unstale":"2024-09-11T23:17:01.271041+0000","last_undegraded":"2024-09-11T23:17:01.271041+0000","last_fullsized":"2024-09-11T23:17:01.271041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.305414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.281603+0000","last_change":"2024-09-11T23:17:01.271149+0000","last_active":"2024-09-11T23:17:01.281603+0000","last_peered":"2024-09-11T23:17:01.281603+0000","last_clean":"2024-09-11T23:17:01.281603+0000","last_became_active":"2024-09-11T23:17:01.270298+0000","last_became_peered":"2024-09-11T23:17:01.270298+0000","last_unstale":"2024-09-11T23:17:01.281603+0000","last_undegraded":"2024-09-11T23:17:01.281603+0000","last_fullsized":"2024-09-11T23:17:01.281603+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:59.444407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.279575+0000","last_change":"2024-09-11T23:17:00.335427+0000","last_active":"2024-09-11T23:17:01.279575+0000","last_peered":"2024-09-11T23:17:01.279575+0000","last_clean":"2024-09-11T23:17:01.279575+0000","last_became_active":"2024-09-11T23:17:00.335159+0000","last_became_peered":"2024-09-11T23:17:00.335159+0000","last_unstale":"2024-09-11T23:17:01.279575+0000","last_undegraded":"2024-09-11T23:17:01.279575+0000","last_fullsized":"2024-09-11T23:17:01.279575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:23.079146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305679+0000","last_change":"2024-09-11T23:17:01.292111+0000","last_active":"2024-09-11T23:17:01.305679+0000","last_peered":"2024-09-11T23:17:01.305679+0000","last_clean":"2024-09-11T23:17:01.305679+0000","last_became_active":"2024-09-11T23:17:01.291389+0000","last_became_peered":"2024-09-11T23:17:01.291389+0000","last_unstale":"2024-09-11T23:17:01.305679+0000","last_undegraded":"2024-09-11T23:17:01.305679+0000","last_fullsized":"2024-09-11T23:17:01.305679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:06.462014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.257615+0000","last_change":"2024-09-11T23:17:00.334790+0000","last_active":"2024-09-11T23:17:01.257615+0000","last_peered":"2024-09-11T23:17:01.257615+0000","last_clean":"2024-09-11T23:17:01.257615+0000","last_became_active":"2024-09-11T23:17:00.334469+0000","last_became_peered":"2024-09-11T23:17:00.334469+0000","last_unstale":"2024-09-11T23:17:01.257615+0000","last_undegraded":"2024-09-11T23:17:01.257615+0000","last_fullsized":"2024-09-11T23:17:01.257615+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:21.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.294329+0000","last_change":"2024-09-11T23:17:01.290591+0000","last_active":"2024-09-11T23:17:01.294329+0000","last_peered":"2024-09-11T23:17:01.294329+0000","last_clean":"2024-09-11T23:17:01.294329+0000","last_became_active":"2024-09-11T23:17:01.289865+0000","last_became_peered":"2024-09-11T23:17:01.289865+0000","last_unstale":"2024-09-11T23:17:01.294329+0000","last_undegraded":"2024-09-11T23:17:01.294329+0000","last_fullsized":"2024-09-11T23:17:01.294329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:39.389730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.256013+0000","last_change":"2024-09-11T23:17:00.344847+0000","last_active":"2024-09-11T23:17:01.256013+0000","last_peered":"2024-09-11T23:17:01.256013+0000","last_clean":"2024-09-11T23:17:01.256013+0000","last_became_active":"2024-09-11T23:17:00.344547+0000","last_became_peered":"2024-09-11T23:17:00.344547+0000","last_unstale":"2024-09-11T23:17:01.256013+0000","last_undegraded":"2024-09-11T23:17:01.256013+0000","last_fullsized":"2024-09-11T23:17:01.256013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:18.498382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305996+0000","last_change":"2024-09-11T23:17:01.298762+0000","last_active":"2024-09-11T23:17:01.305996+0000","last_peered":"2024-09-11T23:17:01.305996+0000","last_clean":"2024-09-11T23:17:01.305996+0000","last_became_active":"2024-09-11T23:17:01.297988+0000","last_became_peered":"2024-09-11T23:17:01.297988+0000","last_unstale":"2024-09-11T23:17:01.305996+0000","last_undegraded":"2024-09-11T23:17:01.305996+0000","last_fullsized":"2024-09-11T23:17:01.305996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:09.374938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.257871+0000","last_change":"2024-09-11T23:17:00.334127+0000","last_active":"2024-09-11T23:17:01.257871+0000","last_peered":"2024-09-11T23:17:01.257871+0000","last_clean":"2024-09-11T23:17:01.257871+0000","last_became_active":"2024-09-11T23:17:00.332617+0000","last_became_peered":"2024-09-11T23:17:00.332617+0000","last_unstale":"2024-09-11T23:17:01.257871+0000","last_undegraded":"2024-09-11T23:17:01.257871+0000","last_fullsized":"2024-09-11T23:17:01.257871+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.398813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290565+0000","last_change":"2024-09-11T23:17:01.287518+0000","last_active":"2024-09-11T23:17:01.290565+0000","last_peered":"2024-09-11T23:17:01.290565+0000","last_clean":"2024-09-11T23:17:01.290565+0000","last_became_active":"2024-09-11T23:17:01.286674+0000","last_became_peered":"2024-09-11T23:17:01.286674+0000","last_unstale":"2024-09-11T23:17:01.290565+0000","last_undegraded":"2024-09-11T23:17:01.290565+0000","last_fullsized":"2024-09-11T23:17:01.290565+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:19.836942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.259036+0000","last_change":"2024-09-11T23:17:00.333014+0000","last_active":"2024-09-11T23:17:01.259036+0000","last_peered":"2024-09-11T23:17:01.259036+0000","last_clean":"2024-09-11T23:17:01.259036+0000","last_became_active":"2024-09-11T23:17:00.332488+0000","last_became_peered":"2024-09-11T23:17:00.332488+0000","last_unstale":"2024-09-11T23:17:01.259036+0000","last_undegraded":"2024-09-11T23:17:01.259036+0000","last_fullsized":"2024-09-11T23:17:01.259036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:33.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.285788+0000","last_change":"2024-09-11T23:17:01.280531+0000","last_active":"2024-09-11T23:17:01.285788+0000","last_peered":"2024-09-11T23:17:01.285788+0000","last_clean":"2024-09-11T23:17:01.285788+0000","last_became_active":"2024-09-11T23:17:01.279788+0000","last_became_peered":"2024-09-11T23:17:01.279788+0000","last_unstale":"2024-09-11T23:17:01.285788+0000","last_undegraded":"2024-09-11T23:17:01.285788+0000","last_fullsized":"2024-09-11T23:17:01.285788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.414874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.267277+0000","last_change":"2024-09-11T23:17:00.332866+0000","last_active":"2024-09-11T23:17:01.267277+0000","last_peered":"2024-09-11T23:17:01.267277+0000","last_clean":"2024-09-11T23:17:01.267277+0000","last_became_active":"2024-09-11T23:17:00.332589+0000","last_became_peered":"2024-09-11T23:17:00.332589+0000","last_unstale":"2024-09-11T23:17:01.267277+0000","last_undegraded":"2024-09-11T23:17:01.267277+0000","last_fullsized":"2024-09-11T23:17:01.267277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.659664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":227,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.270289+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:17:01.270289+0000","last_peered":"2024-09-11T23:17:01.270289+0000","last_clean":"2024-09-11T23:17:01.270289+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:17:01.270289+0000","last_undegraded":"2024-09-11T23:17:01.270289+0000","last_fullsized":"2024-09-11T23:17:01.270289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1196032,"data_stored":854391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":602112,"data_stored":264551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":593920,"data_stored":263899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":264481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35928,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":581632,"data_stored":256732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35944,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335896,"statfs":{"total":96636764160,"available":96599957504,"internally_reserved":0,"allocated":606208,"data_stored":265511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":581632,"data_stored":256732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1196032,"data_stored":854323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:05.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:17:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.474+0000 7f198b608640 1 Processor -- start 2024-09-11T23:17:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.474+0000 7f198b608640 1 -- start start 2024-09-11T23:17:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f198b608640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f198406fef0 0x7f198406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f198b608640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f19840b3d50 0x7f19840b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f198b608640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f198406ee50 con 0x7f1984073e60 2024-09-11T23:17:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f198b608640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f19840b46c0 con 0x7f19840b3d50 2024-09-11T23:17:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f198b608640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f198406f130 con 0x7f198406fef0 2024-09-11T23:17:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1989ba5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f19840b3d50 0x7f19840b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f19893a4640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1984073e60 0x7f198415b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55166/0 (socket says 172.21.15.94:55166) 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1989ba5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f19840b3d50 0x7f19840b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55648/0 (socket says 172.21.15.94:55648) 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f19893a4640 1 -- 172.21.15.94:0/4203450061 learned_addr learned my addr 172.21.15.94:0/4203450061 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1988ba3640 1 --2- 172.21.15.94:0/4203450061 >> v2:172.21.15.155:3300/0 conn(0x7f198406fef0 0x7f198406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1989ba5640 1 -- 172.21.15.94:0/4203450061 >> v2:172.21.15.155:3300/0 conn(0x7f198406fef0 msgr2=0x7f198406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1989ba5640 1 --2- 172.21.15.94:0/4203450061 >> v2:172.21.15.155:3300/0 conn(0x7f198406fef0 0x7f198406e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1989ba5640 1 -- 172.21.15.94:0/4203450061 >> v1:172.21.15.94:6789/0 conn(0x7f1984073e60 legacy=0x7f198415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1989ba5640 1 -- 172.21.15.94:0/4203450061 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198406f410 con 0x7f19840b3d50 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f197bfff640 1 -- 172.21.15.94:0/4203450061 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111834796 0 0) 0x7f198406ee50 con 0x7f1984073e60 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f1989ba5640 1 --2- 172.21.15.94:0/4203450061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19840b3d50 0x7f19840b4180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f19840afe90 tx=0x7f197c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5611c7487a1f1357 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.478+0000 7f197bfff640 1 -- 172.21.15.94:0/4203450061 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c0b2070 con 0x7f19840b3d50 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f197bfff640 1 -- 172.21.15.94:0/4203450061 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c0a57f0 con 0x7f19840b3d50 2024-09-11T23:17:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f197bfff640 1 -- 172.21.15.94:0/4203450061 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c0a5bc0 con 0x7f19840b3d50 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- 172.21.15.94:0/4203450061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19840b3d50 msgr2=0x7f19840b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 --2- 172.21.15.94:0/4203450061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19840b3d50 0x7f19840b4180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f19840afe90 tx=0x7f197c01c8a0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- 172.21.15.94:0/4203450061 shutdown_connections 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 --2- 172.21.15.94:0/4203450061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19840b3d50 0x7f19840b4180 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 --2- 172.21.15.94:0/4203450061 >> v2:172.21.15.155:3300/0 conn(0x7f198406fef0 0x7f198406e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- 172.21.15.94:0/4203450061 >> 172.21.15.94:0/4203450061 conn(0x7f19840b1f90 msgr2=0x7f19840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- 172.21.15.94:0/4203450061 shutdown_connections 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- 172.21.15.94:0/4203450061 wait complete. 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 Processor -- start 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- start start 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f198406fef0 0x7f198414afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1984073e60 0x7f19841501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19840b3d50 0x7f1984150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f19840731b0 con 0x7f198406fef0 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1984073030 con 0x7f1984073e60 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1984073330 con 0x7f19840b3d50 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f198406fef0 0x7f198414afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f198406fef0 0x7f198414afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55652/0 (socket says 172.21.15.94:55652) 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 -- 172.21.15.94:0/3543811425 learned_addr learned my addr 172.21.15.94:0/3543811425 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f1988ba3640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1984073e60 0x7f19841501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f1989ba5640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19840b3d50 0x7f1984150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 -- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19840b3d50 msgr2=0x7f1984150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19840b3d50 0x7f1984150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 -- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1984073e60 msgr2=0x7f19841501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1984073e60 0x7f19841501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 -- 172.21.15.94:0/3543811425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198414b8c0 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f1989ba5640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19840b3d50 0x7f1984150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f19893a4640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f198406fef0 0x7f198414afc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f198000c480 tx=0x7f198000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f1979ffb640 1 -- 172.21.15.94:0/3543811425 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980018070 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f1979ffb640 1 -- 172.21.15.94:0/3543811425 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1980007500 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198414bba0 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f1979ffb640 1 -- 172.21.15.94:0/3543811425 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980004a30 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.482+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198414c160 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.486+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19840b4180 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.486+0000 7f1979ffb640 1 -- 172.21.15.94:0/3543811425 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f198001b070 con 0x7f198406fef0 2024-09-11T23:17:05.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.486+0000 7f1979ffb640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19680678c0 0x7f1968069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.486+0000 7f1979ffb640 1 -- 172.21.15.94:0/3543811425 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f1980085020 con 0x7f198406fef0 2024-09-11T23:17:05.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.486+0000 7f1988ba3640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19680678c0 0x7f1968069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.486+0000 7f1988ba3640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19680678c0 0x7f1968069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f198415bd50 tx=0x7f1974008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.490+0000 7f1979ffb640 1 -- 172.21.15.94:0/3543811425 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1980055a60 con 0x7f198406fef0 2024-09-11T23:17:05.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.646+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19840723f0 con 0x7f19680678c0 2024-09-11T23:17:05.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f1979ffb640 1 -- 172.21.15.94:0/3543811425 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7f19840723f0 con 0x7f19680678c0 2024-09-11T23:17:05.672 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19680678c0 msgr2=0x7f1968069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19680678c0 0x7f1968069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f198415bd50 tx=0x7f1974008040 comp rx=0 tx=0).stop 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f198406fef0 msgr2=0x7f198414afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f198406fef0 0x7f198414afc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f198000c480 tx=0x7f198000c940 comp rx=0 tx=0).stop 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 shutdown_connections 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19840b3d50 0x7f1984150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1984073e60 0x7f19841501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f19680678c0 0x7f1968069d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 --2- 172.21.15.94:0/3543811425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f198406fef0 0x7f198414afc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 >> 172.21.15.94:0/3543811425 conn(0x7f19840b1f90 msgr2=0x7f19840b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:05.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 shutdown_connections 2024-09-11T23:17:05.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.670+0000 7f198b608640 1 -- 172.21.15.94:0/3543811425 wait complete. 2024-09-11T23:17:05.691 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-11T23:17:04.004521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271988,"kb_used_data":5816,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754702732,"statfs":{"total":773094113280,"available":772815597568,"internally_reserved":0,"allocated":5955584,"data_stored":3280620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.704696"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290011+0000","last_change":"2024-09-11T23:17:01.284867+0000","last_active":"2024-09-11T23:17:01.290011+0000","last_peered":"2024-09-11T23:17:01.290011+0000","last_clean":"2024-09-11T23:17:01.290011+0000","last_became_active":"2024-09-11T23:17:01.283940+0000","last_became_peered":"2024-09-11T23:17:01.283940+0000","last_unstale":"2024-09-11T23:17:01.290011+0000","last_undegraded":"2024-09-11T23:17:01.290011+0000","last_fullsized":"2024-09-11T23:17:01.290011+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:40.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302782+0000","last_change":"2024-09-11T23:17:01.299418+0000","last_active":"2024-09-11T23:17:01.302782+0000","last_peered":"2024-09-11T23:17:01.302782+0000","last_clean":"2024-09-11T23:17:01.302782+0000","last_became_active":"2024-09-11T23:17:01.291838+0000","last_became_peered":"2024-09-11T23:17:01.291838+0000","last_unstale":"2024-09-11T23:17:01.302782+0000","last_undegraded":"2024-09-11T23:17:01.302782+0000","last_fullsized":"2024-09-11T23:17:01.302782+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.703259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.306484+0000","last_change":"2024-09-11T23:17:01.291777+0000","last_active":"2024-09-11T23:17:01.306484+0000","last_peered":"2024-09-11T23:17:01.306484+0000","last_clean":"2024-09-11T23:17:01.306484+0000","last_became_active":"2024-09-11T23:17:01.291019+0000","last_became_peered":"2024-09-11T23:17:01.291019+0000","last_unstale":"2024-09-11T23:17:01.306484+0000","last_undegraded":"2024-09-11T23:17:01.306484+0000","last_fullsized":"2024-09-11T23:17:01.306484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.908267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296221+0000","last_change":"2024-09-11T23:17:01.291589+0000","last_active":"2024-09-11T23:17:01.296221+0000","last_peered":"2024-09-11T23:17:01.296221+0000","last_clean":"2024-09-11T23:17:01.296221+0000","last_became_active":"2024-09-11T23:17:01.290703+0000","last_became_peered":"2024-09-11T23:17:01.290703+0000","last_unstale":"2024-09-11T23:17:01.296221+0000","last_undegraded":"2024-09-11T23:17:01.296221+0000","last_fullsized":"2024-09-11T23:17:01.296221+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.187428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296461+0000","last_change":"2024-09-11T23:17:01.288834+0000","last_active":"2024-09-11T23:17:01.296461+0000","last_peered":"2024-09-11T23:17:01.296461+0000","last_clean":"2024-09-11T23:17:01.296461+0000","last_became_active":"2024-09-11T23:17:01.287210+0000","last_became_peered":"2024-09-11T23:17:01.287210+0000","last_unstale":"2024-09-11T23:17:01.296461+0000","last_undegraded":"2024-09-11T23:17:01.296461+0000","last_fullsized":"2024-09-11T23:17:01.296461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:40.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.313246+0000","last_change":"2024-09-11T23:17:01.309596+0000","last_active":"2024-09-11T23:17:01.313246+0000","last_peered":"2024-09-11T23:17:01.313246+0000","last_clean":"2024-09-11T23:17:01.313246+0000","last_became_active":"2024-09-11T23:17:01.308970+0000","last_became_peered":"2024-09-11T23:17:01.308970+0000","last_unstale":"2024-09-11T23:17:01.313246+0000","last_undegraded":"2024-09-11T23:17:01.313246+0000","last_fullsized":"2024-09-11T23:17:01.313246+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305259+0000","last_change":"2024-09-11T23:17:01.287768+0000","last_active":"2024-09-11T23:17:01.305259+0000","last_peered":"2024-09-11T23:17:01.305259+0000","last_clean":"2024-09-11T23:17:01.305259+0000","last_became_active":"2024-09-11T23:17:01.286983+0000","last_became_peered":"2024-09-11T23:17:01.286983+0000","last_unstale":"2024-09-11T23:17:01.305259+0000","last_undegraded":"2024-09-11T23:17:01.305259+0000","last_fullsized":"2024-09-11T23:17:01.305259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.703259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301482+0000","last_change":"2024-09-11T23:17:01.295059+0000","last_active":"2024-09-11T23:17:01.301482+0000","last_peered":"2024-09-11T23:17:01.301482+0000","last_clean":"2024-09-11T23:17:01.301482+0000","last_became_active":"2024-09-11T23:17:01.294375+0000","last_became_peered":"2024-09-11T23:17:01.294375+0000","last_unstale":"2024-09-11T23:17:01.301482+0000","last_undegraded":"2024-09-11T23:17:01.301482+0000","last_fullsized":"2024-09-11T23:17:01.301482+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:21.846816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301559+0000","last_change":"2024-09-11T23:17:01.293855+0000","last_active":"2024-09-11T23:17:01.301559+0000","last_peered":"2024-09-11T23:17:01.301559+0000","last_clean":"2024-09-11T23:17:01.301559+0000","last_became_active":"2024-09-11T23:17:01.292873+0000","last_became_peered":"2024-09-11T23:17:01.292873+0000","last_unstale":"2024-09-11T23:17:01.301559+0000","last_undegraded":"2024-09-11T23:17:01.301559+0000","last_fullsized":"2024-09-11T23:17:01.301559+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:29.084820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.307847+0000","last_change":"2024-09-11T23:17:01.293509+0000","last_active":"2024-09-11T23:17:01.307847+0000","last_peered":"2024-09-11T23:17:01.307847+0000","last_clean":"2024-09-11T23:17:01.307847+0000","last_became_active":"2024-09-11T23:17:01.292831+0000","last_became_peered":"2024-09-11T23:17:01.292831+0000","last_unstale":"2024-09-11T23:17:01.307847+0000","last_undegraded":"2024-09-11T23:17:01.307847+0000","last_fullsized":"2024-09-11T23:17:01.307847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:02.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302453+0000","last_change":"2024-09-11T23:17:01.297843+0000","last_active":"2024-09-11T23:17:01.302453+0000","last_peered":"2024-09-11T23:17:01.302453+0000","last_clean":"2024-09-11T23:17:01.302453+0000","last_became_active":"2024-09-11T23:17:01.297164+0000","last_became_peered":"2024-09-11T23:17:01.297164+0000","last_unstale":"2024-09-11T23:17:01.302453+0000","last_undegraded":"2024-09-11T23:17:01.302453+0000","last_fullsized":"2024-09-11T23:17:01.302453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:00.310665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290181+0000","last_change":"2024-09-11T23:17:01.282714+0000","last_active":"2024-09-11T23:17:01.290181+0000","last_peered":"2024-09-11T23:17:01.290181+0000","last_clean":"2024-09-11T23:17:01.290181+0000","last_became_active":"2024-09-11T23:17:01.281954+0000","last_became_peered":"2024-09-11T23:17:01.281954+0000","last_unstale":"2024-09-11T23:17:01.290181+0000","last_undegraded":"2024-09-11T23:17:01.290181+0000","last_fullsized":"2024-09-11T23:17:01.290181+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:13.539857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.308057+0000","last_change":"2024-09-11T23:17:01.293767+0000","last_active":"2024-09-11T23:17:01.308057+0000","last_peered":"2024-09-11T23:17:01.308057+0000","last_clean":"2024-09-11T23:17:01.308057+0000","last_became_active":"2024-09-11T23:17:01.292987+0000","last_became_peered":"2024-09-11T23:17:01.292987+0000","last_unstale":"2024-09-11T23:17:01.308057+0000","last_undegraded":"2024-09-11T23:17:01.308057+0000","last_fullsized":"2024-09-11T23:17:01.308057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.543014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305783+0000","last_change":"2024-09-11T23:17:01.292248+0000","last_active":"2024-09-11T23:17:01.305783+0000","last_peered":"2024-09-11T23:17:01.305783+0000","last_clean":"2024-09-11T23:17:01.305783+0000","last_became_active":"2024-09-11T23:17:01.291541+0000","last_became_peered":"2024-09-11T23:17:01.291541+0000","last_unstale":"2024-09-11T23:17:01.305783+0000","last_undegraded":"2024-09-11T23:17:01.305783+0000","last_fullsized":"2024-09-11T23:17:01.305783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:39.451942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296471+0000","last_change":"2024-09-11T23:17:01.291754+0000","last_active":"2024-09-11T23:17:01.296471+0000","last_peered":"2024-09-11T23:17:01.296471+0000","last_clean":"2024-09-11T23:17:01.296471+0000","last_became_active":"2024-09-11T23:17:01.290908+0000","last_became_peered":"2024-09-11T23:17:01.290908+0000","last_unstale":"2024-09-11T23:17:01.296471+0000","last_undegraded":"2024-09-11T23:17:01.296471+0000","last_fullsized":"2024-09-11T23:17:01.296471+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:34.047760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.284208+0000","last_change":"2024-09-11T23:17:01.278966+0000","last_active":"2024-09-11T23:17:01.284208+0000","last_peered":"2024-09-11T23:17:01.284208+0000","last_clean":"2024-09-11T23:17:01.284208+0000","last_became_active":"2024-09-11T23:17:01.278219+0000","last_became_peered":"2024-09-11T23:17:01.278219+0000","last_unstale":"2024-09-11T23:17:01.284208+0000","last_undegraded":"2024-09-11T23:17:01.284208+0000","last_fullsized":"2024-09-11T23:17:01.284208+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.414874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.309017+0000","last_change":"2024-09-11T23:17:01.304663+0000","last_active":"2024-09-11T23:17:01.309017+0000","last_peered":"2024-09-11T23:17:01.309017+0000","last_clean":"2024-09-11T23:17:01.309017+0000","last_became_active":"2024-09-11T23:17:01.299596+0000","last_became_peered":"2024-09-11T23:17:01.299596+0000","last_unstale":"2024-09-11T23:17:01.309017+0000","last_undegraded":"2024-09-11T23:17:01.309017+0000","last_fullsized":"2024-09-11T23:17:01.309017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:59.444407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305706+0000","last_change":"2024-09-11T23:17:01.301041+0000","last_active":"2024-09-11T23:17:01.305706+0000","last_peered":"2024-09-11T23:17:01.305706+0000","last_clean":"2024-09-11T23:17:01.305706+0000","last_became_active":"2024-09-11T23:17:01.300313+0000","last_became_peered":"2024-09-11T23:17:01.300313+0000","last_unstale":"2024-09-11T23:17:01.305706+0000","last_undegraded":"2024-09-11T23:17:01.305706+0000","last_fullsized":"2024-09-11T23:17:01.305706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.001235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.310348+0000","last_change":"2024-09-11T23:17:01.306190+0000","last_active":"2024-09-11T23:17:01.310348+0000","last_peered":"2024-09-11T23:17:01.310348+0000","last_clean":"2024-09-11T23:17:01.310348+0000","last_became_active":"2024-09-11T23:17:01.305422+0000","last_became_peered":"2024-09-11T23:17:01.305422+0000","last_unstale":"2024-09-11T23:17:01.310348+0000","last_undegraded":"2024-09-11T23:17:01.310348+0000","last_fullsized":"2024-09-11T23:17:01.310348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:19.836942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302641+0000","last_change":"2024-09-11T23:17:01.298066+0000","last_active":"2024-09-11T23:17:01.302641+0000","last_peered":"2024-09-11T23:17:01.302641+0000","last_clean":"2024-09-11T23:17:01.302641+0000","last_became_active":"2024-09-11T23:17:01.297366+0000","last_became_peered":"2024-09-11T23:17:01.297366+0000","last_unstale":"2024-09-11T23:17:01.302641+0000","last_undegraded":"2024-09-11T23:17:01.302641+0000","last_fullsized":"2024-09-11T23:17:01.302641+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:02.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.303644+0000","last_change":"2024-09-11T23:17:01.298059+0000","last_active":"2024-09-11T23:17:01.303644+0000","last_peered":"2024-09-11T23:17:01.303644+0000","last_clean":"2024-09-11T23:17:01.303644+0000","last_became_active":"2024-09-11T23:17:01.297335+0000","last_became_peered":"2024-09-11T23:17:01.297335+0000","last_unstale":"2024-09-11T23:17:01.303644+0000","last_undegraded":"2024-09-11T23:17:01.303644+0000","last_fullsized":"2024-09-11T23:17:01.303644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:02.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301299+0000","last_change":"2024-09-11T23:17:01.293883+0000","last_active":"2024-09-11T23:17:01.301299+0000","last_peered":"2024-09-11T23:17:01.301299+0000","last_clean":"2024-09-11T23:17:01.301299+0000","last_became_active":"2024-09-11T23:17:01.293132+0000","last_became_peered":"2024-09-11T23:17:01.293132+0000","last_unstale":"2024-09-11T23:17:01.301299+0000","last_undegraded":"2024-09-11T23:17:01.301299+0000","last_fullsized":"2024-09-11T23:17:01.301299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:15.373270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.303526+0000","last_change":"2024-09-11T23:17:01.299863+0000","last_active":"2024-09-11T23:17:01.303526+0000","last_peered":"2024-09-11T23:17:01.303526+0000","last_clean":"2024-09-11T23:17:01.303526+0000","last_became_active":"2024-09-11T23:17:01.298991+0000","last_became_peered":"2024-09-11T23:17:01.298991+0000","last_unstale":"2024-09-11T23:17:01.303526+0000","last_undegraded":"2024-09-11T23:17:01.303526+0000","last_fullsized":"2024-09-11T23:17:01.303526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:49.584193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.309337+0000","last_change":"2024-09-11T23:17:01.299461+0000","last_active":"2024-09-11T23:17:01.309337+0000","last_peered":"2024-09-11T23:17:01.309337+0000","last_clean":"2024-09-11T23:17:01.309337+0000","last_became_active":"2024-09-11T23:17:01.298583+0000","last_became_peered":"2024-09-11T23:17:01.298583+0000","last_unstale":"2024-09-11T23:17:01.309337+0000","last_undegraded":"2024-09-11T23:17:01.309337+0000","last_fullsized":"2024-09-11T23:17:01.309337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:05.102169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305111+0000","last_change":"2024-09-11T23:17:01.292219+0000","last_active":"2024-09-11T23:17:01.305111+0000","last_peered":"2024-09-11T23:17:01.305111+0000","last_clean":"2024-09-11T23:17:01.305111+0000","last_became_active":"2024-09-11T23:17:01.291421+0000","last_became_peered":"2024-09-11T23:17:01.291421+0000","last_unstale":"2024-09-11T23:17:01.305111+0000","last_undegraded":"2024-09-11T23:17:01.305111+0000","last_fullsized":"2024-09-11T23:17:01.305111+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:39.389730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301938+0000","last_change":"2024-09-11T23:17:01.297127+0000","last_active":"2024-09-11T23:17:01.301938+0000","last_peered":"2024-09-11T23:17:01.301938+0000","last_clean":"2024-09-11T23:17:01.301938+0000","last_became_active":"2024-09-11T23:17:01.295969+0000","last_became_peered":"2024-09-11T23:17:01.295969+0000","last_unstale":"2024-09-11T23:17:01.301938+0000","last_undegraded":"2024-09-11T23:17:01.301938+0000","last_fullsized":"2024-09-11T23:17:01.301938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:12.592842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.312624+0000","last_change":"2024-09-11T23:17:01.308165+0000","last_active":"2024-09-11T23:17:01.312624+0000","last_peered":"2024-09-11T23:17:01.312624+0000","last_clean":"2024-09-11T23:17:01.312624+0000","last_became_active":"2024-09-11T23:17:01.307437+0000","last_became_peered":"2024-09-11T23:17:01.307437+0000","last_unstale":"2024-09-11T23:17:01.312624+0000","last_undegraded":"2024-09-11T23:17:01.312624+0000","last_fullsized":"2024-09-11T23:17:01.312624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:24.083053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.289825+0000","last_change":"2024-09-11T23:17:01.287441+0000","last_active":"2024-09-11T23:17:01.289825+0000","last_peered":"2024-09-11T23:17:01.289825+0000","last_clean":"2024-09-11T23:17:01.289825+0000","last_became_active":"2024-09-11T23:17:01.286705+0000","last_became_peered":"2024-09-11T23:17:01.286705+0000","last_unstale":"2024-09-11T23:17:01.289825+0000","last_undegraded":"2024-09-11T23:17:01.289825+0000","last_fullsized":"2024-09-11T23:17:01.289825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:40.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.308925+0000","last_change":"2024-09-11T23:17:01.299541+0000","last_active":"2024-09-11T23:17:01.308925+0000","last_peered":"2024-09-11T23:17:01.308925+0000","last_clean":"2024-09-11T23:17:01.308925+0000","last_became_active":"2024-09-11T23:17:01.291810+0000","last_became_peered":"2024-09-11T23:17:01.291810+0000","last_unstale":"2024-09-11T23:17:01.308925+0000","last_undegraded":"2024-09-11T23:17:01.308925+0000","last_fullsized":"2024-09-11T23:17:01.308925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:22.748203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302250+0000","last_change":"2024-09-11T23:17:01.294962+0000","last_active":"2024-09-11T23:17:01.302250+0000","last_peered":"2024-09-11T23:17:01.302250+0000","last_clean":"2024-09-11T23:17:01.302250+0000","last_became_active":"2024-09-11T23:17:01.293432+0000","last_became_peered":"2024-09-11T23:17:01.293432+0000","last_unstale":"2024-09-11T23:17:01.302250+0000","last_undegraded":"2024-09-11T23:17:01.302250+0000","last_fullsized":"2024-09-11T23:17:01.302250+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305302+0000","last_change":"2024-09-11T23:17:01.291931+0000","last_active":"2024-09-11T23:17:01.305302+0000","last_peered":"2024-09-11T23:17:01.305302+0000","last_clean":"2024-09-11T23:17:01.305302+0000","last_became_active":"2024-09-11T23:17:01.291102+0000","last_became_peered":"2024-09-11T23:17:01.291102+0000","last_unstale":"2024-09-11T23:17:01.305302+0000","last_undegraded":"2024-09-11T23:17:01.305302+0000","last_fullsized":"2024-09-11T23:17:01.305302+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.001235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.292299+0000","last_change":"2024-09-11T23:17:01.283925+0000","last_active":"2024-09-11T23:17:01.292299+0000","last_peered":"2024-09-11T23:17:01.292299+0000","last_clean":"2024-09-11T23:17:01.292299+0000","last_became_active":"2024-09-11T23:17:01.283226+0000","last_became_peered":"2024-09-11T23:17:01.283226+0000","last_unstale":"2024-09-11T23:17:01.292299+0000","last_undegraded":"2024-09-11T23:17:01.292299+0000","last_fullsized":"2024-09-11T23:17:01.292299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.703259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296412+0000","last_change":"2024-09-11T23:17:01.291818+0000","last_active":"2024-09-11T23:17:01.296412+0000","last_peered":"2024-09-11T23:17:01.296412+0000","last_clean":"2024-09-11T23:17:01.296412+0000","last_became_active":"2024-09-11T23:17:01.290861+0000","last_became_peered":"2024-09-11T23:17:01.290861+0000","last_unstale":"2024-09-11T23:17:01.296412+0000","last_undegraded":"2024-09-11T23:17:01.296412+0000","last_fullsized":"2024-09-11T23:17:01.296412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:24.083053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332523+0000","last_change":"2024-09-11T23:17:00.335603+0000","last_active":"2024-09-11T23:17:01.332523+0000","last_peered":"2024-09-11T23:17:01.332523+0000","last_clean":"2024-09-11T23:17:01.332523+0000","last_became_active":"2024-09-11T23:17:00.334917+0000","last_became_peered":"2024-09-11T23:17:00.334917+0000","last_unstale":"2024-09-11T23:17:01.332523+0000","last_undegraded":"2024-09-11T23:17:01.332523+0000","last_fullsized":"2024-09-11T23:17:01.332523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:15.489292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.291858+0000","last_change":"2024-09-11T23:17:01.286652+0000","last_active":"2024-09-11T23:17:01.291858+0000","last_peered":"2024-09-11T23:17:01.291858+0000","last_clean":"2024-09-11T23:17:01.291858+0000","last_became_active":"2024-09-11T23:17:01.285876+0000","last_became_peered":"2024-09-11T23:17:01.285876+0000","last_unstale":"2024-09-11T23:17:01.291858+0000","last_undegraded":"2024-09-11T23:17:01.291858+0000","last_fullsized":"2024-09-11T23:17:01.291858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:06.462014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.330391+0000","last_change":"2024-09-11T23:17:00.344713+0000","last_active":"2024-09-11T23:17:01.330391+0000","last_peered":"2024-09-11T23:17:01.330391+0000","last_clean":"2024-09-11T23:17:01.330391+0000","last_became_active":"2024-09-11T23:17:00.340054+0000","last_became_peered":"2024-09-11T23:17:00.340054+0000","last_unstale":"2024-09-11T23:17:01.330391+0000","last_undegraded":"2024-09-11T23:17:01.330391+0000","last_fullsized":"2024-09-11T23:17:01.330391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:56.326296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302731+0000","last_change":"2024-09-11T23:17:01.300219+0000","last_active":"2024-09-11T23:17:01.302731+0000","last_peered":"2024-09-11T23:17:01.302731+0000","last_clean":"2024-09-11T23:17:01.302731+0000","last_became_active":"2024-09-11T23:17:01.299541+0000","last_became_peered":"2024-09-11T23:17:01.299541+0000","last_unstale":"2024-09-11T23:17:01.302731+0000","last_undegraded":"2024-09-11T23:17:01.302731+0000","last_fullsized":"2024-09-11T23:17:01.302731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.187428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.331582+0000","last_change":"2024-09-11T23:17:00.344393+0000","last_active":"2024-09-11T23:17:01.331582+0000","last_peered":"2024-09-11T23:17:01.331582+0000","last_clean":"2024-09-11T23:17:01.331582+0000","last_became_active":"2024-09-11T23:17:00.343855+0000","last_became_peered":"2024-09-11T23:17:00.343855+0000","last_unstale":"2024-09-11T23:17:01.331582+0000","last_undegraded":"2024-09-11T23:17:01.331582+0000","last_fullsized":"2024-09-11T23:17:01.331582+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.398813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290458+0000","last_change":"2024-09-11T23:17:01.287989+0000","last_active":"2024-09-11T23:17:01.290458+0000","last_peered":"2024-09-11T23:17:01.290458+0000","last_clean":"2024-09-11T23:17:01.290458+0000","last_became_active":"2024-09-11T23:17:01.287297+0000","last_became_peered":"2024-09-11T23:17:01.287297+0000","last_unstale":"2024-09-11T23:17:01.290458+0000","last_undegraded":"2024-09-11T23:17:01.290458+0000","last_fullsized":"2024-09-11T23:17:01.290458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:05.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332029+0000","last_change":"2024-09-11T23:17:00.325681+0000","last_active":"2024-09-11T23:17:01.332029+0000","last_peered":"2024-09-11T23:17:01.332029+0000","last_clean":"2024-09-11T23:17:01.332029+0000","last_became_active":"2024-09-11T23:17:00.324956+0000","last_became_peered":"2024-09-11T23:17:00.324956+0000","last_unstale":"2024-09-11T23:17:01.332029+0000","last_undegraded":"2024-09-11T23:17:01.332029+0000","last_fullsized":"2024-09-11T23:17:01.332029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:23.079146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.310261+0000","last_change":"2024-09-11T23:17:01.307697+0000","last_active":"2024-09-11T23:17:01.310261+0000","last_peered":"2024-09-11T23:17:01.310261+0000","last_clean":"2024-09-11T23:17:01.310261+0000","last_became_active":"2024-09-11T23:17:01.305902+0000","last_became_peered":"2024-09-11T23:17:01.305902+0000","last_unstale":"2024-09-11T23:17:01.310261+0000","last_undegraded":"2024-09-11T23:17:01.310261+0000","last_fullsized":"2024-09-11T23:17:01.310261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.543014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.328537+0000","last_change":"2024-09-11T23:17:00.339952+0000","last_active":"2024-09-11T23:17:01.328537+0000","last_peered":"2024-09-11T23:17:01.328537+0000","last_clean":"2024-09-11T23:17:01.328537+0000","last_became_active":"2024-09-11T23:17:00.339683+0000","last_became_peered":"2024-09-11T23:17:00.339683+0000","last_unstale":"2024-09-11T23:17:01.328537+0000","last_undegraded":"2024-09-11T23:17:01.328537+0000","last_fullsized":"2024-09-11T23:17:01.328537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.305414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301450+0000","last_change":"2024-09-11T23:17:01.294963+0000","last_active":"2024-09-11T23:17:01.301450+0000","last_peered":"2024-09-11T23:17:01.301450+0000","last_clean":"2024-09-11T23:17:01.301450+0000","last_became_active":"2024-09-11T23:17:01.293500+0000","last_became_peered":"2024-09-11T23:17:01.293500+0000","last_unstale":"2024-09-11T23:17:01.301450+0000","last_undegraded":"2024-09-11T23:17:01.301450+0000","last_fullsized":"2024-09-11T23:17:01.301450+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.301589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.325639+0000","last_change":"2024-09-11T23:17:00.334691+0000","last_active":"2024-09-11T23:17:01.325639+0000","last_peered":"2024-09-11T23:17:01.325639+0000","last_clean":"2024-09-11T23:17:01.325639+0000","last_became_active":"2024-09-11T23:17:00.334417+0000","last_became_peered":"2024-09-11T23:17:00.334417+0000","last_unstale":"2024-09-11T23:17:01.325639+0000","last_undegraded":"2024-09-11T23:17:01.325639+0000","last_fullsized":"2024-09-11T23:17:01.325639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:41.414178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301852+0000","last_change":"2024-09-11T23:17:01.296627+0000","last_active":"2024-09-11T23:17:01.301852+0000","last_peered":"2024-09-11T23:17:01.301852+0000","last_clean":"2024-09-11T23:17:01.301852+0000","last_became_active":"2024-09-11T23:17:01.295783+0000","last_became_peered":"2024-09-11T23:17:01.295783+0000","last_unstale":"2024-09-11T23:17:01.301852+0000","last_undegraded":"2024-09-11T23:17:01.301852+0000","last_fullsized":"2024-09-11T23:17:01.301852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:12.404923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.277401+0000","last_change":"2024-09-11T23:17:00.347240+0000","last_active":"2024-09-11T23:17:01.277401+0000","last_peered":"2024-09-11T23:17:01.277401+0000","last_clean":"2024-09-11T23:17:01.277401+0000","last_became_active":"2024-09-11T23:17:00.346554+0000","last_became_peered":"2024-09-11T23:17:00.346554+0000","last_unstale":"2024-09-11T23:17:01.277401+0000","last_undegraded":"2024-09-11T23:17:01.277401+0000","last_fullsized":"2024-09-11T23:17:01.277401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.542481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.310530+0000","last_change":"2024-09-11T23:17:01.307045+0000","last_active":"2024-09-11T23:17:01.310530+0000","last_peered":"2024-09-11T23:17:01.310530+0000","last_clean":"2024-09-11T23:17:01.310530+0000","last_became_active":"2024-09-11T23:17:01.306696+0000","last_became_peered":"2024-09-11T23:17:01.306696+0000","last_unstale":"2024-09-11T23:17:01.310530+0000","last_undegraded":"2024-09-11T23:17:01.310530+0000","last_fullsized":"2024-09-11T23:17:01.310530+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:06.462014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.279472+0000","last_change":"2024-09-11T23:17:00.325371+0000","last_active":"2024-09-11T23:17:01.279472+0000","last_peered":"2024-09-11T23:17:01.279472+0000","last_clean":"2024-09-11T23:17:01.279472+0000","last_became_active":"2024-09-11T23:17:00.324870+0000","last_became_peered":"2024-09-11T23:17:00.324870+0000","last_unstale":"2024-09-11T23:17:01.279472+0000","last_undegraded":"2024-09-11T23:17:01.279472+0000","last_fullsized":"2024-09-11T23:17:01.279472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:33.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296389+0000","last_change":"2024-09-11T23:17:01.284771+0000","last_active":"2024-09-11T23:17:01.296389+0000","last_peered":"2024-09-11T23:17:01.296389+0000","last_clean":"2024-09-11T23:17:01.296389+0000","last_became_active":"2024-09-11T23:17:01.283645+0000","last_became_peered":"2024-09-11T23:17:01.283645+0000","last_unstale":"2024-09-11T23:17:01.296389+0000","last_undegraded":"2024-09-11T23:17:01.296389+0000","last_fullsized":"2024-09-11T23:17:01.296389+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.414874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.271190+0000","last_change":"2024-09-11T23:17:00.349194+0000","last_active":"2024-09-11T23:17:01.271190+0000","last_peered":"2024-09-11T23:17:01.271190+0000","last_clean":"2024-09-11T23:17:01.271190+0000","last_became_active":"2024-09-11T23:17:00.348386+0000","last_became_peered":"2024-09-11T23:17:00.348386+0000","last_unstale":"2024-09-11T23:17:01.271190+0000","last_undegraded":"2024-09-11T23:17:01.271190+0000","last_fullsized":"2024-09-11T23:17:01.271190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.659664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.288513+0000","last_change":"2024-09-11T23:17:01.277828+0000","last_active":"2024-09-11T23:17:01.288513+0000","last_peered":"2024-09-11T23:17:01.288513+0000","last_clean":"2024-09-11T23:17:01.288513+0000","last_became_active":"2024-09-11T23:17:01.277064+0000","last_became_peered":"2024-09-11T23:17:01.277064+0000","last_unstale":"2024-09-11T23:17:01.288513+0000","last_undegraded":"2024-09-11T23:17:01.288513+0000","last_fullsized":"2024-09-11T23:17:01.288513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.258619+0000","last_change":"2024-09-11T23:17:00.335570+0000","last_active":"2024-09-11T23:17:01.258619+0000","last_peered":"2024-09-11T23:17:01.258619+0000","last_clean":"2024-09-11T23:17:01.258619+0000","last_became_active":"2024-09-11T23:17:00.334757+0000","last_became_peered":"2024-09-11T23:17:00.334757+0000","last_unstale":"2024-09-11T23:17:01.258619+0000","last_undegraded":"2024-09-11T23:17:01.258619+0000","last_fullsized":"2024-09-11T23:17:01.258619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.040670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305903+0000","last_change":"2024-09-11T23:17:01.298505+0000","last_active":"2024-09-11T23:17:01.305903+0000","last_peered":"2024-09-11T23:17:01.305903+0000","last_clean":"2024-09-11T23:17:01.305903+0000","last_became_active":"2024-09-11T23:17:01.297673+0000","last_became_peered":"2024-09-11T23:17:01.297673+0000","last_unstale":"2024-09-11T23:17:01.305903+0000","last_undegraded":"2024-09-11T23:17:01.305903+0000","last_fullsized":"2024-09-11T23:17:01.305903+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:19.502289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.328597+0000","last_change":"2024-09-11T23:17:00.347798+0000","last_active":"2024-09-11T23:17:01.328597+0000","last_peered":"2024-09-11T23:17:01.328597+0000","last_clean":"2024-09-11T23:17:01.328597+0000","last_became_active":"2024-09-11T23:17:00.347288+0000","last_became_peered":"2024-09-11T23:17:00.347288+0000","last_unstale":"2024-09-11T23:17:01.328597+0000","last_undegraded":"2024-09-11T23:17:01.328597+0000","last_fullsized":"2024-09-11T23:17:01.328597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:39.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296513+0000","last_change":"2024-09-11T23:17:01.291554+0000","last_active":"2024-09-11T23:17:01.296513+0000","last_peered":"2024-09-11T23:17:01.296513+0000","last_clean":"2024-09-11T23:17:01.296513+0000","last_became_active":"2024-09-11T23:17:01.288175+0000","last_became_peered":"2024-09-11T23:17:01.288175+0000","last_unstale":"2024-09-11T23:17:01.296513+0000","last_undegraded":"2024-09-11T23:17:01.296513+0000","last_fullsized":"2024-09-11T23:17:01.296513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:02.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332735+0000","last_change":"2024-09-11T23:17:00.333832+0000","last_active":"2024-09-11T23:17:01.332735+0000","last_peered":"2024-09-11T23:17:01.332735+0000","last_clean":"2024-09-11T23:17:01.332735+0000","last_became_active":"2024-09-11T23:17:00.333601+0000","last_became_peered":"2024-09-11T23:17:00.333601+0000","last_unstale":"2024-09-11T23:17:01.332735+0000","last_undegraded":"2024-09-11T23:17:01.332735+0000","last_fullsized":"2024-09-11T23:17:01.332735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:04.098262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.296523+0000","last_change":"2024-09-11T23:17:01.294525+0000","last_active":"2024-09-11T23:17:01.296523+0000","last_peered":"2024-09-11T23:17:01.296523+0000","last_clean":"2024-09-11T23:17:01.296523+0000","last_became_active":"2024-09-11T23:17:01.293720+0000","last_became_peered":"2024-09-11T23:17:01.293720+0000","last_unstale":"2024-09-11T23:17:01.296523+0000","last_undegraded":"2024-09-11T23:17:01.296523+0000","last_fullsized":"2024-09-11T23:17:01.296523+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:39.451942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.329337+0000","last_change":"2024-09-11T23:17:00.332442+0000","last_active":"2024-09-11T23:17:01.329337+0000","last_peered":"2024-09-11T23:17:01.329337+0000","last_clean":"2024-09-11T23:17:01.329337+0000","last_became_active":"2024-09-11T23:17:00.332133+0000","last_became_peered":"2024-09-11T23:17:00.332133+0000","last_unstale":"2024-09-11T23:17:01.329337+0000","last_undegraded":"2024-09-11T23:17:01.329337+0000","last_fullsized":"2024-09-11T23:17:01.329337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:03.539107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305183+0000","last_change":"2024-09-11T23:17:01.284152+0000","last_active":"2024-09-11T23:17:01.305183+0000","last_peered":"2024-09-11T23:17:01.305183+0000","last_clean":"2024-09-11T23:17:01.305183+0000","last_became_active":"2024-09-11T23:17:01.283448+0000","last_became_peered":"2024-09-11T23:17:01.283448+0000","last_unstale":"2024-09-11T23:17:01.305183+0000","last_undegraded":"2024-09-11T23:17:01.305183+0000","last_fullsized":"2024-09-11T23:17:01.305183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.301589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.277805+0000","last_change":"2024-09-11T23:17:00.341453+0000","last_active":"2024-09-11T23:17:01.277805+0000","last_peered":"2024-09-11T23:17:01.277805+0000","last_clean":"2024-09-11T23:17:01.277805+0000","last_became_active":"2024-09-11T23:17:00.340833+0000","last_became_peered":"2024-09-11T23:17:00.340833+0000","last_unstale":"2024-09-11T23:17:01.277805+0000","last_undegraded":"2024-09-11T23:17:01.277805+0000","last_fullsized":"2024-09-11T23:17:01.277805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:56.326296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.301898+0000","last_change":"2024-09-11T23:17:01.296625+0000","last_active":"2024-09-11T23:17:01.301898+0000","last_peered":"2024-09-11T23:17:01.301898+0000","last_clean":"2024-09-11T23:17:01.301898+0000","last_became_active":"2024-09-11T23:17:01.295236+0000","last_became_peered":"2024-09-11T23:17:01.295236+0000","last_unstale":"2024-09-11T23:17:01.301898+0000","last_undegraded":"2024-09-11T23:17:01.301898+0000","last_fullsized":"2024-09-11T23:17:01.301898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:03.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.271987+0000","last_change":"2024-09-11T23:17:00.350826+0000","last_active":"2024-09-11T23:17:01.271987+0000","last_peered":"2024-09-11T23:17:01.271987+0000","last_clean":"2024-09-11T23:17:01.271987+0000","last_became_active":"2024-09-11T23:17:00.350547+0000","last_became_peered":"2024-09-11T23:17:00.350547+0000","last_unstale":"2024-09-11T23:17:01.271987+0000","last_undegraded":"2024-09-11T23:17:01.271987+0000","last_fullsized":"2024-09-11T23:17:01.271987+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:03.539107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.309066+0000","last_change":"2024-09-11T23:17:01.304773+0000","last_active":"2024-09-11T23:17:01.309066+0000","last_peered":"2024-09-11T23:17:01.309066+0000","last_clean":"2024-09-11T23:17:01.309066+0000","last_became_active":"2024-09-11T23:17:01.299340+0000","last_became_peered":"2024-09-11T23:17:01.299340+0000","last_unstale":"2024-09-11T23:17:01.309066+0000","last_undegraded":"2024-09-11T23:17:01.309066+0000","last_fullsized":"2024-09-11T23:17:01.309066+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:13.539857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.330996+0000","last_change":"2024-09-11T23:17:00.333456+0000","last_active":"2024-09-11T23:17:01.330996+0000","last_peered":"2024-09-11T23:17:01.330996+0000","last_clean":"2024-09-11T23:17:01.330996+0000","last_became_active":"2024-09-11T23:17:00.333175+0000","last_became_peered":"2024-09-11T23:17:00.333175+0000","last_unstale":"2024-09-11T23:17:01.330996+0000","last_undegraded":"2024-09-11T23:17:01.330996+0000","last_fullsized":"2024-09-11T23:17:01.330996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:08.371031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.281743+0000","last_change":"2024-09-11T23:17:01.270681+0000","last_active":"2024-09-11T23:17:01.281743+0000","last_peered":"2024-09-11T23:17:01.281743+0000","last_clean":"2024-09-11T23:17:01.281743+0000","last_became_active":"2024-09-11T23:17:01.269941+0000","last_became_peered":"2024-09-11T23:17:01.269941+0000","last_unstale":"2024-09-11T23:17:01.281743+0000","last_undegraded":"2024-09-11T23:17:01.281743+0000","last_fullsized":"2024-09-11T23:17:01.281743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:06.908267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.330913+0000","last_change":"2024-09-11T23:17:00.326317+0000","last_active":"2024-09-11T23:17:01.330913+0000","last_peered":"2024-09-11T23:17:01.330913+0000","last_clean":"2024-09-11T23:17:01.330913+0000","last_became_active":"2024-09-11T23:17:00.325675+0000","last_became_peered":"2024-09-11T23:17:00.325675+0000","last_unstale":"2024-09-11T23:17:01.330913+0000","last_undegraded":"2024-09-11T23:17:01.330913+0000","last_fullsized":"2024-09-11T23:17:01.330913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:50.183520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.312489+0000","last_change":"2024-09-11T23:17:01.307977+0000","last_active":"2024-09-11T23:17:01.312489+0000","last_peered":"2024-09-11T23:17:01.312489+0000","last_clean":"2024-09-11T23:17:01.312489+0000","last_became_active":"2024-09-11T23:17:01.307332+0000","last_became_peered":"2024-09-11T23:17:01.307332+0000","last_unstale":"2024-09-11T23:17:01.312489+0000","last_undegraded":"2024-09-11T23:17:01.312489+0000","last_fullsized":"2024-09-11T23:17:01.312489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:34.047760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.331977+0000","last_change":"2024-09-11T23:17:00.333170+0000","last_active":"2024-09-11T23:17:01.331977+0000","last_peered":"2024-09-11T23:17:01.331977+0000","last_clean":"2024-09-11T23:17:01.331977+0000","last_became_active":"2024-09-11T23:17:00.332853+0000","last_became_peered":"2024-09-11T23:17:00.332853+0000","last_unstale":"2024-09-11T23:17:01.331977+0000","last_undegraded":"2024-09-11T23:17:01.331977+0000","last_fullsized":"2024-09-11T23:17:01.331977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:44.382506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.307485+0000","last_change":"2024-09-11T23:17:01.306285+0000","last_active":"2024-09-11T23:17:01.307485+0000","last_peered":"2024-09-11T23:17:01.307485+0000","last_clean":"2024-09-11T23:17:01.307485+0000","last_became_active":"2024-09-11T23:17:01.305534+0000","last_became_peered":"2024-09-11T23:17:01.305534+0000","last_unstale":"2024-09-11T23:17:01.307485+0000","last_undegraded":"2024-09-11T23:17:01.307485+0000","last_fullsized":"2024-09-11T23:17:01.307485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:02.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.328836+0000","last_change":"2024-09-11T23:17:00.348671+0000","last_active":"2024-09-11T23:17:01.328836+0000","last_peered":"2024-09-11T23:17:01.328836+0000","last_clean":"2024-09-11T23:17:01.328836+0000","last_became_active":"2024-09-11T23:17:00.348003+0000","last_became_peered":"2024-09-11T23:17:00.348003+0000","last_unstale":"2024-09-11T23:17:01.328836+0000","last_undegraded":"2024-09-11T23:17:01.328836+0000","last_fullsized":"2024-09-11T23:17:01.328836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.398813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.277598+0000","last_change":"2024-09-11T23:17:01.274605+0000","last_active":"2024-09-11T23:17:01.277598+0000","last_peered":"2024-09-11T23:17:01.277598+0000","last_clean":"2024-09-11T23:17:01.277598+0000","last_became_active":"2024-09-11T23:17:01.273871+0000","last_became_peered":"2024-09-11T23:17:01.273871+0000","last_unstale":"2024-09-11T23:17:01.277598+0000","last_undegraded":"2024-09-11T23:17:01.277598+0000","last_fullsized":"2024-09-11T23:17:01.277598+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:42.418086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.279467+0000","last_change":"2024-09-11T23:17:00.325871+0000","last_active":"2024-09-11T23:17:01.279467+0000","last_peered":"2024-09-11T23:17:01.279467+0000","last_clean":"2024-09-11T23:17:01.279467+0000","last_became_active":"2024-09-11T23:17:00.325604+0000","last_became_peered":"2024-09-11T23:17:00.325604+0000","last_unstale":"2024-09-11T23:17:01.279467+0000","last_undegraded":"2024-09-11T23:17:01.279467+0000","last_fullsized":"2024-09-11T23:17:01.279467+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:41.414178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.291720+0000","last_change":"2024-09-11T23:17:01.284583+0000","last_active":"2024-09-11T23:17:01.291720+0000","last_peered":"2024-09-11T23:17:01.291720+0000","last_clean":"2024-09-11T23:17:01.291720+0000","last_became_active":"2024-09-11T23:17:01.283910+0000","last_became_peered":"2024-09-11T23:17:01.283910+0000","last_unstale":"2024-09-11T23:17:01.291720+0000","last_undegraded":"2024-09-11T23:17:01.291720+0000","last_fullsized":"2024-09-11T23:17:01.291720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.001235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.332174+0000","last_change":"2024-09-11T23:17:00.339884+0000","last_active":"2024-09-11T23:17:01.332174+0000","last_peered":"2024-09-11T23:17:01.332174+0000","last_clean":"2024-09-11T23:17:01.332174+0000","last_became_active":"2024-09-11T23:17:00.339609+0000","last_became_peered":"2024-09-11T23:17:00.339609+0000","last_unstale":"2024-09-11T23:17:01.332174+0000","last_undegraded":"2024-09-11T23:17:01.332174+0000","last_fullsized":"2024-09-11T23:17:01.332174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.040670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.302702+0000","last_change":"2024-09-11T23:17:01.298257+0000","last_active":"2024-09-11T23:17:01.302702+0000","last_peered":"2024-09-11T23:17:01.302702+0000","last_clean":"2024-09-11T23:17:01.302702+0000","last_became_active":"2024-09-11T23:17:01.297559+0000","last_became_peered":"2024-09-11T23:17:01.297559+0000","last_unstale":"2024-09-11T23:17:01.302702+0000","last_undegraded":"2024-09-11T23:17:01.302702+0000","last_fullsized":"2024-09-11T23:17:01.302702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.543014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.255588+0000","last_change":"2024-09-11T23:17:00.334702+0000","last_active":"2024-09-11T23:17:01.255588+0000","last_peered":"2024-09-11T23:17:01.255588+0000","last_clean":"2024-09-11T23:17:01.255588+0000","last_became_active":"2024-09-11T23:17:00.334412+0000","last_became_peered":"2024-09-11T23:17:00.334412+0000","last_unstale":"2024-09-11T23:17:01.255588+0000","last_undegraded":"2024-09-11T23:17:01.255588+0000","last_fullsized":"2024-09-11T23:17:01.255588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:38.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.299105+0000","last_change":"2024-09-11T23:17:01.283378+0000","last_active":"2024-09-11T23:17:01.299105+0000","last_peered":"2024-09-11T23:17:01.299105+0000","last_clean":"2024-09-11T23:17:01.299105+0000","last_became_active":"2024-09-11T23:17:01.282679+0000","last_became_peered":"2024-09-11T23:17:01.282679+0000","last_unstale":"2024-09-11T23:17:01.299105+0000","last_undegraded":"2024-09-11T23:17:01.299105+0000","last_fullsized":"2024-09-11T23:17:01.299105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:45.768185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.264391+0000","last_change":"2024-09-11T23:17:00.328692+0000","last_active":"2024-09-11T23:17:01.264391+0000","last_peered":"2024-09-11T23:17:01.264391+0000","last_clean":"2024-09-11T23:17:01.264391+0000","last_became_active":"2024-09-11T23:17:00.328364+0000","last_became_peered":"2024-09-11T23:17:00.328364+0000","last_unstale":"2024-09-11T23:17:01.264391+0000","last_undegraded":"2024-09-11T23:17:01.264391+0000","last_fullsized":"2024-09-11T23:17:01.264391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:39.326332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.308950+0000","last_change":"2024-09-11T23:17:01.307681+0000","last_active":"2024-09-11T23:17:01.308950+0000","last_peered":"2024-09-11T23:17:01.308950+0000","last_clean":"2024-09-11T23:17:01.308950+0000","last_became_active":"2024-09-11T23:17:01.306915+0000","last_became_peered":"2024-09-11T23:17:01.306915+0000","last_unstale":"2024-09-11T23:17:01.308950+0000","last_undegraded":"2024-09-11T23:17:01.308950+0000","last_fullsized":"2024-09-11T23:17:01.308950+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.187428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.266999+0000","last_change":"2024-09-11T23:17:00.339034+0000","last_active":"2024-09-11T23:17:01.266999+0000","last_peered":"2024-09-11T23:17:01.266999+0000","last_clean":"2024-09-11T23:17:01.266999+0000","last_became_active":"2024-09-11T23:17:00.338748+0000","last_became_peered":"2024-09-11T23:17:00.338748+0000","last_unstale":"2024-09-11T23:17:01.266999+0000","last_undegraded":"2024-09-11T23:17:01.266999+0000","last_fullsized":"2024-09-11T23:17:01.266999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:33.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.292243+0000","last_change":"2024-09-11T23:17:01.283740+0000","last_active":"2024-09-11T23:17:01.292243+0000","last_peered":"2024-09-11T23:17:01.292243+0000","last_clean":"2024-09-11T23:17:01.292243+0000","last_became_active":"2024-09-11T23:17:01.283031+0000","last_became_peered":"2024-09-11T23:17:01.283031+0000","last_unstale":"2024-09-11T23:17:01.292243+0000","last_undegraded":"2024-09-11T23:17:01.292243+0000","last_fullsized":"2024-09-11T23:17:01.292243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.301589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.329648+0000","last_change":"2024-09-11T23:17:00.341317+0000","last_active":"2024-09-11T23:17:01.329648+0000","last_peered":"2024-09-11T23:17:01.329648+0000","last_clean":"2024-09-11T23:17:01.329648+0000","last_became_active":"2024-09-11T23:17:00.340715+0000","last_became_peered":"2024-09-11T23:17:00.340715+0000","last_unstale":"2024-09-11T23:17:01.329648+0000","last_undegraded":"2024-09-11T23:17:01.329648+0000","last_fullsized":"2024-09-11T23:17:01.329648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.040670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.289890+0000","last_change":"2024-09-11T23:17:01.288473+0000","last_active":"2024-09-11T23:17:01.289890+0000","last_peered":"2024-09-11T23:17:01.289890+0000","last_clean":"2024-09-11T23:17:01.289890+0000","last_became_active":"2024-09-11T23:17:01.287362+0000","last_became_peered":"2024-09-11T23:17:01.287362+0000","last_unstale":"2024-09-11T23:17:01.289890+0000","last_undegraded":"2024-09-11T23:17:01.289890+0000","last_fullsized":"2024-09-11T23:17:01.289890+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:02.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.271041+0000","last_change":"2024-09-11T23:17:00.348580+0000","last_active":"2024-09-11T23:17:01.271041+0000","last_peered":"2024-09-11T23:17:01.271041+0000","last_clean":"2024-09-11T23:17:01.271041+0000","last_became_active":"2024-09-11T23:17:00.348143+0000","last_became_peered":"2024-09-11T23:17:00.348143+0000","last_unstale":"2024-09-11T23:17:01.271041+0000","last_undegraded":"2024-09-11T23:17:01.271041+0000","last_fullsized":"2024-09-11T23:17:01.271041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.305414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.281603+0000","last_change":"2024-09-11T23:17:01.271149+0000","last_active":"2024-09-11T23:17:01.281603+0000","last_peered":"2024-09-11T23:17:01.281603+0000","last_clean":"2024-09-11T23:17:01.281603+0000","last_became_active":"2024-09-11T23:17:01.270298+0000","last_became_peered":"2024-09-11T23:17:01.270298+0000","last_unstale":"2024-09-11T23:17:01.281603+0000","last_undegraded":"2024-09-11T23:17:01.281603+0000","last_fullsized":"2024-09-11T23:17:01.281603+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:59.444407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.279575+0000","last_change":"2024-09-11T23:17:00.335427+0000","last_active":"2024-09-11T23:17:01.279575+0000","last_peered":"2024-09-11T23:17:01.279575+0000","last_clean":"2024-09-11T23:17:01.279575+0000","last_became_active":"2024-09-11T23:17:00.335159+0000","last_became_peered":"2024-09-11T23:17:00.335159+0000","last_unstale":"2024-09-11T23:17:01.279575+0000","last_undegraded":"2024-09-11T23:17:01.279575+0000","last_fullsized":"2024-09-11T23:17:01.279575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:23.079146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305679+0000","last_change":"2024-09-11T23:17:01.292111+0000","last_active":"2024-09-11T23:17:01.305679+0000","last_peered":"2024-09-11T23:17:01.305679+0000","last_clean":"2024-09-11T23:17:01.305679+0000","last_became_active":"2024-09-11T23:17:01.291389+0000","last_became_peered":"2024-09-11T23:17:01.291389+0000","last_unstale":"2024-09-11T23:17:01.305679+0000","last_undegraded":"2024-09-11T23:17:01.305679+0000","last_fullsized":"2024-09-11T23:17:01.305679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:06.462014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.257615+0000","last_change":"2024-09-11T23:17:00.334790+0000","last_active":"2024-09-11T23:17:01.257615+0000","last_peered":"2024-09-11T23:17:01.257615+0000","last_clean":"2024-09-11T23:17:01.257615+0000","last_became_active":"2024-09-11T23:17:00.334469+0000","last_became_peered":"2024-09-11T23:17:00.334469+0000","last_unstale":"2024-09-11T23:17:01.257615+0000","last_undegraded":"2024-09-11T23:17:01.257615+0000","last_fullsized":"2024-09-11T23:17:01.257615+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:21.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.294329+0000","last_change":"2024-09-11T23:17:01.290591+0000","last_active":"2024-09-11T23:17:01.294329+0000","last_peered":"2024-09-11T23:17:01.294329+0000","last_clean":"2024-09-11T23:17:01.294329+0000","last_became_active":"2024-09-11T23:17:01.289865+0000","last_became_peered":"2024-09-11T23:17:01.289865+0000","last_unstale":"2024-09-11T23:17:01.294329+0000","last_undegraded":"2024-09-11T23:17:01.294329+0000","last_fullsized":"2024-09-11T23:17:01.294329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:39.389730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.256013+0000","last_change":"2024-09-11T23:17:00.344847+0000","last_active":"2024-09-11T23:17:01.256013+0000","last_peered":"2024-09-11T23:17:01.256013+0000","last_clean":"2024-09-11T23:17:01.256013+0000","last_became_active":"2024-09-11T23:17:00.344547+0000","last_became_peered":"2024-09-11T23:17:00.344547+0000","last_unstale":"2024-09-11T23:17:01.256013+0000","last_undegraded":"2024-09-11T23:17:01.256013+0000","last_fullsized":"2024-09-11T23:17:01.256013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:18.498382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.305996+0000","last_change":"2024-09-11T23:17:01.298762+0000","last_active":"2024-09-11T23:17:01.305996+0000","last_peered":"2024-09-11T23:17:01.305996+0000","last_clean":"2024-09-11T23:17:01.305996+0000","last_became_active":"2024-09-11T23:17:01.297988+0000","last_became_peered":"2024-09-11T23:17:01.297988+0000","last_unstale":"2024-09-11T23:17:01.305996+0000","last_undegraded":"2024-09-11T23:17:01.305996+0000","last_fullsized":"2024-09-11T23:17:01.305996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:09.374938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.257871+0000","last_change":"2024-09-11T23:17:00.334127+0000","last_active":"2024-09-11T23:17:01.257871+0000","last_peered":"2024-09-11T23:17:01.257871+0000","last_clean":"2024-09-11T23:17:01.257871+0000","last_became_active":"2024-09-11T23:17:00.332617+0000","last_became_peered":"2024-09-11T23:17:00.332617+0000","last_unstale":"2024-09-11T23:17:01.257871+0000","last_undegraded":"2024-09-11T23:17:01.257871+0000","last_fullsized":"2024-09-11T23:17:01.257871+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.398813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.290565+0000","last_change":"2024-09-11T23:17:01.287518+0000","last_active":"2024-09-11T23:17:01.290565+0000","last_peered":"2024-09-11T23:17:01.290565+0000","last_clean":"2024-09-11T23:17:01.290565+0000","last_became_active":"2024-09-11T23:17:01.286674+0000","last_became_peered":"2024-09-11T23:17:01.286674+0000","last_unstale":"2024-09-11T23:17:01.290565+0000","last_undegraded":"2024-09-11T23:17:01.290565+0000","last_fullsized":"2024-09-11T23:17:01.290565+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:19.836942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.259036+0000","last_change":"2024-09-11T23:17:00.333014+0000","last_active":"2024-09-11T23:17:01.259036+0000","last_peered":"2024-09-11T23:17:01.259036+0000","last_clean":"2024-09-11T23:17:01.259036+0000","last_became_active":"2024-09-11T23:17:00.332488+0000","last_became_peered":"2024-09-11T23:17:00.332488+0000","last_unstale":"2024-09-11T23:17:01.259036+0000","last_undegraded":"2024-09-11T23:17:01.259036+0000","last_fullsized":"2024-09-11T23:17:01.259036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:33.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.285788+0000","last_change":"2024-09-11T23:17:01.280531+0000","last_active":"2024-09-11T23:17:01.285788+0000","last_peered":"2024-09-11T23:17:01.285788+0000","last_clean":"2024-09-11T23:17:01.285788+0000","last_became_active":"2024-09-11T23:17:01.279788+0000","last_became_peered":"2024-09-11T23:17:01.279788+0000","last_unstale":"2024-09-11T23:17:01.285788+0000","last_undegraded":"2024-09-11T23:17:01.285788+0000","last_fullsized":"2024-09-11T23:17:01.285788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:00.298531+0000","last_clean_scrub_stamp":"2024-09-11T23:17:00.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.414874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.267277+0000","last_change":"2024-09-11T23:17:00.332866+0000","last_active":"2024-09-11T23:17:01.267277+0000","last_peered":"2024-09-11T23:17:01.267277+0000","last_clean":"2024-09-11T23:17:01.267277+0000","last_became_active":"2024-09-11T23:17:00.332589+0000","last_became_peered":"2024-09-11T23:17:00.332589+0000","last_unstale":"2024-09-11T23:17:01.267277+0000","last_undegraded":"2024-09-11T23:17:01.267277+0000","last_fullsized":"2024-09-11T23:17:01.267277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:59.294624+0000","last_clean_scrub_stamp":"2024-09-11T23:16:59.294624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.659664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":227,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.270289+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:17:01.270289+0000","last_peered":"2024-09-11T23:17:01.270289+0000","last_clean":"2024-09-11T23:17:01.270289+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:17:01.270289+0000","last_undegraded":"2024-09-11T23:17:01.270289+0000","last_fullsized":"2024-09-11T23:17:01.270289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1196032,"data_stored":854391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":602112,"data_stored":264551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":593920,"data_stored":263899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":264481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35928,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":581632,"data_stored":256732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35944,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335896,"statfs":{"total":96636764160,"available":96599957504,"internally_reserved":0,"allocated":606208,"data_stored":265511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":581632,"data_stored":256732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1196032,"data_stored":854323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:05.695 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:17:05.695 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:17:05.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9b60f7640 1 Processor -- start 2024-09-11T23:17:05.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9b60f7640 1 -- start start 2024-09-11T23:17:05.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9b60f7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b00cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9b60f7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb9b0162070 0x7fb9b0162500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9b60f7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b00d0350 con 0x7fb9b015e4f0 2024-09-11T23:17:05.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9b60f7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b00cf070 con 0x7fb9b0162070 2024-09-11T23:17:05.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9b60f7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b00d1c20 con 0x7fb9b00d15d0 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9affff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb9b0162070 0x7fb9b0162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9affff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb9b0162070 0x7fb9b0162500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55654/0 (socket says 172.21.15.94:55654) 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.858+0000 7fb9affff640 1 -- 172.21.15.94:0/1597400007 learned_addr learned my addr 172.21.15.94:0/1597400007 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9a7fff640 1 --2- 172.21.15.94:0/1597400007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b00cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9affff640 1 -- 172.21.15.94:0/1597400007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 msgr2=0x7fb9b00cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9affff640 1 --2- 172.21.15.94:0/1597400007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b00cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9affff640 1 -- 172.21.15.94:0/1597400007 >> v1:172.21.15.155:6789/0 conn(0x7fb9b015e4f0 legacy=0x7fb9b00d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:05.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9affff640 1 -- 172.21.15.94:0/1597400007 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b00cf330 con 0x7fb9b0162070 2024-09-11T23:17:05.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9affff640 1 --2- 172.21.15.94:0/1597400007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b0162500 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009e50 tx=0x7fb9a801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7feb2646522159 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9aeffd640 1 -- 172.21.15.94:0/1597400007 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80b4070 con 0x7fb9b0162070 2024-09-11T23:17:05.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9aeffd640 1 -- 172.21.15.94:0/1597400007 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a80af400 con 0x7fb9b0162070 2024-09-11T23:17:05.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9aeffd640 1 -- 172.21.15.94:0/1597400007 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80af7d0 con 0x7fb9b0162070 2024-09-11T23:17:05.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 -- 172.21.15.94:0/1597400007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 msgr2=0x7fb9b0162500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/1597400007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b0162500 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009e50 tx=0x7fb9a801f1e0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 -- 172.21.15.94:0/1597400007 shutdown_connections 2024-09-11T23:17:05.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/1597400007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b0162500 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/1597400007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b00cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 -- 172.21.15.94:0/1597400007 >> 172.21.15.94:0/1597400007 conn(0x7fb9b008bf90 msgr2=0x7fb9b00d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:05.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 -- 172.21.15.94:0/1597400007 shutdown_connections 2024-09-11T23:17:05.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.862+0000 7fb9b60f7640 1 -- 172.21.15.94:0/1597400007 wait complete. 2024-09-11T23:17:05.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 Processor -- start 2024-09-11T23:17:05.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 -- start start 2024-09-11T23:17:05.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b01474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9b015e4f0 0x7fb9b00ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b01611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b015e8d0 con 0x7fb9b0162070 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b00cf8f0 con 0x7fb9b015e4f0 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b00b7260 con 0x7fb9b00d15d0 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b01611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b01611b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55662/0 (socket says 172.21.15.94:55662) 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 -- 172.21.15.94:0/923313605 learned_addr learned my addr 172.21.15.94:0/923313605 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9a7fff640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9b015e4f0 0x7fb9b00ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 -- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 msgr2=0x7fb9b01474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9af7fe640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b01474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b01474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 -- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9b015e4f0 msgr2=0x7fb9b00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9b015e4f0 0x7fb9b00ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 -- 172.21.15.94:0/923313605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b0160150 con 0x7fb9b0162070 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9af7fe640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b01474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9affff640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b01611b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb9a801d890 tx=0x7fb9a801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9acff9640 1 -- 172.21.15.94:0/923313605 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80b4040 con 0x7fb9b0162070 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9acff9640 1 -- 172.21.15.94:0/923313605 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a80c1070 con 0x7fb9b0162070 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9acff9640 1 -- 172.21.15.94:0/923313605 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8009510 con 0x7fb9b0162070 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b01603f0 con 0x7fb9b0162070 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b01609b0 con 0x7fb9b0162070 2024-09-11T23:17:05.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.866+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b00cfe10 con 0x7fb9b0162070 2024-09-11T23:17:05.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.870+0000 7fb9acff9640 1 -- 172.21.15.94:0/923313605 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9a80b7070 con 0x7fb9b0162070 2024-09-11T23:17:05.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.870+0000 7fb9acff9640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.870+0000 7fb9acff9640 1 -- 172.21.15.94:0/923313605 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fb9a8123da0 con 0x7fb9b0162070 2024-09-11T23:17:05.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.870+0000 7fb9af7fe640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.870+0000 7fb9af7fe640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb9900678c0 0x7fb990069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00016e0 tx=0x7fb9a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:05.874+0000 7fb9acff9640 1 -- 172.21.15.94:0/923313605 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9a8018d40 con 0x7fb9b0162070 2024-09-11T23:17:06.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.098+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb9b0161c30 con 0x7fb9b0162070 2024-09-11T23:17:06.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.102+0000 7fb9acff9640 1 -- 172.21.15.94:0/923313605 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fb9a80f4930 con 0x7fb9b0162070 2024-09-11T23:17:06.108 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:17:06.108 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:17:06.108 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2024-09-11T23:17:06.108 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2024-09-11T23:17:06.109 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:17:06.109 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2024-09-11T23:17:06.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb9900678c0 msgr2=0x7fb990069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb9900678c0 0x7fb990069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00016e0 tx=0x7fb9a0009040 comp rx=0 tx=0).stop 2024-09-11T23:17:06.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 msgr2=0x7fb9b01611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b01611b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb9a801d890 tx=0x7fb9a801bf80 comp rx=0 tx=0).stop 2024-09-11T23:17:06.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 shutdown_connections 2024-09-11T23:17:06.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b0162070 0x7fb9b01611b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9b015e4f0 0x7fb9b00ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 --2- 172.21.15.94:0/923313605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9b00d15d0 0x7fb9b01474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 >> 172.21.15.94:0/923313605 conn(0x7fb9b008bf90 msgr2=0x7fb9b00b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:06.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 shutdown_connections 2024-09-11T23:17:06.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.106+0000 7fb9b60f7640 1 -- 172.21.15.94:0/923313605 wait complete. 2024-09-11T23:17:06.126 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:06.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e28fc2640 1 Processor -- start 2024-09-11T23:17:06.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e28fc2640 1 -- start start 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e28fc2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8e2415c000 0x7f8e24165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e28fc2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e240cf8e0 con 0x7f8e2406d3e0 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e28fc2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e240cfbc0 con 0x7f8e2413dfe0 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e28fc2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8e240cfea0 con 0x7f8e2415c000 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e21d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8e2406d3e0 0x7f8e2415b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55170/0 (socket says 172.21.15.94:55170) 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e21d9b640 1 -- 172.21.15.94:0/2059059348 learned_addr learned my addr 172.21.15.94:0/2059059348 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e22d9d640 1 --2- 172.21.15.94:0/2059059348 >> v2:172.21.15.94:3300/0 conn(0x7f8e2415c000 0x7f8e24165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e2159a640 1 -- 172.21.15.94:0/2059059348 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651215434 0 0) 0x7f8e240cf8e0 con 0x7f8e2406d3e0 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e2159a640 1 -- 172.21.15.94:0/2059059348 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e0c003530 con 0x7f8e2406d3e0 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e22d9d640 1 -- 172.21.15.94:0/2059059348 >> v1:172.21.15.155:6789/0 conn(0x7f8e2413dfe0 legacy=0x7f8e2406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e22d9d640 1 -- 172.21.15.94:0/2059059348 >> v1:172.21.15.94:6789/0 conn(0x7f8e2406d3e0 legacy=0x7f8e2415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.226+0000 7f8e22d9d640 1 -- 172.21.15.94:0/2059059348 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240cf590 con 0x7f8e2415c000 2024-09-11T23:17:06.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 --2- 172.21.15.94:0/2059059348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e24165bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0097c0 tx=0x7f8e1c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b630325953cbf53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:06.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e2159a640 1 -- 172.21.15.94:0/2059059348 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0b0070 con 0x7f8e2415c000 2024-09-11T23:17:06.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e2159a640 1 -- 172.21.15.94:0/2059059348 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0ab600 con 0x7f8e2415c000 2024-09-11T23:17:06.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e2159a640 1 -- 172.21.15.94:0/2059059348 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0ab9d0 con 0x7f8e2415c000 2024-09-11T23:17:06.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- 172.21.15.94:0/2059059348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 msgr2=0x7f8e24165bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/2059059348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e24165bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0097c0 tx=0x7f8e1c01c340 comp rx=0 tx=0).stop 2024-09-11T23:17:06.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- 172.21.15.94:0/2059059348 shutdown_connections 2024-09-11T23:17:06.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/2059059348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e24165bf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- 172.21.15.94:0/2059059348 >> 172.21.15.94:0/2059059348 conn(0x7f8e24072690 msgr2=0x7f8e24072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:06.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- 172.21.15.94:0/2059059348 shutdown_connections 2024-09-11T23:17:06.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- 172.21.15.94:0/2059059348 wait complete. 2024-09-11T23:17:06.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 Processor -- start 2024-09-11T23:17:06.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- start start 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e2406d3e0 0x7f8e24151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e2413dfe0 0x7f8e240704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e240b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240b4810 con 0x7f8e2415c000 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240b4690 con 0x7f8e2413dfe0 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e28fc2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8e240b4990 con 0x7f8e2406d3e0 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e240b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e240b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55690/0 (socket says 172.21.15.94:55690) 2024-09-11T23:17:06.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 -- 172.21.15.94:0/3084061165 learned_addr learned my addr 172.21.15.94:0/3084061165 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e2259c640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e2406d3e0 0x7f8e24151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 -- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e2406d3e0 msgr2=0x7f8e24151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e2406d3e0 0x7f8e24151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 -- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e2413dfe0 msgr2=0x7f8e240704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e21d9b640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e2413dfe0 0x7f8e240704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e2413dfe0 0x7f8e240704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e22d9d640 1 -- 172.21.15.94:0/3084061165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e24136d10 con 0x7f8e2415c000 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.230+0000 7f8e2259c640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e2406d3e0 0x7f8e24151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e22d9d640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e240b16f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c018f50 tx=0x7f8e1c01ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e12ffd640 1 -- 172.21.15.94:0/3084061165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0b0050 con 0x7f8e2415c000 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e12ffd640 1 -- 172.21.15.94:0/3084061165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0bc070 con 0x7f8e2415c000 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e24136fd0 con 0x7f8e2415c000 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e12ffd640 1 -- 172.21.15.94:0/3084061165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0b5a30 con 0x7f8e2415c000 2024-09-11T23:17:06.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e24137590 con 0x7f8e2415c000 2024-09-11T23:17:06.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e240b5800 con 0x7f8e2415c000 2024-09-11T23:17:06.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e12ffd640 1 -- 172.21.15.94:0/3084061165 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e1c0ab480 con 0x7f8e2415c000 2024-09-11T23:17:06.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e12ffd640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8e040678c0 0x7f8e04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e12ffd640 1 -- 172.21.15.94:0/3084061165 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f8e1c121280 con 0x7f8e2415c000 2024-09-11T23:17:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e2259c640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8e040678c0 0x7f8e04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.234+0000 7f8e2259c640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8e040678c0 0x7f8e04069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007e90 tx=0x7f8e140073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:06.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.238+0000 7f8e12ffd640 1 -- 172.21.15.94:0/3084061165 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e1c016050 con 0x7f8e2415c000 2024-09-11T23:17:06.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e24072d70 con 0x7f8e2415c000 2024-09-11T23:17:06.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e12ffd640 1 -- 172.21.15.94:0/3084061165 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7f8e1c0f1de0 con 0x7f8e2415c000 2024-09-11T23:17:06.426 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:06.427 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"btime":"2024-09-11T23:17:04:322465+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2442107241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2442107241},{"type":"v1","addr":"172.21.15.155:6837","nonce":2442107241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1638163040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1638163040},{"type":"v1","addr":"172.21.15.155:6836","nonce":1638163040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2826826443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2826826443},{"type":"v1","addr":"172.21.15.94:6833","nonce":2826826443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:00.676836+0000","modified":"2024-09-11T23:17:03.687833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2087871065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2087871065},{"type":"v1","addr":"172.21.15.94:6835","nonce":2087871065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-11T23:17:06.427 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 24 2024-09-11T23:17:06.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8e040678c0 msgr2=0x7f8e04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8e040678c0 0x7f8e04069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007e90 tx=0x7f8e140073a0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 msgr2=0x7f8e240b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e240b16f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c018f50 tx=0x7f8e1c01ab80 comp rx=0 tx=0).stop 2024-09-11T23:17:06.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 shutdown_connections 2024-09-11T23:17:06.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8e040678c0 0x7f8e04069d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2415c000 0x7f8e240b16f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e2413dfe0 0x7f8e240704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 --2- 172.21.15.94:0/3084061165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e2406d3e0 0x7f8e24151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 >> 172.21.15.94:0/3084061165 conn(0x7f8e24072690 msgr2=0x7f8e24140740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:06.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 shutdown_connections 2024-09-11T23:17:06.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.422+0000 7f8e28fc2640 1 -- 172.21.15.94:0/3084061165 wait complete. 2024-09-11T23:17:06.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:17:00.676836+0000', 'modified': '2024-09-11T23:17:03.687833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6835/2087871065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 2087871065}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 2087871065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5328, 'qdb_cluster': [5328]} 2024-09-11T23:17:06.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:17:06.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:17:06.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.974+0000 7f07014e6640 1 Processor -- start 2024-09-11T23:17:06.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.974+0000 7f07014e6640 1 -- start start 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06fc15c2a0 0x7f06fc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06fc0af2a0 0x7f06fc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06fc0b3290 con 0x7f06fc15bec0 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f06fc0b3570 con 0x7f06fc15c2a0 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f06fc0b3850 con 0x7f06fc0af2a0 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06fc15c2a0 0x7f06fc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06fc15c2a0 0x7f06fc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55700/0 (socket says 172.21.15.94:55700) 2024-09-11T23:17:06.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 -- 172.21.15.94:0/2870020741 learned_addr learned my addr 172.21.15.94:0/2870020741 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:06.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/2870020741 >> v2:172.21.15.155:3300/0 conn(0x7f06fc0af2a0 0x7f06fc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 -- 172.21.15.94:0/2870020741 >> v2:172.21.15.155:3300/0 conn(0x7f06fc0af2a0 msgr2=0x7f06fc06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:06.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 --2- 172.21.15.94:0/2870020741 >> v2:172.21.15.155:3300/0 conn(0x7f06fc0af2a0 0x7f06fc06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 -- 172.21.15.94:0/2870020741 >> v1:172.21.15.155:6789/0 conn(0x7f06fc15bec0 legacy=0x7f06fc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:06.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 -- 172.21.15.94:0/2870020741 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc0b3b30 con 0x7f06fc15c2a0 2024-09-11T23:17:06.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06f3fff640 1 --2- 172.21.15.94:0/2870020741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc15c2a0 0x7f06fc0aed60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0b2fb0 tx=0x7f06e401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe00a37a3fdac797 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:06.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06fa7fc640 1 -- 172.21.15.94:0/2870020741 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40aa610 con 0x7f06fc15c2a0 2024-09-11T23:17:06.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06fa7fc640 1 -- 172.21.15.94:0/2870020741 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e40af070 con 0x7f06fc15c2a0 2024-09-11T23:17:06.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f06fa7fc640 1 -- 172.21.15.94:0/2870020741 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40aa9d0 con 0x7f06fc15c2a0 2024-09-11T23:17:06.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- 172.21.15.94:0/2870020741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc15c2a0 msgr2=0x7f06fc0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 --2- 172.21.15.94:0/2870020741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc15c2a0 0x7f06fc0aed60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0b2fb0 tx=0x7f06e401c4b0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- 172.21.15.94:0/2870020741 shutdown_connections 2024-09-11T23:17:06.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 --2- 172.21.15.94:0/2870020741 >> v2:172.21.15.155:3300/0 conn(0x7f06fc0af2a0 0x7f06fc06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 --2- 172.21.15.94:0/2870020741 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc15c2a0 0x7f06fc0aed60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- 172.21.15.94:0/2870020741 >> 172.21.15.94:0/2870020741 conn(0x7f06fc0b1f90 msgr2=0x7f06fc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:06.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- 172.21.15.94:0/2870020741 shutdown_connections 2024-09-11T23:17:06.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.978+0000 7f07014e6640 1 -- 172.21.15.94:0/2870020741 wait complete. 2024-09-11T23:17:06.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 Processor -- start 2024-09-11T23:17:06.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 -- start start 2024-09-11T23:17:06.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc0af2a0 0x7f06fc14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06fc15bec0 0x7f06fc14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06fc15c2a0 0x7f06fc163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc06ed50 con 0x7f06fc0af2a0 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc0af6b0 con 0x7f06fc15bec0 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc06eed0 con 0x7f06fc15c2a0 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc0af2a0 0x7f06fc14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc0af2a0 0x7f06fc14a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55708/0 (socket says 172.21.15.94:55708) 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 -- 172.21.15.94:0/378174187 learned_addr learned my addr 172.21.15.94:0/378174187 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06fc15c2a0 0x7f06fc163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06f3fff640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06fc15bec0 0x7f06fc14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 -- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06fc15c2a0 msgr2=0x7f06fc163fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06fc15c2a0 0x7f06fc163fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 -- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06fc15bec0 msgr2=0x7f06fc14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06fc15bec0 0x7f06fc14d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 -- 172.21.15.94:0/378174187 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc14dde0 con 0x7f06fc0af2a0 2024-09-11T23:17:06.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06faffd640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc0af2a0 0x7f06fc14a280 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c4c0 tx=0x7f06ec001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:06.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06f37fe640 1 -- 172.21.15.94:0/378174187 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec017070 con 0x7f06fc0af2a0 2024-09-11T23:17:06.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06f37fe640 1 -- 172.21.15.94:0/378174187 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec003600 con 0x7f06fc0af2a0 2024-09-11T23:17:06.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f06f37fe640 1 -- 172.21.15.94:0/378174187 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0039f0 con 0x7f06fc0af2a0 2024-09-11T23:17:06.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc14d820 con 0x7f06fc0af2a0 2024-09-11T23:17:06.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.982+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc1560e0 con 0x7f06fc0af2a0 2024-09-11T23:17:06.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f37fe640 1 -- 172.21.15.94:0/378174187 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06ec01a070 con 0x7f06fc0af2a0 2024-09-11T23:17:06.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f37fe640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06dc0678f0 0x7f06dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f37fe640 1 -- 172.21.15.94:0/378174187 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f06ec085080 con 0x7f06fc0af2a0 2024-09-11T23:17:06.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f3fff640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06dc0678f0 0x7f06dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 Processor -- start 2024-09-11T23:17:06.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 -- start start 2024-09-11T23:17:06.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f3fff640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06dc0678f0 0x7f06dc069db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06e40ae000 tx=0x7f06e40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecf7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecadd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecae290 0x55963ecae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55963eb95b60 con 0x55963ecae290 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55963eafcc70 con 0x55963ecf8440 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55963eaa2ed0 con 0x55963ecf7b20 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecae290 0x55963ecae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecae290 0x55963ecae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55716/0 (socket says 172.21.15.94:55716) 2024-09-11T23:17:06.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 -- 172.21.15.94:0/396804667 learned_addr learned my addr 172.21.15.94:0/396804667 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06faffd640 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecf7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f3fff640 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecadd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 -- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 msgr2=0x55963ecf7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecf7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 -- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 msgr2=0x55963ecadd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecadd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 -- 172.21.15.94:0/396804667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963eab4e50 con 0x55963ecae290 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecae290 0x55963ecae670 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f06f400e3c0 tx=0x7f06f400e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e2666bcddc4e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f0ff9640 1 -- 172.21.15.94:0/396804667 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f400f6c0 con 0x55963ecae290 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f0ff9640 1 -- 172.21.15.94:0/396804667 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f400f860 con 0x55963ecae290 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f06f0ff9640 1 -- 172.21.15.94:0/396804667 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f400fc10 con 0x55963ecae290 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 -- 172.21.15.94:0/396804667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecae290 msgr2=0x55963ecae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.986+0000 7f07045a2000 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecae290 0x55963ecae670 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f06f400e3c0 tx=0x7f06f400e880 comp rx=0 tx=0).stop 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- 172.21.15.94:0/396804667 shutdown_connections 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecae290 0x55963ecae670 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecadd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 --2- 172.21.15.94:0/396804667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecf7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- 172.21.15.94:0/396804667 >> 172.21.15.94:0/396804667 conn(0x55963ecb4600 msgr2=0x55963ecac630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- 172.21.15.94:0/396804667 shutdown_connections 2024-09-11T23:17:06.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- 172.21.15.94:0/396804667 wait complete. 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- start start 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 Processor -- start 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecb2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecb8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ecb9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55963eb5eb00 con 0x55963ecb3330 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55963ead7360 con 0x55963ecf8440 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55963ead42d0 con 0x55963ecf7b20 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 10 client.0 _ll_register_callbacks cb 0x55963ec99820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:17:07.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ecb9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ecb9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55730/0 (socket says 172.21.15.94:55730) 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 -- 172.21.15.94:0/1457182250 learned_addr learned my addr 172.21.15.94:0/1457182250 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06faffd640 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecb2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06f3fff640 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecb8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 -- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 msgr2=0x55963ecb2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecb2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 -- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 msgr2=0x55963ecb8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecb8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 -- 172.21.15.94:0/1457182250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963eaa3120 con 0x55963ecb3330 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ecb9230 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x55963ebb4ac0 tx=0x7f06f4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fcad14a59e3ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1457182250 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4024020 con 0x55963ecb3330 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1457182250 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f06f4010cb0 con 0x55963ecb3330 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f400f860 con 0x55963ecb3330 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1457182250 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f06f402e050 con 0x55963ecb3330 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 10 client.5448 fetch_fsmap learned FSMap version 24 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55963ea9c450 con 0x55963ecb3330 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1457182250 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f400f860 con 0x55963ecb3330 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1457182250 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f06f4031020 con 0x55963ecb3330 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 10 client.5448 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 10 client.5448 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 20 client.5448 populate_metadata read hostname 'smithi094' 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed06280 0x55963ed08670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 4 client.5448 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 --> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55963ea96c00 con 0x55963ed06280 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06faffd640 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed06280 0x55963ed08670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06faffd640 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed06280 0x55963ed08670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d35fb46892ff0903 server_cookie=c9a3a9b009277c32 in_seq=0 out_seq=0 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 10 client.5448 ms_handle_connect on v2:172.21.15.94:6834/2087871065 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1457182250 <== mds.0 v2:172.21.15.94:6834/2087871065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55963ea96c00 con 0x55963ed06280 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f06d9ffb640 10 client.5448 handle_command_reply: tid=0 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.990+0000 7f07045a2000 1 client.5448 shutdown 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 msgr2=0x55963ecb9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ecb9230 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x55963ebb4ac0 tx=0x7f06f4004ac0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 shutdown_connections 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed06280 0x55963ed08670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ecb9230 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf8440 0x55963ecb8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f06d9ffb640 0 client.5448 ms_handle_reset on v2:172.21.15.94:6834/2087871065 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 --2- 172.21.15.94:0/1457182250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf7b20 0x55963ecb2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 >> 172.21.15.94:0/1457182250 conn(0x55963ecae290 msgr2=0x55963ecacd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 shutdown_connections 2024-09-11T23:17:07.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 1 -- 172.21.15.94:0/1457182250 wait complete. 2024-09-11T23:17:07.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:06.994+0000 7f07045a2000 20 client.5448 trim_cache size 0 max 16384 2024-09-11T23:17:07.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 Processor -- start 2024-09-11T23:17:07.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 -- start start 2024-09-11T23:17:07.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecb3330 0x55963ecf6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecf7b20 0x55963ecf71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed08670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc202d00 con 0x55963ecf7b20 2024-09-11T23:17:07.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc072310 con 0x55963ecb3330 2024-09-11T23:17:07.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.010+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc072960 con 0x55963ecf8440 2024-09-11T23:17:07.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecf7b20 0x55963ecf71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecf7b20 0x55963ecf71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55732/0 (socket says 172.21.15.94:55732) 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 -- 172.21.15.94:0/4192060385 learned_addr learned my addr 172.21.15.94:0/4192060385 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 -- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 msgr2=0x55963ed08670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed08670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed08670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecb3330 0x55963ecf6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 -- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecb3330 msgr2=0x55963ecf6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecb3330 0x55963ecf6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 -- 172.21.15.94:0/4192060385 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963ea83fd0 con 0x55963ecf7b20 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecf7b20 0x55963ecf71d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f06e40ac040 tx=0x7f06e40a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85879f1affa1e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06dbfff640 1 -- 172.21.15.94:0/4192060385 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40ba070 con 0x55963ecf7b20 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06dbfff640 1 -- 172.21.15.94:0/4192060385 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e40ce070 con 0x55963ecf7b20 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06dbfff640 1 -- 172.21.15.94:0/4192060385 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40bed90 con 0x55963ecf7b20 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- 172.21.15.94:0/4192060385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecf7b20 msgr2=0x55963ecf71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecf7b20 0x55963ecf71d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f06e40ac040 tx=0x7f06e40a9000 comp rx=0 tx=0).stop 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- 172.21.15.94:0/4192060385 shutdown_connections 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed08670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecf7b20 0x55963ecf71d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 --2- 172.21.15.94:0/4192060385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecb3330 0x55963ecf6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- 172.21.15.94:0/4192060385 >> 172.21.15.94:0/4192060385 conn(0x55963ecae290 msgr2=0x55963ecb25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- 172.21.15.94:0/4192060385 shutdown_connections 2024-09-11T23:17:07.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- 172.21.15.94:0/4192060385 wait complete. 2024-09-11T23:17:07.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- start start 2024-09-11T23:17:07.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 Processor -- start 2024-09-11T23:17:07.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ed0b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf7b20 0x55963ed0b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed26960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55963eafbf80 con 0x55963ecb3330 2024-09-11T23:17:07.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55963eab4ca0 con 0x55963ecf7b20 2024-09-11T23:17:07.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55963eb012a0 con 0x55963ecf8440 2024-09-11T23:17:07.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 10 client.0 _ll_register_callbacks cb 0x7f06f4007e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:17:07.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ed0b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ed0b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55748/0 (socket says 172.21.15.94:55748) 2024-09-11T23:17:07.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 -- 172.21.15.94:0/1293094543 learned_addr learned my addr 172.21.15.94:0/1293094543 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:07.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed26960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06f3fff640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf7b20 0x55963ed0b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 -- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 msgr2=0x55963ed26960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed26960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 -- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf7b20 msgr2=0x55963ed0b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf7b20 0x55963ed0b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 -- 172.21.15.94:0/1293094543 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963eb7f750 con 0x55963ecb3330 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06fb7fe640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed26960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06faffd640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ed0b3b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00ce10 tx=0x7f06ec051690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bee515ae69d7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:17:07.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1293094543 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec05df10 con 0x55963ecb3330 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1293094543 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f06ec0519a0 con 0x55963ecb3330 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e40ce070 con 0x55963ecb3330 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1293094543 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f06ec06d190 con 0x55963ecb3330 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 10 client.5454 fetch_fsmap learned FSMap version 24 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55963ea8aa30 con 0x55963ecb3330 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.014+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1293094543 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e40ce070 con 0x55963ecb3330 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1293094543 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f06ec05da80 con 0x55963ecb3330 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 10 client.5454 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 10 client.5454 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 20 client.5454 populate_metadata read hostname 'smithi094' 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed6ae10 0x55963ed6b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 4 client.5454 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 --> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] -- command(tid 0: {"prefix": "status"}) -- 0x55963eb0a3a0 con 0x55963ed6ae10 2024-09-11T23:17:07.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f06f3fff640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed6ae10 0x55963ed6b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f06d9ffb640 10 client.5454 ms_handle_connect on v2:172.21.15.94:6834/2087871065 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f06f3fff640 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed6ae10 0x55963ed6b1f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fde297f6575a64a server_cookie=ea7f8df50e872a7e in_seq=0 out_seq=0 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f06d9ffb640 1 -- 172.21.15.94:0/1293094543 <== mds.0 v2:172.21.15.94:6834/2087871065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55963eb0a3a0 con 0x55963ed6ae10 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f06d9ffb640 10 client.5454 handle_command_reply: tid=0 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 client.5454 shutdown 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 msgr2=0x55963ed0b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ed0b3b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00ce10 tx=0x7f06ec051690 comp rx=0 tx=0).stop 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 shutdown_connections 2024-09-11T23:17:07.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:6834/2087871065,v1:172.21.15.94:6835/2087871065] conn(0x55963ed6ae10 0x55963ed6b1f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55963ecf8440 0x55963ed26960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f06d9ffb640 0 client.5454 ms_handle_reset on v2:172.21.15.94:6834/2087871065 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55963ecf7b20 0x55963ed0b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 --2- 172.21.15.94:0/1293094543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55963ecb3330 0x55963ed0b3b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 >> 172.21.15.94:0/1293094543 conn(0x55963ecae290 msgr2=0x55963ecf5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 shutdown_connections 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 1 -- 172.21.15.94:0/1293094543 wait complete. 2024-09-11T23:17:07.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07045a2000 20 client.5454 trim_cache size 0 max 16384 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5328, 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:17:07.033 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 5.7080145169999996, 2024-09-11T23:17:07.034 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 24, 2024-09-11T23:17:07.034 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 51, 2024-09-11T23:17:07.034 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 51, 2024-09-11T23:17:07.034 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 10.821906198000001 2024-09-11T23:17:07.034 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06dc0678f0 msgr2=0x7f06dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06dc0678f0 0x7f06dc069db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06e40ae000 tx=0x7f06e40a7000 comp rx=0 tx=0).stop 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc0af2a0 msgr2=0x7f06fc14a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc0af2a0 0x7f06fc14a280 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c4c0 tx=0x7f06ec001e80 comp rx=0 tx=0).stop 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 shutdown_connections 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06fc15c2a0 0x7f06fc163fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06fc15bec0 0x7f06fc14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06dc0678f0 0x7f06dc069db0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 --2- 172.21.15.94:0/378174187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06fc0af2a0 0x7f06fc14a280 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 >> 172.21.15.94:0/378174187 conn(0x7f06fc0b1f90 msgr2=0x7f06fc1597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 shutdown_connections 2024-09-11T23:17:07.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.018+0000 7f07014e6640 1 -- 172.21.15.94:0/378174187 wait complete. 2024-09-11T23:17:07.039 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:17:07.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f24627c6640 1 Processor -- start 2024-09-11T23:17:07.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f24627c6640 1 -- start start 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f24627c6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f245c15bec0 0x7f245c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f24627c6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245c0b3290 con 0x7f245c0af470 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f24627c6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245c0b3570 con 0x7f245c15c2a0 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f24627c6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f245c0b3850 con 0x7f245c15bec0 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f2460d63640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f245c0af470 0x7f245c06e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55172/0 (socket says 172.21.15.94:55172) 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f2460d63640 1 -- 172.21.15.94:0/1795111213 learned_addr learned my addr 172.21.15.94:0/1795111213 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 --2- 172.21.15.94:0/1795111213 >> v2:172.21.15.155:3300/0 conn(0x7f245c15bec0 0x7f245c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962406242 0 0) 0x7f245c0b3290 con 0x7f245c0af470 2024-09-11T23:17:07.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2448003530 con 0x7f245c0af470 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2190866902 0 0) 0x7f2448003530 con 0x7f245c0af470 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 >> v2:172.21.15.155:3300/0 conn(0x7f245c15bec0 msgr2=0x7f245c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 --2- 172.21.15.94:0/1795111213 >> v2:172.21.15.155:3300/0 conn(0x7f245c15bec0 0x7f245c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 >> v1:172.21.15.155:6789/0 conn(0x7f245c15c2a0 legacy=0x7f245c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c0b3b30 con 0x7f245c0af470 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f244c001680 con 0x7f245c0af470 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 >> v1:172.21.15.94:6789/0 conn(0x7f245c0af470 legacy=0x7f245c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24480039c0 0x7f2448003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2448004810 0x7f2448004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24480051d0 0x7f244800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f245c0b3850 con 0x7f24480039c0 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f244800c120 con 0x7f24480051d0 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f244800c320 con 0x7f2448004810 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 --2- 172.21.15.94:0/1795111213 >> v2:172.21.15.155:3300/0 conn(0x7f245c15bec0 0x7f245c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24480039c0 0x7f2448003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245b7fe640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2448004810 0x7f2448004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f2460d63640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24480051d0 0x7f244800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 -- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2448004810 msgr2=0x7f2448004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2448004810 0x7f2448004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 -- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24480051d0 msgr2=0x7f244800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:07.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24480051d0 0x7f244800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f245bfff640 1 -- 172.21.15.94:0/1795111213 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2448003530 con 0x7f24480039c0 2024-09-11T23:17:07.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f2460d63640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24480051d0 0x7f244800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:07.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.146+0000 7f2460d63640 1 -- 172.21.15.94:0/1795111213 reap_dead start 2024-09-11T23:17:07.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f245bfff640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24480039c0 0x7f2448003de0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f24540073e0 tx=0x7f245401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77d1aa56ed023ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24540b2070 con 0x7f24480039c0 2024-09-11T23:17:07.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24540a5c80 con 0x7f24480039c0 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f245affd640 1 -- 172.21.15.94:0/1795111213 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454009c70 con 0x7f24480039c0 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- 172.21.15.94:0/1795111213 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24480039c0 msgr2=0x7f2448003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24480039c0 0x7f2448003de0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f24540073e0 tx=0x7f245401ce90 comp rx=0 tx=0).stop 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- 172.21.15.94:0/1795111213 shutdown_connections 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 --2- 172.21.15.94:0/1795111213 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24480039c0 0x7f2448003de0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- 172.21.15.94:0/1795111213 >> 172.21.15.94:0/1795111213 conn(0x7f245c0b1f90 msgr2=0x7f245c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- 172.21.15.94:0/1795111213 shutdown_connections 2024-09-11T23:17:07.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- 172.21.15.94:0/1795111213 wait complete. 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 Processor -- start 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- start start 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24480039c0 0x7f245c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f245c152f80 0x7f245c072920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f245c1ea260 0x7f245c154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f245c0af2f0 con 0x7f245c1ea260 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f245c0af170 con 0x7f245c152f80 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f24627c6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f245c0ad610 con 0x7f24480039c0 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f245c1ea260 0x7f245c154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f245c1ea260 0x7f245c154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55770/0 (socket says 172.21.15.94:55770) 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 -- 172.21.15.94:0/2449639091 learned_addr learned my addr 172.21.15.94:0/2449639091 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f245b7fe640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f245c152f80 0x7f245c072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f245bfff640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24480039c0 0x7f245c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 -- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24480039c0 msgr2=0x7f245c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24480039c0 0x7f245c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 -- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f245c152f80 msgr2=0x7f245c072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f245c152f80 0x7f245c072920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f2460d63640 1 -- 172.21.15.94:0/2449639091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c073950 con 0x7f245c1ea260 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.150+0000 7f245bfff640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24480039c0 0x7f245c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:07.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f2460d63640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f245c1ea260 0x7f245c154970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f245c15c680 tx=0x7f244c00d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f2458ff9640 1 -- 172.21.15.94:0/2449639091 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c007440 con 0x7f245c1ea260 2024-09-11T23:17:07.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f2458ff9640 1 -- 172.21.15.94:0/2449639091 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244c007600 con 0x7f245c1ea260 2024-09-11T23:17:07.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f2458ff9640 1 -- 172.21.15.94:0/2449639091 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c004a30 con 0x7f245c1ea260 2024-09-11T23:17:07.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c073c30 con 0x7f245c1ea260 2024-09-11T23:17:07.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c1e9a60 con 0x7f245c1ea260 2024-09-11T23:17:07.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245c160470 con 0x7f245c1ea260 2024-09-11T23:17:07.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f2458ff9640 1 -- 172.21.15.94:0/2449639091 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f244c004bd0 con 0x7f245c1ea260 2024-09-11T23:17:07.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f2458ff9640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f243c0678f0 0x7f243c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f2458ff9640 1 -- 172.21.15.94:0/2449639091 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f244c085380 con 0x7f245c1ea260 2024-09-11T23:17:07.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f245bfff640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f243c0678f0 0x7f243c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.154+0000 7f245bfff640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f243c0678f0 0x7f243c069db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24540af000 tx=0x7f245400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.158+0000 7f2458ff9640 1 -- 172.21.15.94:0/2449639091 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f244c00f230 con 0x7f245c1ea260 2024-09-11T23:17:07.230 INFO:tasks.ceph.mds.a.smithi094.stderr:2024-09-11T23:17:07.226+0000 7f37579b7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:17:07.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f245c09e330 con 0x7f245c1ea260 2024-09-11T23:17:07.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f2458ff9640 1 -- 172.21.15.94:0/2449639091 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f244c055d20 con 0x7f245c1ea260 2024-09-11T23:17:07.358 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:17:07.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f243c0678f0 msgr2=0x7f243c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f243c0678f0 0x7f243c069db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24540af000 tx=0x7f245400b040 comp rx=0 tx=0).stop 2024-09-11T23:17:07.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f245c1ea260 msgr2=0x7f245c154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f245c1ea260 0x7f245c154970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f245c15c680 tx=0x7f244c00d880 comp rx=0 tx=0).stop 2024-09-11T23:17:07.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 shutdown_connections 2024-09-11T23:17:07.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f243c0678f0 0x7f243c069db0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f245c1ea260 0x7f245c154970 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f245c152f80 0x7f245c072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 --2- 172.21.15.94:0/2449639091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24480039c0 0x7f245c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 >> 172.21.15.94:0/2449639091 conn(0x7f245c0b1f90 msgr2=0x7f245c1599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 shutdown_connections 2024-09-11T23:17:07.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07.354+0000 7f24627c6640 1 -- 172.21.15.94:0/2449639091 wait complete. 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:17:07.376 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:17:07.377 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:17:07.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:07.377 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:17:07.384 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42361sec preferred_lft 42361sec 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:17:07.387 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.387 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:17:07.387 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:07.387 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:17:07.387 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:07.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:07.387 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:17:07.435 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:17:07.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:07.436 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:17:07.484 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:17:07.485 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:17:07.485 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:17:07.485 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:17:07.485 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:17:07.485 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:17:07.485 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:17:07.485 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:17:07.485 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:17:07.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:17:07.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:17:07.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:07.606 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:17:07.611 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:17:07.611 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:17:07.612 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:17:07.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:07.612 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:17:07.667 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:17:07.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:17:07.667 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:07.713 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:17:07.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:17:07.714 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:07.761 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:17:07.823 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:17:07.872 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:07.873 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:07.874 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:07.874 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:07.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:07.874 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:17:07.922 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:17:07.922 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:17:07.967 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:17:07.982 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:17:08.030 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:17:08.031 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:08.032 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:08.033 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:08.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:08.034 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:17:08.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:17:08.042+0000 7f71c73ec580 -1 init, newargv = 0x55816907b320 newargc=15 2024-09-11T23:17:08.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[39570]: starting ceph client 2024-09-11T23:17:08.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[39570]: starting fuse 2024-09-11T23:17:09.153 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:17:09.168 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:17:09.215 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:17:09.216 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:09.217 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:09.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:09.218 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:17:09.265 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:17:09.266 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:17:09.266 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:17:09.267 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:17:09.268 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:17:09.268 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:17:09.268 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:09.268 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:17:09.268 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:17:09.390 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.39570.asok 2024-09-11T23:17:09.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:17:09.401 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39570.asok 2024-09-11T23:17:09.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:09.401 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39570.asok status 2024-09-11T23:17:09.560 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:17:09.560 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:17:09.560 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:17:09.561 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:17:09.561 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:17:09.561 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:17:09.561 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:17:09.561 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "39570", 2024-09-11T23:17:09.562 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:17:09.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:09.562 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:17:09.562 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:17:09.563 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5469, 2024-09-11T23:17:09.563 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:17:09.563 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:17:09.563 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:17:09.564 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 5469 2024-09-11T23:17:09.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:09.564 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:17:09.564 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:17:09.564 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:17:09.565 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2976096240 2024-09-11T23:17:09.565 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:09.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:09.565 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:17:09.566 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:17:09.566 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:17:09.566 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2976096240 2024-09-11T23:17:09.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:09.566 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.5469 192.168.0.1:0/2976096240", 2024-09-11T23:17:09.567 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/2976096240", 2024-09-11T23:17:09.567 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:17:09.567 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 24, 2024-09-11T23:17:09.567 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 51, 2024-09-11T23:17:09.568 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:17:09.568 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:17:09.568 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:17:09.568 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:17:09.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:09.574 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:17:09.575 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:09.581 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:17:09.581 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:09.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:09.582 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:09.636 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_fragment_size_max 50 2024-09-11T23:17:09.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8fa05640 1 Processor -- start 2024-09-11T23:17:09.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8fa05640 1 -- start start 2024-09-11T23:17:09.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8fa05640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 0x7fde880d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8fa05640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde880d2e90 0x7fde880cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8fa05640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde880d32b0 con 0x7fde880cf450 2024-09-11T23:17:09.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8fa05640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fde880d0300 con 0x7fde880d2e90 2024-09-11T23:17:09.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8fa05640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde8806e6c0 con 0x7fde88161a60 2024-09-11T23:17:09.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8dfa2640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fde880cf450 0x7fde880d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55176/0 (socket says 172.21.15.94:55176) 2024-09-11T23:17:09.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8dfa2640 1 -- 172.21.15.94:0/3856263040 learned_addr learned my addr 172.21.15.94:0/3856263040 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:09.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8d7a1640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 0x7fde880d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189977531 0 0) 0x7fde880d32b0 con 0x7fde880cf450 2024-09-11T23:17:09.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8cfa0640 1 --2- 172.21.15.94:0/3856263040 >> v2:172.21.15.155:3300/0 conn(0x7fde880d2e90 0x7fde880cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde74003530 con 0x7fde880cf450 2024-09-11T23:17:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3952197977 0 0) 0x7fde74003530 con 0x7fde880cf450 2024-09-11T23:17:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 msgr2=0x7fde880d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 0x7fde880d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 >> v2:172.21.15.155:3300/0 conn(0x7fde880d2e90 msgr2=0x7fde880cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 --2- 172.21.15.94:0/3856263040 >> v2:172.21.15.155:3300/0 conn(0x7fde880d2e90 0x7fde880cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde880b0f60 con 0x7fde880cf450 2024-09-11T23:17:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fde80001a00 con 0x7fde880cf450 2024-09-11T23:17:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 >> v1:172.21.15.94:6789/0 conn(0x7fde880cf450 legacy=0x7fde880d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 0x7fde740039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde74003f90 0x7fde74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde74004d50 0x7fde740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fde880d0300 con 0x7fde74003f90 2024-09-11T23:17:09.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde8806e6c0 con 0x7fde74004d50 2024-09-11T23:17:09.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde7400bb30 con 0x7fde88161a60 2024-09-11T23:17:09.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8cfa0640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde74003f90 0x7fde74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8d7a1640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 0x7fde740039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8dfa2640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde74004d50 0x7fde740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8cfa0640 1 -- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 msgr2=0x7fde740039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8cfa0640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde88161a60 0x7fde740039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8cfa0640 1 -- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde74004d50 msgr2=0x7fde740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8cfa0640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde74004d50 0x7fde740051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.806+0000 7fde8cfa0640 1 -- 172.21.15.94:0/3856263040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde74003530 con 0x7fde74003f90 2024-09-11T23:17:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8cfa0640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde74003f90 0x7fde74004810 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fde8400ba10 tx=0x7fde8401c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaec497bd1ea2cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8400b610 con 0x7fde74003f90 2024-09-11T23:17:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde840b1070 con 0x7fde74003f90 2024-09-11T23:17:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde7bfff640 1 -- 172.21.15.94:0/3856263040 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde880d1930 con 0x7fde74003f90 2024-09-11T23:17:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 -- 172.21.15.94:0/3856263040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde74003f90 msgr2=0x7fde74004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 --2- 172.21.15.94:0/3856263040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde74003f90 0x7fde74004810 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fde8400ba10 tx=0x7fde8401c690 comp rx=0 tx=0).stop 2024-09-11T23:17:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8dfa2640 1 -- 172.21.15.94:0/3856263040 reap_dead start 2024-09-11T23:17:09.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 -- 172.21.15.94:0/3856263040 shutdown_connections 2024-09-11T23:17:09.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 -- 172.21.15.94:0/3856263040 >> 172.21.15.94:0/3856263040 conn(0x7fde8808bf90 msgr2=0x7fde8809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:09.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 -- 172.21.15.94:0/3856263040 shutdown_connections 2024-09-11T23:17:09.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 -- 172.21.15.94:0/3856263040 wait complete. 2024-09-11T23:17:09.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 Processor -- start 2024-09-11T23:17:09.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.810+0000 7fde8fa05640 1 -- start start 2024-09-11T23:17:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde74003f90 0x7fde881559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde8815b440 0x7fde880b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880b7ed0 0x7fde8815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fde880cf8a0 con 0x7fde880b7ed0 2024-09-11T23:17:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde8806d190 con 0x7fde8815b440 2024-09-11T23:17:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde880cfa20 con 0x7fde74003f90 2024-09-11T23:17:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880b7ed0 0x7fde8815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880b7ed0 0x7fde8815dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55792/0 (socket says 172.21.15.94:55792) 2024-09-11T23:17:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 -- 172.21.15.94:0/589197300 learned_addr learned my addr 172.21.15.94:0/589197300 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8d7a1640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde74003f90 0x7fde881559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8cfa0640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde8815b440 0x7fde880b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 -- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde74003f90 msgr2=0x7fde881559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde74003f90 0x7fde881559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 -- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde8815b440 msgr2=0x7fde880b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde8815b440 0x7fde880b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 -- 172.21.15.94:0/589197300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8815b900 con 0x7fde880b7ed0 2024-09-11T23:17:09.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8cfa0640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde8815b440 0x7fde880b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:09.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8dfa2640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880b7ed0 0x7fde8815dff0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fde880d2370 tx=0x7fde8000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:09.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde79ffb640 1 -- 172.21.15.94:0/589197300 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8000de80 con 0x7fde880b7ed0 2024-09-11T23:17:09.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde79ffb640 1 -- 172.21.15.94:0/589197300 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8000bb20 con 0x7fde880b7ed0 2024-09-11T23:17:09.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde880b73f0 con 0x7fde880b7ed0 2024-09-11T23:17:09.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde79ffb640 1 -- 172.21.15.94:0/589197300 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80007110 con 0x7fde880b7ed0 2024-09-11T23:17:09.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde88168570 con 0x7fde880b7ed0 2024-09-11T23:17:09.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde880d3270 con 0x7fde880b7ed0 2024-09-11T23:17:09.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde79ffb640 1 -- 172.21.15.94:0/589197300 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fde8001b020 con 0x7fde880b7ed0 2024-09-11T23:17:09.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde79ffb640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fde6c0678f0 0x7fde6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde79ffb640 1 -- 172.21.15.94:0/589197300 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fde80085f00 con 0x7fde880b7ed0 2024-09-11T23:17:09.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.814+0000 7fde8d7a1640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fde6c0678f0 0x7fde6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.818+0000 7fde8d7a1640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fde6c0678f0 0x7fde6c069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde8815b370 tx=0x7fde7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:09.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.818+0000 7fde79ffb640 1 -- 172.21.15.94:0/589197300 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fde80056940 con 0x7fde880b7ed0 2024-09-11T23:17:09.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.982+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fde880b49f0 con 0x7fde880b7ed0 2024-09-11T23:17:09.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.986+0000 7fde79ffb640 1 -- 172.21.15.94:0/589197300 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v13)=0 v13) ==== 124+0+0 (secure 0 0 0) 0x7fde80056240 con 0x7fde880b7ed0 2024-09-11T23:17:09.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fde6c0678f0 msgr2=0x7fde6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fde6c0678f0 0x7fde6c069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde8815b370 tx=0x7fde7c008040 comp rx=0 tx=0).stop 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880b7ed0 msgr2=0x7fde8815dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880b7ed0 0x7fde8815dff0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fde880d2370 tx=0x7fde8000b4a0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 shutdown_connections 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fde6c0678f0 0x7fde6c069db0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880b7ed0 0x7fde8815dff0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde8815b440 0x7fde880b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 --2- 172.21.15.94:0/589197300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde74003f90 0x7fde881559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 >> 172.21.15.94:0/589197300 conn(0x7fde8808bf90 msgr2=0x7fde8815bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 shutdown_connections 2024-09-11T23:17:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:09.990+0000 7fde8fa05640 1 -- 172.21.15.94:0/589197300 wait complete. 2024-09-11T23:17:13.672 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:13.675 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:20.009 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:20.009 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> import uuid 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> n = 51 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = False 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> if 0 > 0: 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = True 2024-09-11T23:17:20.016 DEBUG:teuthology.orchestra.run.smithi094:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> dpath = os.path.dirname(path) 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> fnameprefix = os.path.basename(path) 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> os.makedirs(dpath, exist_ok=True) 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> try: 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> for i in range(n): 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> f.write(f"{i}") 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> f.flush() 2024-09-11T23:17:20.017 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(f.fileno()) 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> os.unlink(fpath) 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> if create_hard_links: 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> for j in range(0): 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> if True: 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> finally: 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> os.close(dirfd) 2024-09-11T23:17:20.018 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:17:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:Traceback (most recent call last): 2024-09-11T23:17:20.275 INFO:teuthology.orchestra.run.smithi094.stderr: File "", line 20, in 2024-09-11T23:17:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:OSError: [Errno 28] No space left on device: '/home/ubuntu/cephtest/mnt.0/subdir/file_50' 2024-09-11T23:17:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-09-11T23:17:20.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:17:20.287 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:17:20.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:17:20.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:17:20.434 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:17:20.434 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:17:20.434 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:20.434 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:20.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:17:20.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.610+0000 7f998b8aa640 1 Processor -- start 2024-09-11T23:17:20.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.610+0000 7f998b8aa640 1 -- start start 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f998b8aa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f99841587a0 0x7f99840b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f998b8aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99840b37d0 0x7f998406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f998b8aa640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f998406e4b0 0x7f9984161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f998b8aa640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f998406f870 con 0x7f998406e4b0 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f998b8aa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f99840b3c10 con 0x7f99841587a0 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f998b8aa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f998406ec60 con 0x7f99840b37d0 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f998406e4b0 0x7f9984161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:20.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f998406e4b0 0x7f9984161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54020/0 (socket says 172.21.15.94:54020) 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 -- 172.21.15.94:0/731552429 learned_addr learned my addr 172.21.15.94:0/731552429 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9988e45640 1 --2- 172.21.15.94:0/731552429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99840b37d0 0x7f998406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989646640 1 --2- 172.21.15.94:0/731552429 >> v2:172.21.15.155:3300/0 conn(0x7f99841587a0 0x7f99840b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 -- 172.21.15.94:0/731552429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99840b37d0 msgr2=0x7f998406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 --2- 172.21.15.94:0/731552429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99840b37d0 0x7f998406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 -- 172.21.15.94:0/731552429 >> v2:172.21.15.155:3300/0 conn(0x7f99841587a0 msgr2=0x7f99840b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 --2- 172.21.15.94:0/731552429 >> v2:172.21.15.155:3300/0 conn(0x7f99841587a0 0x7f99840b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 -- 172.21.15.94:0/731552429 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998406ef40 con 0x7f998406e4b0 2024-09-11T23:17:20.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9989e47640 1 --2- 172.21.15.94:0/731552429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f998406e4b0 0x7f9984161e50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9984071710 tx=0x7f997c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6a188fad3d88d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:20.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9983fff640 1 -- 172.21.15.94:0/731552429 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c0b0070 con 0x7f998406e4b0 2024-09-11T23:17:20.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9983fff640 1 -- 172.21.15.94:0/731552429 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c0ab600 con 0x7f998406e4b0 2024-09-11T23:17:20.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.614+0000 7f9983fff640 1 -- 172.21.15.94:0/731552429 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c0ab9d0 con 0x7f998406e4b0 2024-09-11T23:17:20.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- 172.21.15.94:0/731552429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f998406e4b0 msgr2=0x7f9984161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 --2- 172.21.15.94:0/731552429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f998406e4b0 0x7f9984161e50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9984071710 tx=0x7f997c01c230 comp rx=0 tx=0).stop 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- 172.21.15.94:0/731552429 shutdown_connections 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 --2- 172.21.15.94:0/731552429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f998406e4b0 0x7f9984161e50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 --2- 172.21.15.94:0/731552429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99840b37d0 0x7f998406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 --2- 172.21.15.94:0/731552429 >> v2:172.21.15.155:3300/0 conn(0x7f99841587a0 0x7f99840b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- 172.21.15.94:0/731552429 >> 172.21.15.94:0/731552429 conn(0x7f99840b1f90 msgr2=0x7f99840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- 172.21.15.94:0/731552429 shutdown_connections 2024-09-11T23:17:20.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- 172.21.15.94:0/731552429 wait complete. 2024-09-11T23:17:20.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 Processor -- start 2024-09-11T23:17:20.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- start start 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998406e4b0 0x7f99840b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99840b37d0 0x7f9984099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99841587a0 0x7f9984146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9984158b80 con 0x7f99840b37d0 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9984072160 con 0x7f998406e4b0 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9984147c90 con 0x7f99841587a0 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99840b37d0 0x7f9984099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:20.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99840b37d0 0x7f9984099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54032/0 (socket says 172.21.15.94:54032) 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 -- 172.21.15.94:0/2804384996 learned_addr learned my addr 172.21.15.94:0/2804384996 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9989e47640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99841587a0 0x7f9984146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9989646640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998406e4b0 0x7f99840b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 -- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99841587a0 msgr2=0x7f9984146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99841587a0 0x7f9984146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 -- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998406e4b0 msgr2=0x7f99840b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998406e4b0 0x7f99840b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 -- 172.21.15.94:0/2804384996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998414d170 con 0x7f99840b37d0 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9988e45640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99840b37d0 0x7f9984099a20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f997800d800 tx=0x7f997800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9981ffb640 1 -- 172.21.15.94:0/2804384996 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978018020 con 0x7f99840b37d0 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9981ffb640 1 -- 172.21.15.94:0/2804384996 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99780096a0 con 0x7f99840b37d0 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f9981ffb640 1 -- 172.21.15.94:0/2804384996 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978009a50 con 0x7f99840b37d0 2024-09-11T23:17:20.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99841510b0 con 0x7f99840b37d0 2024-09-11T23:17:20.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.618+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9984156780 con 0x7f99840b37d0 2024-09-11T23:17:20.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.622+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99841583b0 con 0x7f99840b37d0 2024-09-11T23:17:20.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.622+0000 7f9981ffb640 1 -- 172.21.15.94:0/2804384996 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f997801b020 con 0x7f99840b37d0 2024-09-11T23:17:20.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.622+0000 7f9981ffb640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f99700678c0 0x7f9970069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:20.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.622+0000 7f9981ffb640 1 -- 172.21.15.94:0/2804384996 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f9978086300 con 0x7f99840b37d0 2024-09-11T23:17:20.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.622+0000 7f9989646640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f99700678c0 0x7f9970069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:20.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.622+0000 7f9989646640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f99700678c0 0x7f9970069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9974003fd0 tx=0x7f99740039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:20.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.626+0000 7f9981ffb640 1 -- 172.21.15.94:0/2804384996 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9978022020 con 0x7f99840b37d0 2024-09-11T23:17:20.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9984070080 con 0x7f99840b37d0 2024-09-11T23:17:20.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f9981ffb640 1 -- 172.21.15.94:0/2804384996 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7f998414d170 con 0x7f99840b37d0 2024-09-11T23:17:20.802 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:17:20.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f99700678c0 msgr2=0x7f9970069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f99700678c0 0x7f9970069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9974003fd0 tx=0x7f99740039a0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99840b37d0 msgr2=0x7f9984099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99840b37d0 0x7f9984099a20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f997800d800 tx=0x7f997800dcc0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 shutdown_connections 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99841587a0 0x7f9984146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f99700678c0 0x7f9970069d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99840b37d0 0x7f9984099a20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 --2- 172.21.15.94:0/2804384996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998406e4b0 0x7f99840b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 >> 172.21.15.94:0/2804384996 conn(0x7f99840b1f90 msgr2=0x7f99841551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 shutdown_connections 2024-09-11T23:17:20.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:20.802+0000 7f998b8aa640 1 -- 172.21.15.94:0/2804384996 wait complete. 2024-09-11T23:17:20.821 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:17:20.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:20.821 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:20.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[39570]: fuse finished with error 0 and tester_r 0 2024-09-11T23:17:20.833 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:17:20.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:20.834 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:17:20.995 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:17:20.996 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:17:20.996 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:21.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:17:21.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:17:21.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:21.002 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:17:21.049 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T23:17:21.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:17:21.050 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:17:21.051 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:21.051 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:21.056 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:17:21.056 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:17:21.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:21.056 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:17:21.105 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T23:17:21.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:17:21.106 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:17:21.106 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:17:21.106 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:21.113 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:17:21.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:17:21.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:21.113 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:17:21.161 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T23:17:21.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:17:21.162 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607ee20640 1 Processor -- start 2024-09-11T23:17:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607ee20640 1 -- start start 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607ee20640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 0x7f60780ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607ee20640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60780cd520 con 0x7f607815c0c0 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607ee20640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60780cd800 con 0x7f60780b5880 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607ee20640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60780cdae0 con 0x7f607806d3e0 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607cbbc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f607815c0c0 0x7f607815c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36120/0 (socket says 172.21.15.94:36120) 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607cbbc640 1 -- 172.21.15.94:0/1722047004 learned_addr learned my addr 172.21.15.94:0/1722047004 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607d3bd640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 0x7f60780ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360250177 0 0) 0x7f60780cd520 con 0x7f607815c0c0 2024-09-11T23:17:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6060003530 con 0x7f607815c0c0 2024-09-11T23:17:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3320721136 0 0) 0x7f6060003530 con 0x7f607815c0c0 2024-09-11T23:17:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 msgr2=0x7f60780ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 0x7f60780ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 >> v1:172.21.15.155:6789/0 conn(0x7f60780b5880 legacy=0x7f607806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60780cddc0 con 0x7f607815c0c0 2024-09-11T23:17:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f6070001a00 con 0x7f607815c0c0 2024-09-11T23:17:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 >> v1:172.21.15.94:6789/0 conn(0x7f607815c0c0 legacy=0x7f607815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 0x7f60600039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6060003f70 0x7f6060004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6060004d50 0x7f60600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f60780cdae0 con 0x7f6060004d50 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f606000fec0 con 0x7f6060003f70 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60600100c0 con 0x7f607806d3e0 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607d3bd640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6060004d50 0x7f60600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607cbbc640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 0x7f60600039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f6077fff640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6060003f70 0x7f6060004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607d3bd640 1 -- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 msgr2=0x7f60600039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607d3bd640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 0x7f60600039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607d3bd640 1 -- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6060003f70 msgr2=0x7f6060004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607d3bd640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6060003f70 0x7f6060004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607d3bd640 1 -- 172.21.15.94:0/1722047004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6060003530 con 0x7f6060004d50 2024-09-11T23:17:21.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.294+0000 7f607cbbc640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f607806d3e0 0x7f60600039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607d3bd640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6060004d50 0x7f60600051d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6068009ae0 tx=0x7f606801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45222ef4f9ea3f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680b2070 con 0x7f6060004d50 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60680a5660 con 0x7f6060004d50 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f60777fe640 1 -- 172.21.15.94:0/1722047004 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680096b0 con 0x7f6060004d50 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 -- 172.21.15.94:0/1722047004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6060004d50 msgr2=0x7f60600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 --2- 172.21.15.94:0/1722047004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6060004d50 0x7f60600051d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6068009ae0 tx=0x7f606801ca70 comp rx=0 tx=0).stop 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607d3bd640 1 -- 172.21.15.94:0/1722047004 reap_dead start 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 -- 172.21.15.94:0/1722047004 shutdown_connections 2024-09-11T23:17:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 -- 172.21.15.94:0/1722047004 >> 172.21.15.94:0/1722047004 conn(0x7f6078072670 msgr2=0x7f6078072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 -- 172.21.15.94:0/1722047004 shutdown_connections 2024-09-11T23:17:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 -- 172.21.15.94:0/1722047004 wait complete. 2024-09-11T23:17:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 Processor -- start 2024-09-11T23:17:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.298+0000 7f607ee20640 1 -- start start 2024-09-11T23:17:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60781482d0 0x7f60780a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60781486b0 0x7f6078156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f607815b000 0x7f607815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f60780b4b20 con 0x7f60781482d0 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f607815cbb0 con 0x7f607815b000 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60780b3aa0 con 0x7f60781486b0 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60781482d0 0x7f60780a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60781482d0 0x7f60780a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54048/0 (socket says 172.21.15.94:54048) 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 -- 172.21.15.94:0/3825100092 learned_addr learned my addr 172.21.15.94:0/3825100092 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607d3bd640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f607815b000 0x7f607815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f6077fff640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60781486b0 0x7f6078156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 -- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60781486b0 msgr2=0x7f6078156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60781486b0 0x7f6078156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 -- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f607815b000 msgr2=0x7f607815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f607815b000 0x7f607815b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 -- 172.21.15.94:0/3825100092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607815ea70 con 0x7f60781482d0 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607cbbc640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60781482d0 0x7f60780a9540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6070001b60 tx=0x7f607000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f60757fa640 1 -- 172.21.15.94:0/3825100092 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070019070 con 0x7f60781482d0 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f60757fa640 1 -- 172.21.15.94:0/3825100092 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60700072d0 con 0x7f60781482d0 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607815ed50 con 0x7f60781482d0 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f60757fa640 1 -- 172.21.15.94:0/3825100092 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60700076c0 con 0x7f60781482d0 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607815e760 con 0x7f60781482d0 2024-09-11T23:17:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60780cd480 con 0x7f60781482d0 2024-09-11T23:17:21.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f60757fa640 1 -- 172.21.15.94:0/3825100092 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f607001c070 con 0x7f60781482d0 2024-09-11T23:17:21.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f60757fa640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f60640678c0 0x7f6064069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f60757fa640 1 -- 172.21.15.94:0/3825100092 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f6070086b30 con 0x7f60781482d0 2024-09-11T23:17:21.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.302+0000 7f6077fff640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f60640678c0 0x7f6064069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.306+0000 7f6077fff640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f60640678c0 0x7f6064069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6078148ab0 tx=0x7f606c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.306+0000 7f60757fa640 1 -- 172.21.15.94:0/3825100092 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6070056f70 con 0x7f60781482d0 2024-09-11T23:17:21.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60780b48b0 con 0x7f60781482d0 2024-09-11T23:17:21.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f60757fa640 1 -- 172.21.15.94:0/3825100092 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7f607005b270 con 0x7f60781482d0 2024-09-11T23:17:21.498 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:21.498 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"btime":"2024-09-11T23:17:04:322465+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2442107241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2442107241},{"type":"v1","addr":"172.21.15.155:6837","nonce":2442107241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1638163040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1638163040},{"type":"v1","addr":"172.21.15.155:6836","nonce":1638163040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2826826443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2826826443},{"type":"v1","addr":"172.21.15.94:6833","nonce":2826826443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:00.676836+0000","modified":"2024-09-11T23:17:03.687833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2087871065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2087871065},{"type":"v1","addr":"172.21.15.94:6835","nonce":2087871065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-11T23:17:21.499 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 24 2024-09-11T23:17:21.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f60640678c0 msgr2=0x7f6064069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f60640678c0 0x7f6064069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6078148ab0 tx=0x7f606c009040 comp rx=0 tx=0).stop 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60781482d0 msgr2=0x7f60780a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60781482d0 0x7f60780a9540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6070001b60 tx=0x7f607000b560 comp rx=0 tx=0).stop 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 shutdown_connections 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f607815b000 0x7f607815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60781486b0 0x7f6078156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f60640678c0 0x7f6064069d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 --2- 172.21.15.94:0/3825100092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60781482d0 0x7f60780a9540 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 >> 172.21.15.94:0/3825100092 conn(0x7f6078072670 msgr2=0x7f60780ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 shutdown_connections 2024-09-11T23:17:21.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.498+0000 7f607ee20640 1 -- 172.21.15.94:0/3825100092 wait complete. 2024-09-11T23:17:21.516 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:21.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1efb7d640 1 Processor -- start 2024-09-11T23:17:21.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1efb7d640 1 -- start start 2024-09-11T23:17:21.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1efb7d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1e8161a60 0x7fa1e80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1efb7d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 0x7fa1e806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1efb7d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e80d32b0 con 0x7fa1e80d2e90 2024-09-11T23:17:21.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1efb7d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e80d0300 con 0x7fa1e8161a60 2024-09-11T23:17:21.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1efb7d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80cfab0 con 0x7fa1e80cf620 2024-09-11T23:17:21.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa1e80d2e90 0x7fa1e80cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36126/0 (socket says 172.21.15.94:36126) 2024-09-11T23:17:21.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 -- 172.21.15.94:0/1543888082 learned_addr learned my addr 172.21.15.94:0/1543888082 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ee11a640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 0x7fa1e806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed919640 1 --2- 172.21.15.94:0/1543888082 >> v2:172.21.15.155:3300/0 conn(0x7fa1e8161a60 0x7fa1e80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515131167 0 0) 0x7fa1e80d32b0 con 0x7fa1e80d2e90 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d8003530 con 0x7fa1e80d2e90 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3607897725 0 0) 0x7fa1d8003530 con 0x7fa1e80d2e90 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 msgr2=0x7fa1e806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 0x7fa1e806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 >> v2:172.21.15.155:3300/0 conn(0x7fa1e8161a60 msgr2=0x7fa1e80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 --2- 172.21.15.94:0/1543888082 >> v2:172.21.15.155:3300/0 conn(0x7fa1e8161a60 0x7fa1e80d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80b0f60 con 0x7fa1e80d2e90 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fa1dc001a00 con 0x7fa1e80d2e90 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 >> v1:172.21.15.94:6789/0 conn(0x7fa1e80d2e90 legacy=0x7fa1e80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d80039c0 0x7fa1d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d8004810 0x7fa1d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 0x7fa1d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80d0300 con 0x7fa1d8004810 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80cfab0 con 0x7fa1d80039c0 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d800b9d0 con 0x7fa1e80cf620 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d8004810 0x7fa1d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed919640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d80039c0 0x7fa1d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ee11a640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 0x7fa1d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 -- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 msgr2=0x7fa1d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1e80cf620 0x7fa1d80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 -- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d80039c0 msgr2=0x7fa1d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d80039c0 0x7fa1d8003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.630+0000 7fa1ed118640 1 -- 172.21.15.94:0/1543888082 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d8003530 con 0x7fa1d8004810 2024-09-11T23:17:21.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1ed118640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d8004810 0x7fa1d8004c90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00a890 tx=0x7fa1dc01d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e684fd4cb1335a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00a4e0 con 0x7fa1d8004810 2024-09-11T23:17:21.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1dc0ad430 con 0x7fa1d8004810 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1ec917640 1 -- 172.21.15.94:0/1543888082 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0ad800 con 0x7fa1d8004810 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 -- 172.21.15.94:0/1543888082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d8004810 msgr2=0x7fa1d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 --2- 172.21.15.94:0/1543888082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d8004810 0x7fa1d8004c90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00a890 tx=0x7fa1dc01d370 comp rx=0 tx=0).stop 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1ee11a640 1 -- 172.21.15.94:0/1543888082 reap_dead start 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 -- 172.21.15.94:0/1543888082 shutdown_connections 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 -- 172.21.15.94:0/1543888082 >> 172.21.15.94:0/1543888082 conn(0x7fa1e808bf90 msgr2=0x7fa1e809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 -- 172.21.15.94:0/1543888082 shutdown_connections 2024-09-11T23:17:21.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 -- 172.21.15.94:0/1543888082 wait complete. 2024-09-11T23:17:21.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 Processor -- start 2024-09-11T23:17:21.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.634+0000 7fa1efb7d640 1 -- start start 2024-09-11T23:17:21.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1d8004810 0x7fa1e8152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1e81fac30 0x7fa1e80ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e80b4b70 0x7fa1e8152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e806dec0 con 0x7fa1e80b4b70 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e806d190 con 0x7fa1e81fac30 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e806e040 con 0x7fa1d8004810 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e80b4b70 0x7fa1e8152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e80b4b70 0x7fa1e8152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54066/0 (socket says 172.21.15.94:54066) 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 -- 172.21.15.94:0/3998552842 learned_addr learned my addr 172.21.15.94:0/3998552842 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ed919640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1d8004810 0x7fa1e8152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ed118640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1e81fac30 0x7fa1e80ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 -- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1d8004810 msgr2=0x7fa1e8152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1d8004810 0x7fa1e8152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 -- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1e81fac30 msgr2=0x7fa1e80ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1e81fac30 0x7fa1e80ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 -- 172.21.15.94:0/3998552842 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e81fb0b0 con 0x7fa1e80b4b70 2024-09-11T23:17:21.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ee11a640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e80b4b70 0x7fa1e8152130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa1e808dd40 tx=0x7fa1e0010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1e67fc640 1 -- 172.21.15.94:0/3998552842 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000f040 con 0x7fa1e80b4b70 2024-09-11T23:17:21.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1e67fc640 1 -- 172.21.15.94:0/3998552842 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e000e8a0 con 0x7fa1e80b4b70 2024-09-11T23:17:21.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e80b72d0 con 0x7fa1e80b4b70 2024-09-11T23:17:21.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1e67fc640 1 -- 172.21.15.94:0/3998552842 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000ec90 con 0x7fa1e80b4b70 2024-09-11T23:17:21.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e80caaf0 con 0x7fa1e80b4b70 2024-09-11T23:17:21.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e806e400 con 0x7fa1e80b4b70 2024-09-11T23:17:21.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1e67fc640 1 -- 172.21.15.94:0/3998552842 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1e001c400 con 0x7fa1e80b4b70 2024-09-11T23:17:21.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1e67fc640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1cc0678f0 0x7fa1cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1e67fc640 1 -- 172.21.15.94:0/3998552842 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fa1e00860a0 con 0x7fa1e80b4b70 2024-09-11T23:17:21.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ed919640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1cc0678f0 0x7fa1cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.638+0000 7fa1ed919640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1cc0678f0 0x7fa1cc069db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1e815ba10 tx=0x7fa1d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.642+0000 7fa1e67fc640 1 -- 172.21.15.94:0/3998552842 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa1e0018030 con 0x7fa1e80b4b70 2024-09-11T23:17:21.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1e80b43f0 con 0x7fa1e80b4b70 2024-09-11T23:17:21.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1e67fc640 1 -- 172.21.15.94:0/3998552842 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7fa1e0056490 con 0x7fa1e80b4b70 2024-09-11T23:17:21.842 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:21.842 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"btime":"2024-09-11T23:17:04:322465+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2442107241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2442107241},{"type":"v1","addr":"172.21.15.155:6837","nonce":2442107241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1638163040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1638163040},{"type":"v1","addr":"172.21.15.155:6836","nonce":1638163040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2826826443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2826826443},{"type":"v1","addr":"172.21.15.94:6833","nonce":2826826443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:00.676836+0000","modified":"2024-09-11T23:17:03.687833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2087871065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2087871065},{"type":"v1","addr":"172.21.15.94:6835","nonce":2087871065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-11T23:17:21.842 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 24 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1cc0678f0 msgr2=0x7fa1cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1cc0678f0 0x7fa1cc069db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1e815ba10 tx=0x7fa1d4008040 comp rx=0 tx=0).stop 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e80b4b70 msgr2=0x7fa1e8152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e80b4b70 0x7fa1e8152130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa1e808dd40 tx=0x7fa1e0010c20 comp rx=0 tx=0).stop 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 shutdown_connections 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1cc0678f0 0x7fa1cc069db0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e80b4b70 0x7fa1e8152130 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1e81fac30 0x7fa1e80ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 --2- 172.21.15.94:0/3998552842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1d8004810 0x7fa1e8152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 >> 172.21.15.94:0/3998552842 conn(0x7fa1e808bf90 msgr2=0x7fa1e80d3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 shutdown_connections 2024-09-11T23:17:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.842+0000 7fa1efb7d640 1 -- 172.21.15.94:0/3998552842 wait complete. 2024-09-11T23:17:21.861 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:21.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5c950640 1 Processor -- start 2024-09-11T23:17:21.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5c950640 1 -- start start 2024-09-11T23:17:21.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5c950640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3c5815bec0 0x7f3c580ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5c950640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 0x7f3c580aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5c950640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c580b3290 con 0x7f3c580af2a0 2024-09-11T23:17:21.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5c950640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f3c580b3570 con 0x7f3c5815bec0 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5c950640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c580b3850 con 0x7f3c5815c2a0 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3c5815bec0 0x7f3c580ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3c5815bec0 0x7f3c580ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54068/0 (socket says 172.21.15.94:54068) 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5659c640 1 -- 172.21.15.94:0/2747136976 learned_addr learned my addr 172.21.15.94:0/2747136976 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c55d9b640 1 --2- 172.21.15.94:0/2747136976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 0x7f3c580aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5659c640 1 -- 172.21.15.94:0/2747136976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 msgr2=0x7f3c580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5659c640 1 --2- 172.21.15.94:0/2747136976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 0x7f3c580aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5659c640 1 -- 172.21.15.94:0/2747136976 >> v1:172.21.15.94:6789/0 conn(0x7f3c580af2a0 legacy=0x7f3c5815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5659c640 1 -- 172.21.15.94:0/2747136976 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c580b3b30 con 0x7f3c5815bec0 2024-09-11T23:17:21.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.978+0000 7f3c5559a640 1 -- 172.21.15.94:0/2747136976 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431077232 0 0) 0x7f3c580b3290 con 0x7f3c580af2a0 2024-09-11T23:17:21.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5659c640 1 --2- 172.21.15.94:0/2747136976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c580ad200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009870 tx=0x7f3c4801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78acbb07c5a4ec57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5559a640 1 -- 172.21.15.94:0/2747136976 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c480a95f0 con 0x7f3c5815bec0 2024-09-11T23:17:21.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5559a640 1 -- 172.21.15.94:0/2747136976 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c480a9790 con 0x7f3c5815bec0 2024-09-11T23:17:21.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5559a640 1 -- 172.21.15.94:0/2747136976 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c480a9b60 con 0x7f3c5815bec0 2024-09-11T23:17:21.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 -- 172.21.15.94:0/2747136976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 msgr2=0x7f3c580ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 --2- 172.21.15.94:0/2747136976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c580ad200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009870 tx=0x7f3c4801c530 comp rx=0 tx=0).stop 2024-09-11T23:17:21.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 -- 172.21.15.94:0/2747136976 shutdown_connections 2024-09-11T23:17:21.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 --2- 172.21.15.94:0/2747136976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 0x7f3c580aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 --2- 172.21.15.94:0/2747136976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c580ad200 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 -- 172.21.15.94:0/2747136976 >> 172.21.15.94:0/2747136976 conn(0x7f3c580b1f90 msgr2=0x7f3c580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:21.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 -- 172.21.15.94:0/2747136976 shutdown_connections 2024-09-11T23:17:21.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.982+0000 7f3c5c950640 1 -- 172.21.15.94:0/2747136976 wait complete. 2024-09-11T23:17:21.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 Processor -- start 2024-09-11T23:17:21.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 -- start start 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c580af2a0 0x7f3c58149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c5814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 0x7f3c5814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3c580af6f0 con 0x7f3c5815bec0 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c580ad740 con 0x7f3c580af2a0 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c58169000 con 0x7f3c5815c2a0 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c5814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c5814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54078/0 (socket says 172.21.15.94:54078) 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 -- 172.21.15.94:0/1235086585 learned_addr learned my addr 172.21.15.94:0/1235086585 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 -- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 msgr2=0x7f3c5814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 0x7f3c5814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 -- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c580af2a0 msgr2=0x7f3c58149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c580af2a0 0x7f3c58149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 -- 172.21.15.94:0/1235086585 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5814e310 con 0x7f3c5815bec0 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c55d9b640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c5814f3b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00d5f0 tx=0x7f3c4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c46ffd640 1 -- 172.21.15.94:0/1235086585 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0125f0 con 0x7f3c5815bec0 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c46ffd640 1 -- 172.21.15.94:0/1235086585 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c019070 con 0x7f3c5815bec0 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5814e5f0 con 0x7f3c5815bec0 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c46ffd640 1 -- 172.21.15.94:0/1235086585 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0129b0 con 0x7f3c5815bec0 2024-09-11T23:17:21.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5814ebb0 con 0x7f3c5815bec0 2024-09-11T23:17:21.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c580ad200 con 0x7f3c5815bec0 2024-09-11T23:17:21.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c46ffd640 1 -- 172.21.15.94:0/1235086585 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c4c012b50 con 0x7f3c5815bec0 2024-09-11T23:17:21.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c46ffd640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3c380678c0 0x7f3c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.986+0000 7f3c46ffd640 1 -- 172.21.15.94:0/1235086585 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f3c4c0861d0 con 0x7f3c5815bec0 2024-09-11T23:17:21.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.990+0000 7f3c5659c640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3c380678c0 0x7f3c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.990+0000 7f3c5659c640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3c380678c0 0x7f3c38069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c480ae000 tx=0x7f3c480b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:21.994+0000 7f3c46ffd640 1 -- 172.21.15.94:0/1235086585 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3c4c056c10 con 0x7f3c5815bec0 2024-09-11T23:17:22.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.142+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c5806fcd0 con 0x7f3c5815bec0 2024-09-11T23:17:22.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c46ffd640 1 -- 172.21.15.94:0/1235086585 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17026 (secure 0 0 0) 0x7f3c4c056510 con 0x7f3c5815bec0 2024-09-11T23:17:22.147 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":51,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:02.251694+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:59.244408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:59.671966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:22.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3c380678c0 msgr2=0x7f3c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3c380678c0 0x7f3c38069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c480ae000 tx=0x7f3c480b3040 comp rx=0 tx=0).stop 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 msgr2=0x7f3c5814f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c5814f3b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00d5f0 tx=0x7f3c4c00dab0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 shutdown_connections 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5815c2a0 0x7f3c5814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3c380678c0 0x7f3c38069d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5815bec0 0x7f3c5814f3b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 --2- 172.21.15.94:0/1235086585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c580af2a0 0x7f3c58149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 >> 172.21.15.94:0/1235086585 conn(0x7f3c580b1f90 msgr2=0x7f3c580b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 shutdown_connections 2024-09-11T23:17:22.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.146+0000 7f3c5c950640 1 -- 172.21.15.94:0/1235086585 wait complete. 2024-09-11T23:17:22.164 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:17:22.164 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:22.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f5854c4f640 1 Processor -- start 2024-09-11T23:17:22.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f5854c4f640 1 -- start start 2024-09-11T23:17:22.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f5854c4f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 0x7f585015f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f5854c4f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58500b0770 con 0x7f5850072dd0 2024-09-11T23:17:22.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f5854c4f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58500b0a50 con 0x7f585015e3e0 2024-09-11T23:17:22.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f5854c4f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f585015eb10 con 0x7f58500b3a10 2024-09-11T23:17:22.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584dd9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5850072dd0 0x7f58500b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36146/0 (socket says 172.21.15.94:36146) 2024-09-11T23:17:22.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584dd9b640 1 -- 172.21.15.94:0/77684676 learned_addr learned my addr 172.21.15.94:0/77684676 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584ed9d640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 0x7f585015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853635855 0 0) 0x7f58500b0770 con 0x7f5850072dd0 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5838003530 con 0x7f5850072dd0 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 721173692 0 0) 0x7f5838003530 con 0x7f5850072dd0 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 msgr2=0x7f585015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 0x7f585015f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 >> v1:172.21.15.155:6789/0 conn(0x7f585015e3e0 legacy=0x7f58500aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585015edf0 con 0x7f5850072dd0 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f58400016a0 con 0x7f5850072dd0 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 >> v1:172.21.15.94:6789/0 conn(0x7f5850072dd0 legacy=0x7f58500b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f5838003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 0x7f5838004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5838004d50 0x7f58380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f585015eb10 con 0x7f58380039f0 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f583800bc10 con 0x7f5838004d50 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f583800be10 con 0x7f58500b3a10 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584e59c640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f5838003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584dd9b640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 0x7f5838004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584e59c640 1 -- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 msgr2=0x7f5838004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584e59c640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58500b3a10 0x7f5838004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584e59c640 1 -- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5838004d50 msgr2=0x7f58380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584e59c640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5838004d50 0x7f58380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.282+0000 7f584e59c640 1 -- 172.21.15.94:0/77684676 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5838003530 con 0x7f58380039f0 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584e59c640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f5838003e10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5844001780 tx=0x7f584401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41de9085ee8827f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440013a0 con 0x7f58380039f0 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58440052f0 con 0x7f58380039f0 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584d59a640 1 -- 172.21.15.94:0/77684676 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844003840 con 0x7f58380039f0 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- 172.21.15.94:0/77684676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 msgr2=0x7f5838003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 --2- 172.21.15.94:0/77684676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f5838003e10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5844001780 tx=0x7f584401c420 comp rx=0 tx=0).stop 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584ed9d640 1 -- 172.21.15.94:0/77684676 reap_dead start 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- 172.21.15.94:0/77684676 shutdown_connections 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- 172.21.15.94:0/77684676 >> 172.21.15.94:0/77684676 conn(0x7f58500b6870 msgr2=0x7f58500b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:22.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- 172.21.15.94:0/77684676 shutdown_connections 2024-09-11T23:17:22.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- 172.21.15.94:0/77684676 wait complete. 2024-09-11T23:17:22.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 Processor -- start 2024-09-11T23:17:22.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- start start 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f58501567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58501577d0 0x7f5850156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5850157220 0x7f58501f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5850162a00 con 0x7f58380039f0 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5850162880 con 0x7f58501577d0 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f5854c4f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5850169f90 con 0x7f5850157220 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f58501567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f58501567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54102/0 (socket says 172.21.15.94:54102) 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584e59c640 1 -- 172.21.15.94:0/2324744570 learned_addr learned my addr 172.21.15.94:0/2324744570 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:22.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584ed9d640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5850157220 0x7f58501f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.286+0000 7f584dd9b640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58501577d0 0x7f5850156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584e59c640 1 -- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5850157220 msgr2=0x7f58501f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584e59c640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5850157220 0x7f58501f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584e59c640 1 -- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58501577d0 msgr2=0x7f5850156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584e59c640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58501577d0 0x7f5850156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584e59c640 1 -- 172.21.15.94:0/2324744570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5850157d40 con 0x7f58380039f0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584ed9d640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5850157220 0x7f58501f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584dd9b640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58501577d0 0x7f5850156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584e59c640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f58501567a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5844001780 tx=0x7f5838005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f583effd640 1 -- 172.21.15.94:0/2324744570 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844007a40 con 0x7f58380039f0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f583effd640 1 -- 172.21.15.94:0/2324744570 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58440bb070 con 0x7f58380039f0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5850158020 con 0x7f58380039f0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f583effd640 1 -- 172.21.15.94:0/2324744570 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844000ee0 con 0x7f58380039f0 2024-09-11T23:17:22.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501585e0 con 0x7f58380039f0 2024-09-11T23:17:22.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58500734a0 con 0x7f58380039f0 2024-09-11T23:17:22.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f583effd640 1 -- 172.21.15.94:0/2324744570 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58440b4040 con 0x7f58380039f0 2024-09-11T23:17:22.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f583effd640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5830067a60 0x7f5830069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f583effd640 1 -- 172.21.15.94:0/2324744570 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f584411fc20 con 0x7f58380039f0 2024-09-11T23:17:22.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584dd9b640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5830067a60 0x7f5830069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.290+0000 7f584dd9b640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5830067a60 0x7f5830069f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58400011f0 tx=0x7f5840009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.294+0000 7f583effd640 1 -- 172.21.15.94:0/2324744570 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5844016130 con 0x7f58380039f0 2024-09-11T23:17:22.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.490+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58500b3280 con 0x7f58380039f0 2024-09-11T23:17:22.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f583effd640 1 -- 172.21.15.94:0/2324744570 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7f58440f0670 con 0x7f58380039f0 2024-09-11T23:17:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:22.494 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"btime":"2024-09-11T23:17:04:322465+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2442107241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2442107241},{"type":"v1","addr":"172.21.15.155:6837","nonce":2442107241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1638163040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1638163040},{"type":"v1","addr":"172.21.15.155:6836","nonce":1638163040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2826826443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2826826443},{"type":"v1","addr":"172.21.15.94:6833","nonce":2826826443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:00.676836+0000","modified":"2024-09-11T23:17:03.687833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2087871065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2087871065},{"type":"v1","addr":"172.21.15.94:6835","nonce":2087871065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-11T23:17:22.494 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 24 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5830067a60 msgr2=0x7f5830069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5830067a60 0x7f5830069f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58400011f0 tx=0x7f5840009040 comp rx=0 tx=0).stop 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 msgr2=0x7f58501567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f58501567a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5844001780 tx=0x7f5838005840 comp rx=0 tx=0).stop 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 shutdown_connections 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5850157220 0x7f58501f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58501577d0 0x7f5850156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5830067a60 0x7f5830069f20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 --2- 172.21.15.94:0/2324744570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58380039f0 0x7f58501567a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 >> 172.21.15.94:0/2324744570 conn(0x7f58500b6870 msgr2=0x7f5850074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:22.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 shutdown_connections 2024-09-11T23:17:22.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.494+0000 7f5854c4f640 1 -- 172.21.15.94:0/2324744570 wait complete. 2024-09-11T23:17:22.512 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:22.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdfa14b640 1 Processor -- start 2024-09-11T23:17:22.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdfa14b640 1 -- start start 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdfa14b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf406c3d0 0x7efdf40b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdfa14b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efdf40b4020 0x7efdf40aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdfa14b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf4147f20 con 0x7efdf4147b40 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdfa14b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7efdf40b60f0 con 0x7efdf40b4020 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdfa14b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40ae1a0 con 0x7efdf406c3d0 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf37fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7efdf4147b40 0x7efdf406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36154/0 (socket says 172.21.15.94:36154) 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf37fe640 1 -- 172.21.15.94:0/4149183802 learned_addr learned my addr 172.21.15.94:0/4149183802 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:22.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf3fff640 1 --2- 172.21.15.94:0/4149183802 >> v2:172.21.15.94:3300/0 conn(0x7efdf40b4020 0x7efdf40aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf2ffd640 1 --2- 172.21.15.94:0/4149183802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf406c3d0 0x7efdf40b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf27fc640 1 -- 172.21.15.94:0/4149183802 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796551121 0 0) 0x7efdf4147f20 con 0x7efdf4147b40 2024-09-11T23:17:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf27fc640 1 -- 172.21.15.94:0/4149183802 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde0003530 con 0x7efdf4147b40 2024-09-11T23:17:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf3fff640 1 -- 172.21.15.94:0/4149183802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf406c3d0 msgr2=0x7efdf40b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf3fff640 1 --2- 172.21.15.94:0/4149183802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf406c3d0 0x7efdf40b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf3fff640 1 -- 172.21.15.94:0/4149183802 >> v1:172.21.15.94:6789/0 conn(0x7efdf4147b40 legacy=0x7efdf406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.634+0000 7efdf3fff640 1 -- 172.21.15.94:0/4149183802 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf40ae480 con 0x7efdf40b4020 2024-09-11T23:17:22.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf3fff640 1 --2- 172.21.15.94:0/4149183802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf40aec80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efdec009d90 tx=0x7efdec01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452a2d2d9350a532 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf27fc640 1 -- 172.21.15.94:0/4149183802 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0b2070 con 0x7efdf40b4020 2024-09-11T23:17:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf27fc640 1 -- 172.21.15.94:0/4149183802 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec0a5880 con 0x7efdf40b4020 2024-09-11T23:17:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf27fc640 1 -- 172.21.15.94:0/4149183802 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0a5c30 con 0x7efdf40b4020 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- 172.21.15.94:0/4149183802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 msgr2=0x7efdf40aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 --2- 172.21.15.94:0/4149183802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf40aec80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efdec009d90 tx=0x7efdec01c8b0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- 172.21.15.94:0/4149183802 shutdown_connections 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 --2- 172.21.15.94:0/4149183802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf40aec80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 --2- 172.21.15.94:0/4149183802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf406c3d0 0x7efdf40b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- 172.21.15.94:0/4149183802 >> 172.21.15.94:0/4149183802 conn(0x7efdf409aa00 msgr2=0x7efdf40b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- 172.21.15.94:0/4149183802 shutdown_connections 2024-09-11T23:17:22.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- 172.21.15.94:0/4149183802 wait complete. 2024-09-11T23:17:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 Processor -- start 2024-09-11T23:17:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- start start 2024-09-11T23:17:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdf406c3d0 0x7efdf4141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf409d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf4147b40 0x7efdf415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40afd60 con 0x7efdf40b4020 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40afbe0 con 0x7efdf406c3d0 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdfa14b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40afee0 con 0x7efdf4147b40 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf409d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf409d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54128/0 (socket says 172.21.15.94:54128) 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 -- 172.21.15.94:0/526057072 learned_addr learned my addr 172.21.15.94:0/526057072 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 -- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf4147b40 msgr2=0x7efdf415ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf4147b40 0x7efdf415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 -- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdf406c3d0 msgr2=0x7efdf4141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdf406c3d0 0x7efdf4141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 -- 172.21.15.94:0/526057072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf4141fd0 con 0x7efdf40b4020 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.638+0000 7efdf2ffd640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf409d520 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efddc00d800 tx=0x7efddc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdebfff640 1 -- 172.21.15.94:0/526057072 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc00b6c0 con 0x7efdf40b4020 2024-09-11T23:17:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdebfff640 1 -- 172.21.15.94:0/526057072 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc019070 con 0x7efdf40b4020 2024-09-11T23:17:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf41422a0 con 0x7efdf40b4020 2024-09-11T23:17:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdebfff640 1 -- 172.21.15.94:0/526057072 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc00ba60 con 0x7efdf40b4020 2024-09-11T23:17:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf413ca40 con 0x7efdf40b4020 2024-09-11T23:17:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf40b5a80 con 0x7efdf40b4020 2024-09-11T23:17:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdebfff640 1 -- 172.21.15.94:0/526057072 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efddc00bc00 con 0x7efdf40b4020 2024-09-11T23:17:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdebfff640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdd40678c0 0x7efdd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdebfff640 1 -- 172.21.15.94:0/526057072 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7efddc086380 con 0x7efdf40b4020 2024-09-11T23:17:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdf37fe640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdd40678c0 0x7efdd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.642+0000 7efdf37fe640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdd40678c0 0x7efdd4069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efde4007fd0 tx=0x7efde4007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.646+0000 7efdebfff640 1 -- 172.21.15.94:0/526057072 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efddc056c90 con 0x7efdf40b4020 2024-09-11T23:17:22.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.846+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdf409f370 con 0x7efdf40b4020 2024-09-11T23:17:22.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.846+0000 7efdebfff640 1 -- 172.21.15.94:0/526057072 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7efddc056590 con 0x7efdf40b4020 2024-09-11T23:17:22.848 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:22.848 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":24,"btime":"2024-09-11T23:17:04:322465+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2442107241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2442107241},{"type":"v1","addr":"172.21.15.155:6837","nonce":2442107241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1638163040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1638163040},{"type":"v1","addr":"172.21.15.155:6836","nonce":1638163040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2826826443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2826826443},{"type":"v1","addr":"172.21.15.94:6833","nonce":2826826443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:00.676836+0000","modified":"2024-09-11T23:17:03.687833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2087871065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2087871065},{"type":"v1","addr":"172.21.15.94:6835","nonce":2087871065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-11T23:17:22.848 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 24 2024-09-11T23:17:22.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdd40678c0 msgr2=0x7efdd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdd40678c0 0x7efdd4069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efde4007fd0 tx=0x7efde4007900 comp rx=0 tx=0).stop 2024-09-11T23:17:22.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 msgr2=0x7efdf409d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf409d520 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efddc00d800 tx=0x7efddc00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 shutdown_connections 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdf4147b40 0x7efdf415ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efdd40678c0 0x7efdd4069d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdf40b4020 0x7efdf409d520 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 --2- 172.21.15.94:0/526057072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdf406c3d0 0x7efdf4141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 >> 172.21.15.94:0/526057072 conn(0x7efdf409aa00 msgr2=0x7efdf40b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 shutdown_connections 2024-09-11T23:17:22.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.850+0000 7efdfa14b640 1 -- 172.21.15.94:0/526057072 wait complete. 2024-09-11T23:17:22.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:22.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.978+0000 7fb18ddf0640 1 Processor -- start 2024-09-11T23:17:22.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.978+0000 7fb18ddf0640 1 -- start start 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1881587a0 0x7fb1880b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb1880b37d0 0x7fb18806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18806e4b0 0x7fb188161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb1880b3c40 con 0x7fb1881587a0 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb18806f870 con 0x7fb1880b37d0 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb18806ec60 con 0x7fb18806e4b0 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1881587a0 0x7fb1880b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1881587a0 0x7fb1880b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54138/0 (socket says 172.21.15.94:54138) 2024-09-11T23:17:22.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 -- 172.21.15.94:0/2712337128 learned_addr learned my addr 172.21.15.94:0/2712337128 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:22.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 -- 172.21.15.94:0/2712337128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18806e4b0 msgr2=0x7fb188161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:22.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 --2- 172.21.15.94:0/2712337128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18806e4b0 0x7fb188161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 -- 172.21.15.94:0/2712337128 >> v2:172.21.15.155:3300/0 conn(0x7fb1880b37d0 msgr2=0x7fb18806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:22.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 --2- 172.21.15.94:0/2712337128 >> v2:172.21.15.155:3300/0 conn(0x7fb1880b37d0 0x7fb18806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 -- 172.21.15.94:0/2712337128 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18806ef40 con 0x7fb1881587a0 2024-09-11T23:17:22.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1877fe640 1 --2- 172.21.15.94:0/2712337128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1881587a0 0x7fb1880b3290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb188161d90 tx=0x7fb18001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac20e3469605925 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1867fc640 1 -- 172.21.15.94:0/2712337128 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1800a5580 con 0x7fb1881587a0 2024-09-11T23:17:22.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1867fc640 1 -- 172.21.15.94:0/2712337128 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1800a5720 con 0x7fb1881587a0 2024-09-11T23:17:22.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb1867fc640 1 -- 172.21.15.94:0/2712337128 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1800a5af0 con 0x7fb1881587a0 2024-09-11T23:17:22.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- 172.21.15.94:0/2712337128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1881587a0 msgr2=0x7fb1880b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/2712337128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1881587a0 0x7fb1880b3290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb188161d90 tx=0x7fb18001c700 comp rx=0 tx=0).stop 2024-09-11T23:17:22.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- 172.21.15.94:0/2712337128 shutdown_connections 2024-09-11T23:17:22.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/2712337128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18806e4b0 0x7fb188161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/2712337128 >> v2:172.21.15.155:3300/0 conn(0x7fb1880b37d0 0x7fb18806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/2712337128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1881587a0 0x7fb1880b3290 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- 172.21.15.94:0/2712337128 >> 172.21.15.94:0/2712337128 conn(0x7fb1880b1f90 msgr2=0x7fb1880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:22.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- 172.21.15.94:0/2712337128 shutdown_connections 2024-09-11T23:17:22.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.982+0000 7fb18ddf0640 1 -- 172.21.15.94:0/2712337128 wait complete. 2024-09-11T23:17:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 Processor -- start 2024-09-11T23:17:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 -- start start 2024-09-11T23:17:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18806e4b0 0x7fb188156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1880b37d0 0x7fb188157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1881587a0 0x7fb1880998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb188158b80 con 0x7fb1880b37d0 2024-09-11T23:17:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb188072160 con 0x7fb18806e4b0 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1881581a0 con 0x7fb1881587a0 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1880b37d0 0x7fb188157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1880b37d0 0x7fb188157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54144/0 (socket says 172.21.15.94:54144) 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 -- 172.21.15.94:0/4231314057 learned_addr learned my addr 172.21.15.94:0/4231314057 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb1877fe640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18806e4b0 0x7fb188156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 -- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1881587a0 msgr2=0x7fb1880998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1881587a0 0x7fb1880998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 -- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18806e4b0 msgr2=0x7fb188156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18806e4b0 0x7fb188156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 -- 172.21.15.94:0/4231314057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb188145de0 con 0x7fb1880b37d0 2024-09-11T23:17:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb1877fe640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18806e4b0 0x7fb188156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb186ffd640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1880b37d0 0x7fb188157c60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb17800b550 tx=0x7fb17800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb17ffff640 1 -- 172.21.15.94:0/4231314057 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178014070 con 0x7fb1880b37d0 2024-09-11T23:17:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb17ffff640 1 -- 172.21.15.94:0/4231314057 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb178010890 con 0x7fb1880b37d0 2024-09-11T23:17:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb188156bc0 con 0x7fb1880b37d0 2024-09-11T23:17:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb17ffff640 1 -- 172.21.15.94:0/4231314057 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178010c80 con 0x7fb1880b37d0 2024-09-11T23:17:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb188157180 con 0x7fb1880b37d0 2024-09-11T23:17:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb188070080 con 0x7fb1880b37d0 2024-09-11T23:17:22.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.986+0000 7fb17ffff640 1 -- 172.21.15.94:0/4231314057 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb178017070 con 0x7fb1880b37d0 2024-09-11T23:17:22.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.990+0000 7fb17ffff640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1680678c0 0x7fb168069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:22.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.990+0000 7fb17ffff640 1 -- 172.21.15.94:0/4231314057 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fb178085c30 con 0x7fb1880b37d0 2024-09-11T23:17:22.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.990+0000 7fb1877fe640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1680678c0 0x7fb168069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:22.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.990+0000 7fb1877fe640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1680678c0 0x7fb168069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1800ae000 tx=0x7fb1800a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:22.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:22.994+0000 7fb17ffff640 1 -- 172.21.15.94:0/4231314057 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb178056550 con 0x7fb1880b37d0 2024-09-11T23:17:23.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.154+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb188072eb0 con 0x7fb1880b37d0 2024-09-11T23:17:23.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb17ffff640 1 -- 172.21.15.94:0/4231314057 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17026 (secure 0 0 0) 0x7fb178010e20 con 0x7fb1880b37d0 2024-09-11T23:17:23.157 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:23.158 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":51,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:02.251694+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:59.244408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:59.671966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1680678c0 msgr2=0x7fb168069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1680678c0 0x7fb168069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1800ae000 tx=0x7fb1800a7070 comp rx=0 tx=0).stop 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1880b37d0 msgr2=0x7fb188157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1880b37d0 0x7fb188157c60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb17800b550 tx=0x7fb17800ba10 comp rx=0 tx=0).stop 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 shutdown_connections 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1881587a0 0x7fb1880998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1680678c0 0x7fb168069d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1880b37d0 0x7fb188157c60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 --2- 172.21.15.94:0/4231314057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18806e4b0 0x7fb188156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 >> 172.21.15.94:0/4231314057 conn(0x7fb1880b1f90 msgr2=0x7fb1880b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 shutdown_connections 2024-09-11T23:17:23.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.158+0000 7fb18ddf0640 1 -- 172.21.15.94:0/4231314057 wait complete. 2024-09-11T23:17:23.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:17:23.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.286+0000 7f440dbe2640 1 Processor -- start 2024-09-11T23:17:23.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.286+0000 7f440dbe2640 1 -- start start 2024-09-11T23:17:23.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f440dbe2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4408073e60 0x7f440806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f440dbe2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f44080b3d50 0x7f44080b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f440dbe2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440806ee50 con 0x7f440806fef0 2024-09-11T23:17:23.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f440dbe2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f44080b46c0 con 0x7f44080b3d50 2024-09-11T23:17:23.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f440dbe2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f440806f130 con 0x7f4408073e60 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f4407fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f44080b3d50 0x7f44080b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f44077fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4408073e60 0x7f440806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f43feffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f440806fef0 0x7f440815b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:57082/0 (socket says 172.21.15.94:57082) 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f43feffd640 1 -- 172.21.15.94:0/3243178482 learned_addr learned my addr 172.21.15.94:0/3243178482 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f4407fff640 1 -- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4408073e60 msgr2=0x7f440806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f4407fff640 1 --2- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4408073e60 0x7f440806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f4407fff640 1 -- 172.21.15.94:0/3243178482 >> v1:172.21.15.155:6789/0 conn(0x7f440806fef0 legacy=0x7f440815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f4407fff640 1 -- 172.21.15.94:0/3243178482 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440806f410 con 0x7f44080b3d50 2024-09-11T23:17:23.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.290+0000 7f44077fe640 1 --2- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4408073e60 0x7f440806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:23.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f4407fff640 1 --2- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 0x7f44080b4180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4400009d90 tx=0x7f440001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d48ce8eb8c0489f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f4406ffd640 1 -- 172.21.15.94:0/3243178482 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44000b2070 con 0x7f44080b3d50 2024-09-11T23:17:23.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f4406ffd640 1 -- 172.21.15.94:0/3243178482 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44000a57b0 con 0x7f44080b3d50 2024-09-11T23:17:23.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f4406ffd640 1 -- 172.21.15.94:0/3243178482 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44000a5b80 con 0x7f44080b3d50 2024-09-11T23:17:23.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 msgr2=0x7f44080b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 0x7f44080b4180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4400009d90 tx=0x7f440001c8e0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- 172.21.15.94:0/3243178482 shutdown_connections 2024-09-11T23:17:23.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 0x7f44080b4180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3243178482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4408073e60 0x7f440806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- 172.21.15.94:0/3243178482 >> 172.21.15.94:0/3243178482 conn(0x7f44080b1f90 msgr2=0x7f44080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:23.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- 172.21.15.94:0/3243178482 shutdown_connections 2024-09-11T23:17:23.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- 172.21.15.94:0/3243178482 wait complete. 2024-09-11T23:17:23.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 Processor -- start 2024-09-11T23:17:23.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- start start 2024-09-11T23:17:23.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f440806fef0 0x7f44080733c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4408073e60 0x7f440814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 0x7f4408152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f44080729a0 con 0x7f4408073e60 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4408072820 con 0x7f44080b3d50 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f440dbe2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4408072b20 con 0x7f440806fef0 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4408073e60 0x7f440814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4408073e60 0x7f440814ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54156/0 (socket says 172.21.15.94:54156) 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 -- 172.21.15.94:0/3207328971 learned_addr learned my addr 172.21.15.94:0/3207328971 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f4407fff640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 0x7f4408152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f44077fe640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f440806fef0 0x7f44080733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 -- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f440806fef0 msgr2=0x7f44080733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f440806fef0 0x7f44080733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 -- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 msgr2=0x7f4408152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 0x7f4408152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 -- 172.21.15.94:0/3207328971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440814dd20 con 0x7f4408073e60 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f43feffd640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4408073e60 0x7f440814ba70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c370 tx=0x7f43f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.294+0000 7f4404ff9640 1 -- 172.21.15.94:0/3207328971 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8017070 con 0x7f4408073e60 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f4404ff9640 1 -- 172.21.15.94:0/3207328971 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f8005cf0 con 0x7f4408073e60 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440814e000 con 0x7f4408073e60 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f4404ff9640 1 -- 172.21.15.94:0/3207328971 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f80072f0 con 0x7f4408073e60 2024-09-11T23:17:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440814e5c0 con 0x7f4408073e60 2024-09-11T23:17:23.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440806e800 con 0x7f4408073e60 2024-09-11T23:17:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f4404ff9640 1 -- 172.21.15.94:0/3207328971 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f43f801a070 con 0x7f4408073e60 2024-09-11T23:17:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f4404ff9640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43e80678c0 0x7f43e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f4404ff9640 1 -- 172.21.15.94:0/3207328971 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f43f80851b0 con 0x7f4408073e60 2024-09-11T23:17:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f44077fe640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43e80678c0 0x7f43e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.298+0000 7f44077fe640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43e80678c0 0x7f43e8069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f43f000a720 tx=0x7f43f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.302+0000 7f4404ff9640 1 -- 172.21.15.94:0/3207328971 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f43f8055b60 con 0x7f4408073e60 2024-09-11T23:17:23.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.486+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f44080723f0 con 0x7f4408073e60 2024-09-11T23:17:23.486 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:17:23.486+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:17:23.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.490+0000 7f4404ff9640 1 -- 172.21.15.94:0/3207328971 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7f43f8055460 con 0x7f4408073e60 2024-09-11T23:17:23.489 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:17:23.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.490+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43e80678c0 msgr2=0x7f43e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.490+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43e80678c0 0x7f43e8069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f43f000a720 tx=0x7f43f0008040 comp rx=0 tx=0).stop 2024-09-11T23:17:23.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.490+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4408073e60 msgr2=0x7f440814ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.490+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4408073e60 0x7f440814ba70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c370 tx=0x7f43f800c830 comp rx=0 tx=0).stop 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 shutdown_connections 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44080b3d50 0x7f4408152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f43e80678c0 0x7f43e8069d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4408073e60 0x7f440814ba70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 --2- 172.21.15.94:0/3207328971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f440806fef0 0x7f44080733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 >> 172.21.15.94:0/3207328971 conn(0x7f44080b1f90 msgr2=0x7f440814f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 shutdown_connections 2024-09-11T23:17:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.494+0000 7f440dbe2640 1 -- 172.21.15.94:0/3207328971 wait complete. 2024-09-11T23:17:23.511 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:17:23.530 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:17:23.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f291d84b640 1 Processor -- start 2024-09-11T23:17:23.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f291d84b640 1 -- start start 2024-09-11T23:17:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f291d84b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2918073e60 0x7f291806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f291d84b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 0x7f291815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f291d84b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f291815bda0 con 0x7f29180b3d50 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f291d84b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f291806ee50 con 0x7f2918073e60 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f291d84b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f291806f130 con 0x7f291806fef0 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f2916ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2918073e60 0x7f291806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f2916ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2918073e60 0x7f291806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54178/0 (socket says 172.21.15.94:54178) 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f2916ffd640 1 -- 172.21.15.94:0/1686661906 learned_addr learned my addr 172.21.15.94:0/1686661906 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f2916ffd640 1 -- 172.21.15.94:0/1686661906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 msgr2=0x7f291815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f2916ffd640 1 --2- 172.21.15.94:0/1686661906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 0x7f291815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f2916ffd640 1 -- 172.21.15.94:0/1686661906 >> v1:172.21.15.155:6789/0 conn(0x7f29180b3d50 legacy=0x7f29180b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.626+0000 7f2916ffd640 1 -- 172.21.15.94:0/1686661906 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291806f410 con 0x7f2918073e60 2024-09-11T23:17:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f2916ffd640 1 --2- 172.21.15.94:0/1686661906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2918073e60 0x7f291806e800 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2910006fd0 tx=0x7f291001e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c91458598b945f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f2915ffb640 1 -- 172.21.15.94:0/1686661906 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29100ad070 con 0x7f2918073e60 2024-09-11T23:17:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f2915ffb640 1 -- 172.21.15.94:0/1686661906 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2910004230 con 0x7f2918073e60 2024-09-11T23:17:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f2915ffb640 1 -- 172.21.15.94:0/1686661906 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910003620 con 0x7f2918073e60 2024-09-11T23:17:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 -- 172.21.15.94:0/1686661906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2918073e60 msgr2=0x7f291806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 --2- 172.21.15.94:0/1686661906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2918073e60 0x7f291806e800 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2910006fd0 tx=0x7f291001e920 comp rx=0 tx=0).stop 2024-09-11T23:17:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 -- 172.21.15.94:0/1686661906 shutdown_connections 2024-09-11T23:17:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 --2- 172.21.15.94:0/1686661906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 0x7f291815b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 --2- 172.21.15.94:0/1686661906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2918073e60 0x7f291806e800 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 -- 172.21.15.94:0/1686661906 >> 172.21.15.94:0/1686661906 conn(0x7f29180b1f90 msgr2=0x7f29180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 -- 172.21.15.94:0/1686661906 shutdown_connections 2024-09-11T23:17:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 -- 172.21.15.94:0/1686661906 wait complete. 2024-09-11T23:17:23.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 Processor -- start 2024-09-11T23:17:23.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.630+0000 7f291d84b640 1 -- start start 2024-09-11T23:17:23.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 0x7f291815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2918073e60 0x7f2918153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29180b3d50 0x7f2918153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f29180729e0 con 0x7f29180b3d50 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2918072860 con 0x7f2918073e60 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2918072b60 con 0x7f291806fef0 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29180b3d50 0x7f2918153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29180b3d50 0x7f2918153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54180/0 (socket says 172.21.15.94:54180) 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 -- 172.21.15.94:0/1094491111 learned_addr learned my addr 172.21.15.94:0/1094491111 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29167fc640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2918073e60 0x7f2918153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f2916ffd640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 0x7f291815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 -- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 msgr2=0x7f291815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 0x7f291815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 -- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2918073e60 msgr2=0x7f2918153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2918073e60 0x7f2918153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 -- 172.21.15.94:0/1094491111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2918156700 con 0x7f29180b3d50 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f29177fe640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29180b3d50 0x7f2918153d60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f290800c780 tx=0x7f290800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f290ffff640 1 -- 172.21.15.94:0/1094491111 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908017070 con 0x7f29180b3d50 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f290ffff640 1 -- 172.21.15.94:0/1094491111 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908003db0 con 0x7f29180b3d50 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f290ffff640 1 -- 172.21.15.94:0/1094491111 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080052b0 con 0x7f29180b3d50 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29181569e0 con 0x7f29180b3d50 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291814c270 con 0x7f29180b3d50 2024-09-11T23:17:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291815b860 con 0x7f29180b3d50 2024-09-11T23:17:23.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f290ffff640 1 -- 172.21.15.94:0/1094491111 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f290801a070 con 0x7f29180b3d50 2024-09-11T23:17:23.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f290ffff640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28f80678c0 0x7f28f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f290ffff640 1 -- 172.21.15.94:0/1094491111 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7f2908085470 con 0x7f29180b3d50 2024-09-11T23:17:23.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.634+0000 7f2916ffd640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28f80678c0 0x7f28f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.638+0000 7f2916ffd640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28f80678c0 0x7f28f8069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f29100b1000 tx=0x7f29100a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.638+0000 7f290ffff640 1 -- 172.21.15.94:0/1094491111 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2908055e60 con 0x7f29180b3d50 2024-09-11T23:17:23.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:23.830+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f29180723f0 con 0x7f29180b3d50 2024-09-11T23:17:24.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.490+0000 7f290ffff640 1 -- 172.21.15.94:0/1094491111 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) ==== 104+0+0 (secure 0 0 0) 0x7f2908055760 con 0x7f29180b3d50 2024-09-11T23:17:24.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28f80678c0 msgr2=0x7f28f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28f80678c0 0x7f28f8069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f29100b1000 tx=0x7f29100a9070 comp rx=0 tx=0).stop 2024-09-11T23:17:24.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29180b3d50 msgr2=0x7f2918153d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29180b3d50 0x7f2918153d60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f290800c780 tx=0x7f290800cc40 comp rx=0 tx=0).stop 2024-09-11T23:17:24.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 shutdown_connections 2024-09-11T23:17:24.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28f80678c0 0x7f28f8069d80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29180b3d50 0x7f2918153d60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2918073e60 0x7f2918153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 --2- 172.21.15.94:0/1094491111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f291806fef0 0x7f291815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 >> 172.21.15.94:0/1094491111 conn(0x7f29180b1f90 msgr2=0x7f29180b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:24.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 shutdown_connections 2024-09-11T23:17:24.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.494+0000 7f291d84b640 1 -- 172.21.15.94:0/1094491111 wait complete. 2024-09-11T23:17:24.516 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:17:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.678+0000 7fb77ceb6640 1 Processor -- start 2024-09-11T23:17:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.678+0000 7fb77ceb6640 1 -- start start 2024-09-11T23:17:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb77ceb6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb778070020 0x7fb77815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb77ceb6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb77815f1d0 0x7fb7780adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb77ceb6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7780aede0 con 0x7fb7781520a0 2024-09-11T23:17:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb77ceb6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb778152480 con 0x7fb77815f1d0 2024-09-11T23:17:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb77ceb6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb77815fa10 con 0x7fb778070020 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb776d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb77815f1d0 0x7fb7780adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb77659c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb7781520a0 0x7fb77806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36184/0 (socket says 172.21.15.94:36184) 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb776d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb77815f1d0 0x7fb7780adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54190/0 (socket says 172.21.15.94:54190) 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb77659c640 1 -- 172.21.15.94:0/3021461444 learned_addr learned my addr 172.21.15.94:0/3021461444 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb776d9d640 1 -- 172.21.15.94:0/3021461444 >> v2:172.21.15.155:3300/0 conn(0x7fb778070020 msgr2=0x7fb77815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb776d9d640 1 --2- 172.21.15.94:0/3021461444 >> v2:172.21.15.155:3300/0 conn(0x7fb778070020 0x7fb77815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb776d9d640 1 -- 172.21.15.94:0/3021461444 >> v1:172.21.15.94:6789/0 conn(0x7fb7781520a0 legacy=0x7fb77806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb775d9b640 1 -- 172.21.15.94:0/3021461444 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426971851 0 0) 0x7fb7780aede0 con 0x7fb7781520a0 2024-09-11T23:17:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb776d9d640 1 -- 172.21.15.94:0/3021461444 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb778074250 con 0x7fb77815f1d0 2024-09-11T23:17:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb776d9d640 1 --2- 172.21.15.94:0/3021461444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77815f1d0 0x7fb7780adc80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb77806e510 tx=0x7fb77001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae920a26316b213d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:24.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb775d9b640 1 -- 172.21.15.94:0/3021461444 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700b2070 con 0x7fb77815f1d0 2024-09-11T23:17:24.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb775d9b640 1 -- 172.21.15.94:0/3021461444 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7700a59c0 con 0x7fb77815f1d0 2024-09-11T23:17:24.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.682+0000 7fb775d9b640 1 -- 172.21.15.94:0/3021461444 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700a5d90 con 0x7fb77815f1d0 2024-09-11T23:17:24.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- 172.21.15.94:0/3021461444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77815f1d0 msgr2=0x7fb7780adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/3021461444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77815f1d0 0x7fb7780adc80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb77806e510 tx=0x7fb77001c900 comp rx=0 tx=0).stop 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- 172.21.15.94:0/3021461444 shutdown_connections 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/3021461444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77815f1d0 0x7fb7780adc80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/3021461444 >> v2:172.21.15.155:3300/0 conn(0x7fb778070020 0x7fb77815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- 172.21.15.94:0/3021461444 >> 172.21.15.94:0/3021461444 conn(0x7fb7780b1f90 msgr2=0x7fb7780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- 172.21.15.94:0/3021461444 shutdown_connections 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- 172.21.15.94:0/3021461444 wait complete. 2024-09-11T23:17:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 Processor -- start 2024-09-11T23:17:24.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- start start 2024-09-11T23:17:24.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb778070020 0x7fb77814a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7781520a0 0x7fb7780ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb77815f1d0 0x7fb77814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb77815f680 con 0x7fb778070020 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb778073d30 con 0x7fb7781520a0 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb77806e800 con 0x7fb77815f1d0 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb778070020 0x7fb77814a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb778070020 0x7fb77814a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54198/0 (socket says 172.21.15.94:54198) 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 -- 172.21.15.94:0/1201324940 learned_addr learned my addr 172.21.15.94:0/1201324940 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 -- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb77815f1d0 msgr2=0x7fb77814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb77815f1d0 0x7fb77814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 -- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7781520a0 msgr2=0x7fb7780ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7781520a0 0x7fb7780ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 -- 172.21.15.94:0/1201324940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77814dd90 con 0x7fb778070020 2024-09-11T23:17:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77659c640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb778070020 0x7fb77814a480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb7680011f0 tx=0x7fb76800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb76f7fe640 1 -- 172.21.15.94:0/1201324940 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768018070 con 0x7fb778070020 2024-09-11T23:17:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb76f7fe640 1 -- 172.21.15.94:0/1201324940 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7680074e0 con 0x7fb778070020 2024-09-11T23:17:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7780cf120 con 0x7fb778070020 2024-09-11T23:17:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb76f7fe640 1 -- 172.21.15.94:0/1201324940 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768004a10 con 0x7fb778070020 2024-09-11T23:17:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.686+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7780cf6e0 con 0x7fb778070020 2024-09-11T23:17:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.690+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77815ec90 con 0x7fb778070020 2024-09-11T23:17:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.690+0000 7fb76f7fe640 1 -- 172.21.15.94:0/1201324940 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb76801b070 con 0x7fb778070020 2024-09-11T23:17:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.690+0000 7fb76f7fe640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7580678c0 0x7fb758069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.690+0000 7fb76f7fe640 1 -- 172.21.15.94:0/1201324940 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7fb768085180 con 0x7fb778070020 2024-09-11T23:17:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.690+0000 7fb76dd9b640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7580678c0 0x7fb758069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.690+0000 7fb76dd9b640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7580678c0 0x7fb758069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7781510c0 tx=0x7fb760006c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:24.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.694+0000 7fb76f7fe640 1 -- 172.21.15.94:0/1201324940 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb768055b70 con 0x7fb778070020 2024-09-11T23:17:24.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:24.850+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb77814f0f0 con 0x7fb778070020 2024-09-11T23:17:25.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.502+0000 7fb76f7fe640 1 -- 172.21.15.94:0/1201324940 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7fb768055470 con 0x7fb778070020 2024-09-11T23:17:25.501 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7580678c0 msgr2=0x7fb758069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7580678c0 0x7fb758069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7781510c0 tx=0x7fb760006c00 comp rx=0 tx=0).stop 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb778070020 msgr2=0x7fb77814a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb778070020 0x7fb77814a480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb7680011f0 tx=0x7fb76800c9b0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 shutdown_connections 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb77815f1d0 0x7fb77814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7781520a0 0x7fb7780ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7580678c0 0x7fb758069d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 --2- 172.21.15.94:0/1201324940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb778070020 0x7fb77814a480 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 >> 172.21.15.94:0/1201324940 conn(0x7fb7780b1f90 msgr2=0x7fb778071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:25.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 shutdown_connections 2024-09-11T23:17:25.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.506+0000 7fb77ceb6640 1 -- 172.21.15.94:0/1201324940 wait complete. 2024-09-11T23:17:25.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ebac0640 1 Processor -- start 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ebac0640 1 -- start start 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ebac0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5e40b38e0 0x7ff5e40d4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ebac0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff5e40d4750 0x7ff5e406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ebac0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5e40d2b20 con 0x7ff5e415e470 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ebac0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e40d3bc0 con 0x7ff5e40b38e0 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ebac0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e40d4ba0 con 0x7ff5e40d4750 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5e905b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5e40b38e0 0x7ff5e40d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5e905b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5e40b38e0 0x7ff5e40d4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54200/0 (socket says 172.21.15.94:54200) 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5e905b640 1 -- 172.21.15.94:0/2412012640 learned_addr learned my addr 172.21.15.94:0/2412012640 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5e905b640 1 -- 172.21.15.94:0/2412012640 >> v2:172.21.15.155:3300/0 conn(0x7ff5e40d4750 msgr2=0x7ff5e406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:25.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5ea05d640 1 --2- 172.21.15.94:0/2412012640 >> v2:172.21.15.155:3300/0 conn(0x7ff5e40d4750 0x7ff5e406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5e905b640 1 --2- 172.21.15.94:0/2412012640 >> v2:172.21.15.155:3300/0 conn(0x7ff5e40d4750 0x7ff5e406d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5e905b640 1 -- 172.21.15.94:0/2412012640 >> v1:172.21.15.155:6789/0 conn(0x7ff5e415e470 legacy=0x7ff5e40d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:25.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.646+0000 7ff5e905b640 1 -- 172.21.15.94:0/2412012640 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e40d2e00 con 0x7ff5e40b38e0 2024-09-11T23:17:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5e905b640 1 --2- 172.21.15.94:0/2412012640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e40b38e0 0x7ff5e40d4210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40d3f70 tx=0x7ff5d401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68290077176c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5e885a640 1 -- 172.21.15.94:0/2412012640 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40b0070 con 0x7ff5e40b38e0 2024-09-11T23:17:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5e885a640 1 -- 172.21.15.94:0/2412012640 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d40ab600 con 0x7ff5e40b38e0 2024-09-11T23:17:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5e885a640 1 -- 172.21.15.94:0/2412012640 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40ab9d0 con 0x7ff5e40b38e0 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 -- 172.21.15.94:0/2412012640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e40b38e0 msgr2=0x7ff5e40d4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/2412012640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e40b38e0 0x7ff5e40d4210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40d3f70 tx=0x7ff5d401c450 comp rx=0 tx=0).stop 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 -- 172.21.15.94:0/2412012640 shutdown_connections 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/2412012640 >> v2:172.21.15.155:3300/0 conn(0x7ff5e40d4750 0x7ff5e406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/2412012640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e40b38e0 0x7ff5e40d4210 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 -- 172.21.15.94:0/2412012640 >> 172.21.15.94:0/2412012640 conn(0x7ff5e409d730 msgr2=0x7ff5e408bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 -- 172.21.15.94:0/2412012640 shutdown_connections 2024-09-11T23:17:25.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 -- 172.21.15.94:0/2412012640 wait complete. 2024-09-11T23:17:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 Processor -- start 2024-09-11T23:17:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.650+0000 7ff5ebac0640 1 -- start start 2024-09-11T23:17:25.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e40b38e0 0x7ff5e415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e40d4750 0x7ff5e40ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e415e470 0x7ff5e40cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e406e290 con 0x7ff5e415e470 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e406e110 con 0x7ff5e40d4750 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e406e410 con 0x7ff5e40b38e0 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e415e470 0x7ff5e40cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e415e470 0x7ff5e40cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54214/0 (socket says 172.21.15.94:54214) 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 -- 172.21.15.94:0/1447477318 learned_addr learned my addr 172.21.15.94:0/1447477318 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5e905b640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e40d4750 0x7ff5e40ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 -- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e40b38e0 msgr2=0x7ff5e415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5e985c640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e40b38e0 0x7ff5e415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e40b38e0 0x7ff5e415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 -- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e40d4750 msgr2=0x7ff5e40ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e40d4750 0x7ff5e40ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 -- 172.21.15.94:0/1447477318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e415dff0 con 0x7ff5e415e470 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5e905b640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e40d4750 0x7ff5e40ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5e985c640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e40b38e0 0x7ff5e415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ea05d640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e415e470 0x7ff5e40cea90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00cda0 tx=0x7ff5dc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5da7fc640 1 -- 172.21.15.94:0/1447477318 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc003ba0 con 0x7ff5e415e470 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5da7fc640 1 -- 172.21.15.94:0/1447477318 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5dc003d40 con 0x7ff5e415e470 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5da7fc640 1 -- 172.21.15.94:0/1447477318 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc004240 con 0x7ff5e415e470 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e40cf120 con 0x7ff5e415e470 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e40a01f0 con 0x7ff5e415e470 2024-09-11T23:17:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e40d4210 con 0x7ff5e415e470 2024-09-11T23:17:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5da7fc640 1 -- 172.21.15.94:0/1447477318 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5dc0043e0 con 0x7ff5e415e470 2024-09-11T23:17:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5da7fc640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5c80678c0 0x7ff5c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5da7fc640 1 -- 172.21.15.94:0/1447477318 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5749+0+0 (secure 0 0 0) 0x7ff5dc0867a0 con 0x7ff5e415e470 2024-09-11T23:17:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.654+0000 7ff5e985c640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5c80678c0 0x7ff5c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.658+0000 7ff5e985c640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5c80678c0 0x7ff5c8069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000a850 tx=0x7ff5e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.658+0000 7ff5da7fc640 1 -- 172.21.15.94:0/1447477318 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5dc057340 con 0x7ff5e415e470 2024-09-11T23:17:25.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:25.822+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff5e40d2420 con 0x7ff5e415e470 2024-09-11T23:17:26.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.502+0000 7ff5da7fc640 1 -- 172.21.15.94:0/1447477318 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7ff5dc056c40 con 0x7ff5e415e470 2024-09-11T23:17:26.504 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:17:26.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5c80678c0 msgr2=0x7ff5c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5c80678c0 0x7ff5c8069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000a850 tx=0x7ff5e0008040 comp rx=0 tx=0).stop 2024-09-11T23:17:26.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e415e470 msgr2=0x7ff5e40cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e415e470 0x7ff5e40cea90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00cda0 tx=0x7ff5dc00a660 comp rx=0 tx=0).stop 2024-09-11T23:17:26.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 shutdown_connections 2024-09-11T23:17:26.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5c80678c0 0x7ff5c8069d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5e415e470 0x7ff5e40cea90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e40d4750 0x7ff5e40ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 --2- 172.21.15.94:0/1447477318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e40b38e0 0x7ff5e415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 >> 172.21.15.94:0/1447477318 conn(0x7ff5e409d730 msgr2=0x7ff5e415eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:26.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 shutdown_connections 2024-09-11T23:17:26.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.510+0000 7ff5ebac0640 1 -- 172.21.15.94:0/1447477318 wait complete. 2024-09-11T23:17:26.534 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_fragment_size_max 2024-09-11T23:17:26.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.654+0000 7fba1eb24640 1 Processor -- start 2024-09-11T23:17:26.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.654+0000 7fba1eb24640 1 -- start start 2024-09-11T23:17:26.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.654+0000 7fba1eb24640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba18073e60 0x7fba1806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.654+0000 7fba1eb24640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba180b3d50 0x7fba180b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1eb24640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba180b4670 con 0x7fba1806fef0 2024-09-11T23:17:26.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1eb24640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fba1806ee50 con 0x7fba180b3d50 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1eb24640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fba1806f130 con 0x7fba18073e60 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1d0c1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba180b3d50 0x7fba180b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba0ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fba1806fef0 0x7fba1815b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36194/0 (socket says 172.21.15.94:36194) 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba0ffff640 1 -- 172.21.15.94:0/1242025648 learned_addr learned my addr 172.21.15.94:0/1242025648 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1c8c0640 1 --2- 172.21.15.94:0/1242025648 >> v2:172.21.15.155:3300/0 conn(0x7fba18073e60 0x7fba1806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1d0c1640 1 -- 172.21.15.94:0/1242025648 >> v2:172.21.15.155:3300/0 conn(0x7fba18073e60 msgr2=0x7fba1806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1d0c1640 1 --2- 172.21.15.94:0/1242025648 >> v2:172.21.15.155:3300/0 conn(0x7fba18073e60 0x7fba1806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1d0c1640 1 -- 172.21.15.94:0/1242025648 >> v1:172.21.15.94:6789/0 conn(0x7fba1806fef0 legacy=0x7fba1815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1d0c1640 1 -- 172.21.15.94:0/1242025648 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1806f410 con 0x7fba180b3d50 2024-09-11T23:17:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1d0c1640 1 --2- 172.21.15.94:0/1242025648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba180b3d50 0x7fba180b4130 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fba18070340 tx=0x7fba1001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6315211e743b747 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba0f7fe640 1 -- 172.21.15.94:0/1242025648 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba100b2070 con 0x7fba180b3d50 2024-09-11T23:17:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba0f7fe640 1 -- 172.21.15.94:0/1242025648 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba100a57f0 con 0x7fba180b3d50 2024-09-11T23:17:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba0f7fe640 1 -- 172.21.15.94:0/1242025648 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba100a5bc0 con 0x7fba180b3d50 2024-09-11T23:17:26.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1eb24640 1 -- 172.21.15.94:0/1242025648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba180b3d50 msgr2=0x7fba180b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.658+0000 7fba1eb24640 1 --2- 172.21.15.94:0/1242025648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba180b3d50 0x7fba180b4130 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fba18070340 tx=0x7fba1001c8a0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- 172.21.15.94:0/1242025648 shutdown_connections 2024-09-11T23:17:26.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 --2- 172.21.15.94:0/1242025648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba180b3d50 0x7fba180b4130 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 --2- 172.21.15.94:0/1242025648 >> v2:172.21.15.155:3300/0 conn(0x7fba18073e60 0x7fba1806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- 172.21.15.94:0/1242025648 >> 172.21.15.94:0/1242025648 conn(0x7fba180b1f90 msgr2=0x7fba180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:26.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- 172.21.15.94:0/1242025648 shutdown_connections 2024-09-11T23:17:26.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- 172.21.15.94:0/1242025648 wait complete. 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 Processor -- start 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- start start 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba1806fef0 0x7fba18164010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba18073e60 0x7fba18099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba180b3d50 0x7fba18099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fba180731b0 con 0x7fba1806fef0 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba18073030 con 0x7fba180b3d50 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba18073330 con 0x7fba18073e60 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba1806fef0 0x7fba18164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba1806fef0 0x7fba18164010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54234/0 (socket says 172.21.15.94:54234) 2024-09-11T23:17:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 -- 172.21.15.94:0/806340834 learned_addr learned my addr 172.21.15.94:0/806340834 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1d0c1640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba180b3d50 0x7fba18099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba0ffff640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba18073e60 0x7fba18099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 -- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba18073e60 msgr2=0x7fba18099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba18073e60 0x7fba18099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 -- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba180b3d50 msgr2=0x7fba18099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba180b3d50 0x7fba18099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 -- 172.21.15.94:0/806340834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba18150af0 con 0x7fba1806fef0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1c8c0640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba1806fef0 0x7fba18164010 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fba1400d620 tx=0x7fba1400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba0d7fa640 1 -- 172.21.15.94:0/806340834 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1400b620 con 0x7fba1806fef0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba0d7fa640 1 -- 172.21.15.94:0/806340834 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba14019070 con 0x7fba1806fef0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba18164620 con 0x7fba1806fef0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba0d7fa640 1 -- 172.21.15.94:0/806340834 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1400ba20 con 0x7fba1806fef0 2024-09-11T23:17:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba18164be0 con 0x7fba1806fef0 2024-09-11T23:17:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.662+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba180b4130 con 0x7fba1806fef0 2024-09-11T23:17:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.666+0000 7fba0d7fa640 1 -- 172.21.15.94:0/806340834 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba1400bbc0 con 0x7fba1806fef0 2024-09-11T23:17:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.666+0000 7fba0d7fa640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba040678c0 0x7fba04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.666+0000 7fba0d7fa640 1 -- 172.21.15.94:0/806340834 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fba14085f90 con 0x7fba1806fef0 2024-09-11T23:17:26.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.666+0000 7fba0ffff640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba040678c0 0x7fba04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.666+0000 7fba0ffff640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba040678c0 0x7fba04069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba18164550 tx=0x7fba08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:26.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.670+0000 7fba0d7fa640 1 -- 172.21.15.94:0/806340834 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba18150af0 con 0x7fba1806fef0 2024-09-11T23:17:26.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.830+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"} v 0) -- 0x7fba180723f0 con 0x7fba1806fef0 2024-09-11T23:17:26.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.834+0000 7fba0d7fa640 1 -- 172.21.15.94:0/806340834 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"}]=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7fba14056c40 con 0x7fba1806fef0 2024-09-11T23:17:26.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba040678c0 msgr2=0x7fba04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba040678c0 0x7fba04069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba18164550 tx=0x7fba08009040 comp rx=0 tx=0).stop 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba1806fef0 msgr2=0x7fba18164010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba1806fef0 0x7fba18164010 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fba1400d620 tx=0x7fba1400dae0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 shutdown_connections 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba180b3d50 0x7fba18099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba18073e60 0x7fba18099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba040678c0 0x7fba04069d80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 --2- 172.21.15.94:0/806340834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba1806fef0 0x7fba18164010 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 >> 172.21.15.94:0/806340834 conn(0x7fba180b1f90 msgr2=0x7fba18151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 shutdown_connections 2024-09-11T23:17:26.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.838+0000 7fba1eb24640 1 -- 172.21.15.94:0/806340834 wait complete. 2024-09-11T23:17:26.855 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:17:26.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb4a0c50640 1 Processor -- start 2024-09-11T23:17:26.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb4a0c50640 1 -- start start 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb4a0c50640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c15e3e0 0x7fb49c15f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb4a0c50640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb49c072dd0 0x7fb49c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb4a0c50640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb49c0b04a0 con 0x7fb49c0b3300 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb4a0c50640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb49c0b0770 con 0x7fb49c072dd0 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb4a0c50640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb49c0b0a50 con 0x7fb49c15e3e0 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb499d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb49c072dd0 0x7fb49c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb499d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb49c072dd0 0x7fb49c0aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54246/0 (socket says 172.21.15.94:54246) 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb499d9b640 1 -- 172.21.15.94:0/1854327083 learned_addr learned my addr 172.21.15.94:0/1854327083 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb49a59c640 1 --2- 172.21.15.94:0/1854327083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c15e3e0 0x7fb49c15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb499d9b640 1 -- 172.21.15.94:0/1854327083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c15e3e0 msgr2=0x7fb49c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb499d9b640 1 --2- 172.21.15.94:0/1854327083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c15e3e0 0x7fb49c15f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb499d9b640 1 -- 172.21.15.94:0/1854327083 >> v1:172.21.15.155:6789/0 conn(0x7fb49c0b3300 legacy=0x7fb49c161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.974+0000 7fb499d9b640 1 -- 172.21.15.94:0/1854327083 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c15eb10 con 0x7fb49c072dd0 2024-09-11T23:17:26.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb499d9b640 1 --2- 172.21.15.94:0/1854327083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c072dd0 0x7fb49c0aff60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb490009870 tx=0x7fb49001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda8c3cf6eff3c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:26.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49959a640 1 -- 172.21.15.94:0/1854327083 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4900b1070 con 0x7fb49c072dd0 2024-09-11T23:17:26.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49959a640 1 -- 172.21.15.94:0/1854327083 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4900a8050 con 0x7fb49c072dd0 2024-09-11T23:17:26.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49959a640 1 -- 172.21.15.94:0/1854327083 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4900ac860 con 0x7fb49c072dd0 2024-09-11T23:17:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1854327083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c072dd0 msgr2=0x7fb49c0aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1854327083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c072dd0 0x7fb49c0aff60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb490009870 tx=0x7fb49001c4d0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1854327083 shutdown_connections 2024-09-11T23:17:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1854327083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c072dd0 0x7fb49c0aff60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1854327083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c15e3e0 0x7fb49c15f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1854327083 >> 172.21.15.94:0/1854327083 conn(0x7fb49c0b6870 msgr2=0x7fb49c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1854327083 shutdown_connections 2024-09-11T23:17:26.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1854327083 wait complete. 2024-09-11T23:17:26.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 Processor -- start 2024-09-11T23:17:26.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- start start 2024-09-11T23:17:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c072dd0 0x7fb49c167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49c0b3300 0x7fb49c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c15e3e0 0x7fb49c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c162ac0 con 0x7fb49c15e3e0 2024-09-11T23:17:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c162940 con 0x7fb49c0b3300 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb4a0c50640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb49c16b7a0 con 0x7fb49c072dd0 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c15e3e0 0x7fb49c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c15e3e0 0x7fb49c151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54254/0 (socket says 172.21.15.94:54254) 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 -- 172.21.15.94:0/1749616600 learned_addr learned my addr 172.21.15.94:0/1749616600 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49a59c640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c072dd0 0x7fb49c167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb499d9b640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49c0b3300 0x7fb49c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 -- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c072dd0 msgr2=0x7fb49c167740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c072dd0 0x7fb49c167740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 -- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49c0b3300 msgr2=0x7fb49c1571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49c0b3300 0x7fb49c1571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 -- 172.21.15.94:0/1749616600 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c152bc0 con 0x7fb49c15e3e0 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb499d9b640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49c0b3300 0x7fb49c1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.978+0000 7fb49ad9d640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c15e3e0 0x7fb49c151470 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c770 tx=0x7fb49400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb48affd640 1 -- 172.21.15.94:0/1749616600 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494003b80 con 0x7fb49c15e3e0 2024-09-11T23:17:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb48affd640 1 -- 172.21.15.94:0/1749616600 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb494003d20 con 0x7fb49c15e3e0 2024-09-11T23:17:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49c152ea0 con 0x7fb49c15e3e0 2024-09-11T23:17:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb48affd640 1 -- 172.21.15.94:0/1749616600 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49400aa90 con 0x7fb49c15e3e0 2024-09-11T23:17:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49c1537b0 con 0x7fb49c15e3e0 2024-09-11T23:17:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49c0aff60 con 0x7fb49c15e3e0 2024-09-11T23:17:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb48affd640 1 -- 172.21.15.94:0/1749616600 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb49400ac30 con 0x7fb49c15e3e0 2024-09-11T23:17:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb48affd640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb47c0678f0 0x7fb47c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb48affd640 1 -- 172.21.15.94:0/1749616600 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fb494085af0 con 0x7fb49c15e3e0 2024-09-11T23:17:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb49a59c640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb47c0678f0 0x7fb47c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.982+0000 7fb49a59c640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb47c0678f0 0x7fb47c069db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009a50 tx=0x7fb48c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:26.986+0000 7fb48affd640 1 -- 172.21.15.94:0/1749616600 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb494056700 con 0x7fb49c15e3e0 2024-09-11T23:17:27.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.138+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb49c153350 con 0x7fb49c15e3e0 2024-09-11T23:17:27.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.142+0000 7fb48affd640 1 -- 172.21.15.94:0/1749616600 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fb494056000 con 0x7fb49c15e3e0 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb47c0678f0 msgr2=0x7fb47c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb47c0678f0 0x7fb47c069db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009a50 tx=0x7fb48c008040 comp rx=0 tx=0).stop 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c15e3e0 msgr2=0x7fb49c151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c15e3e0 0x7fb49c151470 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c770 tx=0x7fb49400cc30 comp rx=0 tx=0).stop 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 shutdown_connections 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb47c0678f0 0x7fb47c069db0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb49c15e3e0 0x7fb49c151470 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49c0b3300 0x7fb49c1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 --2- 172.21.15.94:0/1749616600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49c072dd0 0x7fb49c167740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 >> 172.21.15.94:0/1749616600 conn(0x7fb49c0b6870 msgr2=0x7fb49c06d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 shutdown_connections 2024-09-11T23:17:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.146+0000 7fb4a0c50640 1 -- 172.21.15.94:0/1749616600 wait complete. 2024-09-11T23:17:27.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2024-09-11T23:17:27.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd6039a7640 1 Processor -- start 2024-09-11T23:17:27.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd6039a7640 1 -- start start 2024-09-11T23:17:27.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd6039a7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5fc070020 0x7fd5fc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd6039a7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5fc0aede0 con 0x7fd5fc15f1d0 2024-09-11T23:17:27.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd6039a7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5fc15fa10 con 0x7fd5fc1520a0 2024-09-11T23:17:27.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd6039a7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd5fc152480 con 0x7fd5fc070020 2024-09-11T23:17:27.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd601f44640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd5fc15f1d0 0x7fd5fc0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36202/0 (socket says 172.21.15.94:36202) 2024-09-11T23:17:27.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd601f44640 1 -- 172.21.15.94:0/4205272379 learned_addr learned my addr 172.21.15.94:0/4205272379 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080995747 0 0) 0x7fd5fc0aede0 con 0x7fd5fc15f1d0 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e8003530 con 0x7fd5fc15f1d0 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd600f42640 1 --2- 172.21.15.94:0/4205272379 >> v2:172.21.15.155:3300/0 conn(0x7fd5fc070020 0x7fd5fc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 228944405 0 0) 0x7fd5e8003530 con 0x7fd5fc15f1d0 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 >> v2:172.21.15.155:3300/0 conn(0x7fd5fc070020 msgr2=0x7fd5fc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 --2- 172.21.15.94:0/4205272379 >> v2:172.21.15.155:3300/0 conn(0x7fd5fc070020 0x7fd5fc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 >> v1:172.21.15.155:6789/0 conn(0x7fd5fc1520a0 legacy=0x7fd5fc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc074250 con 0x7fd5fc15f1d0 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fd5f4001a00 con 0x7fd5fc15f1d0 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 >> v1:172.21.15.94:6789/0 conn(0x7fd5fc15f1d0 legacy=0x7fd5fc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e80039c0 0x7fd5e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5e8004810 0x7fd5e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e80051d0 0x7fd5e800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e800e300 con 0x7fd5e8004810 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e800e4b0 con 0x7fd5e80051d0 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e800e6b0 con 0x7fd5e80039c0 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd600f42640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5e8004810 0x7fd5e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd601f44640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e80051d0 0x7fd5e800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd601743640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e80039c0 0x7fd5e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd600f42640 1 -- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e80039c0 msgr2=0x7fd5e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd600f42640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e80039c0 0x7fd5e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd600f42640 1 -- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e80051d0 msgr2=0x7fd5e800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd600f42640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e80051d0 0x7fd5e800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd600f42640 1 -- 172.21.15.94:0/4205272379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e8003530 con 0x7fd5e8004810 2024-09-11T23:17:27.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd601f44640 1 -- 172.21.15.94:0/4205272379 reap_dead start 2024-09-11T23:17:27.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.282+0000 7fd601743640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e80039c0 0x7fd5e8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:27.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd600f42640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5e8004810 0x7fd5e8004c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00b9e0 tx=0x7fd5ec01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e16fcfc7658c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0b2070 con 0x7fd5e8004810 2024-09-11T23:17:27.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec0ad660 con 0x7fd5e8004810 2024-09-11T23:17:27.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd5f3fff640 1 -- 172.21.15.94:0/4205272379 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00b5e0 con 0x7fd5e8004810 2024-09-11T23:17:27.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- 172.21.15.94:0/4205272379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5e8004810 msgr2=0x7fd5e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5e8004810 0x7fd5e8004c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00b9e0 tx=0x7fd5ec01c640 comp rx=0 tx=0).stop 2024-09-11T23:17:27.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- 172.21.15.94:0/4205272379 shutdown_connections 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 --2- 172.21.15.94:0/4205272379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5e8004810 0x7fd5e8004c90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- 172.21.15.94:0/4205272379 >> 172.21.15.94:0/4205272379 conn(0x7fd5fc0b1f90 msgr2=0x7fd5fc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- 172.21.15.94:0/4205272379 shutdown_connections 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- 172.21.15.94:0/4205272379 wait complete. 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 Processor -- start 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- start start 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e8004810 0x7fd5fc14c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc0cccb0 0x7fd5fc099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5fc1f38a0 0x7fd5fc1f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc073a50 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc073770 con 0x7fd5fc0cccb0 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd6039a7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5fc073d30 con 0x7fd5e8004810 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5fc1f38a0 0x7fd5fc1f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5fc1f38a0 0x7fd5fc1f3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54276/0 (socket says 172.21.15.94:54276) 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 -- 172.21.15.94:0/1112587769 learned_addr learned my addr 172.21.15.94:0/1112587769 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601743640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e8004810 0x7fd5fc14c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd600f42640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc0cccb0 0x7fd5fc099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 -- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e8004810 msgr2=0x7fd5fc14c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e8004810 0x7fd5fc14c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 -- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc0cccb0 msgr2=0x7fd5fc099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc0cccb0 0x7fd5fc099890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601f44640 1 -- 172.21.15.94:0/1112587769 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc15d030 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.286+0000 7fd601743640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e8004810 0x7fd5fc14c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd601f44640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5fc1f38a0 0x7fd5fc1f3d30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0b5960 tx=0x7fd5f40119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd5f1ffb640 1 -- 172.21.15.94:0/1112587769 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4010040 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd5f1ffb640 1 -- 172.21.15.94:0/1112587769 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f401a070 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc0cfd10 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd5f1ffb640 1 -- 172.21.15.94:0/1112587769 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4013a20 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc1f03e0 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5fc068e50 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd5f1ffb640 1 -- 172.21.15.94:0/1112587769 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5f4013bc0 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd5f1ffb640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd5e00678c0 0x7fd5e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd5f1ffb640 1 -- 172.21.15.94:0/1112587769 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fd5f40889f0 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd601743640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd5e00678c0 0x7fd5e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.290+0000 7fd601743640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd5e00678c0 0x7fd5e0069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc15ca30 tx=0x7fd5f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.294+0000 7fd5f1ffb640 1 -- 172.21.15.94:0/1112587769 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd5f40596b0 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.514+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) -- 0x7fd5fc0aede0 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.522+0000 7fd5f1ffb640 1 -- 172.21.15.94:0/1112587769 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v136) ==== 133+0+0 (secure 0 0 0) 0x7fd5f4058fb0 con 0x7fd5fc1f38a0 2024-09-11T23:17:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd5e00678c0 msgr2=0x7fd5e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd5e00678c0 0x7fd5e0069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc15ca30 tx=0x7fd5f8009040 comp rx=0 tx=0).stop 2024-09-11T23:17:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5fc1f38a0 msgr2=0x7fd5fc1f3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5fc1f38a0 0x7fd5fc1f3d30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0b5960 tx=0x7fd5f40119f0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 shutdown_connections 2024-09-11T23:17:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd5e00678c0 0x7fd5e0069d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5fc1f38a0 0x7fd5fc1f3d30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc0cccb0 0x7fd5fc099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 --2- 172.21.15.94:0/1112587769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5e8004810 0x7fd5fc14c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 >> 172.21.15.94:0/1112587769 conn(0x7fd5fc0b1f90 msgr2=0x7fd5fc151890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 shutdown_connections 2024-09-11T23:17:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.526+0000 7fd6039a7640 1 -- 172.21.15.94:0/1112587769 wait complete. 2024-09-11T23:17:27.543 INFO:tasks.cephfs_test_runner:That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). ... ok 2024-09-11T23:17:27.543 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit_fragmented (tasks.cephfs.test_strays.TestStrays) That fragmentation (forced) will allow more entries to be created. 2024-09-11T23:17:27.543 INFO:tasks.cephfs_test_runner:test_dirfrag_limit_fragmented (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:17:27.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:27.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.662+0000 7fe096893640 1 Processor -- start 2024-09-11T23:17:27.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.662+0000 7fe096893640 1 -- start start 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe096893640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe09015c2a0 0x7fe0900aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe096893640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0900b3290 con 0x7fe09015bec0 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe096893640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0900b3570 con 0x7fe0900af2a0 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe096893640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe0900b3850 con 0x7fe09015c2a0 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe09015bec0 0x7fe0900ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36206/0 (socket says 172.21.15.94:36206) 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08ffff640 1 -- 172.21.15.94:0/3235924518 learned_addr learned my addr 172.21.15.94:0/3235924518 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918122795 0 0) 0x7fe0900b3290 con 0x7fe09015bec0 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe078003530 con 0x7fe09015bec0 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08f7fe640 1 --2- 172.21.15.94:0/3235924518 >> v2:172.21.15.155:3300/0 conn(0x7fe09015c2a0 0x7fe0900aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3832782713 0 0) 0x7fe078003530 con 0x7fe09015bec0 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 >> v2:172.21.15.155:3300/0 conn(0x7fe09015c2a0 msgr2=0x7fe0900aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 --2- 172.21.15.94:0/3235924518 >> v2:172.21.15.155:3300/0 conn(0x7fe09015c2a0 0x7fe0900aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 >> v1:172.21.15.155:6789/0 conn(0x7fe0900af2a0 legacy=0x7fe09006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0900b3b30 con 0x7fe09015bec0 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fe080001680 con 0x7fe09015bec0 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 >> v1:172.21.15.94:6789/0 conn(0x7fe09015bec0 legacy=0x7fe0900ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0780039c0 0x7fe078003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe078004810 0x7fe078004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe07800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe0900b3850 con 0x7fe0780051d0 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe07800c120 con 0x7fe078004810 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe07800c320 con 0x7fe0780039c0 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe07800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 -- 172.21.15.94:0/3235924518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0780039c0 msgr2=0x7fe078003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:27.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0780039c0 0x7fe078003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 -- 172.21.15.94:0/3235924518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe078004810 msgr2=0x7fe078004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:27.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe078004810 0x7fe078004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 -- 172.21.15.94:0/3235924518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe078003530 con 0x7fe0780051d0 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 -- 172.21.15.94:0/3235924518 reap_dead start 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe094e30640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe07800b9d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe088001e70 tx=0x7fe08801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d07b05fb37b2fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088001a90 con 0x7fe0780051d0 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe088003bc0 con 0x7fe0780051d0 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.666+0000 7fe08effd640 1 -- 172.21.15.94:0/3235924518 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088005020 con 0x7fe0780051d0 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- 172.21.15.94:0/3235924518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 msgr2=0x7fe07800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe07800b9d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe088001e70 tx=0x7fe08801c780 comp rx=0 tx=0).stop 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- 172.21.15.94:0/3235924518 shutdown_connections 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 --2- 172.21.15.94:0/3235924518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe07800b9d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- 172.21.15.94:0/3235924518 >> 172.21.15.94:0/3235924518 conn(0x7fe0900b1f90 msgr2=0x7fe0900b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:27.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- 172.21.15.94:0/3235924518 shutdown_connections 2024-09-11T23:17:27.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- 172.21.15.94:0/3235924518 wait complete. 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 Processor -- start 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- start start 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe090099ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0901e4900 0x7fe0901547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090155fe0 0x7fe0900b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe0900afc90 con 0x7fe0780051d0 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0900b40f0 con 0x7fe090155fe0 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe0900af710 con 0x7fe0901e4900 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe090099ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe090099ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54290/0 (socket says 172.21.15.94:54290) 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 -- 172.21.15.94:0/3721504011 learned_addr learned my addr 172.21.15.94:0/3721504011 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08f7fe640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0901e4900 0x7fe0901547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe094e30640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090155fe0 0x7fe0900b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 -- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0901e4900 msgr2=0x7fe0901547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0901e4900 0x7fe0901547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 -- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090155fe0 msgr2=0x7fe0900b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090155fe0 0x7fe0900b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 -- 172.21.15.94:0/3721504011 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe090154f40 con 0x7fe0780051d0 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe094e30640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090155fe0 0x7fe0900b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08ffff640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe090099ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe08000c730 tx=0x7fe08000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08cff9640 1 -- 172.21.15.94:0/3721504011 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080018070 con 0x7fe0780051d0 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08cff9640 1 -- 172.21.15.94:0/3721504011 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe080007500 con 0x7fe0780051d0 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe090155220 con 0x7fe0780051d0 2024-09-11T23:17:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe08cff9640 1 -- 172.21.15.94:0/3721504011 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080004a30 con 0x7fe0780051d0 2024-09-11T23:17:27.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.670+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0901557e0 con 0x7fe0780051d0 2024-09-11T23:17:27.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.674+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0901e4ce0 con 0x7fe0780051d0 2024-09-11T23:17:27.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.674+0000 7fe08cff9640 1 -- 172.21.15.94:0/3721504011 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe08001b070 con 0x7fe0780051d0 2024-09-11T23:17:27.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.674+0000 7fe08cff9640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe07c0678c0 0x7fe07c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.674+0000 7fe08cff9640 1 -- 172.21.15.94:0/3721504011 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fe080085010 con 0x7fe0780051d0 2024-09-11T23:17:27.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.674+0000 7fe08f7fe640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe07c0678c0 0x7fe07c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.674+0000 7fe08f7fe640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe07c0678c0 0x7fe07c069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0840047c0 tx=0x7fe084008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.678+0000 7fe08cff9640 1 -- 172.21.15.94:0/3721504011 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe080055d50 con 0x7fe0780051d0 2024-09-11T23:17:27.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.850+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0900aed60 con 0x7fe0780051d0 2024-09-11T23:17:27.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe08cff9640 1 -- 172.21.15.94:0/3721504011 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13329 (secure 0 0 0) 0x7fe080055650 con 0x7fe0780051d0 2024-09-11T23:17:27.853 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:27.853 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":54,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:26.502125+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.94:6835/2087871065":"2024-09-12T23:17:23.487225+0000","172.21.15.94:6834/2087871065":"2024-09-12T23:17:23.487225+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:27.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe07c0678c0 msgr2=0x7fe07c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe07c0678c0 0x7fe07c069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0840047c0 tx=0x7fe084008040 comp rx=0 tx=0).stop 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 msgr2=0x7fe090099ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe090099ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe08000c730 tx=0x7fe08000cbf0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 shutdown_connections 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090155fe0 0x7fe0900b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0901e4900 0x7fe0901547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe07c0678c0 0x7fe07c069d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 --2- 172.21.15.94:0/3721504011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0780051d0 0x7fe090099ad0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 >> 172.21.15.94:0/3721504011 conn(0x7fe0900b1f90 msgr2=0x7fe09015a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 shutdown_connections 2024-09-11T23:17:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.854+0000 7fe096893640 1 -- 172.21.15.94:0/3721504011 wait complete. 2024-09-11T23:17:27.872 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:15:02.040073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:17:27.873 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:17:27.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.982+0000 7f62eba09640 1 Processor -- start 2024-09-11T23:17:27.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.982+0000 7f62eba09640 1 -- start start 2024-09-11T23:17:27.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62eba09640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145680 0x7f62e40b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62eba09640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f62e4145bd0 0x7f62e40afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62eba09640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e4145460 con 0x7f62e4145080 2024-09-11T23:17:27.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62eba09640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f62e40afa10 con 0x7f62e4145bd0 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62eba09640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62e406c990 con 0x7f62e4145680 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e97a5640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f62e4145080 0x7f62e406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36210/0 (socket says 172.21.15.94:36210) 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e97a5640 1 -- 172.21.15.94:0/1776957519 learned_addr learned my addr 172.21.15.94:0/1776957519 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e9fa6640 1 --2- 172.21.15.94:0/1776957519 >> v2:172.21.15.94:3300/0 conn(0x7f62e4145bd0 0x7f62e40afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e3fff640 1 -- 172.21.15.94:0/1776957519 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062509383 0 0) 0x7f62e4145460 con 0x7f62e4145080 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e8fa4640 1 --2- 172.21.15.94:0/1776957519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145680 0x7f62e40b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e3fff640 1 -- 172.21.15.94:0/1776957519 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62cc003530 con 0x7f62e4145080 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e9fa6640 1 -- 172.21.15.94:0/1776957519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145680 msgr2=0x7f62e40b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e9fa6640 1 --2- 172.21.15.94:0/1776957519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145680 0x7f62e40b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e9fa6640 1 -- 172.21.15.94:0/1776957519 >> v1:172.21.15.94:6789/0 conn(0x7f62e4145080 legacy=0x7f62e406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e9fa6640 1 -- 172.21.15.94:0/1776957519 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e41607c0 con 0x7f62e4145bd0 2024-09-11T23:17:27.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e9fa6640 1 --2- 172.21.15.94:0/1776957519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145bd0 0x7f62e40afea0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009d90 tx=0x7f62e40b0bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475e6a1ff19a5d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e3fff640 1 -- 172.21.15.94:0/1776957519 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0b2070 con 0x7f62e4145bd0 2024-09-11T23:17:27.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e3fff640 1 -- 172.21.15.94:0/1776957519 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc0a5830 con 0x7f62e4145bd0 2024-09-11T23:17:27.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.986+0000 7f62e3fff640 1 -- 172.21.15.94:0/1776957519 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0a5c00 con 0x7f62e4145bd0 2024-09-11T23:17:27.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/1776957519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145bd0 msgr2=0x7f62e40afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 --2- 172.21.15.94:0/1776957519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145bd0 0x7f62e40afea0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009d90 tx=0x7f62e40b0bf0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/1776957519 shutdown_connections 2024-09-11T23:17:27.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 --2- 172.21.15.94:0/1776957519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145bd0 0x7f62e40afea0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 --2- 172.21.15.94:0/1776957519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145680 0x7f62e40b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/1776957519 >> 172.21.15.94:0/1776957519 conn(0x7f62e409aa00 msgr2=0x7f62e40b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:27.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/1776957519 shutdown_connections 2024-09-11T23:17:27.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/1776957519 wait complete. 2024-09-11T23:17:27.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 Processor -- start 2024-09-11T23:17:27.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- start start 2024-09-11T23:17:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145080 0x7f62e4139450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e4145680 0x7f62e40b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145bd0 0x7f62e415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4169150 con 0x7f62e4145080 2024-09-11T23:17:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4168fd0 con 0x7f62e4145680 2024-09-11T23:17:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62e41692d0 con 0x7f62e4145bd0 2024-09-11T23:17:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145080 0x7f62e4139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145080 0x7f62e4139450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54314/0 (socket says 172.21.15.94:54314) 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 -- 172.21.15.94:0/294742024 learned_addr learned my addr 172.21.15.94:0/294742024 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e8fa4640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e4145680 0x7f62e40b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e9fa6640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145bd0 0x7f62e415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 -- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145bd0 msgr2=0x7f62e415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145bd0 0x7f62e415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 -- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e4145680 msgr2=0x7f62e40b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e4145680 0x7f62e40b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 -- 172.21.15.94:0/294742024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e413bd50 con 0x7f62e4145080 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e97a5640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145080 0x7f62e4139450 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c460 tx=0x7f62d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e1ffb640 1 -- 172.21.15.94:0/294742024 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4017070 con 0x7f62e4145080 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e1ffb640 1 -- 172.21.15.94:0/294742024 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4005d10 con 0x7f62e4145080 2024-09-11T23:17:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62e1ffb640 1 -- 172.21.15.94:0/294742024 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d40072b0 con 0x7f62e4145080 2024-09-11T23:17:27.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e413c030 con 0x7f62e4145080 2024-09-11T23:17:27.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e415c8a0 con 0x7f62e4145080 2024-09-11T23:17:27.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.990+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e40afea0 con 0x7f62e4145080 2024-09-11T23:17:27.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.994+0000 7f62e1ffb640 1 -- 172.21.15.94:0/294742024 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62d401a070 con 0x7f62e4145080 2024-09-11T23:17:27.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.994+0000 7f62e1ffb640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62d00678c0 0x7f62d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.994+0000 7f62e1ffb640 1 -- 172.21.15.94:0/294742024 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f62d4084e10 con 0x7f62e4145080 2024-09-11T23:17:27.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.994+0000 7f62e8fa4640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62d00678c0 0x7f62d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.994+0000 7f62e8fa4640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62d00678c0 0x7f62d0069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62e40b3b70 tx=0x7f62d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:27.998+0000 7f62e1ffb640 1 -- 172.21.15.94:0/294742024 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f62d4055b50 con 0x7f62e4145080 2024-09-11T23:17:28.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.158+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62e409f370 con 0x7f62e4145080 2024-09-11T23:17:28.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.158+0000 7f62e1ffb640 1 -- 172.21.15.94:0/294742024 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f62d4055450 con 0x7f62e4145080 2024-09-11T23:17:28.161 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62d00678c0 msgr2=0x7f62d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62d00678c0 0x7f62d0069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62e40b3b70 tx=0x7f62d8008040 comp rx=0 tx=0).stop 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145080 msgr2=0x7f62e4139450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145080 0x7f62e4139450 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c460 tx=0x7f62d400c920 comp rx=0 tx=0).stop 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 shutdown_connections 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62e4145bd0 0x7f62e415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e4145680 0x7f62e40b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62d00678c0 0x7f62d0069d80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 --2- 172.21.15.94:0/294742024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e4145080 0x7f62e4139450 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 >> 172.21.15.94:0/294742024 conn(0x7f62e409aa00 msgr2=0x7f62e40b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 shutdown_connections 2024-09-11T23:17:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.162+0000 7f62eba09640 1 -- 172.21.15.94:0/294742024 wait complete. 2024-09-11T23:17:28.179 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented' 2024-09-11T23:17:28.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d1760a640 1 Processor -- start 2024-09-11T23:17:28.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d1760a640 1 -- start start 2024-09-11T23:17:28.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d1760a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d100d3060 0x7f2d100cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d1760a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2d100cf450 0x7f2d1006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d1760a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d100d0300 con 0x7f2d10161a60 2024-09-11T23:17:28.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d1760a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2d100b0f60 con 0x7f2d100cf450 2024-09-11T23:17:28.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d1760a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2d100cfd40 con 0x7f2d100d3060 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d15ba7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2d100cf450 0x7f2d1006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d15ba7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2d100cf450 0x7f2d1006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54328/0 (socket says 172.21.15.94:54328) 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d15ba7640 1 -- 172.21.15.94:0/3401287137 learned_addr learned my addr 172.21.15.94:0/3401287137 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d14ba5640 1 --2- 172.21.15.94:0/3401287137 >> v2:172.21.15.155:3300/0 conn(0x7f2d100d3060 0x7f2d100cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d15ba7640 1 -- 172.21.15.94:0/3401287137 >> v2:172.21.15.155:3300/0 conn(0x7f2d100d3060 msgr2=0x7f2d100cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d15ba7640 1 --2- 172.21.15.94:0/3401287137 >> v2:172.21.15.155:3300/0 conn(0x7f2d100d3060 0x7f2d100cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d15ba7640 1 -- 172.21.15.94:0/3401287137 >> v1:172.21.15.155:6789/0 conn(0x7f2d10161a60 legacy=0x7f2d100d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d15ba7640 1 -- 172.21.15.94:0/3401287137 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d100d0020 con 0x7f2d100cf450 2024-09-11T23:17:28.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.298+0000 7f2d14ba5640 1 --2- 172.21.15.94:0/3401287137 >> v2:172.21.15.155:3300/0 conn(0x7f2d100d3060 0x7f2d100cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:28.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d15ba7640 1 --2- 172.21.15.94:0/3401287137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100cf450 0x7f2d1006d6b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2d1008d850 tx=0x7f2d0801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815297f2a5a353cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:28.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d07fff640 1 -- 172.21.15.94:0/3401287137 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d080a55d0 con 0x7f2d100cf450 2024-09-11T23:17:28.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d07fff640 1 -- 172.21.15.94:0/3401287137 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d080a5770 con 0x7f2d100cf450 2024-09-11T23:17:28.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d07fff640 1 -- 172.21.15.94:0/3401287137 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d080a5b40 con 0x7f2d100cf450 2024-09-11T23:17:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 -- 172.21.15.94:0/3401287137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100cf450 msgr2=0x7f2d1006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3401287137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100cf450 0x7f2d1006d6b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2d1008d850 tx=0x7f2d0801c710 comp rx=0 tx=0).stop 2024-09-11T23:17:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 -- 172.21.15.94:0/3401287137 shutdown_connections 2024-09-11T23:17:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3401287137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100cf450 0x7f2d1006d6b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3401287137 >> v2:172.21.15.155:3300/0 conn(0x7f2d100d3060 0x7f2d100cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 -- 172.21.15.94:0/3401287137 >> 172.21.15.94:0/3401287137 conn(0x7f2d1008bf90 msgr2=0x7f2d1009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 -- 172.21.15.94:0/3401287137 shutdown_connections 2024-09-11T23:17:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 -- 172.21.15.94:0/3401287137 wait complete. 2024-09-11T23:17:28.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 Processor -- start 2024-09-11T23:17:28.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.302+0000 7f2d1760a640 1 -- start start 2024-09-11T23:17:28.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d100cf450 0x7f2d100c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100d3060 0x7f2d100c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d10161a60 0x7f2d10159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1006e400 con 0x7f2d100d3060 2024-09-11T23:17:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d100cfad0 con 0x7f2d100cf450 2024-09-11T23:17:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1006e580 con 0x7f2d10161a60 2024-09-11T23:17:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100d3060 0x7f2d100c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100d3060 0x7f2d100c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54334/0 (socket says 172.21.15.94:54334) 2024-09-11T23:17:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 -- 172.21.15.94:0/3214944491 learned_addr learned my addr 172.21.15.94:0/3214944491 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d153a6640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d100cf450 0x7f2d100c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d15ba7640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d10161a60 0x7f2d10159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 -- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d10161a60 msgr2=0x7f2d10159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d10161a60 0x7f2d10159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 -- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d100cf450 msgr2=0x7f2d100c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d100cf450 0x7f2d100c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 -- 172.21.15.94:0/3214944491 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d100c86d0 con 0x7f2d100d3060 2024-09-11T23:17:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d14ba5640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100d3060 0x7f2d100c7e80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c7f0 tx=0x7f2d0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d153a6640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d100cf450 0x7f2d100c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d05ffb640 1 -- 172.21.15.94:0/3214944491 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00015070 con 0x7f2d100d3060 2024-09-11T23:17:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d100c89b0 con 0x7f2d100d3060 2024-09-11T23:17:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d05ffb640 1 -- 172.21.15.94:0/3214944491 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d00007820 con 0x7f2d100d3060 2024-09-11T23:17:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d05ffb640 1 -- 172.21.15.94:0/3214944491 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00007bf0 con 0x7f2d100d3060 2024-09-11T23:17:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d100c7c00 con 0x7f2d100d3060 2024-09-11T23:17:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.306+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1006d6b0 con 0x7f2d100d3060 2024-09-11T23:17:28.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.310+0000 7f2d05ffb640 1 -- 172.21.15.94:0/3214944491 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d00018070 con 0x7f2d100d3060 2024-09-11T23:17:28.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.310+0000 7f2d05ffb640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2cf40678c0 0x7f2cf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.310+0000 7f2d05ffb640 1 -- 172.21.15.94:0/3214944491 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f2d00086030 con 0x7f2d100d3060 2024-09-11T23:17:28.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.310+0000 7f2d153a6640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2cf40678c0 0x7f2cf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.310+0000 7f2d153a6640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2cf40678c0 0x7f2cf4069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009890 tx=0x7f2d0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:28.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.314+0000 7f2d05ffb640 1 -- 172.21.15.94:0/3214944491 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2d00056720 con 0x7f2d100d3060 2024-09-11T23:17:28.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.522+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]} v 0) -- 0x7f2d1009da80 con 0x7f2d100d3060 2024-09-11T23:17:28.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.530+0000 7f2d05ffb640 1 -- 172.21.15.94:0/3214944491 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]}]=0 v137) ==== 147+0+0 (secure 0 0 0) 0x7f2d0005aa20 con 0x7f2d100d3060 2024-09-11T23:17:28.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2cf40678c0 msgr2=0x7f2cf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2cf40678c0 0x7f2cf4069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009890 tx=0x7f2d0c008040 comp rx=0 tx=0).stop 2024-09-11T23:17:28.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100d3060 msgr2=0x7f2d100c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100d3060 0x7f2d100c7e80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c7f0 tx=0x7f2d0000ccb0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 shutdown_connections 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d10161a60 0x7f2d10159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2cf40678c0 0x7f2cf4069d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d100d3060 0x7f2d100c7e80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 --2- 172.21.15.94:0/3214944491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d100cf450 0x7f2d100c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 >> 172.21.15.94:0/3214944491 conn(0x7f2d1008bf90 msgr2=0x7f2d100b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 shutdown_connections 2024-09-11T23:17:28.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.534+0000 7f2d1760a640 1 -- 172.21.15.94:0/3214944491 wait complete. 2024-09-11T23:17:28.550 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:17:28.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 Processor -- start 2024-09-11T23:17:28.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 -- start start 2024-09-11T23:17:28.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815bec0 0x7f02480ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f024815c2a0 0x7f02480aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02480af2a0 0x7f024815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f02480b3290 con 0x7f024815c2a0 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f02480b3570 con 0x7f02480af2a0 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f02501c3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02480b3850 con 0x7f024815bec0 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f024815c2a0 0x7f02480aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f024815c2a0 0x7f02480aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54344/0 (socket says 172.21.15.94:54344) 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 -- 172.21.15.94:0/80741143 learned_addr learned my addr 172.21.15.94:0/80741143 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 -- 172.21.15.94:0/80741143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815bec0 msgr2=0x7f02480ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024e760640 1 --2- 172.21.15.94:0/80741143 >> v2:172.21.15.155:3300/0 conn(0x7f02480af2a0 0x7f024815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024df5f640 1 --2- 172.21.15.94:0/80741143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815bec0 0x7f02480ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 --2- 172.21.15.94:0/80741143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815bec0 0x7f02480ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 -- 172.21.15.94:0/80741143 >> v2:172.21.15.155:3300/0 conn(0x7f02480af2a0 msgr2=0x7f024815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:28.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 --2- 172.21.15.94:0/80741143 >> v2:172.21.15.155:3300/0 conn(0x7f02480af2a0 0x7f024815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024d75e640 1 -- 172.21.15.94:0/80741143 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02480b3b30 con 0x7f024815c2a0 2024-09-11T23:17:28.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.674+0000 7f024e760640 1 --2- 172.21.15.94:0/80741143 >> v2:172.21.15.155:3300/0 conn(0x7f02480af2a0 0x7f024815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:28.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 --2- 172.21.15.94:0/80741143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815c2a0 0x7f02480aed60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f02480ada40 tx=0x7f023801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f6ee887d7281e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:28.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024cf5d640 1 -- 172.21.15.94:0/80741143 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02380b0070 con 0x7f024815c2a0 2024-09-11T23:17:28.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024cf5d640 1 -- 172.21.15.94:0/80741143 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02380ab600 con 0x7f024815c2a0 2024-09-11T23:17:28.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024cf5d640 1 -- 172.21.15.94:0/80741143 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02380ab9d0 con 0x7f024815c2a0 2024-09-11T23:17:28.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- 172.21.15.94:0/80741143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815c2a0 msgr2=0x7f02480aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 --2- 172.21.15.94:0/80741143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815c2a0 0x7f02480aed60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f02480ada40 tx=0x7f023801c230 comp rx=0 tx=0).stop 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- 172.21.15.94:0/80741143 shutdown_connections 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 --2- 172.21.15.94:0/80741143 >> v2:172.21.15.155:3300/0 conn(0x7f02480af2a0 0x7f024815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 --2- 172.21.15.94:0/80741143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815c2a0 0x7f02480aed60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 --2- 172.21.15.94:0/80741143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815bec0 0x7f02480ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- 172.21.15.94:0/80741143 >> 172.21.15.94:0/80741143 conn(0x7f02480b1f90 msgr2=0x7f02480b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- 172.21.15.94:0/80741143 shutdown_connections 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- 172.21.15.94:0/80741143 wait complete. 2024-09-11T23:17:28.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 Processor -- start 2024-09-11T23:17:28.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- start start 2024-09-11T23:17:28.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02480af2a0 0x7f024815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815bec0 0x7f024809d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815c2a0 0x7f0248154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f02480af6b0 con 0x7f024815bec0 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02480ad740 con 0x7f02480af2a0 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f02501c3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f024806e000 con 0x7f024815c2a0 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815bec0 0x7f024809d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815bec0 0x7f024809d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54350/0 (socket says 172.21.15.94:54350) 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 -- 172.21.15.94:0/3849226449 learned_addr learned my addr 172.21.15.94:0/3849226449 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 -- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815c2a0 msgr2=0x7f0248154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815c2a0 0x7f0248154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 -- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02480af2a0 msgr2=0x7f024815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02480af2a0 0x7f024815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 -- 172.21.15.94:0/3849226449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024809da00 con 0x7f024815bec0 2024-09-11T23:17:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f024d75e640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815bec0 0x7f024809d0b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f023801cad0 tx=0x7f0238018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.678+0000 7f023e7fc640 1 -- 172.21.15.94:0/3849226449 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02380b0050 con 0x7f024815bec0 2024-09-11T23:17:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f023e7fc640 1 -- 172.21.15.94:0/3849226449 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02380bc070 con 0x7f024815bec0 2024-09-11T23:17:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f023e7fc640 1 -- 172.21.15.94:0/3849226449 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02380b5a50 con 0x7f024815bec0 2024-09-11T23:17:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024809dce0 con 0x7f024815bec0 2024-09-11T23:17:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024809e2a0 con 0x7f024815bec0 2024-09-11T23:17:28.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02480ad200 con 0x7f024815bec0 2024-09-11T23:17:28.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f023e7fc640 1 -- 172.21.15.94:0/3849226449 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02380b5bf0 con 0x7f024815bec0 2024-09-11T23:17:28.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f023e7fc640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f022c0678c0 0x7f022c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f023e7fc640 1 -- 172.21.15.94:0/3849226449 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f0238120440 con 0x7f024815bec0 2024-09-11T23:17:28.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f024df5f640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f022c0678c0 0x7f022c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.682+0000 7f024df5f640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f022c0678c0 0x7f022c069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0244006b20 tx=0x7f0244008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:28.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.686+0000 7f023e7fc640 1 -- 172.21.15.94:0/3849226449 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0238016110 con 0x7f024815bec0 2024-09-11T23:17:28.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.850+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f024806fcd0 con 0x7f024815bec0 2024-09-11T23:17:28.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f023e7fc640 1 -- 172.21.15.94:0/3849226449 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f02380f0aa0 con 0x7f024815bec0 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f022c0678c0 msgr2=0x7f022c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f022c0678c0 0x7f022c069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0244006b20 tx=0x7f0244008040 comp rx=0 tx=0).stop 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815bec0 msgr2=0x7f024809d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815bec0 0x7f024809d0b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f023801cad0 tx=0x7f0238018fd0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 shutdown_connections 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f024815c2a0 0x7f0248154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f022c0678c0 0x7f022c069d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024815bec0 0x7f024809d0b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 --2- 172.21.15.94:0/3849226449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02480af2a0 0x7f024815dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 >> 172.21.15.94:0/3849226449 conn(0x7f02480b1f90 msgr2=0x7f02480b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:28.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 shutdown_connections 2024-09-11T23:17:28.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:28.858+0000 7f02501c3640 1 -- 172.21.15.94:0/3849226449 wait complete. 2024-09-11T23:17:28.877 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:17:28.877 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:17:28.906 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:17:28.953 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:17:28.954 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:28.954 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:28.959 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:17:28.959 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:17:28.959 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:28.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:17:28.965 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:28.965 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:29.005 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:17:29.005 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:17:29.005 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:29.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:17:29.012 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:17:29.013 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0712a4a640 1 Processor -- start 2024-09-11T23:17:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0712a4a640 1 -- start start 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0712a4a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c15c2a0 0x7f070c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0712a4a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f070c0af2a0 0x7f070c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0712a4a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070c0b3290 con 0x7f070c15bec0 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0712a4a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f070c0b3570 con 0x7f070c0af2a0 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0712a4a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f070c0b3850 con 0x7f070c15c2a0 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0710fe7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f070c0af2a0 0x7f070c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0710fe7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f070c0af2a0 0x7f070c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54364/0 (socket says 172.21.15.94:54364) 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0710fe7640 1 -- 172.21.15.94:0/2372991299 learned_addr learned my addr 172.21.15.94:0/2372991299 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f070b7fe640 1 --2- 172.21.15.94:0/2372991299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c15c2a0 0x7f070c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0710fe7640 1 -- 172.21.15.94:0/2372991299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c15c2a0 msgr2=0x7f070c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0710fe7640 1 --2- 172.21.15.94:0/2372991299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c15c2a0 0x7f070c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0710fe7640 1 -- 172.21.15.94:0/2372991299 >> v1:172.21.15.155:6789/0 conn(0x7f070c15bec0 legacy=0x7f070c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:29.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.170+0000 7f0710fe7640 1 -- 172.21.15.94:0/2372991299 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c0b3b30 con 0x7f070c0af2a0 2024-09-11T23:17:29.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0710fe7640 1 --2- 172.21.15.94:0/2372991299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c0af2a0 0x7f070c06e000 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0704009e50 tx=0x7f070401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6462ee51a4b855a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f070affd640 1 -- 172.21.15.94:0/2372991299 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07040a5840 con 0x7f070c0af2a0 2024-09-11T23:17:29.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f070affd640 1 -- 172.21.15.94:0/2372991299 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07040a59e0 con 0x7f070c0af2a0 2024-09-11T23:17:29.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f070affd640 1 -- 172.21.15.94:0/2372991299 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07040a5db0 con 0x7f070c0af2a0 2024-09-11T23:17:29.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 -- 172.21.15.94:0/2372991299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c0af2a0 msgr2=0x7f070c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 --2- 172.21.15.94:0/2372991299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c0af2a0 0x7f070c06e000 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0704009e50 tx=0x7f070401c9c0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 -- 172.21.15.94:0/2372991299 shutdown_connections 2024-09-11T23:17:29.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 --2- 172.21.15.94:0/2372991299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c0af2a0 0x7f070c06e000 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 --2- 172.21.15.94:0/2372991299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c15c2a0 0x7f070c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 -- 172.21.15.94:0/2372991299 >> 172.21.15.94:0/2372991299 conn(0x7f070c0b1f90 msgr2=0x7f070c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:29.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 -- 172.21.15.94:0/2372991299 shutdown_connections 2024-09-11T23:17:29.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.174+0000 7f0712a4a640 1 -- 172.21.15.94:0/2372991299 wait complete. 2024-09-11T23:17:29.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 Processor -- start 2024-09-11T23:17:29.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 -- start start 2024-09-11T23:17:29.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c0af2a0 0x7f070c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c15bec0 0x7f070c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f070c15c2a0 0x7f070c14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f070c06ed50 con 0x7f070c15bec0 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f070c0afc90 con 0x7f070c15c2a0 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f070c06eed0 con 0x7f070c0af2a0 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c15bec0 0x7f070c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c15bec0 0x7f070c14e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54380/0 (socket says 172.21.15.94:54380) 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 -- 172.21.15.94:0/1005947750 learned_addr learned my addr 172.21.15.94:0/1005947750 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0710fe7640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f070c15c2a0 0x7f070c14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070bfff640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c0af2a0 0x7f070c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 -- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c0af2a0 msgr2=0x7f070c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c0af2a0 0x7f070c150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 -- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f070c15c2a0 msgr2=0x7f070c14a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f070c15c2a0 0x7f070c14a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 -- 172.21.15.94:0/1005947750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c14e610 con 0x7f070c15bec0 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070bfff640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c0af2a0 0x7f070c150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f070b7fe640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c15bec0 0x7f070c14e0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c7f0 tx=0x7f06fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0708ff9640 1 -- 172.21.15.94:0/1005947750 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc015070 con 0x7f070c15bec0 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0708ff9640 1 -- 172.21.15.94:0/1005947750 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc007820 con 0x7f070c15bec0 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c14e890 con 0x7f070c15bec0 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0708ff9640 1 -- 172.21.15.94:0/1005947750 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc007c10 con 0x7f070c15bec0 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c14ee50 con 0x7f070c15bec0 2024-09-11T23:17:29.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070c06e000 con 0x7f070c15bec0 2024-09-11T23:17:29.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0708ff9640 1 -- 172.21.15.94:0/1005947750 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06fc018070 con 0x7f070c15bec0 2024-09-11T23:17:29.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0708ff9640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06f80678c0 0x7f06f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.178+0000 7f0708ff9640 1 -- 172.21.15.94:0/1005947750 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f06fc085b20 con 0x7f070c15bec0 2024-09-11T23:17:29.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.182+0000 7f070bfff640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06f80678c0 0x7f06f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.182+0000 7f070bfff640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06f80678c0 0x7f06f8069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f070c155ef0 tx=0x7f0700009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.186+0000 7f0708ff9640 1 -- 172.21.15.94:0/1005947750 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f070c14e610 con 0x7f070c15bec0 2024-09-11T23:17:29.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f070c06fcd0 con 0x7f070c15bec0 2024-09-11T23:17:29.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0708ff9640 1 -- 172.21.15.94:0/1005947750 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+3917 (secure 0 0 0) 0x7f06fc056860 con 0x7f070c15bec0 2024-09-11T23:17:29.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:29.374 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"btime":"2024-09-11T23:17:24:490390+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2442107241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2442107241},{"type":"v1","addr":"172.21.15.155:6837","nonce":2442107241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1638163040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1638163040},{"type":"v1","addr":"172.21.15.155:6836","nonce":1638163040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/2826826443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2826826443},{"type":"v1","addr":"172.21.15.94:6833","nonce":2826826443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2474711536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2474711536},{"type":"v1","addr":"172.21.15.94:6835","nonce":2474711536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[]} 2024-09-11T23:17:29.374 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 26 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06f80678c0 msgr2=0x7f06f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06f80678c0 0x7f06f8069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f070c155ef0 tx=0x7f0700009040 comp rx=0 tx=0).stop 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c15bec0 msgr2=0x7f070c14e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c15bec0 0x7f070c14e0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c7f0 tx=0x7f06fc00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 shutdown_connections 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f070c15c2a0 0x7f070c14a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06f80678c0 0x7f06f8069d80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f070c15bec0 0x7f070c14e0d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 --2- 172.21.15.94:0/1005947750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f070c0af2a0 0x7f070c150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 >> 172.21.15.94:0/1005947750 conn(0x7f070c0b1f90 msgr2=0x7f070c15af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:29.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 shutdown_connections 2024-09-11T23:17:29.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.374+0000 7f0712a4a640 1 -- 172.21.15.94:0/1005947750 wait complete. 2024-09-11T23:17:29.392 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:17:29.392 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:17:29.392 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:17:29.392 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:17:29.392 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:17:29.393 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:17:29.393 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:17:29.393 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:17:29.393 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:17:29.393 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:17:29.393 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:17:29.393 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:17:29.394 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:17:29.394 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:17:29.394 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:17:29.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:17:29.402 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:17:29.402 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:17:29.403 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:17:29.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:17:29.411 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:17:29.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:17:29.412 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:17:29.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:17:29.450 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:17:29.450 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:29.451 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:17:29.451 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:29.457 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:17:29.457 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:29.458 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:17:29.458 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:29.458 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:17:29.508 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:17:29.510 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:17:29.529 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:17:29.532 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:17:29.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.566+0000 7f18b3c1b640 1 Processor -- start 2024-09-11T23:17:29.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.566+0000 7f18b3c1b640 1 -- start start 2024-09-11T23:17:29.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b3c1b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac15e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b3c1b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18ac15f8d0 0x7f18ac15fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b3c1b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18ac15f180 con 0x7f18ac15ecb0 2024-09-11T23:17:29.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b3c1b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f18ac160270 con 0x7f18ac15f8d0 2024-09-11T23:17:29.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b3c1b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac15f460 con 0x7f18ac0b5cf0 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b19b7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b21b8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18ac15f8d0 0x7f18ac15fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b19b7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac15e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:37166/0 (socket says 172.21.15.94:37166) 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b19b7640 1 -- 172.21.15.94:0/1658477374 learned_addr learned my addr 172.21.15.94:0/1658477374 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b09b5640 1 -- 172.21.15.94:0/1658477374 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082582098 0 0) 0x7f18ac15f180 con 0x7f18ac15ecb0 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b09b5640 1 -- 172.21.15.94:0/1658477374 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1894003530 con 0x7f18ac15ecb0 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b21b8640 1 -- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 msgr2=0x7f18ac15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b21b8640 1 --2- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b21b8640 1 -- 172.21.15.94:0/1658477374 >> v1:172.21.15.155:6789/0 conn(0x7f18ac15ecb0 legacy=0x7f18ac06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b21b8640 1 -- 172.21.15.94:0/1658477374 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac06d440 con 0x7f18ac15f8d0 2024-09-11T23:17:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b19b7640 1 --2- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:29.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b21b8640 1 --2- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 0x7f18ac15fd30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f189c009d90 tx=0x7f189c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d270331e413f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b09b5640 1 -- 172.21.15.94:0/1658477374 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c0b2070 con 0x7f18ac15f8d0 2024-09-11T23:17:29.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b09b5640 1 -- 172.21.15.94:0/1658477374 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189c0a57a0 con 0x7f18ac15f8d0 2024-09-11T23:17:29.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.570+0000 7f18b09b5640 1 -- 172.21.15.94:0/1658477374 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c0a5b70 con 0x7f18ac15f8d0 2024-09-11T23:17:29.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 msgr2=0x7f18ac15fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 0x7f18ac15fd30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f189c009d90 tx=0x7f189c01c8e0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- 172.21.15.94:0/1658477374 shutdown_connections 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 0x7f18ac15fd30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/1658477374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- 172.21.15.94:0/1658477374 >> 172.21.15.94:0/1658477374 conn(0x7f18ac06c0c0 msgr2=0x7f18ac06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- 172.21.15.94:0/1658477374 shutdown_connections 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- 172.21.15.94:0/1658477374 wait complete. 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 Processor -- start 2024-09-11T23:17:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- start start 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac14c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18ac15ecb0 0x7f18ac137f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 0x7f18ac138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac16b0a0 con 0x7f18ac15ecb0 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac16af20 con 0x7f18ac15f8d0 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac16b220 con 0x7f18ac0b5cf0 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18ac15ecb0 0x7f18ac137f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18ac15ecb0 0x7f18ac137f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54412/0 (socket says 172.21.15.94:54412) 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 -- 172.21.15.94:0/2197373950 learned_addr learned my addr 172.21.15.94:0/2197373950 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b19b7640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac14c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b21b8640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 0x7f18ac138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 -- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 msgr2=0x7f18ac14c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac14c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 -- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 msgr2=0x7f18ac138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 0x7f18ac138480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 -- 172.21.15.94:0/2197373950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac14ce60 con 0x7f18ac15ecb0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b11b6640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18ac15ecb0 0x7f18ac137f40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c410 tx=0x7f18a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18aa7fc640 1 -- 172.21.15.94:0/2197373950 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0017070 con 0x7f18ac15ecb0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18aa7fc640 1 -- 172.21.15.94:0/2197373950 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a00052f0 con 0x7f18ac15ecb0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ac138ab0 con 0x7f18ac15ecb0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18aa7fc640 1 -- 172.21.15.94:0/2197373950 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0003840 con 0x7f18ac15ecb0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.574+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ac139070 con 0x7f18ac15ecb0 2024-09-11T23:17:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.578+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ac15e770 con 0x7f18ac15ecb0 2024-09-11T23:17:29.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.578+0000 7f18aa7fc640 1 -- 172.21.15.94:0/2197373950 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18a001a070 con 0x7f18ac15ecb0 2024-09-11T23:17:29.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.578+0000 7f18aa7fc640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18980678c0 0x7f1898069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.578+0000 7f18aa7fc640 1 -- 172.21.15.94:0/2197373950 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7f18a0084e10 con 0x7f18ac15ecb0 2024-09-11T23:17:29.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.578+0000 7f18b19b7640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18980678c0 0x7f1898069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.578+0000 7f18b19b7640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18980678c0 0x7f1898069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f18a4006cb0 tx=0x7f18a4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.582+0000 7f18aa7fc640 1 -- 172.21.15.94:0/2197373950 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f18a0055500 con 0x7f18ac15ecb0 2024-09-11T23:17:29.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:29.742+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f18ac069170 con 0x7f18ac15ecb0 2024-09-11T23:17:30.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.546+0000 7f18aa7fc640 1 -- 172.21.15.94:0/2197373950 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) ==== 97+0+0 (secure 0 0 0) 0x7f18a0059800 con 0x7f18ac15ecb0 2024-09-11T23:17:30.546 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2024-09-11T23:17:30.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18980678c0 msgr2=0x7f1898069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18980678c0 0x7f1898069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f18a4006cb0 tx=0x7f18a4009240 comp rx=0 tx=0).stop 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18ac15ecb0 msgr2=0x7f18ac137f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18ac15ecb0 0x7f18ac137f40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c410 tx=0x7f18a000c8d0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 shutdown_connections 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac15f8d0 0x7f18ac138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18980678c0 0x7f1898069d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18ac15ecb0 0x7f18ac137f40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 --2- 172.21.15.94:0/2197373950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18ac0b5cf0 0x7f18ac14c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 >> 172.21.15.94:0/2197373950 conn(0x7f18ac06c0c0 msgr2=0x7f18ac070790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 shutdown_connections 2024-09-11T23:17:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.550+0000 7f18b3c1b640 1 -- 172.21.15.94:0/2197373950 wait complete. 2024-09-11T23:17:30.574 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:17:30.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8691294640 1 Processor -- start 2024-09-11T23:17:30.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8691294640 1 -- start start 2024-09-11T23:17:30.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8691294640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f868c06f010 0x7f868c166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8691294640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c0b3290 con 0x7f868c15c2a0 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8691294640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c0b3570 con 0x7f868c15bec0 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8691294640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f868c0b3850 con 0x7f868c06f010 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868a7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f868c15c2a0 0x7f868c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58050/0 (socket says 172.21.15.94:58050) 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868a7fc640 1 -- 172.21.15.94:0/1468732200 learned_addr learned my addr 172.21.15.94:0/1468732200 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460141407 0 0) 0x7f868c0b3290 con 0x7f868c15c2a0 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8674003530 con 0x7f868c15c2a0 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868b7fe640 1 --2- 172.21.15.94:0/1468732200 >> v2:172.21.15.155:3300/0 conn(0x7f868c06f010 0x7f868c166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3886790636 0 0) 0x7f8674003530 con 0x7f868c15c2a0 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 >> v2:172.21.15.155:3300/0 conn(0x7f868c06f010 msgr2=0x7f868c166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:30.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 --2- 172.21.15.94:0/1468732200 >> v2:172.21.15.155:3300/0 conn(0x7f868c06f010 0x7f868c166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 >> v1:172.21.15.155:6789/0 conn(0x7f868c15bec0 legacy=0x7f868c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c0b3b30 con 0x7f868c15c2a0 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f867c001680 con 0x7f868c15c2a0 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 >> v1:172.21.15.94:6789/0 conn(0x7f868c15c2a0 legacy=0x7f868c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86740039c0 0x7f8674003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674004810 0x7f8674004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f867400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0b3850 con 0x7f86740051d0 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f867400c120 con 0x7f8674004810 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f867400c320 con 0x7f86740039c0 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868b7fe640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f867400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868a7fc640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674004810 0x7f8674004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868affd640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86740039c0 0x7f8674003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868b7fe640 1 -- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86740039c0 msgr2=0x7f8674003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868b7fe640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86740039c0 0x7f8674003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868b7fe640 1 -- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674004810 msgr2=0x7f8674004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868b7fe640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674004810 0x7f8674004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.742+0000 7f868b7fe640 1 -- 172.21.15.94:0/1468732200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8674003530 con 0x7f86740051d0 2024-09-11T23:17:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868b7fe640 1 -- 172.21.15.94:0/1468732200 reap_dead start 2024-09-11T23:17:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868b7fe640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f867400b9d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8684009fc0 tx=0x7f868401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827ea0b184d79935 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684009bc0 con 0x7f86740051d0 2024-09-11T23:17:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86840a5d60 con 0x7f86740051d0 2024-09-11T23:17:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8689ffb640 1 -- 172.21.15.94:0/1468732200 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840ad680 con 0x7f86740051d0 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- 172.21.15.94:0/1468732200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 msgr2=0x7f867400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f867400b9d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8684009fc0 tx=0x7f868401ce40 comp rx=0 tx=0).stop 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- 172.21.15.94:0/1468732200 shutdown_connections 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 --2- 172.21.15.94:0/1468732200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f867400b9d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- 172.21.15.94:0/1468732200 >> 172.21.15.94:0/1468732200 conn(0x7f868c0b1f90 msgr2=0x7f868c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- 172.21.15.94:0/1468732200 shutdown_connections 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- 172.21.15.94:0/1468732200 wait complete. 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 Processor -- start 2024-09-11T23:17:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- start start 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f868c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f868c14a7d0 0x7f868c154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f868c152df0 0x7f868c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0afc90 con 0x7f86740051d0 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0b40f0 con 0x7f868c14a7d0 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f868c0ad200 con 0x7f868c152df0 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f868c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f868c151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36944/0 (socket says 172.21.15.94:36944) 2024-09-11T23:17:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 -- 172.21.15.94:0/3933885098 learned_addr learned my addr 172.21.15.94:0/3933885098 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 -- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f868c152df0 msgr2=0x7f868c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f868c152df0 0x7f868c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 -- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f868c14a7d0 msgr2=0x7f868c154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f868c14a7d0 0x7f868c154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 -- 172.21.15.94:0/3933885098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c1554f0 con 0x7f86740051d0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f868affd640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f868c151760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f868000e4b0 tx=0x7f868000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f86737fe640 1 -- 172.21.15.94:0/3933885098 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86800052e0 con 0x7f86740051d0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f86737fe640 1 -- 172.21.15.94:0/3933885098 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8680018070 con 0x7f86740051d0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f86737fe640 1 -- 172.21.15.94:0/3933885098 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680003840 con 0x7f86740051d0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c072920 con 0x7f86740051d0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.746+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c072ee0 con 0x7f86740051d0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.750+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868c14ac10 con 0x7f86740051d0 2024-09-11T23:17:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.750+0000 7f86737fe640 1 -- 172.21.15.94:0/3933885098 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86800039e0 con 0x7f86740051d0 2024-09-11T23:17:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.750+0000 7f86737fe640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f86780678f0 0x7f8678069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.750+0000 7f86737fe640 1 -- 172.21.15.94:0/3933885098 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f8680085730 con 0x7f86740051d0 2024-09-11T23:17:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.750+0000 7f868a7fc640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f86780678f0 0x7f8678069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.750+0000 7f868a7fc640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f86780678f0 0x7f8678069db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f868c15dce0 tx=0x7f867c001c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:30.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.754+0000 7f86737fe640 1 -- 172.21.15.94:0/3933885098 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f86800564f0 con 0x7f86740051d0 2024-09-11T23:17:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.958+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f868c0ad590 con 0x7f86740051d0 2024-09-11T23:17:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f86737fe640 1 -- 172.21.15.94:0/3933885098 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f8680055df0 con 0x7f86740051d0 2024-09-11T23:17:30.961 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg==", 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ==", 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ==", 2024-09-11T23:17:30.963 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg==", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ==", 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.965 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g==", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow==", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.966 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA==", 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2024-09-11T23:17:30.967 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw==", 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g==", 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.968 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA==", 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2024-09-11T23:17:30.969 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA==", 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ==", 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow r", 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:17:30.970 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw==", 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2024-09-11T23:17:30.971 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ==", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw==", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:17:30.972 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmAziHChAAz9c8+z77RX+g6eeV2hnBGA==", 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA==", 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg==", 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:17:30.974 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:17:30.975 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:17:30.975 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.975 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:30.975 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:17:30.975 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f86780678f0 msgr2=0x7f8678069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f86780678f0 0x7f8678069db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f868c15dce0 tx=0x7f867c001c40 comp rx=0 tx=0).stop 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 msgr2=0x7f868c151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f868c151760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f868000e4b0 tx=0x7f868000e970 comp rx=0 tx=0).stop 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 shutdown_connections 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f868c152df0 0x7f868c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f868c14a7d0 0x7f868c154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f86780678f0 0x7f8678069db0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 --2- 172.21.15.94:0/3933885098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86740051d0 0x7f868c151760 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 >> 172.21.15.94:0/3933885098 conn(0x7f868c0b1f90 msgr2=0x7f868c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:30.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 shutdown_connections 2024-09-11T23:17:30.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:30.962+0000 7f8691294640 1 -- 172.21.15.94:0/3933885098 wait complete. 2024-09-11T23:17:30.979 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:17:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.086+0000 7f6d4c861640 1 Processor -- start 2024-09-11T23:17:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.086+0000 7f6d4c861640 1 -- start start 2024-09-11T23:17:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4c861640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d480b3c40 0x7f6d4815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4c861640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d480b40d0 0x7f6d48160290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4c861640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d480b4620 con 0x7f6d481567e0 2024-09-11T23:17:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4c861640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6d480b4900 con 0x7f6d480b40d0 2024-09-11T23:17:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4c861640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6d480b4be0 con 0x7f6d480b3c40 2024-09-11T23:17:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4659c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6d481567e0 0x7f6d480b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58054/0 (socket says 172.21.15.94:58054) 2024-09-11T23:17:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4659c640 1 -- 172.21.15.94:0/2277471706 learned_addr learned my addr 172.21.15.94:0/2277471706 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d46d9d640 1 --2- 172.21.15.94:0/2277471706 >> v2:172.21.15.94:3300/0 conn(0x7f6d480b40d0 0x7f6d48160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d46d9d640 1 -- 172.21.15.94:0/2277471706 >> v2:172.21.15.155:3300/0 conn(0x7f6d480b3c40 msgr2=0x7f6d4815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d46d9d640 1 --2- 172.21.15.94:0/2277471706 >> v2:172.21.15.155:3300/0 conn(0x7f6d480b3c40 0x7f6d4815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d46d9d640 1 -- 172.21.15.94:0/2277471706 >> v1:172.21.15.94:6789/0 conn(0x7f6d481567e0 legacy=0x7f6d480b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4559a640 1 -- 172.21.15.94:0/2277471706 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683231403 0 0) 0x7f6d480b4620 con 0x7f6d481567e0 2024-09-11T23:17:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d46d9d640 1 -- 172.21.15.94:0/2277471706 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480b4ec0 con 0x7f6d480b40d0 2024-09-11T23:17:31.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d46d9d640 1 --2- 172.21.15.94:0/2277471706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48160290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097c0 tx=0x7f6d3c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad927c79220ca535 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:31.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4559a640 1 -- 172.21.15.94:0/2277471706 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0b0070 con 0x7f6d480b40d0 2024-09-11T23:17:31.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4559a640 1 -- 172.21.15.94:0/2277471706 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0ab600 con 0x7f6d480b40d0 2024-09-11T23:17:31.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.090+0000 7f6d4559a640 1 -- 172.21.15.94:0/2277471706 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0ab9d0 con 0x7f6d480b40d0 2024-09-11T23:17:31.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2277471706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 msgr2=0x7f6d48160290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2277471706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48160290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097c0 tx=0x7f6d3c01c310 comp rx=0 tx=0).stop 2024-09-11T23:17:31.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2277471706 shutdown_connections 2024-09-11T23:17:31.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2277471706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48160290 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2277471706 >> v2:172.21.15.155:3300/0 conn(0x7f6d480b3c40 0x7f6d4815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2277471706 >> 172.21.15.94:0/2277471706 conn(0x7f6d48073580 msgr2=0x7f6d4806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:31.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2277471706 shutdown_connections 2024-09-11T23:17:31.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2277471706 wait complete. 2024-09-11T23:17:31.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 Processor -- start 2024-09-11T23:17:31.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- start start 2024-09-11T23:17:31.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b3c40 0x7f6d481430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481567e0 0x7f6d4814c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4815e130 con 0x7f6d480b40d0 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48160be0 con 0x7f6d481567e0 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4815e2b0 con 0x7f6d480b3c40 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36954/0 (socket says 172.21.15.94:36954) 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 -- 172.21.15.94:0/2008726193 learned_addr learned my addr 172.21.15.94:0/2008726193 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d46d9d640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481567e0 0x7f6d4814c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4659c640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b3c40 0x7f6d481430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 -- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b3c40 msgr2=0x7f6d481430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b3c40 0x7f6d481430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 -- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481567e0 msgr2=0x7f6d4814c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481567e0 0x7f6d4814c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 -- 172.21.15.94:0/2008726193 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d48146850 con 0x7f6d480b40d0 2024-09-11T23:17:31.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d46d9d640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481567e0 0x7f6d4814c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:31.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4659c640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b3c40 0x7f6d481430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:31.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d45d9b640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48143870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800ba80 tx=0x7f6d3800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:31.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d36ffd640 1 -- 172.21.15.94:0/2008726193 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38019070 con 0x7f6d480b40d0 2024-09-11T23:17:31.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d36ffd640 1 -- 172.21.15.94:0/2008726193 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3800cc20 con 0x7f6d480b40d0 2024-09-11T23:17:31.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d48146b30 con 0x7f6d480b40d0 2024-09-11T23:17:31.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d36ffd640 1 -- 172.21.15.94:0/2008726193 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38014440 con 0x7f6d480b40d0 2024-09-11T23:17:31.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d481470f0 con 0x7f6d480b40d0 2024-09-11T23:17:31.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.094+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d480b56c0 con 0x7f6d480b40d0 2024-09-11T23:17:31.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.098+0000 7f6d36ffd640 1 -- 172.21.15.94:0/2008726193 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6d3801c070 con 0x7f6d480b40d0 2024-09-11T23:17:31.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.098+0000 7f6d36ffd640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d280678c0 0x7f6d28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.098+0000 7f6d36ffd640 1 -- 172.21.15.94:0/2008726193 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f6d38085750 con 0x7f6d480b40d0 2024-09-11T23:17:31.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.098+0000 7f6d4659c640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d280678c0 0x7f6d28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.098+0000 7f6d4659c640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d280678c0 0x7f6d28069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d40000f70 tx=0x7f6d40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:31.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.102+0000 7f6d36ffd640 1 -- 172.21.15.94:0/2008726193 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6d38055e00 con 0x7f6d480b40d0 2024-09-11T23:17:31.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.250+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6d48070e20 con 0x7f6d480b40d0 2024-09-11T23:17:31.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.250+0000 7f6d36ffd640 1 -- 172.21.15.94:0/2008726193 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7f6d3805a100 con 0x7f6d480b40d0 2024-09-11T23:17:31.252 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:31.253 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:17:31.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:17:31.253 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:17:31.253 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:17:31.253 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:31.253 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d280678c0 msgr2=0x7f6d28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d280678c0 0x7f6d28069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d40000f70 tx=0x7f6d40009040 comp rx=0 tx=0).stop 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 msgr2=0x7f6d48143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48143870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800ba80 tx=0x7f6d3800bf40 comp rx=0 tx=0).stop 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 shutdown_connections 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481567e0 0x7f6d4814c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d280678c0 0x7f6d28069d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d480b40d0 0x7f6d48143870 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 --2- 172.21.15.94:0/2008726193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b3c40 0x7f6d481430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 >> 172.21.15.94:0/2008726193 conn(0x7f6d48073580 msgr2=0x7f6d4814dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:31.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 shutdown_connections 2024-09-11T23:17:31.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.254+0000 7f6d4c861640 1 -- 172.21.15.94:0/2008726193 wait complete. 2024-09-11T23:17:31.270 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:17:31.270 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:17:31.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 Processor -- start 2024-09-11T23:17:31.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 -- start start 2024-09-11T23:17:31.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb184158c90 0x7fb1840cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18415f840 0x7fb18406e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1840b3e00 0x7fb1840b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb18406d070 con 0x7fb1840b3e00 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb184159070 con 0x7fb184158c90 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb189dbd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb18406d2c0 con 0x7fb18415f840 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb183fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1840b3e00 0x7fb1840b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb183fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1840b3e00 0x7fb1840b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36966/0 (socket says 172.21.15.94:36966) 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.394+0000 7fb183fff640 1 -- 172.21.15.94:0/2028294444 learned_addr learned my addr 172.21.15.94:0/2028294444 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb182ffd640 1 --2- 172.21.15.94:0/2028294444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18415f840 0x7fb18406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb1837fe640 1 --2- 172.21.15.94:0/2028294444 >> v2:172.21.15.155:3300/0 conn(0x7fb184158c90 0x7fb1840cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb183fff640 1 -- 172.21.15.94:0/2028294444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18415f840 msgr2=0x7fb18406e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb183fff640 1 --2- 172.21.15.94:0/2028294444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18415f840 0x7fb18406e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb183fff640 1 -- 172.21.15.94:0/2028294444 >> v2:172.21.15.155:3300/0 conn(0x7fb184158c90 msgr2=0x7fb1840cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:31.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb183fff640 1 --2- 172.21.15.94:0/2028294444 >> v2:172.21.15.155:3300/0 conn(0x7fb184158c90 0x7fb1840cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb183fff640 1 -- 172.21.15.94:0/2028294444 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18406d5a0 con 0x7fb1840b3e00 2024-09-11T23:17:31.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb182ffd640 1 --2- 172.21.15.94:0/2028294444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18415f840 0x7fb18406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:31.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb1837fe640 1 --2- 172.21.15.94:0/2028294444 >> v2:172.21.15.155:3300/0 conn(0x7fb184158c90 0x7fb1840cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:31.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb183fff640 1 --2- 172.21.15.94:0/2028294444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1840b3e00 0x7fb1840b4290 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb1840d3240 tx=0x7fb17c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1127ac64c2afd772 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:31.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb1827fc640 1 -- 172.21.15.94:0/2028294444 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0a5670 con 0x7fb1840b3e00 2024-09-11T23:17:31.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb1827fc640 1 -- 172.21.15.94:0/2028294444 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c0a5810 con 0x7fb1840b3e00 2024-09-11T23:17:31.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb1827fc640 1 -- 172.21.15.94:0/2028294444 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0a5be0 con 0x7fb1840b3e00 2024-09-11T23:17:31.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 -- 172.21.15.94:0/2028294444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1840b3e00 msgr2=0x7fb1840b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2028294444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1840b3e00 0x7fb1840b4290 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb1840d3240 tx=0x7fb17c01c9f0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 -- 172.21.15.94:0/2028294444 shutdown_connections 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2028294444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1840b3e00 0x7fb1840b4290 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2028294444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb18415f840 0x7fb18406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2028294444 >> v2:172.21.15.155:3300/0 conn(0x7fb184158c90 0x7fb1840cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 -- 172.21.15.94:0/2028294444 >> 172.21.15.94:0/2028294444 conn(0x7fb18406bcc0 msgr2=0x7fb18406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 -- 172.21.15.94:0/2028294444 shutdown_connections 2024-09-11T23:17:31.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.398+0000 7fb189dbd640 1 -- 172.21.15.94:0/2028294444 wait complete. 2024-09-11T23:17:31.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 Processor -- start 2024-09-11T23:17:31.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 -- start start 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1840b3e00 0x7fb1841502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb184158c90 0x7fb18415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18415f840 0x7fb18415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb18406ea20 con 0x7fb18415f840 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb18406e8a0 con 0x7fb1840b3e00 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1840cd000 con 0x7fb184158c90 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18415f840 0x7fb18415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18415f840 0x7fb18415d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36982/0 (socket says 172.21.15.94:36982) 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 -- 172.21.15.94:0/2425777009 learned_addr learned my addr 172.21.15.94:0/2425777009 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:31.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb1837fe640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1840b3e00 0x7fb1841502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 -- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb184158c90 msgr2=0x7fb18415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb184158c90 0x7fb18415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 -- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1840b3e00 msgr2=0x7fb1841502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1840b3e00 0x7fb1841502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 -- 172.21.15.94:0/2425777009 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1840b5b40 con 0x7fb18415f840 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb1837fe640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1840b3e00 0x7fb1841502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb183fff640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18415f840 0x7fb18415d1c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0af040 tx=0x7fb17c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb17bfff640 1 -- 172.21.15.94:0/2425777009 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0bc020 con 0x7fb18415f840 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb17bfff640 1 -- 172.21.15.94:0/2425777009 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c0b8670 con 0x7fb18415f840 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1840b5dd0 con 0x7fb18415f840 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb17bfff640 1 -- 172.21.15.94:0/2425777009 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0b8a40 con 0x7fb18415f840 2024-09-11T23:17:31.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1840b6390 con 0x7fb18415f840 2024-09-11T23:17:31.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.402+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb184160250 con 0x7fb18415f840 2024-09-11T23:17:31.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.406+0000 7fb17bfff640 1 -- 172.21.15.94:0/2425777009 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb17c0bf020 con 0x7fb18415f840 2024-09-11T23:17:31.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.406+0000 7fb17bfff640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1640678c0 0x7fb164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.406+0000 7fb17bfff640 1 -- 172.21.15.94:0/2425777009 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7fb17c120b30 con 0x7fb18415f840 2024-09-11T23:17:31.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.406+0000 7fb1837fe640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1640678c0 0x7fb164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.406+0000 7fb1837fe640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1640678c0 0x7fb164069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fd0 tx=0x7fb174008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:31.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.410+0000 7fb17bfff640 1 -- 172.21.15.94:0/2425777009 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb17c0c6030 con 0x7fb18415f840 2024-09-11T23:17:31.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:31.574+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb1840cb940 con 0x7fb18415f840 2024-09-11T23:17:32.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.554+0000 7fb17bfff640 1 -- 172.21.15.94:0/2425777009 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7fb17c0165e0 con 0x7fb18415f840 2024-09-11T23:17:32.554 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:17:32.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1640678c0 msgr2=0x7fb164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1640678c0 0x7fb164069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fd0 tx=0x7fb174008040 comp rx=0 tx=0).stop 2024-09-11T23:17:32.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18415f840 msgr2=0x7fb18415d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18415f840 0x7fb18415d1c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0af040 tx=0x7fb17c019790 comp rx=0 tx=0).stop 2024-09-11T23:17:32.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 shutdown_connections 2024-09-11T23:17:32.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb1640678c0 0x7fb164069d80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18415f840 0x7fb18415d1c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb184158c90 0x7fb18415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 --2- 172.21.15.94:0/2425777009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1840b3e00 0x7fb1841502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.558+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 >> 172.21.15.94:0/2425777009 conn(0x7fb18406bcc0 msgr2=0x7fb18415ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:32.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.562+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 shutdown_connections 2024-09-11T23:17:32.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.562+0000 7fb189dbd640 1 -- 172.21.15.94:0/2425777009 wait complete. 2024-09-11T23:17:32.586 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:17:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbae0f40640 1 Processor -- start 2024-09-11T23:17:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbae0f40640 1 -- start start 2024-09-11T23:17:32.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbae0f40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbadc0cc870 0x7fbadc0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbae0f40640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbadc0ce8d0 con 0x7fbadc0cdfd0 2024-09-11T23:17:32.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbae0f40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbadc0cebb0 con 0x7fbadc073100 2024-09-11T23:17:32.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbae0f40640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fbadc0cee90 con 0x7fbadc0cc870 2024-09-11T23:17:32.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbada59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbadc0cc870 0x7fbadc0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbadad9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbadc0cdfd0 0x7fbadc06de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58062/0 (socket says 172.21.15.94:58062) 2024-09-11T23:17:32.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbadad9d640 1 -- 172.21.15.94:0/400741528 learned_addr learned my addr 172.21.15.94:0/400741528 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:32.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbada59c640 1 -- 172.21.15.94:0/400741528 >> v1:172.21.15.155:6789/0 conn(0x7fbadc073100 legacy=0x7fbadc0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:32.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbada59c640 1 -- 172.21.15.94:0/400741528 >> v1:172.21.15.94:6789/0 conn(0x7fbadc0cdfd0 legacy=0x7fbadc06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.710+0000 7fbada59c640 1 -- 172.21.15.94:0/400741528 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc0cf170 con 0x7fbadc0cc870 2024-09-11T23:17:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbada59c640 1 --2- 172.21.15.94:0/400741528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc0cf970 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009d90 tx=0x7fbadc06ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30171b09b9b8709 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad959a640 1 -- 172.21.15.94:0/400741528 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0b2070 con 0x7fbadc0cc870 2024-09-11T23:17:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad959a640 1 -- 172.21.15.94:0/400741528 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc0a59e0 con 0x7fbadc0cc870 2024-09-11T23:17:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad959a640 1 -- 172.21.15.94:0/400741528 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0a5db0 con 0x7fbadc0cc870 2024-09-11T23:17:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- 172.21.15.94:0/400741528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 msgr2=0x7fbadc0cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 --2- 172.21.15.94:0/400741528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc0cf970 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009d90 tx=0x7fbadc06ed20 comp rx=0 tx=0).stop 2024-09-11T23:17:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- 172.21.15.94:0/400741528 shutdown_connections 2024-09-11T23:17:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 --2- 172.21.15.94:0/400741528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc0cf970 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- 172.21.15.94:0/400741528 >> 172.21.15.94:0/400741528 conn(0x7fbadc0b1c80 msgr2=0x7fbadc0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- 172.21.15.94:0/400741528 shutdown_connections 2024-09-11T23:17:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- 172.21.15.94:0/400741528 wait complete. 2024-09-11T23:17:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 Processor -- start 2024-09-11T23:17:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- start start 2024-09-11T23:17:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbadc073100 0x7fbadc09d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbadc0cdfd0 0x7fbadc15e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc16a530 con 0x7fbadc0cc870 2024-09-11T23:17:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc16a3b0 con 0x7fbadc0cdfd0 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc16a6b0 con 0x7fbadc073100 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc15e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36998/0 (socket says 172.21.15.94:36998) 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 -- 172.21.15.94:0/1820503494 learned_addr learned my addr 172.21.15.94:0/1820503494 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 -- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbadc073100 msgr2=0x7fbadc09d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbadc073100 0x7fbadc09d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbadad9d640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbadc0cdfd0 0x7fbadc15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 -- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbadc0cdfd0 msgr2=0x7fbadc15e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbadc0cdfd0 0x7fbadc15e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 -- 172.21.15.94:0/1820503494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc09dc50 con 0x7fbadc0cc870 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad9d9b640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc15e0e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c410 tx=0x7fbac400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad2ffd640 1 -- 172.21.15.94:0/1820503494 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4011790 con 0x7fbadc0cc870 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad2ffd640 1 -- 172.21.15.94:0/1820503494 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac4017070 con 0x7fbadc0cc870 2024-09-11T23:17:32.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbadc13ee60 con 0x7fbadc0cc870 2024-09-11T23:17:32.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbad2ffd640 1 -- 172.21.15.94:0/1820503494 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4011bb0 con 0x7fbadc0cc870 2024-09-11T23:17:32.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.714+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbadc160600 con 0x7fbadc0cc870 2024-09-11T23:17:32.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.718+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbadc0cf970 con 0x7fbadc0cc870 2024-09-11T23:17:32.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.718+0000 7fbad2ffd640 1 -- 172.21.15.94:0/1820503494 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbac4007020 con 0x7fbadc0cc870 2024-09-11T23:17:32.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.718+0000 7fbad2ffd640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbabc0678c0 0x7fbabc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.718+0000 7fbad2ffd640 1 -- 172.21.15.94:0/1820503494 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5619+0+0 (secure 0 0 0) 0x7fbac4086160 con 0x7fbadc0cc870 2024-09-11T23:17:32.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.718+0000 7fbada59c640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbabc0678c0 0x7fbabc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.718+0000 7fbada59c640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbabc0678c0 0x7fbabc069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0af000 tx=0x7fbacc004a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.722+0000 7fbad2ffd640 1 -- 172.21.15.94:0/1820503494 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbac4021020 con 0x7fbadc0cc870 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:32.886+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbadc0af8d0 con 0x7fbadc0cc870 2024-09-11T23:17:33.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.562+0000 7fbad2ffd640 1 -- 172.21.15.94:0/1820503494 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7fbadc09dc50 con 0x7fbadc0cc870 2024-09-11T23:17:33.564 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:17:33.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.566+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbabc0678c0 msgr2=0x7fbabc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:33.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.566+0000 7fbae0f40640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbabc0678c0 0x7fbabc069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0af000 tx=0x7fbacc004a50 comp rx=0 tx=0).stop 2024-09-11T23:17:33.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.566+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 msgr2=0x7fbadc15e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:33.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.566+0000 7fbae0f40640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc15e0e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c410 tx=0x7fbac400c8d0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 shutdown_connections 2024-09-11T23:17:33.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbadc0cdfd0 0x7fbadc15e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbabc0678c0 0x7fbabc069d80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbadc0cc870 0x7fbadc15e0e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 --2- 172.21.15.94:0/1820503494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbadc073100 0x7fbadc09d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 >> 172.21.15.94:0/1820503494 conn(0x7fbadc0b1c80 msgr2=0x7fbadc0b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:33.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 shutdown_connections 2024-09-11T23:17:33.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.570+0000 7fbae0f40640 1 -- 172.21.15.94:0/1820503494 wait complete. 2024-09-11T23:17:33.606 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:17:33.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c4492b640 1 Processor -- start 2024-09-11T23:17:33.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c4492b640 1 -- start start 2024-09-11T23:17:33.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c4492b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6c40070020 0x7f6c4015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c4492b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c400aede0 con 0x7f6c401520a0 2024-09-11T23:17:33.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c4492b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4015fa10 con 0x7f6c4015f1d0 2024-09-11T23:17:33.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c4492b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6c40152480 con 0x7f6c40070020 2024-09-11T23:17:33.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c3e59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6c401520a0 0x7f6c4006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58078/0 (socket says 172.21.15.94:58078) 2024-09-11T23:17:33.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.726+0000 7f6c3e59c640 1 -- 172.21.15.94:0/1407696212 learned_addr learned my addr 172.21.15.94:0/1407696212 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727095504 0 0) 0x7f6c400aede0 con 0x7f6c401520a0 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c37fff640 1 --2- 172.21.15.94:0/1407696212 >> v2:172.21.15.155:3300/0 conn(0x7f6c40070020 0x7f6c4015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c2c003530 con 0x7f6c401520a0 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1108586403 0 0) 0x7f6c2c003530 con 0x7f6c401520a0 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 >> v2:172.21.15.155:3300/0 conn(0x7f6c40070020 msgr2=0x7f6c4015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 --2- 172.21.15.94:0/1407696212 >> v2:172.21.15.155:3300/0 conn(0x7f6c40070020 0x7f6c4015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 >> v1:172.21.15.155:6789/0 conn(0x7f6c4015f1d0 legacy=0x7f6c400adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40074250 con 0x7f6c401520a0 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f6c30001680 con 0x7f6c401520a0 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 >> v1:172.21.15.94:6789/0 conn(0x7f6c401520a0 legacy=0x7f6c4006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c004810 0x7f6c2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c00c0d0 con 0x7f6c2c0051d0 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c00c280 con 0x7f6c2c0039c0 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c00c480 con 0x7f6c2c004810 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3e59c640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c37fff640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c004810 0x7f6c2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c004810 msgr2=0x7f6c2c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c004810 0x7f6c2c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0039c0 msgr2=0x7f6c2c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/1407696212 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c003530 con 0x7f6c2c0051d0 2024-09-11T23:17:33.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3e59c640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/1407696212 reap_dead start 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3ed9d640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007fd0 tx=0x7f6c3801c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198ca33eda30c912 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c380040b0 con 0x7f6c2c0051d0 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c380a9680 con 0x7f6c2c0051d0 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c3dd9b640 1 -- 172.21.15.94:0/1407696212 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c380a9a70 con 0x7f6c2c0051d0 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c4492b640 1 -- 172.21.15.94:0/1407696212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2c0051d0 msgr2=0x7f6c2c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c4492b640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007fd0 tx=0x7f6c3801c680 comp rx=0 tx=0).stop 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c4492b640 1 -- 172.21.15.94:0/1407696212 shutdown_connections 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c4492b640 1 --2- 172.21.15.94:0/1407696212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c4492b640 1 -- 172.21.15.94:0/1407696212 >> 172.21.15.94:0/1407696212 conn(0x7f6c400b1f90 msgr2=0x7f6c400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:33.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c4492b640 1 -- 172.21.15.94:0/1407696212 shutdown_connections 2024-09-11T23:17:33.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.730+0000 7f6c4492b640 1 -- 172.21.15.94:0/1407696212 wait complete. 2024-09-11T23:17:33.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 Processor -- start 2024-09-11T23:17:33.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 -- start start 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0051d0 0x7f6c40142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4006f110 0x7f6c4006f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c400cf0b0 0x7f6c400cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40073a50 con 0x7f6c400cf0b0 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40073770 con 0x7f6c2c0051d0 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c40073d30 con 0x7f6c4006f110 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c400cf0b0 0x7f6c400cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c400cf0b0 0x7f6c400cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37016/0 (socket says 172.21.15.94:37016) 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/568942686 learned_addr learned my addr 172.21.15.94:0/568942686 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c37fff640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4006f110 0x7f6c4006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3e59c640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0051d0 0x7f6c40142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4006f110 msgr2=0x7f6c4006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4006f110 0x7f6c4006f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0051d0 msgr2=0x7f6c40142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0051d0 0x7f6c40142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 -- 172.21.15.94:0/568942686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40142a60 con 0x7f6c400cf0b0 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c3ed9d640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c400cf0b0 0x7f6c400cf540 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007fd0 tx=0x7f6c2c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c36ffd640 1 -- 172.21.15.94:0/568942686 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38007e00 con 0x7f6c400cf0b0 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c36ffd640 1 -- 172.21.15.94:0/568942686 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c380b8070 con 0x7f6c400cf0b0 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c400cfda0 con 0x7f6c400cf0b0 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c36ffd640 1 -- 172.21.15.94:0/568942686 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c380b28b0 con 0x7f6c400cf0b0 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c400adf20 con 0x7f6c400cf0b0 2024-09-11T23:17:33.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.734+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c40068e50 con 0x7f6c400cf0b0 2024-09-11T23:17:33.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.738+0000 7f6c36ffd640 1 -- 172.21.15.94:0/568942686 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c380a7070 con 0x7f6c400cf0b0 2024-09-11T23:17:33.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.738+0000 7f6c36ffd640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c200678c0 0x7f6c20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:33.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.738+0000 7f6c36ffd640 1 -- 172.21.15.94:0/568942686 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6001+0+0 (secure 0 0 0) 0x7f6c3811fe90 con 0x7f6c400cf0b0 2024-09-11T23:17:33.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.738+0000 7f6c3e59c640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c200678c0 0x7f6c20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:33.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.738+0000 7f6c3e59c640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c200678c0 0x7f6c20069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c30001930 tx=0x7f6c30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:33.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.742+0000 7f6c36ffd640 1 -- 172.21.15.94:0/568942686 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c38016390 con 0x7f6c400cf0b0 2024-09-11T23:17:33.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:33.942+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6c4006fab0 con 0x7f6c400cf0b0 2024-09-11T23:17:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.566+0000 7f6c36ffd640 1 -- 172.21.15.94:0/568942686 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v29) ==== 173+0+0 (secure 0 0 0) 0x7f6c4006fab0 con 0x7f6c400cf0b0 2024-09-11T23:17:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 9 and data pool 10 2024-09-11T23:17:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c200678c0 msgr2=0x7f6c20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c200678c0 0x7f6c20069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c30001930 tx=0x7f6c30009040 comp rx=0 tx=0).stop 2024-09-11T23:17:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c400cf0b0 msgr2=0x7f6c400cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c400cf0b0 0x7f6c400cf540 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007fd0 tx=0x7f6c2c005840 comp rx=0 tx=0).stop 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 shutdown_connections 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6c200678c0 0x7f6c20069d80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c400cf0b0 0x7f6c400cf540 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4006f110 0x7f6c4006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 --2- 172.21.15.94:0/568942686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0051d0 0x7f6c40142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 >> 172.21.15.94:0/568942686 conn(0x7f6c400b1f90 msgr2=0x7f6c400d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 shutdown_connections 2024-09-11T23:17:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.570+0000 7f6c4492b640 1 -- 172.21.15.94:0/568942686 wait complete. 2024-09-11T23:17:34.604 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:34.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.722+0000 7f3fe6499640 1 Processor -- start 2024-09-11T23:17:34.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.722+0000 7f3fe6499640 1 -- start start 2024-09-11T23:17:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fe6499640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fe01520a0 0x7f3fe006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fe6499640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3fe006fe50 0x7f3fe015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fe6499640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe0070250 con 0x7f3fe015f1d0 2024-09-11T23:17:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fe6499640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe0152480 con 0x7f3fe006fe50 2024-09-11T23:17:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fe6499640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe00aede0 con 0x7f3fe01520a0 2024-09-11T23:17:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3fe006fe50 0x7f3fe015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3fe006fe50 0x7f3fe015ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37020/0 (socket says 172.21.15.94:37020) 2024-09-11T23:17:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 -- 172.21.15.94:0/4034054849 learned_addr learned my addr 172.21.15.94:0/4034054849 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdffff640 1 --2- 172.21.15.94:0/4034054849 >> v2:172.21.15.155:3300/0 conn(0x7f3fe01520a0 0x7f3fe006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 -- 172.21.15.94:0/4034054849 >> v2:172.21.15.155:3300/0 conn(0x7f3fe01520a0 msgr2=0x7f3fe006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 --2- 172.21.15.94:0/4034054849 >> v2:172.21.15.155:3300/0 conn(0x7f3fe01520a0 0x7f3fe006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 -- 172.21.15.94:0/4034054849 >> v1:172.21.15.155:6789/0 conn(0x7f3fe015f1d0 legacy=0x7f3fe0071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 -- 172.21.15.94:0/4034054849 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe015fa10 con 0x7f3fe006fe50 2024-09-11T23:17:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdf7fe640 1 --2- 172.21.15.94:0/4034054849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe006fe50 0x7f3fe015ec90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0071710 tx=0x7f3fd001eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404934b90b253104 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdeffd640 1 -- 172.21.15.94:0/4034054849 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00b4070 con 0x7f3fe006fe50 2024-09-11T23:17:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdeffd640 1 -- 172.21.15.94:0/4034054849 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd00a7b80 con 0x7f3fe006fe50 2024-09-11T23:17:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.726+0000 7f3fdeffd640 1 -- 172.21.15.94:0/4034054849 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00af440 con 0x7f3fe006fe50 2024-09-11T23:17:34.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- 172.21.15.94:0/4034054849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe006fe50 msgr2=0x7f3fe015ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 --2- 172.21.15.94:0/4034054849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe006fe50 0x7f3fe015ec90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0071710 tx=0x7f3fd001eb90 comp rx=0 tx=0).stop 2024-09-11T23:17:34.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- 172.21.15.94:0/4034054849 shutdown_connections 2024-09-11T23:17:34.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 --2- 172.21.15.94:0/4034054849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe006fe50 0x7f3fe015ec90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 --2- 172.21.15.94:0/4034054849 >> v2:172.21.15.155:3300/0 conn(0x7f3fe01520a0 0x7f3fe006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- 172.21.15.94:0/4034054849 >> 172.21.15.94:0/4034054849 conn(0x7f3fe00b1f90 msgr2=0x7f3fe00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:34.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- 172.21.15.94:0/4034054849 shutdown_connections 2024-09-11T23:17:34.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- 172.21.15.94:0/4034054849 wait complete. 2024-09-11T23:17:34.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 Processor -- start 2024-09-11T23:17:34.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- start start 2024-09-11T23:17:34.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe006fe50 0x7f3fe014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe01520a0 0x7f3fe00cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe015f1d0 0x7f3fe015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0073d30 con 0x7f3fe015f1d0 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0073a50 con 0x7f3fe01520a0 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe015f660 con 0x7f3fe006fe50 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe015f1d0 0x7f3fe015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe015f1d0 0x7f3fe015c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37030/0 (socket says 172.21.15.94:37030) 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 -- 172.21.15.94:0/2314318670 learned_addr learned my addr 172.21.15.94:0/2314318670 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fdf7fe640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe01520a0 0x7f3fe00cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fdffff640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe006fe50 0x7f3fe014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 -- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe006fe50 msgr2=0x7f3fe014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe006fe50 0x7f3fe014e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 -- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe01520a0 msgr2=0x7f3fe00cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe01520a0 0x7f3fe00cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 -- 172.21.15.94:0/2314318670 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe014c7e0 con 0x7f3fe015f1d0 2024-09-11T23:17:34.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fdffff640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe006fe50 0x7f3fe014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:34.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe4a36640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe015f1d0 0x7f3fe015c5d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c410 tx=0x7f3fd800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:34.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fdcff9640 1 -- 172.21.15.94:0/2314318670 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8017070 con 0x7f3fe015f1d0 2024-09-11T23:17:34.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fdcff9640 1 -- 172.21.15.94:0/2314318670 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd8003600 con 0x7f3fe015f1d0 2024-09-11T23:17:34.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe00cd730 con 0x7f3fe015f1d0 2024-09-11T23:17:34.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fdcff9640 1 -- 172.21.15.94:0/2314318670 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80039f0 con 0x7f3fe015f1d0 2024-09-11T23:17:34.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.730+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe00ce730 con 0x7f3fe015f1d0 2024-09-11T23:17:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.734+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe015ec90 con 0x7f3fe015f1d0 2024-09-11T23:17:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.734+0000 7f3fdcff9640 1 -- 172.21.15.94:0/2314318670 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fd801a070 con 0x7f3fe015f1d0 2024-09-11T23:17:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.734+0000 7f3fdcff9640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fcc0678f0 0x7f3fcc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.734+0000 7f3fdcff9640 1 -- 172.21.15.94:0/2314318670 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f3fd80850c0 con 0x7f3fe015f1d0 2024-09-11T23:17:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.734+0000 7f3fdffff640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fcc0678f0 0x7f3fcc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.734+0000 7f3fdffff640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fcc0678f0 0x7f3fcc069db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4007eb0 tx=0x7f3fd4007400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:34.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.738+0000 7f3fdcff9640 1 -- 172.21.15.94:0/2314318670 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3fd8055b00 con 0x7f3fe015f1d0 2024-09-11T23:17:34.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.894+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fe006ed60 con 0x7f3fe015f1d0 2024-09-11T23:17:34.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.898+0000 7f3fdcff9640 1 -- 172.21.15.94:0/2314318670 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16981 (secure 0 0 0) 0x7f3fd8055400 con 0x7f3fe015f1d0 2024-09-11T23:17:34.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:34.899 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":61,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:33.944588+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:31.612159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:32.924950+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:34.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fcc0678f0 msgr2=0x7f3fcc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fcc0678f0 0x7f3fcc069db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4007eb0 tx=0x7f3fd4007400 comp rx=0 tx=0).stop 2024-09-11T23:17:34.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe015f1d0 msgr2=0x7f3fe015c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe015f1d0 0x7f3fe015c5d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c410 tx=0x7f3fd800c8d0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 shutdown_connections 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3fcc0678f0 0x7f3fcc069db0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fe015f1d0 0x7f3fe015c5d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe01520a0 0x7f3fe00cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 --2- 172.21.15.94:0/2314318670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe006fe50 0x7f3fe014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 >> 172.21.15.94:0/2314318670 conn(0x7f3fe00b1f90 msgr2=0x7f3fe01512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 shutdown_connections 2024-09-11T23:17:34.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:34.902+0000 7f3fe6499640 1 -- 172.21.15.94:0/2314318670 wait complete. 2024-09-11T23:17:34.917 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:35.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.030+0000 7fd8372ad640 1 Processor -- start 2024-09-11T23:17:35.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.030+0000 7fd8372ad640 1 -- start start 2024-09-11T23:17:35.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd83006f010 0x7fd830166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300b3290 con 0x7fd83015c2a0 2024-09-11T23:17:35.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300b3570 con 0x7fd83015bec0 2024-09-11T23:17:35.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd8300b3850 con 0x7fd83006f010 2024-09-11T23:17:35.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd83584a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd83006f010 0x7fd830166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd834848640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd83015c2a0 0x7fd8300aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58088/0 (socket says 172.21.15.94:58088) 2024-09-11T23:17:35.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd834848640 1 -- 172.21.15.94:0/3423240731 learned_addr learned my addr 172.21.15.94:0/3423240731 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:35.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd83584a640 1 -- 172.21.15.94:0/3423240731 >> v1:172.21.15.155:6789/0 conn(0x7fd83015bec0 legacy=0x7fd8300ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd83584a640 1 -- 172.21.15.94:0/3423240731 >> v1:172.21.15.94:6789/0 conn(0x7fd83015c2a0 legacy=0x7fd8300aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd83584a640 1 -- 172.21.15.94:0/3423240731 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300b3b30 con 0x7fd83006f010 2024-09-11T23:17:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd83584a640 1 --2- 172.21.15.94:0/3423240731 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83006f010 0x7fd830166ff0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd828009d90 tx=0x7fd82801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffac88cdb1e4cdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd823fff640 1 -- 172.21.15.94:0/3423240731 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8280b2070 con 0x7fd83006f010 2024-09-11T23:17:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd823fff640 1 -- 172.21.15.94:0/3423240731 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8280a58d0 con 0x7fd83006f010 2024-09-11T23:17:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd823fff640 1 -- 172.21.15.94:0/3423240731 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8280a5ca0 con 0x7fd83006f010 2024-09-11T23:17:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- 172.21.15.94:0/3423240731 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83006f010 msgr2=0x7fd830166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 --2- 172.21.15.94:0/3423240731 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83006f010 0x7fd830166ff0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd828009d90 tx=0x7fd82801c900 comp rx=0 tx=0).stop 2024-09-11T23:17:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- 172.21.15.94:0/3423240731 shutdown_connections 2024-09-11T23:17:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 --2- 172.21.15.94:0/3423240731 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83006f010 0x7fd830166ff0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- 172.21.15.94:0/3423240731 >> 172.21.15.94:0/3423240731 conn(0x7fd8300b1f90 msgr2=0x7fd8300b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- 172.21.15.94:0/3423240731 shutdown_connections 2024-09-11T23:17:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.034+0000 7fd8372ad640 1 -- 172.21.15.94:0/3423240731 wait complete. 2024-09-11T23:17:35.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 Processor -- start 2024-09-11T23:17:35.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 -- start start 2024-09-11T23:17:35.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83006f010 0x7fd83014dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd83015bec0 0x7fd830157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83015c2a0 0x7fd830151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd830169ed0 con 0x7fd83015c2a0 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd830169d50 con 0x7fd83015bec0 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd83016a050 con 0x7fd83006f010 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83015c2a0 0x7fd830151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83015c2a0 0x7fd830151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37038/0 (socket says 172.21.15.94:37038) 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 -- 172.21.15.94:0/497357443 learned_addr learned my addr 172.21.15.94:0/497357443 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 -- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83006f010 msgr2=0x7fd83014dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83006f010 0x7fd83014dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd834848640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd83015bec0 0x7fd830157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 -- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd83015bec0 msgr2=0x7fd830157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd83015bec0 0x7fd830157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 -- 172.21.15.94:0/497357443 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd830150b40 con 0x7fd83015c2a0 2024-09-11T23:17:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd83584a640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83015c2a0 0x7fd830151fd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd8280b0040 tx=0x7fd8280196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd821ffb640 1 -- 172.21.15.94:0/497357443 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8280b2040 con 0x7fd83015c2a0 2024-09-11T23:17:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd821ffb640 1 -- 172.21.15.94:0/497357443 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8280bf070 con 0x7fd83015c2a0 2024-09-11T23:17:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd821ffb640 1 -- 172.21.15.94:0/497357443 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8280ad8e0 con 0x7fd83015c2a0 2024-09-11T23:17:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83015c930 con 0x7fd83015c2a0 2024-09-11T23:17:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83015cef0 con 0x7fd83015c2a0 2024-09-11T23:17:35.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.038+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8300ad200 con 0x7fd83015c2a0 2024-09-11T23:17:35.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.042+0000 7fd821ffb640 1 -- 172.21.15.94:0/497357443 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8280ada80 con 0x7fd83015c2a0 2024-09-11T23:17:35.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.042+0000 7fd821ffb640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd8140678c0 0x7fd814069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.042+0000 7fd821ffb640 1 -- 172.21.15.94:0/497357443 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7fd828121ad0 con 0x7fd83015c2a0 2024-09-11T23:17:35.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.042+0000 7fd835049640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd8140678c0 0x7fd814069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.042+0000 7fd835049640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd8140678c0 0x7fd814069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd82c003cf0 tx=0x7fd82c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.046+0000 7fd821ffb640 1 -- 172.21.15.94:0/497357443 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd828121e20 con 0x7fd83015c2a0 2024-09-11T23:17:35.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.206+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd83006fcd0 con 0x7fd83015c2a0 2024-09-11T23:17:35.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.210+0000 7fd821ffb640 1 -- 172.21.15.94:0/497357443 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16981 (secure 0 0 0) 0x7fd828016520 con 0x7fd83015c2a0 2024-09-11T23:17:35.211 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:35.211 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":61,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:33.944588+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:31.612159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:32.924950+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:35.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd8140678c0 msgr2=0x7fd814069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd8140678c0 0x7fd814069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd82c003cf0 tx=0x7fd82c0079c0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83015c2a0 msgr2=0x7fd830151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83015c2a0 0x7fd830151fd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd8280b0040 tx=0x7fd8280196a0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 shutdown_connections 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd8140678c0 0x7fd814069d80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd83015c2a0 0x7fd830151fd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd83015bec0 0x7fd830157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 --2- 172.21.15.94:0/497357443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83006f010 0x7fd83014dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 >> 172.21.15.94:0/497357443 conn(0x7fd8300b1f90 msgr2=0x7fd830158320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 shutdown_connections 2024-09-11T23:17:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.214+0000 7fd8372ad640 1 -- 172.21.15.94:0/497357443 wait complete. 2024-09-11T23:17:35.230 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:17:35.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.346+0000 7f97a57f4640 1 Processor -- start 2024-09-11T23:17:35.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.346+0000 7f97a57f4640 1 -- start start 2024-09-11T23:17:35.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f97a57f4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97a015c2a0 0x7f97a00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f97a57f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a00af2a0 0x7f97a006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f97a57f4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97a00b3290 con 0x7f97a015bec0 2024-09-11T23:17:35.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f97a57f4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f97a00b3570 con 0x7f97a015c2a0 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f97a57f4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97a00b3850 con 0x7f97a00af2a0 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97a015c2a0 0x7f97a00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97a015c2a0 0x7f97a00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37054/0 (socket says 172.21.15.94:37054) 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 -- 172.21.15.94:0/3330595171 learned_addr learned my addr 172.21.15.94:0/3330595171 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 -- 172.21.15.94:0/3330595171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a00af2a0 msgr2=0x7f97a006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 --2- 172.21.15.94:0/3330595171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a00af2a0 0x7f97a006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 -- 172.21.15.94:0/3330595171 >> v1:172.21.15.155:6789/0 conn(0x7f97a015bec0 legacy=0x7f97a00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 -- 172.21.15.94:0/3330595171 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a00b3b30 con 0x7f97a015c2a0 2024-09-11T23:17:35.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979e7fc640 1 --2- 172.21.15.94:0/3330595171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a015c2a0 0x7f97a00aed60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9790009870 tx=0x7f979001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a8903e388f7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979dffb640 1 -- 172.21.15.94:0/3330595171 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900aa610 con 0x7f97a015c2a0 2024-09-11T23:17:35.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979dffb640 1 -- 172.21.15.94:0/3330595171 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97900af070 con 0x7f97a015c2a0 2024-09-11T23:17:35.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.350+0000 7f979dffb640 1 -- 172.21.15.94:0/3330595171 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900aa9d0 con 0x7f97a015c2a0 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- 172.21.15.94:0/3330595171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a015c2a0 msgr2=0x7f97a00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 --2- 172.21.15.94:0/3330595171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a015c2a0 0x7f97a00aed60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9790009870 tx=0x7f979001c4f0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- 172.21.15.94:0/3330595171 shutdown_connections 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 --2- 172.21.15.94:0/3330595171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a00af2a0 0x7f97a006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 --2- 172.21.15.94:0/3330595171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a015c2a0 0x7f97a00aed60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- 172.21.15.94:0/3330595171 >> 172.21.15.94:0/3330595171 conn(0x7f97a00b1f90 msgr2=0x7f97a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- 172.21.15.94:0/3330595171 shutdown_connections 2024-09-11T23:17:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- 172.21.15.94:0/3330595171 wait complete. 2024-09-11T23:17:35.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 Processor -- start 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- start start 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a00af2a0 0x7f97a0153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a015bec0 0x7f97a015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a015c2a0 0x7f97a015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f97a006ed50 con 0x7f97a00af2a0 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97a00af710 con 0x7f97a015bec0 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97a006eed0 con 0x7f97a015c2a0 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a00af2a0 0x7f97a0153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a00af2a0 0x7f97a0153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37066/0 (socket says 172.21.15.94:37066) 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 -- 172.21.15.94:0/4237024415 learned_addr learned my addr 172.21.15.94:0/4237024415 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979f7fe640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a015c2a0 0x7f97a015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 -- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a015c2a0 msgr2=0x7f97a015f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a015c2a0 0x7f97a015f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 -- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a015bec0 msgr2=0x7f97a015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a015bec0 0x7f97a015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 -- 172.21.15.94:0/4237024415 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a006e310 con 0x7f97a00af2a0 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979f7fe640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a015c2a0 0x7f97a015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f979effd640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a00af2a0 0x7f97a0153410 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f979400c450 tx=0x7f979400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97877fe640 1 -- 172.21.15.94:0/4237024415 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794012830 con 0x7f97a00af2a0 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97877fe640 1 -- 172.21.15.94:0/4237024415 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9794017070 con 0x7f97a00af2a0 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a015c870 con 0x7f97a00af2a0 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97877fe640 1 -- 172.21.15.94:0/4237024415 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794012c30 con 0x7f97a00af2a0 2024-09-11T23:17:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.354+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a015d2a0 con 0x7f97a00af2a0 2024-09-11T23:17:35.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.358+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a006e000 con 0x7f97a00af2a0 2024-09-11T23:17:35.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.358+0000 7f97877fe640 1 -- 172.21.15.94:0/4237024415 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f979401c460 con 0x7f97a00af2a0 2024-09-11T23:17:35.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.358+0000 7f97877fe640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f978c0678c0 0x7f978c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.358+0000 7f97877fe640 1 -- 172.21.15.94:0/4237024415 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f9794085b40 con 0x7f97a00af2a0 2024-09-11T23:17:35.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.358+0000 7f979e7fc640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f978c0678c0 0x7f978c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.358+0000 7f979e7fc640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f978c0678c0 0x7f978c069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97900ae000 tx=0x7f9790004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.362+0000 7f97877fe640 1 -- 172.21.15.94:0/4237024415 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9794056580 con 0x7f97a00af2a0 2024-09-11T23:17:35.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.562+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f97a00d0fb0 con 0x7f97a00af2a0 2024-09-11T23:17:35.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.586+0000 7f97877fe640 1 -- 172.21.15.94:0/4237024415 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) ==== 118+0+0 (secure 0 0 0) 0x7f9794055e80 con 0x7f97a00af2a0 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f978c0678c0 msgr2=0x7f978c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f978c0678c0 0x7f978c069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97900ae000 tx=0x7f9790004740 comp rx=0 tx=0).stop 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a00af2a0 msgr2=0x7f97a0153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a00af2a0 0x7f97a0153410 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f979400c450 tx=0x7f979400c910 comp rx=0 tx=0).stop 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 shutdown_connections 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a015c2a0 0x7f97a015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a015bec0 0x7f97a015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f978c0678c0 0x7f978c069d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 --2- 172.21.15.94:0/4237024415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a00af2a0 0x7f97a0153410 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 >> 172.21.15.94:0/4237024415 conn(0x7f97a00b1f90 msgr2=0x7f97a01597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 shutdown_connections 2024-09-11T23:17:35.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.590+0000 7f97a57f4640 1 -- 172.21.15.94:0/4237024415 wait complete. 2024-09-11T23:17:35.613 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:17:35.613 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:17:35.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bba36a640 1 Processor -- start 2024-09-11T23:17:35.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bba36a640 1 -- start start 2024-09-11T23:17:35.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bba36a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb415bec0 0x7f0bb40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bba36a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0bb415c2a0 0x7f0bb40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bba36a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb40b3290 con 0x7f0bb40af2a0 2024-09-11T23:17:35.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bba36a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb40b3570 con 0x7f0bb415c2a0 2024-09-11T23:17:35.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bba36a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb40b3850 con 0x7f0bb415bec0 2024-09-11T23:17:35.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb37fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0bb415c2a0 0x7f0bb40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb37fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0bb415c2a0 0x7f0bb40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37078/0 (socket says 172.21.15.94:37078) 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb37fe640 1 -- 172.21.15.94:0/125193725 learned_addr learned my addr 172.21.15.94:0/125193725 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb3fff640 1 --2- 172.21.15.94:0/125193725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb415bec0 0x7f0bb40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb37fe640 1 -- 172.21.15.94:0/125193725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb415bec0 msgr2=0x7f0bb40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb37fe640 1 --2- 172.21.15.94:0/125193725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb415bec0 0x7f0bb40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb37fe640 1 -- 172.21.15.94:0/125193725 >> v1:172.21.15.155:6789/0 conn(0x7f0bb40af2a0 legacy=0x7f0bb415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb37fe640 1 -- 172.21.15.94:0/125193725 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb40b3b30 con 0x7f0bb415c2a0 2024-09-11T23:17:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.734+0000 7f0bb3fff640 1 --2- 172.21.15.94:0/125193725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb415bec0 0x7f0bb40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:35.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 --2- 172.21.15.94:0/125193725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415c2a0 0x7f0bb40aed60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009870 tx=0x7f0ba801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d11a7ffd014ec3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb2ffd640 1 -- 172.21.15.94:0/125193725 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80aa610 con 0x7f0bb415c2a0 2024-09-11T23:17:35.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb2ffd640 1 -- 172.21.15.94:0/125193725 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba80af070 con 0x7f0bb415c2a0 2024-09-11T23:17:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb2ffd640 1 -- 172.21.15.94:0/125193725 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80aa9d0 con 0x7f0bb415c2a0 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- 172.21.15.94:0/125193725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415c2a0 msgr2=0x7f0bb40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 --2- 172.21.15.94:0/125193725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415c2a0 0x7f0bb40aed60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009870 tx=0x7f0ba801c4f0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- 172.21.15.94:0/125193725 shutdown_connections 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 --2- 172.21.15.94:0/125193725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415c2a0 0x7f0bb40aed60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 --2- 172.21.15.94:0/125193725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb415bec0 0x7f0bb40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- 172.21.15.94:0/125193725 >> 172.21.15.94:0/125193725 conn(0x7f0bb40b1f90 msgr2=0x7f0bb40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- 172.21.15.94:0/125193725 shutdown_connections 2024-09-11T23:17:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- 172.21.15.94:0/125193725 wait complete. 2024-09-11T23:17:35.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 Processor -- start 2024-09-11T23:17:35.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- start start 2024-09-11T23:17:35.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40af2a0 0x7f0bb41f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415bec0 0x7f0bb40b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415c2a0 0x7f0bb4165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb40ad740 con 0x7f0bb415bec0 2024-09-11T23:17:35.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb40afc90 con 0x7f0bb415c2a0 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bba36a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb4169000 con 0x7f0bb40af2a0 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415bec0 0x7f0bb40b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415bec0 0x7f0bb40b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37086/0 (socket says 172.21.15.94:37086) 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 -- 172.21.15.94:0/3330419663 learned_addr learned my addr 172.21.15.94:0/3330419663 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb8907640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415c2a0 0x7f0bb4165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb3fff640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40af2a0 0x7f0bb41f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 -- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40af2a0 msgr2=0x7f0bb41f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40af2a0 0x7f0bb41f73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 -- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415c2a0 msgr2=0x7f0bb4165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415c2a0 0x7f0bb4165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 -- 172.21.15.94:0/3330419663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb40b1aa0 con 0x7f0bb415bec0 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb3fff640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40af2a0 0x7f0bb41f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.738+0000 7f0bb37fe640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415bec0 0x7f0bb40b13c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ac040 tx=0x7f0ba8019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb0ff9640 1 -- 172.21.15.94:0/3330419663 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80b4810 con 0x7f0bb415bec0 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb0ff9640 1 -- 172.21.15.94:0/3330419663 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba80b49b0 con 0x7f0bb415bec0 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb415d860 con 0x7f0bb415bec0 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb0ff9640 1 -- 172.21.15.94:0/3330419663 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80b4da0 con 0x7f0bb415bec0 2024-09-11T23:17:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb41fa1e0 con 0x7f0bb415bec0 2024-09-11T23:17:35.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb40ad200 con 0x7f0bb415bec0 2024-09-11T23:17:35.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb0ff9640 1 -- 172.21.15.94:0/3330419663 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ba80bc020 con 0x7f0bb415bec0 2024-09-11T23:17:35.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb0ff9640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ba00678c0 0x7f0ba0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb0ff9640 1 -- 172.21.15.94:0/3330419663 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f0ba8120730 con 0x7f0bb415bec0 2024-09-11T23:17:35.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb3fff640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ba00678c0 0x7f0ba0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.742+0000 7f0bb3fff640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ba00678c0 0x7f0ba0069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4008930 tx=0x7f0ba4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.746+0000 7f0bb0ff9640 1 -- 172.21.15.94:0/3330419663 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ba80a7070 con 0x7f0bb415bec0 2024-09-11T23:17:35.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:35.938+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0bb406fcd0 con 0x7f0bb415bec0 2024-09-11T23:17:36.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.602+0000 7f0bb0ff9640 1 -- 172.21.15.94:0/3330419663 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) ==== 122+0+0 (secure 0 0 0) 0x7f0ba8016110 con 0x7f0bb415bec0 2024-09-11T23:17:36.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ba00678c0 msgr2=0x7f0ba0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ba00678c0 0x7f0ba0069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4008930 tx=0x7f0ba4008040 comp rx=0 tx=0).stop 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415bec0 msgr2=0x7f0bb40b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415bec0 0x7f0bb40b13c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ac040 tx=0x7f0ba8019290 comp rx=0 tx=0).stop 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 shutdown_connections 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415c2a0 0x7f0bb4165dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ba00678c0 0x7f0ba0069d80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bb415bec0 0x7f0bb40b13c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 --2- 172.21.15.94:0/3330419663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40af2a0 0x7f0bb41f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 >> 172.21.15.94:0/3330419663 conn(0x7f0bb40b1f90 msgr2=0x7f0bb40b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 shutdown_connections 2024-09-11T23:17:36.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.606+0000 7f0bba36a640 1 -- 172.21.15.94:0/3330419663 wait complete. 2024-09-11T23:17:36.628 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:17:36.628 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.750+0000 7f04aa3dc640 1 Processor -- start 2024-09-11T23:17:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.750+0000 7f04aa3dc640 1 -- start start 2024-09-11T23:17:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04aa3dc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04aa3dc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04a415c2a0 0x7f04a40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04aa3dc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a40b3290 con 0x7f04a40af2a0 2024-09-11T23:17:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04aa3dc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f04a40b3570 con 0x7f04a415c2a0 2024-09-11T23:17:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04aa3dc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f04a40b3850 con 0x7f04a415bec0 2024-09-11T23:17:36.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04a415c2a0 0x7f04a40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04a415c2a0 0x7f04a40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:56122/0 (socket says 172.21.15.94:56122) 2024-09-11T23:17:36.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 -- 172.21.15.94:0/490186975 learned_addr learned my addr 172.21.15.94:0/490186975 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:36.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 -- 172.21.15.94:0/490186975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 msgr2=0x7f04a40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:36.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 --2- 172.21.15.94:0/490186975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 -- 172.21.15.94:0/490186975 >> v1:172.21.15.155:6789/0 conn(0x7f04a40af2a0 legacy=0x7f04a415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 -- 172.21.15.94:0/490186975 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a40b3b30 con 0x7f04a415c2a0 2024-09-11T23:17:36.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.754+0000 7f04a37fe640 1 --2- 172.21.15.94:0/490186975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 0x7f04a40aed60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0498009870 tx=0x7f049801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b78675fedf0929 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a2ffd640 1 -- 172.21.15.94:0/490186975 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980a95f0 con 0x7f04a415c2a0 2024-09-11T23:17:36.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a2ffd640 1 -- 172.21.15.94:0/490186975 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04980a9790 con 0x7f04a415c2a0 2024-09-11T23:17:36.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a2ffd640 1 -- 172.21.15.94:0/490186975 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980a9b60 con 0x7f04a415c2a0 2024-09-11T23:17:36.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- 172.21.15.94:0/490186975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 msgr2=0x7f04a40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/490186975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 0x7f04a40aed60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0498009870 tx=0x7f049801c530 comp rx=0 tx=0).stop 2024-09-11T23:17:36.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- 172.21.15.94:0/490186975 shutdown_connections 2024-09-11T23:17:36.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/490186975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 0x7f04a40aed60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/490186975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- 172.21.15.94:0/490186975 >> 172.21.15.94:0/490186975 conn(0x7f04a40b1f90 msgr2=0x7f04a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- 172.21.15.94:0/490186975 shutdown_connections 2024-09-11T23:17:36.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- 172.21.15.94:0/490186975 wait complete. 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 Processor -- start 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- start start 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a40af2a0 0x7f04a415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a4146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 0x7f04a41f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f04a40af6b0 con 0x7f04a40af2a0 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f04a40ad740 con 0x7f04a415c2a0 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f04a4169000 con 0x7f04a415bec0 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a40af2a0 0x7f04a415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a40af2a0 0x7f04a415b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37094/0 (socket says 172.21.15.94:37094) 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 -- 172.21.15.94:0/903325220 learned_addr learned my addr 172.21.15.94:0/903325220 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:36.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a8979640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 0x7f04a41f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a37fe640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a4146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 -- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 msgr2=0x7f04a4146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a4146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 -- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 msgr2=0x7f04a41f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 0x7f04a41f7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 -- 172.21.15.94:0/903325220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a4146bd0 con 0x7f04a40af2a0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a3fff640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a40af2a0 0x7f04a415b270 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f049400e930 tx=0x7f049400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a0ff9640 1 -- 172.21.15.94:0/903325220 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494017070 con 0x7f04a40af2a0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a0ff9640 1 -- 172.21.15.94:0/903325220 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049400ca00 con 0x7f04a40af2a0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a415a1d0 con 0x7f04a40af2a0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04a0ff9640 1 -- 172.21.15.94:0/903325220 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049400cdb0 con 0x7f04a40af2a0 2024-09-11T23:17:36.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.758+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a415a790 con 0x7f04a40af2a0 2024-09-11T23:17:36.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.762+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a40ad200 con 0x7f04a40af2a0 2024-09-11T23:17:36.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.762+0000 7f04a0ff9640 1 -- 172.21.15.94:0/903325220 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f049401a070 con 0x7f04a40af2a0 2024-09-11T23:17:36.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.762+0000 7f04a0ff9640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f04900678c0 0x7f0490069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.762+0000 7f04a0ff9640 1 -- 172.21.15.94:0/903325220 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f0494085dd0 con 0x7f04a40af2a0 2024-09-11T23:17:36.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.762+0000 7f04a37fe640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f04900678c0 0x7f0490069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.762+0000 7f04a37fe640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f04900678c0 0x7f0490069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f04980ae000 tx=0x7f04980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.766+0000 7f04a0ff9640 1 -- 172.21.15.94:0/903325220 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f04940568d0 con 0x7f04a40af2a0 2024-09-11T23:17:36.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.962+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04a406fcd0 con 0x7f04a40af2a0 2024-09-11T23:17:36.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.962+0000 7f04a0ff9640 1 -- 172.21.15.94:0/903325220 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7f04940561d0 con 0x7f04a40af2a0 2024-09-11T23:17:36.964 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:36.964 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:17:36.964 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:17:36.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f04900678c0 msgr2=0x7f0490069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f04900678c0 0x7f0490069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f04980ae000 tx=0x7f04980a7000 comp rx=0 tx=0).stop 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a40af2a0 msgr2=0x7f04a415b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a40af2a0 0x7f04a415b270 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f049400e930 tx=0x7f049400edf0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 shutdown_connections 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415c2a0 0x7f04a41f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a415bec0 0x7f04a4146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f04900678c0 0x7f0490069d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 --2- 172.21.15.94:0/903325220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a40af2a0 0x7f04a415b270 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 >> 172.21.15.94:0/903325220 conn(0x7f04a40b1f90 msgr2=0x7f04a4158320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 shutdown_connections 2024-09-11T23:17:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:36.966+0000 7f04aa3dc640 1 -- 172.21.15.94:0/903325220 wait complete. 2024-09-11T23:17:36.984 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b9a7ce640 1 Processor -- start 2024-09-11T23:17:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b9a7ce640 1 -- start start 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b9a7ce640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2b9406f010 0x7f2b94166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b9a7ce640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b940b3290 con 0x7f2b9415bec0 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b9a7ce640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b940b3570 con 0x7f2b9415c2a0 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b9a7ce640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2b940b3850 con 0x7f2b9406f010 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b93fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2b9415bec0 0x7f2b940ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58094/0 (socket says 172.21.15.94:58094) 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b93fff640 1 -- 172.21.15.94:0/4033653372 learned_addr learned my addr 172.21.15.94:0/4033653372 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b98d6b640 1 --2- 172.21.15.94:0/4033653372 >> v2:172.21.15.94:3300/0 conn(0x7f2b9406f010 0x7f2b94166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b92ffd640 1 -- 172.21.15.94:0/4033653372 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975298670 0 0) 0x7f2b940b3290 con 0x7f2b9415bec0 2024-09-11T23:17:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b92ffd640 1 -- 172.21.15.94:0/4033653372 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b7c003530 con 0x7f2b9415bec0 2024-09-11T23:17:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b98d6b640 1 -- 172.21.15.94:0/4033653372 >> v1:172.21.15.155:6789/0 conn(0x7f2b9415c2a0 legacy=0x7f2b940aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b98d6b640 1 -- 172.21.15.94:0/4033653372 >> v1:172.21.15.94:6789/0 conn(0x7f2b9415bec0 legacy=0x7f2b940ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.106+0000 7f2b98d6b640 1 -- 172.21.15.94:0/4033653372 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b940b3b30 con 0x7f2b9406f010 2024-09-11T23:17:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b98d6b640 1 --2- 172.21.15.94:0/4033653372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9406f010 0x7f2b94166ff0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009d90 tx=0x7f2b8c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fbfc808b0e101b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b92ffd640 1 -- 172.21.15.94:0/4033653372 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0b2070 con 0x7f2b9406f010 2024-09-11T23:17:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b92ffd640 1 -- 172.21.15.94:0/4033653372 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0a5910 con 0x7f2b9406f010 2024-09-11T23:17:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b92ffd640 1 -- 172.21.15.94:0/4033653372 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0a5ce0 con 0x7f2b9406f010 2024-09-11T23:17:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/4033653372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9406f010 msgr2=0x7f2b94166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/4033653372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9406f010 0x7f2b94166ff0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009d90 tx=0x7f2b8c01c940 comp rx=0 tx=0).stop 2024-09-11T23:17:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/4033653372 shutdown_connections 2024-09-11T23:17:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/4033653372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9406f010 0x7f2b94166ff0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/4033653372 >> 172.21.15.94:0/4033653372 conn(0x7f2b940b1f90 msgr2=0x7f2b940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/4033653372 shutdown_connections 2024-09-11T23:17:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/4033653372 wait complete. 2024-09-11T23:17:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 Processor -- start 2024-09-11T23:17:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- start start 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9406f010 0x7f2b9414d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9415bec0 0x7f2b94152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9415c2a0 0x7f2b9414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94169ed0 con 0x7f2b9415c2a0 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94169d50 con 0x7f2b9415bec0 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b9a7ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9416a050 con 0x7f2b9406f010 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b98d6b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9415c2a0 0x7f2b9414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b98d6b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9415c2a0 0x7f2b9414f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37114/0 (socket says 172.21.15.94:37114) 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.110+0000 7f2b98d6b640 1 -- 172.21.15.94:0/1564011572 learned_addr learned my addr 172.21.15.94:0/1564011572 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b93fff640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9406f010 0x7f2b9414d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b937fe640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9415bec0 0x7f2b94152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b98d6b640 1 -- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9406f010 msgr2=0x7f2b9414d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b98d6b640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9406f010 0x7f2b9414d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b98d6b640 1 -- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9415bec0 msgr2=0x7f2b94152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b98d6b640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9415bec0 0x7f2b94152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b98d6b640 1 -- 172.21.15.94:0/1564011572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b941563d0 con 0x7f2b9415c2a0 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b937fe640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9415bec0 0x7f2b94152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b98d6b640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9415c2a0 0x7f2b9414f180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c01a570 tx=0x7f2b8c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b90ff9640 1 -- 172.21.15.94:0/1564011572 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0b2050 con 0x7f2b9415c2a0 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b90ff9640 1 -- 172.21.15.94:0/1564011572 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0be070 con 0x7f2b9415c2a0 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b941566b0 con 0x7f2b9415c2a0 2024-09-11T23:17:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b90ff9640 1 -- 172.21.15.94:0/1564011572 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0ada50 con 0x7f2b9415c2a0 2024-09-11T23:17:37.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b94156c70 con 0x7f2b9415c2a0 2024-09-11T23:17:37.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b940b3290 con 0x7f2b9415c2a0 2024-09-11T23:17:37.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b90ff9640 1 -- 172.21.15.94:0/1564011572 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b8c0adbf0 con 0x7f2b9415c2a0 2024-09-11T23:17:37.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b90ff9640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b800678c0 0x7f2b80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b90ff9640 1 -- 172.21.15.94:0/1564011572 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f2b8c121030 con 0x7f2b9415c2a0 2024-09-11T23:17:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b93fff640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b800678c0 0x7f2b80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.114+0000 7f2b93fff640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b800678c0 0x7f2b80069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2b880011f0 tx=0x7f2b88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.118+0000 7f2b90ff9640 1 -- 172.21.15.94:0/1564011572 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2b8c016560 con 0x7f2b9415c2a0 2024-09-11T23:17:37.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.278+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b940b1c90 con 0x7f2b9415c2a0 2024-09-11T23:17:37.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.278+0000 7f2b90ff9640 1 -- 172.21.15.94:0/1564011572 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16968 (secure 0 0 0) 0x7f2b8c0ab340 con 0x7f2b9415c2a0 2024-09-11T23:17:37.281 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:37.281 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":62,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:35.568025+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:31.612159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:32.924950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b800678c0 msgr2=0x7f2b80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b800678c0 0x7f2b80069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2b880011f0 tx=0x7f2b88009040 comp rx=0 tx=0).stop 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9415c2a0 msgr2=0x7f2b9414f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9415c2a0 0x7f2b9414f180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c01a570 tx=0x7f2b8c0196e0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 shutdown_connections 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b800678c0 0x7f2b80069d80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9415c2a0 0x7f2b9414f180 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9415bec0 0x7f2b94152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 --2- 172.21.15.94:0/1564011572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9406f010 0x7f2b9414d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 >> 172.21.15.94:0/1564011572 conn(0x7f2b940b1f90 msgr2=0x7f2b940b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 shutdown_connections 2024-09-11T23:17:37.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.282+0000 7f2b9a7ce640 1 -- 172.21.15.94:0/1564011572 wait complete. 2024-09-11T23:17:37.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:17:37.299 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:17:37.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f6450471640 1 Processor -- start 2024-09-11T23:17:37.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f6450471640 1 -- start start 2024-09-11T23:17:37.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f6450471640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644815c2a0 0x7f64480aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f6450471640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64480b3290 con 0x7f64480af2a0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f6450471640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64480b3570 con 0x7f644815bec0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f6450471640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64480b3850 con 0x7f644815c2a0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644ea0e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f64480af2a0 0x7f644806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58102/0 (socket says 172.21.15.94:58102) 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644ea0e640 1 -- 172.21.15.94:0/3112440199 learned_addr learned my addr 172.21.15.94:0/3112440199 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644da0c640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644815c2a0 0x7f64480aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342756019 0 0) 0x7f64480b3290 con 0x7f64480af2a0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6434003530 con 0x7f64480af2a0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2099505015 0 0) 0x7f6434003530 con 0x7f64480af2a0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644815c2a0 msgr2=0x7f64480aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644815c2a0 0x7f64480aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 >> v1:172.21.15.155:6789/0 conn(0x7f644815bec0 legacy=0x7f64480ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64480b3b30 con 0x7f64480af2a0 2024-09-11T23:17:37.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f6440001a00 con 0x7f64480af2a0 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 >> v1:172.21.15.94:6789/0 conn(0x7f64480af2a0 legacy=0x7f644806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64340039f0 0x7f6434003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6434004810 0x7f6434004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644815c2a0 0x7f64340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f64480b3850 con 0x7f64340039f0 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f643400ba80 con 0x7f6434004810 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f643400bc80 con 0x7f644815c2a0 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644e20d640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64340039f0 0x7f6434003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644e20d640 1 -- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644815c2a0 msgr2=0x7f64340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644e20d640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644815c2a0 0x7f64340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644e20d640 1 -- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6434004810 msgr2=0x7f6434004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644e20d640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6434004810 0x7f6434004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.406+0000 7f644e20d640 1 -- 172.21.15.94:0/3112440199 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6434003530 con 0x7f64340039f0 2024-09-11T23:17:37.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644e20d640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64340039f0 0x7f6434003e10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6444001750 tx=0x7f644401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a83460716c8d3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440013a0 con 0x7f64340039f0 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64440a4e50 con 0x7f64340039f0 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644d20b640 1 -- 172.21.15.94:0/3112440199 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444003600 con 0x7f64340039f0 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- 172.21.15.94:0/3112440199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64340039f0 msgr2=0x7f6434003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 --2- 172.21.15.94:0/3112440199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64340039f0 0x7f6434003e10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6444001750 tx=0x7f644401c390 comp rx=0 tx=0).stop 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 -- 172.21.15.94:0/3112440199 reap_dead start 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- 172.21.15.94:0/3112440199 shutdown_connections 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- 172.21.15.94:0/3112440199 >> 172.21.15.94:0/3112440199 conn(0x7f64480b1f90 msgr2=0x7f64480b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- 172.21.15.94:0/3112440199 shutdown_connections 2024-09-11T23:17:37.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- 172.21.15.94:0/3112440199 wait complete. 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 Processor -- start 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- start start 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64340039f0 0x7f6448152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644814d740 0x7f6448143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f644814e0e0 0x7f644815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f644806ef20 con 0x7f644814e0e0 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64480af6d0 con 0x7f644814d740 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f6450471640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f644806f0a0 con 0x7f64340039f0 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f644814e0e0 0x7f644815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f644814e0e0 0x7f644815aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37140/0 (socket says 172.21.15.94:37140) 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 -- 172.21.15.94:0/94679350 learned_addr learned my addr 172.21.15.94:0/94679350 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644e20d640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64340039f0 0x7f6448152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644da0c640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644814d740 0x7f6448143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 -- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64340039f0 msgr2=0x7f6448152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64340039f0 0x7f6448152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 -- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644814d740 msgr2=0x7f6448143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644814d740 0x7f6448143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 -- 172.21.15.94:0/94679350 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644814e560 con 0x7f644814e0e0 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644da0c640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644814d740 0x7f6448143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.410+0000 7f644ea0e640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f644814e0e0 0x7f644815aa30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f644000c840 tx=0x7f644000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f643effd640 1 -- 172.21.15.94:0/94679350 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644000a5e0 con 0x7f644814e0e0 2024-09-11T23:17:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f643effd640 1 -- 172.21.15.94:0/94679350 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644000a780 con 0x7f644814e0e0 2024-09-11T23:17:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64481530c0 con 0x7f644814e0e0 2024-09-11T23:17:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f643effd640 1 -- 172.21.15.94:0/94679350 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644000ab30 con 0x7f644814e0e0 2024-09-11T23:17:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6448153680 con 0x7f644814e0e0 2024-09-11T23:17:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6448153850 con 0x7f644814e0e0 2024-09-11T23:17:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f643effd640 1 -- 172.21.15.94:0/94679350 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f644000acd0 con 0x7f644814e0e0 2024-09-11T23:17:37.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f643effd640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f642c0678c0 0x7f642c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f643effd640 1 -- 172.21.15.94:0/94679350 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f6440085600 con 0x7f644814e0e0 2024-09-11T23:17:37.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.414+0000 7f644e20d640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f642c0678c0 0x7f642c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.418+0000 7f644e20d640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f642c0678c0 0x7f642c069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f64340057f0 tx=0x7f64440011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.418+0000 7f643effd640 1 -- 172.21.15.94:0/94679350 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f644814e560 con 0x7f644814e0e0 2024-09-11T23:17:37.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.578+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f644806e000 con 0x7f642c0678c0 2024-09-11T23:17:37.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.594+0000 7f643effd640 1 -- 172.21.15.94:0/94679350 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237243 (secure 0 0 0) 0x7f644806e000 con 0x7f642c0678c0 2024-09-11T23:17:37.596 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:37.598 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:17:37.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f642c0678c0 msgr2=0x7f642c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f642c0678c0 0x7f642c069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f64340057f0 tx=0x7f64440011a0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f644814e0e0 msgr2=0x7f644815aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f644814e0e0 0x7f644815aa30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f644000c840 tx=0x7f644000cd00 comp rx=0 tx=0).stop 2024-09-11T23:17:37.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 shutdown_connections 2024-09-11T23:17:37.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f642c0678c0 0x7f642c069d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f644814e0e0 0x7f644815aa30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644814d740 0x7f6448143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 --2- 172.21.15.94:0/94679350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64340039f0 0x7f6448152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 >> 172.21.15.94:0/94679350 conn(0x7f64480b1f90 msgr2=0x7f64480b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 shutdown_connections 2024-09-11T23:17:37.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.598+0000 7f6450471640 1 -- 172.21.15.94:0/94679350 wait complete. 2024-09-11T23:17:37.614 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-09-11T23:17:36.014768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":272764,"kb_used_data":6608,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754701956,"statfs":{"total":773094113280,"available":772814802944,"internally_reserved":0,"allocated":6766592,"data_stored":3661470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001115"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:17:30.562316+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:17:30.562316+0000","last_peered":"2024-09-11T23:17:30.562316+0000","last_clean":"2024-09-11T23:17:30.562316+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:17:30.562316+0000","last_undegraded":"2024-09-11T23:17:30.562316+0000","last_fullsized":"2024-09-11T23:17:30.562316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1294336,"data_stored":901822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31876,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31860,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":688128,"data_stored":306005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36020,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":688128,"data_stored":306005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36616,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335224,"statfs":{"total":96636764160,"available":96599269376,"internally_reserved":0,"allocated":1294336,"data_stored":901822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:37.619 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:17:37.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3ed82640 1 Processor -- start 2024-09-11T23:17:37.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3ed82640 1 -- start start 2024-09-11T23:17:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3ed82640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0f3815bec0 0x7f0f380ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3ed82640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0f380af470 0x7f0f3806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3ed82640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f380b3290 con 0x7f0f3815c2a0 2024-09-11T23:17:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3ed82640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0f380b3570 con 0x7f0f3815bec0 2024-09-11T23:17:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3ed82640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0f380b3850 con 0x7f0f380af470 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3cb1e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0f3815bec0 0x7f0f380ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3cb1e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0f3815bec0 0x7f0f380ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37146/0 (socket says 172.21.15.94:37146) 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3cb1e640 1 -- 172.21.15.94:0/3287482832 learned_addr learned my addr 172.21.15.94:0/3287482832 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3d31f640 1 --2- 172.21.15.94:0/3287482832 >> v2:172.21.15.155:3300/0 conn(0x7f0f380af470 0x7f0f3806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3cb1e640 1 -- 172.21.15.94:0/3287482832 >> v2:172.21.15.155:3300/0 conn(0x7f0f380af470 msgr2=0x7f0f3806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3cb1e640 1 --2- 172.21.15.94:0/3287482832 >> v2:172.21.15.155:3300/0 conn(0x7f0f380af470 0x7f0f3806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3cb1e640 1 -- 172.21.15.94:0/3287482832 >> v1:172.21.15.155:6789/0 conn(0x7f0f3815c2a0 legacy=0x7f0f380aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3cb1e640 1 -- 172.21.15.94:0/3287482832 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f380b3b30 con 0x7f0f3815bec0 2024-09-11T23:17:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.778+0000 7f0f3d31f640 1 --2- 172.21.15.94:0/3287482832 >> v2:172.21.15.155:3300/0 conn(0x7f0f380af470 0x7f0f3806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:37.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3cb1e640 1 --2- 172.21.15.94:0/3287482832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815bec0 0x7f0f380ad200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0f380b2fb0 tx=0x7f0f3001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb310952342bd90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f377fe640 1 -- 172.21.15.94:0/3287482832 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f300b1070 con 0x7f0f3815bec0 2024-09-11T23:17:37.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f377fe640 1 -- 172.21.15.94:0/3287482832 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f300ac620 con 0x7f0f3815bec0 2024-09-11T23:17:37.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f377fe640 1 -- 172.21.15.94:0/3287482832 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f300ac9f0 con 0x7f0f3815bec0 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3287482832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815bec0 msgr2=0x7f0f380ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3287482832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815bec0 0x7f0f380ad200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0f380b2fb0 tx=0x7f0f3001c4b0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3287482832 shutdown_connections 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3287482832 >> v2:172.21.15.155:3300/0 conn(0x7f0f380af470 0x7f0f3806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3287482832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815bec0 0x7f0f380ad200 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3287482832 >> 172.21.15.94:0/3287482832 conn(0x7f0f380b1f90 msgr2=0x7f0f380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3287482832 shutdown_connections 2024-09-11T23:17:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3287482832 wait complete. 2024-09-11T23:17:37.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 Processor -- start 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.782+0000 7f0f3ed82640 1 -- start start 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380af470 0x7f0f38166470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3815bec0 0x7f0f381478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815c2a0 0x7f0f38157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3806ed50 con 0x7f0f3815c2a0 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f380ad740 con 0x7f0f380af470 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3806eed0 con 0x7f0f3815bec0 2024-09-11T23:17:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815c2a0 0x7f0f38157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815c2a0 0x7f0f38157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37148/0 (socket says 172.21.15.94:37148) 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 -- 172.21.15.94:0/3794163465 learned_addr learned my addr 172.21.15.94:0/3794163465 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3cb1e640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380af470 0x7f0f38166470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f37fff640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3815bec0 0x7f0f381478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 -- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3815bec0 msgr2=0x7f0f381478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3815bec0 0x7f0f381478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 -- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380af470 msgr2=0x7f0f38166470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380af470 0x7f0f38166470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 -- 172.21.15.94:0/3794163465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f380b0670 con 0x7f0f3815c2a0 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f37fff640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3815bec0 0x7f0f381478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3cb1e640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380af470 0x7f0f38166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3d31f640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815c2a0 0x7f0f38157820 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800cf20 tx=0x7f0f2800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f357fa640 1 -- 172.21.15.94:0/3794163465 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2801a070 con 0x7f0f3815c2a0 2024-09-11T23:17:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f357fa640 1 -- 172.21.15.94:0/3794163465 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2800d840 con 0x7f0f3815c2a0 2024-09-11T23:17:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f380b0950 con 0x7f0f3815c2a0 2024-09-11T23:17:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f357fa640 1 -- 172.21.15.94:0/3794163465 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2800dc30 con 0x7f0f3815c2a0 2024-09-11T23:17:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f380b0f10 con 0x7f0f3815c2a0 2024-09-11T23:17:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3806e000 con 0x7f0f3815c2a0 2024-09-11T23:17:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f357fa640 1 -- 172.21.15.94:0/3794163465 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f2801d070 con 0x7f0f3815c2a0 2024-09-11T23:17:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f357fa640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f180678f0 0x7f0f18069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f357fa640 1 -- 172.21.15.94:0/3794163465 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f0f28086710 con 0x7f0f3815c2a0 2024-09-11T23:17:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.786+0000 7f0f3cb1e640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f180678f0 0x7f0f18069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.790+0000 7f0f3cb1e640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f180678f0 0x7f0f18069db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0f300ae000 tx=0x7f0f30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.790+0000 7f0f357fa640 1 -- 172.21.15.94:0/3794163465 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f28057030 con 0x7f0f3815c2a0 2024-09-11T23:17:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.938+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f380b0420 con 0x7f0f180678f0 2024-09-11T23:17:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.954+0000 7f0f357fa640 1 -- 172.21.15.94:0/3794163465 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237243 (secure 0 0 0) 0x7f0f380b0420 con 0x7f0f180678f0 2024-09-11T23:17:37.959 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:37.961 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f180678f0 msgr2=0x7f0f18069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f180678f0 0x7f0f18069db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0f300ae000 tx=0x7f0f30008040 comp rx=0 tx=0).stop 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815c2a0 msgr2=0x7f0f38157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815c2a0 0x7f0f38157820 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800cf20 tx=0x7f0f2800a7d0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 shutdown_connections 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f180678f0 0x7f0f18069db0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f3815c2a0 0x7f0f38157820 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3815bec0 0x7f0f381478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 --2- 172.21.15.94:0/3794163465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380af470 0x7f0f38166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 >> 172.21.15.94:0/3794163465 conn(0x7f0f380b1f90 msgr2=0x7f0f38159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 shutdown_connections 2024-09-11T23:17:37.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:37.958+0000 7f0f3ed82640 1 -- 172.21.15.94:0/3794163465 wait complete. 2024-09-11T23:17:37.975 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-09-11T23:17:36.014768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":272764,"kb_used_data":6608,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754701956,"statfs":{"total":773094113280,"available":772814802944,"internally_reserved":0,"allocated":6766592,"data_stored":3661470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001115"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:33.555574+0000","last_change":"2024-09-11T23:17:33.555574+0000","last_active":"2024-09-11T23:17:33.555574+0000","last_peered":"2024-09-11T23:17:33.555574+0000","last_clean":"2024-09-11T23:17:33.555574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:33.555574+0000","last_undegraded":"2024-09-11T23:17:33.555574+0000","last_fullsized":"2024-09-11T23:17:33.555574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:17:32.545366+0000","last_change":"2024-09-11T23:17:32.545366+0000","last_active":"2024-09-11T23:17:32.545366+0000","last_peered":"2024-09-11T23:17:32.545366+0000","last_clean":"2024-09-11T23:17:32.545366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:32.545366+0000","last_undegraded":"2024-09-11T23:17:32.545366+0000","last_fullsized":"2024-09-11T23:17:32.545366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:17:30.562316+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:17:30.562316+0000","last_peered":"2024-09-11T23:17:30.562316+0000","last_clean":"2024-09-11T23:17:30.562316+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:17:30.562316+0000","last_undegraded":"2024-09-11T23:17:30.562316+0000","last_fullsized":"2024-09-11T23:17:30.562316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1294336,"data_stored":901822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31876,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31860,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":688128,"data_stored":306005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":311454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36020,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":688128,"data_stored":306005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36616,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335224,"statfs":{"total":96636764160,"available":96599269376,"internally_reserved":0,"allocated":1294336,"data_stored":901822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:37.978 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:17:38.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.126+0000 7f92450c1640 1 Processor -- start 2024-09-11T23:17:38.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.126+0000 7f92450c1640 1 -- start start 2024-09-11T23:17:38.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.126+0000 7f92450c1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9240070020 0x7f924015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.126+0000 7f92450c1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92400aede0 con 0x7f92401520a0 2024-09-11T23:17:38.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.126+0000 7f92450c1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924015fa10 con 0x7f924015f1d0 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.126+0000 7f92450c1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9240152480 con 0x7f9240070020 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923ed9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f92401520a0 0x7f924006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58104/0 (socket says 172.21.15.94:58104) 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923ed9d640 1 -- 172.21.15.94:0/2408327234 learned_addr learned my addr 172.21.15.94:0/2408327234 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923e59c640 1 --2- 172.21.15.94:0/2408327234 >> v2:172.21.15.155:3300/0 conn(0x7f9240070020 0x7f924015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339270699 0 0) 0x7f92400aede0 con 0x7f92401520a0 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9228003530 con 0x7f92401520a0 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2747525879 0 0) 0x7f9228003530 con 0x7f92401520a0 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 >> v2:172.21.15.155:3300/0 conn(0x7f9240070020 msgr2=0x7f924015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 --2- 172.21.15.94:0/2408327234 >> v2:172.21.15.155:3300/0 conn(0x7f9240070020 0x7f924015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 >> v1:172.21.15.155:6789/0 conn(0x7f924015f1d0 legacy=0x7f92400adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9240074250 con 0x7f92401520a0 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f9230001680 con 0x7f92401520a0 2024-09-11T23:17:38.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 >> v1:172.21.15.94:6789/0 conn(0x7f92401520a0 legacy=0x7f924006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92280039c0 0x7f9228003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9228004810 0x7f9228004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92280051d0 0x7f922800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f922800c040 con 0x7f92280051d0 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f922800c1f0 con 0x7f9228004810 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f922800c3f0 con 0x7f92280039c0 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923f59e640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92280051d0 0x7f922800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923e59c640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9228004810 0x7f9228004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923ed9d640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92280039c0 0x7f9228003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923f59e640 1 -- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92280039c0 msgr2=0x7f9228003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923f59e640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92280039c0 0x7f9228003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923f59e640 1 -- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9228004810 msgr2=0x7f9228004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:38.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923f59e640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9228004810 0x7f9228004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923f59e640 1 -- 172.21.15.94:0/2408327234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9228003530 con 0x7f92280051d0 2024-09-11T23:17:38.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.130+0000 7f923f59e640 1 -- 172.21.15.94:0/2408327234 reap_dead start 2024-09-11T23:17:38.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92280051d0 0x7f922800b9d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9238001e70 tx=0x7f923801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27001fa5563b3fff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238001a90 con 0x7f92280051d0 2024-09-11T23:17:38.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9238003ba0 con 0x7f92280051d0 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923dd9b640 1 -- 172.21.15.94:0/2408327234 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238005020 con 0x7f92280051d0 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- 172.21.15.94:0/2408327234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92280051d0 msgr2=0x7f922800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92280051d0 0x7f922800b9d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9238001e70 tx=0x7f923801c780 comp rx=0 tx=0).stop 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- 172.21.15.94:0/2408327234 shutdown_connections 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 --2- 172.21.15.94:0/2408327234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92280051d0 0x7f922800b9d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- 172.21.15.94:0/2408327234 >> 172.21.15.94:0/2408327234 conn(0x7f92400b1f90 msgr2=0x7f92400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- 172.21.15.94:0/2408327234 shutdown_connections 2024-09-11T23:17:38.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- 172.21.15.94:0/2408327234 wait complete. 2024-09-11T23:17:38.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 Processor -- start 2024-09-11T23:17:38.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- start start 2024-09-11T23:17:38.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92280051d0 0x7f924015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924015b5f0 0x7f92400cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92400cd1f0 0x7f92400cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9240073a50 con 0x7f92400cd1f0 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9240073770 con 0x7f92280051d0 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9240073d30 con 0x7f924015b5f0 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92400cd1f0 0x7f92400cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92400cd1f0 0x7f92400cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37162/0 (socket says 172.21.15.94:37162) 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 -- 172.21.15.94:0/2761630987 learned_addr learned my addr 172.21.15.94:0/2761630987 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923e59c640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924015b5f0 0x7f92400cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923ed9d640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92280051d0 0x7f924015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 -- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924015b5f0 msgr2=0x7f92400cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924015b5f0 0x7f92400cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 -- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92280051d0 msgr2=0x7f924015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92280051d0 0x7f924015cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 -- 172.21.15.94:0/2761630987 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924015be40 con 0x7f92400cd1f0 2024-09-11T23:17:38.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f923f59e640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92400cd1f0 0x7f92400cf2e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f923801d020 tx=0x7f9228005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92277fe640 1 -- 172.21.15.94:0/2761630987 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238007dc0 con 0x7f92400cd1f0 2024-09-11T23:17:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92277fe640 1 -- 172.21.15.94:0/2761630987 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9238001260 con 0x7f92400cd1f0 2024-09-11T23:17:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924015c120 con 0x7f92400cd1f0 2024-09-11T23:17:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92277fe640 1 -- 172.21.15.94:0/2761630987 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238006b60 con 0x7f92400cd1f0 2024-09-11T23:17:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.134+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924015c6e0 con 0x7f92400cd1f0 2024-09-11T23:17:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.138+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9240068e50 con 0x7f92400cd1f0 2024-09-11T23:17:38.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.138+0000 7f92277fe640 1 -- 172.21.15.94:0/2761630987 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9238005070 con 0x7f92400cd1f0 2024-09-11T23:17:38.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.138+0000 7f92277fe640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f922c0678f0 0x7f922c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.138+0000 7f92277fe640 1 -- 172.21.15.94:0/2761630987 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f923811f520 con 0x7f92400cd1f0 2024-09-11T23:17:38.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.138+0000 7f923ed9d640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f922c0678f0 0x7f922c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.138+0000 7f923ed9d640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f922c0678f0 0x7f922c069db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9230001060 tx=0x7f9230009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.142+0000 7f92277fe640 1 -- 172.21.15.94:0/2761630987 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9238016490 con 0x7f92400cd1f0 2024-09-11T23:17:38.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.298+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92400aede0 con 0x7f922c0678f0 2024-09-11T23:17:38.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.314+0000 7f92277fe640 1 -- 172.21.15.94:0/2761630987 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252022 (secure 0 0 0) 0x7f92400aede0 con 0x7f922c0678f0 2024-09-11T23:17:38.319 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:38.321 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f922c0678f0 msgr2=0x7f922c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f922c0678f0 0x7f922c069db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9230001060 tx=0x7f9230009040 comp rx=0 tx=0).stop 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92400cd1f0 msgr2=0x7f92400cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92400cd1f0 0x7f92400cf2e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f923801d020 tx=0x7f9228005840 comp rx=0 tx=0).stop 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 shutdown_connections 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f922c0678f0 0x7f922c069db0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92400cd1f0 0x7f92400cf2e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924015b5f0 0x7f92400cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 --2- 172.21.15.94:0/2761630987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92280051d0 0x7f924015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.318+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 >> 172.21.15.94:0/2761630987 conn(0x7f92400b1f90 msgr2=0x7f924006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.322+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 shutdown_connections 2024-09-11T23:17:38.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.322+0000 7f92450c1640 1 -- 172.21.15.94:0/2761630987 wait complete. 2024-09-11T23:17:38.337 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-11T23:17:38.015359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273276,"kb_used_data":7080,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754701444,"statfs":{"total":773094113280,"available":772814278656,"internally_reserved":0,"allocated":7249920,"data_stored":3891004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457620"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574338+0000","last_change":"2024-09-11T23:17:34.610626+0000","last_active":"2024-09-11T23:17:35.574338+0000","last_peered":"2024-09-11T23:17:35.574338+0000","last_clean":"2024-09-11T23:17:35.574338+0000","last_became_active":"2024-09-11T23:17:34.610292+0000","last_became_peered":"2024-09-11T23:17:34.610292+0000","last_unstale":"2024-09-11T23:17:35.574338+0000","last_undegraded":"2024-09-11T23:17:35.574338+0000","last_fullsized":"2024-09-11T23:17:35.574338+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.737918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573919+0000","last_change":"2024-09-11T23:17:34.598346+0000","last_active":"2024-09-11T23:17:35.573919+0000","last_peered":"2024-09-11T23:17:35.573919+0000","last_clean":"2024-09-11T23:17:35.573919+0000","last_became_active":"2024-09-11T23:17:34.597835+0000","last_became_peered":"2024-09-11T23:17:34.597835+0000","last_unstale":"2024-09-11T23:17:35.573919+0000","last_undegraded":"2024-09-11T23:17:35.573919+0000","last_fullsized":"2024-09-11T23:17:35.573919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581697+0000","last_change":"2024-09-11T23:17:34.639616+0000","last_active":"2024-09-11T23:17:35.581697+0000","last_peered":"2024-09-11T23:17:35.581697+0000","last_clean":"2024-09-11T23:17:35.581697+0000","last_became_active":"2024-09-11T23:17:34.639047+0000","last_became_peered":"2024-09-11T23:17:34.639047+0000","last_unstale":"2024-09-11T23:17:35.581697+0000","last_undegraded":"2024-09-11T23:17:35.581697+0000","last_fullsized":"2024-09-11T23:17:35.581697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:55.919028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778401+0000","last_change":"2024-09-11T23:17:34.601465+0000","last_active":"2024-09-11T23:17:35.778401+0000","last_peered":"2024-09-11T23:17:35.778401+0000","last_clean":"2024-09-11T23:17:35.778401+0000","last_became_active":"2024-09-11T23:17:34.600532+0000","last_became_peered":"2024-09-11T23:17:34.600532+0000","last_unstale":"2024-09-11T23:17:35.778401+0000","last_undegraded":"2024-09-11T23:17:35.778401+0000","last_fullsized":"2024-09-11T23:17:35.778401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835933+0000","last_change":"2024-09-11T23:17:34.624914+0000","last_active":"2024-09-11T23:17:35.835933+0000","last_peered":"2024-09-11T23:17:35.835933+0000","last_clean":"2024-09-11T23:17:35.835933+0000","last_became_active":"2024-09-11T23:17:34.623884+0000","last_became_peered":"2024-09-11T23:17:34.623884+0000","last_unstale":"2024-09-11T23:17:35.835933+0000","last_undegraded":"2024-09-11T23:17:35.835933+0000","last_fullsized":"2024-09-11T23:17:35.835933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:27.679699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805057+0000","last_change":"2024-09-11T23:17:34.634109+0000","last_active":"2024-09-11T23:17:35.805057+0000","last_peered":"2024-09-11T23:17:35.805057+0000","last_clean":"2024-09-11T23:17:35.805057+0000","last_became_active":"2024-09-11T23:17:34.633857+0000","last_became_peered":"2024-09-11T23:17:34.633857+0000","last_unstale":"2024-09-11T23:17:35.805057+0000","last_undegraded":"2024-09-11T23:17:35.805057+0000","last_fullsized":"2024-09-11T23:17:35.805057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:46.404163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835274+0000","last_change":"2024-09-11T23:17:34.614969+0000","last_active":"2024-09-11T23:17:35.835274+0000","last_peered":"2024-09-11T23:17:35.835274+0000","last_clean":"2024-09-11T23:17:35.835274+0000","last_became_active":"2024-09-11T23:17:34.614609+0000","last_became_peered":"2024-09-11T23:17:34.614609+0000","last_unstale":"2024-09-11T23:17:35.835274+0000","last_undegraded":"2024-09-11T23:17:35.835274+0000","last_fullsized":"2024-09-11T23:17:35.835274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:24.347228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.577901+0000","last_change":"2024-09-11T23:17:34.630620+0000","last_active":"2024-09-11T23:17:35.577901+0000","last_peered":"2024-09-11T23:17:35.577901+0000","last_clean":"2024-09-11T23:17:35.577901+0000","last_became_active":"2024-09-11T23:17:34.630078+0000","last_became_peered":"2024-09-11T23:17:34.630078+0000","last_unstale":"2024-09-11T23:17:35.577901+0000","last_undegraded":"2024-09-11T23:17:35.577901+0000","last_fullsized":"2024-09-11T23:17:35.577901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:52.631056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582238+0000","last_change":"2024-09-11T23:17:34.644282+0000","last_active":"2024-09-11T23:17:35.582238+0000","last_peered":"2024-09-11T23:17:35.582238+0000","last_clean":"2024-09-11T23:17:35.582238+0000","last_became_active":"2024-09-11T23:17:34.643881+0000","last_became_peered":"2024-09-11T23:17:34.643881+0000","last_unstale":"2024-09-11T23:17:35.582238+0000","last_undegraded":"2024-09-11T23:17:35.582238+0000","last_fullsized":"2024-09-11T23:17:35.582238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:01.314621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581683+0000","last_change":"2024-09-11T23:17:34.640010+0000","last_active":"2024-09-11T23:17:35.581683+0000","last_peered":"2024-09-11T23:17:35.581683+0000","last_clean":"2024-09-11T23:17:35.581683+0000","last_became_active":"2024-09-11T23:17:34.639510+0000","last_became_peered":"2024-09-11T23:17:34.639510+0000","last_unstale":"2024-09-11T23:17:35.581683+0000","last_undegraded":"2024-09-11T23:17:35.581683+0000","last_fullsized":"2024-09-11T23:17:35.581683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778144+0000","last_change":"2024-09-11T23:17:34.618630+0000","last_active":"2024-09-11T23:17:35.778144+0000","last_peered":"2024-09-11T23:17:35.778144+0000","last_clean":"2024-09-11T23:17:35.778144+0000","last_became_active":"2024-09-11T23:17:34.608228+0000","last_became_peered":"2024-09-11T23:17:34.608228+0000","last_unstale":"2024-09-11T23:17:35.778144+0000","last_undegraded":"2024-09-11T23:17:35.778144+0000","last_fullsized":"2024-09-11T23:17:35.778144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:53.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578819+0000","last_change":"2024-09-11T23:17:34.632597+0000","last_active":"2024-09-11T23:17:35.578819+0000","last_peered":"2024-09-11T23:17:35.578819+0000","last_clean":"2024-09-11T23:17:35.578819+0000","last_became_active":"2024-09-11T23:17:34.632015+0000","last_became_peered":"2024-09-11T23:17:34.632015+0000","last_unstale":"2024-09-11T23:17:35.578819+0000","last_undegraded":"2024-09-11T23:17:35.578819+0000","last_fullsized":"2024-09-11T23:17:35.578819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:55.919028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578297+0000","last_change":"2024-09-11T23:17:34.604297+0000","last_active":"2024-09-11T23:17:35.578297+0000","last_peered":"2024-09-11T23:17:35.578297+0000","last_clean":"2024-09-11T23:17:35.578297+0000","last_became_active":"2024-09-11T23:17:34.603548+0000","last_became_peered":"2024-09-11T23:17:34.603548+0000","last_unstale":"2024-09-11T23:17:35.578297+0000","last_undegraded":"2024-09-11T23:17:35.578297+0000","last_fullsized":"2024-09-11T23:17:35.578297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:21.417324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582034+0000","last_change":"2024-09-11T23:17:34.639859+0000","last_active":"2024-09-11T23:17:35.582034+0000","last_peered":"2024-09-11T23:17:35.582034+0000","last_clean":"2024-09-11T23:17:35.582034+0000","last_became_active":"2024-09-11T23:17:34.634911+0000","last_became_peered":"2024-09-11T23:17:34.634911+0000","last_unstale":"2024-09-11T23:17:35.582034+0000","last_undegraded":"2024-09-11T23:17:35.582034+0000","last_fullsized":"2024-09-11T23:17:35.582034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:37.152639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582111+0000","last_change":"2024-09-11T23:17:34.639618+0000","last_active":"2024-09-11T23:17:35.582111+0000","last_peered":"2024-09-11T23:17:35.582111+0000","last_clean":"2024-09-11T23:17:35.582111+0000","last_became_active":"2024-09-11T23:17:34.638865+0000","last_became_peered":"2024-09-11T23:17:34.638865+0000","last_unstale":"2024-09-11T23:17:35.582111+0000","last_undegraded":"2024-09-11T23:17:35.582111+0000","last_fullsized":"2024-09-11T23:17:35.582111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.144974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835776+0000","last_change":"2024-09-11T23:17:34.594655+0000","last_active":"2024-09-11T23:17:35.835776+0000","last_peered":"2024-09-11T23:17:35.835776+0000","last_clean":"2024-09-11T23:17:35.835776+0000","last_became_active":"2024-09-11T23:17:34.594178+0000","last_became_peered":"2024-09-11T23:17:34.594178+0000","last_unstale":"2024-09-11T23:17:35.835776+0000","last_undegraded":"2024-09-11T23:17:35.835776+0000","last_fullsized":"2024-09-11T23:17:35.835776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:39.763314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574434+0000","last_change":"2024-09-11T23:17:34.631438+0000","last_active":"2024-09-11T23:17:35.574434+0000","last_peered":"2024-09-11T23:17:35.574434+0000","last_clean":"2024-09-11T23:17:35.574434+0000","last_became_active":"2024-09-11T23:17:34.631153+0000","last_became_peered":"2024-09-11T23:17:34.631153+0000","last_unstale":"2024-09-11T23:17:35.574434+0000","last_undegraded":"2024-09-11T23:17:35.574434+0000","last_fullsized":"2024-09-11T23:17:35.574434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:52.631056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778229+0000","last_change":"2024-09-11T23:17:34.608071+0000","last_active":"2024-09-11T23:17:35.778229+0000","last_peered":"2024-09-11T23:17:35.778229+0000","last_clean":"2024-09-11T23:17:35.778229+0000","last_became_active":"2024-09-11T23:17:34.607234+0000","last_became_peered":"2024-09-11T23:17:34.607234+0000","last_unstale":"2024-09-11T23:17:35.778229+0000","last_undegraded":"2024-09-11T23:17:35.778229+0000","last_fullsized":"2024-09-11T23:17:35.778229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836532+0000","last_change":"2024-09-11T23:17:34.623285+0000","last_active":"2024-09-11T23:17:35.836532+0000","last_peered":"2024-09-11T23:17:35.836532+0000","last_clean":"2024-09-11T23:17:35.836532+0000","last_became_active":"2024-09-11T23:17:34.616906+0000","last_became_peered":"2024-09-11T23:17:34.616906+0000","last_unstale":"2024-09-11T23:17:35.836532+0000","last_undegraded":"2024-09-11T23:17:35.836532+0000","last_fullsized":"2024-09-11T23:17:35.836532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677292+0000","last_change":"2024-09-11T23:17:34.616201+0000","last_active":"2024-09-11T23:17:35.677292+0000","last_peered":"2024-09-11T23:17:35.677292+0000","last_clean":"2024-09-11T23:17:35.677292+0000","last_became_active":"2024-09-11T23:17:34.615857+0000","last_became_peered":"2024-09-11T23:17:34.615857+0000","last_unstale":"2024-09-11T23:17:35.677292+0000","last_undegraded":"2024-09-11T23:17:35.677292+0000","last_fullsized":"2024-09-11T23:17:35.677292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:48.219264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578949+0000","last_change":"2024-09-11T23:17:34.603353+0000","last_active":"2024-09-11T23:17:35.578949+0000","last_peered":"2024-09-11T23:17:35.578949+0000","last_clean":"2024-09-11T23:17:35.578949+0000","last_became_active":"2024-09-11T23:17:34.602564+0000","last_became_peered":"2024-09-11T23:17:34.602564+0000","last_unstale":"2024-09-11T23:17:35.578949+0000","last_undegraded":"2024-09-11T23:17:35.578949+0000","last_fullsized":"2024-09-11T23:17:35.578949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:24.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677377+0000","last_change":"2024-09-11T23:17:34.627921+0000","last_active":"2024-09-11T23:17:35.677377+0000","last_peered":"2024-09-11T23:17:35.677377+0000","last_clean":"2024-09-11T23:17:35.677377+0000","last_became_active":"2024-09-11T23:17:34.627609+0000","last_became_peered":"2024-09-11T23:17:34.627609+0000","last_unstale":"2024-09-11T23:17:35.677377+0000","last_undegraded":"2024-09-11T23:17:35.677377+0000","last_fullsized":"2024-09-11T23:17:35.677377+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:07.851836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677119+0000","last_change":"2024-09-11T23:17:34.613694+0000","last_active":"2024-09-11T23:17:35.677119+0000","last_peered":"2024-09-11T23:17:35.677119+0000","last_clean":"2024-09-11T23:17:35.677119+0000","last_became_active":"2024-09-11T23:17:34.613455+0000","last_became_peered":"2024-09-11T23:17:34.613455+0000","last_unstale":"2024-09-11T23:17:35.677119+0000","last_undegraded":"2024-09-11T23:17:35.677119+0000","last_fullsized":"2024-09-11T23:17:35.677119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:51.163893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581047+0000","last_change":"2024-09-11T23:17:34.642971+0000","last_active":"2024-09-11T23:17:35.581047+0000","last_peered":"2024-09-11T23:17:35.581047+0000","last_clean":"2024-09-11T23:17:35.581047+0000","last_became_active":"2024-09-11T23:17:34.635154+0000","last_became_peered":"2024-09-11T23:17:34.635154+0000","last_unstale":"2024-09-11T23:17:35.581047+0000","last_undegraded":"2024-09-11T23:17:35.581047+0000","last_fullsized":"2024-09-11T23:17:35.581047+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579164+0000","last_change":"2024-09-11T23:17:34.590339+0000","last_active":"2024-09-11T23:17:35.579164+0000","last_peered":"2024-09-11T23:17:35.579164+0000","last_clean":"2024-09-11T23:17:35.579164+0000","last_became_active":"2024-09-11T23:17:34.587717+0000","last_became_peered":"2024-09-11T23:17:34.587717+0000","last_unstale":"2024-09-11T23:17:35.579164+0000","last_undegraded":"2024-09-11T23:17:35.579164+0000","last_fullsized":"2024-09-11T23:17:35.579164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:37.152639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579884+0000","last_change":"2024-09-11T23:17:34.591092+0000","last_active":"2024-09-11T23:17:35.579884+0000","last_peered":"2024-09-11T23:17:35.579884+0000","last_clean":"2024-09-11T23:17:35.579884+0000","last_became_active":"2024-09-11T23:17:34.588315+0000","last_became_peered":"2024-09-11T23:17:34.588315+0000","last_unstale":"2024-09-11T23:17:35.579884+0000","last_undegraded":"2024-09-11T23:17:35.579884+0000","last_fullsized":"2024-09-11T23:17:35.579884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.144974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778333+0000","last_change":"2024-09-11T23:17:34.618277+0000","last_active":"2024-09-11T23:17:35.778333+0000","last_peered":"2024-09-11T23:17:35.778333+0000","last_clean":"2024-09-11T23:17:35.778333+0000","last_became_active":"2024-09-11T23:17:34.599936+0000","last_became_peered":"2024-09-11T23:17:34.599936+0000","last_unstale":"2024-09-11T23:17:35.778333+0000","last_undegraded":"2024-09-11T23:17:35.778333+0000","last_fullsized":"2024-09-11T23:17:35.778333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:27.679699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573423+0000","last_change":"2024-09-11T23:17:34.625949+0000","last_active":"2024-09-11T23:17:35.573423+0000","last_peered":"2024-09-11T23:17:35.573423+0000","last_clean":"2024-09-11T23:17:35.573423+0000","last_became_active":"2024-09-11T23:17:34.625727+0000","last_became_peered":"2024-09-11T23:17:34.625727+0000","last_unstale":"2024-09-11T23:17:35.573423+0000","last_undegraded":"2024-09-11T23:17:35.573423+0000","last_fullsized":"2024-09-11T23:17:35.573423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:26.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582293+0000","last_change":"2024-09-11T23:17:34.644062+0000","last_active":"2024-09-11T23:17:35.582293+0000","last_peered":"2024-09-11T23:17:35.582293+0000","last_clean":"2024-09-11T23:17:35.582293+0000","last_became_active":"2024-09-11T23:17:34.643628+0000","last_became_peered":"2024-09-11T23:17:34.643628+0000","last_unstale":"2024-09-11T23:17:35.582293+0000","last_undegraded":"2024-09-11T23:17:35.582293+0000","last_fullsized":"2024-09-11T23:17:35.582293+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:29.478638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578297+0000","last_change":"2024-09-11T23:17:34.632613+0000","last_active":"2024-09-11T23:17:35.578297+0000","last_peered":"2024-09-11T23:17:35.578297+0000","last_clean":"2024-09-11T23:17:35.578297+0000","last_became_active":"2024-09-11T23:17:34.631898+0000","last_became_peered":"2024-09-11T23:17:34.631898+0000","last_unstale":"2024-09-11T23:17:35.578297+0000","last_undegraded":"2024-09-11T23:17:35.578297+0000","last_fullsized":"2024-09-11T23:17:35.578297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777491+0000","last_change":"2024-09-11T23:17:34.601241+0000","last_active":"2024-09-11T23:17:35.777491+0000","last_peered":"2024-09-11T23:17:35.777491+0000","last_clean":"2024-09-11T23:17:35.777491+0000","last_became_active":"2024-09-11T23:17:34.600433+0000","last_became_peered":"2024-09-11T23:17:34.600433+0000","last_unstale":"2024-09-11T23:17:35.777491+0000","last_undegraded":"2024-09-11T23:17:35.777491+0000","last_fullsized":"2024-09-11T23:17:35.777491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:20.681186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804668+0000","last_change":"2024-09-11T23:17:34.581058+0000","last_active":"2024-09-11T23:17:35.804668+0000","last_peered":"2024-09-11T23:17:35.804668+0000","last_clean":"2024-09-11T23:17:35.804668+0000","last_became_active":"2024-09-11T23:17:34.580717+0000","last_became_peered":"2024-09-11T23:17:34.580717+0000","last_unstale":"2024-09-11T23:17:35.804668+0000","last_undegraded":"2024-09-11T23:17:35.804668+0000","last_fullsized":"2024-09-11T23:17:35.804668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:33.507282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836415+0000","last_change":"2024-09-11T23:17:34.616624+0000","last_active":"2024-09-11T23:17:35.836415+0000","last_peered":"2024-09-11T23:17:35.836415+0000","last_clean":"2024-09-11T23:17:35.836415+0000","last_became_active":"2024-09-11T23:17:34.615847+0000","last_became_peered":"2024-09-11T23:17:34.615847+0000","last_unstale":"2024-09-11T23:17:35.836415+0000","last_undegraded":"2024-09-11T23:17:35.836415+0000","last_fullsized":"2024-09-11T23:17:35.836415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:54.006933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574618+0000","last_change":"2024-09-11T23:17:33.601698+0000","last_active":"2024-09-11T23:17:35.574618+0000","last_peered":"2024-09-11T23:17:35.574618+0000","last_clean":"2024-09-11T23:17:35.574618+0000","last_became_active":"2024-09-11T23:17:33.601480+0000","last_became_peered":"2024-09-11T23:17:33.601480+0000","last_unstale":"2024-09-11T23:17:35.574618+0000","last_undegraded":"2024-09-11T23:17:35.574618+0000","last_fullsized":"2024-09-11T23:17:35.574618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:29.115868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778511+0000","last_change":"2024-09-11T23:17:34.621266+0000","last_active":"2024-09-11T23:17:35.778511+0000","last_peered":"2024-09-11T23:17:35.778511+0000","last_clean":"2024-09-11T23:17:35.778511+0000","last_became_active":"2024-09-11T23:17:34.619431+0000","last_became_peered":"2024-09-11T23:17:34.619431+0000","last_unstale":"2024-09-11T23:17:35.778511+0000","last_undegraded":"2024-09-11T23:17:35.778511+0000","last_fullsized":"2024-09-11T23:17:35.778511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.843183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805483+0000","last_change":"2024-09-11T23:17:33.609107+0000","last_active":"2024-09-11T23:17:35.805483+0000","last_peered":"2024-09-11T23:17:35.805483+0000","last_clean":"2024-09-11T23:17:35.805483+0000","last_became_active":"2024-09-11T23:17:33.608856+0000","last_became_peered":"2024-09-11T23:17:33.608856+0000","last_unstale":"2024-09-11T23:17:35.805483+0000","last_undegraded":"2024-09-11T23:17:35.805483+0000","last_fullsized":"2024-09-11T23:17:35.805483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:36.142432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805439+0000","last_change":"2024-09-11T23:17:34.587167+0000","last_active":"2024-09-11T23:17:35.805439+0000","last_peered":"2024-09-11T23:17:35.805439+0000","last_clean":"2024-09-11T23:17:35.805439+0000","last_became_active":"2024-09-11T23:17:34.586697+0000","last_became_peered":"2024-09-11T23:17:34.586697+0000","last_unstale":"2024-09-11T23:17:35.805439+0000","last_undegraded":"2024-09-11T23:17:35.805439+0000","last_fullsized":"2024-09-11T23:17:35.805439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:47.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805116+0000","last_change":"2024-09-11T23:17:33.604047+0000","last_active":"2024-09-11T23:17:35.805116+0000","last_peered":"2024-09-11T23:17:35.805116+0000","last_clean":"2024-09-11T23:17:35.805116+0000","last_became_active":"2024-09-11T23:17:33.603390+0000","last_became_peered":"2024-09-11T23:17:33.603390+0000","last_unstale":"2024-09-11T23:17:35.805116+0000","last_undegraded":"2024-09-11T23:17:35.805116+0000","last_fullsized":"2024-09-11T23:17:35.805116+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:23.848101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581943+0000","last_change":"2024-09-11T23:17:34.639148+0000","last_active":"2024-09-11T23:17:35.581943+0000","last_peered":"2024-09-11T23:17:35.581943+0000","last_clean":"2024-09-11T23:17:35.581943+0000","last_became_active":"2024-09-11T23:17:34.638637+0000","last_became_peered":"2024-09-11T23:17:34.638637+0000","last_unstale":"2024-09-11T23:17:35.581943+0000","last_undegraded":"2024-09-11T23:17:35.581943+0000","last_fullsized":"2024-09-11T23:17:35.581943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:24.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805198+0000","last_change":"2024-09-11T23:17:33.582839+0000","last_active":"2024-09-11T23:17:35.805198+0000","last_peered":"2024-09-11T23:17:35.805198+0000","last_clean":"2024-09-11T23:17:35.805198+0000","last_became_active":"2024-09-11T23:17:33.582485+0000","last_became_peered":"2024-09-11T23:17:33.582485+0000","last_unstale":"2024-09-11T23:17:35.805198+0000","last_undegraded":"2024-09-11T23:17:35.805198+0000","last_fullsized":"2024-09-11T23:17:35.805198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:42.802430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835596+0000","last_change":"2024-09-11T23:17:34.600717+0000","last_active":"2024-09-11T23:17:35.835596+0000","last_peered":"2024-09-11T23:17:35.835596+0000","last_clean":"2024-09-11T23:17:35.835596+0000","last_became_active":"2024-09-11T23:17:34.600234+0000","last_became_peered":"2024-09-11T23:17:34.600234+0000","last_unstale":"2024-09-11T23:17:35.835596+0000","last_undegraded":"2024-09-11T23:17:35.835596+0000","last_fullsized":"2024-09-11T23:17:35.835596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:46.484269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677281+0000","last_change":"2024-09-11T23:17:33.581416+0000","last_active":"2024-09-11T23:17:35.677281+0000","last_peered":"2024-09-11T23:17:35.677281+0000","last_clean":"2024-09-11T23:17:35.677281+0000","last_became_active":"2024-09-11T23:17:33.581153+0000","last_became_peered":"2024-09-11T23:17:33.581153+0000","last_unstale":"2024-09-11T23:17:35.677281+0000","last_undegraded":"2024-09-11T23:17:35.677281+0000","last_fullsized":"2024-09-11T23:17:35.677281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:00.304414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573499+0000","last_change":"2024-09-11T23:17:34.607397+0000","last_active":"2024-09-11T23:17:35.573499+0000","last_peered":"2024-09-11T23:17:35.573499+0000","last_clean":"2024-09-11T23:17:35.573499+0000","last_became_active":"2024-09-11T23:17:34.607117+0000","last_became_peered":"2024-09-11T23:17:34.607117+0000","last_unstale":"2024-09-11T23:17:35.573499+0000","last_undegraded":"2024-09-11T23:17:35.573499+0000","last_fullsized":"2024-09-11T23:17:35.573499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677061+0000","last_change":"2024-09-11T23:17:33.580760+0000","last_active":"2024-09-11T23:17:35.677061+0000","last_peered":"2024-09-11T23:17:35.677061+0000","last_clean":"2024-09-11T23:17:35.677061+0000","last_became_active":"2024-09-11T23:17:33.580479+0000","last_became_peered":"2024-09-11T23:17:33.580479+0000","last_unstale":"2024-09-11T23:17:35.677061+0000","last_undegraded":"2024-09-11T23:17:35.677061+0000","last_fullsized":"2024-09-11T23:17:35.677061+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:45.371483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835979+0000","last_change":"2024-09-11T23:17:34.615898+0000","last_active":"2024-09-11T23:17:35.835979+0000","last_peered":"2024-09-11T23:17:35.835979+0000","last_clean":"2024-09-11T23:17:35.835979+0000","last_became_active":"2024-09-11T23:17:34.615084+0000","last_became_peered":"2024-09-11T23:17:34.615084+0000","last_unstale":"2024-09-11T23:17:35.835979+0000","last_undegraded":"2024-09-11T23:17:35.835979+0000","last_fullsized":"2024-09-11T23:17:35.835979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677057+0000","last_change":"2024-09-11T23:17:33.596770+0000","last_active":"2024-09-11T23:17:35.677057+0000","last_peered":"2024-09-11T23:17:35.677057+0000","last_clean":"2024-09-11T23:17:35.677057+0000","last_became_active":"2024-09-11T23:17:33.596421+0000","last_became_peered":"2024-09-11T23:17:33.596421+0000","last_unstale":"2024-09-11T23:17:35.677057+0000","last_undegraded":"2024-09-11T23:17:35.677057+0000","last_fullsized":"2024-09-11T23:17:35.677057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:36.142432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677308+0000","last_change":"2024-09-11T23:17:34.600319+0000","last_active":"2024-09-11T23:17:35.677308+0000","last_peered":"2024-09-11T23:17:35.677308+0000","last_clean":"2024-09-11T23:17:35.677308+0000","last_became_active":"2024-09-11T23:17:34.600022+0000","last_became_peered":"2024-09-11T23:17:34.600022+0000","last_unstale":"2024-09-11T23:17:35.677308+0000","last_undegraded":"2024-09-11T23:17:35.677308+0000","last_fullsized":"2024-09-11T23:17:35.677308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:35.014823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835790+0000","last_change":"2024-09-11T23:17:33.605702+0000","last_active":"2024-09-11T23:17:35.835790+0000","last_peered":"2024-09-11T23:17:35.835790+0000","last_clean":"2024-09-11T23:17:35.835790+0000","last_became_active":"2024-09-11T23:17:33.602583+0000","last_became_peered":"2024-09-11T23:17:33.602583+0000","last_unstale":"2024-09-11T23:17:35.835790+0000","last_undegraded":"2024-09-11T23:17:35.835790+0000","last_fullsized":"2024-09-11T23:17:35.835790+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:01.331655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573512+0000","last_change":"2024-09-11T23:17:34.598065+0000","last_active":"2024-09-11T23:17:35.573512+0000","last_peered":"2024-09-11T23:17:35.573512+0000","last_clean":"2024-09-11T23:17:35.573512+0000","last_became_active":"2024-09-11T23:17:34.597749+0000","last_became_peered":"2024-09-11T23:17:34.597749+0000","last_unstale":"2024-09-11T23:17:35.573512+0000","last_undegraded":"2024-09-11T23:17:35.573512+0000","last_fullsized":"2024-09-11T23:17:35.573512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.496612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582485+0000","last_change":"2024-09-11T23:17:33.613985+0000","last_active":"2024-09-11T23:17:35.582485+0000","last_peered":"2024-09-11T23:17:35.582485+0000","last_clean":"2024-09-11T23:17:35.582485+0000","last_became_active":"2024-09-11T23:17:33.607571+0000","last_became_peered":"2024-09-11T23:17:33.607571+0000","last_unstale":"2024-09-11T23:17:35.582485+0000","last_undegraded":"2024-09-11T23:17:35.582485+0000","last_fullsized":"2024-09-11T23:17:35.582485+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:52.996726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677282+0000","last_change":"2024-09-11T23:17:34.610229+0000","last_active":"2024-09-11T23:17:35.677282+0000","last_peered":"2024-09-11T23:17:35.677282+0000","last_clean":"2024-09-11T23:17:35.677282+0000","last_became_active":"2024-09-11T23:17:34.609894+0000","last_became_peered":"2024-09-11T23:17:34.609894+0000","last_unstale":"2024-09-11T23:17:35.677282+0000","last_undegraded":"2024-09-11T23:17:35.677282+0000","last_fullsized":"2024-09-11T23:17:35.677282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:47.400476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778471+0000","last_change":"2024-09-11T23:17:33.594110+0000","last_active":"2024-09-11T23:17:35.778471+0000","last_peered":"2024-09-11T23:17:35.778471+0000","last_clean":"2024-09-11T23:17:35.778471+0000","last_became_active":"2024-09-11T23:17:33.593398+0000","last_became_peered":"2024-09-11T23:17:33.593398+0000","last_unstale":"2024-09-11T23:17:35.778471+0000","last_undegraded":"2024-09-11T23:17:35.778471+0000","last_fullsized":"2024-09-11T23:17:35.778471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:37.898983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836472+0000","last_change":"2024-09-11T23:17:34.624554+0000","last_active":"2024-09-11T23:17:35.836472+0000","last_peered":"2024-09-11T23:17:35.836472+0000","last_clean":"2024-09-11T23:17:35.836472+0000","last_became_active":"2024-09-11T23:17:34.623795+0000","last_became_peered":"2024-09-11T23:17:34.623795+0000","last_unstale":"2024-09-11T23:17:35.836472+0000","last_undegraded":"2024-09-11T23:17:35.836472+0000","last_fullsized":"2024-09-11T23:17:35.836472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:26.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581987+0000","last_change":"2024-09-11T23:17:33.607951+0000","last_active":"2024-09-11T23:17:35.581987+0000","last_peered":"2024-09-11T23:17:35.581987+0000","last_clean":"2024-09-11T23:17:35.581987+0000","last_became_active":"2024-09-11T23:17:33.607176+0000","last_became_peered":"2024-09-11T23:17:33.607176+0000","last_unstale":"2024-09-11T23:17:35.581987+0000","last_undegraded":"2024-09-11T23:17:35.581987+0000","last_fullsized":"2024-09-11T23:17:35.581987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.669492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778738+0000","last_change":"2024-09-11T23:17:34.601023+0000","last_active":"2024-09-11T23:17:35.778738+0000","last_peered":"2024-09-11T23:17:35.778738+0000","last_clean":"2024-09-11T23:17:35.778738+0000","last_became_active":"2024-09-11T23:17:34.600249+0000","last_became_peered":"2024-09-11T23:17:34.600249+0000","last_unstale":"2024-09-11T23:17:35.778738+0000","last_undegraded":"2024-09-11T23:17:35.778738+0000","last_fullsized":"2024-09-11T23:17:35.778738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:17.406523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573486+0000","last_change":"2024-09-11T23:17:33.610912+0000","last_active":"2024-09-11T23:17:35.573486+0000","last_peered":"2024-09-11T23:17:35.573486+0000","last_clean":"2024-09-11T23:17:35.573486+0000","last_became_active":"2024-09-11T23:17:33.610648+0000","last_became_peered":"2024-09-11T23:17:33.610648+0000","last_unstale":"2024-09-11T23:17:35.573486+0000","last_undegraded":"2024-09-11T23:17:35.573486+0000","last_fullsized":"2024-09-11T23:17:35.573486+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:19.670978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777462+0000","last_change":"2024-09-11T23:17:34.630989+0000","last_active":"2024-09-11T23:17:35.777462+0000","last_peered":"2024-09-11T23:17:35.777462+0000","last_clean":"2024-09-11T23:17:35.777462+0000","last_became_active":"2024-09-11T23:17:34.629103+0000","last_became_peered":"2024-09-11T23:17:34.629103+0000","last_unstale":"2024-09-11T23:17:35.777462+0000","last_undegraded":"2024-09-11T23:17:35.777462+0000","last_fullsized":"2024-09-11T23:17:35.777462+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:30.126075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582318+0000","last_change":"2024-09-11T23:17:33.608707+0000","last_active":"2024-09-11T23:17:35.582318+0000","last_peered":"2024-09-11T23:17:35.582318+0000","last_clean":"2024-09-11T23:17:35.582318+0000","last_became_active":"2024-09-11T23:17:33.607484+0000","last_became_peered":"2024-09-11T23:17:33.607484+0000","last_unstale":"2024-09-11T23:17:35.582318+0000","last_undegraded":"2024-09-11T23:17:35.582318+0000","last_fullsized":"2024-09-11T23:17:35.582318+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:13.843316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.577924+0000","last_change":"2024-09-11T23:17:34.592872+0000","last_active":"2024-09-11T23:17:35.577924+0000","last_peered":"2024-09-11T23:17:35.577924+0000","last_clean":"2024-09-11T23:17:35.577924+0000","last_became_active":"2024-09-11T23:17:34.592173+0000","last_became_peered":"2024-09-11T23:17:34.592173+0000","last_unstale":"2024-09-11T23:17:35.577924+0000","last_undegraded":"2024-09-11T23:17:35.577924+0000","last_fullsized":"2024-09-11T23:17:35.577924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:03.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578590+0000","last_change":"2024-09-11T23:17:33.609687+0000","last_active":"2024-09-11T23:17:35.578590+0000","last_peered":"2024-09-11T23:17:35.578590+0000","last_clean":"2024-09-11T23:17:35.578590+0000","last_became_active":"2024-09-11T23:17:33.604476+0000","last_became_peered":"2024-09-11T23:17:33.604476+0000","last_unstale":"2024-09-11T23:17:35.578590+0000","last_undegraded":"2024-09-11T23:17:35.578590+0000","last_fullsized":"2024-09-11T23:17:35.578590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:52.900370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835910+0000","last_change":"2024-09-11T23:17:34.606320+0000","last_active":"2024-09-11T23:17:35.835910+0000","last_peered":"2024-09-11T23:17:35.835910+0000","last_clean":"2024-09-11T23:17:35.835910+0000","last_became_active":"2024-09-11T23:17:34.605573+0000","last_became_peered":"2024-09-11T23:17:34.605573+0000","last_unstale":"2024-09-11T23:17:35.835910+0000","last_undegraded":"2024-09-11T23:17:35.835910+0000","last_fullsized":"2024-09-11T23:17:35.835910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581380+0000","last_change":"2024-09-11T23:17:33.601596+0000","last_active":"2024-09-11T23:17:35.581380+0000","last_peered":"2024-09-11T23:17:35.581380+0000","last_clean":"2024-09-11T23:17:35.581380+0000","last_became_active":"2024-09-11T23:17:33.600439+0000","last_became_peered":"2024-09-11T23:17:33.600439+0000","last_unstale":"2024-09-11T23:17:35.581380+0000","last_undegraded":"2024-09-11T23:17:35.581380+0000","last_fullsized":"2024-09-11T23:17:35.581380+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:32.832975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574435+0000","last_change":"2024-09-11T23:17:34.613739+0000","last_active":"2024-09-11T23:17:35.574435+0000","last_peered":"2024-09-11T23:17:35.574435+0000","last_clean":"2024-09-11T23:17:35.574435+0000","last_became_active":"2024-09-11T23:17:34.613519+0000","last_became_peered":"2024-09-11T23:17:34.613519+0000","last_unstale":"2024-09-11T23:17:35.574435+0000","last_undegraded":"2024-09-11T23:17:35.574435+0000","last_fullsized":"2024-09-11T23:17:35.574435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:03.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777350+0000","last_change":"2024-09-11T23:17:33.610938+0000","last_active":"2024-09-11T23:17:35.777350+0000","last_peered":"2024-09-11T23:17:35.777350+0000","last_clean":"2024-09-11T23:17:35.777350+0000","last_became_active":"2024-09-11T23:17:33.609912+0000","last_became_peered":"2024-09-11T23:17:33.609912+0000","last_unstale":"2024-09-11T23:17:35.777350+0000","last_undegraded":"2024-09-11T23:17:35.777350+0000","last_fullsized":"2024-09-11T23:17:35.777350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:52.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581619+0000","last_change":"2024-09-11T23:17:34.642677+0000","last_active":"2024-09-11T23:17:35.581619+0000","last_peered":"2024-09-11T23:17:35.581619+0000","last_clean":"2024-09-11T23:17:35.581619+0000","last_became_active":"2024-09-11T23:17:34.639640+0000","last_became_peered":"2024-09-11T23:17:34.639640+0000","last_unstale":"2024-09-11T23:17:35.581619+0000","last_undegraded":"2024-09-11T23:17:35.581619+0000","last_fullsized":"2024-09-11T23:17:35.581619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:21.417324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579349+0000","last_change":"2024-09-11T23:17:33.597492+0000","last_active":"2024-09-11T23:17:35.579349+0000","last_peered":"2024-09-11T23:17:35.579349+0000","last_clean":"2024-09-11T23:17:35.579349+0000","last_became_active":"2024-09-11T23:17:33.596742+0000","last_became_peered":"2024-09-11T23:17:33.596742+0000","last_unstale":"2024-09-11T23:17:35.579349+0000","last_undegraded":"2024-09-11T23:17:35.579349+0000","last_fullsized":"2024-09-11T23:17:35.579349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.396316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836627+0000","last_change":"2024-09-11T23:17:34.625162+0000","last_active":"2024-09-11T23:17:35.836627+0000","last_peered":"2024-09-11T23:17:35.836627+0000","last_clean":"2024-09-11T23:17:35.836627+0000","last_became_active":"2024-09-11T23:17:34.624277+0000","last_became_peered":"2024-09-11T23:17:34.624277+0000","last_unstale":"2024-09-11T23:17:35.836627+0000","last_undegraded":"2024-09-11T23:17:35.836627+0000","last_fullsized":"2024-09-11T23:17:35.836627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.496612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581923+0000","last_change":"2024-09-11T23:17:33.615817+0000","last_active":"2024-09-11T23:17:35.581923+0000","last_peered":"2024-09-11T23:17:35.581923+0000","last_clean":"2024-09-11T23:17:35.581923+0000","last_became_active":"2024-09-11T23:17:33.614982+0000","last_became_peered":"2024-09-11T23:17:33.614982+0000","last_unstale":"2024-09-11T23:17:35.581923+0000","last_undegraded":"2024-09-11T23:17:35.581923+0000","last_fullsized":"2024-09-11T23:17:35.581923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:37.305117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778498+0000","last_change":"2024-09-11T23:17:34.626238+0000","last_active":"2024-09-11T23:17:35.778498+0000","last_peered":"2024-09-11T23:17:35.778498+0000","last_clean":"2024-09-11T23:17:35.778498+0000","last_became_active":"2024-09-11T23:17:34.620763+0000","last_became_peered":"2024-09-11T23:17:34.620763+0000","last_unstale":"2024-09-11T23:17:35.778498+0000","last_undegraded":"2024-09-11T23:17:35.778498+0000","last_fullsized":"2024-09-11T23:17:35.778498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:14.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581675+0000","last_change":"2024-09-11T23:17:33.607778+0000","last_active":"2024-09-11T23:17:35.581675+0000","last_peered":"2024-09-11T23:17:35.581675+0000","last_clean":"2024-09-11T23:17:35.581675+0000","last_became_active":"2024-09-11T23:17:33.607009+0000","last_became_peered":"2024-09-11T23:17:33.607009+0000","last_unstale":"2024-09-11T23:17:35.581675+0000","last_undegraded":"2024-09-11T23:17:35.581675+0000","last_fullsized":"2024-09-11T23:17:35.581675+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:05.140612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836260+0000","last_change":"2024-09-11T23:17:34.625821+0000","last_active":"2024-09-11T23:17:35.836260+0000","last_peered":"2024-09-11T23:17:35.836260+0000","last_clean":"2024-09-11T23:17:35.836260+0000","last_became_active":"2024-09-11T23:17:34.617004+0000","last_became_peered":"2024-09-11T23:17:34.617004+0000","last_unstale":"2024-09-11T23:17:35.836260+0000","last_undegraded":"2024-09-11T23:17:35.836260+0000","last_fullsized":"2024-09-11T23:17:35.836260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.843183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677325+0000","last_change":"2024-09-11T23:17:33.597454+0000","last_active":"2024-09-11T23:17:35.677325+0000","last_peered":"2024-09-11T23:17:35.677325+0000","last_clean":"2024-09-11T23:17:35.677325+0000","last_became_active":"2024-09-11T23:17:33.596782+0000","last_became_peered":"2024-09-11T23:17:33.596782+0000","last_unstale":"2024-09-11T23:17:35.677325+0000","last_undegraded":"2024-09-11T23:17:35.677325+0000","last_fullsized":"2024-09-11T23:17:35.677325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:28.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804801+0000","last_change":"2024-09-11T23:17:34.581389+0000","last_active":"2024-09-11T23:17:35.804801+0000","last_peered":"2024-09-11T23:17:35.804801+0000","last_clean":"2024-09-11T23:17:35.804801+0000","last_became_active":"2024-09-11T23:17:34.581081+0000","last_became_peered":"2024-09-11T23:17:34.581081+0000","last_unstale":"2024-09-11T23:17:35.804801+0000","last_undegraded":"2024-09-11T23:17:35.804801+0000","last_fullsized":"2024-09-11T23:17:35.804801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:53.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804713+0000","last_change":"2024-09-11T23:17:33.592826+0000","last_active":"2024-09-11T23:17:35.804713+0000","last_peered":"2024-09-11T23:17:35.804713+0000","last_clean":"2024-09-11T23:17:35.804713+0000","last_became_active":"2024-09-11T23:17:33.592527+0000","last_became_peered":"2024-09-11T23:17:33.592527+0000","last_unstale":"2024-09-11T23:17:35.804713+0000","last_undegraded":"2024-09-11T23:17:35.804713+0000","last_fullsized":"2024-09-11T23:17:35.804713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:20.407117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578037+0000","last_change":"2024-09-11T23:17:34.609138+0000","last_active":"2024-09-11T23:17:35.578037+0000","last_peered":"2024-09-11T23:17:35.578037+0000","last_clean":"2024-09-11T23:17:35.578037+0000","last_became_active":"2024-09-11T23:17:34.608321+0000","last_became_peered":"2024-09-11T23:17:34.608321+0000","last_unstale":"2024-09-11T23:17:35.578037+0000","last_undegraded":"2024-09-11T23:17:35.578037+0000","last_fullsized":"2024-09-11T23:17:35.578037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578847+0000","last_change":"2024-09-11T23:17:33.597388+0000","last_active":"2024-09-11T23:17:35.578847+0000","last_peered":"2024-09-11T23:17:35.578847+0000","last_clean":"2024-09-11T23:17:35.578847+0000","last_became_active":"2024-09-11T23:17:33.596633+0000","last_became_peered":"2024-09-11T23:17:33.596633+0000","last_unstale":"2024-09-11T23:17:35.578847+0000","last_undegraded":"2024-09-11T23:17:35.578847+0000","last_fullsized":"2024-09-11T23:17:35.578847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:05.140612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836408+0000","last_change":"2024-09-11T23:17:34.606167+0000","last_active":"2024-09-11T23:17:35.836408+0000","last_peered":"2024-09-11T23:17:35.836408+0000","last_clean":"2024-09-11T23:17:35.836408+0000","last_became_active":"2024-09-11T23:17:34.605453+0000","last_became_peered":"2024-09-11T23:17:34.605453+0000","last_unstale":"2024-09-11T23:17:35.836408+0000","last_undegraded":"2024-09-11T23:17:35.836408+0000","last_fullsized":"2024-09-11T23:17:35.836408+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:17.406523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804404+0000","last_change":"2024-09-11T23:17:33.600865+0000","last_active":"2024-09-11T23:17:35.804404+0000","last_peered":"2024-09-11T23:17:35.804404+0000","last_clean":"2024-09-11T23:17:35.804404+0000","last_became_active":"2024-09-11T23:17:33.600415+0000","last_became_peered":"2024-09-11T23:17:33.600415+0000","last_unstale":"2024-09-11T23:17:35.804404+0000","last_undegraded":"2024-09-11T23:17:35.804404+0000","last_fullsized":"2024-09-11T23:17:35.804404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:23.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805160+0000","last_change":"2024-09-11T23:17:34.618628+0000","last_active":"2024-09-11T23:17:35.805160+0000","last_peered":"2024-09-11T23:17:35.805160+0000","last_clean":"2024-09-11T23:17:35.805160+0000","last_became_active":"2024-09-11T23:17:34.618379+0000","last_became_peered":"2024-09-11T23:17:34.618379+0000","last_unstale":"2024-09-11T23:17:35.805160+0000","last_undegraded":"2024-09-11T23:17:35.805160+0000","last_fullsized":"2024-09-11T23:17:35.805160+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:06.102547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579770+0000","last_change":"2024-09-11T23:17:33.604801+0000","last_active":"2024-09-11T23:17:35.579770+0000","last_peered":"2024-09-11T23:17:35.579770+0000","last_clean":"2024-09-11T23:17:35.579770+0000","last_became_active":"2024-09-11T23:17:33.604091+0000","last_became_peered":"2024-09-11T23:17:33.604091+0000","last_unstale":"2024-09-11T23:17:35.579770+0000","last_undegraded":"2024-09-11T23:17:35.579770+0000","last_fullsized":"2024-09-11T23:17:35.579770+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:37.305117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835969+0000","last_change":"2024-09-11T23:17:34.584055+0000","last_active":"2024-09-11T23:17:35.835969+0000","last_peered":"2024-09-11T23:17:35.835969+0000","last_clean":"2024-09-11T23:17:35.835969+0000","last_became_active":"2024-09-11T23:17:34.583725+0000","last_became_peered":"2024-09-11T23:17:34.583725+0000","last_unstale":"2024-09-11T23:17:35.835969+0000","last_undegraded":"2024-09-11T23:17:35.835969+0000","last_fullsized":"2024-09-11T23:17:35.835969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:42.803431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:36.577286+0000","last_change":"2024-09-11T23:17:33.604201+0000","last_active":"2024-09-11T23:17:36.577286+0000","last_peered":"2024-09-11T23:17:36.577286+0000","last_clean":"2024-09-11T23:17:36.577286+0000","last_became_active":"2024-09-11T23:17:33.602885+0000","last_became_peered":"2024-09-11T23:17:33.602885+0000","last_unstale":"2024-09-11T23:17:36.577286+0000","last_undegraded":"2024-09-11T23:17:36.577286+0000","last_fullsized":"2024-09-11T23:17:36.577286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.669492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579451+0000","last_change":"2024-09-11T23:17:34.591850+0000","last_active":"2024-09-11T23:17:35.579451+0000","last_peered":"2024-09-11T23:17:35.579451+0000","last_clean":"2024-09-11T23:17:35.579451+0000","last_became_active":"2024-09-11T23:17:34.591097+0000","last_became_peered":"2024-09-11T23:17:34.591097+0000","last_unstale":"2024-09-11T23:17:35.579451+0000","last_undegraded":"2024-09-11T23:17:35.579451+0000","last_fullsized":"2024-09-11T23:17:35.579451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:01.314621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805225+0000","last_change":"2024-09-11T23:17:33.603466+0000","last_active":"2024-09-11T23:17:35.805225+0000","last_peered":"2024-09-11T23:17:35.805225+0000","last_clean":"2024-09-11T23:17:35.805225+0000","last_became_active":"2024-09-11T23:17:33.603187+0000","last_became_peered":"2024-09-11T23:17:33.603187+0000","last_unstale":"2024-09-11T23:17:35.805225+0000","last_undegraded":"2024-09-11T23:17:35.805225+0000","last_fullsized":"2024-09-11T23:17:35.805225+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:54.908821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836428+0000","last_change":"2024-09-11T23:17:34.628560+0000","last_active":"2024-09-11T23:17:35.836428+0000","last_peered":"2024-09-11T23:17:35.836428+0000","last_clean":"2024-09-11T23:17:35.836428+0000","last_became_active":"2024-09-11T23:17:34.626398+0000","last_became_peered":"2024-09-11T23:17:34.626398+0000","last_unstale":"2024-09-11T23:17:35.836428+0000","last_undegraded":"2024-09-11T23:17:35.836428+0000","last_fullsized":"2024-09-11T23:17:35.836428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:53.046941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573554+0000","last_change":"2024-09-11T23:17:33.611169+0000","last_active":"2024-09-11T23:17:35.573554+0000","last_peered":"2024-09-11T23:17:35.573554+0000","last_clean":"2024-09-11T23:17:35.573554+0000","last_became_active":"2024-09-11T23:17:33.610838+0000","last_became_peered":"2024-09-11T23:17:33.610838+0000","last_unstale":"2024-09-11T23:17:35.573554+0000","last_undegraded":"2024-09-11T23:17:35.573554+0000","last_fullsized":"2024-09-11T23:17:35.573554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.666435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835700+0000","last_change":"2024-09-11T23:17:34.606096+0000","last_active":"2024-09-11T23:17:35.835700+0000","last_peered":"2024-09-11T23:17:35.835700+0000","last_clean":"2024-09-11T23:17:35.835700+0000","last_became_active":"2024-09-11T23:17:34.605365+0000","last_became_peered":"2024-09-11T23:17:34.605365+0000","last_unstale":"2024-09-11T23:17:35.835700+0000","last_undegraded":"2024-09-11T23:17:35.835700+0000","last_fullsized":"2024-09-11T23:17:35.835700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:53.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582434+0000","last_change":"2024-09-11T23:17:33.614246+0000","last_active":"2024-09-11T23:17:35.582434+0000","last_peered":"2024-09-11T23:17:35.582434+0000","last_clean":"2024-09-11T23:17:35.582434+0000","last_became_active":"2024-09-11T23:17:33.606935+0000","last_became_peered":"2024-09-11T23:17:33.606935+0000","last_unstale":"2024-09-11T23:17:35.582434+0000","last_undegraded":"2024-09-11T23:17:35.582434+0000","last_fullsized":"2024-09-11T23:17:35.582434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.396316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777716+0000","last_change":"2024-09-11T23:17:34.636973+0000","last_active":"2024-09-11T23:17:35.777716+0000","last_peered":"2024-09-11T23:17:35.777716+0000","last_clean":"2024-09-11T23:17:35.777716+0000","last_became_active":"2024-09-11T23:17:34.636144+0000","last_became_peered":"2024-09-11T23:17:34.636144+0000","last_unstale":"2024-09-11T23:17:35.777716+0000","last_undegraded":"2024-09-11T23:17:35.777716+0000","last_fullsized":"2024-09-11T23:17:35.777716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:46.676642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677170+0000","last_change":"2024-09-11T23:17:33.575459+0000","last_active":"2024-09-11T23:17:35.677170+0000","last_peered":"2024-09-11T23:17:35.677170+0000","last_clean":"2024-09-11T23:17:35.677170+0000","last_became_active":"2024-09-11T23:17:33.575096+0000","last_became_peered":"2024-09-11T23:17:33.575096+0000","last_unstale":"2024-09-11T23:17:35.677170+0000","last_undegraded":"2024-09-11T23:17:35.677170+0000","last_fullsized":"2024-09-11T23:17:35.677170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.676254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573633+0000","last_change":"2024-09-11T23:17:34.621514+0000","last_active":"2024-09-11T23:17:35.573633+0000","last_peered":"2024-09-11T23:17:35.573633+0000","last_clean":"2024-09-11T23:17:35.573633+0000","last_became_active":"2024-09-11T23:17:34.621224+0000","last_became_peered":"2024-09-11T23:17:34.621224+0000","last_unstale":"2024-09-11T23:17:35.573633+0000","last_undegraded":"2024-09-11T23:17:35.573633+0000","last_fullsized":"2024-09-11T23:17:35.573633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.092645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677354+0000","last_change":"2024-09-11T23:17:33.596774+0000","last_active":"2024-09-11T23:17:35.677354+0000","last_peered":"2024-09-11T23:17:35.677354+0000","last_clean":"2024-09-11T23:17:35.677354+0000","last_became_active":"2024-09-11T23:17:33.596443+0000","last_became_peered":"2024-09-11T23:17:33.596443+0000","last_unstale":"2024-09-11T23:17:35.677354+0000","last_undegraded":"2024-09-11T23:17:35.677354+0000","last_fullsized":"2024-09-11T23:17:35.677354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:49.134767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835804+0000","last_change":"2024-09-11T23:17:34.594235+0000","last_active":"2024-09-11T23:17:35.835804+0000","last_peered":"2024-09-11T23:17:35.835804+0000","last_clean":"2024-09-11T23:17:35.835804+0000","last_became_active":"2024-09-11T23:17:34.593883+0000","last_became_peered":"2024-09-11T23:17:34.593883+0000","last_unstale":"2024-09-11T23:17:35.835804+0000","last_undegraded":"2024-09-11T23:17:35.835804+0000","last_fullsized":"2024-09-11T23:17:35.835804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:35.388987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573210+0000","last_change":"2024-09-11T23:17:33.596882+0000","last_active":"2024-09-11T23:17:35.573210+0000","last_peered":"2024-09-11T23:17:35.573210+0000","last_clean":"2024-09-11T23:17:35.573210+0000","last_became_active":"2024-09-11T23:17:33.596596+0000","last_became_peered":"2024-09-11T23:17:33.596596+0000","last_unstale":"2024-09-11T23:17:35.573210+0000","last_undegraded":"2024-09-11T23:17:35.573210+0000","last_fullsized":"2024-09-11T23:17:35.573210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:52.900370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836046+0000","last_change":"2024-09-11T23:17:34.616537+0000","last_active":"2024-09-11T23:17:35.836046+0000","last_peered":"2024-09-11T23:17:35.836046+0000","last_clean":"2024-09-11T23:17:35.836046+0000","last_became_active":"2024-09-11T23:17:34.615717+0000","last_became_peered":"2024-09-11T23:17:34.615717+0000","last_unstale":"2024-09-11T23:17:35.836046+0000","last_undegraded":"2024-09-11T23:17:35.836046+0000","last_fullsized":"2024-09-11T23:17:35.836046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:14.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.676989+0000","last_change":"2024-09-11T23:17:33.578984+0000","last_active":"2024-09-11T23:17:35.676989+0000","last_peered":"2024-09-11T23:17:35.676989+0000","last_clean":"2024-09-11T23:17:35.676989+0000","last_became_active":"2024-09-11T23:17:33.578717+0000","last_became_peered":"2024-09-11T23:17:33.578717+0000","last_unstale":"2024-09-11T23:17:35.676989+0000","last_undegraded":"2024-09-11T23:17:35.676989+0000","last_fullsized":"2024-09-11T23:17:35.676989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:23.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581107+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:17:35.581107+0000","last_peered":"2024-09-11T23:17:35.581107+0000","last_clean":"2024-09-11T23:17:35.581107+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:17:35.581107+0000","last_undegraded":"2024-09-11T23:17:35.581107+0000","last_fullsized":"2024-09-11T23:17:35.581107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1359872,"data_stored":929325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":753664,"data_stored":338215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":753664,"data_stored":338203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":761856,"data_stored":339793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":338181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":749568,"data_stored":338181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36116,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":778240,"data_stored":340557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36668,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335172,"statfs":{"total":96636764160,"available":96599216128,"internally_reserved":0,"allocated":1343488,"data_stored":928549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:38.342 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:17:38.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86f7a8640 1 Processor -- start 2024-09-11T23:17:38.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86f7a8640 1 -- start start 2024-09-11T23:17:38.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86f7a8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8681587a0 0x7fc8680b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86f7a8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86806ec60 con 0x7fc8680b37d0 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86f7a8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86806ef40 con 0x7fc86806e680 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86f7a8640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc8680b3c40 con 0x7fc8681587a0 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86d544640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8681587a0 0x7fc8680b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86cd43640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc8680b37d0 0x7fc86806df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58108/0 (socket says 172.21.15.94:58108) 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.498+0000 7fc86cd43640 1 -- 172.21.15.94:0/1677335241 learned_addr learned my addr 172.21.15.94:0/1677335241 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86d544640 1 -- 172.21.15.94:0/1677335241 >> v1:172.21.15.155:6789/0 conn(0x7fc86806e680 legacy=0x7fc868072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:38.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86d544640 1 -- 172.21.15.94:0/1677335241 >> v1:172.21.15.94:6789/0 conn(0x7fc8680b37d0 legacy=0x7fc86806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86d544640 1 -- 172.21.15.94:0/1677335241 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86806f220 con 0x7fc8681587a0 2024-09-11T23:17:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc85bfff640 1 -- 172.21.15.94:0/1677335241 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333321843 0 0) 0x7fc86806ec60 con 0x7fc8680b37d0 2024-09-11T23:17:38.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86d544640 1 --2- 172.21.15.94:0/1677335241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc8680b3290 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097c0 tx=0x7fc86401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222c6d651cd2f48c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc85bfff640 1 -- 172.21.15.94:0/1677335241 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8640b0070 con 0x7fc8681587a0 2024-09-11T23:17:38.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc85bfff640 1 -- 172.21.15.94:0/1677335241 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8640ab600 con 0x7fc8681587a0 2024-09-11T23:17:38.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc85bfff640 1 -- 172.21.15.94:0/1677335241 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8640ab9d0 con 0x7fc8681587a0 2024-09-11T23:17:38.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1677335241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 msgr2=0x7fc8680b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1677335241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc8680b3290 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097c0 tx=0x7fc86401c460 comp rx=0 tx=0).stop 2024-09-11T23:17:38.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1677335241 shutdown_connections 2024-09-11T23:17:38.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1677335241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc8680b3290 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1677335241 >> 172.21.15.94:0/1677335241 conn(0x7fc8680b1f90 msgr2=0x7fc8680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1677335241 shutdown_connections 2024-09-11T23:17:38.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.502+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1677335241 wait complete. 2024-09-11T23:17:38.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 Processor -- start 2024-09-11T23:17:38.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 -- start start 2024-09-11T23:17:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc86806e680 0x7fc868158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8680b37d0 0x7fc868099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc868157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc86816c200 con 0x7fc8681587a0 2024-09-11T23:17:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8680732d0 con 0x7fc86806e680 2024-09-11T23:17:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc86816c380 con 0x7fc8680b37d0 2024-09-11T23:17:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc868157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc868157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37168/0 (socket says 172.21.15.94:37168) 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 -- 172.21.15.94:0/1505827283 learned_addr learned my addr 172.21.15.94:0/1505827283 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 -- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8680b37d0 msgr2=0x7fc868099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8680b37d0 0x7fc868099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 -- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc86806e680 msgr2=0x7fc868158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc86806e680 0x7fc868158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 -- 172.21.15.94:0/1505827283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc868147d20 con 0x7fc8681587a0 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86dd45640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc868157920 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc86000c7b0 tx=0x7fc86000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc859ffb640 1 -- 172.21.15.94:0/1505827283 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860004b70 con 0x7fc8681587a0 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc859ffb640 1 -- 172.21.15.94:0/1505827283 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc860004d10 con 0x7fc8681587a0 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc859ffb640 1 -- 172.21.15.94:0/1505827283 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86000aa90 con 0x7fc8681587a0 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8681547e0 con 0x7fc8681587a0 2024-09-11T23:17:38.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc868154da0 con 0x7fc8681587a0 2024-09-11T23:17:38.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8680b3290 con 0x7fc8681587a0 2024-09-11T23:17:38.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.506+0000 7fc859ffb640 1 -- 172.21.15.94:0/1505827283 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc86000ac30 con 0x7fc8681587a0 2024-09-11T23:17:38.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.510+0000 7fc859ffb640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc84c0678c0 0x7fc84c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.510+0000 7fc859ffb640 1 -- 172.21.15.94:0/1505827283 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fc8600860d0 con 0x7fc8681587a0 2024-09-11T23:17:38.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.510+0000 7fc86d544640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc84c0678c0 0x7fc84c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.510+0000 7fc86d544640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc84c0678c0 0x7fc84c069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ad000 tx=0x7fc864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.514+0000 7fc859ffb640 1 -- 172.21.15.94:0/1505827283 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc860020070 con 0x7fc8681587a0 2024-09-11T23:17:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc8680afce0 con 0x7fc8681587a0 2024-09-11T23:17:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc859ffb640 1 -- 172.21.15.94:0/1505827283 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1474 (secure 0 0 0) 0x7fc860056a80 con 0x7fc8681587a0 2024-09-11T23:17:38.730 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:38.730 INFO:teuthology.orchestra.run.smithi094.stdout:{"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":169,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096501,"num_in_osds":8,"osd_in_since":1726096491,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":279834624,"bytes_avail":772814278656,"bytes_total":773094113280,"write_bytes_sec":2626,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5622}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-11T23:17:24.011528+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc84c0678c0 msgr2=0x7fc84c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc84c0678c0 0x7fc84c069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ad000 tx=0x7fc864008040 comp rx=0 tx=0).stop 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 msgr2=0x7fc868157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc868157920 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc86000c7b0 tx=0x7fc86000cc70 comp rx=0 tx=0).stop 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 shutdown_connections 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc84c0678c0 0x7fc84c069d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8681587a0 0x7fc868157920 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8680b37d0 0x7fc868099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 --2- 172.21.15.94:0/1505827283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc86806e680 0x7fc868158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.730+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 >> 172.21.15.94:0/1505827283 conn(0x7fc8680b1f90 msgr2=0x7fc8680b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.734+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 shutdown_connections 2024-09-11T23:17:38.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.734+0000 7fc86f7a8640 1 -- 172.21.15.94:0/1505827283 wait complete. 2024-09-11T23:17:38.749 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:17:38.749 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:17:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.858+0000 7fd2d1ada640 1 Processor -- start 2024-09-11T23:17:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.858+0000 7fd2d1ada640 1 -- start start 2024-09-11T23:17:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2d1ada640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc15bec0 0x7fd2cc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2d1ada640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2cc0af470 0x7fd2cc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2d1ada640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2cc0b3290 con 0x7fd2cc15c2a0 2024-09-11T23:17:38.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2d1ada640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd2cc0b3570 con 0x7fd2cc0af470 2024-09-11T23:17:38.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2d1ada640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc0b3850 con 0x7fd2cc15bec0 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cbfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2cc0af470 0x7fd2cc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cb7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc15bec0 0x7fd2cc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cb7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc15bec0 0x7fd2cc0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:51420/0 (socket says 172.21.15.94:51420) 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cb7fe640 1 -- 172.21.15.94:0/3348853798 learned_addr learned my addr 172.21.15.94:0/3348853798 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2caffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd2cc15c2a0 0x7fd2cc0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:37788/0 (socket says 172.21.15.94:37788) 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cb7fe640 1 -- 172.21.15.94:0/3348853798 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc0af470 msgr2=0x7fd2cc06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cb7fe640 1 --2- 172.21.15.94:0/3348853798 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc0af470 0x7fd2cc06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cb7fe640 1 -- 172.21.15.94:0/3348853798 >> v1:172.21.15.155:6789/0 conn(0x7fd2cc15c2a0 legacy=0x7fd2cc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cb7fe640 1 -- 172.21.15.94:0/3348853798 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc0b3b30 con 0x7fd2cc15bec0 2024-09-11T23:17:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.862+0000 7fd2cbfff640 1 --2- 172.21.15.94:0/3348853798 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc0af470 0x7fd2cc06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:38.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2cb7fe640 1 --2- 172.21.15.94:0/3348853798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc15bec0 0x7fd2cc0ad200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009870 tx=0x7fd2b401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0412aca4beba08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2ca7fc640 1 -- 172.21.15.94:0/3348853798 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40a95f0 con 0x7fd2cc15bec0 2024-09-11T23:17:38.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2ca7fc640 1 -- 172.21.15.94:0/3348853798 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b40a9790 con 0x7fd2cc15bec0 2024-09-11T23:17:38.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2ca7fc640 1 -- 172.21.15.94:0/3348853798 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40a9b60 con 0x7fd2cc15bec0 2024-09-11T23:17:38.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- 172.21.15.94:0/3348853798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc15bec0 msgr2=0x7fd2cc0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/3348853798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc15bec0 0x7fd2cc0ad200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009870 tx=0x7fd2b401c530 comp rx=0 tx=0).stop 2024-09-11T23:17:38.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- 172.21.15.94:0/3348853798 shutdown_connections 2024-09-11T23:17:38.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/3348853798 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc0af470 0x7fd2cc06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/3348853798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc15bec0 0x7fd2cc0ad200 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- 172.21.15.94:0/3348853798 >> 172.21.15.94:0/3348853798 conn(0x7fd2cc0b1f90 msgr2=0x7fd2cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- 172.21.15.94:0/3348853798 shutdown_connections 2024-09-11T23:17:38.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- 172.21.15.94:0/3348853798 wait complete. 2024-09-11T23:17:38.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 Processor -- start 2024-09-11T23:17:38.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- start start 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc0af470 0x7fd2cc152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2cc15bec0 0x7fd2cc14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2cc15c2a0 0x7fd2cc14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc06ed50 con 0x7fd2cc15bec0 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0ad740 con 0x7fd2cc15c2a0 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2d1ada640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc06eed0 con 0x7fd2cc0af470 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2cc15bec0 0x7fd2cc14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2cc15bec0 0x7fd2cc14c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37182/0 (socket says 172.21.15.94:37182) 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 -- 172.21.15.94:0/2001810316 learned_addr learned my addr 172.21.15.94:0/2001810316 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2cbfff640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2cc15c2a0 0x7fd2cc14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2cb7fe640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc0af470 0x7fd2cc152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 -- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc0af470 msgr2=0x7fd2cc152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc0af470 0x7fd2cc152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 -- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2cc15c2a0 msgr2=0x7fd2cc14ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2cc15c2a0 0x7fd2cc14ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 -- 172.21.15.94:0/2001810316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc14d150 con 0x7fd2cc15bec0 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.866+0000 7fd2caffd640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2cc15bec0 0x7fd2cc14c4c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c340 tx=0x7fd2bc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2c3fff640 1 -- 172.21.15.94:0/2001810316 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0074e0 con 0x7fd2cc15bec0 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2c3fff640 1 -- 172.21.15.94:0/2001810316 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2bc007680 con 0x7fd2cc15bec0 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2c3fff640 1 -- 172.21.15.94:0/2001810316 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc004a30 con 0x7fd2cc15bec0 2024-09-11T23:17:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc14f650 con 0x7fd2cc15bec0 2024-09-11T23:17:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc14ae50 con 0x7fd2cc15bec0 2024-09-11T23:17:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc14b0e0 con 0x7fd2cc15bec0 2024-09-11T23:17:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2c3fff640 1 -- 172.21.15.94:0/2001810316 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2bc01a020 con 0x7fd2cc15bec0 2024-09-11T23:17:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2c3fff640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd2ac0678c0 0x7fd2ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2c3fff640 1 -- 172.21.15.94:0/2001810316 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fd2bc085550 con 0x7fd2cc15bec0 2024-09-11T23:17:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2cb7fe640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd2ac0678c0 0x7fd2ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.870+0000 7fd2cb7fe640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd2ac0678c0 0x7fd2ac069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ae000 tx=0x7fd2b40b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:38.874+0000 7fd2c3fff640 1 -- 172.21.15.94:0/2001810316 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2cc14b0e0 con 0x7fd2cc15bec0 2024-09-11T23:17:39.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.026+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2cc06f280 con 0x7fd2ac0678c0 2024-09-11T23:17:39.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.042+0000 7fd2c3fff640 1 -- 172.21.15.94:0/2001810316 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252022 (secure 0 0 0) 0x7fd2cc06f280 con 0x7fd2ac0678c0 2024-09-11T23:17:39.046 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:39.048 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd2ac0678c0 msgr2=0x7fd2ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd2ac0678c0 0x7fd2ac069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ae000 tx=0x7fd2b40b3040 comp rx=0 tx=0).stop 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2cc15bec0 msgr2=0x7fd2cc14c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2cc15bec0 0x7fd2cc14c4c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c340 tx=0x7fd2bc00c800 comp rx=0 tx=0).stop 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 shutdown_connections 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2cc15c2a0 0x7fd2cc14ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd2ac0678c0 0x7fd2ac069d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2cc15bec0 0x7fd2cc14c4c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 --2- 172.21.15.94:0/2001810316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc0af470 0x7fd2cc152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 >> 172.21.15.94:0/2001810316 conn(0x7fd2cc0b1f90 msgr2=0x7fd2cc151900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:39.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 shutdown_connections 2024-09-11T23:17:39.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:39.046+0000 7fd2d1ada640 1 -- 172.21.15.94:0/2001810316 wait complete. 2024-09-11T23:17:39.062 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-11T23:17:38.015359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273276,"kb_used_data":7080,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754701444,"statfs":{"total":773094113280,"available":772814278656,"internally_reserved":0,"allocated":7249920,"data_stored":3891004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457620"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574338+0000","last_change":"2024-09-11T23:17:34.610626+0000","last_active":"2024-09-11T23:17:35.574338+0000","last_peered":"2024-09-11T23:17:35.574338+0000","last_clean":"2024-09-11T23:17:35.574338+0000","last_became_active":"2024-09-11T23:17:34.610292+0000","last_became_peered":"2024-09-11T23:17:34.610292+0000","last_unstale":"2024-09-11T23:17:35.574338+0000","last_undegraded":"2024-09-11T23:17:35.574338+0000","last_fullsized":"2024-09-11T23:17:35.574338+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.737918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573919+0000","last_change":"2024-09-11T23:17:34.598346+0000","last_active":"2024-09-11T23:17:35.573919+0000","last_peered":"2024-09-11T23:17:35.573919+0000","last_clean":"2024-09-11T23:17:35.573919+0000","last_became_active":"2024-09-11T23:17:34.597835+0000","last_became_peered":"2024-09-11T23:17:34.597835+0000","last_unstale":"2024-09-11T23:17:35.573919+0000","last_undegraded":"2024-09-11T23:17:35.573919+0000","last_fullsized":"2024-09-11T23:17:35.573919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581697+0000","last_change":"2024-09-11T23:17:34.639616+0000","last_active":"2024-09-11T23:17:35.581697+0000","last_peered":"2024-09-11T23:17:35.581697+0000","last_clean":"2024-09-11T23:17:35.581697+0000","last_became_active":"2024-09-11T23:17:34.639047+0000","last_became_peered":"2024-09-11T23:17:34.639047+0000","last_unstale":"2024-09-11T23:17:35.581697+0000","last_undegraded":"2024-09-11T23:17:35.581697+0000","last_fullsized":"2024-09-11T23:17:35.581697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:55.919028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778401+0000","last_change":"2024-09-11T23:17:34.601465+0000","last_active":"2024-09-11T23:17:35.778401+0000","last_peered":"2024-09-11T23:17:35.778401+0000","last_clean":"2024-09-11T23:17:35.778401+0000","last_became_active":"2024-09-11T23:17:34.600532+0000","last_became_peered":"2024-09-11T23:17:34.600532+0000","last_unstale":"2024-09-11T23:17:35.778401+0000","last_undegraded":"2024-09-11T23:17:35.778401+0000","last_fullsized":"2024-09-11T23:17:35.778401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835933+0000","last_change":"2024-09-11T23:17:34.624914+0000","last_active":"2024-09-11T23:17:35.835933+0000","last_peered":"2024-09-11T23:17:35.835933+0000","last_clean":"2024-09-11T23:17:35.835933+0000","last_became_active":"2024-09-11T23:17:34.623884+0000","last_became_peered":"2024-09-11T23:17:34.623884+0000","last_unstale":"2024-09-11T23:17:35.835933+0000","last_undegraded":"2024-09-11T23:17:35.835933+0000","last_fullsized":"2024-09-11T23:17:35.835933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:27.679699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805057+0000","last_change":"2024-09-11T23:17:34.634109+0000","last_active":"2024-09-11T23:17:35.805057+0000","last_peered":"2024-09-11T23:17:35.805057+0000","last_clean":"2024-09-11T23:17:35.805057+0000","last_became_active":"2024-09-11T23:17:34.633857+0000","last_became_peered":"2024-09-11T23:17:34.633857+0000","last_unstale":"2024-09-11T23:17:35.805057+0000","last_undegraded":"2024-09-11T23:17:35.805057+0000","last_fullsized":"2024-09-11T23:17:35.805057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:46.404163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835274+0000","last_change":"2024-09-11T23:17:34.614969+0000","last_active":"2024-09-11T23:17:35.835274+0000","last_peered":"2024-09-11T23:17:35.835274+0000","last_clean":"2024-09-11T23:17:35.835274+0000","last_became_active":"2024-09-11T23:17:34.614609+0000","last_became_peered":"2024-09-11T23:17:34.614609+0000","last_unstale":"2024-09-11T23:17:35.835274+0000","last_undegraded":"2024-09-11T23:17:35.835274+0000","last_fullsized":"2024-09-11T23:17:35.835274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:24.347228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.577901+0000","last_change":"2024-09-11T23:17:34.630620+0000","last_active":"2024-09-11T23:17:35.577901+0000","last_peered":"2024-09-11T23:17:35.577901+0000","last_clean":"2024-09-11T23:17:35.577901+0000","last_became_active":"2024-09-11T23:17:34.630078+0000","last_became_peered":"2024-09-11T23:17:34.630078+0000","last_unstale":"2024-09-11T23:17:35.577901+0000","last_undegraded":"2024-09-11T23:17:35.577901+0000","last_fullsized":"2024-09-11T23:17:35.577901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:52.631056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582238+0000","last_change":"2024-09-11T23:17:34.644282+0000","last_active":"2024-09-11T23:17:35.582238+0000","last_peered":"2024-09-11T23:17:35.582238+0000","last_clean":"2024-09-11T23:17:35.582238+0000","last_became_active":"2024-09-11T23:17:34.643881+0000","last_became_peered":"2024-09-11T23:17:34.643881+0000","last_unstale":"2024-09-11T23:17:35.582238+0000","last_undegraded":"2024-09-11T23:17:35.582238+0000","last_fullsized":"2024-09-11T23:17:35.582238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:01.314621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581683+0000","last_change":"2024-09-11T23:17:34.640010+0000","last_active":"2024-09-11T23:17:35.581683+0000","last_peered":"2024-09-11T23:17:35.581683+0000","last_clean":"2024-09-11T23:17:35.581683+0000","last_became_active":"2024-09-11T23:17:34.639510+0000","last_became_peered":"2024-09-11T23:17:34.639510+0000","last_unstale":"2024-09-11T23:17:35.581683+0000","last_undegraded":"2024-09-11T23:17:35.581683+0000","last_fullsized":"2024-09-11T23:17:35.581683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778144+0000","last_change":"2024-09-11T23:17:34.618630+0000","last_active":"2024-09-11T23:17:35.778144+0000","last_peered":"2024-09-11T23:17:35.778144+0000","last_clean":"2024-09-11T23:17:35.778144+0000","last_became_active":"2024-09-11T23:17:34.608228+0000","last_became_peered":"2024-09-11T23:17:34.608228+0000","last_unstale":"2024-09-11T23:17:35.778144+0000","last_undegraded":"2024-09-11T23:17:35.778144+0000","last_fullsized":"2024-09-11T23:17:35.778144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:53.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578819+0000","last_change":"2024-09-11T23:17:34.632597+0000","last_active":"2024-09-11T23:17:35.578819+0000","last_peered":"2024-09-11T23:17:35.578819+0000","last_clean":"2024-09-11T23:17:35.578819+0000","last_became_active":"2024-09-11T23:17:34.632015+0000","last_became_peered":"2024-09-11T23:17:34.632015+0000","last_unstale":"2024-09-11T23:17:35.578819+0000","last_undegraded":"2024-09-11T23:17:35.578819+0000","last_fullsized":"2024-09-11T23:17:35.578819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:55.919028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578297+0000","last_change":"2024-09-11T23:17:34.604297+0000","last_active":"2024-09-11T23:17:35.578297+0000","last_peered":"2024-09-11T23:17:35.578297+0000","last_clean":"2024-09-11T23:17:35.578297+0000","last_became_active":"2024-09-11T23:17:34.603548+0000","last_became_peered":"2024-09-11T23:17:34.603548+0000","last_unstale":"2024-09-11T23:17:35.578297+0000","last_undegraded":"2024-09-11T23:17:35.578297+0000","last_fullsized":"2024-09-11T23:17:35.578297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:21.417324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582034+0000","last_change":"2024-09-11T23:17:34.639859+0000","last_active":"2024-09-11T23:17:35.582034+0000","last_peered":"2024-09-11T23:17:35.582034+0000","last_clean":"2024-09-11T23:17:35.582034+0000","last_became_active":"2024-09-11T23:17:34.634911+0000","last_became_peered":"2024-09-11T23:17:34.634911+0000","last_unstale":"2024-09-11T23:17:35.582034+0000","last_undegraded":"2024-09-11T23:17:35.582034+0000","last_fullsized":"2024-09-11T23:17:35.582034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:37.152639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582111+0000","last_change":"2024-09-11T23:17:34.639618+0000","last_active":"2024-09-11T23:17:35.582111+0000","last_peered":"2024-09-11T23:17:35.582111+0000","last_clean":"2024-09-11T23:17:35.582111+0000","last_became_active":"2024-09-11T23:17:34.638865+0000","last_became_peered":"2024-09-11T23:17:34.638865+0000","last_unstale":"2024-09-11T23:17:35.582111+0000","last_undegraded":"2024-09-11T23:17:35.582111+0000","last_fullsized":"2024-09-11T23:17:35.582111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.144974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835776+0000","last_change":"2024-09-11T23:17:34.594655+0000","last_active":"2024-09-11T23:17:35.835776+0000","last_peered":"2024-09-11T23:17:35.835776+0000","last_clean":"2024-09-11T23:17:35.835776+0000","last_became_active":"2024-09-11T23:17:34.594178+0000","last_became_peered":"2024-09-11T23:17:34.594178+0000","last_unstale":"2024-09-11T23:17:35.835776+0000","last_undegraded":"2024-09-11T23:17:35.835776+0000","last_fullsized":"2024-09-11T23:17:35.835776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:39.763314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574434+0000","last_change":"2024-09-11T23:17:34.631438+0000","last_active":"2024-09-11T23:17:35.574434+0000","last_peered":"2024-09-11T23:17:35.574434+0000","last_clean":"2024-09-11T23:17:35.574434+0000","last_became_active":"2024-09-11T23:17:34.631153+0000","last_became_peered":"2024-09-11T23:17:34.631153+0000","last_unstale":"2024-09-11T23:17:35.574434+0000","last_undegraded":"2024-09-11T23:17:35.574434+0000","last_fullsized":"2024-09-11T23:17:35.574434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:52.631056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778229+0000","last_change":"2024-09-11T23:17:34.608071+0000","last_active":"2024-09-11T23:17:35.778229+0000","last_peered":"2024-09-11T23:17:35.778229+0000","last_clean":"2024-09-11T23:17:35.778229+0000","last_became_active":"2024-09-11T23:17:34.607234+0000","last_became_peered":"2024-09-11T23:17:34.607234+0000","last_unstale":"2024-09-11T23:17:35.778229+0000","last_undegraded":"2024-09-11T23:17:35.778229+0000","last_fullsized":"2024-09-11T23:17:35.778229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836532+0000","last_change":"2024-09-11T23:17:34.623285+0000","last_active":"2024-09-11T23:17:35.836532+0000","last_peered":"2024-09-11T23:17:35.836532+0000","last_clean":"2024-09-11T23:17:35.836532+0000","last_became_active":"2024-09-11T23:17:34.616906+0000","last_became_peered":"2024-09-11T23:17:34.616906+0000","last_unstale":"2024-09-11T23:17:35.836532+0000","last_undegraded":"2024-09-11T23:17:35.836532+0000","last_fullsized":"2024-09-11T23:17:35.836532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677292+0000","last_change":"2024-09-11T23:17:34.616201+0000","last_active":"2024-09-11T23:17:35.677292+0000","last_peered":"2024-09-11T23:17:35.677292+0000","last_clean":"2024-09-11T23:17:35.677292+0000","last_became_active":"2024-09-11T23:17:34.615857+0000","last_became_peered":"2024-09-11T23:17:34.615857+0000","last_unstale":"2024-09-11T23:17:35.677292+0000","last_undegraded":"2024-09-11T23:17:35.677292+0000","last_fullsized":"2024-09-11T23:17:35.677292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:48.219264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578949+0000","last_change":"2024-09-11T23:17:34.603353+0000","last_active":"2024-09-11T23:17:35.578949+0000","last_peered":"2024-09-11T23:17:35.578949+0000","last_clean":"2024-09-11T23:17:35.578949+0000","last_became_active":"2024-09-11T23:17:34.602564+0000","last_became_peered":"2024-09-11T23:17:34.602564+0000","last_unstale":"2024-09-11T23:17:35.578949+0000","last_undegraded":"2024-09-11T23:17:35.578949+0000","last_fullsized":"2024-09-11T23:17:35.578949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:24.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677377+0000","last_change":"2024-09-11T23:17:34.627921+0000","last_active":"2024-09-11T23:17:35.677377+0000","last_peered":"2024-09-11T23:17:35.677377+0000","last_clean":"2024-09-11T23:17:35.677377+0000","last_became_active":"2024-09-11T23:17:34.627609+0000","last_became_peered":"2024-09-11T23:17:34.627609+0000","last_unstale":"2024-09-11T23:17:35.677377+0000","last_undegraded":"2024-09-11T23:17:35.677377+0000","last_fullsized":"2024-09-11T23:17:35.677377+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:07.851836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677119+0000","last_change":"2024-09-11T23:17:34.613694+0000","last_active":"2024-09-11T23:17:35.677119+0000","last_peered":"2024-09-11T23:17:35.677119+0000","last_clean":"2024-09-11T23:17:35.677119+0000","last_became_active":"2024-09-11T23:17:34.613455+0000","last_became_peered":"2024-09-11T23:17:34.613455+0000","last_unstale":"2024-09-11T23:17:35.677119+0000","last_undegraded":"2024-09-11T23:17:35.677119+0000","last_fullsized":"2024-09-11T23:17:35.677119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:51.163893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581047+0000","last_change":"2024-09-11T23:17:34.642971+0000","last_active":"2024-09-11T23:17:35.581047+0000","last_peered":"2024-09-11T23:17:35.581047+0000","last_clean":"2024-09-11T23:17:35.581047+0000","last_became_active":"2024-09-11T23:17:34.635154+0000","last_became_peered":"2024-09-11T23:17:34.635154+0000","last_unstale":"2024-09-11T23:17:35.581047+0000","last_undegraded":"2024-09-11T23:17:35.581047+0000","last_fullsized":"2024-09-11T23:17:35.581047+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579164+0000","last_change":"2024-09-11T23:17:34.590339+0000","last_active":"2024-09-11T23:17:35.579164+0000","last_peered":"2024-09-11T23:17:35.579164+0000","last_clean":"2024-09-11T23:17:35.579164+0000","last_became_active":"2024-09-11T23:17:34.587717+0000","last_became_peered":"2024-09-11T23:17:34.587717+0000","last_unstale":"2024-09-11T23:17:35.579164+0000","last_undegraded":"2024-09-11T23:17:35.579164+0000","last_fullsized":"2024-09-11T23:17:35.579164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:37.152639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579884+0000","last_change":"2024-09-11T23:17:34.591092+0000","last_active":"2024-09-11T23:17:35.579884+0000","last_peered":"2024-09-11T23:17:35.579884+0000","last_clean":"2024-09-11T23:17:35.579884+0000","last_became_active":"2024-09-11T23:17:34.588315+0000","last_became_peered":"2024-09-11T23:17:34.588315+0000","last_unstale":"2024-09-11T23:17:35.579884+0000","last_undegraded":"2024-09-11T23:17:35.579884+0000","last_fullsized":"2024-09-11T23:17:35.579884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.144974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778333+0000","last_change":"2024-09-11T23:17:34.618277+0000","last_active":"2024-09-11T23:17:35.778333+0000","last_peered":"2024-09-11T23:17:35.778333+0000","last_clean":"2024-09-11T23:17:35.778333+0000","last_became_active":"2024-09-11T23:17:34.599936+0000","last_became_peered":"2024-09-11T23:17:34.599936+0000","last_unstale":"2024-09-11T23:17:35.778333+0000","last_undegraded":"2024-09-11T23:17:35.778333+0000","last_fullsized":"2024-09-11T23:17:35.778333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:27.679699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573423+0000","last_change":"2024-09-11T23:17:34.625949+0000","last_active":"2024-09-11T23:17:35.573423+0000","last_peered":"2024-09-11T23:17:35.573423+0000","last_clean":"2024-09-11T23:17:35.573423+0000","last_became_active":"2024-09-11T23:17:34.625727+0000","last_became_peered":"2024-09-11T23:17:34.625727+0000","last_unstale":"2024-09-11T23:17:35.573423+0000","last_undegraded":"2024-09-11T23:17:35.573423+0000","last_fullsized":"2024-09-11T23:17:35.573423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:26.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582293+0000","last_change":"2024-09-11T23:17:34.644062+0000","last_active":"2024-09-11T23:17:35.582293+0000","last_peered":"2024-09-11T23:17:35.582293+0000","last_clean":"2024-09-11T23:17:35.582293+0000","last_became_active":"2024-09-11T23:17:34.643628+0000","last_became_peered":"2024-09-11T23:17:34.643628+0000","last_unstale":"2024-09-11T23:17:35.582293+0000","last_undegraded":"2024-09-11T23:17:35.582293+0000","last_fullsized":"2024-09-11T23:17:35.582293+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:29.478638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578297+0000","last_change":"2024-09-11T23:17:34.632613+0000","last_active":"2024-09-11T23:17:35.578297+0000","last_peered":"2024-09-11T23:17:35.578297+0000","last_clean":"2024-09-11T23:17:35.578297+0000","last_became_active":"2024-09-11T23:17:34.631898+0000","last_became_peered":"2024-09-11T23:17:34.631898+0000","last_unstale":"2024-09-11T23:17:35.578297+0000","last_undegraded":"2024-09-11T23:17:35.578297+0000","last_fullsized":"2024-09-11T23:17:35.578297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777491+0000","last_change":"2024-09-11T23:17:34.601241+0000","last_active":"2024-09-11T23:17:35.777491+0000","last_peered":"2024-09-11T23:17:35.777491+0000","last_clean":"2024-09-11T23:17:35.777491+0000","last_became_active":"2024-09-11T23:17:34.600433+0000","last_became_peered":"2024-09-11T23:17:34.600433+0000","last_unstale":"2024-09-11T23:17:35.777491+0000","last_undegraded":"2024-09-11T23:17:35.777491+0000","last_fullsized":"2024-09-11T23:17:35.777491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:20.681186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804668+0000","last_change":"2024-09-11T23:17:34.581058+0000","last_active":"2024-09-11T23:17:35.804668+0000","last_peered":"2024-09-11T23:17:35.804668+0000","last_clean":"2024-09-11T23:17:35.804668+0000","last_became_active":"2024-09-11T23:17:34.580717+0000","last_became_peered":"2024-09-11T23:17:34.580717+0000","last_unstale":"2024-09-11T23:17:35.804668+0000","last_undegraded":"2024-09-11T23:17:35.804668+0000","last_fullsized":"2024-09-11T23:17:35.804668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:33.507282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836415+0000","last_change":"2024-09-11T23:17:34.616624+0000","last_active":"2024-09-11T23:17:35.836415+0000","last_peered":"2024-09-11T23:17:35.836415+0000","last_clean":"2024-09-11T23:17:35.836415+0000","last_became_active":"2024-09-11T23:17:34.615847+0000","last_became_peered":"2024-09-11T23:17:34.615847+0000","last_unstale":"2024-09-11T23:17:35.836415+0000","last_undegraded":"2024-09-11T23:17:35.836415+0000","last_fullsized":"2024-09-11T23:17:35.836415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:54.006933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574618+0000","last_change":"2024-09-11T23:17:33.601698+0000","last_active":"2024-09-11T23:17:35.574618+0000","last_peered":"2024-09-11T23:17:35.574618+0000","last_clean":"2024-09-11T23:17:35.574618+0000","last_became_active":"2024-09-11T23:17:33.601480+0000","last_became_peered":"2024-09-11T23:17:33.601480+0000","last_unstale":"2024-09-11T23:17:35.574618+0000","last_undegraded":"2024-09-11T23:17:35.574618+0000","last_fullsized":"2024-09-11T23:17:35.574618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:29.115868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778511+0000","last_change":"2024-09-11T23:17:34.621266+0000","last_active":"2024-09-11T23:17:35.778511+0000","last_peered":"2024-09-11T23:17:35.778511+0000","last_clean":"2024-09-11T23:17:35.778511+0000","last_became_active":"2024-09-11T23:17:34.619431+0000","last_became_peered":"2024-09-11T23:17:34.619431+0000","last_unstale":"2024-09-11T23:17:35.778511+0000","last_undegraded":"2024-09-11T23:17:35.778511+0000","last_fullsized":"2024-09-11T23:17:35.778511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.843183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805483+0000","last_change":"2024-09-11T23:17:33.609107+0000","last_active":"2024-09-11T23:17:35.805483+0000","last_peered":"2024-09-11T23:17:35.805483+0000","last_clean":"2024-09-11T23:17:35.805483+0000","last_became_active":"2024-09-11T23:17:33.608856+0000","last_became_peered":"2024-09-11T23:17:33.608856+0000","last_unstale":"2024-09-11T23:17:35.805483+0000","last_undegraded":"2024-09-11T23:17:35.805483+0000","last_fullsized":"2024-09-11T23:17:35.805483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:36.142432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805439+0000","last_change":"2024-09-11T23:17:34.587167+0000","last_active":"2024-09-11T23:17:35.805439+0000","last_peered":"2024-09-11T23:17:35.805439+0000","last_clean":"2024-09-11T23:17:35.805439+0000","last_became_active":"2024-09-11T23:17:34.586697+0000","last_became_peered":"2024-09-11T23:17:34.586697+0000","last_unstale":"2024-09-11T23:17:35.805439+0000","last_undegraded":"2024-09-11T23:17:35.805439+0000","last_fullsized":"2024-09-11T23:17:35.805439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:47.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805116+0000","last_change":"2024-09-11T23:17:33.604047+0000","last_active":"2024-09-11T23:17:35.805116+0000","last_peered":"2024-09-11T23:17:35.805116+0000","last_clean":"2024-09-11T23:17:35.805116+0000","last_became_active":"2024-09-11T23:17:33.603390+0000","last_became_peered":"2024-09-11T23:17:33.603390+0000","last_unstale":"2024-09-11T23:17:35.805116+0000","last_undegraded":"2024-09-11T23:17:35.805116+0000","last_fullsized":"2024-09-11T23:17:35.805116+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:23.848101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581943+0000","last_change":"2024-09-11T23:17:34.639148+0000","last_active":"2024-09-11T23:17:35.581943+0000","last_peered":"2024-09-11T23:17:35.581943+0000","last_clean":"2024-09-11T23:17:35.581943+0000","last_became_active":"2024-09-11T23:17:34.638637+0000","last_became_peered":"2024-09-11T23:17:34.638637+0000","last_unstale":"2024-09-11T23:17:35.581943+0000","last_undegraded":"2024-09-11T23:17:35.581943+0000","last_fullsized":"2024-09-11T23:17:35.581943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:24.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805198+0000","last_change":"2024-09-11T23:17:33.582839+0000","last_active":"2024-09-11T23:17:35.805198+0000","last_peered":"2024-09-11T23:17:35.805198+0000","last_clean":"2024-09-11T23:17:35.805198+0000","last_became_active":"2024-09-11T23:17:33.582485+0000","last_became_peered":"2024-09-11T23:17:33.582485+0000","last_unstale":"2024-09-11T23:17:35.805198+0000","last_undegraded":"2024-09-11T23:17:35.805198+0000","last_fullsized":"2024-09-11T23:17:35.805198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:42.802430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835596+0000","last_change":"2024-09-11T23:17:34.600717+0000","last_active":"2024-09-11T23:17:35.835596+0000","last_peered":"2024-09-11T23:17:35.835596+0000","last_clean":"2024-09-11T23:17:35.835596+0000","last_became_active":"2024-09-11T23:17:34.600234+0000","last_became_peered":"2024-09-11T23:17:34.600234+0000","last_unstale":"2024-09-11T23:17:35.835596+0000","last_undegraded":"2024-09-11T23:17:35.835596+0000","last_fullsized":"2024-09-11T23:17:35.835596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:46.484269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677281+0000","last_change":"2024-09-11T23:17:33.581416+0000","last_active":"2024-09-11T23:17:35.677281+0000","last_peered":"2024-09-11T23:17:35.677281+0000","last_clean":"2024-09-11T23:17:35.677281+0000","last_became_active":"2024-09-11T23:17:33.581153+0000","last_became_peered":"2024-09-11T23:17:33.581153+0000","last_unstale":"2024-09-11T23:17:35.677281+0000","last_undegraded":"2024-09-11T23:17:35.677281+0000","last_fullsized":"2024-09-11T23:17:35.677281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:00.304414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573499+0000","last_change":"2024-09-11T23:17:34.607397+0000","last_active":"2024-09-11T23:17:35.573499+0000","last_peered":"2024-09-11T23:17:35.573499+0000","last_clean":"2024-09-11T23:17:35.573499+0000","last_became_active":"2024-09-11T23:17:34.607117+0000","last_became_peered":"2024-09-11T23:17:34.607117+0000","last_unstale":"2024-09-11T23:17:35.573499+0000","last_undegraded":"2024-09-11T23:17:35.573499+0000","last_fullsized":"2024-09-11T23:17:35.573499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677061+0000","last_change":"2024-09-11T23:17:33.580760+0000","last_active":"2024-09-11T23:17:35.677061+0000","last_peered":"2024-09-11T23:17:35.677061+0000","last_clean":"2024-09-11T23:17:35.677061+0000","last_became_active":"2024-09-11T23:17:33.580479+0000","last_became_peered":"2024-09-11T23:17:33.580479+0000","last_unstale":"2024-09-11T23:17:35.677061+0000","last_undegraded":"2024-09-11T23:17:35.677061+0000","last_fullsized":"2024-09-11T23:17:35.677061+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:45.371483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835979+0000","last_change":"2024-09-11T23:17:34.615898+0000","last_active":"2024-09-11T23:17:35.835979+0000","last_peered":"2024-09-11T23:17:35.835979+0000","last_clean":"2024-09-11T23:17:35.835979+0000","last_became_active":"2024-09-11T23:17:34.615084+0000","last_became_peered":"2024-09-11T23:17:34.615084+0000","last_unstale":"2024-09-11T23:17:35.835979+0000","last_undegraded":"2024-09-11T23:17:35.835979+0000","last_fullsized":"2024-09-11T23:17:35.835979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677057+0000","last_change":"2024-09-11T23:17:33.596770+0000","last_active":"2024-09-11T23:17:35.677057+0000","last_peered":"2024-09-11T23:17:35.677057+0000","last_clean":"2024-09-11T23:17:35.677057+0000","last_became_active":"2024-09-11T23:17:33.596421+0000","last_became_peered":"2024-09-11T23:17:33.596421+0000","last_unstale":"2024-09-11T23:17:35.677057+0000","last_undegraded":"2024-09-11T23:17:35.677057+0000","last_fullsized":"2024-09-11T23:17:35.677057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:36.142432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677308+0000","last_change":"2024-09-11T23:17:34.600319+0000","last_active":"2024-09-11T23:17:35.677308+0000","last_peered":"2024-09-11T23:17:35.677308+0000","last_clean":"2024-09-11T23:17:35.677308+0000","last_became_active":"2024-09-11T23:17:34.600022+0000","last_became_peered":"2024-09-11T23:17:34.600022+0000","last_unstale":"2024-09-11T23:17:35.677308+0000","last_undegraded":"2024-09-11T23:17:35.677308+0000","last_fullsized":"2024-09-11T23:17:35.677308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:35.014823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835790+0000","last_change":"2024-09-11T23:17:33.605702+0000","last_active":"2024-09-11T23:17:35.835790+0000","last_peered":"2024-09-11T23:17:35.835790+0000","last_clean":"2024-09-11T23:17:35.835790+0000","last_became_active":"2024-09-11T23:17:33.602583+0000","last_became_peered":"2024-09-11T23:17:33.602583+0000","last_unstale":"2024-09-11T23:17:35.835790+0000","last_undegraded":"2024-09-11T23:17:35.835790+0000","last_fullsized":"2024-09-11T23:17:35.835790+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:01.331655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573512+0000","last_change":"2024-09-11T23:17:34.598065+0000","last_active":"2024-09-11T23:17:35.573512+0000","last_peered":"2024-09-11T23:17:35.573512+0000","last_clean":"2024-09-11T23:17:35.573512+0000","last_became_active":"2024-09-11T23:17:34.597749+0000","last_became_peered":"2024-09-11T23:17:34.597749+0000","last_unstale":"2024-09-11T23:17:35.573512+0000","last_undegraded":"2024-09-11T23:17:35.573512+0000","last_fullsized":"2024-09-11T23:17:35.573512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.496612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582485+0000","last_change":"2024-09-11T23:17:33.613985+0000","last_active":"2024-09-11T23:17:35.582485+0000","last_peered":"2024-09-11T23:17:35.582485+0000","last_clean":"2024-09-11T23:17:35.582485+0000","last_became_active":"2024-09-11T23:17:33.607571+0000","last_became_peered":"2024-09-11T23:17:33.607571+0000","last_unstale":"2024-09-11T23:17:35.582485+0000","last_undegraded":"2024-09-11T23:17:35.582485+0000","last_fullsized":"2024-09-11T23:17:35.582485+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:52.996726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677282+0000","last_change":"2024-09-11T23:17:34.610229+0000","last_active":"2024-09-11T23:17:35.677282+0000","last_peered":"2024-09-11T23:17:35.677282+0000","last_clean":"2024-09-11T23:17:35.677282+0000","last_became_active":"2024-09-11T23:17:34.609894+0000","last_became_peered":"2024-09-11T23:17:34.609894+0000","last_unstale":"2024-09-11T23:17:35.677282+0000","last_undegraded":"2024-09-11T23:17:35.677282+0000","last_fullsized":"2024-09-11T23:17:35.677282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:47.400476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778471+0000","last_change":"2024-09-11T23:17:33.594110+0000","last_active":"2024-09-11T23:17:35.778471+0000","last_peered":"2024-09-11T23:17:35.778471+0000","last_clean":"2024-09-11T23:17:35.778471+0000","last_became_active":"2024-09-11T23:17:33.593398+0000","last_became_peered":"2024-09-11T23:17:33.593398+0000","last_unstale":"2024-09-11T23:17:35.778471+0000","last_undegraded":"2024-09-11T23:17:35.778471+0000","last_fullsized":"2024-09-11T23:17:35.778471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:37.898983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836472+0000","last_change":"2024-09-11T23:17:34.624554+0000","last_active":"2024-09-11T23:17:35.836472+0000","last_peered":"2024-09-11T23:17:35.836472+0000","last_clean":"2024-09-11T23:17:35.836472+0000","last_became_active":"2024-09-11T23:17:34.623795+0000","last_became_peered":"2024-09-11T23:17:34.623795+0000","last_unstale":"2024-09-11T23:17:35.836472+0000","last_undegraded":"2024-09-11T23:17:35.836472+0000","last_fullsized":"2024-09-11T23:17:35.836472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:26.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581987+0000","last_change":"2024-09-11T23:17:33.607951+0000","last_active":"2024-09-11T23:17:35.581987+0000","last_peered":"2024-09-11T23:17:35.581987+0000","last_clean":"2024-09-11T23:17:35.581987+0000","last_became_active":"2024-09-11T23:17:33.607176+0000","last_became_peered":"2024-09-11T23:17:33.607176+0000","last_unstale":"2024-09-11T23:17:35.581987+0000","last_undegraded":"2024-09-11T23:17:35.581987+0000","last_fullsized":"2024-09-11T23:17:35.581987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.669492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778738+0000","last_change":"2024-09-11T23:17:34.601023+0000","last_active":"2024-09-11T23:17:35.778738+0000","last_peered":"2024-09-11T23:17:35.778738+0000","last_clean":"2024-09-11T23:17:35.778738+0000","last_became_active":"2024-09-11T23:17:34.600249+0000","last_became_peered":"2024-09-11T23:17:34.600249+0000","last_unstale":"2024-09-11T23:17:35.778738+0000","last_undegraded":"2024-09-11T23:17:35.778738+0000","last_fullsized":"2024-09-11T23:17:35.778738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:17.406523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573486+0000","last_change":"2024-09-11T23:17:33.610912+0000","last_active":"2024-09-11T23:17:35.573486+0000","last_peered":"2024-09-11T23:17:35.573486+0000","last_clean":"2024-09-11T23:17:35.573486+0000","last_became_active":"2024-09-11T23:17:33.610648+0000","last_became_peered":"2024-09-11T23:17:33.610648+0000","last_unstale":"2024-09-11T23:17:35.573486+0000","last_undegraded":"2024-09-11T23:17:35.573486+0000","last_fullsized":"2024-09-11T23:17:35.573486+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:19.670978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777462+0000","last_change":"2024-09-11T23:17:34.630989+0000","last_active":"2024-09-11T23:17:35.777462+0000","last_peered":"2024-09-11T23:17:35.777462+0000","last_clean":"2024-09-11T23:17:35.777462+0000","last_became_active":"2024-09-11T23:17:34.629103+0000","last_became_peered":"2024-09-11T23:17:34.629103+0000","last_unstale":"2024-09-11T23:17:35.777462+0000","last_undegraded":"2024-09-11T23:17:35.777462+0000","last_fullsized":"2024-09-11T23:17:35.777462+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:30.126075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582318+0000","last_change":"2024-09-11T23:17:33.608707+0000","last_active":"2024-09-11T23:17:35.582318+0000","last_peered":"2024-09-11T23:17:35.582318+0000","last_clean":"2024-09-11T23:17:35.582318+0000","last_became_active":"2024-09-11T23:17:33.607484+0000","last_became_peered":"2024-09-11T23:17:33.607484+0000","last_unstale":"2024-09-11T23:17:35.582318+0000","last_undegraded":"2024-09-11T23:17:35.582318+0000","last_fullsized":"2024-09-11T23:17:35.582318+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:13.843316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.577924+0000","last_change":"2024-09-11T23:17:34.592872+0000","last_active":"2024-09-11T23:17:35.577924+0000","last_peered":"2024-09-11T23:17:35.577924+0000","last_clean":"2024-09-11T23:17:35.577924+0000","last_became_active":"2024-09-11T23:17:34.592173+0000","last_became_peered":"2024-09-11T23:17:34.592173+0000","last_unstale":"2024-09-11T23:17:35.577924+0000","last_undegraded":"2024-09-11T23:17:35.577924+0000","last_fullsized":"2024-09-11T23:17:35.577924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:03.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578590+0000","last_change":"2024-09-11T23:17:33.609687+0000","last_active":"2024-09-11T23:17:35.578590+0000","last_peered":"2024-09-11T23:17:35.578590+0000","last_clean":"2024-09-11T23:17:35.578590+0000","last_became_active":"2024-09-11T23:17:33.604476+0000","last_became_peered":"2024-09-11T23:17:33.604476+0000","last_unstale":"2024-09-11T23:17:35.578590+0000","last_undegraded":"2024-09-11T23:17:35.578590+0000","last_fullsized":"2024-09-11T23:17:35.578590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:52.900370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835910+0000","last_change":"2024-09-11T23:17:34.606320+0000","last_active":"2024-09-11T23:17:35.835910+0000","last_peered":"2024-09-11T23:17:35.835910+0000","last_clean":"2024-09-11T23:17:35.835910+0000","last_became_active":"2024-09-11T23:17:34.605573+0000","last_became_peered":"2024-09-11T23:17:34.605573+0000","last_unstale":"2024-09-11T23:17:35.835910+0000","last_undegraded":"2024-09-11T23:17:35.835910+0000","last_fullsized":"2024-09-11T23:17:35.835910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581380+0000","last_change":"2024-09-11T23:17:33.601596+0000","last_active":"2024-09-11T23:17:35.581380+0000","last_peered":"2024-09-11T23:17:35.581380+0000","last_clean":"2024-09-11T23:17:35.581380+0000","last_became_active":"2024-09-11T23:17:33.600439+0000","last_became_peered":"2024-09-11T23:17:33.600439+0000","last_unstale":"2024-09-11T23:17:35.581380+0000","last_undegraded":"2024-09-11T23:17:35.581380+0000","last_fullsized":"2024-09-11T23:17:35.581380+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:32.832975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574435+0000","last_change":"2024-09-11T23:17:34.613739+0000","last_active":"2024-09-11T23:17:35.574435+0000","last_peered":"2024-09-11T23:17:35.574435+0000","last_clean":"2024-09-11T23:17:35.574435+0000","last_became_active":"2024-09-11T23:17:34.613519+0000","last_became_peered":"2024-09-11T23:17:34.613519+0000","last_unstale":"2024-09-11T23:17:35.574435+0000","last_undegraded":"2024-09-11T23:17:35.574435+0000","last_fullsized":"2024-09-11T23:17:35.574435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:03.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777350+0000","last_change":"2024-09-11T23:17:33.610938+0000","last_active":"2024-09-11T23:17:35.777350+0000","last_peered":"2024-09-11T23:17:35.777350+0000","last_clean":"2024-09-11T23:17:35.777350+0000","last_became_active":"2024-09-11T23:17:33.609912+0000","last_became_peered":"2024-09-11T23:17:33.609912+0000","last_unstale":"2024-09-11T23:17:35.777350+0000","last_undegraded":"2024-09-11T23:17:35.777350+0000","last_fullsized":"2024-09-11T23:17:35.777350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:52.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581619+0000","last_change":"2024-09-11T23:17:34.642677+0000","last_active":"2024-09-11T23:17:35.581619+0000","last_peered":"2024-09-11T23:17:35.581619+0000","last_clean":"2024-09-11T23:17:35.581619+0000","last_became_active":"2024-09-11T23:17:34.639640+0000","last_became_peered":"2024-09-11T23:17:34.639640+0000","last_unstale":"2024-09-11T23:17:35.581619+0000","last_undegraded":"2024-09-11T23:17:35.581619+0000","last_fullsized":"2024-09-11T23:17:35.581619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:21.417324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579349+0000","last_change":"2024-09-11T23:17:33.597492+0000","last_active":"2024-09-11T23:17:35.579349+0000","last_peered":"2024-09-11T23:17:35.579349+0000","last_clean":"2024-09-11T23:17:35.579349+0000","last_became_active":"2024-09-11T23:17:33.596742+0000","last_became_peered":"2024-09-11T23:17:33.596742+0000","last_unstale":"2024-09-11T23:17:35.579349+0000","last_undegraded":"2024-09-11T23:17:35.579349+0000","last_fullsized":"2024-09-11T23:17:35.579349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.396316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836627+0000","last_change":"2024-09-11T23:17:34.625162+0000","last_active":"2024-09-11T23:17:35.836627+0000","last_peered":"2024-09-11T23:17:35.836627+0000","last_clean":"2024-09-11T23:17:35.836627+0000","last_became_active":"2024-09-11T23:17:34.624277+0000","last_became_peered":"2024-09-11T23:17:34.624277+0000","last_unstale":"2024-09-11T23:17:35.836627+0000","last_undegraded":"2024-09-11T23:17:35.836627+0000","last_fullsized":"2024-09-11T23:17:35.836627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.496612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581923+0000","last_change":"2024-09-11T23:17:33.615817+0000","last_active":"2024-09-11T23:17:35.581923+0000","last_peered":"2024-09-11T23:17:35.581923+0000","last_clean":"2024-09-11T23:17:35.581923+0000","last_became_active":"2024-09-11T23:17:33.614982+0000","last_became_peered":"2024-09-11T23:17:33.614982+0000","last_unstale":"2024-09-11T23:17:35.581923+0000","last_undegraded":"2024-09-11T23:17:35.581923+0000","last_fullsized":"2024-09-11T23:17:35.581923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:37.305117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778498+0000","last_change":"2024-09-11T23:17:34.626238+0000","last_active":"2024-09-11T23:17:35.778498+0000","last_peered":"2024-09-11T23:17:35.778498+0000","last_clean":"2024-09-11T23:17:35.778498+0000","last_became_active":"2024-09-11T23:17:34.620763+0000","last_became_peered":"2024-09-11T23:17:34.620763+0000","last_unstale":"2024-09-11T23:17:35.778498+0000","last_undegraded":"2024-09-11T23:17:35.778498+0000","last_fullsized":"2024-09-11T23:17:35.778498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:14.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581675+0000","last_change":"2024-09-11T23:17:33.607778+0000","last_active":"2024-09-11T23:17:35.581675+0000","last_peered":"2024-09-11T23:17:35.581675+0000","last_clean":"2024-09-11T23:17:35.581675+0000","last_became_active":"2024-09-11T23:17:33.607009+0000","last_became_peered":"2024-09-11T23:17:33.607009+0000","last_unstale":"2024-09-11T23:17:35.581675+0000","last_undegraded":"2024-09-11T23:17:35.581675+0000","last_fullsized":"2024-09-11T23:17:35.581675+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:05.140612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836260+0000","last_change":"2024-09-11T23:17:34.625821+0000","last_active":"2024-09-11T23:17:35.836260+0000","last_peered":"2024-09-11T23:17:35.836260+0000","last_clean":"2024-09-11T23:17:35.836260+0000","last_became_active":"2024-09-11T23:17:34.617004+0000","last_became_peered":"2024-09-11T23:17:34.617004+0000","last_unstale":"2024-09-11T23:17:35.836260+0000","last_undegraded":"2024-09-11T23:17:35.836260+0000","last_fullsized":"2024-09-11T23:17:35.836260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.843183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677325+0000","last_change":"2024-09-11T23:17:33.597454+0000","last_active":"2024-09-11T23:17:35.677325+0000","last_peered":"2024-09-11T23:17:35.677325+0000","last_clean":"2024-09-11T23:17:35.677325+0000","last_became_active":"2024-09-11T23:17:33.596782+0000","last_became_peered":"2024-09-11T23:17:33.596782+0000","last_unstale":"2024-09-11T23:17:35.677325+0000","last_undegraded":"2024-09-11T23:17:35.677325+0000","last_fullsized":"2024-09-11T23:17:35.677325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:28.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804801+0000","last_change":"2024-09-11T23:17:34.581389+0000","last_active":"2024-09-11T23:17:35.804801+0000","last_peered":"2024-09-11T23:17:35.804801+0000","last_clean":"2024-09-11T23:17:35.804801+0000","last_became_active":"2024-09-11T23:17:34.581081+0000","last_became_peered":"2024-09-11T23:17:34.581081+0000","last_unstale":"2024-09-11T23:17:35.804801+0000","last_undegraded":"2024-09-11T23:17:35.804801+0000","last_fullsized":"2024-09-11T23:17:35.804801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:53.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804713+0000","last_change":"2024-09-11T23:17:33.592826+0000","last_active":"2024-09-11T23:17:35.804713+0000","last_peered":"2024-09-11T23:17:35.804713+0000","last_clean":"2024-09-11T23:17:35.804713+0000","last_became_active":"2024-09-11T23:17:33.592527+0000","last_became_peered":"2024-09-11T23:17:33.592527+0000","last_unstale":"2024-09-11T23:17:35.804713+0000","last_undegraded":"2024-09-11T23:17:35.804713+0000","last_fullsized":"2024-09-11T23:17:35.804713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:20.407117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578037+0000","last_change":"2024-09-11T23:17:34.609138+0000","last_active":"2024-09-11T23:17:35.578037+0000","last_peered":"2024-09-11T23:17:35.578037+0000","last_clean":"2024-09-11T23:17:35.578037+0000","last_became_active":"2024-09-11T23:17:34.608321+0000","last_became_peered":"2024-09-11T23:17:34.608321+0000","last_unstale":"2024-09-11T23:17:35.578037+0000","last_undegraded":"2024-09-11T23:17:35.578037+0000","last_fullsized":"2024-09-11T23:17:35.578037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578847+0000","last_change":"2024-09-11T23:17:33.597388+0000","last_active":"2024-09-11T23:17:35.578847+0000","last_peered":"2024-09-11T23:17:35.578847+0000","last_clean":"2024-09-11T23:17:35.578847+0000","last_became_active":"2024-09-11T23:17:33.596633+0000","last_became_peered":"2024-09-11T23:17:33.596633+0000","last_unstale":"2024-09-11T23:17:35.578847+0000","last_undegraded":"2024-09-11T23:17:35.578847+0000","last_fullsized":"2024-09-11T23:17:35.578847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:05.140612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836408+0000","last_change":"2024-09-11T23:17:34.606167+0000","last_active":"2024-09-11T23:17:35.836408+0000","last_peered":"2024-09-11T23:17:35.836408+0000","last_clean":"2024-09-11T23:17:35.836408+0000","last_became_active":"2024-09-11T23:17:34.605453+0000","last_became_peered":"2024-09-11T23:17:34.605453+0000","last_unstale":"2024-09-11T23:17:35.836408+0000","last_undegraded":"2024-09-11T23:17:35.836408+0000","last_fullsized":"2024-09-11T23:17:35.836408+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:17.406523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804404+0000","last_change":"2024-09-11T23:17:33.600865+0000","last_active":"2024-09-11T23:17:35.804404+0000","last_peered":"2024-09-11T23:17:35.804404+0000","last_clean":"2024-09-11T23:17:35.804404+0000","last_became_active":"2024-09-11T23:17:33.600415+0000","last_became_peered":"2024-09-11T23:17:33.600415+0000","last_unstale":"2024-09-11T23:17:35.804404+0000","last_undegraded":"2024-09-11T23:17:35.804404+0000","last_fullsized":"2024-09-11T23:17:35.804404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:23.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805160+0000","last_change":"2024-09-11T23:17:34.618628+0000","last_active":"2024-09-11T23:17:35.805160+0000","last_peered":"2024-09-11T23:17:35.805160+0000","last_clean":"2024-09-11T23:17:35.805160+0000","last_became_active":"2024-09-11T23:17:34.618379+0000","last_became_peered":"2024-09-11T23:17:34.618379+0000","last_unstale":"2024-09-11T23:17:35.805160+0000","last_undegraded":"2024-09-11T23:17:35.805160+0000","last_fullsized":"2024-09-11T23:17:35.805160+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:06.102547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579770+0000","last_change":"2024-09-11T23:17:33.604801+0000","last_active":"2024-09-11T23:17:35.579770+0000","last_peered":"2024-09-11T23:17:35.579770+0000","last_clean":"2024-09-11T23:17:35.579770+0000","last_became_active":"2024-09-11T23:17:33.604091+0000","last_became_peered":"2024-09-11T23:17:33.604091+0000","last_unstale":"2024-09-11T23:17:35.579770+0000","last_undegraded":"2024-09-11T23:17:35.579770+0000","last_fullsized":"2024-09-11T23:17:35.579770+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:37.305117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835969+0000","last_change":"2024-09-11T23:17:34.584055+0000","last_active":"2024-09-11T23:17:35.835969+0000","last_peered":"2024-09-11T23:17:35.835969+0000","last_clean":"2024-09-11T23:17:35.835969+0000","last_became_active":"2024-09-11T23:17:34.583725+0000","last_became_peered":"2024-09-11T23:17:34.583725+0000","last_unstale":"2024-09-11T23:17:35.835969+0000","last_undegraded":"2024-09-11T23:17:35.835969+0000","last_fullsized":"2024-09-11T23:17:35.835969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:42.803431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:36.577286+0000","last_change":"2024-09-11T23:17:33.604201+0000","last_active":"2024-09-11T23:17:36.577286+0000","last_peered":"2024-09-11T23:17:36.577286+0000","last_clean":"2024-09-11T23:17:36.577286+0000","last_became_active":"2024-09-11T23:17:33.602885+0000","last_became_peered":"2024-09-11T23:17:33.602885+0000","last_unstale":"2024-09-11T23:17:36.577286+0000","last_undegraded":"2024-09-11T23:17:36.577286+0000","last_fullsized":"2024-09-11T23:17:36.577286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.669492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579451+0000","last_change":"2024-09-11T23:17:34.591850+0000","last_active":"2024-09-11T23:17:35.579451+0000","last_peered":"2024-09-11T23:17:35.579451+0000","last_clean":"2024-09-11T23:17:35.579451+0000","last_became_active":"2024-09-11T23:17:34.591097+0000","last_became_peered":"2024-09-11T23:17:34.591097+0000","last_unstale":"2024-09-11T23:17:35.579451+0000","last_undegraded":"2024-09-11T23:17:35.579451+0000","last_fullsized":"2024-09-11T23:17:35.579451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:01.314621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805225+0000","last_change":"2024-09-11T23:17:33.603466+0000","last_active":"2024-09-11T23:17:35.805225+0000","last_peered":"2024-09-11T23:17:35.805225+0000","last_clean":"2024-09-11T23:17:35.805225+0000","last_became_active":"2024-09-11T23:17:33.603187+0000","last_became_peered":"2024-09-11T23:17:33.603187+0000","last_unstale":"2024-09-11T23:17:35.805225+0000","last_undegraded":"2024-09-11T23:17:35.805225+0000","last_fullsized":"2024-09-11T23:17:35.805225+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:54.908821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836428+0000","last_change":"2024-09-11T23:17:34.628560+0000","last_active":"2024-09-11T23:17:35.836428+0000","last_peered":"2024-09-11T23:17:35.836428+0000","last_clean":"2024-09-11T23:17:35.836428+0000","last_became_active":"2024-09-11T23:17:34.626398+0000","last_became_peered":"2024-09-11T23:17:34.626398+0000","last_unstale":"2024-09-11T23:17:35.836428+0000","last_undegraded":"2024-09-11T23:17:35.836428+0000","last_fullsized":"2024-09-11T23:17:35.836428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:53.046941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573554+0000","last_change":"2024-09-11T23:17:33.611169+0000","last_active":"2024-09-11T23:17:35.573554+0000","last_peered":"2024-09-11T23:17:35.573554+0000","last_clean":"2024-09-11T23:17:35.573554+0000","last_became_active":"2024-09-11T23:17:33.610838+0000","last_became_peered":"2024-09-11T23:17:33.610838+0000","last_unstale":"2024-09-11T23:17:35.573554+0000","last_undegraded":"2024-09-11T23:17:35.573554+0000","last_fullsized":"2024-09-11T23:17:35.573554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.666435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835700+0000","last_change":"2024-09-11T23:17:34.606096+0000","last_active":"2024-09-11T23:17:35.835700+0000","last_peered":"2024-09-11T23:17:35.835700+0000","last_clean":"2024-09-11T23:17:35.835700+0000","last_became_active":"2024-09-11T23:17:34.605365+0000","last_became_peered":"2024-09-11T23:17:34.605365+0000","last_unstale":"2024-09-11T23:17:35.835700+0000","last_undegraded":"2024-09-11T23:17:35.835700+0000","last_fullsized":"2024-09-11T23:17:35.835700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:53.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582434+0000","last_change":"2024-09-11T23:17:33.614246+0000","last_active":"2024-09-11T23:17:35.582434+0000","last_peered":"2024-09-11T23:17:35.582434+0000","last_clean":"2024-09-11T23:17:35.582434+0000","last_became_active":"2024-09-11T23:17:33.606935+0000","last_became_peered":"2024-09-11T23:17:33.606935+0000","last_unstale":"2024-09-11T23:17:35.582434+0000","last_undegraded":"2024-09-11T23:17:35.582434+0000","last_fullsized":"2024-09-11T23:17:35.582434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.396316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777716+0000","last_change":"2024-09-11T23:17:34.636973+0000","last_active":"2024-09-11T23:17:35.777716+0000","last_peered":"2024-09-11T23:17:35.777716+0000","last_clean":"2024-09-11T23:17:35.777716+0000","last_became_active":"2024-09-11T23:17:34.636144+0000","last_became_peered":"2024-09-11T23:17:34.636144+0000","last_unstale":"2024-09-11T23:17:35.777716+0000","last_undegraded":"2024-09-11T23:17:35.777716+0000","last_fullsized":"2024-09-11T23:17:35.777716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:46.676642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677170+0000","last_change":"2024-09-11T23:17:33.575459+0000","last_active":"2024-09-11T23:17:35.677170+0000","last_peered":"2024-09-11T23:17:35.677170+0000","last_clean":"2024-09-11T23:17:35.677170+0000","last_became_active":"2024-09-11T23:17:33.575096+0000","last_became_peered":"2024-09-11T23:17:33.575096+0000","last_unstale":"2024-09-11T23:17:35.677170+0000","last_undegraded":"2024-09-11T23:17:35.677170+0000","last_fullsized":"2024-09-11T23:17:35.677170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.676254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573633+0000","last_change":"2024-09-11T23:17:34.621514+0000","last_active":"2024-09-11T23:17:35.573633+0000","last_peered":"2024-09-11T23:17:35.573633+0000","last_clean":"2024-09-11T23:17:35.573633+0000","last_became_active":"2024-09-11T23:17:34.621224+0000","last_became_peered":"2024-09-11T23:17:34.621224+0000","last_unstale":"2024-09-11T23:17:35.573633+0000","last_undegraded":"2024-09-11T23:17:35.573633+0000","last_fullsized":"2024-09-11T23:17:35.573633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.092645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677354+0000","last_change":"2024-09-11T23:17:33.596774+0000","last_active":"2024-09-11T23:17:35.677354+0000","last_peered":"2024-09-11T23:17:35.677354+0000","last_clean":"2024-09-11T23:17:35.677354+0000","last_became_active":"2024-09-11T23:17:33.596443+0000","last_became_peered":"2024-09-11T23:17:33.596443+0000","last_unstale":"2024-09-11T23:17:35.677354+0000","last_undegraded":"2024-09-11T23:17:35.677354+0000","last_fullsized":"2024-09-11T23:17:35.677354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:49.134767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835804+0000","last_change":"2024-09-11T23:17:34.594235+0000","last_active":"2024-09-11T23:17:35.835804+0000","last_peered":"2024-09-11T23:17:35.835804+0000","last_clean":"2024-09-11T23:17:35.835804+0000","last_became_active":"2024-09-11T23:17:34.593883+0000","last_became_peered":"2024-09-11T23:17:34.593883+0000","last_unstale":"2024-09-11T23:17:35.835804+0000","last_undegraded":"2024-09-11T23:17:35.835804+0000","last_fullsized":"2024-09-11T23:17:35.835804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:35.388987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573210+0000","last_change":"2024-09-11T23:17:33.596882+0000","last_active":"2024-09-11T23:17:35.573210+0000","last_peered":"2024-09-11T23:17:35.573210+0000","last_clean":"2024-09-11T23:17:35.573210+0000","last_became_active":"2024-09-11T23:17:33.596596+0000","last_became_peered":"2024-09-11T23:17:33.596596+0000","last_unstale":"2024-09-11T23:17:35.573210+0000","last_undegraded":"2024-09-11T23:17:35.573210+0000","last_fullsized":"2024-09-11T23:17:35.573210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:52.900370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836046+0000","last_change":"2024-09-11T23:17:34.616537+0000","last_active":"2024-09-11T23:17:35.836046+0000","last_peered":"2024-09-11T23:17:35.836046+0000","last_clean":"2024-09-11T23:17:35.836046+0000","last_became_active":"2024-09-11T23:17:34.615717+0000","last_became_peered":"2024-09-11T23:17:34.615717+0000","last_unstale":"2024-09-11T23:17:35.836046+0000","last_undegraded":"2024-09-11T23:17:35.836046+0000","last_fullsized":"2024-09-11T23:17:35.836046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:14.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.676989+0000","last_change":"2024-09-11T23:17:33.578984+0000","last_active":"2024-09-11T23:17:35.676989+0000","last_peered":"2024-09-11T23:17:35.676989+0000","last_clean":"2024-09-11T23:17:35.676989+0000","last_became_active":"2024-09-11T23:17:33.578717+0000","last_became_peered":"2024-09-11T23:17:33.578717+0000","last_unstale":"2024-09-11T23:17:35.676989+0000","last_undegraded":"2024-09-11T23:17:35.676989+0000","last_fullsized":"2024-09-11T23:17:35.676989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:23.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581107+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:17:35.581107+0000","last_peered":"2024-09-11T23:17:35.581107+0000","last_clean":"2024-09-11T23:17:35.581107+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:17:35.581107+0000","last_undegraded":"2024-09-11T23:17:35.581107+0000","last_fullsized":"2024-09-11T23:17:35.581107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1359872,"data_stored":929325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":753664,"data_stored":338215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":753664,"data_stored":338203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":761856,"data_stored":339793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":338181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":749568,"data_stored":338181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36116,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":778240,"data_stored":340557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36668,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335172,"statfs":{"total":96636764160,"available":96599216128,"internally_reserved":0,"allocated":1343488,"data_stored":928549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:39.871 INFO:tasks.ceph.mds.c.smithi094.stderr:2024-09-11T23:17:39.870+0000 7eff716d0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:17:42.068 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:17:42.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 Processor -- start 2024-09-11T23:17:42.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 -- start start 2024-09-11T23:17:42.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb01520a0 0x7f8cb006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cb006fe50 0x7f8cb015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8cb015f1d0 0x7f8cb0071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb0152480 con 0x7f8cb015f1d0 2024-09-11T23:17:42.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb0070250 con 0x7f8cb006fe50 2024-09-11T23:17:42.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb79ab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb00aede0 con 0x7f8cb01520a0 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8cb015f1d0 0x7f8cb0071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8cb015f1d0 0x7f8cb0071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34974/0 (socket says 172.21.15.94:34974) 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 -- 172.21.15.94:0/1039517405 learned_addr learned my addr 172.21.15.94:0/1039517405 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb4f46640 1 --2- 172.21.15.94:0/1039517405 >> v2:172.21.15.155:3300/0 conn(0x7f8cb006fe50 0x7f8cb015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5747640 1 --2- 172.21.15.94:0/1039517405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb01520a0 0x7f8cb006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 -- 172.21.15.94:0/1039517405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb01520a0 msgr2=0x7f8cb006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 --2- 172.21.15.94:0/1039517405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb01520a0 0x7f8cb006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 -- 172.21.15.94:0/1039517405 >> v2:172.21.15.155:3300/0 conn(0x7f8cb006fe50 msgr2=0x7f8cb015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 --2- 172.21.15.94:0/1039517405 >> v2:172.21.15.155:3300/0 conn(0x7f8cb006fe50 0x7f8cb015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.198+0000 7f8cb5f48640 1 -- 172.21.15.94:0/1039517405 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb015fa10 con 0x7f8cb015f1d0 2024-09-11T23:17:42.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb5f48640 1 --2- 172.21.15.94:0/1039517405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb015f1d0 0x7f8cb0071f10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8cb006de20 tx=0x7f8ca801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b1f4d801bf1a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8ca7fff640 1 -- 172.21.15.94:0/1039517405 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80a5590 con 0x7f8cb015f1d0 2024-09-11T23:17:42.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8ca7fff640 1 -- 172.21.15.94:0/1039517405 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca80a5730 con 0x7f8cb015f1d0 2024-09-11T23:17:42.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8ca7fff640 1 -- 172.21.15.94:0/1039517405 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80a5b00 con 0x7f8cb015f1d0 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 -- 172.21.15.94:0/1039517405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb015f1d0 msgr2=0x7f8cb0071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/1039517405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb015f1d0 0x7f8cb0071f10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8cb006de20 tx=0x7f8ca801c710 comp rx=0 tx=0).stop 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 -- 172.21.15.94:0/1039517405 shutdown_connections 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/1039517405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb015f1d0 0x7f8cb0071f10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/1039517405 >> v2:172.21.15.155:3300/0 conn(0x7f8cb006fe50 0x7f8cb015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/1039517405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb01520a0 0x7f8cb006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 -- 172.21.15.94:0/1039517405 >> 172.21.15.94:0/1039517405 conn(0x7f8cb00b1f90 msgr2=0x7f8cb00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 -- 172.21.15.94:0/1039517405 shutdown_connections 2024-09-11T23:17:42.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 -- 172.21.15.94:0/1039517405 wait complete. 2024-09-11T23:17:42.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 Processor -- start 2024-09-11T23:17:42.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.202+0000 7f8cb79ab640 1 -- start start 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb006fe50 0x7f8cb013f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb01520a0 0x7f8cb014c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb015f1d0 0x7f8cb01640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0073d30 con 0x7f8cb01520a0 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0073a50 con 0x7f8cb015f1d0 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb015f680 con 0x7f8cb006fe50 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb01520a0 0x7f8cb014c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb01520a0 0x7f8cb014c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34990/0 (socket says 172.21.15.94:34990) 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 -- 172.21.15.94:0/2526120722 learned_addr learned my addr 172.21.15.94:0/2526120722 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb5f48640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb015f1d0 0x7f8cb01640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb5747640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb006fe50 0x7f8cb013f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 -- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb006fe50 msgr2=0x7f8cb013f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb006fe50 0x7f8cb013f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 -- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb015f1d0 msgr2=0x7f8cb01640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb015f1d0 0x7f8cb01640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 -- 172.21.15.94:0/2526120722 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb006fc50 con 0x7f8cb01520a0 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb4f46640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb01520a0 0x7f8cb014c7c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00d5f0 tx=0x7f8cac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8ca5ffb640 1 -- 172.21.15.94:0/2526120722 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac004240 con 0x7f8cb01520a0 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8ca5ffb640 1 -- 172.21.15.94:0/2526120722 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac0043e0 con 0x7f8cb01520a0 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb0164a20 con 0x7f8cb01520a0 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8ca5ffb640 1 -- 172.21.15.94:0/2526120722 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac003620 con 0x7f8cb01520a0 2024-09-11T23:17:42.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb0164fe0 con 0x7f8cb01520a0 2024-09-11T23:17:42.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb015ec90 con 0x7f8cb01520a0 2024-09-11T23:17:42.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8ca5ffb640 1 -- 172.21.15.94:0/2526120722 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8cac01b020 con 0x7f8cb01520a0 2024-09-11T23:17:42.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8ca5ffb640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c940678c0 0x7f8c94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8ca5ffb640 1 -- 172.21.15.94:0/2526120722 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f8cac085b90 con 0x7f8cb01520a0 2024-09-11T23:17:42.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.206+0000 7f8cb5747640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c940678c0 0x7f8c94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.210+0000 7f8cb5747640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c940678c0 0x7f8c94069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8cb01facc0 tx=0x7f8ca0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.214+0000 7f8ca5ffb640 1 -- 172.21.15.94:0/2526120722 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8cac056540 con 0x7f8cb01520a0 2024-09-11T23:17:42.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.370+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cb006e540 con 0x7f8c940678c0 2024-09-11T23:17:42.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.386+0000 7f8ca5ffb640 1 -- 172.21.15.94:0/2526120722 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251987 (secure 0 0 0) 0x7f8cb006e540 con 0x7f8c940678c0 2024-09-11T23:17:42.390 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:42.392 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c940678c0 msgr2=0x7f8c94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c940678c0 0x7f8c94069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8cb01facc0 tx=0x7f8ca0008040 comp rx=0 tx=0).stop 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb01520a0 msgr2=0x7f8cb014c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb01520a0 0x7f8cb014c7c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00d5f0 tx=0x7f8cac00dab0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 shutdown_connections 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb015f1d0 0x7f8cb01640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c940678c0 0x7f8c94069d80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cb01520a0 0x7f8cb014c7c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 --2- 172.21.15.94:0/2526120722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb006fe50 0x7f8cb013f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 >> 172.21.15.94:0/2526120722 conn(0x7f8cb00b1f90 msgr2=0x7f8cb006f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 shutdown_connections 2024-09-11T23:17:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.390+0000 7f8cb79ab640 1 -- 172.21.15.94:0/2526120722 wait complete. 2024-09-11T23:17:42.409 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-11T23:17:42.016784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273276,"kb_used_data":7080,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754701444,"statfs":{"total":773094113280,"available":772814278656,"internally_reserved":0,"allocated":7249920,"data_stored":3891004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002642"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574338+0000","last_change":"2024-09-11T23:17:34.610626+0000","last_active":"2024-09-11T23:17:35.574338+0000","last_peered":"2024-09-11T23:17:35.574338+0000","last_clean":"2024-09-11T23:17:35.574338+0000","last_became_active":"2024-09-11T23:17:34.610292+0000","last_became_peered":"2024-09-11T23:17:34.610292+0000","last_unstale":"2024-09-11T23:17:35.574338+0000","last_undegraded":"2024-09-11T23:17:35.574338+0000","last_fullsized":"2024-09-11T23:17:35.574338+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.737918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573919+0000","last_change":"2024-09-11T23:17:34.598346+0000","last_active":"2024-09-11T23:17:35.573919+0000","last_peered":"2024-09-11T23:17:35.573919+0000","last_clean":"2024-09-11T23:17:35.573919+0000","last_became_active":"2024-09-11T23:17:34.597835+0000","last_became_peered":"2024-09-11T23:17:34.597835+0000","last_unstale":"2024-09-11T23:17:35.573919+0000","last_undegraded":"2024-09-11T23:17:35.573919+0000","last_fullsized":"2024-09-11T23:17:35.573919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581697+0000","last_change":"2024-09-11T23:17:34.639616+0000","last_active":"2024-09-11T23:17:35.581697+0000","last_peered":"2024-09-11T23:17:35.581697+0000","last_clean":"2024-09-11T23:17:35.581697+0000","last_became_active":"2024-09-11T23:17:34.639047+0000","last_became_peered":"2024-09-11T23:17:34.639047+0000","last_unstale":"2024-09-11T23:17:35.581697+0000","last_undegraded":"2024-09-11T23:17:35.581697+0000","last_fullsized":"2024-09-11T23:17:35.581697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:55.919028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778401+0000","last_change":"2024-09-11T23:17:34.601465+0000","last_active":"2024-09-11T23:17:35.778401+0000","last_peered":"2024-09-11T23:17:35.778401+0000","last_clean":"2024-09-11T23:17:35.778401+0000","last_became_active":"2024-09-11T23:17:34.600532+0000","last_became_peered":"2024-09-11T23:17:34.600532+0000","last_unstale":"2024-09-11T23:17:35.778401+0000","last_undegraded":"2024-09-11T23:17:35.778401+0000","last_fullsized":"2024-09-11T23:17:35.778401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835933+0000","last_change":"2024-09-11T23:17:34.624914+0000","last_active":"2024-09-11T23:17:35.835933+0000","last_peered":"2024-09-11T23:17:35.835933+0000","last_clean":"2024-09-11T23:17:35.835933+0000","last_became_active":"2024-09-11T23:17:34.623884+0000","last_became_peered":"2024-09-11T23:17:34.623884+0000","last_unstale":"2024-09-11T23:17:35.835933+0000","last_undegraded":"2024-09-11T23:17:35.835933+0000","last_fullsized":"2024-09-11T23:17:35.835933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:27.679699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805057+0000","last_change":"2024-09-11T23:17:34.634109+0000","last_active":"2024-09-11T23:17:35.805057+0000","last_peered":"2024-09-11T23:17:35.805057+0000","last_clean":"2024-09-11T23:17:35.805057+0000","last_became_active":"2024-09-11T23:17:34.633857+0000","last_became_peered":"2024-09-11T23:17:34.633857+0000","last_unstale":"2024-09-11T23:17:35.805057+0000","last_undegraded":"2024-09-11T23:17:35.805057+0000","last_fullsized":"2024-09-11T23:17:35.805057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:46.404163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835274+0000","last_change":"2024-09-11T23:17:34.614969+0000","last_active":"2024-09-11T23:17:35.835274+0000","last_peered":"2024-09-11T23:17:35.835274+0000","last_clean":"2024-09-11T23:17:35.835274+0000","last_became_active":"2024-09-11T23:17:34.614609+0000","last_became_peered":"2024-09-11T23:17:34.614609+0000","last_unstale":"2024-09-11T23:17:35.835274+0000","last_undegraded":"2024-09-11T23:17:35.835274+0000","last_fullsized":"2024-09-11T23:17:35.835274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:24.347228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.577901+0000","last_change":"2024-09-11T23:17:34.630620+0000","last_active":"2024-09-11T23:17:35.577901+0000","last_peered":"2024-09-11T23:17:35.577901+0000","last_clean":"2024-09-11T23:17:35.577901+0000","last_became_active":"2024-09-11T23:17:34.630078+0000","last_became_peered":"2024-09-11T23:17:34.630078+0000","last_unstale":"2024-09-11T23:17:35.577901+0000","last_undegraded":"2024-09-11T23:17:35.577901+0000","last_fullsized":"2024-09-11T23:17:35.577901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:52.631056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582238+0000","last_change":"2024-09-11T23:17:34.644282+0000","last_active":"2024-09-11T23:17:35.582238+0000","last_peered":"2024-09-11T23:17:35.582238+0000","last_clean":"2024-09-11T23:17:35.582238+0000","last_became_active":"2024-09-11T23:17:34.643881+0000","last_became_peered":"2024-09-11T23:17:34.643881+0000","last_unstale":"2024-09-11T23:17:35.582238+0000","last_undegraded":"2024-09-11T23:17:35.582238+0000","last_fullsized":"2024-09-11T23:17:35.582238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:01.314621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581683+0000","last_change":"2024-09-11T23:17:34.640010+0000","last_active":"2024-09-11T23:17:35.581683+0000","last_peered":"2024-09-11T23:17:35.581683+0000","last_clean":"2024-09-11T23:17:35.581683+0000","last_became_active":"2024-09-11T23:17:34.639510+0000","last_became_peered":"2024-09-11T23:17:34.639510+0000","last_unstale":"2024-09-11T23:17:35.581683+0000","last_undegraded":"2024-09-11T23:17:35.581683+0000","last_fullsized":"2024-09-11T23:17:35.581683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778144+0000","last_change":"2024-09-11T23:17:34.618630+0000","last_active":"2024-09-11T23:17:35.778144+0000","last_peered":"2024-09-11T23:17:35.778144+0000","last_clean":"2024-09-11T23:17:35.778144+0000","last_became_active":"2024-09-11T23:17:34.608228+0000","last_became_peered":"2024-09-11T23:17:34.608228+0000","last_unstale":"2024-09-11T23:17:35.778144+0000","last_undegraded":"2024-09-11T23:17:35.778144+0000","last_fullsized":"2024-09-11T23:17:35.778144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:53.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578819+0000","last_change":"2024-09-11T23:17:34.632597+0000","last_active":"2024-09-11T23:17:35.578819+0000","last_peered":"2024-09-11T23:17:35.578819+0000","last_clean":"2024-09-11T23:17:35.578819+0000","last_became_active":"2024-09-11T23:17:34.632015+0000","last_became_peered":"2024-09-11T23:17:34.632015+0000","last_unstale":"2024-09-11T23:17:35.578819+0000","last_undegraded":"2024-09-11T23:17:35.578819+0000","last_fullsized":"2024-09-11T23:17:35.578819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:55.919028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578297+0000","last_change":"2024-09-11T23:17:34.604297+0000","last_active":"2024-09-11T23:17:35.578297+0000","last_peered":"2024-09-11T23:17:35.578297+0000","last_clean":"2024-09-11T23:17:35.578297+0000","last_became_active":"2024-09-11T23:17:34.603548+0000","last_became_peered":"2024-09-11T23:17:34.603548+0000","last_unstale":"2024-09-11T23:17:35.578297+0000","last_undegraded":"2024-09-11T23:17:35.578297+0000","last_fullsized":"2024-09-11T23:17:35.578297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:21.417324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582034+0000","last_change":"2024-09-11T23:17:34.639859+0000","last_active":"2024-09-11T23:17:35.582034+0000","last_peered":"2024-09-11T23:17:35.582034+0000","last_clean":"2024-09-11T23:17:35.582034+0000","last_became_active":"2024-09-11T23:17:34.634911+0000","last_became_peered":"2024-09-11T23:17:34.634911+0000","last_unstale":"2024-09-11T23:17:35.582034+0000","last_undegraded":"2024-09-11T23:17:35.582034+0000","last_fullsized":"2024-09-11T23:17:35.582034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:37.152639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582111+0000","last_change":"2024-09-11T23:17:34.639618+0000","last_active":"2024-09-11T23:17:35.582111+0000","last_peered":"2024-09-11T23:17:35.582111+0000","last_clean":"2024-09-11T23:17:35.582111+0000","last_became_active":"2024-09-11T23:17:34.638865+0000","last_became_peered":"2024-09-11T23:17:34.638865+0000","last_unstale":"2024-09-11T23:17:35.582111+0000","last_undegraded":"2024-09-11T23:17:35.582111+0000","last_fullsized":"2024-09-11T23:17:35.582111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.144974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835776+0000","last_change":"2024-09-11T23:17:34.594655+0000","last_active":"2024-09-11T23:17:35.835776+0000","last_peered":"2024-09-11T23:17:35.835776+0000","last_clean":"2024-09-11T23:17:35.835776+0000","last_became_active":"2024-09-11T23:17:34.594178+0000","last_became_peered":"2024-09-11T23:17:34.594178+0000","last_unstale":"2024-09-11T23:17:35.835776+0000","last_undegraded":"2024-09-11T23:17:35.835776+0000","last_fullsized":"2024-09-11T23:17:35.835776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:39.763314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574434+0000","last_change":"2024-09-11T23:17:34.631438+0000","last_active":"2024-09-11T23:17:35.574434+0000","last_peered":"2024-09-11T23:17:35.574434+0000","last_clean":"2024-09-11T23:17:35.574434+0000","last_became_active":"2024-09-11T23:17:34.631153+0000","last_became_peered":"2024-09-11T23:17:34.631153+0000","last_unstale":"2024-09-11T23:17:35.574434+0000","last_undegraded":"2024-09-11T23:17:35.574434+0000","last_fullsized":"2024-09-11T23:17:35.574434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:52.631056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778229+0000","last_change":"2024-09-11T23:17:34.608071+0000","last_active":"2024-09-11T23:17:35.778229+0000","last_peered":"2024-09-11T23:17:35.778229+0000","last_clean":"2024-09-11T23:17:35.778229+0000","last_became_active":"2024-09-11T23:17:34.607234+0000","last_became_peered":"2024-09-11T23:17:34.607234+0000","last_unstale":"2024-09-11T23:17:35.778229+0000","last_undegraded":"2024-09-11T23:17:35.778229+0000","last_fullsized":"2024-09-11T23:17:35.778229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836532+0000","last_change":"2024-09-11T23:17:34.623285+0000","last_active":"2024-09-11T23:17:35.836532+0000","last_peered":"2024-09-11T23:17:35.836532+0000","last_clean":"2024-09-11T23:17:35.836532+0000","last_became_active":"2024-09-11T23:17:34.616906+0000","last_became_peered":"2024-09-11T23:17:34.616906+0000","last_unstale":"2024-09-11T23:17:35.836532+0000","last_undegraded":"2024-09-11T23:17:35.836532+0000","last_fullsized":"2024-09-11T23:17:35.836532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677292+0000","last_change":"2024-09-11T23:17:34.616201+0000","last_active":"2024-09-11T23:17:35.677292+0000","last_peered":"2024-09-11T23:17:35.677292+0000","last_clean":"2024-09-11T23:17:35.677292+0000","last_became_active":"2024-09-11T23:17:34.615857+0000","last_became_peered":"2024-09-11T23:17:34.615857+0000","last_unstale":"2024-09-11T23:17:35.677292+0000","last_undegraded":"2024-09-11T23:17:35.677292+0000","last_fullsized":"2024-09-11T23:17:35.677292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:48.219264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578949+0000","last_change":"2024-09-11T23:17:34.603353+0000","last_active":"2024-09-11T23:17:35.578949+0000","last_peered":"2024-09-11T23:17:35.578949+0000","last_clean":"2024-09-11T23:17:35.578949+0000","last_became_active":"2024-09-11T23:17:34.602564+0000","last_became_peered":"2024-09-11T23:17:34.602564+0000","last_unstale":"2024-09-11T23:17:35.578949+0000","last_undegraded":"2024-09-11T23:17:35.578949+0000","last_fullsized":"2024-09-11T23:17:35.578949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:24.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677377+0000","last_change":"2024-09-11T23:17:34.627921+0000","last_active":"2024-09-11T23:17:35.677377+0000","last_peered":"2024-09-11T23:17:35.677377+0000","last_clean":"2024-09-11T23:17:35.677377+0000","last_became_active":"2024-09-11T23:17:34.627609+0000","last_became_peered":"2024-09-11T23:17:34.627609+0000","last_unstale":"2024-09-11T23:17:35.677377+0000","last_undegraded":"2024-09-11T23:17:35.677377+0000","last_fullsized":"2024-09-11T23:17:35.677377+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:07.851836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677119+0000","last_change":"2024-09-11T23:17:34.613694+0000","last_active":"2024-09-11T23:17:35.677119+0000","last_peered":"2024-09-11T23:17:35.677119+0000","last_clean":"2024-09-11T23:17:35.677119+0000","last_became_active":"2024-09-11T23:17:34.613455+0000","last_became_peered":"2024-09-11T23:17:34.613455+0000","last_unstale":"2024-09-11T23:17:35.677119+0000","last_undegraded":"2024-09-11T23:17:35.677119+0000","last_fullsized":"2024-09-11T23:17:35.677119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:51.163893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581047+0000","last_change":"2024-09-11T23:17:34.642971+0000","last_active":"2024-09-11T23:17:35.581047+0000","last_peered":"2024-09-11T23:17:35.581047+0000","last_clean":"2024-09-11T23:17:35.581047+0000","last_became_active":"2024-09-11T23:17:34.635154+0000","last_became_peered":"2024-09-11T23:17:34.635154+0000","last_unstale":"2024-09-11T23:17:35.581047+0000","last_undegraded":"2024-09-11T23:17:35.581047+0000","last_fullsized":"2024-09-11T23:17:35.581047+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579164+0000","last_change":"2024-09-11T23:17:34.590339+0000","last_active":"2024-09-11T23:17:35.579164+0000","last_peered":"2024-09-11T23:17:35.579164+0000","last_clean":"2024-09-11T23:17:35.579164+0000","last_became_active":"2024-09-11T23:17:34.587717+0000","last_became_peered":"2024-09-11T23:17:34.587717+0000","last_unstale":"2024-09-11T23:17:35.579164+0000","last_undegraded":"2024-09-11T23:17:35.579164+0000","last_fullsized":"2024-09-11T23:17:35.579164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:37.152639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579884+0000","last_change":"2024-09-11T23:17:34.591092+0000","last_active":"2024-09-11T23:17:35.579884+0000","last_peered":"2024-09-11T23:17:35.579884+0000","last_clean":"2024-09-11T23:17:35.579884+0000","last_became_active":"2024-09-11T23:17:34.588315+0000","last_became_peered":"2024-09-11T23:17:34.588315+0000","last_unstale":"2024-09-11T23:17:35.579884+0000","last_undegraded":"2024-09-11T23:17:35.579884+0000","last_fullsized":"2024-09-11T23:17:35.579884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.144974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778333+0000","last_change":"2024-09-11T23:17:34.618277+0000","last_active":"2024-09-11T23:17:35.778333+0000","last_peered":"2024-09-11T23:17:35.778333+0000","last_clean":"2024-09-11T23:17:35.778333+0000","last_became_active":"2024-09-11T23:17:34.599936+0000","last_became_peered":"2024-09-11T23:17:34.599936+0000","last_unstale":"2024-09-11T23:17:35.778333+0000","last_undegraded":"2024-09-11T23:17:35.778333+0000","last_fullsized":"2024-09-11T23:17:35.778333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:27.679699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573423+0000","last_change":"2024-09-11T23:17:34.625949+0000","last_active":"2024-09-11T23:17:35.573423+0000","last_peered":"2024-09-11T23:17:35.573423+0000","last_clean":"2024-09-11T23:17:35.573423+0000","last_became_active":"2024-09-11T23:17:34.625727+0000","last_became_peered":"2024-09-11T23:17:34.625727+0000","last_unstale":"2024-09-11T23:17:35.573423+0000","last_undegraded":"2024-09-11T23:17:35.573423+0000","last_fullsized":"2024-09-11T23:17:35.573423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:26.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582293+0000","last_change":"2024-09-11T23:17:34.644062+0000","last_active":"2024-09-11T23:17:35.582293+0000","last_peered":"2024-09-11T23:17:35.582293+0000","last_clean":"2024-09-11T23:17:35.582293+0000","last_became_active":"2024-09-11T23:17:34.643628+0000","last_became_peered":"2024-09-11T23:17:34.643628+0000","last_unstale":"2024-09-11T23:17:35.582293+0000","last_undegraded":"2024-09-11T23:17:35.582293+0000","last_fullsized":"2024-09-11T23:17:35.582293+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:29.478638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578297+0000","last_change":"2024-09-11T23:17:34.632613+0000","last_active":"2024-09-11T23:17:35.578297+0000","last_peered":"2024-09-11T23:17:35.578297+0000","last_clean":"2024-09-11T23:17:35.578297+0000","last_became_active":"2024-09-11T23:17:34.631898+0000","last_became_peered":"2024-09-11T23:17:34.631898+0000","last_unstale":"2024-09-11T23:17:35.578297+0000","last_undegraded":"2024-09-11T23:17:35.578297+0000","last_fullsized":"2024-09-11T23:17:35.578297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777491+0000","last_change":"2024-09-11T23:17:34.601241+0000","last_active":"2024-09-11T23:17:35.777491+0000","last_peered":"2024-09-11T23:17:35.777491+0000","last_clean":"2024-09-11T23:17:35.777491+0000","last_became_active":"2024-09-11T23:17:34.600433+0000","last_became_peered":"2024-09-11T23:17:34.600433+0000","last_unstale":"2024-09-11T23:17:35.777491+0000","last_undegraded":"2024-09-11T23:17:35.777491+0000","last_fullsized":"2024-09-11T23:17:35.777491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:20.681186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804668+0000","last_change":"2024-09-11T23:17:34.581058+0000","last_active":"2024-09-11T23:17:35.804668+0000","last_peered":"2024-09-11T23:17:35.804668+0000","last_clean":"2024-09-11T23:17:35.804668+0000","last_became_active":"2024-09-11T23:17:34.580717+0000","last_became_peered":"2024-09-11T23:17:34.580717+0000","last_unstale":"2024-09-11T23:17:35.804668+0000","last_undegraded":"2024-09-11T23:17:35.804668+0000","last_fullsized":"2024-09-11T23:17:35.804668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:33.507282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836415+0000","last_change":"2024-09-11T23:17:34.616624+0000","last_active":"2024-09-11T23:17:35.836415+0000","last_peered":"2024-09-11T23:17:35.836415+0000","last_clean":"2024-09-11T23:17:35.836415+0000","last_became_active":"2024-09-11T23:17:34.615847+0000","last_became_peered":"2024-09-11T23:17:34.615847+0000","last_unstale":"2024-09-11T23:17:35.836415+0000","last_undegraded":"2024-09-11T23:17:35.836415+0000","last_fullsized":"2024-09-11T23:17:35.836415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:54.006933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574618+0000","last_change":"2024-09-11T23:17:33.601698+0000","last_active":"2024-09-11T23:17:35.574618+0000","last_peered":"2024-09-11T23:17:35.574618+0000","last_clean":"2024-09-11T23:17:35.574618+0000","last_became_active":"2024-09-11T23:17:33.601480+0000","last_became_peered":"2024-09-11T23:17:33.601480+0000","last_unstale":"2024-09-11T23:17:35.574618+0000","last_undegraded":"2024-09-11T23:17:35.574618+0000","last_fullsized":"2024-09-11T23:17:35.574618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:29.115868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778511+0000","last_change":"2024-09-11T23:17:34.621266+0000","last_active":"2024-09-11T23:17:35.778511+0000","last_peered":"2024-09-11T23:17:35.778511+0000","last_clean":"2024-09-11T23:17:35.778511+0000","last_became_active":"2024-09-11T23:17:34.619431+0000","last_became_peered":"2024-09-11T23:17:34.619431+0000","last_unstale":"2024-09-11T23:17:35.778511+0000","last_undegraded":"2024-09-11T23:17:35.778511+0000","last_fullsized":"2024-09-11T23:17:35.778511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.843183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805483+0000","last_change":"2024-09-11T23:17:33.609107+0000","last_active":"2024-09-11T23:17:35.805483+0000","last_peered":"2024-09-11T23:17:35.805483+0000","last_clean":"2024-09-11T23:17:35.805483+0000","last_became_active":"2024-09-11T23:17:33.608856+0000","last_became_peered":"2024-09-11T23:17:33.608856+0000","last_unstale":"2024-09-11T23:17:35.805483+0000","last_undegraded":"2024-09-11T23:17:35.805483+0000","last_fullsized":"2024-09-11T23:17:35.805483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:36.142432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805439+0000","last_change":"2024-09-11T23:17:34.587167+0000","last_active":"2024-09-11T23:17:35.805439+0000","last_peered":"2024-09-11T23:17:35.805439+0000","last_clean":"2024-09-11T23:17:35.805439+0000","last_became_active":"2024-09-11T23:17:34.586697+0000","last_became_peered":"2024-09-11T23:17:34.586697+0000","last_unstale":"2024-09-11T23:17:35.805439+0000","last_undegraded":"2024-09-11T23:17:35.805439+0000","last_fullsized":"2024-09-11T23:17:35.805439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:47.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805116+0000","last_change":"2024-09-11T23:17:33.604047+0000","last_active":"2024-09-11T23:17:35.805116+0000","last_peered":"2024-09-11T23:17:35.805116+0000","last_clean":"2024-09-11T23:17:35.805116+0000","last_became_active":"2024-09-11T23:17:33.603390+0000","last_became_peered":"2024-09-11T23:17:33.603390+0000","last_unstale":"2024-09-11T23:17:35.805116+0000","last_undegraded":"2024-09-11T23:17:35.805116+0000","last_fullsized":"2024-09-11T23:17:35.805116+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:23.848101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581943+0000","last_change":"2024-09-11T23:17:34.639148+0000","last_active":"2024-09-11T23:17:35.581943+0000","last_peered":"2024-09-11T23:17:35.581943+0000","last_clean":"2024-09-11T23:17:35.581943+0000","last_became_active":"2024-09-11T23:17:34.638637+0000","last_became_peered":"2024-09-11T23:17:34.638637+0000","last_unstale":"2024-09-11T23:17:35.581943+0000","last_undegraded":"2024-09-11T23:17:35.581943+0000","last_fullsized":"2024-09-11T23:17:35.581943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:24.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805198+0000","last_change":"2024-09-11T23:17:33.582839+0000","last_active":"2024-09-11T23:17:35.805198+0000","last_peered":"2024-09-11T23:17:35.805198+0000","last_clean":"2024-09-11T23:17:35.805198+0000","last_became_active":"2024-09-11T23:17:33.582485+0000","last_became_peered":"2024-09-11T23:17:33.582485+0000","last_unstale":"2024-09-11T23:17:35.805198+0000","last_undegraded":"2024-09-11T23:17:35.805198+0000","last_fullsized":"2024-09-11T23:17:35.805198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:42.802430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835596+0000","last_change":"2024-09-11T23:17:34.600717+0000","last_active":"2024-09-11T23:17:35.835596+0000","last_peered":"2024-09-11T23:17:35.835596+0000","last_clean":"2024-09-11T23:17:35.835596+0000","last_became_active":"2024-09-11T23:17:34.600234+0000","last_became_peered":"2024-09-11T23:17:34.600234+0000","last_unstale":"2024-09-11T23:17:35.835596+0000","last_undegraded":"2024-09-11T23:17:35.835596+0000","last_fullsized":"2024-09-11T23:17:35.835596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:46.484269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677281+0000","last_change":"2024-09-11T23:17:33.581416+0000","last_active":"2024-09-11T23:17:35.677281+0000","last_peered":"2024-09-11T23:17:35.677281+0000","last_clean":"2024-09-11T23:17:35.677281+0000","last_became_active":"2024-09-11T23:17:33.581153+0000","last_became_peered":"2024-09-11T23:17:33.581153+0000","last_unstale":"2024-09-11T23:17:35.677281+0000","last_undegraded":"2024-09-11T23:17:35.677281+0000","last_fullsized":"2024-09-11T23:17:35.677281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:00.304414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573499+0000","last_change":"2024-09-11T23:17:34.607397+0000","last_active":"2024-09-11T23:17:35.573499+0000","last_peered":"2024-09-11T23:17:35.573499+0000","last_clean":"2024-09-11T23:17:35.573499+0000","last_became_active":"2024-09-11T23:17:34.607117+0000","last_became_peered":"2024-09-11T23:17:34.607117+0000","last_unstale":"2024-09-11T23:17:35.573499+0000","last_undegraded":"2024-09-11T23:17:35.573499+0000","last_fullsized":"2024-09-11T23:17:35.573499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677061+0000","last_change":"2024-09-11T23:17:33.580760+0000","last_active":"2024-09-11T23:17:35.677061+0000","last_peered":"2024-09-11T23:17:35.677061+0000","last_clean":"2024-09-11T23:17:35.677061+0000","last_became_active":"2024-09-11T23:17:33.580479+0000","last_became_peered":"2024-09-11T23:17:33.580479+0000","last_unstale":"2024-09-11T23:17:35.677061+0000","last_undegraded":"2024-09-11T23:17:35.677061+0000","last_fullsized":"2024-09-11T23:17:35.677061+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:45.371483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835979+0000","last_change":"2024-09-11T23:17:34.615898+0000","last_active":"2024-09-11T23:17:35.835979+0000","last_peered":"2024-09-11T23:17:35.835979+0000","last_clean":"2024-09-11T23:17:35.835979+0000","last_became_active":"2024-09-11T23:17:34.615084+0000","last_became_peered":"2024-09-11T23:17:34.615084+0000","last_unstale":"2024-09-11T23:17:35.835979+0000","last_undegraded":"2024-09-11T23:17:35.835979+0000","last_fullsized":"2024-09-11T23:17:35.835979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677057+0000","last_change":"2024-09-11T23:17:33.596770+0000","last_active":"2024-09-11T23:17:35.677057+0000","last_peered":"2024-09-11T23:17:35.677057+0000","last_clean":"2024-09-11T23:17:35.677057+0000","last_became_active":"2024-09-11T23:17:33.596421+0000","last_became_peered":"2024-09-11T23:17:33.596421+0000","last_unstale":"2024-09-11T23:17:35.677057+0000","last_undegraded":"2024-09-11T23:17:35.677057+0000","last_fullsized":"2024-09-11T23:17:35.677057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:36.142432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677308+0000","last_change":"2024-09-11T23:17:34.600319+0000","last_active":"2024-09-11T23:17:35.677308+0000","last_peered":"2024-09-11T23:17:35.677308+0000","last_clean":"2024-09-11T23:17:35.677308+0000","last_became_active":"2024-09-11T23:17:34.600022+0000","last_became_peered":"2024-09-11T23:17:34.600022+0000","last_unstale":"2024-09-11T23:17:35.677308+0000","last_undegraded":"2024-09-11T23:17:35.677308+0000","last_fullsized":"2024-09-11T23:17:35.677308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:35.014823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835790+0000","last_change":"2024-09-11T23:17:33.605702+0000","last_active":"2024-09-11T23:17:35.835790+0000","last_peered":"2024-09-11T23:17:35.835790+0000","last_clean":"2024-09-11T23:17:35.835790+0000","last_became_active":"2024-09-11T23:17:33.602583+0000","last_became_peered":"2024-09-11T23:17:33.602583+0000","last_unstale":"2024-09-11T23:17:35.835790+0000","last_undegraded":"2024-09-11T23:17:35.835790+0000","last_fullsized":"2024-09-11T23:17:35.835790+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:01.331655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573512+0000","last_change":"2024-09-11T23:17:34.598065+0000","last_active":"2024-09-11T23:17:35.573512+0000","last_peered":"2024-09-11T23:17:35.573512+0000","last_clean":"2024-09-11T23:17:35.573512+0000","last_became_active":"2024-09-11T23:17:34.597749+0000","last_became_peered":"2024-09-11T23:17:34.597749+0000","last_unstale":"2024-09-11T23:17:35.573512+0000","last_undegraded":"2024-09-11T23:17:35.573512+0000","last_fullsized":"2024-09-11T23:17:35.573512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.496612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582485+0000","last_change":"2024-09-11T23:17:33.613985+0000","last_active":"2024-09-11T23:17:35.582485+0000","last_peered":"2024-09-11T23:17:35.582485+0000","last_clean":"2024-09-11T23:17:35.582485+0000","last_became_active":"2024-09-11T23:17:33.607571+0000","last_became_peered":"2024-09-11T23:17:33.607571+0000","last_unstale":"2024-09-11T23:17:35.582485+0000","last_undegraded":"2024-09-11T23:17:35.582485+0000","last_fullsized":"2024-09-11T23:17:35.582485+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:52.996726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677282+0000","last_change":"2024-09-11T23:17:34.610229+0000","last_active":"2024-09-11T23:17:35.677282+0000","last_peered":"2024-09-11T23:17:35.677282+0000","last_clean":"2024-09-11T23:17:35.677282+0000","last_became_active":"2024-09-11T23:17:34.609894+0000","last_became_peered":"2024-09-11T23:17:34.609894+0000","last_unstale":"2024-09-11T23:17:35.677282+0000","last_undegraded":"2024-09-11T23:17:35.677282+0000","last_fullsized":"2024-09-11T23:17:35.677282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:47.400476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778471+0000","last_change":"2024-09-11T23:17:33.594110+0000","last_active":"2024-09-11T23:17:35.778471+0000","last_peered":"2024-09-11T23:17:35.778471+0000","last_clean":"2024-09-11T23:17:35.778471+0000","last_became_active":"2024-09-11T23:17:33.593398+0000","last_became_peered":"2024-09-11T23:17:33.593398+0000","last_unstale":"2024-09-11T23:17:35.778471+0000","last_undegraded":"2024-09-11T23:17:35.778471+0000","last_fullsized":"2024-09-11T23:17:35.778471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:37.898983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836472+0000","last_change":"2024-09-11T23:17:34.624554+0000","last_active":"2024-09-11T23:17:35.836472+0000","last_peered":"2024-09-11T23:17:35.836472+0000","last_clean":"2024-09-11T23:17:35.836472+0000","last_became_active":"2024-09-11T23:17:34.623795+0000","last_became_peered":"2024-09-11T23:17:34.623795+0000","last_unstale":"2024-09-11T23:17:35.836472+0000","last_undegraded":"2024-09-11T23:17:35.836472+0000","last_fullsized":"2024-09-11T23:17:35.836472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:26.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581987+0000","last_change":"2024-09-11T23:17:33.607951+0000","last_active":"2024-09-11T23:17:35.581987+0000","last_peered":"2024-09-11T23:17:35.581987+0000","last_clean":"2024-09-11T23:17:35.581987+0000","last_became_active":"2024-09-11T23:17:33.607176+0000","last_became_peered":"2024-09-11T23:17:33.607176+0000","last_unstale":"2024-09-11T23:17:35.581987+0000","last_undegraded":"2024-09-11T23:17:35.581987+0000","last_fullsized":"2024-09-11T23:17:35.581987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.669492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778738+0000","last_change":"2024-09-11T23:17:34.601023+0000","last_active":"2024-09-11T23:17:35.778738+0000","last_peered":"2024-09-11T23:17:35.778738+0000","last_clean":"2024-09-11T23:17:35.778738+0000","last_became_active":"2024-09-11T23:17:34.600249+0000","last_became_peered":"2024-09-11T23:17:34.600249+0000","last_unstale":"2024-09-11T23:17:35.778738+0000","last_undegraded":"2024-09-11T23:17:35.778738+0000","last_fullsized":"2024-09-11T23:17:35.778738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:17.406523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573486+0000","last_change":"2024-09-11T23:17:33.610912+0000","last_active":"2024-09-11T23:17:35.573486+0000","last_peered":"2024-09-11T23:17:35.573486+0000","last_clean":"2024-09-11T23:17:35.573486+0000","last_became_active":"2024-09-11T23:17:33.610648+0000","last_became_peered":"2024-09-11T23:17:33.610648+0000","last_unstale":"2024-09-11T23:17:35.573486+0000","last_undegraded":"2024-09-11T23:17:35.573486+0000","last_fullsized":"2024-09-11T23:17:35.573486+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:19.670978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777462+0000","last_change":"2024-09-11T23:17:34.630989+0000","last_active":"2024-09-11T23:17:35.777462+0000","last_peered":"2024-09-11T23:17:35.777462+0000","last_clean":"2024-09-11T23:17:35.777462+0000","last_became_active":"2024-09-11T23:17:34.629103+0000","last_became_peered":"2024-09-11T23:17:34.629103+0000","last_unstale":"2024-09-11T23:17:35.777462+0000","last_undegraded":"2024-09-11T23:17:35.777462+0000","last_fullsized":"2024-09-11T23:17:35.777462+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:30.126075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582318+0000","last_change":"2024-09-11T23:17:33.608707+0000","last_active":"2024-09-11T23:17:35.582318+0000","last_peered":"2024-09-11T23:17:35.582318+0000","last_clean":"2024-09-11T23:17:35.582318+0000","last_became_active":"2024-09-11T23:17:33.607484+0000","last_became_peered":"2024-09-11T23:17:33.607484+0000","last_unstale":"2024-09-11T23:17:35.582318+0000","last_undegraded":"2024-09-11T23:17:35.582318+0000","last_fullsized":"2024-09-11T23:17:35.582318+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:13.843316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.577924+0000","last_change":"2024-09-11T23:17:34.592872+0000","last_active":"2024-09-11T23:17:35.577924+0000","last_peered":"2024-09-11T23:17:35.577924+0000","last_clean":"2024-09-11T23:17:35.577924+0000","last_became_active":"2024-09-11T23:17:34.592173+0000","last_became_peered":"2024-09-11T23:17:34.592173+0000","last_unstale":"2024-09-11T23:17:35.577924+0000","last_undegraded":"2024-09-11T23:17:35.577924+0000","last_fullsized":"2024-09-11T23:17:35.577924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:03.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578590+0000","last_change":"2024-09-11T23:17:33.609687+0000","last_active":"2024-09-11T23:17:35.578590+0000","last_peered":"2024-09-11T23:17:35.578590+0000","last_clean":"2024-09-11T23:17:35.578590+0000","last_became_active":"2024-09-11T23:17:33.604476+0000","last_became_peered":"2024-09-11T23:17:33.604476+0000","last_unstale":"2024-09-11T23:17:35.578590+0000","last_undegraded":"2024-09-11T23:17:35.578590+0000","last_fullsized":"2024-09-11T23:17:35.578590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:52.900370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835910+0000","last_change":"2024-09-11T23:17:34.606320+0000","last_active":"2024-09-11T23:17:35.835910+0000","last_peered":"2024-09-11T23:17:35.835910+0000","last_clean":"2024-09-11T23:17:35.835910+0000","last_became_active":"2024-09-11T23:17:34.605573+0000","last_became_peered":"2024-09-11T23:17:34.605573+0000","last_unstale":"2024-09-11T23:17:35.835910+0000","last_undegraded":"2024-09-11T23:17:35.835910+0000","last_fullsized":"2024-09-11T23:17:35.835910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581380+0000","last_change":"2024-09-11T23:17:33.601596+0000","last_active":"2024-09-11T23:17:35.581380+0000","last_peered":"2024-09-11T23:17:35.581380+0000","last_clean":"2024-09-11T23:17:35.581380+0000","last_became_active":"2024-09-11T23:17:33.600439+0000","last_became_peered":"2024-09-11T23:17:33.600439+0000","last_unstale":"2024-09-11T23:17:35.581380+0000","last_undegraded":"2024-09-11T23:17:35.581380+0000","last_fullsized":"2024-09-11T23:17:35.581380+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:32.832975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.574435+0000","last_change":"2024-09-11T23:17:34.613739+0000","last_active":"2024-09-11T23:17:35.574435+0000","last_peered":"2024-09-11T23:17:35.574435+0000","last_clean":"2024-09-11T23:17:35.574435+0000","last_became_active":"2024-09-11T23:17:34.613519+0000","last_became_peered":"2024-09-11T23:17:34.613519+0000","last_unstale":"2024-09-11T23:17:35.574435+0000","last_undegraded":"2024-09-11T23:17:35.574435+0000","last_fullsized":"2024-09-11T23:17:35.574435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:03.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777350+0000","last_change":"2024-09-11T23:17:33.610938+0000","last_active":"2024-09-11T23:17:35.777350+0000","last_peered":"2024-09-11T23:17:35.777350+0000","last_clean":"2024-09-11T23:17:35.777350+0000","last_became_active":"2024-09-11T23:17:33.609912+0000","last_became_peered":"2024-09-11T23:17:33.609912+0000","last_unstale":"2024-09-11T23:17:35.777350+0000","last_undegraded":"2024-09-11T23:17:35.777350+0000","last_fullsized":"2024-09-11T23:17:35.777350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:52.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581619+0000","last_change":"2024-09-11T23:17:34.642677+0000","last_active":"2024-09-11T23:17:35.581619+0000","last_peered":"2024-09-11T23:17:35.581619+0000","last_clean":"2024-09-11T23:17:35.581619+0000","last_became_active":"2024-09-11T23:17:34.639640+0000","last_became_peered":"2024-09-11T23:17:34.639640+0000","last_unstale":"2024-09-11T23:17:35.581619+0000","last_undegraded":"2024-09-11T23:17:35.581619+0000","last_fullsized":"2024-09-11T23:17:35.581619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:21.417324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579349+0000","last_change":"2024-09-11T23:17:33.597492+0000","last_active":"2024-09-11T23:17:35.579349+0000","last_peered":"2024-09-11T23:17:35.579349+0000","last_clean":"2024-09-11T23:17:35.579349+0000","last_became_active":"2024-09-11T23:17:33.596742+0000","last_became_peered":"2024-09-11T23:17:33.596742+0000","last_unstale":"2024-09-11T23:17:35.579349+0000","last_undegraded":"2024-09-11T23:17:35.579349+0000","last_fullsized":"2024-09-11T23:17:35.579349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.396316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836627+0000","last_change":"2024-09-11T23:17:34.625162+0000","last_active":"2024-09-11T23:17:35.836627+0000","last_peered":"2024-09-11T23:17:35.836627+0000","last_clean":"2024-09-11T23:17:35.836627+0000","last_became_active":"2024-09-11T23:17:34.624277+0000","last_became_peered":"2024-09-11T23:17:34.624277+0000","last_unstale":"2024-09-11T23:17:35.836627+0000","last_undegraded":"2024-09-11T23:17:35.836627+0000","last_fullsized":"2024-09-11T23:17:35.836627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.496612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581923+0000","last_change":"2024-09-11T23:17:33.615817+0000","last_active":"2024-09-11T23:17:35.581923+0000","last_peered":"2024-09-11T23:17:35.581923+0000","last_clean":"2024-09-11T23:17:35.581923+0000","last_became_active":"2024-09-11T23:17:33.614982+0000","last_became_peered":"2024-09-11T23:17:33.614982+0000","last_unstale":"2024-09-11T23:17:35.581923+0000","last_undegraded":"2024-09-11T23:17:35.581923+0000","last_fullsized":"2024-09-11T23:17:35.581923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:37.305117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.778498+0000","last_change":"2024-09-11T23:17:34.626238+0000","last_active":"2024-09-11T23:17:35.778498+0000","last_peered":"2024-09-11T23:17:35.778498+0000","last_clean":"2024-09-11T23:17:35.778498+0000","last_became_active":"2024-09-11T23:17:34.620763+0000","last_became_peered":"2024-09-11T23:17:34.620763+0000","last_unstale":"2024-09-11T23:17:35.778498+0000","last_undegraded":"2024-09-11T23:17:35.778498+0000","last_fullsized":"2024-09-11T23:17:35.778498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:14.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581675+0000","last_change":"2024-09-11T23:17:33.607778+0000","last_active":"2024-09-11T23:17:35.581675+0000","last_peered":"2024-09-11T23:17:35.581675+0000","last_clean":"2024-09-11T23:17:35.581675+0000","last_became_active":"2024-09-11T23:17:33.607009+0000","last_became_peered":"2024-09-11T23:17:33.607009+0000","last_unstale":"2024-09-11T23:17:35.581675+0000","last_undegraded":"2024-09-11T23:17:35.581675+0000","last_fullsized":"2024-09-11T23:17:35.581675+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:05.140612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836260+0000","last_change":"2024-09-11T23:17:34.625821+0000","last_active":"2024-09-11T23:17:35.836260+0000","last_peered":"2024-09-11T23:17:35.836260+0000","last_clean":"2024-09-11T23:17:35.836260+0000","last_became_active":"2024-09-11T23:17:34.617004+0000","last_became_peered":"2024-09-11T23:17:34.617004+0000","last_unstale":"2024-09-11T23:17:35.836260+0000","last_undegraded":"2024-09-11T23:17:35.836260+0000","last_fullsized":"2024-09-11T23:17:35.836260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.843183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677325+0000","last_change":"2024-09-11T23:17:33.597454+0000","last_active":"2024-09-11T23:17:35.677325+0000","last_peered":"2024-09-11T23:17:35.677325+0000","last_clean":"2024-09-11T23:17:35.677325+0000","last_became_active":"2024-09-11T23:17:33.596782+0000","last_became_peered":"2024-09-11T23:17:33.596782+0000","last_unstale":"2024-09-11T23:17:35.677325+0000","last_undegraded":"2024-09-11T23:17:35.677325+0000","last_fullsized":"2024-09-11T23:17:35.677325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:28.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804801+0000","last_change":"2024-09-11T23:17:34.581389+0000","last_active":"2024-09-11T23:17:35.804801+0000","last_peered":"2024-09-11T23:17:35.804801+0000","last_clean":"2024-09-11T23:17:35.804801+0000","last_became_active":"2024-09-11T23:17:34.581081+0000","last_became_peered":"2024-09-11T23:17:34.581081+0000","last_unstale":"2024-09-11T23:17:35.804801+0000","last_undegraded":"2024-09-11T23:17:35.804801+0000","last_fullsized":"2024-09-11T23:17:35.804801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:53.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804713+0000","last_change":"2024-09-11T23:17:33.592826+0000","last_active":"2024-09-11T23:17:35.804713+0000","last_peered":"2024-09-11T23:17:35.804713+0000","last_clean":"2024-09-11T23:17:35.804713+0000","last_became_active":"2024-09-11T23:17:33.592527+0000","last_became_peered":"2024-09-11T23:17:33.592527+0000","last_unstale":"2024-09-11T23:17:35.804713+0000","last_undegraded":"2024-09-11T23:17:35.804713+0000","last_fullsized":"2024-09-11T23:17:35.804713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:20.407117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578037+0000","last_change":"2024-09-11T23:17:34.609138+0000","last_active":"2024-09-11T23:17:35.578037+0000","last_peered":"2024-09-11T23:17:35.578037+0000","last_clean":"2024-09-11T23:17:35.578037+0000","last_became_active":"2024-09-11T23:17:34.608321+0000","last_became_peered":"2024-09-11T23:17:34.608321+0000","last_unstale":"2024-09-11T23:17:35.578037+0000","last_undegraded":"2024-09-11T23:17:35.578037+0000","last_fullsized":"2024-09-11T23:17:35.578037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.578847+0000","last_change":"2024-09-11T23:17:33.597388+0000","last_active":"2024-09-11T23:17:35.578847+0000","last_peered":"2024-09-11T23:17:35.578847+0000","last_clean":"2024-09-11T23:17:35.578847+0000","last_became_active":"2024-09-11T23:17:33.596633+0000","last_became_peered":"2024-09-11T23:17:33.596633+0000","last_unstale":"2024-09-11T23:17:35.578847+0000","last_undegraded":"2024-09-11T23:17:35.578847+0000","last_fullsized":"2024-09-11T23:17:35.578847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:05.140612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836408+0000","last_change":"2024-09-11T23:17:34.606167+0000","last_active":"2024-09-11T23:17:35.836408+0000","last_peered":"2024-09-11T23:17:35.836408+0000","last_clean":"2024-09-11T23:17:35.836408+0000","last_became_active":"2024-09-11T23:17:34.605453+0000","last_became_peered":"2024-09-11T23:17:34.605453+0000","last_unstale":"2024-09-11T23:17:35.836408+0000","last_undegraded":"2024-09-11T23:17:35.836408+0000","last_fullsized":"2024-09-11T23:17:35.836408+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:17.406523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.804404+0000","last_change":"2024-09-11T23:17:33.600865+0000","last_active":"2024-09-11T23:17:35.804404+0000","last_peered":"2024-09-11T23:17:35.804404+0000","last_clean":"2024-09-11T23:17:35.804404+0000","last_became_active":"2024-09-11T23:17:33.600415+0000","last_became_peered":"2024-09-11T23:17:33.600415+0000","last_unstale":"2024-09-11T23:17:35.804404+0000","last_undegraded":"2024-09-11T23:17:35.804404+0000","last_fullsized":"2024-09-11T23:17:35.804404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:23.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805160+0000","last_change":"2024-09-11T23:17:34.618628+0000","last_active":"2024-09-11T23:17:35.805160+0000","last_peered":"2024-09-11T23:17:35.805160+0000","last_clean":"2024-09-11T23:17:35.805160+0000","last_became_active":"2024-09-11T23:17:34.618379+0000","last_became_peered":"2024-09-11T23:17:34.618379+0000","last_unstale":"2024-09-11T23:17:35.805160+0000","last_undegraded":"2024-09-11T23:17:35.805160+0000","last_fullsized":"2024-09-11T23:17:35.805160+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:06.102547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579770+0000","last_change":"2024-09-11T23:17:33.604801+0000","last_active":"2024-09-11T23:17:35.579770+0000","last_peered":"2024-09-11T23:17:35.579770+0000","last_clean":"2024-09-11T23:17:35.579770+0000","last_became_active":"2024-09-11T23:17:33.604091+0000","last_became_peered":"2024-09-11T23:17:33.604091+0000","last_unstale":"2024-09-11T23:17:35.579770+0000","last_undegraded":"2024-09-11T23:17:35.579770+0000","last_fullsized":"2024-09-11T23:17:35.579770+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:37.305117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835969+0000","last_change":"2024-09-11T23:17:34.584055+0000","last_active":"2024-09-11T23:17:35.835969+0000","last_peered":"2024-09-11T23:17:35.835969+0000","last_clean":"2024-09-11T23:17:35.835969+0000","last_became_active":"2024-09-11T23:17:34.583725+0000","last_became_peered":"2024-09-11T23:17:34.583725+0000","last_unstale":"2024-09-11T23:17:35.835969+0000","last_undegraded":"2024-09-11T23:17:35.835969+0000","last_fullsized":"2024-09-11T23:17:35.835969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:42.803431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:36.577286+0000","last_change":"2024-09-11T23:17:33.604201+0000","last_active":"2024-09-11T23:17:36.577286+0000","last_peered":"2024-09-11T23:17:36.577286+0000","last_clean":"2024-09-11T23:17:36.577286+0000","last_became_active":"2024-09-11T23:17:33.602885+0000","last_became_peered":"2024-09-11T23:17:33.602885+0000","last_unstale":"2024-09-11T23:17:36.577286+0000","last_undegraded":"2024-09-11T23:17:36.577286+0000","last_fullsized":"2024-09-11T23:17:36.577286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.669492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.579451+0000","last_change":"2024-09-11T23:17:34.591850+0000","last_active":"2024-09-11T23:17:35.579451+0000","last_peered":"2024-09-11T23:17:35.579451+0000","last_clean":"2024-09-11T23:17:35.579451+0000","last_became_active":"2024-09-11T23:17:34.591097+0000","last_became_peered":"2024-09-11T23:17:34.591097+0000","last_unstale":"2024-09-11T23:17:35.579451+0000","last_undegraded":"2024-09-11T23:17:35.579451+0000","last_fullsized":"2024-09-11T23:17:35.579451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:01.314621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.805225+0000","last_change":"2024-09-11T23:17:33.603466+0000","last_active":"2024-09-11T23:17:35.805225+0000","last_peered":"2024-09-11T23:17:35.805225+0000","last_clean":"2024-09-11T23:17:35.805225+0000","last_became_active":"2024-09-11T23:17:33.603187+0000","last_became_peered":"2024-09-11T23:17:33.603187+0000","last_unstale":"2024-09-11T23:17:35.805225+0000","last_undegraded":"2024-09-11T23:17:35.805225+0000","last_fullsized":"2024-09-11T23:17:35.805225+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:54.908821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836428+0000","last_change":"2024-09-11T23:17:34.628560+0000","last_active":"2024-09-11T23:17:35.836428+0000","last_peered":"2024-09-11T23:17:35.836428+0000","last_clean":"2024-09-11T23:17:35.836428+0000","last_became_active":"2024-09-11T23:17:34.626398+0000","last_became_peered":"2024-09-11T23:17:34.626398+0000","last_unstale":"2024-09-11T23:17:35.836428+0000","last_undegraded":"2024-09-11T23:17:35.836428+0000","last_fullsized":"2024-09-11T23:17:35.836428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:53.046941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573554+0000","last_change":"2024-09-11T23:17:33.611169+0000","last_active":"2024-09-11T23:17:35.573554+0000","last_peered":"2024-09-11T23:17:35.573554+0000","last_clean":"2024-09-11T23:17:35.573554+0000","last_became_active":"2024-09-11T23:17:33.610838+0000","last_became_peered":"2024-09-11T23:17:33.610838+0000","last_unstale":"2024-09-11T23:17:35.573554+0000","last_undegraded":"2024-09-11T23:17:35.573554+0000","last_fullsized":"2024-09-11T23:17:35.573554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.666435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835700+0000","last_change":"2024-09-11T23:17:34.606096+0000","last_active":"2024-09-11T23:17:35.835700+0000","last_peered":"2024-09-11T23:17:35.835700+0000","last_clean":"2024-09-11T23:17:35.835700+0000","last_became_active":"2024-09-11T23:17:34.605365+0000","last_became_peered":"2024-09-11T23:17:34.605365+0000","last_unstale":"2024-09-11T23:17:35.835700+0000","last_undegraded":"2024-09-11T23:17:35.835700+0000","last_fullsized":"2024-09-11T23:17:35.835700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:53.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.582434+0000","last_change":"2024-09-11T23:17:33.614246+0000","last_active":"2024-09-11T23:17:35.582434+0000","last_peered":"2024-09-11T23:17:35.582434+0000","last_clean":"2024-09-11T23:17:35.582434+0000","last_became_active":"2024-09-11T23:17:33.606935+0000","last_became_peered":"2024-09-11T23:17:33.606935+0000","last_unstale":"2024-09-11T23:17:35.582434+0000","last_undegraded":"2024-09-11T23:17:35.582434+0000","last_fullsized":"2024-09-11T23:17:35.582434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.396316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.777716+0000","last_change":"2024-09-11T23:17:34.636973+0000","last_active":"2024-09-11T23:17:35.777716+0000","last_peered":"2024-09-11T23:17:35.777716+0000","last_clean":"2024-09-11T23:17:35.777716+0000","last_became_active":"2024-09-11T23:17:34.636144+0000","last_became_peered":"2024-09-11T23:17:34.636144+0000","last_unstale":"2024-09-11T23:17:35.777716+0000","last_undegraded":"2024-09-11T23:17:35.777716+0000","last_fullsized":"2024-09-11T23:17:35.777716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:46.676642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677170+0000","last_change":"2024-09-11T23:17:33.575459+0000","last_active":"2024-09-11T23:17:35.677170+0000","last_peered":"2024-09-11T23:17:35.677170+0000","last_clean":"2024-09-11T23:17:35.677170+0000","last_became_active":"2024-09-11T23:17:33.575096+0000","last_became_peered":"2024-09-11T23:17:33.575096+0000","last_unstale":"2024-09-11T23:17:35.677170+0000","last_undegraded":"2024-09-11T23:17:35.677170+0000","last_fullsized":"2024-09-11T23:17:35.677170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.676254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573633+0000","last_change":"2024-09-11T23:17:34.621514+0000","last_active":"2024-09-11T23:17:35.573633+0000","last_peered":"2024-09-11T23:17:35.573633+0000","last_clean":"2024-09-11T23:17:35.573633+0000","last_became_active":"2024-09-11T23:17:34.621224+0000","last_became_peered":"2024-09-11T23:17:34.621224+0000","last_unstale":"2024-09-11T23:17:35.573633+0000","last_undegraded":"2024-09-11T23:17:35.573633+0000","last_fullsized":"2024-09-11T23:17:35.573633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.092645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.677354+0000","last_change":"2024-09-11T23:17:33.596774+0000","last_active":"2024-09-11T23:17:35.677354+0000","last_peered":"2024-09-11T23:17:35.677354+0000","last_clean":"2024-09-11T23:17:35.677354+0000","last_became_active":"2024-09-11T23:17:33.596443+0000","last_became_peered":"2024-09-11T23:17:33.596443+0000","last_unstale":"2024-09-11T23:17:35.677354+0000","last_undegraded":"2024-09-11T23:17:35.677354+0000","last_fullsized":"2024-09-11T23:17:35.677354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:49.134767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.835804+0000","last_change":"2024-09-11T23:17:34.594235+0000","last_active":"2024-09-11T23:17:35.835804+0000","last_peered":"2024-09-11T23:17:35.835804+0000","last_clean":"2024-09-11T23:17:35.835804+0000","last_became_active":"2024-09-11T23:17:34.593883+0000","last_became_peered":"2024-09-11T23:17:34.593883+0000","last_unstale":"2024-09-11T23:17:35.835804+0000","last_undegraded":"2024-09-11T23:17:35.835804+0000","last_fullsized":"2024-09-11T23:17:35.835804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:35.388987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.573210+0000","last_change":"2024-09-11T23:17:33.596882+0000","last_active":"2024-09-11T23:17:35.573210+0000","last_peered":"2024-09-11T23:17:35.573210+0000","last_clean":"2024-09-11T23:17:35.573210+0000","last_became_active":"2024-09-11T23:17:33.596596+0000","last_became_peered":"2024-09-11T23:17:33.596596+0000","last_unstale":"2024-09-11T23:17:35.573210+0000","last_undegraded":"2024-09-11T23:17:35.573210+0000","last_fullsized":"2024-09-11T23:17:35.573210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:52.900370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.836046+0000","last_change":"2024-09-11T23:17:34.616537+0000","last_active":"2024-09-11T23:17:35.836046+0000","last_peered":"2024-09-11T23:17:35.836046+0000","last_clean":"2024-09-11T23:17:35.836046+0000","last_became_active":"2024-09-11T23:17:34.615717+0000","last_became_peered":"2024-09-11T23:17:34.615717+0000","last_unstale":"2024-09-11T23:17:35.836046+0000","last_undegraded":"2024-09-11T23:17:35.836046+0000","last_fullsized":"2024-09-11T23:17:35.836046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:33.555574+0000","last_clean_scrub_stamp":"2024-09-11T23:17:33.555574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:14.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.676989+0000","last_change":"2024-09-11T23:17:33.578984+0000","last_active":"2024-09-11T23:17:35.676989+0000","last_peered":"2024-09-11T23:17:35.676989+0000","last_clean":"2024-09-11T23:17:35.676989+0000","last_became_active":"2024-09-11T23:17:33.578717+0000","last_became_peered":"2024-09-11T23:17:33.578717+0000","last_unstale":"2024-09-11T23:17:35.676989+0000","last_undegraded":"2024-09-11T23:17:35.676989+0000","last_fullsized":"2024-09-11T23:17:35.676989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:32.545366+0000","last_clean_scrub_stamp":"2024-09-11T23:17:32.545366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:23.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:17:35.581107+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:17:35.581107+0000","last_peered":"2024-09-11T23:17:35.581107+0000","last_clean":"2024-09-11T23:17:35.581107+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:17:35.581107+0000","last_undegraded":"2024-09-11T23:17:35.581107+0000","last_fullsized":"2024-09-11T23:17:35.581107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1359872,"data_stored":929325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":753664,"data_stored":338215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":753664,"data_stored":338203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":761856,"data_stored":339793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":338181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":749568,"data_stored":338181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36116,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":778240,"data_stored":340557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36668,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335172,"statfs":{"total":96636764160,"available":96599216128,"internally_reserved":0,"allocated":1343488,"data_stored":928549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:42.413 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:17:42.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:17:42.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91bd3ca640 1 Processor -- start 2024-09-11T23:17:42.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91bd3ca640 1 -- start start 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91bd3ca640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f91b815aa50 0x7f91b80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91bd3ca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f91b80cdfd0 0x7f91b80ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91bd3ca640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b80b3720 con 0x7f91b80cebe0 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91bd3ca640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f91b80ce940 con 0x7f91b815aa50 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91bd3ca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f91b80cc470 con 0x7f91b80cdfd0 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91b6ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f91b815aa50 0x7f91b80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91b67fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f91b80cebe0 0x7f91b80b3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45378/0 (socket says 172.21.15.94:45378) 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91b67fc640 1 -- 172.21.15.94:0/3112183073 learned_addr learned my addr 172.21.15.94:0/3112183073 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91b77fe640 1 --2- 172.21.15.94:0/3112183073 >> v2:172.21.15.155:3300/0 conn(0x7f91b80cdfd0 0x7f91b80ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91b6ffd640 1 -- 172.21.15.94:0/3112183073 >> v2:172.21.15.155:3300/0 conn(0x7f91b80cdfd0 msgr2=0x7f91b80ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91b6ffd640 1 --2- 172.21.15.94:0/3112183073 >> v2:172.21.15.155:3300/0 conn(0x7f91b80cdfd0 0x7f91b80ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.586+0000 7f91b6ffd640 1 -- 172.21.15.94:0/3112183073 >> v1:172.21.15.94:6789/0 conn(0x7f91b80cebe0 legacy=0x7f91b80b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91b6ffd640 1 -- 172.21.15.94:0/3112183073 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b80cc750 con 0x7f91b815aa50 2024-09-11T23:17:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91b5ffb640 1 -- 172.21.15.94:0/3112183073 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159500613 0 0) 0x7f91b80b3720 con 0x7f91b80cebe0 2024-09-11T23:17:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91b77fe640 1 --2- 172.21.15.94:0/3112183073 >> v2:172.21.15.155:3300/0 conn(0x7f91b80cdfd0 0x7f91b80ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:42.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91b6ffd640 1 --2- 172.21.15.94:0/3112183073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b815aa50 0x7f91b80b4ba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f91b8074230 tx=0x7f91a801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef5c0f434c74596 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91b5ffb640 1 -- 172.21.15.94:0/3112183073 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a80b2070 con 0x7f91b815aa50 2024-09-11T23:17:42.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91b5ffb640 1 -- 172.21.15.94:0/3112183073 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a80a57e0 con 0x7f91b815aa50 2024-09-11T23:17:42.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91b5ffb640 1 -- 172.21.15.94:0/3112183073 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80cd240 con 0x7f91b815aa50 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 -- 172.21.15.94:0/3112183073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b815aa50 msgr2=0x7f91b80b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/3112183073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b815aa50 0x7f91b80b4ba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f91b8074230 tx=0x7f91a801c810 comp rx=0 tx=0).stop 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 -- 172.21.15.94:0/3112183073 shutdown_connections 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/3112183073 >> v2:172.21.15.155:3300/0 conn(0x7f91b80cdfd0 0x7f91b80ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/3112183073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b815aa50 0x7f91b80b4ba0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 -- 172.21.15.94:0/3112183073 >> 172.21.15.94:0/3112183073 conn(0x7f91b80b1c80 msgr2=0x7f91b80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 -- 172.21.15.94:0/3112183073 shutdown_connections 2024-09-11T23:17:42.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.590+0000 7f91bd3ca640 1 -- 172.21.15.94:0/3112183073 wait complete. 2024-09-11T23:17:42.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 Processor -- start 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 -- start start 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b80cdfd0 0x7f91b8150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80cebe0 0x7f91b80cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b815aa50 0x7f91b80c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f91b806eb70 con 0x7f91b80cdfd0 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91b806e9f0 con 0x7f91b80cebe0 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f91b806ecf0 con 0x7f91b815aa50 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b80cdfd0 0x7f91b8150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b80cdfd0 0x7f91b8150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35002/0 (socket says 172.21.15.94:35002) 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 -- 172.21.15.94:0/1152833119 learned_addr learned my addr 172.21.15.94:0/1152833119 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:42.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b67fc640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80cebe0 0x7f91b80cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b77fe640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b815aa50 0x7f91b80c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 -- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b815aa50 msgr2=0x7f91b80c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b815aa50 0x7f91b80c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 -- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80cebe0 msgr2=0x7f91b80cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80cebe0 0x7f91b80cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 -- 172.21.15.94:0/1152833119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b8159200 con 0x7f91b80cdfd0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b77fe640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b815aa50 0x7f91b80c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b67fc640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80cebe0 0x7f91b80cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91b6ffd640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b80cdfd0 0x7f91b8150f90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f91a801ccf0 tx=0x7f91a80195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91af7fe640 1 -- 172.21.15.94:0/1152833119 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a80b2050 con 0x7f91b80cdfd0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91af7fe640 1 -- 172.21.15.94:0/1152833119 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a80b3040 con 0x7f91b80cdfd0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b80cbf60 con 0x7f91b80cdfd0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91af7fe640 1 -- 172.21.15.94:0/1152833119 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a80ad850 con 0x7f91b80cdfd0 2024-09-11T23:17:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b8159780 con 0x7f91b80cdfd0 2024-09-11T23:17:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b806eff0 con 0x7f91b80cdfd0 2024-09-11T23:17:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.594+0000 7f91af7fe640 1 -- 172.21.15.94:0/1152833119 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91a80c0020 con 0x7f91b80cdfd0 2024-09-11T23:17:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.598+0000 7f91af7fe640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91980678c0 0x7f9198069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.598+0000 7f91af7fe640 1 -- 172.21.15.94:0/1152833119 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f91a8120820 con 0x7f91b80cdfd0 2024-09-11T23:17:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.598+0000 7f91b67fc640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91980678c0 0x7f9198069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.598+0000 7f91b67fc640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91980678c0 0x7f9198069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f91b80b2540 tx=0x7f91a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.602+0000 7f91af7fe640 1 -- 172.21.15.94:0/1152833119 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91a8016520 con 0x7f91b80cdfd0 2024-09-11T23:17:42.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.842+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f91b8073870 con 0x7f91b80cdfd0 2024-09-11T23:17:42.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.846+0000 7f91af7fe640 1 -- 172.21.15.94:0/1152833119 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f91a80f12f0 con 0x7f91b80cdfd0 2024-09-11T23:17:42.848 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:17:42.848 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:17:42.848 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2024-09-11T23:17:42.848 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2024-09-11T23:17:42.848 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:17:42.848 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2024-09-11T23:17:42.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91980678c0 msgr2=0x7f9198069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91980678c0 0x7f9198069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f91b80b2540 tx=0x7f91a0009040 comp rx=0 tx=0).stop 2024-09-11T23:17:42.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b80cdfd0 msgr2=0x7f91b8150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b80cdfd0 0x7f91b8150f90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f91a801ccf0 tx=0x7f91a80195b0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 shutdown_connections 2024-09-11T23:17:42.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b815aa50 0x7f91b80c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80cebe0 0x7f91b80cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91980678c0 0x7f9198069d80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 --2- 172.21.15.94:0/1152833119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91b80cdfd0 0x7f91b8150f90 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 >> 172.21.15.94:0/1152833119 conn(0x7f91b80b1c80 msgr2=0x7f91b80aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:42.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 shutdown_connections 2024-09-11T23:17:42.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.850+0000 7f91bd3ca640 1 -- 172.21.15.94:0/1152833119 wait complete. 2024-09-11T23:17:42.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:42.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f757a217640 1 Processor -- start 2024-09-11T23:17:42.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f757a217640 1 -- start start 2024-09-11T23:17:42.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f757a217640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f75740cf1e0 0x7f757415d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f757a217640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75740ce140 con 0x7f75740cdb00 2024-09-11T23:17:42.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f757a217640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75740ce420 con 0x7f75740b3280 2024-09-11T23:17:42.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f757a217640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f75740ce700 con 0x7f75740cf1e0 2024-09-11T23:17:42.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f7573fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f75740cf1e0 0x7f757415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f7572ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f75740cdb00 0x7f75740b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45394/0 (socket says 172.21.15.94:45394) 2024-09-11T23:17:42.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f7572ffd640 1 -- 172.21.15.94:0/4173613155 learned_addr learned my addr 172.21.15.94:0/4173613155 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:42.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f7573fff640 1 -- 172.21.15.94:0/4173613155 >> v1:172.21.15.155:6789/0 conn(0x7f75740b3280 legacy=0x7f757415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f7573fff640 1 -- 172.21.15.94:0/4173613155 >> v1:172.21.15.94:6789/0 conn(0x7f75740cdb00 legacy=0x7f75740b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f7573fff640 1 -- 172.21.15.94:0/4173613155 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75740ce9e0 con 0x7f75740cf1e0 2024-09-11T23:17:42.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.986+0000 7f75727fc640 1 -- 172.21.15.94:0/4173613155 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046019734 0 0) 0x7f75740ce140 con 0x7f75740cdb00 2024-09-11T23:17:42.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7573fff640 1 --2- 172.21.15.94:0/4173613155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cf1e0 0x7f757415d810 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f756c009d90 tx=0x7f756c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a018aaa2e6865a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f75727fc640 1 -- 172.21.15.94:0/4173613155 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c0b2070 con 0x7f75740cf1e0 2024-09-11T23:17:42.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f75727fc640 1 -- 172.21.15.94:0/4173613155 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f756c0a58b0 con 0x7f75740cf1e0 2024-09-11T23:17:42.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f75727fc640 1 -- 172.21.15.94:0/4173613155 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c0a5c80 con 0x7f75740cf1e0 2024-09-11T23:17:42.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- 172.21.15.94:0/4173613155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cf1e0 msgr2=0x7f757415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 --2- 172.21.15.94:0/4173613155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cf1e0 0x7f757415d810 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f756c009d90 tx=0x7f756c01c8e0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- 172.21.15.94:0/4173613155 shutdown_connections 2024-09-11T23:17:42.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 --2- 172.21.15.94:0/4173613155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cf1e0 0x7f757415d810 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- 172.21.15.94:0/4173613155 >> 172.21.15.94:0/4173613155 conn(0x7f75740b6870 msgr2=0x7f75740b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:42.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- 172.21.15.94:0/4173613155 shutdown_connections 2024-09-11T23:17:42.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- 172.21.15.94:0/4173613155 wait complete. 2024-09-11T23:17:42.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 Processor -- start 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- start start 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75740b3280 0x7f757415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cdb00 0x7f75741f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75740cf1e0 0x7f75741f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f757416a4b0 con 0x7f75740cdb00 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f757415e370 con 0x7f75740cf1e0 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f757a217640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f757416a630 con 0x7f75740b3280 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cdb00 0x7f75741f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cdb00 0x7f75741f8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35020/0 (socket says 172.21.15.94:35020) 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 -- 172.21.15.94:0/932841528 learned_addr learned my addr 172.21.15.94:0/932841528 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f75737fe640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75740b3280 0x7f757415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7573fff640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75740cf1e0 0x7f75741f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 -- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75740b3280 msgr2=0x7f757415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75740b3280 0x7f757415b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 -- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75740cf1e0 msgr2=0x7f75741f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75740cf1e0 0x7f75741f90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 -- 172.21.15.94:0/932841528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7574138960 con 0x7f75740cdb00 2024-09-11T23:17:42.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.990+0000 7f7572ffd640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cdb00 0x7f75741f8b70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f756800c4a0 tx=0x7f756800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f755bfff640 1 -- 172.21.15.94:0/932841528 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568018070 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f755bfff640 1 -- 172.21.15.94:0/932841528 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75680074e0 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7574138c40 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f755bfff640 1 -- 172.21.15.94:0/932841528 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568004a30 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7574139200 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757415d810 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f755bfff640 1 -- 172.21.15.94:0/932841528 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f756801b070 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f755bfff640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75600678f0 0x7f7560069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f755bfff640 1 -- 172.21.15.94:0/932841528 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f75680850d0 con 0x7f75740cdb00 2024-09-11T23:17:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f75737fe640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75600678f0 0x7f7560069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.994+0000 7f75737fe640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75600678f0 0x7f7560069db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7564000f70 tx=0x7f7564009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:42.998+0000 7f755bfff640 1 -- 172.21.15.94:0/932841528 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7568055b10 con 0x7f75740cdb00 2024-09-11T23:17:43.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.194+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75741504b0 con 0x7f75740cdb00 2024-09-11T23:17:43.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f755bfff640 1 -- 172.21.15.94:0/932841528 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7f7568055410 con 0x7f75740cdb00 2024-09-11T23:17:43.198 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:17:43.198 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:17:43.198 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:17:43.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75600678f0 msgr2=0x7f7560069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75600678f0 0x7f7560069db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7564000f70 tx=0x7f7564009040 comp rx=0 tx=0).stop 2024-09-11T23:17:43.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cdb00 msgr2=0x7f75741f8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cdb00 0x7f75741f8b70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f756800c4a0 tx=0x7f756800c960 comp rx=0 tx=0).stop 2024-09-11T23:17:43.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 shutdown_connections 2024-09-11T23:17:43.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75740cf1e0 0x7f75741f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75600678f0 0x7f7560069db0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75740cdb00 0x7f75741f8b70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 --2- 172.21.15.94:0/932841528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75740b3280 0x7f757415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 >> 172.21.15.94:0/932841528 conn(0x7f75740b6870 msgr2=0x7f757415e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 shutdown_connections 2024-09-11T23:17:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.198+0000 7f757a217640 1 -- 172.21.15.94:0/932841528 wait complete. 2024-09-11T23:17:43.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:17:33.945017+0000', 'modified': '2024-09-11T23:17:35.941620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5622': {'gid': 5622, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6835/2185007452', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 2185007452}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 2185007452}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5622, 'qdb_cluster': [5622]} 2024-09-11T23:17:43.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:17:43.622 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:17:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e6e4e640 1 Processor -- start 2024-09-11T23:17:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e6e4e640 1 -- start start 2024-09-11T23:17:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e6e4e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13e01587a0 0x7f13e00b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e6e4e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e006ec60 con 0x7f13e006e680 2024-09-11T23:17:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e6e4e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e006ef40 con 0x7f13e00b37d0 2024-09-11T23:17:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e6e4e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f13e00b3c40 con 0x7f13e01587a0 2024-09-11T23:17:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e53eb640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f13e006e680 0x7f13e0072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45402/0 (socket says 172.21.15.94:45402) 2024-09-11T23:17:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e53eb640 1 -- 172.21.15.94:0/2592806072 learned_addr learned my addr 172.21.15.94:0/2592806072 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e4bea640 1 --2- 172.21.15.94:0/2592806072 >> v2:172.21.15.155:3300/0 conn(0x7f13e01587a0 0x7f13e00b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752713549 0 0) 0x7f13e006ec60 con 0x7f13e006e680 2024-09-11T23:17:43.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c8003530 con 0x7f13e006e680 2024-09-11T23:17:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4037182968 0 0) 0x7f13c8003530 con 0x7f13e006e680 2024-09-11T23:17:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 >> v2:172.21.15.155:3300/0 conn(0x7f13e01587a0 msgr2=0x7f13e00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 --2- 172.21.15.94:0/2592806072 >> v2:172.21.15.155:3300/0 conn(0x7f13e01587a0 0x7f13e00b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 >> v1:172.21.15.155:6789/0 conn(0x7f13e00b37d0 legacy=0x7f13e006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e006f220 con 0x7f13e006e680 2024-09-11T23:17:43.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f13d8001a00 con 0x7f13e006e680 2024-09-11T23:17:43.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 >> v1:172.21.15.94:6789/0 conn(0x7f13e006e680 legacy=0x7f13e0072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c80039c0 0x7f13c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8004810 0x7f13c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13c80051d0 0x7f13c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f13e00b3c40 con 0x7f13c80039c0 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13c800c070 con 0x7f13c8004810 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13c800c270 con 0x7f13c80051d0 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.754+0000 7f13e4bea640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c80039c0 0x7f13c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13dffff640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8004810 0x7f13c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e4bea640 1 -- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13c80051d0 msgr2=0x7f13c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e4bea640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13c80051d0 0x7f13c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e4bea640 1 -- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8004810 msgr2=0x7f13c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e4bea640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8004810 0x7f13c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e4bea640 1 -- 172.21.15.94:0/2592806072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c8003530 con 0x7f13c80039c0 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13dffff640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8004810 0x7f13c8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:43.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e53eb640 1 -- 172.21.15.94:0/2592806072 reap_dead start 2024-09-11T23:17:43.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e4bea640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c80039c0 0x7f13c8003de0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009ae0 tx=0x7f13d001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4d37da5de7b3c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00096b0 con 0x7f13c80039c0 2024-09-11T23:17:43.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d00a64e0 con 0x7f13c80039c0 2024-09-11T23:17:43.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13df7fe640 1 -- 172.21.15.94:0/2592806072 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00a68d0 con 0x7f13c80039c0 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e6e4e640 1 -- 172.21.15.94:0/2592806072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c80039c0 msgr2=0x7f13c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c80039c0 0x7f13c8003de0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009ae0 tx=0x7f13d001ca70 comp rx=0 tx=0).stop 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e6e4e640 1 -- 172.21.15.94:0/2592806072 shutdown_connections 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/2592806072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c80039c0 0x7f13c8003de0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e6e4e640 1 -- 172.21.15.94:0/2592806072 >> 172.21.15.94:0/2592806072 conn(0x7f13e00b1f90 msgr2=0x7f13e00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e6e4e640 1 -- 172.21.15.94:0/2592806072 shutdown_connections 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.758+0000 7f13e6e4e640 1 -- 172.21.15.94:0/2592806072 wait complete. 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 Processor -- start 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 -- start start 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c80039c0 0x7f13e014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13e0150ad0 0x7f13e0154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e01553d0 0x7f13e01ff3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f13e01627e0 con 0x7f13e0150ad0 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13e0162660 con 0x7f13c80039c0 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13e0162960 con 0x7f13e01553d0 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13e0150ad0 0x7f13e0154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13e0150ad0 0x7f13e0154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35032/0 (socket says 172.21.15.94:35032) 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 -- 172.21.15.94:0/190521930 learned_addr learned my addr 172.21.15.94:0/190521930 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e53eb640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e01553d0 0x7f13e01ff3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 -- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e01553d0 msgr2=0x7f13e01ff3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e01553d0 0x7f13e01ff3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 -- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c80039c0 msgr2=0x7f13e014f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e4bea640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c80039c0 0x7f13e014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c80039c0 0x7f13e014f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 -- 172.21.15.94:0/190521930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e014fa30 con 0x7f13e0150ad0 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e53eb640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e01553d0 0x7f13e01ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dffff640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13e0150ad0 0x7f13e0154e90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f13d400d770 tx=0x7f13d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dd7fa640 1 -- 172.21.15.94:0/190521930 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4019070 con 0x7f13e0150ad0 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dd7fa640 1 -- 172.21.15.94:0/190521930 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d4005270 con 0x7f13e0150ad0 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e014fd10 con 0x7f13e0150ad0 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dd7fa640 1 -- 172.21.15.94:0/190521930 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4007030 con 0x7f13e0150ad0 2024-09-11T23:17:43.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e01502d0 con 0x7f13e0150ad0 2024-09-11T23:17:43.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dd7fa640 1 -- 172.21.15.94:0/190521930 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f13d401c070 con 0x7f13e0150ad0 2024-09-11T23:17:43.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dd7fa640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13cc0678c0 0x7f13cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.762+0000 7f13dd7fa640 1 -- 172.21.15.94:0/190521930 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f13d4085660 con 0x7f13e0150ad0 2024-09-11T23:17:43.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e4bea640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13cc0678c0 0x7f13cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 Processor -- start 2024-09-11T23:17:43.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- start start 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e4bea640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13cc0678c0 0x7f13cc069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f13d00af000 tx=0x7f13d00046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 0x556802611f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 0x5568025c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025c8290 0x5568025c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5568024afb60 con 0x5568025c8290 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556802416c70 con 0x556802612440 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5568023bced0 con 0x556802611b20 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025c8290 0x5568025c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025c8290 0x5568025c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35034/0 (socket says 172.21.15.94:35034) 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 -- 172.21.15.94:0/1346758197 learned_addr learned my addr 172.21.15.94:0/1346758197 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e4bea640 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 0x556802611f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13dffff640 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 0x5568025c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 -- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 msgr2=0x556802611f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 0x556802611f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 -- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 msgr2=0x5568025c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 0x5568025c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 -- 172.21.15.94:0/1346758197 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568023cee50 con 0x5568025c8290 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e53eb640 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025c8290 0x5568025c8670 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b44f0 tx=0x7f13e006f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6af39b5b95bc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13c67fc640 1 -- 172.21.15.94:0/1346758197 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d800d820 con 0x5568025c8290 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13c67fc640 1 -- 172.21.15.94:0/1346758197 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d800d9e0 con 0x5568025c8290 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13c67fc640 1 -- 172.21.15.94:0/1346758197 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d800ddd0 con 0x5568025c8290 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1346758197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025c8290 msgr2=0x5568025c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025c8290 0x5568025c8670 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b44f0 tx=0x7f13e006f3f0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1346758197 shutdown_connections 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025c8290 0x5568025c8670 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 0x5568025c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1346758197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 0x556802611f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1346758197 >> 172.21.15.94:0/1346758197 conn(0x5568025ce600 msgr2=0x5568025c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1346758197 shutdown_connections 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1346758197 wait complete. 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 -- start start 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.766+0000 7f13e9f0a000 1 Processor -- start 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556802611b20 0x5568025ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 0x5568025d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568025cd330 0x5568025d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556802478b00 con 0x556802611b20 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5568023f1360 con 0x5568025cd330 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5568023ee2d0 con 0x556802612440 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 10 client.0 _ll_register_callbacks cb 0x5568025b3820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556802611b20 0x5568025ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556802611b20 0x5568025ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35046/0 (socket says 172.21.15.94:35046) 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 -- 172.21.15.94:0/1781026522 learned_addr learned my addr 172.21.15.94:0/1781026522 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e53eb640 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568025cd330 0x5568025d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13dffff640 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 0x5568025d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 -- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 msgr2=0x5568025d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 0x5568025d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 -- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568025cd330 msgr2=0x5568025d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568025cd330 0x5568025d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 -- 172.21.15.94:0/1781026522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568023bd120 con 0x556802611b20 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e4bea640 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556802611b20 0x5568025ccdf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f13d001cf50 tx=0x7f13d0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcd91f1db1ec9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1781026522 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d000f080 con 0x556802611b20 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1781026522 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f13d00a64e0 con 0x556802611b20 2024-09-11T23:17:43.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13d800d9e0 con 0x556802611b20 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1781026522 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f13d00d0050 con 0x556802611b20 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 10 client.5778 fetch_fsmap learned FSMap version 31 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5568023b6450 con 0x556802611b20 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1781026522 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d800d9e0 con 0x556802611b20 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1781026522 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f13d00d3020 con 0x556802611b20 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 10 client.5778 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 10 client.5778 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 20 client.5778 populate_metadata read hostname 'smithi094' 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802620280 0x556802622670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 4 client.5778 mds_command: new command op to 5622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 --> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568023b0c00 con 0x556802620280 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13dffff640 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802620280 0x556802622670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13dffff640 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802620280 0x556802622670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9575bacc72cd250 server_cookie=6fd3ef15c69d1950 in_seq=0 out_seq=0 2024-09-11T23:17:43.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 10 client.5778 ms_handle_connect on v2:172.21.15.94:6834/2185007452 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1781026522 <== mds.0 v2:172.21.15.94:6834/2185007452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568023b0c00 con 0x556802620280 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 10 client.5778 handle_command_reply: tid=0 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 client.5778 shutdown 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556802611b20 msgr2=0x5568025ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556802611b20 0x5568025ccdf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f13d001cf50 tx=0x7f13d0019810 comp rx=0 tx=0).stop 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 shutdown_connections 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802620280 0x556802622670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568025cd330 0x5568025d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 0x5568025d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13bf7fe640 0 client.5778 ms_handle_reset on v2:172.21.15.94:6834/2185007452 2024-09-11T23:17:43.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1781026522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x556802611b20 0x5568025ccdf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 >> 172.21.15.94:0/1781026522 conn(0x5568025c8290 msgr2=0x5568025c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 shutdown_connections 2024-09-11T23:17:43.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1781026522 wait complete. 2024-09-11T23:17:43.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.770+0000 7f13e9f0a000 20 client.5778 trim_cache size 0 max 16384 2024-09-11T23:17:43.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 Processor -- start 2024-09-11T23:17:43.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- start start 2024-09-11T23:17:43.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802610cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802611b20 0x556802611230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 0x556802622670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f13e02081e0 con 0x5568025cd330 2024-09-11T23:17:43.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13e01fdc40 con 0x556802611b20 2024-09-11T23:17:43.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13e0207b90 con 0x556802612440 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802610cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802610cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35048/0 (socket says 172.21.15.94:35048) 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 -- 172.21.15.94:0/3612176784 learned_addr learned my addr 172.21.15.94:0/3612176784 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 -- 172.21.15.94:0/3612176784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 msgr2=0x556802622670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 --2- 172.21.15.94:0/3612176784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 0x556802622670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 -- 172.21.15.94:0/3612176784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802611b20 msgr2=0x556802611230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 --2- 172.21.15.94:0/3612176784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802611b20 0x556802611230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 -- 172.21.15.94:0/3612176784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55680239dfd0 con 0x5568025cd330 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e4bea640 1 --2- 172.21.15.94:0/3612176784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802610cf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f13d001c8a0 tx=0x7f13d00bb070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85564f27b5a0fde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13c5ffb640 1 -- 172.21.15.94:0/3612176784 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00a64e0 con 0x5568025cd330 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13c5ffb640 1 -- 172.21.15.94:0/3612176784 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d00d9070 con 0x5568025cd330 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13c5ffb640 1 -- 172.21.15.94:0/3612176784 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00a6680 con 0x5568025cd330 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- 172.21.15.94:0/3612176784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 msgr2=0x556802610cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/3612176784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802610cf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f13d001c8a0 tx=0x7f13d00bb070 comp rx=0 tx=0).stop 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- 172.21.15.94:0/3612176784 shutdown_connections 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/3612176784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802612440 0x556802622670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/3612176784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802611b20 0x556802611230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/3612176784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802610cf0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- 172.21.15.94:0/3612176784 >> 172.21.15.94:0/3612176784 conn(0x5568025c8290 msgr2=0x5568025cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- 172.21.15.94:0/3612176784 shutdown_connections 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.790+0000 7f13e9f0a000 1 -- 172.21.15.94:0/3612176784 wait complete. 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- start start 2024-09-11T23:17:43.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 Processor -- start 2024-09-11T23:17:43.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802625590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 0x556802684070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 0x5568026845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x556802415f80 con 0x5568025cd330 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5568023ceca0 con 0x556802612440 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55680241b2a0 con 0x556802611b20 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 10 client.0 _ll_register_callbacks cb 0x7f13c8003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802625590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802625590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35050/0 (socket says 172.21.15.94:35050) 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 -- 172.21.15.94:0/1454528593 learned_addr learned my addr 172.21.15.94:0/1454528593 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 -- 172.21.15.94:0/1454528593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 msgr2=0x556802684070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 0x556802684070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 -- 172.21.15.94:0/1454528593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 msgr2=0x5568026845b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 0x5568026845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 -- 172.21.15.94:0/1454528593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556802499750 con 0x5568025cd330 2024-09-11T23:17:43.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e4bea640 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802625590 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f13d001cf50 tx=0x7f13d0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d456b901c37e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1454528593 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00e2060 con 0x5568025cd330 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1454528593 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f13d00c58b0 con 0x5568025cd330 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13d00d9070 con 0x5568025cd330 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1454528593 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f13d00c5ad0 con 0x5568025cd330 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 10 client.5784 fetch_fsmap learned FSMap version 31 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5568023a4a30 con 0x5568025cd330 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1454528593 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d00d9070 con 0x5568025cd330 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1454528593 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f13d00d3040 con 0x5568025cd330 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 10 client.5784 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 10 client.5784 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 20 client.5784 populate_metadata read hostname 'smithi094' 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802640960 0x556802640d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 4 client.5784 mds_command: new command op to 5622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 --> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] -- command(tid 0: {"prefix": "status"}) -- 0x5568024243a0 con 0x556802640960 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13dffff640 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802640960 0x556802640d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13dffff640 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802640960 0x556802640d40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=443a1ef8f6a7ab8f server_cookie=4ace746845403164 in_seq=0 out_seq=0 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 10 client.5784 ms_handle_connect on v2:172.21.15.94:6834/2185007452 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 1 -- 172.21.15.94:0/1454528593 <== mds.0 v2:172.21.15.94:6834/2185007452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5568024243a0 con 0x556802640960 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 10 client.5784 handle_command_reply: tid=0 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 client.5784 shutdown 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 msgr2=0x556802625590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802625590 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f13d001cf50 tx=0x7f13d0009190 comp rx=0 tx=0).stop 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 shutdown_connections 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:6834/2185007452,v1:172.21.15.94:6835/2185007452] conn(0x556802640960 0x556802640d40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556802612440 0x5568026845b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13bf7fe640 0 client.5784 ms_handle_reset on v2:172.21.15.94:6834/2185007452 2024-09-11T23:17:43.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556802611b20 0x556802684070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 --2- 172.21.15.94:0/1454528593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5568025cd330 0x556802625590 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 >> 172.21.15.94:0/1454528593 conn(0x5568025c8290 msgr2=0x55680260fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 shutdown_connections 2024-09-11T23:17:43.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 1 -- 172.21.15.94:0/1454528593 wait complete. 2024-09-11T23:17:43.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e9f0a000 20 client.5784 trim_cache size 0 max 16384 2024-09-11T23:17:43.803 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:17:43.803 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5622, 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 9.2280170600000009, 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 31, 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 62, 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 62, 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 14.284279142000001 2024-09-11T23:17:43.804 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:17:43.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13cc0678c0 msgr2=0x7f13cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13cc0678c0 0x7f13cc069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f13d00af000 tx=0x7f13d00046d0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13e0150ad0 msgr2=0x7f13e0154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13e0150ad0 0x7f13e0154e90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f13d400d770 tx=0x7f13d400dc30 comp rx=0 tx=0).stop 2024-09-11T23:17:43.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 shutdown_connections 2024-09-11T23:17:43.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e01553d0 0x7f13e01ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f13cc0678c0 0x7f13cc069d80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13e0150ad0 0x7f13e0154e90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 --2- 172.21.15.94:0/190521930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c80039c0 0x7f13e014f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.794+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 >> 172.21.15.94:0/190521930 conn(0x7f13e00b1f90 msgr2=0x7f13e015e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.798+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 shutdown_connections 2024-09-11T23:17:43.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.798+0000 7f13e6e4e640 1 -- 172.21.15.94:0/190521930 wait complete. 2024-09-11T23:17:43.811 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:43.813 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:17:43.857 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:43.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c2c00640 1 Processor -- start 2024-09-11T23:17:43.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c2c00640 1 -- start start 2024-09-11T23:17:43.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c2c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f77bc15c2a0 0x7f77bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c2c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc0b3290 con 0x7f77bc0af2a0 2024-09-11T23:17:43.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c2c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc0b3570 con 0x7f77bc15bec0 2024-09-11T23:17:43.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c2c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f77bc0b3850 con 0x7f77bc15c2a0 2024-09-11T23:17:43.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77bbfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f77bc15c2a0 0x7f77bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c119d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f77bc0af2a0 0x7f77bc06e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45406/0 (socket says 172.21.15.94:45406) 2024-09-11T23:17:43.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77c119d640 1 -- 172.21.15.94:0/2620374165 learned_addr learned my addr 172.21.15.94:0/2620374165 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:43.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77bbfff640 1 -- 172.21.15.94:0/2620374165 >> v1:172.21.15.155:6789/0 conn(0x7f77bc15bec0 legacy=0x7f77bc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:43.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77bbfff640 1 -- 172.21.15.94:0/2620374165 >> v1:172.21.15.94:6789/0 conn(0x7f77bc0af2a0 legacy=0x7f77bc06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.966+0000 7f77bbfff640 1 -- 172.21.15.94:0/2620374165 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc0b3b30 con 0x7f77bc15c2a0 2024-09-11T23:17:43.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77bbfff640 1 --2- 172.21.15.94:0/2620374165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc15c2a0 0x7f77bc0aed60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f77a40097c0 tx=0x7f77a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898d65481db57773 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77bb7fe640 1 -- 172.21.15.94:0/2620374165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a40ab430 con 0x7f77bc15c2a0 2024-09-11T23:17:43.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77bb7fe640 1 -- 172.21.15.94:0/2620374165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a40b0070 con 0x7f77bc15c2a0 2024-09-11T23:17:43.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77bb7fe640 1 -- 172.21.15.94:0/2620374165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a40ab7f0 con 0x7f77bc15c2a0 2024-09-11T23:17:43.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 -- 172.21.15.94:0/2620374165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc15c2a0 msgr2=0x7f77bc0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 --2- 172.21.15.94:0/2620374165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc15c2a0 0x7f77bc0aed60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f77a40097c0 tx=0x7f77a401c430 comp rx=0 tx=0).stop 2024-09-11T23:17:43.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 -- 172.21.15.94:0/2620374165 shutdown_connections 2024-09-11T23:17:43.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 --2- 172.21.15.94:0/2620374165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc15c2a0 0x7f77bc0aed60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 -- 172.21.15.94:0/2620374165 >> 172.21.15.94:0/2620374165 conn(0x7f77bc0b1f90 msgr2=0x7f77bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 -- 172.21.15.94:0/2620374165 shutdown_connections 2024-09-11T23:17:43.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 -- 172.21.15.94:0/2620374165 wait complete. 2024-09-11T23:17:43.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 Processor -- start 2024-09-11T23:17:43.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.970+0000 7f77c2c00640 1 -- start start 2024-09-11T23:17:43.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc0af2a0 0x7f77bc1670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77bc15bec0 0x7f77bc15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77bc15c2a0 0x7f77bc15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc06ef20 con 0x7f77bc0af2a0 2024-09-11T23:17:43.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0af6b0 con 0x7f77bc15bec0 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc06f0a0 con 0x7f77bc15c2a0 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc0af2a0 0x7f77bc1670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc0af2a0 0x7f77bc1670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35078/0 (socket says 172.21.15.94:35078) 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 -- 172.21.15.94:0/1171661303 learned_addr learned my addr 172.21.15.94:0/1171661303 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77bbfff640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77bc15bec0 0x7f77bc15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c119d640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77bc15c2a0 0x7f77bc15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 -- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77bc15c2a0 msgr2=0x7f77bc15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77bc15c2a0 0x7f77bc15b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 -- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77bc15bec0 msgr2=0x7f77bc15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77bc15bec0 0x7f77bc15ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 -- 172.21.15.94:0/1171661303 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc1675e0 con 0x7f77bc0af2a0 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77bbfff640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77bc15bec0 0x7f77bc15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c099c640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc0af2a0 0x7f77bc1670a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c7c0 tx=0x7f77ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77b97fa640 1 -- 172.21.15.94:0/1171661303 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac016020 con 0x7f77bc0af2a0 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77b97fa640 1 -- 172.21.15.94:0/1171661303 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac00aa50 con 0x7f77bc0af2a0 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc154180 con 0x7f77bc0af2a0 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77b97fa640 1 -- 172.21.15.94:0/1171661303 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac012420 con 0x7f77bc0af2a0 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc154740 con 0x7f77bc0af2a0 2024-09-11T23:17:43.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77bc0aed60 con 0x7f77bc0af2a0 2024-09-11T23:17:43.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77b97fa640 1 -- 172.21.15.94:0/1171661303 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77ac019020 con 0x7f77bc0af2a0 2024-09-11T23:17:43.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77b97fa640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f779c0678f0 0x7f779c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77b97fa640 1 -- 172.21.15.94:0/1171661303 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f77ac085e40 con 0x7f77bc0af2a0 2024-09-11T23:17:43.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.974+0000 7f77bbfff640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f779c0678f0 0x7f779c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.978+0000 7f77bbfff640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f779c0678f0 0x7f779c069db0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77a40af000 tx=0x7f77a40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:43.978+0000 7f77b97fa640 1 -- 172.21.15.94:0/1171661303 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f77ac020030 con 0x7f77bc0af2a0 2024-09-11T23:17:44.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.162+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f77bc073f00 con 0x7f77bc0af2a0 2024-09-11T23:17:44.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.162+0000 7f77b97fa640 1 -- 172.21.15.94:0/1171661303 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) ==== 53+0+73 (secure 0 0 0) 0x7f77ac0567f0 con 0x7f77bc0af2a0 2024-09-11T23:17:44.165 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f779c0678f0 msgr2=0x7f779c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f779c0678f0 0x7f779c069db0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77a40af000 tx=0x7f77a40a7000 comp rx=0 tx=0).stop 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc0af2a0 msgr2=0x7f77bc1670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc0af2a0 0x7f77bc1670a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c7c0 tx=0x7f77ac00cc80 comp rx=0 tx=0).stop 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 shutdown_connections 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77bc15c2a0 0x7f77bc15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77bc15bec0 0x7f77bc15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f779c0678f0 0x7f779c069db0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 --2- 172.21.15.94:0/1171661303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77bc0af2a0 0x7f77bc1670a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 >> 172.21.15.94:0/1171661303 conn(0x7f77bc0b1f90 msgr2=0x7f77bc0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 shutdown_connections 2024-09-11T23:17:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44.166+0000 7f77c2c00640 1 -- 172.21.15.94:0/1171661303 wait complete. 2024-09-11T23:17:44.182 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:17:44.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:17:44.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:17:44.182 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:17:44.182 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:44.182 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:17:44.183 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:17:44.183 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:17:44.183 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:17:44.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:44.183 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:44.189 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42324sec preferred_lft 42324sec 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:17:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.191 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:17:44.192 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:44.192 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:17:44.192 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:17:44.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:44.192 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:17:44.241 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:17:44.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:44.243 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:17:44.296 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:17:44.296 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:17:44.297 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:17:44.298 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:17:44.298 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:17:44.298 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:17:44.298 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:17:44.298 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:17:44.298 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:17:44.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:17:44.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:17:44.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:44.422 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:17:44.473 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:17:44.473 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:17:44.473 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:17:44.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:44.474 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:17:44.527 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:17:44.527 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:17:44.528 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:44.577 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:17:44.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:17:44.577 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:44.625 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:17:44.683 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:17:44.732 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:17:44.732 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:17:44.733 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:17:44.734 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:17:44.735 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:17:44.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:17:44.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:44.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:44.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:44.735 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:44.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:44.737 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:17:44.786 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:17:44.786 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:17:44.830 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:17:44.844 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:17:44.889 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:17:44.890 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:17:44.891 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:44.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:44.892 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:17:44.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:17:44.906+0000 7f65e2f2a580 -1 init, newargv = 0x55f3c7c4eed0 newargc=15 2024-09-11T23:17:44.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[40881]: starting ceph client 2024-09-11T23:17:44.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[40881]: starting fuse 2024-09-11T23:17:46.017 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:17:46.034 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:17:46.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:17:46.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:17:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:17:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:46.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:46.086 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:17:46.140 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:17:46.140 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:46.141 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:17:46.142 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:17:46.143 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:17:46.143 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:17:46.143 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:46.143 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:17:46.143 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:17:46.262 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.40881.asok 2024-09-11T23:17:46.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:17:46.274 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40881.asok 2024-09-11T23:17:46.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:46.274 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40881.asok status 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "40881", 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5802, 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 5802 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:17:46.435 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1251285440 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1251285440 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.5802 192.168.0.1:0/1251285440", 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/1251285440", 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 31, 2024-09-11T23:17:46.436 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 62, 2024-09-11T23:17:46.437 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:17:46.437 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:17:46.437 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:17:46.437 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:17:46.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:46.451 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:17:46.451 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:46.456 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:17:46.457 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:46.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:46.457 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:46.513 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_fragment_size_max 50 2024-09-11T23:17:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb6975d6640 1 Processor -- start 2024-09-11T23:17:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb6975d6640 1 -- start start 2024-09-11T23:17:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb6975d6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb690161a60 0x7fb6900d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb6975d6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6900d32b0 con 0x7fb6900cf620 2024-09-11T23:17:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb6975d6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6900d0300 con 0x7fb6900d2e90 2024-09-11T23:17:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb6975d6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb6900cfa90 con 0x7fb690161a60 2024-09-11T23:17:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695b73640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb6900cf620 0x7fb69006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45412/0 (socket says 172.21.15.94:45412) 2024-09-11T23:17:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695b73640 1 -- 172.21.15.94:0/339363198 learned_addr learned my addr 172.21.15.94:0/339363198 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695372640 1 --2- 172.21.15.94:0/339363198 >> v2:172.21.15.155:3300/0 conn(0x7fb690161a60 0x7fb6900d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486009711 0 0) 0x7fb6900d32b0 con 0x7fb6900cf620 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb678003530 con 0x7fb6900cf620 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4164958937 0 0) 0x7fb678003530 con 0x7fb6900cf620 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 >> v2:172.21.15.155:3300/0 conn(0x7fb690161a60 msgr2=0x7fb6900d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 --2- 172.21.15.94:0/339363198 >> v2:172.21.15.155:3300/0 conn(0x7fb690161a60 0x7fb6900d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 >> v1:172.21.15.155:6789/0 conn(0x7fb6900d2e90 legacy=0x7fb6900cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6900b0f60 con 0x7fb6900cf620 2024-09-11T23:17:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fb680001680 con 0x7fb6900cf620 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 >> v1:172.21.15.94:6789/0 conn(0x7fb6900cf620 legacy=0x7fb69006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6780039c0 0x7fb678003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb678004810 0x7fb678004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780051d0 0x7fb67800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900cfa90 con 0x7fb6780039c0 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb67800c170 con 0x7fb6780051d0 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb67800c370 con 0x7fb678004810 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695372640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6780039c0 0x7fb678003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb694b71640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb678004810 0x7fb678004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695372640 1 -- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb678004810 msgr2=0x7fb678004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695372640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb678004810 0x7fb678004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695b73640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780051d0 0x7fb67800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695372640 1 -- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780051d0 msgr2=0x7fb67800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695372640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780051d0 0x7fb67800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695372640 1 -- 172.21.15.94:0/339363198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb678003530 con 0x7fb6780039c0 2024-09-11T23:17:46.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695b73640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780051d0 0x7fb67800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:46.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.686+0000 7fb695b73640 1 -- 172.21.15.94:0/339363198 reap_dead start 2024-09-11T23:17:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb695372640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6780039c0 0x7fb678003de0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb684009ac0 tx=0x7fb68401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75291239e26de2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb684009690 con 0x7fb6780039c0 2024-09-11T23:17:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6840a6510 con 0x7fb6780039c0 2024-09-11T23:17:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb68ffff640 1 -- 172.21.15.94:0/339363198 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6840a68e0 con 0x7fb6780039c0 2024-09-11T23:17:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 -- 172.21.15.94:0/339363198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6780039c0 msgr2=0x7fb678003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6780039c0 0x7fb678003de0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb684009ac0 tx=0x7fb68401ca20 comp rx=0 tx=0).stop 2024-09-11T23:17:46.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 -- 172.21.15.94:0/339363198 shutdown_connections 2024-09-11T23:17:46.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 --2- 172.21.15.94:0/339363198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6780039c0 0x7fb678003de0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 -- 172.21.15.94:0/339363198 >> 172.21.15.94:0/339363198 conn(0x7fb69008bf90 msgr2=0x7fb69009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:46.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 -- 172.21.15.94:0/339363198 shutdown_connections 2024-09-11T23:17:46.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 -- 172.21.15.94:0/339363198 wait complete. 2024-09-11T23:17:46.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 Processor -- start 2024-09-11T23:17:46.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.690+0000 7fb6975d6640 1 -- start start 2024-09-11T23:17:46.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780039c0 0x7fb69014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6901fba40 0x7fb6900b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6901faea0 0x7fb6901fb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900cf320 con 0x7fb6901faea0 2024-09-11T23:17:46.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb69006d190 con 0x7fb6780039c0 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6900cf4a0 con 0x7fb6901fba40 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6901faea0 0x7fb6901fb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6901faea0 0x7fb6901fb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35098/0 (socket says 172.21.15.94:35098) 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 -- 172.21.15.94:0/4268021417 learned_addr learned my addr 172.21.15.94:0/4268021417 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695372640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780039c0 0x7fb69014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 -- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6901fba40 msgr2=0x7fb6900b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6901fba40 0x7fb6900b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 -- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780039c0 msgr2=0x7fb69014b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780039c0 0x7fb69014b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 -- 172.21.15.94:0/4268021417 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69014b8f0 con 0x7fb6901faea0 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695b73640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6901faea0 0x7fb6901fb320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb6900d5140 tx=0x7fb68000d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb68dffb640 1 -- 172.21.15.94:0/4268021417 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680007440 con 0x7fb6901faea0 2024-09-11T23:17:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb68dffb640 1 -- 172.21.15.94:0/4268021417 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680007620 con 0x7fb6901faea0 2024-09-11T23:17:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6900b9b30 con 0x7fb6901faea0 2024-09-11T23:17:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb68dffb640 1 -- 172.21.15.94:0/4268021417 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680004a30 con 0x7fb6901faea0 2024-09-11T23:17:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6900ba0f0 con 0x7fb6901faea0 2024-09-11T23:17:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6900d12b0 con 0x7fb6901faea0 2024-09-11T23:17:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb68dffb640 1 -- 172.21.15.94:0/4268021417 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb680004bd0 con 0x7fb6901faea0 2024-09-11T23:17:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb68dffb640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb67c0678c0 0x7fb67c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb68dffb640 1 -- 172.21.15.94:0/4268021417 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fb6800859d0 con 0x7fb6901faea0 2024-09-11T23:17:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.694+0000 7fb695372640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb67c0678c0 0x7fb67c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.698+0000 7fb695372640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb67c0678c0 0x7fb67c069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb6840af000 tx=0x7fb684008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:46.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.698+0000 7fb68dffb640 1 -- 172.21.15.94:0/4268021417 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb68001a060 con 0x7fb6901faea0 2024-09-11T23:17:46.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.858+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fb6900b4050 con 0x7fb6901faea0 2024-09-11T23:17:46.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.862+0000 7fb68dffb640 1 -- 172.21.15.94:0/4268021417 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 124+0+0 (secure 0 0 0) 0x7fb680056380 con 0x7fb6901faea0 2024-09-11T23:17:46.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb67c0678c0 msgr2=0x7fb67c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb67c0678c0 0x7fb67c069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb6840af000 tx=0x7fb684008040 comp rx=0 tx=0).stop 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6901faea0 msgr2=0x7fb6901fb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6901faea0 0x7fb6901fb320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb6900d5140 tx=0x7fb68000d900 comp rx=0 tx=0).stop 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 shutdown_connections 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb67c0678c0 0x7fb67c069d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6901faea0 0x7fb6901fb320 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6901fba40 0x7fb6900b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 --2- 172.21.15.94:0/4268021417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6780039c0 0x7fb69014b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 >> 172.21.15.94:0/4268021417 conn(0x7fb69008bf90 msgr2=0x7fb69015e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 shutdown_connections 2024-09-11T23:17:46.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:46.866+0000 7fb6975d6640 1 -- 172.21.15.94:0/4268021417 wait complete. 2024-09-11T23:17:46.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 1 2024-09-11T23:17:47.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f534b49b640 1 Processor -- start 2024-09-11T23:17:47.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f534b49b640 1 -- start start 2024-09-11T23:17:47.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f534b49b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 0x7f5344071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f534b49b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f534406bcc0 0x7f534406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f534b49b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5344073890 con 0x7f53441471e0 2024-09-11T23:17:47.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f534b49b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f53440716c0 con 0x7f534406bcc0 2024-09-11T23:17:47.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f534b49b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f534406c670 con 0x7f5344073470 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5349237640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f53441471e0 0x7f53440b4c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45428/0 (socket says 172.21.15.94:45428) 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5349237640 1 -- 172.21.15.94:0/66770335 learned_addr learned my addr 172.21.15.94:0/66770335 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5348a36640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 0x7f5344071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5349a38640 1 --2- 172.21.15.94:0/66770335 >> v2:172.21.15.155:3300/0 conn(0x7f534406bcc0 0x7f534406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102969110 0 0) 0x7f5344073890 con 0x7f53441471e0 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5330003530 con 0x7f53441471e0 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 599827661 0 0) 0x7f5330003530 con 0x7f53441471e0 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 msgr2=0x7f5344071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 0x7f5344071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 >> v2:172.21.15.155:3300/0 conn(0x7f534406bcc0 msgr2=0x7f534406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 --2- 172.21.15.94:0/66770335 >> v2:172.21.15.155:3300/0 conn(0x7f534406bcc0 0x7f534406c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53440703c0 con 0x7f53441471e0 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f5340001680 con 0x7f53441471e0 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 >> v1:172.21.15.94:6789/0 conn(0x7f53441471e0 legacy=0x7f53440b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53300039c0 0x7f5330003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5330004810 0x7f5330004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 0x7f53300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53440716c0 con 0x7f5330004810 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f534406c670 con 0x7f53300039c0 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f533000b9d0 con 0x7f5344073470 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5348a36640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5330004810 0x7f5330004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5348a36640 1 -- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 msgr2=0x7f53300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5349a38640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 0x7f53300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5349237640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53300039c0 0x7f5330003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5348a36640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5344073470 0x7f53300051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5348a36640 1 -- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53300039c0 msgr2=0x7f5330003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5348a36640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53300039c0 0x7f5330003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.010+0000 7f5348a36640 1 -- 172.21.15.94:0/66770335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5330003530 con 0x7f5330004810 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f5348a36640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5330004810 0x7f5330004c90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5334009ae0 tx=0x7f533401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b5a9065404f973 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340b2070 con 0x7f5330004810 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53340a5580 con 0x7f5330004810 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f533bfff640 1 -- 172.21.15.94:0/66770335 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340096b0 con 0x7f5330004810 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- 172.21.15.94:0/66770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5330004810 msgr2=0x7f5330004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 --2- 172.21.15.94:0/66770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5330004810 0x7f5330004c90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5334009ae0 tx=0x7f533401ca70 comp rx=0 tx=0).stop 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f5349a38640 1 -- 172.21.15.94:0/66770335 reap_dead start 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- 172.21.15.94:0/66770335 shutdown_connections 2024-09-11T23:17:47.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- 172.21.15.94:0/66770335 >> 172.21.15.94:0/66770335 conn(0x7f53440b2de0 msgr2=0x7f53440b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- 172.21.15.94:0/66770335 shutdown_connections 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- 172.21.15.94:0/66770335 wait complete. 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 Processor -- start 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- start start 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5330004810 0x7f53440c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53440ae8c0 0x7f53441416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53440aed40 0x7f5344141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5344070c60 con 0x7f53440aed40 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5344070980 con 0x7f53440ae8c0 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f534b49b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5344071180 con 0x7f5330004810 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f5349a38640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53440aed40 0x7f5344141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f5349a38640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53440aed40 0x7f5344141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35122/0 (socket says 172.21.15.94:35122) 2024-09-11T23:17:47.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f5349a38640 1 -- 172.21.15.94:0/2055385327 learned_addr learned my addr 172.21.15.94:0/2055385327 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.014+0000 7f5348a36640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53440ae8c0 0x7f53441416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349237640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5330004810 0x7f53440c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349a38640 1 -- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5330004810 msgr2=0x7f53440c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349a38640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5330004810 0x7f53440c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349a38640 1 -- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53440ae8c0 msgr2=0x7f53441416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349a38640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53440ae8c0 0x7f53441416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349a38640 1 -- 172.21.15.94:0/2055385327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53440af310 con 0x7f53440aed40 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349a38640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53440aed40 0x7f5344141bf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f53440b4c10 tx=0x7f533c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5339ffb640 1 -- 172.21.15.94:0/2055385327 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c01c070 con 0x7f53440aed40 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5339ffb640 1 -- 172.21.15.94:0/2055385327 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c017400 con 0x7f53440aed40 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5339ffb640 1 -- 172.21.15.94:0/2055385327 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0177f0 con 0x7f53440aed40 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53440af5f0 con 0x7f53440aed40 2024-09-11T23:17:47.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53440afbb0 con 0x7f53440aed40 2024-09-11T23:17:47.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f534406c130 con 0x7f53440aed40 2024-09-11T23:17:47.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5339ffb640 1 -- 172.21.15.94:0/2055385327 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f533c01f070 con 0x7f53440aed40 2024-09-11T23:17:47.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5339ffb640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f53280678c0 0x7f5328069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5339ffb640 1 -- 172.21.15.94:0/2055385327 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f533c0862e0 con 0x7f53440aed40 2024-09-11T23:17:47.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349237640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f53280678c0 0x7f5328069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.018+0000 7f5349237640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f53280678c0 0x7f5328069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5340004880 tx=0x7f5340001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:47.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.022+0000 7f5339ffb640 1 -- 172.21.15.94:0/2055385327 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f533c012070 con 0x7f53440aed40 2024-09-11T23:17:47.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.186+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f53440b0b30 con 0x7f53440aed40 2024-09-11T23:17:47.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.190+0000 7f5339ffb640 1 -- 172.21.15.94:0/2055385327 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7f533c056c90 con 0x7f53440aed40 2024-09-11T23:17:47.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f53280678c0 msgr2=0x7f5328069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f53280678c0 0x7f5328069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5340004880 tx=0x7f5340001440 comp rx=0 tx=0).stop 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53440aed40 msgr2=0x7f5344141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53440aed40 0x7f5344141bf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f53440b4c10 tx=0x7f533c00f4a0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 shutdown_connections 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f53280678c0 0x7f5328069d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53440aed40 0x7f5344141bf0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53440ae8c0 0x7f53441416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 --2- 172.21.15.94:0/2055385327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5330004810 0x7f53440c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 >> 172.21.15.94:0/2055385327 conn(0x7f53440b2de0 msgr2=0x7f53440b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 shutdown_connections 2024-09-11T23:17:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:47.194+0000 7f534b49b640 1 -- 172.21.15.94:0/2055385327 wait complete. 2024-09-11T23:17:57.213 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:57.213 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:57.220 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:17:57.220 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:17:57.220 DEBUG:teuthology.orchestra.run.smithi094:> import uuid 2024-09-11T23:17:57.220 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:57.220 DEBUG:teuthology.orchestra.run.smithi094:> n = 50 2024-09-11T23:17:57.220 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = False 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> if 0 > 0: 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = True 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> dpath = os.path.dirname(path) 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> fnameprefix = os.path.basename(path) 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> os.makedirs(dpath, exist_ok=True) 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> try: 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> for i in range(n): 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T23:17:57.221 DEBUG:teuthology.orchestra.run.smithi094:> f.write(f"{i}") 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> f.flush() 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(f.fileno()) 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> os.unlink(fpath) 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> if create_hard_links: 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> for j in range(0): 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> if True: 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> finally: 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> os.close(dirfd) 2024-09-11T23:17:57.222 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:17:57.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:17:57.491 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:57.491 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:57.538 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:17:57.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6098d8640 1 Processor -- start 2024-09-11T23:17:57.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6098d8640 1 -- start start 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6098d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc6040d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6098d8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6040af300 con 0x7fc6040aee70 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6098d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6040af5e0 con 0x7fc6040adad0 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6098d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc6040af8c0 con 0x7fc604155450 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6027fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc6040aee70 0x7fc6040cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42204/0 (socket says 172.21.15.94:42204) 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6027fc640 1 -- 172.21.15.94:0/336467603 learned_addr learned my addr 172.21.15.94:0/336467603 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6037fe640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc6040d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074595405 0 0) 0x7fc6040af300 con 0x7fc6040aee70 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5ec003530 con 0x7fc6040aee70 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4257757265 0 0) 0x7fc5ec003530 con 0x7fc6040aee70 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 msgr2=0x7fc6040d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:57.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc6040d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 >> v1:172.21.15.155:6789/0 conn(0x7fc6040adad0 legacy=0x7fc604154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6040afba0 con 0x7fc6040aee70 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fc5f8001680 con 0x7fc6040aee70 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6037fe640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc6040d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 >> v1:172.21.15.94:6789/0 conn(0x7fc6040aee70 legacy=0x7fc6040cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc5ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5ec004810 0x7fc5ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc5ec005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040af8c0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec00bb60 con 0x7fc5ec004810 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ec00bd10 con 0x7fc604155450 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc602ffd640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc5ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6027fc640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5ec004810 0x7fc5ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc602ffd640 1 -- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 msgr2=0x7fc5ec005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6037fe640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc5ec005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc602ffd640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc5ec005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc602ffd640 1 -- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5ec004810 msgr2=0x7fc5ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc602ffd640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5ec004810 0x7fc5ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc602ffd640 1 -- 172.21.15.94:0/336467603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec003530 con 0x7fc5ec0039f0 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6037fe640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604155450 0x7fc5ec005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:57.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.709+0000 7fc6027fc640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5ec004810 0x7fc5ec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:57.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc602ffd640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc5ec003e10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001780 tx=0x7fc5f401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a032edb85ff4b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40013a0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f40052f0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc601ffb640 1 -- 172.21.15.94:0/336467603 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40a4e60 con 0x7fc5ec0039f0 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 -- 172.21.15.94:0/336467603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 msgr2=0x7fc5ec003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 --2- 172.21.15.94:0/336467603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc5ec003e10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001780 tx=0x7fc5f401c420 comp rx=0 tx=0).stop 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6037fe640 1 -- 172.21.15.94:0/336467603 reap_dead start 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 -- 172.21.15.94:0/336467603 shutdown_connections 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 -- 172.21.15.94:0/336467603 >> 172.21.15.94:0/336467603 conn(0x7fc6040736d0 msgr2=0x7fc60406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 -- 172.21.15.94:0/336467603 shutdown_connections 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 -- 172.21.15.94:0/336467603 wait complete. 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 Processor -- start 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.713+0000 7fc6098d8640 1 -- start start 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc604150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6041679f0 0x7fc6041505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6041541f0 0x7fc604154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040b0520 con 0x7fc5ec0039f0 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040b03a0 con 0x7fc6041541f0 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc60415f320 con 0x7fc6041679f0 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc604150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc604150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33090/0 (socket says 172.21.15.94:33090) 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 -- 172.21.15.94:0/36404807 learned_addr learned my addr 172.21.15.94:0/36404807 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6037fe640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6041541f0 0x7fc604154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6027fc640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6041679f0 0x7fc6041505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 -- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6041679f0 msgr2=0x7fc6041505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6041679f0 0x7fc6041505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 -- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6041541f0 msgr2=0x7fc604154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6041541f0 0x7fc604154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 -- 172.21.15.94:0/36404807 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc604165dd0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc602ffd640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc604150c50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001780 tx=0x7fc5ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc5ebfff640 1 -- 172.21.15.94:0/36404807 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ba020 con 0x7fc5ec0039f0 2024-09-11T23:17:57.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc5ebfff640 1 -- 172.21.15.94:0/36404807 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f40054a0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc5ebfff640 1 -- 172.21.15.94:0/36404807 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4007a40 con 0x7fc5ec0039f0 2024-09-11T23:17:57.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6041660b0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc604163050 con 0x7fc5ec0039f0 2024-09-11T23:17:57.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc604167dd0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc5ebfff640 1 -- 172.21.15.94:0/36404807 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc5f40bd020 con 0x7fc5ec0039f0 2024-09-11T23:17:57.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc5ebfff640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc5f00678c0 0x7fc5f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc5ebfff640 1 -- 172.21.15.94:0/36404807 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fc5f411feb0 con 0x7fc5ec0039f0 2024-09-11T23:17:57.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.717+0000 7fc6027fc640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc5f00678c0 0x7fc5f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.721+0000 7fc6027fc640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc5f00678c0 0x7fc5f0069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8000c10 tx=0x7fc5f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.721+0000 7fc5ebfff640 1 -- 172.21.15.94:0/36404807 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc5f40c4030 con 0x7fc5ec0039f0 2024-09-11T23:17:57.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.897+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc60415f700 con 0x7fc5ec0039f0 2024-09-11T23:17:57.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.897+0000 7fc5ebfff640 1 -- 172.21.15.94:0/36404807 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7fc5f4016130 con 0x7fc5ec0039f0 2024-09-11T23:17:57.899 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.897+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc5f00678c0 msgr2=0x7fc5f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.897+0000 7fc6098d8640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc5f00678c0 0x7fc5f0069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8000c10 tx=0x7fc5f8009040 comp rx=0 tx=0).stop 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.897+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 msgr2=0x7fc604150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.897+0000 7fc6098d8640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc604150c50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001780 tx=0x7fc5ec005840 comp rx=0 tx=0).stop 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 shutdown_connections 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6041541f0 0x7fc604154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6041679f0 0x7fc6041505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc5f00678c0 0x7fc5f0069d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 --2- 172.21.15.94:0/36404807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5ec0039f0 0x7fc604150c50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 >> 172.21.15.94:0/36404807 conn(0x7fc6040736d0 msgr2=0x7fc6041610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:57.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 shutdown_connections 2024-09-11T23:17:57.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:57.901+0000 7fc6098d8640 1 -- 172.21.15.94:0/36404807 wait complete. 2024-09-11T23:17:57.918 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:17:57.918 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:17:57.924 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:17:58.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 Processor -- start 2024-09-11T23:17:58.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 -- start start 2024-09-11T23:17:58.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff6c15bec0 0x7eff6c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15c2a0 0x7eff6c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff6c0af2a0 0x7eff6c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7eff6c0b3290 con 0x7eff6c15bec0 2024-09-11T23:17:58.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7eff6c0b3570 con 0x7eff6c0af2a0 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff72c47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff6c0b3850 con 0x7eff6c15c2a0 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff6c15bec0 0x7eff6c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff6c15bec0 0x7eff6c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33102/0 (socket says 172.21.15.94:33102) 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 -- 172.21.15.94:0/615622723 learned_addr learned my addr 172.21.15.94:0/615622723 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff6bfff640 1 --2- 172.21.15.94:0/615622723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15c2a0 0x7eff6c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff711e4640 1 --2- 172.21.15.94:0/615622723 >> v2:172.21.15.155:3300/0 conn(0x7eff6c0af2a0 0x7eff6c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 -- 172.21.15.94:0/615622723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15c2a0 msgr2=0x7eff6c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 --2- 172.21.15.94:0/615622723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15c2a0 0x7eff6c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 -- 172.21.15.94:0/615622723 >> v2:172.21.15.155:3300/0 conn(0x7eff6c0af2a0 msgr2=0x7eff6c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 --2- 172.21.15.94:0/615622723 >> v2:172.21.15.155:3300/0 conn(0x7eff6c0af2a0 0x7eff6c15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff709e3640 1 -- 172.21.15.94:0/615622723 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c0b3b30 con 0x7eff6c15bec0 2024-09-11T23:17:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.081+0000 7eff711e4640 1 --2- 172.21.15.94:0/615622723 >> v2:172.21.15.155:3300/0 conn(0x7eff6c0af2a0 0x7eff6c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff709e3640 1 --2- 172.21.15.94:0/615622723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15bec0 0x7eff6c0ad200 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7eff6c06dc90 tx=0x7eff6401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d5da6ac697fb36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff6b7fe640 1 -- 172.21.15.94:0/615622723 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640a5580 con 0x7eff6c15bec0 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff6b7fe640 1 -- 172.21.15.94:0/615622723 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff640a5720 con 0x7eff6c15bec0 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff6b7fe640 1 -- 172.21.15.94:0/615622723 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640a5af0 con 0x7eff6c15bec0 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 -- 172.21.15.94:0/615622723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15bec0 msgr2=0x7eff6c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 --2- 172.21.15.94:0/615622723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15bec0 0x7eff6c0ad200 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7eff6c06dc90 tx=0x7eff6401c700 comp rx=0 tx=0).stop 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 -- 172.21.15.94:0/615622723 shutdown_connections 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 --2- 172.21.15.94:0/615622723 >> v2:172.21.15.155:3300/0 conn(0x7eff6c0af2a0 0x7eff6c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 --2- 172.21.15.94:0/615622723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15c2a0 0x7eff6c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 --2- 172.21.15.94:0/615622723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15bec0 0x7eff6c0ad200 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 -- 172.21.15.94:0/615622723 >> 172.21.15.94:0/615622723 conn(0x7eff6c0b1f90 msgr2=0x7eff6c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:58.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 -- 172.21.15.94:0/615622723 shutdown_connections 2024-09-11T23:17:58.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.085+0000 7eff72c47640 1 -- 172.21.15.94:0/615622723 wait complete. 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 Processor -- start 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 -- start start 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6c0af2a0 0x7eff6c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15bec0 0x7eff6c166640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15c2a0 0x7eff6c0998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c0af6b0 con 0x7eff6c15c2a0 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c0ad740 con 0x7eff6c0af2a0 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff6c06e000 con 0x7eff6c15bec0 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15c2a0 0x7eff6c0998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15c2a0 0x7eff6c0998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33108/0 (socket says 172.21.15.94:33108) 2024-09-11T23:17:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 -- 172.21.15.94:0/2448409471 learned_addr learned my addr 172.21.15.94:0/2448409471 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff6bfff640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15bec0 0x7eff6c166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff709e3640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6c0af2a0 0x7eff6c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 -- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15bec0 msgr2=0x7eff6c166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15bec0 0x7eff6c166640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 -- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6c0af2a0 msgr2=0x7eff6c152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6c0af2a0 0x7eff6c152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 -- 172.21.15.94:0/2448409471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c0af930 con 0x7eff6c15c2a0 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff6bfff640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15bec0 0x7eff6c166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff711e4640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15c2a0 0x7eff6c0998d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c7f0 tx=0x7eff5c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff697fa640 1 -- 172.21.15.94:0/2448409471 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c015070 con 0x7eff6c15c2a0 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff697fa640 1 -- 172.21.15.94:0/2448409471 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5c007860 con 0x7eff6c15c2a0 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6c15e760 con 0x7eff6c15c2a0 2024-09-11T23:17:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff697fa640 1 -- 172.21.15.94:0/2448409471 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c007c50 con 0x7eff6c15c2a0 2024-09-11T23:17:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6c15ed20 con 0x7eff6c15c2a0 2024-09-11T23:17:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6c0ad200 con 0x7eff6c15c2a0 2024-09-11T23:17:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff697fa640 1 -- 172.21.15.94:0/2448409471 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff5c018070 con 0x7eff6c15c2a0 2024-09-11T23:17:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff697fa640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff4c0678f0 0x7eff4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff697fa640 1 -- 172.21.15.94:0/2448409471 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7eff5c086000 con 0x7eff6c15c2a0 2024-09-11T23:17:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.089+0000 7eff709e3640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff4c0678f0 0x7eff4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.093+0000 7eff709e3640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff4c0678f0 0x7eff4c069db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff640ae000 tx=0x7eff640a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.093+0000 7eff697fa640 1 -- 172.21.15.94:0/2448409471 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff5c056920 con 0x7eff6c15c2a0 2024-09-11T23:17:58.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.269+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7eff6c06fcd0 con 0x7eff6c15c2a0 2024-09-11T23:17:58.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.269+0000 7eff697fa640 1 -- 172.21.15.94:0/2448409471 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7eff5c056220 con 0x7eff6c15c2a0 2024-09-11T23:17:58.271 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.269+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff4c0678f0 msgr2=0x7eff4c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.269+0000 7eff72c47640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff4c0678f0 0x7eff4c069db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff640ae000 tx=0x7eff640a7070 comp rx=0 tx=0).stop 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.269+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15c2a0 msgr2=0x7eff6c0998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.269+0000 7eff72c47640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15c2a0 0x7eff6c0998d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c7f0 tx=0x7eff5c00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 shutdown_connections 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff4c0678f0 0x7eff4c069db0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c15c2a0 0x7eff6c0998d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c15bec0 0x7eff6c166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 --2- 172.21.15.94:0/2448409471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6c0af2a0 0x7eff6c152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 >> 172.21.15.94:0/2448409471 conn(0x7eff6c0b1f90 msgr2=0x7eff6c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:58.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 shutdown_connections 2024-09-11T23:17:58.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:17:58.273+0000 7eff72c47640 1 -- 172.21.15.94:0/2448409471 wait complete. 2024-09-11T23:17:58.289 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:17:58.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:17:58.289 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:17:58.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[40881]: fuse finished with error 0 and tester_r 0 2024-09-11T23:17:58.301 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:04.403 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:04.404 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:18:04.412 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:04.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.581+0000 7fea5d528640 1 Processor -- start 2024-09-11T23:18:04.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea5d528640 1 -- start start 2024-09-11T23:18:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea5d528640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea58073e60 0x7fea5806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea5d528640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fea5806fef0 0x7fea5815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea5d528640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5815bda0 con 0x7fea580b3d50 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea5d528640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fea5806ee50 con 0x7fea5806fef0 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea5d528640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fea5806f130 con 0x7fea58073e60 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea577fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fea580b3d50 0x7fea580b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55816/0 (socket says 172.21.15.94:55816) 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea577fe640 1 -- 172.21.15.94:0/175765312 learned_addr learned my addr 172.21.15.94:0/175765312 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea567fc640 1 --2- 172.21.15.94:0/175765312 >> v2:172.21.15.94:3300/0 conn(0x7fea5806fef0 0x7fea5815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea55ffb640 1 -- 172.21.15.94:0/175765312 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214428961 0 0) 0x7fea5815bda0 con 0x7fea580b3d50 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea55ffb640 1 -- 172.21.15.94:0/175765312 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea44003530 con 0x7fea580b3d50 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea56ffd640 1 --2- 172.21.15.94:0/175765312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea58073e60 0x7fea5806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea567fc640 1 -- 172.21.15.94:0/175765312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea58073e60 msgr2=0x7fea5806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea567fc640 1 --2- 172.21.15.94:0/175765312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea58073e60 0x7fea5806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea567fc640 1 -- 172.21.15.94:0/175765312 >> v1:172.21.15.94:6789/0 conn(0x7fea580b3d50 legacy=0x7fea580b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea567fc640 1 -- 172.21.15.94:0/175765312 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5806f410 con 0x7fea5806fef0 2024-09-11T23:18:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea567fc640 1 --2- 172.21.15.94:0/175765312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea5806fef0 0x7fea5815b860 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fea400097c0 tx=0x7fea4001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3550db4fc99da64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.585+0000 7fea55ffb640 1 -- 172.21.15.94:0/175765312 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea400b0070 con 0x7fea5806fef0 2024-09-11T23:18:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea55ffb640 1 -- 172.21.15.94:0/175765312 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea400ab600 con 0x7fea5806fef0 2024-09-11T23:18:04.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea55ffb640 1 -- 172.21.15.94:0/175765312 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea400ab9d0 con 0x7fea5806fef0 2024-09-11T23:18:04.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- 172.21.15.94:0/175765312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea5806fef0 msgr2=0x7fea5815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 --2- 172.21.15.94:0/175765312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea5806fef0 0x7fea5815b860 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fea400097c0 tx=0x7fea4001c410 comp rx=0 tx=0).stop 2024-09-11T23:18:04.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- 172.21.15.94:0/175765312 shutdown_connections 2024-09-11T23:18:04.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 --2- 172.21.15.94:0/175765312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea5806fef0 0x7fea5815b860 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 --2- 172.21.15.94:0/175765312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea58073e60 0x7fea5806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- 172.21.15.94:0/175765312 >> 172.21.15.94:0/175765312 conn(0x7fea580b1f90 msgr2=0x7fea580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:04.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- 172.21.15.94:0/175765312 shutdown_connections 2024-09-11T23:18:04.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- 172.21.15.94:0/175765312 wait complete. 2024-09-11T23:18:04.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 Processor -- start 2024-09-11T23:18:04.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- start start 2024-09-11T23:18:04.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5806fef0 0x7fea58150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea58073e60 0x7fea5814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea580b3d50 0x7fea5814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fea580729e0 con 0x7fea58073e60 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea58072860 con 0x7fea5806fef0 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fea58072b60 con 0x7fea580b3d50 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea58073e60 0x7fea5814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea58073e60 0x7fea5814a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35800/0 (socket says 172.21.15.94:35800) 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 -- 172.21.15.94:0/1440614944 learned_addr learned my addr 172.21.15.94:0/1440614944 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea577fe640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea580b3d50 0x7fea5814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea56ffd640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5806fef0 0x7fea58150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 -- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea580b3d50 msgr2=0x7fea5814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea580b3d50 0x7fea5814e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 -- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5806fef0 msgr2=0x7fea58150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5806fef0 0x7fea58150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 -- 172.21.15.94:0/1440614944 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea581686c0 con 0x7fea58073e60 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea567fc640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea58073e60 0x7fea5814a660 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fea4001a040 tx=0x7fea400191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea4f7fe640 1 -- 172.21.15.94:0/1440614944 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea400b0040 con 0x7fea58073e60 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea4f7fe640 1 -- 172.21.15.94:0/1440614944 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea400b9070 con 0x7fea58073e60 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea4f7fe640 1 -- 172.21.15.94:0/1440614944 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40006e20 con 0x7fea58073e60 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea580ae9e0 con 0x7fea58073e60 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.589+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea580aefa0 con 0x7fea58073e60 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.593+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5806e800 con 0x7fea58073e60 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.593+0000 7fea4f7fe640 1 -- 172.21.15.94:0/1440614944 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fea400b4650 con 0x7fea58073e60 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.593+0000 7fea4f7fe640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fea380678c0 0x7fea38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.593+0000 7fea4f7fe640 1 -- 172.21.15.94:0/1440614944 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fea4011fbc0 con 0x7fea58073e60 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.593+0000 7fea56ffd640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fea380678c0 0x7fea38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.593+0000 7fea56ffd640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fea380678c0 0x7fea38069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea50009f30 tx=0x7fea5000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.597+0000 7fea4f7fe640 1 -- 172.21.15.94:0/1440614944 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fea40016090 con 0x7fea58073e60 2024-09-11T23:18:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.785+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea580723f0 con 0x7fea58073e60 2024-09-11T23:18:04.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.785+0000 7fea4f7fe640 1 -- 172.21.15.94:0/1440614944 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7fea400f04e0 con 0x7fea58073e60 2024-09-11T23:18:04.788 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:04.788 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:18:04.789 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:18:04.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fea380678c0 msgr2=0x7fea38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fea380678c0 0x7fea38069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea50009f30 tx=0x7fea5000b040 comp rx=0 tx=0).stop 2024-09-11T23:18:04.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea58073e60 msgr2=0x7fea5814a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea58073e60 0x7fea5814a660 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fea4001a040 tx=0x7fea400191b0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 shutdown_connections 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea580b3d50 0x7fea5814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fea380678c0 0x7fea38069d80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea58073e60 0x7fea5814a660 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 --2- 172.21.15.94:0/1440614944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5806fef0 0x7fea58150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 >> 172.21.15.94:0/1440614944 conn(0x7fea580b1f90 msgr2=0x7fea580d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 shutdown_connections 2024-09-11T23:18:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:04.789+0000 7fea5d528640 1 -- 172.21.15.94:0/1440614944 wait complete. 2024-09-11T23:18:04.806 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dirfrag split /subdir 0/0 1 2024-09-11T23:18:04.942 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-11T23:18:04.943 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.061+0000 7f4e3a14c640 1 Processor -- start 2024-09-11T23:18:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.061+0000 7f4e3a14c640 1 -- start start 2024-09-11T23:18:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e3a14c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 0x7f4e3415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e3a14c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e340aede0 con 0x7f4e3415f1d0 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e3a14c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e3415fa10 con 0x7f4e341520a0 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e3a14c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e34152480 con 0x7f4e34070020 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e33fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4e3415f1d0 0x7f4e340adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55826/0 (socket says 172.21.15.94:55826) 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e33fff640 1 -- 172.21.15.94:0/3396381781 learned_addr learned my addr 172.21.15.94:0/3396381781 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e2affd640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 0x7f4e3415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987794245 0 0) 0x7f4e340aede0 con 0x7f4e3415f1d0 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e20005740 con 0x7f4e3415f1d0 2024-09-11T23:18:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 283468640 0 0) 0x7f4e20005740 con 0x7f4e3415f1d0 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 msgr2=0x7f4e3415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 0x7f4e3415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 >> v1:172.21.15.155:6789/0 conn(0x7f4e341520a0 legacy=0x7f4e3406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e34074250 con 0x7f4e3415f1d0 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f4e2c001a00 con 0x7f4e3415f1d0 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 >> v1:172.21.15.94:6789/0 conn(0x7f4e3415f1d0 legacy=0x7f4e340adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e20005c00 0x7f4e20006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 0x7f4e20006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20006f60 0x7f4e200073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2000dc90 con 0x7f4e20005c00 2024-09-11T23:18:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2000de10 con 0x7f4e20006f60 2024-09-11T23:18:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2000e010 con 0x7f4e34070020 2024-09-11T23:18:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e337fe640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e20005c00 0x7f4e20006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e2affd640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 0x7f4e20006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e33fff640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20006f60 0x7f4e200073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e337fe640 1 -- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 msgr2=0x7f4e20006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e337fe640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e34070020 0x7f4e20006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e337fe640 1 -- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20006f60 msgr2=0x7f4e200073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e337fe640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20006f60 0x7f4e200073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.065+0000 7f4e337fe640 1 -- 172.21.15.94:0/3396381781 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e20005740 con 0x7f4e20005c00 2024-09-11T23:18:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e337fe640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e20005c00 0x7f4e20006020 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4e24001750 tx=0x7f4e2401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e16576a2139dce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240013a0 con 0x7f4e20005c00 2024-09-11T23:18:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e240052f0 con 0x7f4e20005c00 2024-09-11T23:18:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e32ffd640 1 -- 172.21.15.94:0/3396381781 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e340aeba0 con 0x7f4e20005c00 2024-09-11T23:18:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- 172.21.15.94:0/3396381781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e20005c00 msgr2=0x7f4e20006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 --2- 172.21.15.94:0/3396381781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e20005c00 0x7f4e20006020 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4e24001750 tx=0x7f4e2401c3b0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e33fff640 1 -- 172.21.15.94:0/3396381781 reap_dead start 2024-09-11T23:18:05.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- 172.21.15.94:0/3396381781 shutdown_connections 2024-09-11T23:18:05.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- 172.21.15.94:0/3396381781 >> 172.21.15.94:0/3396381781 conn(0x7f4e340b1f90 msgr2=0x7f4e340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- 172.21.15.94:0/3396381781 shutdown_connections 2024-09-11T23:18:05.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- 172.21.15.94:0/3396381781 wait complete. 2024-09-11T23:18:05.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 Processor -- start 2024-09-11T23:18:05.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- start start 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20005c00 0x7f4e341f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e34148800 0x7f4e340cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e340cf310 0x7f4e3415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3415f620 con 0x7f4e34148800 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e34073d30 con 0x7f4e340cf310 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e3a14c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3415f7a0 con 0x7f4e20005c00 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e34148800 0x7f4e340cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e34148800 0x7f4e340cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35816/0 (socket says 172.21.15.94:35816) 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 -- 172.21.15.94:0/1423845686 learned_addr learned my addr 172.21.15.94:0/1423845686 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e337fe640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20005c00 0x7f4e341f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e33fff640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e340cf310 0x7f4e3415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 -- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20005c00 msgr2=0x7f4e341f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20005c00 0x7f4e341f7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 -- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e340cf310 msgr2=0x7f4e3415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e340cf310 0x7f4e3415d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e2affd640 1 -- 172.21.15.94:0/1423845686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e341fa5b0 con 0x7f4e34148800 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e33fff640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e340cf310 0x7f4e3415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.069+0000 7f4e337fe640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20005c00 0x7f4e341f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e2affd640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e34148800 0x7f4e340cedd0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c011600 tx=0x7f4e1c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e30ff9640 1 -- 172.21.15.94:0/1423845686 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00f920 con 0x7f4e34148800 2024-09-11T23:18:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e30ff9640 1 -- 172.21.15.94:0/1423845686 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1c00fac0 con 0x7f4e34148800 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e30ff9640 1 -- 172.21.15.94:0/1423845686 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c015460 con 0x7f4e34148800 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e340b0150 con 0x7f4e34148800 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e340b0710 con 0x7f4e34148800 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e340adc80 con 0x7f4e34148800 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e30ff9640 1 -- 172.21.15.94:0/1423845686 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e1c015600 con 0x7f4e34148800 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e30ff9640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e140678c0 0x7f4e14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e30ff9640 1 -- 172.21.15.94:0/1423845686 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f4e1c086760 con 0x7f4e34148800 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e337fe640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e140678c0 0x7f4e14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.073+0000 7f4e337fe640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e140678c0 0x7f4e14069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4e20007a00 tx=0x7f4e240011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.077+0000 7f4e30ff9640 1 -- 172.21.15.94:0/1423845686 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4e1c019030 con 0x7f4e34148800 2024-09-11T23:18:05.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.273+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e3406e540 con 0x7f4e34148800 2024-09-11T23:18:05.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e30ff9640 1 -- 172.21.15.94:0/1423845686 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7f4e1c057080 con 0x7f4e34148800 2024-09-11T23:18:05.277 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:05.278 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:18:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e140678c0 msgr2=0x7f4e14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e140678c0 0x7f4e14069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4e20007a00 tx=0x7f4e240011a0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e34148800 msgr2=0x7f4e340cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e34148800 0x7f4e340cedd0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c011600 tx=0x7f4e1c011ac0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 shutdown_connections 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e340cf310 0x7f4e3415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4e140678c0 0x7f4e14069d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e34148800 0x7f4e340cedd0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 --2- 172.21.15.94:0/1423845686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20005c00 0x7f4e341f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 >> 172.21.15.94:0/1423845686 conn(0x7f4e340b1f90 msgr2=0x7f4e3406ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 shutdown_connections 2024-09-11T23:18:05.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.277+0000 7f4e3a14c640 1 -- 172.21.15.94:0/1423845686 wait complete. 2024-09-11T23:18:05.297 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-11T23:18:05.465 INFO:teuthology.orchestra.run.smithi094.stdout:{"message":"","return_code":0} 2024-09-11T23:18:05.465 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T23:18:05.466 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:18:05.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e2c5a640 1 Processor -- start 2024-09-11T23:18:05.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e2c5a640 1 -- start start 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e2c5a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f17dc15e5f0 0x7f17dc06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e2c5a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f17dc0cfaf0 0x7f17dc0d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e2c5a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17dc06d9c0 con 0x7f17dc0ce9d0 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e2c5a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f17dc06dca0 con 0x7f17dc0cfaf0 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e2c5a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f17dc06df80 con 0x7f17dc15e5f0 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17dbfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f17dc0ce9d0 0x7f17dc0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55834/0 (socket says 172.21.15.94:55834) 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17dbfff640 1 -- 172.21.15.94:0/1141091328 learned_addr learned my addr 172.21.15.94:0/1141091328 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e11f7640 1 --2- 172.21.15.94:0/1141091328 >> v2:172.21.15.94:3300/0 conn(0x7f17dc0cfaf0 0x7f17dc0d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e09f6640 1 --2- 172.21.15.94:0/1141091328 >> v2:172.21.15.155:3300/0 conn(0x7f17dc15e5f0 0x7f17dc06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17db7fe640 1 -- 172.21.15.94:0/1141091328 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234045745 0 0) 0x7f17dc06d9c0 con 0x7f17dc0ce9d0 2024-09-11T23:18:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17db7fe640 1 -- 172.21.15.94:0/1141091328 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17c4003530 con 0x7f17dc0ce9d0 2024-09-11T23:18:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e11f7640 1 -- 172.21.15.94:0/1141091328 >> v2:172.21.15.155:3300/0 conn(0x7f17dc15e5f0 msgr2=0x7f17dc06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e11f7640 1 --2- 172.21.15.94:0/1141091328 >> v2:172.21.15.155:3300/0 conn(0x7f17dc15e5f0 0x7f17dc06d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e11f7640 1 -- 172.21.15.94:0/1141091328 >> v1:172.21.15.94:6789/0 conn(0x7f17dc0ce9d0 legacy=0x7f17dc0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.585+0000 7f17e11f7640 1 -- 172.21.15.94:0/1141091328 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc06e260 con 0x7f17dc0cfaf0 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e11f7640 1 --2- 172.21.15.94:0/1141091328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cfaf0 0x7f17dc0d2b60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f17dc08e380 tx=0x7f17d401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16f04cbf98e381a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17db7fe640 1 -- 172.21.15.94:0/1141091328 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d40b2070 con 0x7f17dc0cfaf0 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17db7fe640 1 -- 172.21.15.94:0/1141091328 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d40a5900 con 0x7f17dc0cfaf0 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17db7fe640 1 -- 172.21.15.94:0/1141091328 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d40a5cd0 con 0x7f17dc0cfaf0 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- 172.21.15.94:0/1141091328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cfaf0 msgr2=0x7f17dc0d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/1141091328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cfaf0 0x7f17dc0d2b60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f17dc08e380 tx=0x7f17d401c930 comp rx=0 tx=0).stop 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- 172.21.15.94:0/1141091328 shutdown_connections 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/1141091328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cfaf0 0x7f17dc0d2b60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/1141091328 >> v2:172.21.15.155:3300/0 conn(0x7f17dc15e5f0 0x7f17dc06d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- 172.21.15.94:0/1141091328 >> 172.21.15.94:0/1141091328 conn(0x7f17dc074030 msgr2=0x7f17dc09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- 172.21.15.94:0/1141091328 shutdown_connections 2024-09-11T23:18:05.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- 172.21.15.94:0/1141091328 wait complete. 2024-09-11T23:18:05.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 Processor -- start 2024-09-11T23:18:05.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- start start 2024-09-11T23:18:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17dc0cfaf0 0x7f17dc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cd9e0 0x7f17dc155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17dc157290 0x7f17dc157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc0d3c40 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc0d3ac0 con 0x7f17dc0cfaf0 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc16afa0 con 0x7f17dc157290 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cd9e0 0x7f17dc155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cd9e0 0x7f17dc155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35838/0 (socket says 172.21.15.94:35838) 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 -- 172.21.15.94:0/4228231742 learned_addr learned my addr 172.21.15.94:0/4228231742 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 -- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17dc157290 msgr2=0x7f17dc157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17dc157290 0x7f17dc157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 -- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17dc0cfaf0 msgr2=0x7f17dc0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17dc0cfaf0 0x7f17dc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 -- 172.21.15.94:0/4228231742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc0cdee0 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17dbfff640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cd9e0 0x7f17dc155dd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00c450 tx=0x7f17cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17d97fa640 1 -- 172.21.15.94:0/4228231742 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc017070 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17d97fa640 1 -- 172.21.15.94:0/4228231742 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc005cf0 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17dc0ce1c0 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17d97fa640 1 -- 172.21.15.94:0/4228231742 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc007290 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.589+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17dc0cb990 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.593+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17dc0d2b60 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.593+0000 7f17d97fa640 1 -- 172.21.15.94:0/4228231742 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17cc01a070 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.593+0000 7f17d97fa640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f17c80678f0 0x7f17c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.593+0000 7f17d97fa640 1 -- 172.21.15.94:0/4228231742 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f17cc085220 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.593+0000 7f17e09f6640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f17c80678f0 0x7f17c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.593+0000 7f17e09f6640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f17c80678f0 0x7f17c8069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0cccc0 tx=0x7f17d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.597+0000 7f17d97fa640 1 -- 172.21.15.94:0/4228231742 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17cc055b40 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.789+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17dc0ce390 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.789+0000 7f17d97fa640 1 -- 172.21.15.94:0/4228231742 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) ==== 53+0+73 (secure 0 0 0) 0x7f17cc055440 con 0x7f17dc0cd9e0 2024-09-11T23:18:05.791 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:18:05.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f17c80678f0 msgr2=0x7f17c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f17c80678f0 0x7f17c8069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0cccc0 tx=0x7f17d0008040 comp rx=0 tx=0).stop 2024-09-11T23:18:05.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cd9e0 msgr2=0x7f17dc155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cd9e0 0x7f17dc155dd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00c450 tx=0x7f17cc00c910 comp rx=0 tx=0).stop 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 shutdown_connections 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17dc157290 0x7f17dc157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f17c80678f0 0x7f17c8069db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc0cd9e0 0x7f17dc155dd0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 --2- 172.21.15.94:0/4228231742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17dc0cfaf0 0x7f17dc0cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 >> 172.21.15.94:0/4228231742 conn(0x7f17dc0ce9d0 msgr2=0x7f17dc15b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 shutdown_connections 2024-09-11T23:18:05.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:05.793+0000 7f17e2c5a640 1 -- 172.21.15.94:0/4228231742 wait complete. 2024-09-11T23:18:05.809 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:18:05.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:18:05.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:18:05.809 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:18:05.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:05.810 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:18:05.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:18:05.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:18:05.810 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:05.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:05.811 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:05.817 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42303sec preferred_lft 42303sec 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:18:05.818 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.819 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:18:05.820 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:05.820 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:18:05.820 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:05.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:05.820 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:18:05.872 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:18:05.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:05.873 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:18:05.925 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:18:05.925 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:18:05.925 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:18:05.926 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:18:05.926 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:05.927 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:18:05.927 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:18:05.927 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:18:05.927 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:18:05.927 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:18:06.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:06.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:06.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:06.047 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:18:06.052 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:18:06.053 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:18:06.053 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:06.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:06.053 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:18:06.110 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:18:06.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:06.110 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:06.158 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:06.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:06.158 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:06.205 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:18:06.264 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:18:06.315 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:18:06.316 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:06.317 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:06.318 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:06.318 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:06.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:06.318 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:18:06.362 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:18:06.362 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:18:06.406 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:18:06.420 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:18:06.466 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:18:06.467 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:06.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:06.468 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:18:06.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:18:06.481+0000 7f434986c580 -1 init, newargv = 0x55f2756c5f00 newargc=15 2024-09-11T23:18:06.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[41168]: starting ceph client 2024-09-11T23:18:06.487 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[41168]: starting fuse 2024-09-11T23:18:06.489 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:18:06.489 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:18:06.489 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:18:06.489 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:18:06.489 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:18:06.489 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:18:06.489 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:18:06.490 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:18:06.491 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:18:06.599 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.41168.asok 2024-09-11T23:18:06.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:06.610 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41168.asok 2024-09-11T23:18:06.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:06.611 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41168.asok status 2024-09-11T23:18:06.767 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:18:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:18:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "41168", 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5856, 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:18:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:18:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:18:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 5856 2024-09-11T23:18:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:18:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:18:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:18:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3619806198 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3619806198 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.5856 192.168.0.1:0/3619806198", 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/3619806198", 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 31, 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 64, 2024-09-11T23:18:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:18:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:18:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:18:06.771 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:18:06.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:06.781 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:18:06.781 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:06.787 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:18:06.788 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:06.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:06.788 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:06.841 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:06.841 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:06.891 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:18:06.891 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:18:06.891 DEBUG:teuthology.orchestra.run.smithi094:> import uuid 2024-09-11T23:18:06.891 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.891 DEBUG:teuthology.orchestra.run.smithi094:> n = 75 2024-09-11T23:18:06.892 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = False 2024-09-11T23:18:06.892 DEBUG:teuthology.orchestra.run.smithi094:> if 0 > 0: 2024-09-11T23:18:06.892 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = True 2024-09-11T23:18:06.892 DEBUG:teuthology.orchestra.run.smithi094:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-11T23:18:06.892 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.892 DEBUG:teuthology.orchestra.run.smithi094:> dpath = os.path.dirname(path) 2024-09-11T23:18:06.893 DEBUG:teuthology.orchestra.run.smithi094:> fnameprefix = os.path.basename(path) 2024-09-11T23:18:06.893 DEBUG:teuthology.orchestra.run.smithi094:> os.makedirs(dpath, exist_ok=True) 2024-09-11T23:18:06.893 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.893 DEBUG:teuthology.orchestra.run.smithi094:> try: 2024-09-11T23:18:06.893 DEBUG:teuthology.orchestra.run.smithi094:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T23:18:06.893 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:06.894 DEBUG:teuthology.orchestra.run.smithi094:> for i in range(n): 2024-09-11T23:18:06.894 DEBUG:teuthology.orchestra.run.smithi094:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T23:18:06.894 DEBUG:teuthology.orchestra.run.smithi094:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T23:18:06.894 DEBUG:teuthology.orchestra.run.smithi094:> f.write(f"{i}") 2024-09-11T23:18:06.894 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:18:06.895 DEBUG:teuthology.orchestra.run.smithi094:> f.flush() 2024-09-11T23:18:06.895 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(f.fileno()) 2024-09-11T23:18:06.895 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:18:06.895 DEBUG:teuthology.orchestra.run.smithi094:> os.unlink(fpath) 2024-09-11T23:18:06.895 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:18:06.895 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:18:06.895 DEBUG:teuthology.orchestra.run.smithi094:> if create_hard_links: 2024-09-11T23:18:06.896 DEBUG:teuthology.orchestra.run.smithi094:> for j in range(0): 2024-09-11T23:18:06.896 DEBUG:teuthology.orchestra.run.smithi094:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T23:18:06.896 DEBUG:teuthology.orchestra.run.smithi094:> if True: 2024-09-11T23:18:06.896 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:18:06.896 DEBUG:teuthology.orchestra.run.smithi094:> finally: 2024-09-11T23:18:06.896 DEBUG:teuthology.orchestra.run.smithi094:> os.close(dirfd) 2024-09-11T23:18:06.896 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:18:07.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:07.408 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:18:07.409 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:07.486 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:07.577 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:18:07.577 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:07.577 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:07.578 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:07.583 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:18:07.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2e5f2640 1 Processor -- start 2024-09-11T23:18:07.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2e5f2640 1 -- start start 2024-09-11T23:18:07.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2e5f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 0x7f0d280ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:07.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2e5f2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d280af470 0x7f0d2806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:07.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2e5f2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d280b3290 con 0x7f0d2815c2a0 2024-09-11T23:18:07.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2e5f2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0d280b3570 con 0x7f0d280af470 2024-09-11T23:18:07.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2e5f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d280b3850 con 0x7f0d2815bec0 2024-09-11T23:18:07.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2cb8f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d280af470 0x7f0d2806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:07.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2cb8f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d280af470 0x7f0d2806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35850/0 (socket says 172.21.15.94:35850) 2024-09-11T23:18:07.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2cb8f640 1 -- 172.21.15.94:0/3939525406 learned_addr learned my addr 172.21.15.94:0/3939525406 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:07.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2cb8f640 1 -- 172.21.15.94:0/3939525406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 msgr2=0x7f0d280ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:07.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2cb8f640 1 --2- 172.21.15.94:0/3939525406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 0x7f0d280ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2cb8f640 1 -- 172.21.15.94:0/3939525406 >> v1:172.21.15.94:6789/0 conn(0x7f0d2815c2a0 legacy=0x7f0d280aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d26ffd640 1 -- 172.21.15.94:0/3939525406 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949659292 0 0) 0x7f0d280b3290 con 0x7f0d2815c2a0 2024-09-11T23:18:07.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.741+0000 7f0d2cb8f640 1 -- 172.21.15.94:0/3939525406 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d280b3b30 con 0x7f0d280af470 2024-09-11T23:18:07.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2cb8f640 1 --2- 172.21.15.94:0/3939525406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2806e000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009870 tx=0x7f0d2001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9b1d6c38e66e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:07.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d26ffd640 1 -- 172.21.15.94:0/3939525406 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200a95f0 con 0x7f0d280af470 2024-09-11T23:18:07.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d26ffd640 1 -- 172.21.15.94:0/3939525406 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d200a9790 con 0x7f0d280af470 2024-09-11T23:18:07.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d26ffd640 1 -- 172.21.15.94:0/3939525406 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200a9b60 con 0x7f0d280af470 2024-09-11T23:18:07.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3939525406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 msgr2=0x7f0d2806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3939525406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2806e000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009870 tx=0x7f0d2001c530 comp rx=0 tx=0).stop 2024-09-11T23:18:07.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3939525406 shutdown_connections 2024-09-11T23:18:07.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3939525406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2806e000 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3939525406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 0x7f0d280ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3939525406 >> 172.21.15.94:0/3939525406 conn(0x7f0d280b1f90 msgr2=0x7f0d280b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:07.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3939525406 shutdown_connections 2024-09-11T23:18:07.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3939525406 wait complete. 2024-09-11T23:18:07.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 Processor -- start 2024-09-11T23:18:07.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- start start 2024-09-11T23:18:07.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2814a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:07.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 0x7f0d280aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:07.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2815c2a0 0x7f0d280b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:07.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2806ed50 con 0x7f0d280af470 2024-09-11T23:18:07.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280ad740 con 0x7f0d2815c2a0 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d2e5f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2806eed0 con 0x7f0d2815bec0 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2814a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2814a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35854/0 (socket says 172.21.15.94:35854) 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.745+0000 7f0d27fff640 1 -- 172.21.15.94:0/3594303085 learned_addr learned my addr 172.21.15.94:0/3594303085 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d277fe640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 0x7f0d280aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d27fff640 1 -- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 msgr2=0x7f0d280aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d2cb8f640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2815c2a0 0x7f0d280b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d27fff640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 0x7f0d280aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d27fff640 1 -- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2815c2a0 msgr2=0x7f0d280b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d27fff640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2815c2a0 0x7f0d280b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d27fff640 1 -- 172.21.15.94:0/3594303085 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d28154e80 con 0x7f0d280af470 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d27fff640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2814a760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800ba80 tx=0x7f0d1800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:07.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d24ff9640 1 -- 172.21.15.94:0/3594303085 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18019070 con 0x7f0d280af470 2024-09-11T23:18:07.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d24ff9640 1 -- 172.21.15.94:0/3594303085 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1800cc20 con 0x7f0d280af470 2024-09-11T23:18:07.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d24ff9640 1 -- 172.21.15.94:0/3594303085 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18014440 con 0x7f0d280af470 2024-09-11T23:18:07.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d28155fe0 con 0x7f0d280af470 2024-09-11T23:18:07.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d281565a0 con 0x7f0d280af470 2024-09-11T23:18:07.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2806f220 con 0x7f0d280af470 2024-09-11T23:18:07.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d24ff9640 1 -- 172.21.15.94:0/3594303085 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d1801c070 con 0x7f0d280af470 2024-09-11T23:18:07.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d24ff9640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d140678c0 0x7f0d14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:07.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d24ff9640 1 -- 172.21.15.94:0/3594303085 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f0d18085cd0 con 0x7f0d280af470 2024-09-11T23:18:07.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d277fe640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d140678c0 0x7f0d14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:07.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.749+0000 7f0d277fe640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d140678c0 0x7f0d14069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d2814fe80 tx=0x7f0d1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:07.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.753+0000 7f0d24ff9640 1 -- 172.21.15.94:0/3594303085 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d180565f0 con 0x7f0d280af470 2024-09-11T23:18:07.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.925+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0d280ad320 con 0x7f0d280af470 2024-09-11T23:18:07.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.925+0000 7f0d24ff9640 1 -- 172.21.15.94:0/3594303085 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7f0d18055ef0 con 0x7f0d280af470 2024-09-11T23:18:07.928 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:18:07.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d140678c0 msgr2=0x7f0d14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d140678c0 0x7f0d14069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d2814fe80 tx=0x7f0d1c009040 comp rx=0 tx=0).stop 2024-09-11T23:18:07.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 msgr2=0x7f0d2814a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2814a760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800ba80 tx=0x7f0d1800bf40 comp rx=0 tx=0).stop 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 shutdown_connections 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2815c2a0 0x7f0d280b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2815bec0 0x7f0d280aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d140678c0 0x7f0d14069d80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 --2- 172.21.15.94:0/3594303085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d280af470 0x7f0d2814a760 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 >> 172.21.15.94:0/3594303085 conn(0x7f0d280b1f90 msgr2=0x7f0d281597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 shutdown_connections 2024-09-11T23:18:07.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:07.929+0000 7f0d2e5f2640 1 -- 172.21.15.94:0/3594303085 wait complete. 2024-09-11T23:18:07.947 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:18:07.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:07.948 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:07.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[41168]: fuse finished with error 0 and tester_r 0 2024-09-11T23:18:07.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:18:07.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:07.960 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:18:08.077 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:08.077 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:18:08.077 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:08.084 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:18:08.085 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:18:08.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:08.085 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:18:08.131 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T23:18:08.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:08.133 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:08.133 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:08.133 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:08.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:18:08.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:18:08.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:08.139 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:18:08.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:08.190 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T23:18:08.190 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:08.191 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:18:08.191 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:08.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:18:08.196 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:18:08.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:08.196 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:18:08.244 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T23:18:08.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:08.245 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:08.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b35332640 1 Processor -- start 2024-09-11T23:18:08.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b35332640 1 -- start start 2024-09-11T23:18:08.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b35332640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4b3015c2a0 0x7f4b300aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b35332640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b300af2a0 0x7f4b3006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b35332640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b300b3290 con 0x7f4b3015bec0 2024-09-11T23:18:08.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b35332640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4b300b3570 con 0x7f4b3015c2a0 2024-09-11T23:18:08.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b35332640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b300b3850 con 0x7f4b300af2a0 2024-09-11T23:18:08.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2effd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4b3015bec0 0x7f4b300ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55858/0 (socket says 172.21.15.94:55858) 2024-09-11T23:18:08.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4b3015c2a0 0x7f4b300aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2effd640 1 -- 172.21.15.94:0/787396362 learned_addr learned my addr 172.21.15.94:0/787396362 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:08.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2f7fe640 1 --2- 172.21.15.94:0/787396362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b300af2a0 0x7f4b3006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2e7fc640 1 -- 172.21.15.94:0/787396362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b300af2a0 msgr2=0x7f4b3006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:08.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2e7fc640 1 --2- 172.21.15.94:0/787396362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b300af2a0 0x7f4b3006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2e7fc640 1 -- 172.21.15.94:0/787396362 >> v1:172.21.15.94:6789/0 conn(0x7f4b3015bec0 legacy=0x7f4b300ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2e7fc640 1 -- 172.21.15.94:0/787396362 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b300b3b30 con 0x7f4b3015c2a0 2024-09-11T23:18:08.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.373+0000 7f4b2dffb640 1 -- 172.21.15.94:0/787396362 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670803235 0 0) 0x7f4b300b3290 con 0x7f4b3015bec0 2024-09-11T23:18:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 --2- 172.21.15.94:0/787396362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015c2a0 0x7f4b300aed60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009d90 tx=0x7f4b2001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d673d1ed41fee5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2dffb640 1 -- 172.21.15.94:0/787396362 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b200b2070 con 0x7f4b3015c2a0 2024-09-11T23:18:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2dffb640 1 -- 172.21.15.94:0/787396362 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b200a5a00 con 0x7f4b3015c2a0 2024-09-11T23:18:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2dffb640 1 -- 172.21.15.94:0/787396362 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b200a5dd0 con 0x7f4b3015c2a0 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- 172.21.15.94:0/787396362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015c2a0 msgr2=0x7f4b300aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 --2- 172.21.15.94:0/787396362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015c2a0 0x7f4b300aed60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009d90 tx=0x7f4b2001c940 comp rx=0 tx=0).stop 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- 172.21.15.94:0/787396362 shutdown_connections 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 --2- 172.21.15.94:0/787396362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b300af2a0 0x7f4b3006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 --2- 172.21.15.94:0/787396362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015c2a0 0x7f4b300aed60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- 172.21.15.94:0/787396362 >> 172.21.15.94:0/787396362 conn(0x7f4b300b1f90 msgr2=0x7f4b300b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- 172.21.15.94:0/787396362 shutdown_connections 2024-09-11T23:18:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- 172.21.15.94:0/787396362 wait complete. 2024-09-11T23:18:08.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 Processor -- start 2024-09-11T23:18:08.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- start start 2024-09-11T23:18:08.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b300af2a0 0x7f4b30164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015bec0 0x7f4b300729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b3015c2a0 0x7f4b3014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3006ed50 con 0x7f4b3015bec0 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4b300af6b0 con 0x7f4b300af2a0 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b35332640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3006eed0 con 0x7f4b3015c2a0 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015bec0 0x7f4b300729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015bec0 0x7f4b300729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35872/0 (socket says 172.21.15.94:35872) 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 -- 172.21.15.94:0/629204927 learned_addr learned my addr 172.21.15.94:0/629204927 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2f7fe640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b3015c2a0 0x7f4b3014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2effd640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b300af2a0 0x7f4b30164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 -- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b3015c2a0 msgr2=0x7f4b3014f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b3015c2a0 0x7f4b3014f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 -- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b300af2a0 msgr2=0x7f4b30164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b300af2a0 0x7f4b30164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.377+0000 7f4b2e7fc640 1 -- 172.21.15.94:0/629204927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b301515f0 con 0x7f4b3015bec0 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b2e7fc640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015bec0 0x7f4b300729d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4b200b0040 tx=0x7f4b200196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b277fe640 1 -- 172.21.15.94:0/629204927 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b200b2050 con 0x7f4b3015bec0 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b277fe640 1 -- 172.21.15.94:0/629204927 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b200be070 con 0x7f4b3015bec0 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b277fe640 1 -- 172.21.15.94:0/629204927 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b200adb70 con 0x7f4b3015bec0 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b30151890 con 0x7f4b3015bec0 2024-09-11T23:18:08.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b30151e50 con 0x7f4b3015bec0 2024-09-11T23:18:08.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3006e000 con 0x7f4b3015bec0 2024-09-11T23:18:08.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b277fe640 1 -- 172.21.15.94:0/629204927 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b200add10 con 0x7f4b3015bec0 2024-09-11T23:18:08.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b277fe640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b100678c0 0x7f4b10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b277fe640 1 -- 172.21.15.94:0/629204927 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f4b20121da0 con 0x7f4b3015bec0 2024-09-11T23:18:08.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b2effd640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b100678c0 0x7f4b10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.381+0000 7f4b2effd640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b100678c0 0x7f4b10069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b18000f70 tx=0x7f4b18007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.385+0000 7f4b277fe640 1 -- 172.21.15.94:0/629204927 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b20016560 con 0x7f4b3015bec0 2024-09-11T23:18:08.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.585+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b3006fcd0 con 0x7f4b3015bec0 2024-09-11T23:18:08.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.585+0000 7f4b277fe640 1 -- 172.21.15.94:0/629204927 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7f4b200f26b0 con 0x7f4b3015bec0 2024-09-11T23:18:08.587 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:08.587 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:18:08.588 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b100678c0 msgr2=0x7f4b10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b100678c0 0x7f4b10069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b18000f70 tx=0x7f4b18007b60 comp rx=0 tx=0).stop 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015bec0 msgr2=0x7f4b300729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015bec0 0x7f4b300729d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4b200b0040 tx=0x7f4b200196e0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 shutdown_connections 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b3015c2a0 0x7f4b3014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b100678c0 0x7f4b10069d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b3015bec0 0x7f4b300729d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 --2- 172.21.15.94:0/629204927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b300af2a0 0x7f4b30164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 >> 172.21.15.94:0/629204927 conn(0x7f4b300b1f90 msgr2=0x7f4b300b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 shutdown_connections 2024-09-11T23:18:08.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.589+0000 7f4b35332640 1 -- 172.21.15.94:0/629204927 wait complete. 2024-09-11T23:18:08.606 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:08.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff548571640 1 Processor -- start 2024-09-11T23:18:08.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff548571640 1 -- start start 2024-09-11T23:18:08.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff548571640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5400b39a0 0x7ff54006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff548571640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54006ec60 con 0x7ff54006e4b0 2024-09-11T23:18:08.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff548571640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54006ef40 con 0x7ff5401587a0 2024-09-11T23:18:08.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff548571640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff54006f870 con 0x7ff5400b39a0 2024-09-11T23:18:08.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff545b0c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5400b39a0 0x7ff54006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff545b0c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5400b39a0 0x7ff54006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35884/0 (socket says 172.21.15.94:35884) 2024-09-11T23:18:08.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff545b0c640 1 -- 172.21.15.94:0/3847073973 learned_addr learned my addr 172.21.15.94:0/3847073973 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:08.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff546b0e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff54006e4b0 0x7ff540072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55874/0 (socket says 172.21.15.94:55874) 2024-09-11T23:18:08.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff545b0c640 1 -- 172.21.15.94:0/3847073973 >> v1:172.21.15.155:6789/0 conn(0x7ff5401587a0 legacy=0x7ff5400b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff545b0c640 1 -- 172.21.15.94:0/3847073973 >> v1:172.21.15.94:6789/0 conn(0x7ff54006e4b0 legacy=0x7ff540072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff545b0c640 1 -- 172.21.15.94:0/3847073973 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54006f220 con 0x7ff5400b39a0 2024-09-11T23:18:08.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.721+0000 7ff54530b640 1 -- 172.21.15.94:0/3847073973 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191185489 0 0) 0x7ff54006ec60 con 0x7ff54006e4b0 2024-09-11T23:18:08.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff545b0c640 1 --2- 172.21.15.94:0/3847073973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5400b39a0 0x7ff54006df70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff54006f9f0 tx=0x7ff53c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df90a1e2a2a96a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54530b640 1 -- 172.21.15.94:0/3847073973 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0a95f0 con 0x7ff5400b39a0 2024-09-11T23:18:08.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54530b640 1 -- 172.21.15.94:0/3847073973 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c0a9790 con 0x7ff5400b39a0 2024-09-11T23:18:08.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54530b640 1 -- 172.21.15.94:0/3847073973 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0a9b60 con 0x7ff5400b39a0 2024-09-11T23:18:08.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- 172.21.15.94:0/3847073973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5400b39a0 msgr2=0x7ff54006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 --2- 172.21.15.94:0/3847073973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5400b39a0 0x7ff54006df70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff54006f9f0 tx=0x7ff53c01c510 comp rx=0 tx=0).stop 2024-09-11T23:18:08.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- 172.21.15.94:0/3847073973 shutdown_connections 2024-09-11T23:18:08.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 --2- 172.21.15.94:0/3847073973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5400b39a0 0x7ff54006df70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- 172.21.15.94:0/3847073973 >> 172.21.15.94:0/3847073973 conn(0x7ff5400b1f90 msgr2=0x7ff5400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- 172.21.15.94:0/3847073973 shutdown_connections 2024-09-11T23:18:08.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- 172.21.15.94:0/3847073973 wait complete. 2024-09-11T23:18:08.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 Processor -- start 2024-09-11T23:18:08.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- start start 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff54006e4b0 0x7ff540154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5400b39a0 0x7ff540157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5401587a0 0x7ff540147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff540073200 con 0x7ff54006e4b0 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff540073080 con 0x7ff5401587a0 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff548571640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff540073380 con 0x7ff5400b39a0 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54630d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff54006e4b0 0x7ff540154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54630d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff54006e4b0 0x7ff540154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35900/0 (socket says 172.21.15.94:35900) 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54630d640 1 -- 172.21.15.94:0/1554691234 learned_addr learned my addr 172.21.15.94:0/1554691234 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff546b0e640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5401587a0 0x7ff540147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff545b0c640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5400b39a0 0x7ff540157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54630d640 1 -- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5400b39a0 msgr2=0x7ff540157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54630d640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5400b39a0 0x7ff540157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54630d640 1 -- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5401587a0 msgr2=0x7ff540147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.725+0000 7ff54630d640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5401587a0 0x7ff540147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff54630d640 1 -- 172.21.15.94:0/1554691234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff540156350 con 0x7ff54006e4b0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff545b0c640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5400b39a0 0x7ff540157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff54630d640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff54006e4b0 0x7ff540154900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c3c0 tx=0x7ff53000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff536ffd640 1 -- 172.21.15.94:0/1554691234 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530017070 con 0x7ff54006e4b0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff536ffd640 1 -- 172.21.15.94:0/1554691234 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5300052d0 con 0x7ff54006e4b0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff536ffd640 1 -- 172.21.15.94:0/1554691234 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530003840 con 0x7ff54006e4b0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff540154e40 con 0x7ff54006e4b0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff540152c80 con 0x7ff54006e4b0 2024-09-11T23:18:08.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff540070080 con 0x7ff54006e4b0 2024-09-11T23:18:08.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff536ffd640 1 -- 172.21.15.94:0/1554691234 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff53001a070 con 0x7ff54006e4b0 2024-09-11T23:18:08.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff536ffd640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5240678c0 0x7ff524069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff536ffd640 1 -- 172.21.15.94:0/1554691234 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7ff530085250 con 0x7ff54006e4b0 2024-09-11T23:18:08.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff545b0c640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5240678c0 0x7ff524069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.729+0000 7ff545b0c640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5240678c0 0x7ff524069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0ae000 tx=0x7ff53c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.733+0000 7ff536ffd640 1 -- 172.21.15.94:0/1554691234 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff540154e40 con 0x7ff54006e4b0 2024-09-11T23:18:08.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.925+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff54015fff0 con 0x7ff54006e4b0 2024-09-11T23:18:08.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.925+0000 7ff536ffd640 1 -- 172.21.15.94:0/1554691234 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7ff540156350 con 0x7ff54006e4b0 2024-09-11T23:18:08.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:08.927 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:18:08.928 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5240678c0 msgr2=0x7ff524069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5240678c0 0x7ff524069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0ae000 tx=0x7ff53c0b3040 comp rx=0 tx=0).stop 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff54006e4b0 msgr2=0x7ff540154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff54006e4b0 0x7ff540154900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c3c0 tx=0x7ff53000c880 comp rx=0 tx=0).stop 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 shutdown_connections 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5401587a0 0x7ff540147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5400b39a0 0x7ff540157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5240678c0 0x7ff524069d80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 --2- 172.21.15.94:0/1554691234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff54006e4b0 0x7ff540154900 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 >> 172.21.15.94:0/1554691234 conn(0x7ff5400b1f90 msgr2=0x7ff5401607f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 shutdown_connections 2024-09-11T23:18:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:08.929+0000 7ff548571640 1 -- 172.21.15.94:0/1554691234 wait complete. 2024-09-11T23:18:08.946 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:09.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.049+0000 7ff73a4b1640 1 Processor -- start 2024-09-11T23:18:09.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff73a4b1640 1 -- start start 2024-09-11T23:18:09.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff73a4b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 0x7ff7340ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff73a4b1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff7340af470 0x7ff73406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff73a4b1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7340b3290 con 0x7ff73415c2a0 2024-09-11T23:18:09.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff73a4b1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff7340b3570 con 0x7ff7340af470 2024-09-11T23:18:09.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff73a4b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7340b3850 con 0x7ff73415bec0 2024-09-11T23:18:09.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff738a4e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff7340af470 0x7ff73406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff7337fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff73415c2a0 0x7ff7340aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55882/0 (socket says 172.21.15.94:55882) 2024-09-11T23:18:09.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff7337fe640 1 -- 172.21.15.94:0/2558253794 learned_addr learned my addr 172.21.15.94:0/2558253794 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:09.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff738a4e640 1 -- 172.21.15.94:0/2558253794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 msgr2=0x7ff7340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff738a4e640 1 --2- 172.21.15.94:0/2558253794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 0x7ff7340ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff738a4e640 1 -- 172.21.15.94:0/2558253794 >> v1:172.21.15.94:6789/0 conn(0x7ff73415c2a0 legacy=0x7ff7340aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff738a4e640 1 -- 172.21.15.94:0/2558253794 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7340b3b30 con 0x7ff7340af470 2024-09-11T23:18:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff738a4e640 1 --2- 172.21.15.94:0/2558253794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff73406e000 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009d90 tx=0x7ff72c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdac1e63e750c4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff732ffd640 1 -- 172.21.15.94:0/2558253794 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0b2070 con 0x7ff7340af470 2024-09-11T23:18:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff732ffd640 1 -- 172.21.15.94:0/2558253794 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72c0a5a00 con 0x7ff7340af470 2024-09-11T23:18:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.053+0000 7ff732ffd640 1 -- 172.21.15.94:0/2558253794 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0a5dd0 con 0x7ff7340af470 2024-09-11T23:18:09.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2558253794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 msgr2=0x7ff73406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2558253794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff73406e000 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009d90 tx=0x7ff72c01c940 comp rx=0 tx=0).stop 2024-09-11T23:18:09.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2558253794 shutdown_connections 2024-09-11T23:18:09.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2558253794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff73406e000 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2558253794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 0x7ff7340ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2558253794 >> 172.21.15.94:0/2558253794 conn(0x7ff7340b1f90 msgr2=0x7ff7340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2558253794 shutdown_connections 2024-09-11T23:18:09.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2558253794 wait complete. 2024-09-11T23:18:09.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 Processor -- start 2024-09-11T23:18:09.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- start start 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff734148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 0x7ff7340cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73415c2a0 0x7ff7340d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff73406ed50 con 0x7ff7340af470 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7340ad740 con 0x7ff73415c2a0 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff73406eed0 con 0x7ff73415bec0 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff734148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff734148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35918/0 (socket says 172.21.15.94:35918) 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 -- 172.21.15.94:0/2014245888 learned_addr learned my addr 172.21.15.94:0/2014245888 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 -- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 msgr2=0x7ff7340cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 0x7ff7340cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 -- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73415c2a0 msgr2=0x7ff7340d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73415c2a0 0x7ff7340d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 -- 172.21.15.94:0/2014245888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7340b0150 con 0x7ff7340af470 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff733fff640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff734148720 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff72400b580 tx=0x7ff72400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff730ff9640 1 -- 172.21.15.94:0/2014245888 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724014070 con 0x7ff7340af470 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff730ff9640 1 -- 172.21.15.94:0/2014245888 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff724010890 con 0x7ff7340af470 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7340b0430 con 0x7ff7340af470 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff730ff9640 1 -- 172.21.15.94:0/2014245888 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724010c80 con 0x7ff7340af470 2024-09-11T23:18:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7340b09f0 con 0x7ff7340af470 2024-09-11T23:18:09.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.057+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73406e000 con 0x7ff7340af470 2024-09-11T23:18:09.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.061+0000 7ff730ff9640 1 -- 172.21.15.94:0/2014245888 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff724017070 con 0x7ff7340af470 2024-09-11T23:18:09.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.061+0000 7ff730ff9640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7200678c0 0x7ff720069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.061+0000 7ff730ff9640 1 -- 172.21.15.94:0/2014245888 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7ff724085d90 con 0x7ff7340af470 2024-09-11T23:18:09.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.061+0000 7ff7337fe640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7200678c0 0x7ff720069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.061+0000 7ff7337fe640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7200678c0 0x7ff720069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff728000f70 tx=0x7ff728007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.065+0000 7ff730ff9640 1 -- 172.21.15.94:0/2014245888 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff724056620 con 0x7ff7340af470 2024-09-11T23:18:09.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.229+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7340b0d60 con 0x7ff7340af470 2024-09-11T23:18:09.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.229+0000 7ff730ff9640 1 -- 172.21.15.94:0/2014245888 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17206 (secure 0 0 0) 0x7ff724010e20 con 0x7ff7340af470 2024-09-11T23:18:09.232 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:09.232 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":64,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:55.221674+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:31.612159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:32.924950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7200678c0 msgr2=0x7ff720069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7200678c0 0x7ff720069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff728000f70 tx=0x7ff728007a90 comp rx=0 tx=0).stop 2024-09-11T23:18:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 msgr2=0x7ff734148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff734148720 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff72400b580 tx=0x7ff72400ba40 comp rx=0 tx=0).stop 2024-09-11T23:18:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 shutdown_connections 2024-09-11T23:18:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73415c2a0 0x7ff7340d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73415bec0 0x7ff7340cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7200678c0 0x7ff720069d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 --2- 172.21.15.94:0/2014245888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7340af470 0x7ff734148720 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 >> 172.21.15.94:0/2014245888 conn(0x7ff7340b1f90 msgr2=0x7ff7340b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 shutdown_connections 2024-09-11T23:18:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.233+0000 7ff73a4b1640 1 -- 172.21.15.94:0/2014245888 wait complete. 2024-09-11T23:18:09.250 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:18:09.251 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:09.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.357+0000 7fba9e90c640 1 Processor -- start 2024-09-11T23:18:09.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.357+0000 7fba9e90c640 1 -- start start 2024-09-11T23:18:09.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9e90c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba9806f010 0x7fba98166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9e90c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba980b3290 con 0x7fba9815bec0 2024-09-11T23:18:09.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9e90c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba980b3570 con 0x7fba9815c2a0 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9e90c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fba980b3850 con 0x7fba9806f010 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba97fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fba9815bec0 0x7fba980ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55890/0 (socket says 172.21.15.94:55890) 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba97fff640 1 -- 172.21.15.94:0/3133596978 learned_addr learned my addr 172.21.15.94:0/3133596978 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346120276 0 0) 0x7fba980b3290 con 0x7fba9815bec0 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba80003530 con 0x7fba9815bec0 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 --2- 172.21.15.94:0/3133596978 >> v2:172.21.15.155:3300/0 conn(0x7fba9806f010 0x7fba98166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 307991341 0 0) 0x7fba80003530 con 0x7fba9815bec0 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 >> v2:172.21.15.155:3300/0 conn(0x7fba9806f010 msgr2=0x7fba98166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 --2- 172.21.15.94:0/3133596978 >> v2:172.21.15.155:3300/0 conn(0x7fba9806f010 0x7fba98166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 >> v1:172.21.15.155:6789/0 conn(0x7fba9815c2a0 legacy=0x7fba980aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980b3b30 con 0x7fba9815bec0 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fba88001680 con 0x7fba9815bec0 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 >> v1:172.21.15.94:6789/0 conn(0x7fba9815bec0 legacy=0x7fba980ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba800039c0 0x7fba80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba80004810 0x7fba80004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fba980b3850 con 0x7fba800051d0 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba8000c120 con 0x7fba80004810 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba8000c320 con 0x7fba800039c0 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba97fff640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba800039c0 0x7fba80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba977fe640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba80004810 0x7fba80004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 -- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba800039c0 msgr2=0x7fba80003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba800039c0 0x7fba80003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 -- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba80004810 msgr2=0x7fba80004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba80004810 0x7fba80004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 -- 172.21.15.94:0/3133596978 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba80003530 con 0x7fba800051d0 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 -- 172.21.15.94:0/3133596978 reap_dead start 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba9cea9640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba8000b9d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fba90007330 tx=0x7fba9001ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332dac7aaa7742b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90009be0 con 0x7fba800051d0 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba900a5d60 con 0x7fba800051d0 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.361+0000 7fba96ffd640 1 -- 172.21.15.94:0/3133596978 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90003be0 con 0x7fba800051d0 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/3133596978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 msgr2=0x7fba8000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba8000b9d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fba90007330 tx=0x7fba9001ce60 comp rx=0 tx=0).stop 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/3133596978 shutdown_connections 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 --2- 172.21.15.94:0/3133596978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba8000b9d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/3133596978 >> 172.21.15.94:0/3133596978 conn(0x7fba980b1f90 msgr2=0x7fba980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/3133596978 shutdown_connections 2024-09-11T23:18:09.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/3133596978 wait complete. 2024-09-11T23:18:09.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 Processor -- start 2024-09-11T23:18:09.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- start start 2024-09-11T23:18:09.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba98147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba9809d740 0x7fba981533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba98153910 0x7fba98071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fba980afc90 con 0x7fba800051d0 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba980b40f0 con 0x7fba9809d740 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba980ad200 con 0x7fba98153910 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba98147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba98147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35930/0 (socket says 172.21.15.94:35930) 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 -- 172.21.15.94:0/2009139724 learned_addr learned my addr 172.21.15.94:0/2009139724 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 -- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba98153910 msgr2=0x7fba98071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba98153910 0x7fba98071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 -- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba9809d740 msgr2=0x7fba981533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba9809d740 0x7fba981533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 -- 172.21.15.94:0/2009139724 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba98152350 con 0x7fba800051d0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba97fff640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba98147fe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fba88007fd0 tx=0x7fba8800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba94ff9640 1 -- 172.21.15.94:0/2009139724 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88019070 con 0x7fba800051d0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba94ff9640 1 -- 172.21.15.94:0/2009139724 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba880072d0 con 0x7fba800051d0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba98148520 con 0x7fba800051d0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba94ff9640 1 -- 172.21.15.94:0/2009139724 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88007680 con 0x7fba800051d0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba981528f0 con 0x7fba800051d0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.365+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba980ad590 con 0x7fba800051d0 2024-09-11T23:18:09.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.369+0000 7fba94ff9640 1 -- 172.21.15.94:0/2009139724 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba8801c070 con 0x7fba800051d0 2024-09-11T23:18:09.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.369+0000 7fba94ff9640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba840678f0 0x7fba84069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.369+0000 7fba94ff9640 1 -- 172.21.15.94:0/2009139724 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fba88085a70 con 0x7fba800051d0 2024-09-11T23:18:09.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.369+0000 7fba977fe640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba840678f0 0x7fba84069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.369+0000 7fba977fe640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba840678f0 0x7fba84069db0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fba8c007fd0 tx=0x7fba8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.373+0000 7fba94ff9640 1 -- 172.21.15.94:0/2009139724 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba88056370 con 0x7fba800051d0 2024-09-11T23:18:09.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.553+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba9806fcd0 con 0x7fba800051d0 2024-09-11T23:18:09.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.553+0000 7fba94ff9640 1 -- 172.21.15.94:0/2009139724 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7fba88085e20 con 0x7fba800051d0 2024-09-11T23:18:09.558 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:09.558 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:18:09.559 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba840678f0 msgr2=0x7fba84069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba840678f0 0x7fba84069db0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fba8c007fd0 tx=0x7fba8c009040 comp rx=0 tx=0).stop 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 msgr2=0x7fba98147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba98147fe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fba88007fd0 tx=0x7fba8800db90 comp rx=0 tx=0).stop 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 shutdown_connections 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba98153910 0x7fba98071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba9809d740 0x7fba981533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba840678f0 0x7fba84069db0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 --2- 172.21.15.94:0/2009139724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba800051d0 0x7fba98147fe0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 >> 172.21.15.94:0/2009139724 conn(0x7fba980b1f90 msgr2=0x7fba9815a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 shutdown_connections 2024-09-11T23:18:09.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.557+0000 7fba9e90c640 1 -- 172.21.15.94:0/2009139724 wait complete. 2024-09-11T23:18:09.573 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:09.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.677+0000 7f350c842640 1 Processor -- start 2024-09-11T23:18:09.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.677+0000 7f350c842640 1 -- start start 2024-09-11T23:18:09.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350c842640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 0x7f35080cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350c842640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35080d0300 con 0x7f3508161a60 2024-09-11T23:18:09.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350c842640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35080b0f60 con 0x7f35080cf450 2024-09-11T23:18:09.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350c842640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f35080cfd40 con 0x7f35080d3060 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350659c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3508161a60 0x7f35080d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55892/0 (socket says 172.21.15.94:55892) 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350659c640 1 -- 172.21.15.94:0/1346866282 learned_addr learned my addr 172.21.15.94:0/1346866282 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3505d9b640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 0x7f35080cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757550469 0 0) 0x7f34f8001120 con 0x7f3508161a60 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34f0003530 con 0x7f3508161a60 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1400025548 0 0) 0x7f34f0003530 con 0x7f3508161a60 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 msgr2=0x7f35080cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 0x7f35080cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 >> v1:172.21.15.155:6789/0 conn(0x7f35080cf450 legacy=0x7f350806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35080d0020 con 0x7f3508161a60 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f34f8001850 con 0x7f3508161a60 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 >> v1:172.21.15.94:6789/0 conn(0x7f3508161a60 legacy=0x7f35080d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f00039f0 0x7f34f0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 0x7f34f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34f0004d50 0x7f34f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f35080cfd40 con 0x7f34f0004d50 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34f000bc50 con 0x7f34f00039f0 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34f000be50 con 0x7f35080d3060 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3506d9d640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34f0004d50 0x7f34f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350659c640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f00039f0 0x7f34f0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3505d9b640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 0x7f34f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3506d9d640 1 -- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 msgr2=0x7f34f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3506d9d640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080d3060 0x7f34f0004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3506d9d640 1 -- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f00039f0 msgr2=0x7f34f0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3506d9d640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f00039f0 0x7f34f0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3506d9d640 1 -- 172.21.15.94:0/1346866282 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f0003530 con 0x7f34f0004d50 2024-09-11T23:18:09.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f3506d9d640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34f0004d50 0x7f34f00051d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3500001e70 tx=0x7f350001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd5b97789b0734e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500001a90 con 0x7f34f0004d50 2024-09-11T23:18:09.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3500003b80 con 0x7f34f0004d50 2024-09-11T23:18:09.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.681+0000 7f350559a640 1 -- 172.21.15.94:0/1346866282 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500005080 con 0x7f34f0004d50 2024-09-11T23:18:09.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/1346866282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34f0004d50 msgr2=0x7f34f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 --2- 172.21.15.94:0/1346866282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34f0004d50 0x7f34f00051d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3500001e70 tx=0x7f350001c780 comp rx=0 tx=0).stop 2024-09-11T23:18:09.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3506d9d640 1 -- 172.21.15.94:0/1346866282 reap_dead start 2024-09-11T23:18:09.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/1346866282 shutdown_connections 2024-09-11T23:18:09.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/1346866282 >> 172.21.15.94:0/1346866282 conn(0x7f350808bf90 msgr2=0x7f350809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/1346866282 shutdown_connections 2024-09-11T23:18:09.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/1346866282 wait complete. 2024-09-11T23:18:09.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 Processor -- start 2024-09-11T23:18:09.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- start start 2024-09-11T23:18:09.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f0004d50 0x7f3508159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35081e7c80 0x7f35081e8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080b8000 0x7f35080b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f35080cf8e0 con 0x7f35081e7c80 2024-09-11T23:18:09.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f350806d190 con 0x7f34f0004d50 2024-09-11T23:18:09.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f35080cfa60 con 0x7f35080b8000 2024-09-11T23:18:09.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35081e7c80 0x7f35081e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35081e7c80 0x7f35081e8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35944/0 (socket says 172.21.15.94:35944) 2024-09-11T23:18:09.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 -- 172.21.15.94:0/3645182806 learned_addr learned my addr 172.21.15.94:0/3645182806 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:09.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350659c640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f0004d50 0x7f3508159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3506d9d640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080b8000 0x7f35080b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 -- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080b8000 msgr2=0x7f35080b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080b8000 0x7f35080b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 -- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f0004d50 msgr2=0x7f3508159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f0004d50 0x7f3508159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 -- 172.21.15.94:0/3645182806 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35080b8f10 con 0x7f35081e7c80 2024-09-11T23:18:09.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3506d9d640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080b8000 0x7f35080b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:09.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f3505d9b640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35081e7c80 0x7f35081e8100 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00e810 tx=0x7f34fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f34f6ffd640 1 -- 172.21.15.94:0/3645182806 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc017070 con 0x7f35081e7c80 2024-09-11T23:18:09.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f34f6ffd640 1 -- 172.21.15.94:0/3645182806 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc00c670 con 0x7f35081e7c80 2024-09-11T23:18:09.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f34f6ffd640 1 -- 172.21.15.94:0/3645182806 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00f040 con 0x7f35081e7c80 2024-09-11T23:18:09.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35080b91f0 con 0x7f35081e7c80 2024-09-11T23:18:09.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35080cb5e0 con 0x7f35081e7c80 2024-09-11T23:18:09.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.685+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35080b9710 con 0x7f35081e7c80 2024-09-11T23:18:09.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.689+0000 7f34f6ffd640 1 -- 172.21.15.94:0/3645182806 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34fc01a070 con 0x7f35081e7c80 2024-09-11T23:18:09.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.689+0000 7f34f6ffd640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34e80678f0 0x7f34e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.689+0000 7f34f6ffd640 1 -- 172.21.15.94:0/3645182806 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f34fc0858b0 con 0x7f35081e7c80 2024-09-11T23:18:09.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.689+0000 7f350659c640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34e80678f0 0x7f34e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.689+0000 7f350659c640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34e80678f0 0x7f34e8069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005260 tx=0x7f34f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.693+0000 7f34f6ffd640 1 -- 172.21.15.94:0/3645182806 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35080b9710 con 0x7f35081e7c80 2024-09-11T23:18:09.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.873+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35080cef10 con 0x7f35081e7c80 2024-09-11T23:18:09.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.873+0000 7f34f6ffd640 1 -- 172.21.15.94:0/3645182806 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5230 (secure 0 0 0) 0x7f34fc056260 con 0x7f35081e7c80 2024-09-11T23:18:09.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:09.875 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":31,"btime":"2024-09-11T23:17:36:601082+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:33.945017+0000","modified":"2024-09-11T23:17:35.941620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/2185007452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2185007452},{"type":"v1","addr":"172.21.15.94:6835","nonce":2185007452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":4}]} 2024-09-11T23:18:09.876 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 31 2024-09-11T23:18:09.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34e80678f0 msgr2=0x7f34e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34e80678f0 0x7f34e8069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005260 tx=0x7f34f8009040 comp rx=0 tx=0).stop 2024-09-11T23:18:09.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35081e7c80 msgr2=0x7f35081e8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35081e7c80 0x7f35081e8100 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00e810 tx=0x7f34fc00ecd0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 shutdown_connections 2024-09-11T23:18:09.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35080b8000 0x7f35080b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34e80678f0 0x7f34e8069db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35081e7c80 0x7f35081e8100 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 --2- 172.21.15.94:0/3645182806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f0004d50 0x7f3508159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 >> 172.21.15.94:0/3645182806 conn(0x7f350808bf90 msgr2=0x7f35080b4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 shutdown_connections 2024-09-11T23:18:09.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:09.877+0000 7f350c842640 1 -- 172.21.15.94:0/3645182806 wait complete. 2024-09-11T23:18:09.892 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:10.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d205bd640 1 Processor -- start 2024-09-11T23:18:10.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d205bd640 1 -- start start 2024-09-11T23:18:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d205bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d180b3c40 0x7f0d1815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d205bd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d180b40d0 0x7f0d18160290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d205bd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d180b4620 con 0x7f0d181567e0 2024-09-11T23:18:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d205bd640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0d180b4900 con 0x7f0d180b40d0 2024-09-11T23:18:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d205bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d180b4be0 con 0x7f0d180b3c40 2024-09-11T23:18:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1e359640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0d181567e0 0x7f0d180b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49704/0 (socket says 172.21.15.94:49704) 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1e359640 1 -- 172.21.15.94:0/2889393029 learned_addr learned my addr 172.21.15.94:0/2889393029 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1eb5a640 1 --2- 172.21.15.94:0/2889393029 >> v2:172.21.15.94:3300/0 conn(0x7f0d180b40d0 0x7f0d18160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1db58640 1 --2- 172.21.15.94:0/2889393029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d180b3c40 0x7f0d1815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1d357640 1 -- 172.21.15.94:0/2889393029 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670407174 0 0) 0x7f0d180b4620 con 0x7f0d181567e0 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1d357640 1 -- 172.21.15.94:0/2889393029 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d04003530 con 0x7f0d181567e0 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1eb5a640 1 -- 172.21.15.94:0/2889393029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d180b3c40 msgr2=0x7f0d1815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1eb5a640 1 --2- 172.21.15.94:0/2889393029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d180b3c40 0x7f0d1815fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1eb5a640 1 -- 172.21.15.94:0/2889393029 >> v1:172.21.15.94:6789/0 conn(0x7f0d181567e0 legacy=0x7f0d180b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1eb5a640 1 -- 172.21.15.94:0/2889393029 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d180b4ec0 con 0x7f0d180b40d0 2024-09-11T23:18:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.001+0000 7f0d1db58640 1 --2- 172.21.15.94:0/2889393029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d180b3c40 0x7f0d1815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:10.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1eb5a640 1 --2- 172.21.15.94:0/2889393029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d18160290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009d90 tx=0x7f0d1001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed8dabfc2a09154 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1d357640 1 -- 172.21.15.94:0/2889393029 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d100b2070 con 0x7f0d180b40d0 2024-09-11T23:18:10.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1d357640 1 -- 172.21.15.94:0/2889393029 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d100a5900 con 0x7f0d180b40d0 2024-09-11T23:18:10.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1d357640 1 -- 172.21.15.94:0/2889393029 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d100a5cb0 con 0x7f0d180b40d0 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- 172.21.15.94:0/2889393029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 msgr2=0x7f0d18160290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 --2- 172.21.15.94:0/2889393029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d18160290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009d90 tx=0x7f0d1001c820 comp rx=0 tx=0).stop 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- 172.21.15.94:0/2889393029 shutdown_connections 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 --2- 172.21.15.94:0/2889393029 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d18160290 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 --2- 172.21.15.94:0/2889393029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d180b3c40 0x7f0d1815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- 172.21.15.94:0/2889393029 >> 172.21.15.94:0/2889393029 conn(0x7f0d18073580 msgr2=0x7f0d1806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- 172.21.15.94:0/2889393029 shutdown_connections 2024-09-11T23:18:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- 172.21.15.94:0/2889393029 wait complete. 2024-09-11T23:18:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 Processor -- start 2024-09-11T23:18:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- start start 2024-09-11T23:18:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d180b3c40 0x7f0d1814a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d1815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d181567e0 0x7f0d1815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1815e130 con 0x7f0d180b40d0 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18160be0 con 0x7f0d180b3c40 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1815e2b0 con 0x7f0d181567e0 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d1815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d1815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57630/0 (socket says 172.21.15.94:57630) 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 -- 172.21.15.94:0/674244241 learned_addr learned my addr 172.21.15.94:0/674244241 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 -- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d181567e0 msgr2=0x7f0d1815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d181567e0 0x7f0d1815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 -- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d180b3c40 msgr2=0x7f0d1814a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d180b3c40 0x7f0d1814a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 -- 172.21.15.94:0/674244241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1806f600 con 0x7f0d180b40d0 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d1db58640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d1815b230 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400d830 tx=0x7f0d1400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d0affd640 1 -- 172.21.15.94:0/674244241 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14018020 con 0x7f0d180b40d0 2024-09-11T23:18:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d0affd640 1 -- 172.21.15.94:0/674244241 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140096c0 con 0x7f0d180b40d0 2024-09-11T23:18:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d18151a10 con 0x7f0d180b40d0 2024-09-11T23:18:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d0affd640 1 -- 172.21.15.94:0/674244241 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14009ab0 con 0x7f0d180b40d0 2024-09-11T23:18:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.005+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d18151fd0 con 0x7f0d180b40d0 2024-09-11T23:18:10.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.009+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d180b56c0 con 0x7f0d180b40d0 2024-09-11T23:18:10.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.009+0000 7f0d0affd640 1 -- 172.21.15.94:0/674244241 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d1401b020 con 0x7f0d180b40d0 2024-09-11T23:18:10.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.009+0000 7f0d0affd640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cfc0678c0 0x7f0cfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.009+0000 7f0d0affd640 1 -- 172.21.15.94:0/674244241 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f0d140866c0 con 0x7f0d180b40d0 2024-09-11T23:18:10.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.009+0000 7f0d1e359640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cfc0678c0 0x7f0cfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.009+0000 7f0d1e359640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cfc0678c0 0x7f0cfc069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c007fd0 tx=0x7f0d0c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.013+0000 7f0d0affd640 1 -- 172.21.15.94:0/674244241 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d14022020 con 0x7f0d180b40d0 2024-09-11T23:18:10.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.161+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d18070e20 con 0x7f0d180b40d0 2024-09-11T23:18:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d0affd640 1 -- 172.21.15.94:0/674244241 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17206 (secure 0 0 0) 0x7f0d14056fd0 con 0x7f0d180b40d0 2024-09-11T23:18:10.166 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:10.166 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":64,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:17:55.221674+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:31.612159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:32.924950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cfc0678c0 msgr2=0x7f0cfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cfc0678c0 0x7f0cfc069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c007fd0 tx=0x7f0d0c007900 comp rx=0 tx=0).stop 2024-09-11T23:18:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 msgr2=0x7f0d1815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d1815b230 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400d830 tx=0x7f0d1400dcf0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 shutdown_connections 2024-09-11T23:18:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d181567e0 0x7f0d1815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0cfc0678c0 0x7f0cfc069d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d180b40d0 0x7f0d1815b230 secure :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400d830 tx=0x7f0d1400dcf0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 --2- 172.21.15.94:0/674244241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d180b3c40 0x7f0d1814a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 >> 172.21.15.94:0/674244241 conn(0x7f0d18073580 msgr2=0x7f0d1814d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 shutdown_connections 2024-09-11T23:18:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.165+0000 7f0d205bd640 1 -- 172.21.15.94:0/674244241 wait complete. 2024-09-11T23:18:10.184 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:18:10.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff3e3ed640 1 Processor -- start 2024-09-11T23:18:10.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff3e3ed640 1 -- start start 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff3e3ed640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff38162620 0x7eff380b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff3e3ed640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38070050 0x7eff3806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff3e3ed640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff380b4250 con 0x7eff380b0590 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff3e3ed640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7eff380b4020 con 0x7eff38162620 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff3e3ed640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff380b4530 con 0x7eff38070050 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff37fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff38162620 0x7eff380b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff377fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7eff380b0590 0x7eff3806f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49708/0 (socket says 172.21.15.94:49708) 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff377fe640 1 -- 172.21.15.94:0/3291661250 learned_addr learned my addr 172.21.15.94:0/3291661250 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff37fff640 1 -- 172.21.15.94:0/3291661250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38070050 msgr2=0x7eff3806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff37fff640 1 --2- 172.21.15.94:0/3291661250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38070050 0x7eff3806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff37fff640 1 -- 172.21.15.94:0/3291661250 >> v1:172.21.15.94:6789/0 conn(0x7eff380b0590 legacy=0x7eff3806f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.305+0000 7eff37fff640 1 -- 172.21.15.94:0/3291661250 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff38070980 con 0x7eff38162620 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 --2- 172.21.15.94:0/3291661250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38162620 0x7eff380b5ed0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7eff30009d90 tx=0x7eff3001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4f6b4d5ce07c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff36ffd640 1 -- 172.21.15.94:0/3291661250 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300b2070 con 0x7eff38162620 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff36ffd640 1 -- 172.21.15.94:0/3291661250 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff300a5970 con 0x7eff38162620 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff36ffd640 1 -- 172.21.15.94:0/3291661250 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300a5d40 con 0x7eff38162620 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- 172.21.15.94:0/3291661250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38162620 msgr2=0x7eff380b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/3291661250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38162620 0x7eff380b5ed0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7eff30009d90 tx=0x7eff3001c8b0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- 172.21.15.94:0/3291661250 shutdown_connections 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/3291661250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38070050 0x7eff3806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/3291661250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38162620 0x7eff380b5ed0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- 172.21.15.94:0/3291661250 >> 172.21.15.94:0/3291661250 conn(0x7eff3809aa00 msgr2=0x7eff380b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- 172.21.15.94:0/3291661250 shutdown_connections 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- 172.21.15.94:0/3291661250 wait complete. 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 Processor -- start 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- start start 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38070050 0x7eff380b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff380b0590 0x7eff380b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38162620 0x7eff3815df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7eff38162a00 con 0x7eff38070050 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff3816f3a0 con 0x7eff380b0590 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3e3ed640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff3815dae0 con 0x7eff38162620 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38070050 0x7eff380b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38070050 0x7eff380b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57648/0 (socket says 172.21.15.94:57648) 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 -- 172.21.15.94:0/158738907 learned_addr learned my addr 172.21.15.94:0/158738907 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff377fe640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff380b0590 0x7eff380b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff3c98a640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38162620 0x7eff3815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 -- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38162620 msgr2=0x7eff3815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38162620 0x7eff3815df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 -- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff380b0590 msgr2=0x7eff380b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff380b0590 0x7eff380b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.309+0000 7eff37fff640 1 -- 172.21.15.94:0/158738907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff380b2490 con 0x7eff38070050 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff377fe640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff380b0590 0x7eff380b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff37fff640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38070050 0x7eff380b1f50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7eff3001a4e0 tx=0x7eff30019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff34ff9640 1 -- 172.21.15.94:0/158738907 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300bd020 con 0x7eff38070050 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff34ff9640 1 -- 172.21.15.94:0/158738907 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff300ad740 con 0x7eff38070050 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3815c550 con 0x7eff38070050 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff34ff9640 1 -- 172.21.15.94:0/158738907 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300b2040 con 0x7eff38070050 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3815cb10 con 0x7eff38070050 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3806bcc0 con 0x7eff38070050 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff34ff9640 1 -- 172.21.15.94:0/158738907 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff300c0020 con 0x7eff38070050 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff34ff9640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff180678c0 0x7eff18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff34ff9640 1 -- 172.21.15.94:0/158738907 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7eff30121060 con 0x7eff38070050 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff377fe640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff180678c0 0x7eff18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.313+0000 7eff377fe640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff180678c0 0x7eff18069d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7eff20007fd0 tx=0x7eff20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.317+0000 7eff34ff9640 1 -- 172.21.15.94:0/158738907 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff300c7030 con 0x7eff38070050 2024-09-11T23:18:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.505+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7eff380b0280 con 0x7eff38070050 2024-09-11T23:18:10.506 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:18:10.505+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:18:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.505+0000 7eff34ff9640 1 -- 172.21.15.94:0/158738907 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7eff380b2490 con 0x7eff38070050 2024-09-11T23:18:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:18:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff180678c0 msgr2=0x7eff18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff180678c0 0x7eff18069d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7eff20007fd0 tx=0x7eff20009040 comp rx=0 tx=0).stop 2024-09-11T23:18:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38070050 msgr2=0x7eff380b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38070050 0x7eff380b1f50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7eff3001a4e0 tx=0x7eff30019650 comp rx=0 tx=0).stop 2024-09-11T23:18:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 shutdown_connections 2024-09-11T23:18:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff38162620 0x7eff3815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff380b0590 0x7eff380b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff180678c0 0x7eff18069d80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 --2- 172.21.15.94:0/158738907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff38070050 0x7eff380b1f50 secure :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7eff3001a4e0 tx=0x7eff30019650 comp rx=0 tx=0).stop 2024-09-11T23:18:10.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 >> 172.21.15.94:0/158738907 conn(0x7eff3809aa00 msgr2=0x7eff380b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 shutdown_connections 2024-09-11T23:18:10.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.509+0000 7eff3e3ed640 1 -- 172.21.15.94:0/158738907 wait complete. 2024-09-11T23:18:10.528 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:18:10.566 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:18:10.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d9a1a640 1 Processor -- start 2024-09-11T23:18:10.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d9a1a640 1 -- start start 2024-09-11T23:18:10.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d9a1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d4070020 0x7fb7d415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d9a1a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7d415f1d0 0x7fb7d40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d9a1a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d40aede0 con 0x7fb7d41520a0 2024-09-11T23:18:10.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d9a1a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d4152480 con 0x7fb7d415f1d0 2024-09-11T23:18:10.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d9a1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d415fa10 con 0x7fb7d4070020 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7ca7fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d4070020 0x7fb7d415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7d415f1d0 0x7fb7d40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7ca7fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d4070020 0x7fb7d415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:59352/0 (socket says 172.21.15.94:59352) 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7d37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7d415f1d0 0x7fb7d40adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:57014/0 (socket says 172.21.15.94:57014) 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7ca7fc640 1 -- 172.21.15.94:0/3088706109 learned_addr learned my addr 172.21.15.94:0/3088706109 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7ca7fc640 1 -- 172.21.15.94:0/3088706109 >> v2:172.21.15.155:3300/0 conn(0x7fb7d415f1d0 msgr2=0x7fb7d40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7ca7fc640 1 --2- 172.21.15.94:0/3088706109 >> v2:172.21.15.155:3300/0 conn(0x7fb7d415f1d0 0x7fb7d40adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7ca7fc640 1 -- 172.21.15.94:0/3088706109 >> v1:172.21.15.155:6789/0 conn(0x7fb7d41520a0 legacy=0x7fb7d406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.657+0000 7fb7ca7fc640 1 -- 172.21.15.94:0/3088706109 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d4074250 con 0x7fb7d4070020 2024-09-11T23:18:10.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7ca7fc640 1 --2- 172.21.15.94:0/3088706109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d4070020 0x7fb7d415ec90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0098a0 tx=0x7fb7bc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86efde6cc02a26d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d27fc640 1 -- 172.21.15.94:0/3088706109 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc0aa670 con 0x7fb7d4070020 2024-09-11T23:18:10.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d27fc640 1 -- 172.21.15.94:0/3088706109 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0af070 con 0x7fb7d4070020 2024-09-11T23:18:10.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d27fc640 1 -- 172.21.15.94:0/3088706109 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc0aaa30 con 0x7fb7d4070020 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/3088706109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d4070020 msgr2=0x7fb7d415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/3088706109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d4070020 0x7fb7d415ec90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0098a0 tx=0x7fb7bc01c510 comp rx=0 tx=0).stop 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/3088706109 shutdown_connections 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/3088706109 >> v2:172.21.15.155:3300/0 conn(0x7fb7d415f1d0 0x7fb7d40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/3088706109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d4070020 0x7fb7d415ec90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/3088706109 >> 172.21.15.94:0/3088706109 conn(0x7fb7d40b1f90 msgr2=0x7fb7d40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/3088706109 shutdown_connections 2024-09-11T23:18:10.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/3088706109 wait complete. 2024-09-11T23:18:10.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 Processor -- start 2024-09-11T23:18:10.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.661+0000 7fb7d9a1a640 1 -- start start 2024-09-11T23:18:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7d4070020 0x7fb7d414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d41520a0 0x7fb7d40b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d415f1d0 0x7fb7d40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d415f5e0 con 0x7fb7d4070020 2024-09-11T23:18:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d4073d30 con 0x7fb7d41520a0 2024-09-11T23:18:10.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d415f760 con 0x7fb7d415f1d0 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7d4070020 0x7fb7d414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7d4070020 0x7fb7d414f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57672/0 (socket says 172.21.15.94:57672) 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/168014628 learned_addr learned my addr 172.21.15.94:0/168014628 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7ca7fc640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d41520a0 0x7fb7d40b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d37fe640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d415f1d0 0x7fb7d40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d415f1d0 msgr2=0x7fb7d40b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d415f1d0 0x7fb7d40b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d41520a0 msgr2=0x7fb7d40b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d41520a0 0x7fb7d40b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 -- 172.21.15.94:0/168014628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d414fe80 con 0x7fb7d4070020 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d2ffd640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7d4070020 0x7fb7d414f940 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c420 tx=0x7fb7c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d0ff9640 1 -- 172.21.15.94:0/168014628 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c40052d0 con 0x7fb7d4070020 2024-09-11T23:18:10.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d0ff9640 1 -- 172.21.15.94:0/168014628 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4005470 con 0x7fb7d4070020 2024-09-11T23:18:10.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d414aa30 con 0x7fb7d4070020 2024-09-11T23:18:10.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d0ff9640 1 -- 172.21.15.94:0/168014628 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4007260 con 0x7fb7d4070020 2024-09-11T23:18:10.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d40cea60 con 0x7fb7d4070020 2024-09-11T23:18:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d415ec90 con 0x7fb7d4070020 2024-09-11T23:18:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d0ff9640 1 -- 172.21.15.94:0/168014628 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7c4007400 con 0x7fb7d4070020 2024-09-11T23:18:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d0ff9640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7b40678f0 0x7fb7b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7d0ff9640 1 -- 172.21.15.94:0/168014628 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6332+0+0 (secure 0 0 0) 0x7fb7c4085340 con 0x7fb7d4070020 2024-09-11T23:18:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.665+0000 7fb7ca7fc640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7b40678f0 0x7fb7b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.669+0000 7fb7ca7fc640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7b40678f0 0x7fb7b4069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ae000 tx=0x7fb7bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.669+0000 7fb7d0ff9640 1 -- 172.21.15.94:0/168014628 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7c4055ca0 con 0x7fb7d4070020 2024-09-11T23:18:10.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:10.865+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb7d406e540 con 0x7fb7d4070020 2024-09-11T23:18:11.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.509+0000 7fb7d0ff9640 1 -- 172.21.15.94:0/168014628 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7fb7c40555a0 con 0x7fb7d4070020 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7b40678f0 msgr2=0x7fb7b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7b40678f0 0x7fb7b4069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ae000 tx=0x7fb7bc0a7000 comp rx=0 tx=0).stop 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7d4070020 msgr2=0x7fb7d414f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7d4070020 0x7fb7d414f940 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c420 tx=0x7fb7c400c8e0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 shutdown_connections 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7d415f1d0 0x7fb7d40b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d41520a0 0x7fb7d40b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb7b40678f0 0x7fb7b4069db0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 --2- 172.21.15.94:0/168014628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7d4070020 0x7fb7d414f940 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 >> 172.21.15.94:0/168014628 conn(0x7fb7d40b1f90 msgr2=0x7fb7d406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 shutdown_connections 2024-09-11T23:18:11.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.513+0000 7fb7d9a1a640 1 -- 172.21.15.94:0/168014628 wait complete. 2024-09-11T23:18:11.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:18:11.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.701+0000 7f8425591640 1 Processor -- start 2024-09-11T23:18:11.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.701+0000 7f8425591640 1 -- start start 2024-09-11T23:18:11.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f8425591640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8420070020 0x7f842015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f8425591640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f842015f1d0 0x7f84200adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f8425591640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84200aede0 con 0x7f84201520a0 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f8425591640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8420152480 con 0x7f842015f1d0 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f8425591640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f842015fa10 con 0x7f8420070020 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841effd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f84201520a0 0x7f842006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49730/0 (socket says 172.21.15.94:49730) 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841effd640 1 -- 172.21.15.94:0/830506882 learned_addr learned my addr 172.21.15.94:0/830506882 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482759856 0 0) 0x7f84200aede0 con 0x7f84201520a0 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8408003530 con 0x7f84201520a0 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841f7fe640 1 --2- 172.21.15.94:0/830506882 >> v2:172.21.15.155:3300/0 conn(0x7f842015f1d0 0x7f84200adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841e7fc640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8420070020 0x7f842015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2608592654 0 0) 0x7f8408003530 con 0x7f84201520a0 2024-09-11T23:18:11.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8420070020 msgr2=0x7f842015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8420070020 0x7f842015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 >> v2:172.21.15.155:3300/0 conn(0x7f842015f1d0 msgr2=0x7f84200adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 --2- 172.21.15.94:0/830506882 >> v2:172.21.15.155:3300/0 conn(0x7f842015f1d0 0x7f84200adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8420074250 con 0x7f84201520a0 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f8410001680 con 0x7f84201520a0 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 >> v1:172.21.15.94:6789/0 conn(0x7f84201520a0 legacy=0x7f842006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84080039c0 0x7f8408003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8408004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8420070020 0x7f84080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f842015fa10 con 0x7f8408004810 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f840800b9d0 con 0x7f84080039c0 2024-09-11T23:18:11.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f840800bb50 con 0x7f8420070020 2024-09-11T23:18:11.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841e7fc640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8408004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841effd640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84080039c0 0x7f8408003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841e7fc640 1 -- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8420070020 msgr2=0x7f84080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:11.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841e7fc640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8420070020 0x7f84080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841e7fc640 1 -- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84080039c0 msgr2=0x7f8408003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:11.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841e7fc640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84080039c0 0x7f8408003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.705+0000 7f841e7fc640 1 -- 172.21.15.94:0/830506882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8408003530 con 0x7f8408004810 2024-09-11T23:18:11.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841e7fc640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8408004c90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f841400ba10 tx=0x7f841401c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e9e5f13c49709a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:11.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841400b610 con 0x7f8408004810 2024-09-11T23:18:11.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84140b0070 con 0x7f8408004810 2024-09-11T23:18:11.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841dffb640 1 -- 172.21.15.94:0/830506882 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84140ab830 con 0x7f8408004810 2024-09-11T23:18:11.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- 172.21.15.94:0/830506882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 msgr2=0x7f8408004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 --2- 172.21.15.94:0/830506882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8408004c90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f841400ba10 tx=0x7f841401c6c0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841f7fe640 1 -- 172.21.15.94:0/830506882 reap_dead start 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- 172.21.15.94:0/830506882 shutdown_connections 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- 172.21.15.94:0/830506882 >> 172.21.15.94:0/830506882 conn(0x7f84200b1f90 msgr2=0x7f84200b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- 172.21.15.94:0/830506882 shutdown_connections 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- 172.21.15.94:0/830506882 wait complete. 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 Processor -- start 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- start start 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8420150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842009e0a0 0x7f842015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84200cf460 0x7f842015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8420073a50 con 0x7f8408004810 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8420073770 con 0x7f84200cf460 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8420073d30 con 0x7f842009e0a0 2024-09-11T23:18:11.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8420150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8420150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57692/0 (socket says 172.21.15.94:57692) 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 -- 172.21.15.94:0/865859234 learned_addr learned my addr 172.21.15.94:0/865859234 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841e7fc640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842009e0a0 0x7f842015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841f7fe640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84200cf460 0x7f842015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 -- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842009e0a0 msgr2=0x7f842015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842009e0a0 0x7f842015d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 -- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84200cf460 msgr2=0x7f842015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84200cf460 0x7f842015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 -- 172.21.15.94:0/865859234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8420153940 con 0x7f8408004810 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841f7fe640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84200cf460 0x7f842015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f841effd640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8420150950 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8410000fc0 tx=0x7f841000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f84077fe640 1 -- 172.21.15.94:0/865859234 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000eb60 con 0x7f8408004810 2024-09-11T23:18:11.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f84077fe640 1 -- 172.21.15.94:0/865859234 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8410011040 con 0x7f8408004810 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84201540a0 con 0x7f8408004810 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f84077fe640 1 -- 172.21.15.94:0/865859234 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410015400 con 0x7f8408004810 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.709+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8420154660 con 0x7f8408004810 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.713+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420068e50 con 0x7f8408004810 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.713+0000 7f84077fe640 1 -- 172.21.15.94:0/865859234 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f841001d020 con 0x7f8408004810 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.713+0000 7f84077fe640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f840c0678f0 0x7f840c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.713+0000 7f84077fe640 1 -- 172.21.15.94:0/865859234 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6332+0+0 (secure 0 0 0) 0x7f8410088e40 con 0x7f8408004810 2024-09-11T23:18:11.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.713+0000 7f841e7fc640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f840c0678f0 0x7f840c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:11.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.713+0000 7f841e7fc640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f840c0678f0 0x7f840c069db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f84140af000 tx=0x7f84140046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:11.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.717+0000 7f84077fe640 1 -- 172.21.15.94:0/865859234 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f84100597a0 con 0x7f8408004810 2024-09-11T23:18:11.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:11.881+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84200aede0 con 0x7f8408004810 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.517+0000 7f84077fe640 1 -- 172.21.15.94:0/865859234 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) ==== 181+0+0 (secure 0 0 0) 0x7f84100590a0 con 0x7f8408004810 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:18:12.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f840c0678f0 msgr2=0x7f840c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f840c0678f0 0x7f840c069db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f84140af000 tx=0x7f84140046d0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 msgr2=0x7f8420150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8420150950 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8410000fc0 tx=0x7f841000e4d0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 shutdown_connections 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84200cf460 0x7f842015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842009e0a0 0x7f842015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f840c0678f0 0x7f840c069db0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 --2- 172.21.15.94:0/865859234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8408004810 0x7f8420150950 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 >> 172.21.15.94:0/865859234 conn(0x7f84200b1f90 msgr2=0x7f842006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 shutdown_connections 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.521+0000 7f8425591640 1 -- 172.21.15.94:0/865859234 wait complete. 2024-09-11T23:18:12.542 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:18:12.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f3679b25640 1 Processor -- start 2024-09-11T23:18:12.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f3679b25640 1 -- start start 2024-09-11T23:18:12.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f3679b25640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3674160520 0x7f3674071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f3679b25640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 0x7f3674071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f3679b25640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36740d0d70 con 0x7f3674160900 2024-09-11T23:18:12.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f3679b25640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f367415d170 con 0x7f3674160520 2024-09-11T23:18:12.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f3679b25640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36740d1640 con 0x7f367415cd00 2024-09-11T23:18:12.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f36737fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3674160520 0x7f3674071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f36737fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3674160520 0x7f3674071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57708/0 (socket says 172.21.15.94:57708) 2024-09-11T23:18:12.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f36737fe640 1 -- 172.21.15.94:0/1084536732 learned_addr learned my addr 172.21.15.94:0/1084536732 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:12.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f36737fe640 1 -- 172.21.15.94:0/1084536732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 msgr2=0x7f3674071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f36737fe640 1 --2- 172.21.15.94:0/1084536732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 0x7f3674071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f36737fe640 1 -- 172.21.15.94:0/1084536732 >> v1:172.21.15.155:6789/0 conn(0x7f3674160900 legacy=0x7f367415c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.669+0000 7f36737fe640 1 -- 172.21.15.94:0/1084536732 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367415d390 con 0x7f3674160520 2024-09-11T23:18:12.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f36737fe640 1 --2- 172.21.15.94:0/1084536732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f3674071750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f366c009e50 tx=0x7f366c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148bf7969027ebbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f36727fc640 1 -- 172.21.15.94:0/1084536732 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0a5510 con 0x7f3674160520 2024-09-11T23:18:12.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f36727fc640 1 -- 172.21.15.94:0/1084536732 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c0a56b0 con 0x7f3674160520 2024-09-11T23:18:12.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f36727fc640 1 -- 172.21.15.94:0/1084536732 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0a5a80 con 0x7f3674160520 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- 172.21.15.94:0/1084536732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 msgr2=0x7f3674071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 --2- 172.21.15.94:0/1084536732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f3674071750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f366c009e50 tx=0x7f366c01c780 comp rx=0 tx=0).stop 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- 172.21.15.94:0/1084536732 shutdown_connections 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 --2- 172.21.15.94:0/1084536732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 0x7f3674071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 --2- 172.21.15.94:0/1084536732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f3674071750 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- 172.21.15.94:0/1084536732 >> 172.21.15.94:0/1084536732 conn(0x7f367406c0c0 msgr2=0x7f367406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- 172.21.15.94:0/1084536732 shutdown_connections 2024-09-11T23:18:12.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- 172.21.15.94:0/1084536732 wait complete. 2024-09-11T23:18:12.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 Processor -- start 2024-09-11T23:18:12.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- start start 2024-09-11T23:18:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 0x7f3674166790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f367413e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3674160900 0x7f367406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3674141190 con 0x7f3674160520 2024-09-11T23:18:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36740d2ae0 con 0x7f3674160900 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.673+0000 7f3679b25640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3674141310 con 0x7f367415cd00 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f367413e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f367413e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57724/0 (socket says 172.21.15.94:57724) 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 -- 172.21.15.94:0/3228848745 learned_addr learned my addr 172.21.15.94:0/3228848745 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 -- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 msgr2=0x7f3674166790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 0x7f3674166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 -- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3674160900 msgr2=0x7f367406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3674160900 0x7f367406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 -- 172.21.15.94:0/3228848745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367415fdd0 con 0x7f3674160520 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3672ffd640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f367413e750 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f366800b3e0 tx=0x7f366800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f365bfff640 1 -- 172.21.15.94:0/3228848745 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668015020 con 0x7f3674160520 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f365bfff640 1 -- 172.21.15.94:0/3228848745 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3668011850 con 0x7f3674160520 2024-09-11T23:18:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3674070c30 con 0x7f3674160520 2024-09-11T23:18:12.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f365bfff640 1 -- 172.21.15.94:0/3228848745 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668011c40 con 0x7f3674160520 2024-09-11T23:18:12.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367415f930 con 0x7f3674160520 2024-09-11T23:18:12.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367415c5f0 con 0x7f3674160520 2024-09-11T23:18:12.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f365bfff640 1 -- 172.21.15.94:0/3228848745 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3668018020 con 0x7f3674160520 2024-09-11T23:18:12.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f365bfff640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36600678c0 0x7f3660069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f365bfff640 1 -- 172.21.15.94:0/3228848745 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5865+0+0 (secure 0 0 0) 0x7f3668085cd0 con 0x7f3674160520 2024-09-11T23:18:12.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.677+0000 7f36737fe640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36600678c0 0x7f3660069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.681+0000 7f36737fe640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36600678c0 0x7f3660069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f366c0ae000 tx=0x7f366c004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.681+0000 7f365bfff640 1 -- 172.21.15.94:0/3228848745 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f366801f020 con 0x7f3674160520 2024-09-11T23:18:12.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:12.845+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3674143b50 con 0x7f3674160520 2024-09-11T23:18:13.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.517+0000 7f365bfff640 1 -- 172.21.15.94:0/3228848745 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) ==== 169+0+0 (secure 0 0 0) 0x7f36680172c0 con 0x7f3674160520 2024-09-11T23:18:13.521 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36600678c0 msgr2=0x7f3660069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36600678c0 0x7f3660069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f366c0ae000 tx=0x7f366c004ac0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 msgr2=0x7f367413e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f367413e750 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f366800b3e0 tx=0x7f366800b8a0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 shutdown_connections 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3674160900 0x7f367406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36600678c0 0x7f3660069d80 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f366c0ae000 tx=0x7f366c004ac0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3674160520 0x7f367413e750 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 --2- 172.21.15.94:0/3228848745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f367415cd00 0x7f3674166790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.521+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 >> 172.21.15.94:0/3228848745 conn(0x7f367406c0c0 msgr2=0x7f367415b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.525+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 shutdown_connections 2024-09-11T23:18:13.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.525+0000 7f3679b25640 1 -- 172.21.15.94:0/3228848745 wait complete. 2024-09-11T23:18:13.550 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_fragment_size_max 2024-09-11T23:18:13.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f3750640 1 Processor -- start 2024-09-11T23:18:13.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f3750640 1 -- start start 2024-09-11T23:18:13.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f3750640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe6ec070020 0x7fe6ec15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f3750640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec0aede0 con 0x7fe6ec15f1d0 2024-09-11T23:18:13.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f3750640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec15fa10 con 0x7fe6ec1520a0 2024-09-11T23:18:13.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f3750640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec152480 con 0x7fe6ec070020 2024-09-11T23:18:13.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f0ceb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe6ec070020 0x7fe6ec15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f1ced640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe6ec15f1d0 0x7fe6ec0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49744/0 (socket says 172.21.15.94:49744) 2024-09-11T23:18:13.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f1ced640 1 -- 172.21.15.94:0/889666732 learned_addr learned my addr 172.21.15.94:0/889666732 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:13.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f0ceb640 1 -- 172.21.15.94:0/889666732 >> v1:172.21.15.155:6789/0 conn(0x7fe6ec1520a0 legacy=0x7fe6ec06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:13.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f0ceb640 1 -- 172.21.15.94:0/889666732 >> v1:172.21.15.94:6789/0 conn(0x7fe6ec15f1d0 legacy=0x7fe6ec0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6f0ceb640 1 -- 172.21.15.94:0/889666732 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec074250 con 0x7fe6ec070020 2024-09-11T23:18:13.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.677+0000 7fe6e3fff640 1 -- 172.21.15.94:0/889666732 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057283462 0 0) 0x7fe6ec0aede0 con 0x7fe6ec15f1d0 2024-09-11T23:18:13.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f0ceb640 1 --2- 172.21.15.94:0/889666732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec070020 0x7fe6ec15ec90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0097c0 tx=0x7fe6dc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95294df940d99b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6e3fff640 1 -- 172.21.15.94:0/889666732 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0aeba0 con 0x7fe6ec070020 2024-09-11T23:18:13.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6e3fff640 1 -- 172.21.15.94:0/889666732 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0b0070 con 0x7fe6ec070020 2024-09-11T23:18:13.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6e3fff640 1 -- 172.21.15.94:0/889666732 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0ab650 con 0x7fe6ec070020 2024-09-11T23:18:13.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f3750640 1 -- 172.21.15.94:0/889666732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec070020 msgr2=0x7fe6ec15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f3750640 1 --2- 172.21.15.94:0/889666732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec070020 0x7fe6ec15ec90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0097c0 tx=0x7fe6dc01c430 comp rx=0 tx=0).stop 2024-09-11T23:18:13.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f3750640 1 -- 172.21.15.94:0/889666732 shutdown_connections 2024-09-11T23:18:13.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f3750640 1 --2- 172.21.15.94:0/889666732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec070020 0x7fe6ec15ec90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f3750640 1 -- 172.21.15.94:0/889666732 >> 172.21.15.94:0/889666732 conn(0x7fe6ec0b1f90 msgr2=0x7fe6ec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f3750640 1 -- 172.21.15.94:0/889666732 shutdown_connections 2024-09-11T23:18:13.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.681+0000 7fe6f3750640 1 -- 172.21.15.94:0/889666732 wait complete. 2024-09-11T23:18:13.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 Processor -- start 2024-09-11T23:18:13.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 -- start start 2024-09-11T23:18:13.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ec070020 0x7fe6ec14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec1520a0 0x7fe6ec15d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6ec15f1d0 0x7fe6ec143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec15f640 con 0x7fe6ec1520a0 2024-09-11T23:18:13.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec073d30 con 0x7fe6ec070020 2024-09-11T23:18:13.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec15f7c0 con 0x7fe6ec15f1d0 2024-09-11T23:18:13.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec1520a0 0x7fe6ec15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec1520a0 0x7fe6ec15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57746/0 (socket says 172.21.15.94:57746) 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 -- 172.21.15.94:0/2507942297 learned_addr learned my addr 172.21.15.94:0/2507942297 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f14ec640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ec070020 0x7fe6ec14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 -- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6ec15f1d0 msgr2=0x7fe6ec143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6ec15f1d0 0x7fe6ec143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 -- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ec070020 msgr2=0x7fe6ec14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ec070020 0x7fe6ec14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 -- 172.21.15.94:0/2507942297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec0b1d60 con 0x7fe6ec1520a0 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f0ceb640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec1520a0 0x7fe6ec15d960 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0ad040 tx=0x7fe6dc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6e1ffb640 1 -- 172.21.15.94:0/2507942297 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0bf610 con 0x7fe6ec1520a0 2024-09-11T23:18:13.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6e1ffb640 1 -- 172.21.15.94:0/2507942297 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0bf7d0 con 0x7fe6ec1520a0 2024-09-11T23:18:13.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec14c7e0 con 0x7fe6ec1520a0 2024-09-11T23:18:13.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6e1ffb640 1 -- 172.21.15.94:0/2507942297 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0bfbc0 con 0x7fe6ec1520a0 2024-09-11T23:18:13.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec14cda0 con 0x7fe6ec1520a0 2024-09-11T23:18:13.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec15ec90 con 0x7fe6ec1520a0 2024-09-11T23:18:13.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6e1ffb640 1 -- 172.21.15.94:0/2507942297 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6dc0bd020 con 0x7fe6ec1520a0 2024-09-11T23:18:13.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6e1ffb640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6d00678c0 0x7fe6d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.685+0000 7fe6e1ffb640 1 -- 172.21.15.94:0/2507942297 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fe6dc0a8030 con 0x7fe6ec1520a0 2024-09-11T23:18:13.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.689+0000 7fe6f14ec640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6d00678c0 0x7fe6d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.689+0000 7fe6f14ec640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6d00678c0 0x7fe6d0069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8003d60 tx=0x7fe6e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.689+0000 7fe6e1ffb640 1 -- 172.21.15.94:0/2507942297 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe6dc0c4060 con 0x7fe6ec1520a0 2024-09-11T23:18:13.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.853+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"} v 0) -- 0x7fe6ec06e540 con 0x7fe6ec1520a0 2024-09-11T23:18:13.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.857+0000 7fe6e1ffb640 1 -- 172.21.15.94:0/2507942297 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"}]=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7fe6dc016050 con 0x7fe6ec1520a0 2024-09-11T23:18:13.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6d00678c0 msgr2=0x7fe6d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6d00678c0 0x7fe6d0069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8003d60 tx=0x7fe6e8009040 comp rx=0 tx=0).stop 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec1520a0 msgr2=0x7fe6ec15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec1520a0 0x7fe6ec15d960 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0ad040 tx=0x7fe6dc01ac70 comp rx=0 tx=0).stop 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 shutdown_connections 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6ec15f1d0 0x7fe6ec143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe6d00678c0 0x7fe6d0069d80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ec1520a0 0x7fe6ec15d960 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 --2- 172.21.15.94:0/2507942297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ec070020 0x7fe6ec14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 >> 172.21.15.94:0/2507942297 conn(0x7fe6ec0b1f90 msgr2=0x7fe6ec071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 shutdown_connections 2024-09-11T23:18:13.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:13.861+0000 7fe6f3750640 1 -- 172.21.15.94:0/2507942297 wait complete. 2024-09-11T23:18:13.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-11T23:18:13.984 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:13.986 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.025+0000 7ffa89bec640 1 Processor -- start 2024-09-11T23:18:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.025+0000 7ffa89bec640 1 -- start start 2024-09-11T23:18:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.025+0000 7ffa89bec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa840b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.025+0000 7ffa89bec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa8406c3d0 0x7ffa8415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.025+0000 7ffa89bec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa840b4be0 con 0x7ffa840b61c0 2024-09-11T23:18:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.025+0000 7ffa89bec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffa840b4ec0 con 0x7ffa8406c3d0 2024-09-11T23:18:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.025+0000 7ffa89bec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa840b51a0 con 0x7ffa84145250 2024-09-11T23:18:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa840b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa83fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa8406c3d0 0x7ffa8415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa840b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:59440/0 (socket says 172.21.15.94:59440) 2024-09-11T23:18:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa82ffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ffa840b61c0 0x7ffa8406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:46906/0 (socket says 172.21.15.94:46906) 2024-09-11T23:18:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 -- 172.21.15.94:0/3897743510 learned_addr learned my addr 172.21.15.94:0/3897743510 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 -- 172.21.15.94:0/3897743510 >> v2:172.21.15.155:3300/0 conn(0x7ffa8406c3d0 msgr2=0x7ffa8415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 --2- 172.21.15.94:0/3897743510 >> v2:172.21.15.155:3300/0 conn(0x7ffa8406c3d0 0x7ffa8415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 -- 172.21.15.94:0/3897743510 >> v1:172.21.15.155:6789/0 conn(0x7ffa840b61c0 legacy=0x7ffa8406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 -- 172.21.15.94:0/3897743510 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa840b5480 con 0x7ffa84145250 2024-09-11T23:18:14.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa837fe640 1 --2- 172.21.15.94:0/3897743510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa840b5c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009870 tx=0x7ffa7401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769df2021c80bc7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa827fc640 1 -- 172.21.15.94:0/3897743510 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa740b0070 con 0x7ffa84145250 2024-09-11T23:18:14.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa827fc640 1 -- 172.21.15.94:0/3897743510 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74004230 con 0x7ffa84145250 2024-09-11T23:18:14.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.029+0000 7ffa827fc640 1 -- 172.21.15.94:0/3897743510 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74003620 con 0x7ffa84145250 2024-09-11T23:18:14.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- 172.21.15.94:0/3897743510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 msgr2=0x7ffa840b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 --2- 172.21.15.94:0/3897743510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa840b5c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009870 tx=0x7ffa7401c440 comp rx=0 tx=0).stop 2024-09-11T23:18:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- 172.21.15.94:0/3897743510 shutdown_connections 2024-09-11T23:18:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 --2- 172.21.15.94:0/3897743510 >> v2:172.21.15.155:3300/0 conn(0x7ffa8406c3d0 0x7ffa8415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 --2- 172.21.15.94:0/3897743510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa840b5c80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- 172.21.15.94:0/3897743510 >> 172.21.15.94:0/3897743510 conn(0x7ffa840b6650 msgr2=0x7ffa840b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- 172.21.15.94:0/3897743510 shutdown_connections 2024-09-11T23:18:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- 172.21.15.94:0/3897743510 wait complete. 2024-09-11T23:18:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 Processor -- start 2024-09-11T23:18:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- start start 2024-09-11T23:18:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8406c3d0 0x7ffa84141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa8409c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa84142350 0x7ffa8409c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8415d2f0 con 0x7ffa84142350 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8415d170 con 0x7ffa8406c3d0 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8415d470 con 0x7ffa84145250 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa84142350 0x7ffa8409c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa84142350 0x7ffa8409c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57762/0 (socket says 172.21.15.94:57762) 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 -- 172.21.15.94:0/222204788 learned_addr learned my addr 172.21.15.94:0/222204788 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa82ffd640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa8409c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa837fe640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8406c3d0 0x7ffa84141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 -- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 msgr2=0x7ffa8409c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa8409c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 -- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8406c3d0 msgr2=0x7ffa84141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8406c3d0 0x7ffa84141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 -- 172.21.15.94:0/222204788 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8409edb0 con 0x7ffa84142350 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa83fff640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa84142350 0x7ffa8409c750 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00efc0 tx=0x7ffa7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa6bfff640 1 -- 172.21.15.94:0/222204788 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c018020 con 0x7ffa84142350 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa6bfff640 1 -- 172.21.15.94:0/222204788 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c014480 con 0x7ffa84142350 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8409f090 con 0x7ffa84142350 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa6bfff640 1 -- 172.21.15.94:0/222204788 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c014870 con 0x7ffa84142350 2024-09-11T23:18:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.033+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa841418f0 con 0x7ffa84142350 2024-09-11T23:18:14.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.037+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8409eba0 con 0x7ffa84142350 2024-09-11T23:18:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.037+0000 7ffa6bfff640 1 -- 172.21.15.94:0/222204788 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa7c01b020 con 0x7ffa84142350 2024-09-11T23:18:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.037+0000 7ffa6bfff640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa700678c0 0x7ffa70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.037+0000 7ffa6bfff640 1 -- 172.21.15.94:0/222204788 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7ffa7c086470 con 0x7ffa84142350 2024-09-11T23:18:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.037+0000 7ffa837fe640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa700678c0 0x7ffa70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.037+0000 7ffa837fe640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa700678c0 0x7ffa70069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa740ad000 tx=0x7ffa740a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.041+0000 7ffa6bfff640 1 -- 172.21.15.94:0/222204788 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa7c022070 con 0x7ffa84142350 2024-09-11T23:18:14.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.205+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7ffa8415c9e0 con 0x7ffa84142350 2024-09-11T23:18:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.209+0000 7ffa6bfff640 1 -- 172.21.15.94:0/222204788 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v20) ==== 101+0+0 (secure 0 0 0) 0x7ffa7c010040 con 0x7ffa84142350 2024-09-11T23:18:14.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa700678c0 msgr2=0x7ffa70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa700678c0 0x7ffa70069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa740ad000 tx=0x7ffa740a6000 comp rx=0 tx=0).stop 2024-09-11T23:18:14.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa84142350 msgr2=0x7ffa8409c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa84142350 0x7ffa8409c750 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00efc0 tx=0x7ffa7c00c490 comp rx=0 tx=0).stop 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 shutdown_connections 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ffa700678c0 0x7ffa70069d80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa84142350 0x7ffa8409c750 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84145250 0x7ffa8409c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 --2- 172.21.15.94:0/222204788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8406c3d0 0x7ffa84141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 >> 172.21.15.94:0/222204788 conn(0x7ffa840b6650 msgr2=0x7ffa8406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 shutdown_connections 2024-09-11T23:18:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.213+0000 7ffa89bec640 1 -- 172.21.15.94:0/222204788 wait complete. 2024-09-11T23:18:14.231 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:18:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 Processor -- start 2024-09-11T23:18:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 -- start start 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03341520a0 0x7f033406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f033406fe50 0x7f033415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f033415f1d0 0x7f0334071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0334152480 con 0x7f033415f1d0 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0334070250 con 0x7f033406fe50 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0338ae4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f03340aede0 con 0x7f03341520a0 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0332d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f033415f1d0 0x7f0334071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0332d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f033415f1d0 0x7f0334071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57766/0 (socket says 172.21.15.94:57766) 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0332d9d640 1 -- 172.21.15.94:0/4216854042 learned_addr learned my addr 172.21.15.94:0/4216854042 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f0331d9b640 1 --2- 172.21.15.94:0/4216854042 >> v2:172.21.15.155:3300/0 conn(0x7f033406fe50 0x7f033415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.349+0000 7f033259c640 1 --2- 172.21.15.94:0/4216854042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03341520a0 0x7f033406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0332d9d640 1 -- 172.21.15.94:0/4216854042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03341520a0 msgr2=0x7f033406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0332d9d640 1 --2- 172.21.15.94:0/4216854042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03341520a0 0x7f033406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0332d9d640 1 -- 172.21.15.94:0/4216854042 >> v2:172.21.15.155:3300/0 conn(0x7f033406fe50 msgr2=0x7f033415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0332d9d640 1 --2- 172.21.15.94:0/4216854042 >> v2:172.21.15.155:3300/0 conn(0x7f033406fe50 0x7f033415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0332d9d640 1 -- 172.21.15.94:0/4216854042 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033415fa10 con 0x7f033415f1d0 2024-09-11T23:18:14.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0332d9d640 1 --2- 172.21.15.94:0/4216854042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f0334071f10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f033406de20 tx=0x7f032c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368778e91608e995 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f033159a640 1 -- 172.21.15.94:0/4216854042 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0a5590 con 0x7f033415f1d0 2024-09-11T23:18:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f033159a640 1 -- 172.21.15.94:0/4216854042 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c0a5730 con 0x7f033415f1d0 2024-09-11T23:18:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f033159a640 1 -- 172.21.15.94:0/4216854042 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0a5b00 con 0x7f033415f1d0 2024-09-11T23:18:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 -- 172.21.15.94:0/4216854042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 msgr2=0x7f0334071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 --2- 172.21.15.94:0/4216854042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f0334071f10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f033406de20 tx=0x7f032c01c710 comp rx=0 tx=0).stop 2024-09-11T23:18:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 -- 172.21.15.94:0/4216854042 shutdown_connections 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 --2- 172.21.15.94:0/4216854042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f0334071f10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 --2- 172.21.15.94:0/4216854042 >> v2:172.21.15.155:3300/0 conn(0x7f033406fe50 0x7f033415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 --2- 172.21.15.94:0/4216854042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03341520a0 0x7f033406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 -- 172.21.15.94:0/4216854042 >> 172.21.15.94:0/4216854042 conn(0x7f03340b1f90 msgr2=0x7f03340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 -- 172.21.15.94:0/4216854042 shutdown_connections 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.353+0000 7f0338ae4640 1 -- 172.21.15.94:0/4216854042 wait complete. 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 Processor -- start 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 -- start start 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f033406fe50 0x7f033414df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03341520a0 0x7f033414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f033414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0334073d30 con 0x7f033415f1d0 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0334073a50 con 0x7f03341520a0 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f033415f680 con 0x7f033406fe50 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f033414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f033414fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57768/0 (socket says 172.21.15.94:57768) 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 -- 172.21.15.94:0/3695300407 learned_addr learned my addr 172.21.15.94:0/3695300407 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 -- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f033406fe50 msgr2=0x7f033414df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f033259c640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f033406fe50 0x7f033414df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0331d9b640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03341520a0 0x7f033414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f033406fe50 0x7f033414df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 -- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03341520a0 msgr2=0x7f033414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03341520a0 0x7f033414f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 -- 172.21.15.94:0/3695300407 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033414ea30 con 0x7f033415f1d0 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0332d9d640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f033414fa00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f032c0af040 tx=0x7f032c0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0322ffd640 1 -- 172.21.15.94:0/3695300407 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c009510 con 0x7f033415f1d0 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0322ffd640 1 -- 172.21.15.94:0/3695300407 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c0b8440 con 0x7f033415f1d0 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033409b220 con 0x7f033415f1d0 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0322ffd640 1 -- 172.21.15.94:0/3695300407 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0b8850 con 0x7f033415f1d0 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03340cdbb0 con 0x7f033415f1d0 2024-09-11T23:18:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.357+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03340cd6c0 con 0x7f033415f1d0 2024-09-11T23:18:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.361+0000 7f0322ffd640 1 -- 172.21.15.94:0/3695300407 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f032c0c1020 con 0x7f033415f1d0 2024-09-11T23:18:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.361+0000 7f0322ffd640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f03140678c0 0x7f0314069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.361+0000 7f0322ffd640 1 -- 172.21.15.94:0/3695300407 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f032c11ff50 con 0x7f033415f1d0 2024-09-11T23:18:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.361+0000 7f033259c640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f03140678c0 0x7f0314069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.361+0000 7f033259c640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f03140678c0 0x7f0314069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0324009790 tx=0x7f0324008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.365+0000 7f0322ffd640 1 -- 172.21.15.94:0/3695300407 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f032c0c8020 con 0x7f033415f1d0 2024-09-11T23:18:14.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.525+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f033406e540 con 0x7f033415f1d0 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0322ffd640 1 -- 172.21.15.94:0/3695300407 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f032c0165c0 con 0x7f033415f1d0 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f03140678c0 msgr2=0x7f0314069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f03140678c0 0x7f0314069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0324009790 tx=0x7f0324008040 comp rx=0 tx=0).stop 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 msgr2=0x7f033414fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f033414fa00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f032c0af040 tx=0x7f032c0194b0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 shutdown_connections 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f03140678c0 0x7f0314069d80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033415f1d0 0x7f033414fa00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03341520a0 0x7f033414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 --2- 172.21.15.94:0/3695300407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f033406fe50 0x7f033414df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 >> 172.21.15.94:0/3695300407 conn(0x7f03340b1f90 msgr2=0x7f033406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 shutdown_connections 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.533+0000 7f0338ae4640 1 -- 172.21.15.94:0/3695300407 wait complete. 2024-09-11T23:18:14.553 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented' 2024-09-11T23:18:14.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f574c97c640 1 Processor -- start 2024-09-11T23:18:14.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f574c97c640 1 -- start start 2024-09-11T23:18:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f574c97c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f574815bec0 0x7f57480ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f574c97c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57480b3290 con 0x7f57480af470 2024-09-11T23:18:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f574c97c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57480b3570 con 0x7f574815c2a0 2024-09-11T23:18:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f574c97c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f57480b3850 con 0x7f574815bec0 2024-09-11T23:18:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5746d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f57480af470 0x7f574806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49752/0 (socket says 172.21.15.94:49752) 2024-09-11T23:18:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5746d9d640 1 -- 172.21.15.94:0/744105377 learned_addr learned my addr 172.21.15.94:0/744105377 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:14.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188739585 0 0) 0x7f57480b3290 con 0x7f57480af470 2024-09-11T23:18:14.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5734003530 con 0x7f57480af470 2024-09-11T23:18:14.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f574659c640 1 --2- 172.21.15.94:0/744105377 >> v2:172.21.15.155:3300/0 conn(0x7f574815bec0 0x7f57480ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3931030556 0 0) 0x7f5734003530 con 0x7f57480af470 2024-09-11T23:18:14.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 >> v2:172.21.15.155:3300/0 conn(0x7f574815bec0 msgr2=0x7f57480ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 --2- 172.21.15.94:0/744105377 >> v2:172.21.15.155:3300/0 conn(0x7f574815bec0 0x7f57480ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 >> v1:172.21.15.155:6789/0 conn(0x7f574815c2a0 legacy=0x7f57480aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57480b3b30 con 0x7f57480af470 2024-09-11T23:18:14.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f5740001a00 con 0x7f57480af470 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 >> v1:172.21.15.94:6789/0 conn(0x7f57480af470 legacy=0x7f574806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734003a10 0x7f5734003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5734004810 0x7f5734004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5734005220 0x7f573400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f57480b3850 con 0x7f5734004810 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f573400c150 con 0x7f5734003a10 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f573400c350 con 0x7f5734005220 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f573ffff640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5734004810 0x7f5734004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f573ffff640 1 -- 172.21.15.94:0/744105377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5734005220 msgr2=0x7f573400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f573ffff640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5734005220 0x7f573400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f573ffff640 1 -- 172.21.15.94:0/744105377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734003a10 msgr2=0x7f5734003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f573ffff640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734003a10 0x7f5734003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f573ffff640 1 -- 172.21.15.94:0/744105377 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734003530 con 0x7f5734004810 2024-09-11T23:18:14.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.669+0000 7f5746d9d640 1 -- 172.21.15.94:0/744105377 reap_dead start 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f573ffff640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5734004810 0x7f5734004c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5730007fd0 tx=0x7f573001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33880be38369926b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300b0070 con 0x7f5734004810 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57300ab620 con 0x7f5734004810 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5745d9b640 1 -- 172.21.15.94:0/744105377 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300039b0 con 0x7f5734004810 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- 172.21.15.94:0/744105377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5734004810 msgr2=0x7f5734004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5734004810 0x7f5734004c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5730007fd0 tx=0x7f573001c2a0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- 172.21.15.94:0/744105377 shutdown_connections 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 --2- 172.21.15.94:0/744105377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5734004810 0x7f5734004c90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- 172.21.15.94:0/744105377 >> 172.21.15.94:0/744105377 conn(0x7f57480b1f90 msgr2=0x7f57480b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- 172.21.15.94:0/744105377 shutdown_connections 2024-09-11T23:18:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- 172.21.15.94:0/744105377 wait complete. 2024-09-11T23:18:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 Processor -- start 2024-09-11T23:18:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- start start 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734004810 0x7f574806e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574815d730 0x7f574809ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f574815dbb0 0x7f574809b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f57480afc90 con 0x7f574815dbb0 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57480b40f0 con 0x7f5734004810 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574c97c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57480aed60 con 0x7f574815d730 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f574815dbb0 0x7f574809b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f574815dbb0 0x7f574809b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57782/0 (socket says 172.21.15.94:57782) 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 -- 172.21.15.94:0/2962531747 learned_addr learned my addr 172.21.15.94:0/2962531747 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f573ffff640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574815d730 0x7f574809ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574659c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734004810 0x7f574806e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 -- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574815d730 msgr2=0x7f574809ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574815d730 0x7f574809ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 -- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734004810 msgr2=0x7f574806e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734004810 0x7f574806e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f5746d9d640 1 -- 172.21.15.94:0/2962531747 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574815e180 con 0x7f574815dbb0 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.673+0000 7f574659c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734004810 0x7f574806e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f5746d9d640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f574815dbb0 0x7f574809b160 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f574815c680 tx=0x7f574000ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f573effd640 1 -- 172.21.15.94:0/2962531747 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574001b070 con 0x7f574815dbb0 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f573effd640 1 -- 172.21.15.94:0/2962531747 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574000da20 con 0x7f574815dbb0 2024-09-11T23:18:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574815e460 con 0x7f574815dbb0 2024-09-11T23:18:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f573effd640 1 -- 172.21.15.94:0/2962531747 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000de10 con 0x7f574815dbb0 2024-09-11T23:18:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574806e710 con 0x7f574815dbb0 2024-09-11T23:18:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57480af0f0 con 0x7f574815dbb0 2024-09-11T23:18:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f573effd640 1 -- 172.21.15.94:0/2962531747 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f574001e070 con 0x7f574815dbb0 2024-09-11T23:18:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f573effd640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57280678f0 0x7f5728069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f573effd640 1 -- 172.21.15.94:0/2962531747 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f5740088300 con 0x7f574815dbb0 2024-09-11T23:18:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f574659c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57280678f0 0x7f5728069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.677+0000 7f574659c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57280678f0 0x7f5728069db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5738006aa0 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.681+0000 7f573effd640 1 -- 172.21.15.94:0/2962531747 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5740058fb0 con 0x7f574815dbb0 2024-09-11T23:18:14.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:14.897+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]} v 0) -- 0x7f574815e630 con 0x7f574815dbb0 2024-09-11T23:18:15.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f573effd640 1 -- 172.21.15.94:0/2962531747 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]}]=0 v176) ==== 144+0+0 (secure 0 0 0) 0x7f57400588b0 con 0x7f574815dbb0 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57280678f0 msgr2=0x7f5728069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57280678f0 0x7f5728069db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5738006aa0 tx=0x7f5738008040 comp rx=0 tx=0).stop 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f574815dbb0 msgr2=0x7f574809b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f574815dbb0 0x7f574809b160 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f574815c680 tx=0x7f574000ff00 comp rx=0 tx=0).stop 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 shutdown_connections 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57280678f0 0x7f5728069db0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f574815dbb0 0x7f574809b160 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574815d730 0x7f574809ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 --2- 172.21.15.94:0/2962531747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5734004810 0x7f574806e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.525+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 >> 172.21.15.94:0/2962531747 conn(0x7f57480b1f90 msgr2=0x7f57480afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.529+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 shutdown_connections 2024-09-11T23:18:15.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.529+0000 7f574c97c640 1 -- 172.21.15.94:0/2962531747 wait complete. 2024-09-11T23:18:15.551 INFO:tasks.cephfs_test_runner:That fragmentation (forced) will allow more entries to be created. ... ok 2024-09-11T23:18:15.551 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit_strays (tasks.cephfs.test_strays.TestStrays) That unlinking fails when the stray directory fragment becomes too 2024-09-11T23:18:15.552 INFO:tasks.cephfs_test_runner:test_dirfrag_limit_strays (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:18:15.552 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:15.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.673+0000 7fec8f8d6640 1 Processor -- start 2024-09-11T23:18:15.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.673+0000 7fec8f8d6640 1 -- start start 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8f8d6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec88161a60 0x7fec880d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8f8d6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec880cf620 0x7fec8806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8f8d6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec880d32b0 con 0x7fec880d2e90 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8f8d6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fec880d0300 con 0x7fec88161a60 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8f8d6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fec880cfab0 con 0x7fec880cf620 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec88161a60 0x7fec880d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec88161a60 0x7fec880d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57790/0 (socket says 172.21.15.94:57790) 2024-09-11T23:18:15.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 -- 172.21.15.94:0/2387216446 learned_addr learned my addr 172.21.15.94:0/2387216446 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:15.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 -- 172.21.15.94:0/2387216446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec880cf620 msgr2=0x7fec8806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:15.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8de73640 1 --2- 172.21.15.94:0/2387216446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec880cf620 0x7fec8806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 --2- 172.21.15.94:0/2387216446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec880cf620 0x7fec8806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 -- 172.21.15.94:0/2387216446 >> v1:172.21.15.155:6789/0 conn(0x7fec880d2e90 legacy=0x7fec880cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:15.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 -- 172.21.15.94:0/2387216446 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec880b0f60 con 0x7fec88161a60 2024-09-11T23:18:15.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec8d672640 1 --2- 172.21.15.94:0/2387216446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec88161a60 0x7fec880d2950 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fec78009870 tx=0x7fec7801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c5b29bbd8deec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec7ffff640 1 -- 172.21.15.94:0/2387216446 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec780ab620 con 0x7fec88161a60 2024-09-11T23:18:15.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec7ffff640 1 -- 172.21.15.94:0/2387216446 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec780b0070 con 0x7fec88161a60 2024-09-11T23:18:15.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.677+0000 7fec7ffff640 1 -- 172.21.15.94:0/2387216446 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec780ab9e0 con 0x7fec88161a60 2024-09-11T23:18:15.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- 172.21.15.94:0/2387216446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec88161a60 msgr2=0x7fec880d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/2387216446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec88161a60 0x7fec880d2950 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fec78009870 tx=0x7fec7801c460 comp rx=0 tx=0).stop 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- 172.21.15.94:0/2387216446 shutdown_connections 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/2387216446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec880cf620 0x7fec8806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/2387216446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec88161a60 0x7fec880d2950 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- 172.21.15.94:0/2387216446 >> 172.21.15.94:0/2387216446 conn(0x7fec8808bf90 msgr2=0x7fec8809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- 172.21.15.94:0/2387216446 shutdown_connections 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- 172.21.15.94:0/2387216446 wait complete. 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 Processor -- start 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- start start 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec880cf620 0x7fec880b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880d2e90 0x7fec880b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec88161a60 0x7fec880cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fec8806e400 con 0x7fec880cf620 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec8806d190 con 0x7fec880d2e90 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fec8806e580 con 0x7fec88161a60 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec880cf620 0x7fec880b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec880cf620 0x7fec880b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57802/0 (socket says 172.21.15.94:57802) 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 -- 172.21.15.94:0/1207521839 learned_addr learned my addr 172.21.15.94:0/1207521839 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8de73640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec88161a60 0x7fec880cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8ce71640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880d2e90 0x7fec880b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 -- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec88161a60 msgr2=0x7fec880cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec88161a60 0x7fec880cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 -- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880d2e90 msgr2=0x7fec880b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880d2e90 0x7fec880b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 -- 172.21.15.94:0/1207521839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec880ce1a0 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8d672640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec880cf620 0x7fec880b4dc0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fec780ad040 tx=0x7fec7801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec7dffb640 1 -- 172.21.15.94:0/1207521839 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec780abd70 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec7dffb640 1 -- 172.21.15.94:0/1207521839 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec780be3f0 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec880cd100 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec7dffb640 1 -- 172.21.15.94:0/1207521839 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec780be7e0 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.681+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec880cd6c0 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.685+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec8806d6b0 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.685+0000 7fec7dffb640 1 -- 172.21.15.94:0/1207521839 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec780b43f0 con 0x7fec880cf620 2024-09-11T23:18:15.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.685+0000 7fec7dffb640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec6c0678f0 0x7fec6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.685+0000 7fec7dffb640 1 -- 172.21.15.94:0/1207521839 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fec7811ff20 con 0x7fec880cf620 2024-09-11T23:18:15.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.685+0000 7fec8ce71640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec6c0678f0 0x7fec6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.685+0000 7fec8ce71640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec6c0678f0 0x7fec6c069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fec880b9c80 tx=0x7fec840094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.689+0000 7fec7dffb640 1 -- 172.21.15.94:0/1207521839 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec780c4060 con 0x7fec880cf620 2024-09-11T23:18:15.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.837+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec880d1950 con 0x7fec880cf620 2024-09-11T23:18:15.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.837+0000 7fec7dffb640 1 -- 172.21.15.94:0/1207521839 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+13330 (secure 0 0 0) 0x7fec78016110 con 0x7fec880cf620 2024-09-11T23:18:15.840 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:15.840 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":67,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:18:13.519472+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.94:6835/2185007452":"2024-09-12T23:18:10.507129+0000","172.21.15.94:6834/2185007452":"2024-09-12T23:18:10.507129+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:15.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec6c0678f0 msgr2=0x7fec6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec6c0678f0 0x7fec6c069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fec880b9c80 tx=0x7fec840094d0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec880cf620 msgr2=0x7fec880b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec880cf620 0x7fec880b4dc0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fec780ad040 tx=0x7fec7801aca0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 shutdown_connections 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec88161a60 0x7fec880cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880d2e90 0x7fec880b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec6c0678f0 0x7fec6c069db0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 --2- 172.21.15.94:0/1207521839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec880cf620 0x7fec880b4dc0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 >> 172.21.15.94:0/1207521839 conn(0x7fec8808bf90 msgr2=0x7fec8815e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 shutdown_connections 2024-09-11T23:18:15.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.841+0000 7fec8f8d6640 1 -- 172.21.15.94:0/1207521839 wait complete. 2024-09-11T23:18:15.858 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:15:02.040073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:18:15.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:18:15.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f86089f4640 1 Processor -- start 2024-09-11T23:18:15.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f86089f4640 1 -- start start 2024-09-11T23:18:15.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f86089f4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8604144d60 0x7f8604070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f86089f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 0x7f86040b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f86089f4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8604071030 con 0x7f86040b4ba0 2024-09-11T23:18:15.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f86089f4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8604070660 con 0x7f8604144d60 2024-09-11T23:18:15.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f86089f4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f860406fa50 con 0x7f86040b4090 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f86040b4ba0 0x7f86040ae610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49764/0 (socket says 172.21.15.94:49764) 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 -- 172.21.15.94:0/803134481 learned_addr learned my addr 172.21.15.94:0/803134481 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8601d9b640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 0x7f86040b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860259c640 1 --2- 172.21.15.94:0/803134481 >> v2:172.21.15.155:3300/0 conn(0x7f8604144d60 0x7f8604070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614723632 0 0) 0x7f8604071030 con 0x7f86040b4ba0 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85ec003530 con 0x7f86040b4ba0 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 171500029 0 0) 0x7f85ec003530 con 0x7f86040b4ba0 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 msgr2=0x7f86040b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 0x7f86040b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 >> v2:172.21.15.155:3300/0 conn(0x7f8604144d60 msgr2=0x7f8604070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 --2- 172.21.15.94:0/803134481 >> v2:172.21.15.155:3300/0 conn(0x7f8604144d60 0x7f8604070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860406fd30 con 0x7f86040b4ba0 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f85fc001a00 con 0x7f86040b4ba0 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 >> v1:172.21.15.94:6789/0 conn(0x7f86040b4ba0 legacy=0x7f86040ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85ec0039c0 0x7f85ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 0x7f85ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85ec004d50 0x7f85ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8604070660 con 0x7f85ec004d50 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f860406fa50 con 0x7f85ec0039c0 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec00b9d0 con 0x7f86040b4090 2024-09-11T23:18:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85ec004d50 0x7f85ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8601d9b640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 0x7f85ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f860259c640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85ec0039c0 0x7f85ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 -- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 msgr2=0x7f85ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86040b4090 0x7f85ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 -- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85ec0039c0 msgr2=0x7f85ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85ec0039c0 0x7f85ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.977+0000 7f8602d9d640 1 -- 172.21.15.94:0/803134481 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec003530 con 0x7f85ec004d50 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f8602d9d640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85ec004d50 0x7f85ec0051d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0013e0 tx=0x7f85fc01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7794577179cc2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc00a4e0 con 0x7f85ec004d50 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0072f0 con 0x7f85ec004d50 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f860159a640 1 -- 172.21.15.94:0/803134481 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0076e0 con 0x7f85ec004d50 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f86089f4640 1 -- 172.21.15.94:0/803134481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85ec004d50 msgr2=0x7f85ec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f86089f4640 1 --2- 172.21.15.94:0/803134481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85ec004d50 0x7f85ec0051d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0013e0 tx=0x7f85fc01d3a0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f8602d9d640 1 -- 172.21.15.94:0/803134481 reap_dead start 2024-09-11T23:18:15.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f86089f4640 1 -- 172.21.15.94:0/803134481 shutdown_connections 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f86089f4640 1 -- 172.21.15.94:0/803134481 >> 172.21.15.94:0/803134481 conn(0x7f860409aa00 msgr2=0x7f86040b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f86089f4640 1 -- 172.21.15.94:0/803134481 shutdown_connections 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.981+0000 7f86089f4640 1 -- 172.21.15.94:0/803134481 wait complete. 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 Processor -- start 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 -- start start 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8604137d40 0x7f860413ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f860415a9b0 0x7f860413c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8604138350 0x7f86041387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f86040b6e50 con 0x7f8604138350 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86040702f0 con 0x7f860415a9b0 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f86040b6fd0 con 0x7f8604137d40 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8604138350 0x7f86041387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8604138350 0x7f86041387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57826/0 (socket says 172.21.15.94:57826) 2024-09-11T23:18:15.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 -- 172.21.15.94:0/1558842424 learned_addr learned my addr 172.21.15.94:0/1558842424 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8601d9b640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f860415a9b0 0x7f860413c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f860259c640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8604137d40 0x7f860413ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 -- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8604137d40 msgr2=0x7f860413ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8604137d40 0x7f860413ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 -- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f860415a9b0 msgr2=0x7f860413c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f860415a9b0 0x7f860413c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 -- 172.21.15.94:0/1558842424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860413b470 con 0x7f8604138350 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8601d9b640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f860415a9b0 0x7f860413c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f8602d9d640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8604138350 0x7f86041387d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f85fc01ce10 tx=0x7f85ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f85f2ffd640 1 -- 172.21.15.94:0/1558842424 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc00a4c0 con 0x7f8604138350 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f85f2ffd640 1 -- 172.21.15.94:0/1558842424 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0017c0 con 0x7f8604138350 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86041423b0 con 0x7f8604138350 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f85f2ffd640 1 -- 172.21.15.94:0/1558842424 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc001970 con 0x7f8604138350 2024-09-11T23:18:15.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8604142970 con 0x7f8604138350 2024-09-11T23:18:15.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86040b44d0 con 0x7f8604138350 2024-09-11T23:18:15.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f85f2ffd640 1 -- 172.21.15.94:0/1558842424 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85fc0bd030 con 0x7f8604138350 2024-09-11T23:18:15.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f85f2ffd640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85e40678f0 0x7f85e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.985+0000 7f85f2ffd640 1 -- 172.21.15.94:0/1558842424 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f85fc11ff80 con 0x7f8604138350 2024-09-11T23:18:15.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.989+0000 7f860259c640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85e40678f0 0x7f85e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.989+0000 7f860259c640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85e40678f0 0x7f85e4069db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009970 tx=0x7f85f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:15.989+0000 7f85f2ffd640 1 -- 172.21.15.94:0/1558842424 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f85fc0170b0 con 0x7f8604138350 2024-09-11T23:18:16.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8604142b40 con 0x7f8604138350 2024-09-11T23:18:16.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f85f2ffd640 1 -- 172.21.15.94:0/1558842424 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f85fc0abe40 con 0x7f8604138350 2024-09-11T23:18:16.153 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85e40678f0 msgr2=0x7f85e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85e40678f0 0x7f85e4069db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009970 tx=0x7f85f4008040 comp rx=0 tx=0).stop 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8604138350 msgr2=0x7f86041387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8604138350 0x7f86041387d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f85fc01ce10 tx=0x7f85ec005840 comp rx=0 tx=0).stop 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 shutdown_connections 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85e40678f0 0x7f85e4069db0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8604138350 0x7f86041387d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f860415a9b0 0x7f860413c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 --2- 172.21.15.94:0/1558842424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8604137d40 0x7f860413ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 >> 172.21.15.94:0/1558842424 conn(0x7f860409aa00 msgr2=0x7f86040b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 shutdown_connections 2024-09-11T23:18:16.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.153+0000 7f86089f4640 1 -- 172.21.15.94:0/1558842424 wait complete. 2024-09-11T23:18:16.172 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays' 2024-09-11T23:18:16.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.281+0000 7f108142f640 1 Processor -- start 2024-09-11T23:18:16.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.281+0000 7f108142f640 1 -- start start 2024-09-11T23:18:16.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f107c073e60 0x7f107c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f107c06fef0 0x7f107c15b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107c15bda0 con 0x7f107c0b3d50 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f107c06ee50 con 0x7f107c06fef0 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f107c06f130 con 0x7f107c073e60 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f107c06fef0 0x7f107c15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f107c0b3d50 0x7f107c0b4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49780/0 (socket says 172.21.15.94:49780) 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f107c06fef0 0x7f107c15b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57830/0 (socket says 172.21.15.94:57830) 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107b7fe640 1 -- 172.21.15.94:0/1511681388 learned_addr learned my addr 172.21.15.94:0/1511681388 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107affd640 1 --2- 172.21.15.94:0/1511681388 >> v2:172.21.15.155:3300/0 conn(0x7f107c073e60 0x7f107c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107a7fc640 1 -- 172.21.15.94:0/1511681388 >> v2:172.21.15.155:3300/0 conn(0x7f107c073e60 msgr2=0x7f107c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107a7fc640 1 --2- 172.21.15.94:0/1511681388 >> v2:172.21.15.155:3300/0 conn(0x7f107c073e60 0x7f107c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107a7fc640 1 -- 172.21.15.94:0/1511681388 >> v1:172.21.15.94:6789/0 conn(0x7f107c0b3d50 legacy=0x7f107c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107a7fc640 1 -- 172.21.15.94:0/1511681388 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c06f410 con 0x7f107c06fef0 2024-09-11T23:18:16.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f107a7fc640 1 --2- 172.21.15.94:0/1511681388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c06fef0 0x7f107c15b860 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f107c070340 tx=0x7f106c01d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9be9b9c1abc8a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f1079ffb640 1 -- 172.21.15.94:0/1511681388 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c00b040 con 0x7f107c06fef0 2024-09-11T23:18:16.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f1079ffb640 1 -- 172.21.15.94:0/1511681388 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c0a76b0 con 0x7f107c06fef0 2024-09-11T23:18:16.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f1079ffb640 1 -- 172.21.15.94:0/1511681388 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0a7a80 con 0x7f107c06fef0 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 -- 172.21.15.94:0/1511681388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c06fef0 msgr2=0x7f107c15b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 --2- 172.21.15.94:0/1511681388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c06fef0 0x7f107c15b860 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f107c070340 tx=0x7f106c01d7c0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 -- 172.21.15.94:0/1511681388 shutdown_connections 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 --2- 172.21.15.94:0/1511681388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c06fef0 0x7f107c15b860 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 --2- 172.21.15.94:0/1511681388 >> v2:172.21.15.155:3300/0 conn(0x7f107c073e60 0x7f107c06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.285+0000 7f108142f640 1 -- 172.21.15.94:0/1511681388 >> 172.21.15.94:0/1511681388 conn(0x7f107c0b1f90 msgr2=0x7f107c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- 172.21.15.94:0/1511681388 shutdown_connections 2024-09-11T23:18:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- 172.21.15.94:0/1511681388 wait complete. 2024-09-11T23:18:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 Processor -- start 2024-09-11T23:18:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- start start 2024-09-11T23:18:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107c06fef0 0x7f107c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c073e60 0x7f107c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f107c0b3d50 0x7f107c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f107c0729a0 con 0x7f107c073e60 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f107c072820 con 0x7f107c06fef0 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f107c072b20 con 0x7f107c0b3d50 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c073e60 0x7f107c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c073e60 0x7f107c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57844/0 (socket says 172.21.15.94:57844) 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 -- 172.21.15.94:0/887138061 learned_addr learned my addr 172.21.15.94:0/887138061 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107affd640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107c06fef0 0x7f107c15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 -- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f107c0b3d50 msgr2=0x7f107c14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f107c0b3d50 0x7f107c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 -- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107c06fef0 msgr2=0x7f107c15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107c06fef0 0x7f107c15b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 -- 172.21.15.94:0/887138061 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c14f980 con 0x7f107c073e60 2024-09-11T23:18:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f107a7fc640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c073e60 0x7f107c159840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f106c01a3d0 tx=0x7f106c01a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f10737fe640 1 -- 172.21.15.94:0/887138061 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0bd020 con 0x7f107c073e60 2024-09-11T23:18:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f10737fe640 1 -- 172.21.15.94:0/887138061 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c0a7df0 con 0x7f107c073e60 2024-09-11T23:18:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f10737fe640 1 -- 172.21.15.94:0/887138061 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b8680 con 0x7f107c073e60 2024-09-11T23:18:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c157b50 con 0x7f107c073e60 2024-09-11T23:18:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c158110 con 0x7f107c073e60 2024-09-11T23:18:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.289+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c1582e0 con 0x7f107c073e60 2024-09-11T23:18:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.293+0000 7f10737fe640 1 -- 172.21.15.94:0/887138061 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f106c0c0020 con 0x7f107c073e60 2024-09-11T23:18:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.293+0000 7f10737fe640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f105c0678f0 0x7f105c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.293+0000 7f10737fe640 1 -- 172.21.15.94:0/887138061 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f106c120030 con 0x7f107c073e60 2024-09-11T23:18:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.293+0000 7f107affd640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f105c0678f0 0x7f105c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.293+0000 7f107affd640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f105c0678f0 0x7f105c069db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f107c09e550 tx=0x7f1064008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.297+0000 7f10737fe640 1 -- 172.21.15.94:0/887138061 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f106c017440 con 0x7f107c073e60 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.505+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]} v 0) -- 0x7f107c15b860 con 0x7f107c073e60 2024-09-11T23:18:16.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.529+0000 7f10737fe640 1 -- 172.21.15.94:0/887138061 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]}]=0 v177) ==== 143+0+0 (secure 0 0 0) 0x7f106c0f0d70 con 0x7f107c073e60 2024-09-11T23:18:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f105c0678f0 msgr2=0x7f105c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f105c0678f0 0x7f105c069db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f107c09e550 tx=0x7f1064008040 comp rx=0 tx=0).stop 2024-09-11T23:18:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c073e60 msgr2=0x7f107c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c073e60 0x7f107c159840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f106c01a3d0 tx=0x7f106c01a560 comp rx=0 tx=0).stop 2024-09-11T23:18:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 shutdown_connections 2024-09-11T23:18:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f107c0b3d50 0x7f107c14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f105c0678f0 0x7f105c069db0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f107c073e60 0x7f107c159840 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 --2- 172.21.15.94:0/887138061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107c06fef0 0x7f107c15b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 >> 172.21.15.94:0/887138061 conn(0x7f107c0b1f90 msgr2=0x7f107c154700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 shutdown_connections 2024-09-11T23:18:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.533+0000 7f108142f640 1 -- 172.21.15.94:0/887138061 wait complete. 2024-09-11T23:18:16.552 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:18:16.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f38866640 1 Processor -- start 2024-09-11T23:18:16.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f38866640 1 -- start start 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f38866640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f34070020 0x7f1f3415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f38866640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3415f1d0 0x7f1f340adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f38866640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f340aede0 con 0x7f1f341520a0 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f38866640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1f34152480 con 0x7f1f34070020 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f38866640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3415fa10 con 0x7f1f3415f1d0 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f31d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f34070020 0x7f1f3415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f31d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f34070020 0x7f1f3415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57858/0 (socket says 172.21.15.94:57858) 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f31d9b640 1 -- 172.21.15.94:0/2097645408 learned_addr learned my addr 172.21.15.94:0/2097645408 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f32d9d640 1 --2- 172.21.15.94:0/2097645408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3415f1d0 0x7f1f340adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f31d9b640 1 -- 172.21.15.94:0/2097645408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3415f1d0 msgr2=0x7f1f340adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f31d9b640 1 --2- 172.21.15.94:0/2097645408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3415f1d0 0x7f1f340adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f31d9b640 1 -- 172.21.15.94:0/2097645408 >> v1:172.21.15.155:6789/0 conn(0x7f1f341520a0 legacy=0x7f1f3406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.673+0000 7f1f31d9b640 1 -- 172.21.15.94:0/2097645408 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34074250 con 0x7f1f34070020 2024-09-11T23:18:16.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f31d9b640 1 --2- 172.21.15.94:0/2097645408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f34070020 0x7f1f3415ec90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009870 tx=0x7f1f2801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41c1c5272a233e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f3159a640 1 -- 172.21.15.94:0/2097645408 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f280aa610 con 0x7f1f34070020 2024-09-11T23:18:16.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f3159a640 1 -- 172.21.15.94:0/2097645408 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f280af070 con 0x7f1f34070020 2024-09-11T23:18:16.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f3159a640 1 -- 172.21.15.94:0/2097645408 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f280aa9d0 con 0x7f1f34070020 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- 172.21.15.94:0/2097645408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f34070020 msgr2=0x7f1f3415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 --2- 172.21.15.94:0/2097645408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f34070020 0x7f1f3415ec90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009870 tx=0x7f1f2801c4f0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- 172.21.15.94:0/2097645408 shutdown_connections 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 --2- 172.21.15.94:0/2097645408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3415f1d0 0x7f1f340adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 --2- 172.21.15.94:0/2097645408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f34070020 0x7f1f3415ec90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- 172.21.15.94:0/2097645408 >> 172.21.15.94:0/2097645408 conn(0x7f1f340b1f90 msgr2=0x7f1f340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- 172.21.15.94:0/2097645408 shutdown_connections 2024-09-11T23:18:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- 172.21.15.94:0/2097645408 wait complete. 2024-09-11T23:18:16.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 Processor -- start 2024-09-11T23:18:16.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- start start 2024-09-11T23:18:16.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f341520a0 0x7f1f3414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f3415f1d0 0x7f1f3415da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f340d0ac0 0x7f1f34164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3415f5e0 con 0x7f1f340d0ac0 2024-09-11T23:18:16.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34073d30 con 0x7f1f3415f1d0 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f38866640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3415f760 con 0x7f1f341520a0 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f32d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f340d0ac0 0x7f1f34164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f32d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f340d0ac0 0x7f1f34164e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57860/0 (socket says 172.21.15.94:57860) 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f32d9d640 1 -- 172.21.15.94:0/1684265884 learned_addr learned my addr 172.21.15.94:0/1684265884 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f3259c640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f341520a0 0x7f1f3414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f31d9b640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f3415f1d0 0x7f1f3415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.677+0000 7f1f32d9d640 1 -- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f341520a0 msgr2=0x7f1f3414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f32d9d640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f341520a0 0x7f1f3414a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f32d9d640 1 -- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f3415f1d0 msgr2=0x7f1f3415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f32d9d640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f3415f1d0 0x7f1f3415da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f32d9d640 1 -- 172.21.15.94:0/1684265884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f340cfcc0 con 0x7f1f340d0ac0 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f31d9b640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f3415f1d0 0x7f1f3415da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:16.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f32d9d640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f340d0ac0 0x7f1f34164e50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cd70 tx=0x7f1f2c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f22ffd640 1 -- 172.21.15.94:0/1684265884 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c003ba0 con 0x7f1f340d0ac0 2024-09-11T23:18:16.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f22ffd640 1 -- 172.21.15.94:0/1684265884 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c003d40 con 0x7f1f340d0ac0 2024-09-11T23:18:16.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f22ffd640 1 -- 172.21.15.94:0/1684265884 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c004240 con 0x7f1f340d0ac0 2024-09-11T23:18:16.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f340adde0 con 0x7f1f340d0ac0 2024-09-11T23:18:16.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3415dfd0 con 0x7f1f340d0ac0 2024-09-11T23:18:16.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f340cfe90 con 0x7f1f340d0ac0 2024-09-11T23:18:16.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f22ffd640 1 -- 172.21.15.94:0/1684265884 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f2c0043e0 con 0x7f1f340d0ac0 2024-09-11T23:18:16.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f22ffd640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1f140678c0 0x7f1f14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f22ffd640 1 -- 172.21.15.94:0/1684265884 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f1f2c0865a0 con 0x7f1f340d0ac0 2024-09-11T23:18:16.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f3259c640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1f140678c0 0x7f1f14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.681+0000 7f1f3259c640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1f140678c0 0x7f1f14069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400b810 tx=0x7f1f24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.685+0000 7f1f22ffd640 1 -- 172.21.15.94:0/1684265884 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1f340cfe90 con 0x7f1f340d0ac0 2024-09-11T23:18:16.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.849+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1f3415ec90 con 0x7f1f340d0ac0 2024-09-11T23:18:16.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.853+0000 7f1f22ffd640 1 -- 172.21.15.94:0/1684265884 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f1f2c01d340 con 0x7f1f340d0ac0 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1f140678c0 msgr2=0x7f1f14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1f140678c0 0x7f1f14069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400b810 tx=0x7f1f24008040 comp rx=0 tx=0).stop 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f340d0ac0 msgr2=0x7f1f34164e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f340d0ac0 0x7f1f34164e50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cd70 tx=0x7f1f2c00a660 comp rx=0 tx=0).stop 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 shutdown_connections 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1f140678c0 0x7f1f14069d80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f340d0ac0 0x7f1f34164e50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f3415f1d0 0x7f1f3415da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 --2- 172.21.15.94:0/1684265884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f341520a0 0x7f1f3414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 >> 172.21.15.94:0/1684265884 conn(0x7f1f340b1f90 msgr2=0x7f1f34151470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 shutdown_connections 2024-09-11T23:18:16.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:16.857+0000 7f1f38866640 1 -- 172.21.15.94:0/1684265884 wait complete. 2024-09-11T23:18:16.876 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:18:16.876 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:16.938 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:17.005 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:18:17.005 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:17.005 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:17.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:18:17.011 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:18:17.011 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:17.016 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:18:17.017 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:17.017 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:17.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:18:17.058 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:18:17.058 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:17.064 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:18:17.064 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:18:17.064 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:17.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.229+0000 7f921c47d640 1 Processor -- start 2024-09-11T23:18:17.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921c47d640 1 -- start start 2024-09-11T23:18:17.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921c47d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f921415c2a0 0x7f92140aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921c47d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140b3290 con 0x7f92140af2a0 2024-09-11T23:18:17.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921c47d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140b3570 con 0x7f921415bec0 2024-09-11T23:18:17.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921c47d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f92140b3850 con 0x7f921415c2a0 2024-09-11T23:18:17.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921aa1a640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f92140af2a0 0x7f921406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49782/0 (socket says 172.21.15.94:49782) 2024-09-11T23:18:17.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921aa1a640 1 -- 172.21.15.94:0/2114428840 learned_addr learned my addr 172.21.15.94:0/2114428840 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:17.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219a18640 1 --2- 172.21.15.94:0/2114428840 >> v2:172.21.15.155:3300/0 conn(0x7f921415c2a0 0x7f92140aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179113596 0 0) 0x7f92140b3290 con 0x7f92140af2a0 2024-09-11T23:18:17.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9200003530 con 0x7f92140af2a0 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2360760561 0 0) 0x7f9200003530 con 0x7f92140af2a0 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 >> v2:172.21.15.155:3300/0 conn(0x7f921415c2a0 msgr2=0x7f92140aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 --2- 172.21.15.94:0/2114428840 >> v2:172.21.15.155:3300/0 conn(0x7f921415c2a0 0x7f92140aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 >> v1:172.21.15.155:6789/0 conn(0x7f921415bec0 legacy=0x7f92140ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140b3b30 con 0x7f92140af2a0 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f920c001a00 con 0x7f92140af2a0 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 >> v1:172.21.15.94:6789/0 conn(0x7f92140af2a0 legacy=0x7f921406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92000039c0 0x7f9200003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9200004810 0x7f9200004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92000051d0 0x7f920000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f92140b3850 con 0x7f92000039c0 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f920000c070 con 0x7f9200004810 2024-09-11T23:18:17.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f920000c270 con 0x7f92000051d0 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921a219640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92000039c0 0x7f9200003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f9219a18640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9200004810 0x7f9200004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921a219640 1 -- 172.21.15.94:0/2114428840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92000051d0 msgr2=0x7f920000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921a219640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92000051d0 0x7f920000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921a219640 1 -- 172.21.15.94:0/2114428840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9200004810 msgr2=0x7f9200004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921a219640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9200004810 0x7f9200004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921a219640 1 -- 172.21.15.94:0/2114428840 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9200003530 con 0x7f92000039c0 2024-09-11T23:18:17.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.233+0000 7f921aa1a640 1 -- 172.21.15.94:0/2114428840 reap_dead start 2024-09-11T23:18:17.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921a219640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92000039c0 0x7f9200003de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9210001780 tx=0x7f921001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5a845ce1e94f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92100013a0 con 0x7f92000039c0 2024-09-11T23:18:17.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92100052f0 con 0x7f92000039c0 2024-09-11T23:18:17.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f9219217640 1 -- 172.21.15.94:0/2114428840 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210003840 con 0x7f92000039c0 2024-09-11T23:18:17.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- 172.21.15.94:0/2114428840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92000039c0 msgr2=0x7f9200003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92000039c0 0x7f9200003de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9210001780 tx=0x7f921001c3d0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- 172.21.15.94:0/2114428840 shutdown_connections 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 --2- 172.21.15.94:0/2114428840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92000039c0 0x7f9200003de0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- 172.21.15.94:0/2114428840 >> 172.21.15.94:0/2114428840 conn(0x7f92140b1f90 msgr2=0x7f92140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- 172.21.15.94:0/2114428840 shutdown_connections 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- 172.21.15.94:0/2114428840 wait complete. 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 Processor -- start 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- start start 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92000039c0 0x7f92140cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9214146560 0x7f92140b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92141469c0 0x7f92140b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f92140af680 con 0x7f92141469c0 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92140ad610 con 0x7f92000039c0 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921c47d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92140d0150 con 0x7f9214146560 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92141469c0 0x7f92140b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92141469c0 0x7f92140b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57874/0 (socket says 172.21.15.94:57874) 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 -- 172.21.15.94:0/3521560510 learned_addr learned my addr 172.21.15.94:0/3521560510 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f9219a18640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9214146560 0x7f92140b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921a219640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92000039c0 0x7f92140cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 -- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9214146560 msgr2=0x7f92140b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9214146560 0x7f92140b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 -- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92000039c0 msgr2=0x7f92140cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92000039c0 0x7f92140cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921aa1a640 1 -- 172.21.15.94:0/3521560510 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140d03f0 con 0x7f92141469c0 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f9219a18640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9214146560 0x7f92140b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.237+0000 7f921a219640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92000039c0 0x7f92140cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f921aa1a640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92141469c0 0x7f92140b1820 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f921415c680 tx=0x7f920c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f920affd640 1 -- 172.21.15.94:0/3521560510 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c004d70 con 0x7f92141469c0 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f920affd640 1 -- 172.21.15.94:0/3521560510 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c00a610 con 0x7f92141469c0 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92140d06d0 con 0x7f92141469c0 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f920affd640 1 -- 172.21.15.94:0/3521560510 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c00aa00 con 0x7f92141469c0 2024-09-11T23:18:17.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f921415e0d0 con 0x7f92141469c0 2024-09-11T23:18:17.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9214160470 con 0x7f92141469c0 2024-09-11T23:18:17.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f920affd640 1 -- 172.21.15.94:0/3521560510 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f920c011070 con 0x7f92141469c0 2024-09-11T23:18:17.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f920affd640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91f80678c0 0x7f91f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f920affd640 1 -- 172.21.15.94:0/3521560510 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f920c085430 con 0x7f92141469c0 2024-09-11T23:18:17.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f921a219640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91f80678c0 0x7f91f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.241+0000 7f921a219640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91f80678c0 0x7f91f8069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9210001750 tx=0x7f92100011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.245+0000 7f920affd640 1 -- 172.21.15.94:0/3521560510 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f920c019060 con 0x7f92141469c0 2024-09-11T23:18:17.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.441+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92140d08a0 con 0x7f92141469c0 2024-09-11T23:18:17.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.441+0000 7f920affd640 1 -- 172.21.15.94:0/3521560510 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+3914 (secure 0 0 0) 0x7f920c056170 con 0x7f92141469c0 2024-09-11T23:18:17.444 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:17.444 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":33,"btime":"2024-09-11T23:18:11:509924+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2513412024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2513412024},{"type":"v1","addr":"172.21.15.155:6835","nonce":2513412024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1764873532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1764873532},{"type":"v1","addr":"172.21.15.155:6837","nonce":1764873532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3022877210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3022877210},{"type":"v1","addr":"172.21.15.94:6833","nonce":3022877210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5931,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/329520922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":329520922},{"type":"v1","addr":"172.21.15.94:6835","nonce":329520922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[]} 2024-09-11T23:18:17.445 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 33 2024-09-11T23:18:17.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91f80678c0 msgr2=0x7f91f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91f80678c0 0x7f91f8069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9210001750 tx=0x7f92100011a0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92141469c0 msgr2=0x7f92140b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92141469c0 0x7f92140b1820 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f921415c680 tx=0x7f920c00cb90 comp rx=0 tx=0).stop 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 shutdown_connections 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f91f80678c0 0x7f91f8069d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92141469c0 0x7f92140b1820 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9214146560 0x7f92140b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 --2- 172.21.15.94:0/3521560510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92000039c0 0x7f92140cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 >> 172.21.15.94:0/3521560510 conn(0x7f92140b1f90 msgr2=0x7f92141557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 shutdown_connections 2024-09-11T23:18:17.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.445+0000 7f921c47d640 1 -- 172.21.15.94:0/3521560510 wait complete. 2024-09-11T23:18:17.464 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:18:17.464 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:18:17.464 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:18:17.464 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:17.465 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:18:17.465 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:18:17.465 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:18:17.465 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:17.465 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:18:17.465 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:18:17.465 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:18:17.465 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:17.466 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:18:17.466 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:18:17.466 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:18:17.466 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:17.474 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:18:17.474 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:18:17.476 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:18:17.477 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:18:17.486 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:18:17.486 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:18:17.487 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:18:17.487 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:18:17.521 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:18:17.522 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:17.523 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:18:17.523 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:17.533 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:18:17.533 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:17.533 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:18:17.534 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:17.534 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:18:17.582 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:18:17.587 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:18:17.602 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:18:17.604 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:18:17.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.653+0000 7fd48c0f7640 1 Processor -- start 2024-09-11T23:18:17.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.653+0000 7fd48c0f7640 1 -- start start 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.653+0000 7fd48c0f7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd484161a60 0x7fd4840d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.653+0000 7fd48c0f7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4840d2e90 0x7fd4840cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.653+0000 7fd48c0f7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4840d32b0 con 0x7fd4840cf450 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.653+0000 7fd48c0f7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd4840d0300 con 0x7fd4840d2e90 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.653+0000 7fd48c0f7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd48406e6c0 con 0x7fd484161a60 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4840d2e90 0x7fd4840cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4840d2e90 0x7fd4840cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57904/0 (socket says 172.21.15.94:57904) 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48a694640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd4840cf450 0x7fd4840d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49798/0 (socket says 172.21.15.94:49798) 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 -- 172.21.15.94:0/2771681924 learned_addr learned my addr 172.21.15.94:0/2771681924 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489e93640 1 --2- 172.21.15.94:0/2771681924 >> v2:172.21.15.155:3300/0 conn(0x7fd484161a60 0x7fd4840d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 -- 172.21.15.94:0/2771681924 >> v2:172.21.15.155:3300/0 conn(0x7fd484161a60 msgr2=0x7fd4840d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 --2- 172.21.15.94:0/2771681924 >> v2:172.21.15.155:3300/0 conn(0x7fd484161a60 0x7fd4840d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 -- 172.21.15.94:0/2771681924 >> v1:172.21.15.94:6789/0 conn(0x7fd4840cf450 legacy=0x7fd4840d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd488e91640 1 -- 172.21.15.94:0/2771681924 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815968682 0 0) 0x7fd4840d32b0 con 0x7fd4840cf450 2024-09-11T23:18:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 -- 172.21.15.94:0/2771681924 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840b0f60 con 0x7fd4840d2e90 2024-09-11T23:18:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489e93640 1 --2- 172.21.15.94:0/2771681924 >> v2:172.21.15.155:3300/0 conn(0x7fd484161a60 0x7fd4840d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:17.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd489692640 1 --2- 172.21.15.94:0/2771681924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4840d2e90 0x7fd4840cef10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd48408e010 tx=0x7fd47401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e79fefd3ce7cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd488e91640 1 -- 172.21.15.94:0/2771681924 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740ab660 con 0x7fd4840d2e90 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd488e91640 1 -- 172.21.15.94:0/2771681924 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4740b0070 con 0x7fd4840d2e90 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd488e91640 1 -- 172.21.15.94:0/2771681924 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740aba20 con 0x7fd4840d2e90 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 -- 172.21.15.94:0/2771681924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4840d2e90 msgr2=0x7fd4840cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/2771681924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4840d2e90 0x7fd4840cef10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd48408e010 tx=0x7fd47401c460 comp rx=0 tx=0).stop 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 -- 172.21.15.94:0/2771681924 shutdown_connections 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/2771681924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4840d2e90 0x7fd4840cef10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/2771681924 >> v2:172.21.15.155:3300/0 conn(0x7fd484161a60 0x7fd4840d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 -- 172.21.15.94:0/2771681924 >> 172.21.15.94:0/2771681924 conn(0x7fd48408bf90 msgr2=0x7fd48409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 -- 172.21.15.94:0/2771681924 shutdown_connections 2024-09-11T23:18:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.657+0000 7fd48c0f7640 1 -- 172.21.15.94:0/2771681924 wait complete. 2024-09-11T23:18:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 Processor -- start 2024-09-11T23:18:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 -- start start 2024-09-11T23:18:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4840cf450 0x7fd484154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4840d2e90 0x7fd4841585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd484161a60 0x7fd48406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd48406d190 con 0x7fd484161a60 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840d1930 con 0x7fd4840cf450 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd4840cf880 con 0x7fd4840d2e90 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd484161a60 0x7fd48406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd484161a60 0x7fd48406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57920/0 (socket says 172.21.15.94:57920) 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 -- 172.21.15.94:0/4164730214 learned_addr learned my addr 172.21.15.94:0/4164730214 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd489e93640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4840cf450 0x7fd484154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd489692640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4840d2e90 0x7fd4841585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 -- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4840d2e90 msgr2=0x7fd4841585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4840d2e90 0x7fd4841585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 -- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4840cf450 msgr2=0x7fd484154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4840cf450 0x7fd484154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 -- 172.21.15.94:0/4164730214 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd484157380 con 0x7fd484161a60 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48a694640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd484161a60 0x7fd48406d5b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c7a0 tx=0x7fd47c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd47a7fc640 1 -- 172.21.15.94:0/4164730214 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c018070 con 0x7fd484161a60 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd47a7fc640 1 -- 172.21.15.94:0/4164730214 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c00a640 con 0x7fd484161a60 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd484157660 con 0x7fd484161a60 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd47a7fc640 1 -- 172.21.15.94:0/4164730214 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00aab0 con 0x7fd484161a60 2024-09-11T23:18:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd484157c20 con 0x7fd484161a60 2024-09-11T23:18:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.661+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4840cef10 con 0x7fd484161a60 2024-09-11T23:18:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.665+0000 7fd47a7fc640 1 -- 172.21.15.94:0/4164730214 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd47c01b070 con 0x7fd484161a60 2024-09-11T23:18:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.665+0000 7fd47a7fc640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4680678c0 0x7fd468069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.665+0000 7fd47a7fc640 1 -- 172.21.15.94:0/4164730214 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fd47c0850f0 con 0x7fd484161a60 2024-09-11T23:18:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.665+0000 7fd489e93640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4680678c0 0x7fd468069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.665+0000 7fd489e93640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4680678c0 0x7fd468069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4800045f0 tx=0x7fd480008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.669+0000 7fd47a7fc640 1 -- 172.21.15.94:0/4164730214 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd47c055750 con 0x7fd484161a60 2024-09-11T23:18:17.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:17.841+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd4840b4120 con 0x7fd484161a60 2024-09-11T23:18:18.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.549+0000 7fd47a7fc640 1 -- 172.21.15.94:0/4164730214 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) ==== 97+0+0 (secure 0 0 0) 0x7fd47c059a50 con 0x7fd484161a60 2024-09-11T23:18:18.551 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2024-09-11T23:18:18.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4680678c0 msgr2=0x7fd468069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4680678c0 0x7fd468069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4800045f0 tx=0x7fd480008040 comp rx=0 tx=0).stop 2024-09-11T23:18:18.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd484161a60 msgr2=0x7fd48406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd484161a60 0x7fd48406d5b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c7a0 tx=0x7fd47c00cc60 comp rx=0 tx=0).stop 2024-09-11T23:18:18.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 shutdown_connections 2024-09-11T23:18:18.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd4680678c0 0x7fd468069d80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd484161a60 0x7fd48406d5b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4840d2e90 0x7fd4841585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 --2- 172.21.15.94:0/4164730214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4840cf450 0x7fd484154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 >> 172.21.15.94:0/4164730214 conn(0x7fd48408bf90 msgr2=0x7fd48415d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 shutdown_connections 2024-09-11T23:18:18.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.553+0000 7fd48c0f7640 1 -- 172.21.15.94:0/4164730214 wait complete. 2024-09-11T23:18:18.577 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:18:18.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.697+0000 7fd6e17fa640 1 Processor -- start 2024-09-11T23:18:18.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.697+0000 7fd6e17fa640 1 -- start start 2024-09-11T23:18:18.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6e17fa640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd6dc1520a0 0x7fd6dc06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6e17fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6e17fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6dc070250 con 0x7fd6dc15f1d0 2024-09-11T23:18:18.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6e17fa640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd6dc152480 con 0x7fd6dc1520a0 2024-09-11T23:18:18.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6e17fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc0aede0 con 0x7fd6dc06fe50 2024-09-11T23:18:18.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6daffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd6dc1520a0 0x7fd6dc06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6daffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd6dc1520a0 0x7fd6dc06f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57934/0 (socket says 172.21.15.94:57934) 2024-09-11T23:18:18.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6daffd640 1 -- 172.21.15.94:0/807412884 learned_addr learned my addr 172.21.15.94:0/807412884 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:18.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6daffd640 1 -- 172.21.15.94:0/807412884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 msgr2=0x7fd6dc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6da7fc640 1 --2- 172.21.15.94:0/807412884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6daffd640 1 --2- 172.21.15.94:0/807412884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6daffd640 1 -- 172.21.15.94:0/807412884 >> v1:172.21.15.155:6789/0 conn(0x7fd6dc15f1d0 legacy=0x7fd6dc071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6daffd640 1 -- 172.21.15.94:0/807412884 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc15fa10 con 0x7fd6dc1520a0 2024-09-11T23:18:18.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.701+0000 7fd6da7fc640 1 --2- 172.21.15.94:0/807412884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:18.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6daffd640 1 --2- 172.21.15.94:0/807412884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc06f910 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009e50 tx=0x7fd6d401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd0ef3154cccd2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6d9ffb640 1 -- 172.21.15.94:0/807412884 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40a5770 con 0x7fd6dc1520a0 2024-09-11T23:18:18.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6d9ffb640 1 -- 172.21.15.94:0/807412884 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d40a5910 con 0x7fd6dc1520a0 2024-09-11T23:18:18.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6d9ffb640 1 -- 172.21.15.94:0/807412884 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40a5ce0 con 0x7fd6dc1520a0 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- 172.21.15.94:0/807412884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 msgr2=0x7fd6dc06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/807412884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc06f910 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009e50 tx=0x7fd6d401c9d0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- 172.21.15.94:0/807412884 shutdown_connections 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/807412884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/807412884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc06f910 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- 172.21.15.94:0/807412884 >> 172.21.15.94:0/807412884 conn(0x7fd6dc0b1f90 msgr2=0x7fd6dc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- 172.21.15.94:0/807412884 shutdown_connections 2024-09-11T23:18:18.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- 172.21.15.94:0/807412884 wait complete. 2024-09-11T23:18:18.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 Processor -- start 2024-09-11T23:18:18.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- start start 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc09ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc15f1d0 0x7fd6dc15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc073d30 con 0x7fd6dc1520a0 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc073a50 con 0x7fd6dc15f1d0 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.705+0000 7fd6e17fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc15f680 con 0x7fd6dc06fe50 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc164f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57948/0 (socket says 172.21.15.94:57948) 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 -- 172.21.15.94:0/3347482671 learned_addr learned my addr 172.21.15.94:0/3347482671 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:18.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6db7fe640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc15f1d0 0x7fd6dc15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6daffd640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc09ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 -- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 msgr2=0x7fd6dc09ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc09ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 -- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc15f1d0 msgr2=0x7fd6dc15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc15f1d0 0x7fd6dc15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 -- 172.21.15.94:0/3347482671 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc09bb20 con 0x7fd6dc1520a0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6da7fc640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc164f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c7f0 tx=0x7fd6cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6d37fe640 1 -- 172.21.15.94:0/3347482671 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc015070 con 0x7fd6dc1520a0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6d37fe640 1 -- 172.21.15.94:0/3347482671 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc007820 con 0x7fd6dc1520a0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6dc09be00 con 0x7fd6dc1520a0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6d37fe640 1 -- 172.21.15.94:0/3347482671 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc007bd0 con 0x7fd6dc1520a0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6dc09c3c0 con 0x7fd6dc1520a0 2024-09-11T23:18:18.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6dc15ec90 con 0x7fd6dc1520a0 2024-09-11T23:18:18.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6d37fe640 1 -- 172.21.15.94:0/3347482671 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6cc018070 con 0x7fd6dc1520a0 2024-09-11T23:18:18.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6d37fe640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd6bc0678c0 0x7fd6bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6d37fe640 1 -- 172.21.15.94:0/3347482671 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7fd6cc085b50 con 0x7fd6dc1520a0 2024-09-11T23:18:18.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.709+0000 7fd6daffd640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd6bc0678c0 0x7fd6bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.713+0000 7fd6daffd640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd6bc0678c0 0x7fd6bc069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ae000 tx=0x7fd6d40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.713+0000 7fd6d37fe640 1 -- 172.21.15.94:0/3347482671 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd6cc0568e0 con 0x7fd6dc1520a0 2024-09-11T23:18:18.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.933+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd6dc06e540 con 0x7fd6dc1520a0 2024-09-11T23:18:18.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.933+0000 7fd6d37fe640 1 -- 172.21.15.94:0/3347482671 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fd6cc0561e0 con 0x7fd6dc1520a0 2024-09-11T23:18:18.934 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:18.934 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg==", 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ==", 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ==", 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg==", 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:18:18.938 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ==", 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g==", 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow==", 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.940 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA==", 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw==", 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.943 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2024-09-11T23:18:18.943 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g==", 2024-09-11T23:18:18.943 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.943 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.943 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.943 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.943 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA==", 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2024-09-11T23:18:18.944 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA==", 2024-09-11T23:18:18.945 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.945 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:18.945 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:18:18.945 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.945 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.949 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ==", 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow r", 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2024-09-11T23:18:18.950 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw==", 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ==", 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw==", 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmAziHChAAz9c8+z77RX+g6eeV2hnBGA==", 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA==", 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg==", 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd6bc0678c0 msgr2=0x7fd6bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd6bc0678c0 0x7fd6bc069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ae000 tx=0x7fd6d40a7070 comp rx=0 tx=0).stop 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 msgr2=0x7fd6dc164f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc164f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c7f0 tx=0x7fd6cc00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 shutdown_connections 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc15f1d0 0x7fd6dc15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd6bc0678c0 0x7fd6bc069d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6dc1520a0 0x7fd6dc164f60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 --2- 172.21.15.94:0/3347482671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06fe50 0x7fd6dc09ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 >> 172.21.15.94:0/3347482671 conn(0x7fd6dc0b1f90 msgr2=0x7fd6dc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 shutdown_connections 2024-09-11T23:18:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:18.937+0000 7fd6e17fa640 1 -- 172.21.15.94:0/3347482671 wait complete. 2024-09-11T23:18:18.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:18:19.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1b2d1640 1 Processor -- start 2024-09-11T23:18:19.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1b2d1640 1 -- start start 2024-09-11T23:18:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1b2d1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 0x7f7d140ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1b2d1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7d140af470 0x7f7d1406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1b2d1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d140b3290 con 0x7f7d1415c2a0 2024-09-11T23:18:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1b2d1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7d140b3570 con 0x7f7d140af470 2024-09-11T23:18:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1b2d1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7d140b3850 con 0x7f7d1415bec0 2024-09-11T23:18:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1886c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7d1415c2a0 0x7f7d140aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:49814/0 (socket says 172.21.15.94:49814) 2024-09-11T23:18:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1886c640 1 -- 172.21.15.94:0/3743744500 learned_addr learned my addr 172.21.15.94:0/3743744500 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:19.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1906d640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 0x7f7d140ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1986e640 1 --2- 172.21.15.94:0/3743744500 >> v2:172.21.15.155:3300/0 conn(0x7f7d140af470 0x7f7d1406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333740895 0 0) 0x7f7d140b3290 con 0x7f7d1415c2a0 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d00003530 con 0x7f7d1415c2a0 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1459307216 0 0) 0x7f7d00003530 con 0x7f7d1415c2a0 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 msgr2=0x7f7d140ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 0x7f7d140ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 >> v2:172.21.15.155:3300/0 conn(0x7f7d140af470 msgr2=0x7f7d1406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 --2- 172.21.15.94:0/3743744500 >> v2:172.21.15.155:3300/0 conn(0x7f7d140af470 0x7f7d1406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d140b3b30 con 0x7f7d1415c2a0 2024-09-11T23:18:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7d04001680 con 0x7f7d1415c2a0 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 >> v1:172.21.15.94:6789/0 conn(0x7f7d1415c2a0 legacy=0x7f7d140aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d000039c0 0x7f7d00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 0x7f7d00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d00004d50 0x7f7d000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140b3570 con 0x7f7d000039c0 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140b3850 con 0x7f7d00004d50 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0000b9d0 con 0x7f7d1415bec0 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1906d640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d000039c0 0x7f7d00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1886c640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 0x7f7d00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1906d640 1 -- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 msgr2=0x7f7d00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:19.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1906d640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 0x7f7d00004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1906d640 1 -- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d00004d50 msgr2=0x7f7d000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:19.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1906d640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d00004d50 0x7f7d000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1906d640 1 -- 172.21.15.94:0/3743744500 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d00003530 con 0x7f7d000039c0 2024-09-11T23:18:19.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.077+0000 7f7d1886c640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d1415bec0 0x7f7d00004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1906d640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d000039c0 0x7f7d00003de0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009ae0 tx=0x7f7d1001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0775b8056569af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d100b2070 con 0x7f7d000039c0 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d100a5610 con 0x7f7d000039c0 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d0bfff640 1 -- 172.21.15.94:0/3743744500 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d100096b0 con 0x7f7d000039c0 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/3743744500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d000039c0 msgr2=0x7f7d00003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 --2- 172.21.15.94:0/3743744500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d000039c0 0x7f7d00003de0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009ae0 tx=0x7f7d1001ca40 comp rx=0 tx=0).stop 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1986e640 1 -- 172.21.15.94:0/3743744500 reap_dead start 2024-09-11T23:18:19.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/3743744500 shutdown_connections 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/3743744500 >> 172.21.15.94:0/3743744500 conn(0x7f7d140b1f90 msgr2=0x7f7d140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/3743744500 shutdown_connections 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/3743744500 wait complete. 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 Processor -- start 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 -- start start 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d000039c0 0x7f7d1415f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.081+0000 7f7d1b2d1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d14154010 0x7f7d1414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1b2d1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d141601e0 0x7f7d1409bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1b2d1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140ad790 con 0x7f7d141601e0 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1b2d1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140ad610 con 0x7f7d14154010 2024-09-11T23:18:19.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1b2d1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1406ed50 con 0x7f7d000039c0 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d141601e0 0x7f7d1409bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d141601e0 0x7f7d1409bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57956/0 (socket says 172.21.15.94:57956) 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 -- 172.21.15.94:0/200877765 learned_addr learned my addr 172.21.15.94:0/200877765 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1906d640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d000039c0 0x7f7d1415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 -- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d000039c0 msgr2=0x7f7d1415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1886c640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d14154010 0x7f7d1414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d000039c0 0x7f7d1415f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 -- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d14154010 msgr2=0x7f7d1414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d14154010 0x7f7d1414c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 -- 172.21.15.94:0/200877765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d14160690 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1906d640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d000039c0 0x7f7d1415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1986e640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d141601e0 0x7f7d1409bc30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7d1406dc90 tx=0x7f7d0c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d09ffb640 1 -- 172.21.15.94:0/200877765 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c018020 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d09ffb640 1 -- 172.21.15.94:0/200877765 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c00bb10 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1415e290 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d09ffb640 1 -- 172.21.15.94:0/200877765 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c014400 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1415e850 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1406f130 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d09ffb640 1 -- 172.21.15.94:0/200877765 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d0c01b020 con 0x7f7d141601e0 2024-09-11T23:18:19.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d09ffb640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d09ffb640 1 -- 172.21.15.94:0/200877765 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f7d0c085f50 con 0x7f7d141601e0 2024-09-11T23:18:19.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1906d640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.085+0000 7f7d1906d640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7cf80678c0 0x7f7cf8069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7d100af000 tx=0x7f7d100046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:19.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.089+0000 7f7d09ffb640 1 -- 172.21.15.94:0/200877765 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7d0c022030 con 0x7f7d141601e0 2024-09-11T23:18:19.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.241+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7d1406fcd0 con 0x7f7d141601e0 2024-09-11T23:18:19.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.241+0000 7f7d09ffb640 1 -- 172.21.15.94:0/200877765 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f7d14160690 con 0x7f7d141601e0 2024-09-11T23:18:19.244 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:19.244 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:18:19.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:18:19.244 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:18:19.244 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:18:19.244 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:19.245 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:18:19.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7cf80678c0 msgr2=0x7f7cf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7cf80678c0 0x7f7cf8069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7d100af000 tx=0x7f7d100046d0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d141601e0 msgr2=0x7f7d1409bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d141601e0 0x7f7d1409bc30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7d1406dc90 tx=0x7f7d0c00b480 comp rx=0 tx=0).stop 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 shutdown_connections 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d141601e0 0x7f7d1409bc30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d14154010 0x7f7d1414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 --2- 172.21.15.94:0/200877765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d000039c0 0x7f7d1415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 >> 172.21.15.94:0/200877765 conn(0x7f7d140b1f90 msgr2=0x7f7d140cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:19.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 shutdown_connections 2024-09-11T23:18:19.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.245+0000 7f7d1b2d1640 1 -- 172.21.15.94:0/200877765 wait complete. 2024-09-11T23:18:19.261 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:18:19.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:18:19.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 Processor -- start 2024-09-11T23:18:19.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 -- start start 2024-09-11T23:18:19.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f56dc1520a0 0x7f56dc06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f56dc06fe50 0x7f56dc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc15f1d0 0x7f56dc071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f56dc152480 con 0x7f56dc1520a0 2024-09-11T23:18:19.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f56dc070250 con 0x7f56dc06fe50 2024-09-11T23:18:19.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.373+0000 7f56e3aca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc0aede0 con 0x7f56dc15f1d0 2024-09-11T23:18:19.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f56dc1520a0 0x7f56dc06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f56dc1520a0 0x7f56dc06f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57968/0 (socket says 172.21.15.94:57968) 2024-09-11T23:18:19.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 -- 172.21.15.94:0/2179002268 learned_addr learned my addr 172.21.15.94:0/2179002268 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:19.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1065640 1 --2- 172.21.15.94:0/2179002268 >> v2:172.21.15.155:3300/0 conn(0x7f56dc06fe50 0x7f56dc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e2067640 1 --2- 172.21.15.94:0/2179002268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc15f1d0 0x7f56dc071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 -- 172.21.15.94:0/2179002268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc15f1d0 msgr2=0x7f56dc071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 --2- 172.21.15.94:0/2179002268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc15f1d0 0x7f56dc071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 -- 172.21.15.94:0/2179002268 >> v2:172.21.15.155:3300/0 conn(0x7f56dc06fe50 msgr2=0x7f56dc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 --2- 172.21.15.94:0/2179002268 >> v2:172.21.15.155:3300/0 conn(0x7f56dc06fe50 0x7f56dc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 -- 172.21.15.94:0/2179002268 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc15fa10 con 0x7f56dc1520a0 2024-09-11T23:18:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1065640 1 --2- 172.21.15.94:0/2179002268 >> v2:172.21.15.155:3300/0 conn(0x7f56dc06fe50 0x7f56dc15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e1866640 1 --2- 172.21.15.94:0/2179002268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc06f910 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f56dc06e510 tx=0x7f56d801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debce2408a641ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:19.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e0864640 1 -- 172.21.15.94:0/2179002268 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80b0070 con 0x7f56dc1520a0 2024-09-11T23:18:19.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e0864640 1 -- 172.21.15.94:0/2179002268 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d80ab600 con 0x7f56dc1520a0 2024-09-11T23:18:19.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e0864640 1 -- 172.21.15.94:0/2179002268 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80ab9d0 con 0x7f56dc1520a0 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 -- 172.21.15.94:0/2179002268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 msgr2=0x7f56dc06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 --2- 172.21.15.94:0/2179002268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc06f910 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f56dc06e510 tx=0x7f56d801c240 comp rx=0 tx=0).stop 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 -- 172.21.15.94:0/2179002268 shutdown_connections 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 --2- 172.21.15.94:0/2179002268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc15f1d0 0x7f56dc071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 --2- 172.21.15.94:0/2179002268 >> v2:172.21.15.155:3300/0 conn(0x7f56dc06fe50 0x7f56dc15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 --2- 172.21.15.94:0/2179002268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc06f910 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 -- 172.21.15.94:0/2179002268 >> 172.21.15.94:0/2179002268 conn(0x7f56dc0b1f90 msgr2=0x7f56dc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 -- 172.21.15.94:0/2179002268 shutdown_connections 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.377+0000 7f56e3aca640 1 -- 172.21.15.94:0/2179002268 wait complete. 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 Processor -- start 2024-09-11T23:18:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 -- start start 2024-09-11T23:18:19.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc06fe50 0x7f56dc14c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56dc15f1d0 0x7f56dc0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc073d30 con 0x7f56dc1520a0 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc073a50 con 0x7f56dc15f1d0 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc15f5e0 con 0x7f56dc06fe50 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc0b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57974/0 (socket says 172.21.15.94:57974) 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 -- 172.21.15.94:0/3144323229 learned_addr learned my addr 172.21.15.94:0/3144323229 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1866640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc06fe50 0x7f56dc14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e2067640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56dc15f1d0 0x7f56dc0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 -- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc06fe50 msgr2=0x7f56dc14c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc06fe50 0x7f56dc14c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 -- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56dc15f1d0 msgr2=0x7f56dc0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56dc15f1d0 0x7f56dc0ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:19.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 -- 172.21.15.94:0/3144323229 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc14cb60 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e1065640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc0b1790 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00c7f0 tx=0x7f56cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56d27fc640 1 -- 172.21.15.94:0/3144323229 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc015070 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56d27fc640 1 -- 172.21.15.94:0/3144323229 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc007820 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56dc14ce40 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56d27fc640 1 -- 172.21.15.94:0/3144323229 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc007c10 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56dc14d400 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.381+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56dc14d840 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.385+0000 7f56d27fc640 1 -- 172.21.15.94:0/3144323229 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56cc018070 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.385+0000 7f56d27fc640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56c00678c0 0x7f56c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.385+0000 7f56d27fc640 1 -- 172.21.15.94:0/3144323229 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f56cc085c50 con 0x7f56dc1520a0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.385+0000 7f56e1866640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56c00678c0 0x7f56c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.385+0000 7f56e1866640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56c00678c0 0x7f56c0069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ad000 tx=0x7f56d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.389+0000 7f56d27fc640 1 -- 172.21.15.94:0/3144323229 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f56cc08b020 con 0x7f56dc1520a0 2024-09-11T23:18:19.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:19.545+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f56dc06f910 con 0x7f56dc1520a0 2024-09-11T23:18:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.549+0000 7f56d27fc640 1 -- 172.21.15.94:0/3144323229 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f56cc0568d0 con 0x7f56dc1520a0 2024-09-11T23:18:20.551 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:18:20.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56c00678c0 msgr2=0x7f56c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56c00678c0 0x7f56c0069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ad000 tx=0x7f56d8008040 comp rx=0 tx=0).stop 2024-09-11T23:18:20.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 msgr2=0x7f56dc0b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc0b1790 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00c7f0 tx=0x7f56cc00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 shutdown_connections 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56dc15f1d0 0x7f56dc0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f56c00678c0 0x7f56c0069d80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56dc1520a0 0x7f56dc0b1790 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 --2- 172.21.15.94:0/3144323229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56dc06fe50 0x7f56dc14c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 >> 172.21.15.94:0/3144323229 conn(0x7f56dc0b1f90 msgr2=0x7f56dc0ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 shutdown_connections 2024-09-11T23:18:20.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.553+0000 7f56e3aca640 1 -- 172.21.15.94:0/3144323229 wait complete. 2024-09-11T23:18:20.578 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:18:20.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2908e640 1 Processor -- start 2024-09-11T23:18:20.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2908e640 1 -- start start 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2908e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc24147e30 0x7efc240b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2908e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc240b5aa0 0x7efc240b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2908e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc240b44d0 con 0x7efc2415fe00 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2908e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7efc2415ed60 con 0x7efc240b5aa0 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2908e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efc2415f040 con 0x7efc24147e30 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc240b5aa0 0x7efc240b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc240b5aa0 0x7efc240b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57210/0 (socket says 172.21.15.94:57210) 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2259c640 1 -- 172.21.15.94:0/1120174984 learned_addr learned my addr 172.21.15.94:0/1120174984 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc22d9d640 1 --2- 172.21.15.94:0/1120174984 >> v2:172.21.15.155:3300/0 conn(0x7efc24147e30 0x7efc240b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2259c640 1 -- 172.21.15.94:0/1120174984 >> v2:172.21.15.155:3300/0 conn(0x7efc24147e30 msgr2=0x7efc240b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2259c640 1 --2- 172.21.15.94:0/1120174984 >> v2:172.21.15.155:3300/0 conn(0x7efc24147e30 0x7efc240b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2259c640 1 -- 172.21.15.94:0/1120174984 >> v1:172.21.15.155:6789/0 conn(0x7efc2415fe00 legacy=0x7efc24160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc2259c640 1 -- 172.21.15.94:0/1120174984 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2415f320 con 0x7efc240b5aa0 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.705+0000 7efc22d9d640 1 --2- 172.21.15.94:0/1120174984 >> v2:172.21.15.155:3300/0 conn(0x7efc24147e30 0x7efc240b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2259c640 1 --2- 172.21.15.94:0/1120174984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc240b5aa0 0x7efc240b5f10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efc240d2200 tx=0x7efc0c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd588b6bab0a022 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc21d9b640 1 -- 172.21.15.94:0/1120174984 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24161130 con 0x7efc240b5aa0 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc21d9b640 1 -- 172.21.15.94:0/1120174984 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0c0a5720 con 0x7efc240b5aa0 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc21d9b640 1 -- 172.21.15.94:0/1120174984 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0a5af0 con 0x7efc240b5aa0 2024-09-11T23:18:20.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 -- 172.21.15.94:0/1120174984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc240b5aa0 msgr2=0x7efc240b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 --2- 172.21.15.94:0/1120174984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc240b5aa0 0x7efc240b5f10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efc240d2200 tx=0x7efc0c01c860 comp rx=0 tx=0).stop 2024-09-11T23:18:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 -- 172.21.15.94:0/1120174984 shutdown_connections 2024-09-11T23:18:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 --2- 172.21.15.94:0/1120174984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc240b5aa0 0x7efc240b5f10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 --2- 172.21.15.94:0/1120174984 >> v2:172.21.15.155:3300/0 conn(0x7efc24147e30 0x7efc240b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 -- 172.21.15.94:0/1120174984 >> 172.21.15.94:0/1120174984 conn(0x7efc2409aa00 msgr2=0x7efc240b6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 -- 172.21.15.94:0/1120174984 shutdown_connections 2024-09-11T23:18:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.709+0000 7efc2908e640 1 -- 172.21.15.94:0/1120174984 wait complete. 2024-09-11T23:18:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 Processor -- start 2024-09-11T23:18:20.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 -- start start 2024-09-11T23:18:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc240b5aa0 0x7efc24139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc24147e30 0x7efc240ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc2415fe00 0x7efc24138950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc240b2ba0 con 0x7efc2415fe00 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc2415ea10 con 0x7efc240b5aa0 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc240b2d20 con 0x7efc24147e30 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc2415fe00 0x7efc24138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc2415fe00 0x7efc24138950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57214/0 (socket says 172.21.15.94:57214) 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 -- 172.21.15.94:0/2408750116 learned_addr learned my addr 172.21.15.94:0/2408750116 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc22d9d640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc240b5aa0 0x7efc24139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2259c640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc24147e30 0x7efc240ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 -- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc24147e30 msgr2=0x7efc240ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc24147e30 0x7efc240ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 -- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc240b5aa0 msgr2=0x7efc24139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc240b5aa0 0x7efc24139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 -- 172.21.15.94:0/2408750116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc24138e90 con 0x7efc2415fe00 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2259c640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc24147e30 0x7efc240ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2359e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc2415fe00 0x7efc24138950 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c3f0 tx=0x7efc1400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc1b7fe640 1 -- 172.21.15.94:0/2408750116 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14011790 con 0x7efc2415fe00 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc1b7fe640 1 -- 172.21.15.94:0/2408750116 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc14017070 con 0x7efc2415fe00 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc1b7fe640 1 -- 172.21.15.94:0/2408750116 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14011b70 con 0x7efc2415fe00 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc240cb7a0 con 0x7efc2415fe00 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc240caf00 con 0x7efc2415fe00 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc240b5f10 con 0x7efc2415fe00 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc1b7fe640 1 -- 172.21.15.94:0/2408750116 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc14011d10 con 0x7efc2415fe00 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.713+0000 7efc1b7fe640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc040678c0 0x7efc04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.717+0000 7efc1b7fe640 1 -- 172.21.15.94:0/2408750116 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5619+0+0 (secure 0 0 0) 0x7efc14085a30 con 0x7efc2415fe00 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.717+0000 7efc22d9d640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc040678c0 0x7efc04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.717+0000 7efc22d9d640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc040678c0 0x7efc04069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006fd0 tx=0x7efc1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.721+0000 7efc1b7fe640 1 -- 172.21.15.94:0/2408750116 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc14056650 con 0x7efc2415fe00 2024-09-11T23:18:20.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:20.877+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc240d1f30 con 0x7efc2415fe00 2024-09-11T23:18:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.561+0000 7efc1b7fe640 1 -- 172.21.15.94:0/2408750116 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7efc14055f50 con 0x7efc2415fe00 2024-09-11T23:18:21.563 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:18:21.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc040678c0 msgr2=0x7efc04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc040678c0 0x7efc04069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006fd0 tx=0x7efc1c008040 comp rx=0 tx=0).stop 2024-09-11T23:18:21.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc2415fe00 msgr2=0x7efc24138950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc2415fe00 0x7efc24138950 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c3f0 tx=0x7efc1400c8b0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 shutdown_connections 2024-09-11T23:18:21.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efc040678c0 0x7efc04069d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc2415fe00 0x7efc24138950 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc24147e30 0x7efc240ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 --2- 172.21.15.94:0/2408750116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc240b5aa0 0x7efc24139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.565+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 >> 172.21.15.94:0/2408750116 conn(0x7efc2409aa00 msgr2=0x7efc24145c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:21.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.573+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 shutdown_connections 2024-09-11T23:18:21.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.573+0000 7efc2908e640 1 -- 172.21.15.94:0/2408750116 wait complete. 2024-09-11T23:18:21.605 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:18:21.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f095105f640 1 Processor -- start 2024-09-11T23:18:21.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f095105f640 1 -- start start 2024-09-11T23:18:21.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f095105f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f094c15bec0 0x7f094c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f095105f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f094c0af470 0x7f094c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f095105f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094c0b3290 con 0x7f094c15c2a0 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f095105f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f094c0b3570 con 0x7f094c0af470 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f095105f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f094c0b3850 con 0x7f094c15bec0 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094b59e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f094c0af470 0x7f094c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094b59e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f094c0af470 0x7f094c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57220/0 (socket says 172.21.15.94:57220) 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094b59e640 1 -- 172.21.15.94:0/2995011754 learned_addr learned my addr 172.21.15.94:0/2995011754 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094ad9d640 1 --2- 172.21.15.94:0/2995011754 >> v2:172.21.15.155:3300/0 conn(0x7f094c15bec0 0x7f094c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094b59e640 1 -- 172.21.15.94:0/2995011754 >> v2:172.21.15.155:3300/0 conn(0x7f094c15bec0 msgr2=0x7f094c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094b59e640 1 --2- 172.21.15.94:0/2995011754 >> v2:172.21.15.155:3300/0 conn(0x7f094c15bec0 0x7f094c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094b59e640 1 -- 172.21.15.94:0/2995011754 >> v1:172.21.15.155:6789/0 conn(0x7f094c15c2a0 legacy=0x7f094c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:21.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.725+0000 7f094b59e640 1 -- 172.21.15.94:0/2995011754 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c0b3b30 con 0x7f094c0af470 2024-09-11T23:18:21.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094b59e640 1 --2- 172.21.15.94:0/2995011754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c0af470 0x7f094c06e000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f094c071710 tx=0x7f094401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cdf09445a59a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:21.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f0949d9b640 1 -- 172.21.15.94:0/2995011754 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09440a5840 con 0x7f094c0af470 2024-09-11T23:18:21.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f0949d9b640 1 -- 172.21.15.94:0/2995011754 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09440a59e0 con 0x7f094c0af470 2024-09-11T23:18:21.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f0949d9b640 1 -- 172.21.15.94:0/2995011754 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09440a5db0 con 0x7f094c0af470 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- 172.21.15.94:0/2995011754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c0af470 msgr2=0x7f094c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 --2- 172.21.15.94:0/2995011754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c0af470 0x7f094c06e000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f094c071710 tx=0x7f094401c980 comp rx=0 tx=0).stop 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- 172.21.15.94:0/2995011754 shutdown_connections 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 --2- 172.21.15.94:0/2995011754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c0af470 0x7f094c06e000 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 --2- 172.21.15.94:0/2995011754 >> v2:172.21.15.155:3300/0 conn(0x7f094c15bec0 0x7f094c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- 172.21.15.94:0/2995011754 >> 172.21.15.94:0/2995011754 conn(0x7f094c0b1f90 msgr2=0x7f094c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- 172.21.15.94:0/2995011754 shutdown_connections 2024-09-11T23:18:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- 172.21.15.94:0/2995011754 wait complete. 2024-09-11T23:18:21.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 Processor -- start 2024-09-11T23:18:21.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- start start 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f094c0af470 0x7f094c163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c15bec0 0x7f094c099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f094c15c2a0 0x7f094c073730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f094c06ed50 con 0x7f094c15bec0 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f094c0ad740 con 0x7f094c0af470 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f095105f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f094c06eed0 con 0x7f094c15c2a0 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c15bec0 0x7f094c099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c15bec0 0x7f094c099810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57228/0 (socket says 172.21.15.94:57228) 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 -- 172.21.15.94:0/53690882 learned_addr learned my addr 172.21.15.94:0/53690882 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094ad9d640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f094c0af470 0x7f094c163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094b59e640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f094c15c2a0 0x7f094c073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 -- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f094c15c2a0 msgr2=0x7f094c073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f094c15c2a0 0x7f094c073730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 -- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f094c0af470 msgr2=0x7f094c163fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f094c0af470 0x7f094c163fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 -- 172.21.15.94:0/53690882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c153e90 con 0x7f094c15bec0 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.729+0000 7f094a59c640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c15bec0 0x7f094c099810 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f094000b410 tx=0x7f094000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f09337fe640 1 -- 172.21.15.94:0/53690882 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940015020 con 0x7f094c15bec0 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f09337fe640 1 -- 172.21.15.94:0/53690882 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940011850 con 0x7f094c15bec0 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094c154170 con 0x7f094c15bec0 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f09337fe640 1 -- 172.21.15.94:0/53690882 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940011c40 con 0x7f094c15bec0 2024-09-11T23:18:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094c154730 con 0x7f094c15bec0 2024-09-11T23:18:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094c06f260 con 0x7f094c15bec0 2024-09-11T23:18:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f09337fe640 1 -- 172.21.15.94:0/53690882 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0940018020 con 0x7f094c15bec0 2024-09-11T23:18:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f09337fe640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09380678c0 0x7f0938069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f09337fe640 1 -- 172.21.15.94:0/53690882 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6001+0+0 (secure 0 0 0) 0x7f0940086250 con 0x7f094c15bec0 2024-09-11T23:18:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f094ad9d640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09380678c0 0x7f0938069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.733+0000 7f094ad9d640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09380678c0 0x7f0938069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f093c00a970 tx=0x7f093c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:21.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.737+0000 7f09337fe640 1 -- 172.21.15.94:0/53690882 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f094001f020 con 0x7f094c15bec0 2024-09-11T23:18:21.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:21.933+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f094c06fcd0 con 0x7f094c15bec0 2024-09-11T23:18:22.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.589+0000 7f09337fe640 1 -- 172.21.15.94:0/53690882 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v36) ==== 174+0+0 (secure 0 0 0) 0x7f094000f2e0 con 0x7f094c15bec0 2024-09-11T23:18:22.600 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 11 and data pool 12 2024-09-11T23:18:22.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09380678c0 msgr2=0x7f0938069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09380678c0 0x7f0938069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f093c00a970 tx=0x7f093c008040 comp rx=0 tx=0).stop 2024-09-11T23:18:22.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c15bec0 msgr2=0x7f094c099810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c15bec0 0x7f094c099810 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f094000b410 tx=0x7f094000b8d0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 shutdown_connections 2024-09-11T23:18:22.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f094c15c2a0 0x7f094c073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09380678c0 0x7f0938069d80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f094c15bec0 0x7f094c099810 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 --2- 172.21.15.94:0/53690882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f094c0af470 0x7f094c163fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.609+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 >> 172.21.15.94:0/53690882 conn(0x7f094c0b1f90 msgr2=0x7f094c159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.613+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 shutdown_connections 2024-09-11T23:18:22.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.613+0000 7f095105f640 1 -- 172.21.15.94:0/53690882 wait complete. 2024-09-11T23:18:22.639 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:22.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 Processor -- start 2024-09-11T23:18:22.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 -- start start 2024-09-11T23:18:22.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a841520a0 0x7f6a8406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a8406fe50 0x7f6a8415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a8415f1d0 0x7f6a84071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6a84152480 con 0x7f6a841520a0 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6a84070250 con 0x7f6a8406fe50 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a88eb3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a840aede0 con 0x7f6a8415f1d0 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a841520a0 0x7f6a8406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a841520a0 0x7f6a8406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57240/0 (socket says 172.21.15.94:57240) 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 -- 172.21.15.94:0/946950041 learned_addr learned my addr 172.21.15.94:0/946950041 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a82d9d640 1 --2- 172.21.15.94:0/946950041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a8415f1d0 0x7f6a84071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 -- 172.21.15.94:0/946950041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a8415f1d0 msgr2=0x7f6a84071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 --2- 172.21.15.94:0/946950041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a8415f1d0 0x7f6a84071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a81d9b640 1 --2- 172.21.15.94:0/946950041 >> v2:172.21.15.155:3300/0 conn(0x7f6a8406fe50 0x7f6a8415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 -- 172.21.15.94:0/946950041 >> v2:172.21.15.155:3300/0 conn(0x7f6a8406fe50 msgr2=0x7f6a8415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 --2- 172.21.15.94:0/946950041 >> v2:172.21.15.155:3300/0 conn(0x7f6a8406fe50 0x7f6a8415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.757+0000 7f6a8259c640 1 -- 172.21.15.94:0/946950041 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8415fa10 con 0x7f6a841520a0 2024-09-11T23:18:22.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a8259c640 1 --2- 172.21.15.94:0/946950041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a841520a0 0x7f6a8406f910 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6a8406e510 tx=0x7f6a7401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb9957ec52592d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a8159a640 1 -- 172.21.15.94:0/946950041 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a740b0070 con 0x7f6a841520a0 2024-09-11T23:18:22.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a8159a640 1 -- 172.21.15.94:0/946950041 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a740ab600 con 0x7f6a841520a0 2024-09-11T23:18:22.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a8159a640 1 -- 172.21.15.94:0/946950041 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a740ab9d0 con 0x7f6a841520a0 2024-09-11T23:18:22.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- 172.21.15.94:0/946950041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a841520a0 msgr2=0x7f6a8406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/946950041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a841520a0 0x7f6a8406f910 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6a8406e510 tx=0x7f6a7401c240 comp rx=0 tx=0).stop 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- 172.21.15.94:0/946950041 shutdown_connections 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/946950041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a8415f1d0 0x7f6a84071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/946950041 >> v2:172.21.15.155:3300/0 conn(0x7f6a8406fe50 0x7f6a8415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/946950041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a841520a0 0x7f6a8406f910 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- 172.21.15.94:0/946950041 >> 172.21.15.94:0/946950041 conn(0x7f6a840b1f90 msgr2=0x7f6a840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- 172.21.15.94:0/946950041 shutdown_connections 2024-09-11T23:18:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- 172.21.15.94:0/946950041 wait complete. 2024-09-11T23:18:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 Processor -- start 2024-09-11T23:18:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- start start 2024-09-11T23:18:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a8406fe50 0x7f6a84099820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a841520a0 0x7f6a840cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a8415f1d0 0x7f6a840cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84073d30 con 0x7f6a8406fe50 2024-09-11T23:18:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84073a50 con 0x7f6a8415f1d0 2024-09-11T23:18:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a88eb3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8415f5e0 con 0x7f6a841520a0 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a8259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a8406fe50 0x7f6a84099820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a8259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a8406fe50 0x7f6a84099820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57248/0 (socket says 172.21.15.94:57248) 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a8259c640 1 -- 172.21.15.94:0/641610119 learned_addr learned my addr 172.21.15.94:0/641610119 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.761+0000 7f6a81d9b640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a841520a0 0x7f6a840cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a82d9d640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a8415f1d0 0x7f6a840cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a8259c640 1 -- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a841520a0 msgr2=0x7f6a840cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a8259c640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a841520a0 0x7f6a840cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a8259c640 1 -- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a8415f1d0 msgr2=0x7f6a840cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a8259c640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a8415f1d0 0x7f6a840cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a8259c640 1 -- 172.21.15.94:0/641610119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a841450c0 con 0x7f6a8406fe50 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a82d9d640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a8415f1d0 0x7f6a840cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a8259c640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a8406fe50 0x7f6a84099820 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ae040 tx=0x7f6a74018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a72ffd640 1 -- 172.21.15.94:0/641610119 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a740b9070 con 0x7f6a8406fe50 2024-09-11T23:18:22.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a72ffd640 1 -- 172.21.15.94:0/641610119 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a740b4600 con 0x7f6a8406fe50 2024-09-11T23:18:22.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a840cce70 con 0x7f6a8406fe50 2024-09-11T23:18:22.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a72ffd640 1 -- 172.21.15.94:0/641610119 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a740b0040 con 0x7f6a8406fe50 2024-09-11T23:18:22.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a840cd430 con 0x7f6a8406fe50 2024-09-11T23:18:22.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8415ec90 con 0x7f6a8406fe50 2024-09-11T23:18:22.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a72ffd640 1 -- 172.21.15.94:0/641610119 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a740bc070 con 0x7f6a8406fe50 2024-09-11T23:18:22.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a72ffd640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a640678c0 0x7f6a64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a72ffd640 1 -- 172.21.15.94:0/641610119 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f6a7411ef90 con 0x7f6a8406fe50 2024-09-11T23:18:22.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a81d9b640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a640678c0 0x7f6a64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.765+0000 7f6a81d9b640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a640678c0 0x7f6a64069d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6a8414eff0 tx=0x7f6a78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.769+0000 7f6a72ffd640 1 -- 172.21.15.94:0/641610119 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6a740160f0 con 0x7f6a8406fe50 2024-09-11T23:18:22.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.933+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a8406e540 con 0x7f6a8406fe50 2024-09-11T23:18:22.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a72ffd640 1 -- 172.21.15.94:0/641610119 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17042 (secure 0 0 0) 0x7f6a740ef8e0 con 0x7f6a8406fe50 2024-09-11T23:18:22.938 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:22.938 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":74,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:18:21.938262+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:19.583667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:20.919663+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a640678c0 msgr2=0x7f6a64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a640678c0 0x7f6a64069d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6a8414eff0 tx=0x7f6a78008040 comp rx=0 tx=0).stop 2024-09-11T23:18:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a8406fe50 msgr2=0x7f6a84099820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a8406fe50 0x7f6a84099820 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ae040 tx=0x7f6a74018fe0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 shutdown_connections 2024-09-11T23:18:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a8415f1d0 0x7f6a840cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a841520a0 0x7f6a840cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a640678c0 0x7f6a64069d80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 --2- 172.21.15.94:0/641610119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a8406fe50 0x7f6a84099820 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 >> 172.21.15.94:0/641610119 conn(0x7f6a840b1f90 msgr2=0x7f6a8415d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 shutdown_connections 2024-09-11T23:18:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:22.937+0000 7f6a88eb3640 1 -- 172.21.15.94:0/641610119 wait complete. 2024-09-11T23:18:22.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:23.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.073+0000 7f7ddffaf640 1 Processor -- start 2024-09-11T23:18:23.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.073+0000 7f7ddffaf640 1 -- start start 2024-09-11T23:18:23.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddffaf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7dd81520a0 0x7f7dd806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddffaf640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd8070250 con 0x7f7dd815f3a0 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddffaf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd80aede0 con 0x7f7dd806fe50 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddffaf640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd8152480 con 0x7f7dd81520a0 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7dddd4b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7dd81520a0 0x7f7dd806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7dde54c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7dd815f3a0 0x7f7dd80adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44602/0 (socket says 172.21.15.94:44602) 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7dde54c640 1 -- 172.21.15.94:0/1979004881 learned_addr learned my addr 172.21.15.94:0/1979004881 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7dddd4b640 1 -- 172.21.15.94:0/1979004881 >> v1:172.21.15.155:6789/0 conn(0x7f7dd806fe50 legacy=0x7f7dd815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7dddd4b640 1 -- 172.21.15.94:0/1979004881 >> v1:172.21.15.94:6789/0 conn(0x7f7dd815f3a0 legacy=0x7f7dd80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7dddd4b640 1 -- 172.21.15.94:0/1979004881 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd815fa10 con 0x7f7dd81520a0 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddcd49640 1 -- 172.21.15.94:0/1979004881 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625477410 0 0) 0x7f7dd8070250 con 0x7f7dd815f3a0 2024-09-11T23:18:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7dddd4b640 1 --2- 172.21.15.94:0/1979004881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd81520a0 0x7f7dd806f910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80097c0 tx=0x7f7dc801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf8876683225e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddcd49640 1 -- 172.21.15.94:0/1979004881 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80b0070 con 0x7f7dd81520a0 2024-09-11T23:18:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddcd49640 1 -- 172.21.15.94:0/1979004881 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc8004230 con 0x7f7dd81520a0 2024-09-11T23:18:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddcd49640 1 -- 172.21.15.94:0/1979004881 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80aeba0 con 0x7f7dd81520a0 2024-09-11T23:18:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddffaf640 1 -- 172.21.15.94:0/1979004881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd81520a0 msgr2=0x7f7dd806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.077+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/1979004881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd81520a0 0x7f7dd806f910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80097c0 tx=0x7f7dc801c460 comp rx=0 tx=0).stop 2024-09-11T23:18:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- 172.21.15.94:0/1979004881 shutdown_connections 2024-09-11T23:18:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/1979004881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd81520a0 0x7f7dd806f910 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- 172.21.15.94:0/1979004881 >> 172.21.15.94:0/1979004881 conn(0x7f7dd80b1f90 msgr2=0x7f7dd80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- 172.21.15.94:0/1979004881 shutdown_connections 2024-09-11T23:18:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- 172.21.15.94:0/1979004881 wait complete. 2024-09-11T23:18:23.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 Processor -- start 2024-09-11T23:18:23.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- start start 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd806fe50 0x7f7dd80cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd81520a0 0x7f7dd8145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd815f3a0 0x7f7dd80cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8073d30 con 0x7f7dd815f3a0 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8073a50 con 0x7f7dd81520a0 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd8168f20 con 0x7f7dd806fe50 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd815f3a0 0x7f7dd80cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddd54a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd81520a0 0x7f7dd8145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dddd4b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd806fe50 0x7f7dd80cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd815f3a0 0x7f7dd80cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57266/0 (socket says 172.21.15.94:57266) 2024-09-11T23:18:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddd54a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd81520a0 0x7f7dd8145930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:51262/0 (socket says 172.21.15.94:51262) 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 -- 172.21.15.94:0/954150903 learned_addr learned my addr 172.21.15.94:0/954150903 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 -- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd806fe50 msgr2=0x7f7dd80cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd806fe50 0x7f7dd80cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 -- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd81520a0 msgr2=0x7f7dd8145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd81520a0 0x7f7dd8145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 -- 172.21.15.94:0/954150903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd80b4710 con 0x7f7dd815f3a0 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dde54c640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd815f3a0 0x7f7dd80cd8d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c7a0 tx=0x7f7dd000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dce7fc640 1 -- 172.21.15.94:0/954150903 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0018070 con 0x7f7dd815f3a0 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dce7fc640 1 -- 172.21.15.94:0/954150903 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd000a640 con 0x7f7dd815f3a0 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd81503b0 con 0x7f7dd815f3a0 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7dce7fc640 1 -- 172.21.15.94:0/954150903 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000aab0 con 0x7f7dd815f3a0 2024-09-11T23:18:23.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.081+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd8150970 con 0x7f7dd815f3a0 2024-09-11T23:18:23.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.085+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd806f910 con 0x7f7dd815f3a0 2024-09-11T23:18:23.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.085+0000 7f7dce7fc640 1 -- 172.21.15.94:0/954150903 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7dd001b070 con 0x7f7dd815f3a0 2024-09-11T23:18:23.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.085+0000 7f7dce7fc640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7dbc0678c0 0x7f7dbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.085+0000 7f7dce7fc640 1 -- 172.21.15.94:0/954150903 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f7dd00852b0 con 0x7f7dd815f3a0 2024-09-11T23:18:23.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.085+0000 7f7dddd4b640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7dbc0678c0 0x7f7dbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.085+0000 7f7dddd4b640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7dbc0678c0 0x7f7dbc069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80ad000 tx=0x7f7dc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.089+0000 7f7dce7fc640 1 -- 172.21.15.94:0/954150903 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7dd00556a0 con 0x7f7dd815f3a0 2024-09-11T23:18:23.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.253+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dd8145e70 con 0x7f7dd815f3a0 2024-09-11T23:18:23.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.253+0000 7f7dce7fc640 1 -- 172.21.15.94:0/954150903 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17042 (secure 0 0 0) 0x7f7dd00599a0 con 0x7f7dd815f3a0 2024-09-11T23:18:23.256 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:23.256 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":74,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:18:21.938262+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:19.583667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:20.919663+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:23.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7dbc0678c0 msgr2=0x7f7dbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7dbc0678c0 0x7f7dbc069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80ad000 tx=0x7f7dc8008040 comp rx=0 tx=0).stop 2024-09-11T23:18:23.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd815f3a0 msgr2=0x7f7dd80cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd815f3a0 0x7f7dd80cd8d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c7a0 tx=0x7f7dd000cc60 comp rx=0 tx=0).stop 2024-09-11T23:18:23.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 shutdown_connections 2024-09-11T23:18:23.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7dbc0678c0 0x7f7dbc069d80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dd815f3a0 0x7f7dd80cd8d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd81520a0 0x7f7dd8145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 --2- 172.21.15.94:0/954150903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd806fe50 0x7f7dd80cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 >> 172.21.15.94:0/954150903 conn(0x7f7dd80b1f90 msgr2=0x7f7dd815c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:23.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 shutdown_connections 2024-09-11T23:18:23.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.257+0000 7f7ddffaf640 1 -- 172.21.15.94:0/954150903 wait complete. 2024-09-11T23:18:23.275 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:18:23.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa5669ca640 1 Processor -- start 2024-09-11T23:18:23.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa5669ca640 1 -- start start 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa5669ca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa56015c2a0 0x7fa5600aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa5669ca640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5600b3290 con 0x7fa5600af2a0 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa5669ca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5600b3570 con 0x7fa56015bec0 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa5669ca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa5600b3850 con 0x7fa56015c2a0 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa564f67640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa5600af2a0 0x7fa56006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44604/0 (socket says 172.21.15.94:44604) 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa564f67640 1 -- 172.21.15.94:0/586274543 learned_addr learned my addr 172.21.15.94:0/586274543 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa557fff640 1 --2- 172.21.15.94:0/586274543 >> v2:172.21.15.155:3300/0 conn(0x7fa56015c2a0 0x7fa5600aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999760980 0 0) 0x7fa5600b3290 con 0x7fa5600af2a0 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54c003530 con 0x7fa5600af2a0 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2949624306 0 0) 0x7fa54c003530 con 0x7fa5600af2a0 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 >> v2:172.21.15.155:3300/0 conn(0x7fa56015c2a0 msgr2=0x7fa5600aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:23.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 --2- 172.21.15.94:0/586274543 >> v2:172.21.15.155:3300/0 conn(0x7fa56015c2a0 0x7fa5600aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 >> v1:172.21.15.155:6789/0 conn(0x7fa56015bec0 legacy=0x7fa5600ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5600b3b30 con 0x7fa5600af2a0 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fa558001a00 con 0x7fa5600af2a0 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 >> v1:172.21.15.94:6789/0 conn(0x7fa5600af2a0 legacy=0x7fa56006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c0039c0 0x7fa54c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa54c004810 0x7fa54c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54c0051d0 0x7fa54c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa5600b3850 con 0x7fa54c004810 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c00c070 con 0x7fa54c0039c0 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa54c00c270 con 0x7fa54c0051d0 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa557fff640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa54c004810 0x7fa54c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa564f67640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54c0051d0 0x7fa54c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55ffff640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c0039c0 0x7fa54c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa557fff640 1 -- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54c0051d0 msgr2=0x7fa54c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa557fff640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54c0051d0 0x7fa54c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa557fff640 1 -- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c0039c0 msgr2=0x7fa54c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa557fff640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c0039c0 0x7fa54c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa557fff640 1 -- 172.21.15.94:0/586274543 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c003530 con 0x7fa54c004810 2024-09-11T23:18:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa55ffff640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c0039c0 0x7fa54c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.401+0000 7fa564f67640 1 -- 172.21.15.94:0/586274543 reap_dead start 2024-09-11T23:18:23.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa557fff640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa54c004810 0x7fa54c004c90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa548009ab0 tx=0x7fa54801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7508341b08b59a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480b2070 con 0x7fa54c004810 2024-09-11T23:18:23.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5480a5660 con 0x7fa54c004810 2024-09-11T23:18:23.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa55f7fe640 1 -- 172.21.15.94:0/586274543 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480096b0 con 0x7fa54c004810 2024-09-11T23:18:23.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- 172.21.15.94:0/586274543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa54c004810 msgr2=0x7fa54c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa54c004810 0x7fa54c004c90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa548009ab0 tx=0x7fa54801ca70 comp rx=0 tx=0).stop 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- 172.21.15.94:0/586274543 shutdown_connections 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 --2- 172.21.15.94:0/586274543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa54c004810 0x7fa54c004c90 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- 172.21.15.94:0/586274543 >> 172.21.15.94:0/586274543 conn(0x7fa5600b1f90 msgr2=0x7fa5600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- 172.21.15.94:0/586274543 shutdown_connections 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- 172.21.15.94:0/586274543 wait complete. 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 Processor -- start 2024-09-11T23:18:23.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- start start 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c004810 0x7fa56006e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa56015c6e0 0x7fa56015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa560099520 0x7fa5600999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa5600afc90 con 0x7fa56015c6e0 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5600b40f0 con 0x7fa54c004810 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa5669ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5600af710 con 0x7fa560099520 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa557fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa56015c6e0 0x7fa56015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.405+0000 7fa557fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa56015c6e0 0x7fa56015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57286/0 (socket says 172.21.15.94:57286) 2024-09-11T23:18:23.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa557fff640 1 -- 172.21.15.94:0/3059367342 learned_addr learned my addr 172.21.15.94:0/3059367342 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa564f67640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa560099520 0x7fa5600999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55ffff640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c004810 0x7fa56006e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa557fff640 1 -- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa560099520 msgr2=0x7fa5600999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa557fff640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa560099520 0x7fa5600999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa557fff640 1 -- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c004810 msgr2=0x7fa56006e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa557fff640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c004810 0x7fa56006e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa557fff640 1 -- 172.21.15.94:0/3059367342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5601f2380 con 0x7fa56015c6e0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa557fff640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa56015c6e0 0x7fa56015cb40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa5480b0040 tx=0x7fa548019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55d7fa640 1 -- 172.21.15.94:0/3059367342 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480b2040 con 0x7fa56015c6e0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55d7fa640 1 -- 172.21.15.94:0/3059367342 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54800f000 con 0x7fa56015c6e0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56015d160 con 0x7fa56015c6e0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55d7fa640 1 -- 172.21.15.94:0/3059367342 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480096b0 con 0x7fa56015c6e0 2024-09-11T23:18:23.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56015d720 con 0x7fa56015c6e0 2024-09-11T23:18:23.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5600aed60 con 0x7fa56015c6e0 2024-09-11T23:18:23.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55d7fa640 1 -- 172.21.15.94:0/3059367342 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5480bf030 con 0x7fa56015c6e0 2024-09-11T23:18:23.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55d7fa640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5400678f0 0x7fa540069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55d7fa640 1 -- 172.21.15.94:0/3059367342 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fa54811fb20 con 0x7fa56015c6e0 2024-09-11T23:18:23.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55ffff640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5400678f0 0x7fa540069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.409+0000 7fa55ffff640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5400678f0 0x7fa540069db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c10 tx=0x7fa550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.413+0000 7fa55d7fa640 1 -- 172.21.15.94:0/3059367342 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5480c6060 con 0x7fa56015c6e0 2024-09-11T23:18:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:23.617+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa56006fcd0 con 0x7fa56015c6e0 2024-09-11T23:18:24.596 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-09-11T23:18:24.595+0000 7f107f27e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:18:24.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.605+0000 7fa55d7fa640 1 -- 172.21.15.94:0/3059367342 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) ==== 118+0+0 (secure 0 0 0) 0x7fa548016780 con 0x7fa56015c6e0 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5400678f0 msgr2=0x7fa540069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5400678f0 0x7fa540069db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c10 tx=0x7fa550009040 comp rx=0 tx=0).stop 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa56015c6e0 msgr2=0x7fa56015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa56015c6e0 0x7fa56015cb40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa5480b0040 tx=0x7fa548019810 comp rx=0 tx=0).stop 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 shutdown_connections 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa560099520 0x7fa5600999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa5400678f0 0x7fa540069db0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa56015c6e0 0x7fa56015cb40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 --2- 172.21.15.94:0/3059367342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa54c004810 0x7fa56006e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 >> 172.21.15.94:0/3059367342 conn(0x7fa5600b1f90 msgr2=0x7fa56015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 shutdown_connections 2024-09-11T23:18:24.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.609+0000 7fa5669ca640 1 -- 172.21.15.94:0/3059367342 wait complete. 2024-09-11T23:18:24.632 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:18:24.632 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:18:24.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.757+0000 7f9b8d614640 1 Processor -- start 2024-09-11T23:18:24.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b8d614640 1 -- start start 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b8d614640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9b8806f010 0x7f9b88166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b8d614640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b880b3290 con 0x7f9b8815c2a0 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b8d614640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b880b3570 con 0x7f9b8815bec0 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b8d614640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9b880b3850 con 0x7f9b8806f010 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b877fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9b8806f010 0x7f9b88166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b867fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9b8815c2a0 0x7f9b880aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44608/0 (socket says 172.21.15.94:44608) 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b867fc640 1 -- 172.21.15.94:0/2568036641 learned_addr learned my addr 172.21.15.94:0/2568036641 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b877fe640 1 -- 172.21.15.94:0/2568036641 >> v1:172.21.15.155:6789/0 conn(0x7f9b8815bec0 legacy=0x7f9b880ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b877fe640 1 -- 172.21.15.94:0/2568036641 >> v1:172.21.15.94:6789/0 conn(0x7f9b8815c2a0 legacy=0x7f9b880aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b877fe640 1 -- 172.21.15.94:0/2568036641 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b880b3b30 con 0x7f9b8806f010 2024-09-11T23:18:24.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b85ffb640 1 -- 172.21.15.94:0/2568036641 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649848157 0 0) 0x7f9b880b3290 con 0x7f9b8815c2a0 2024-09-11T23:18:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b877fe640 1 --2- 172.21.15.94:0/2568036641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8806f010 0x7f9b88166ff0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b8001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd3e5418395224 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b85ffb640 1 -- 172.21.15.94:0/2568036641 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800b2070 con 0x7f9b8806f010 2024-09-11T23:18:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b85ffb640 1 -- 172.21.15.94:0/2568036641 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b800a58d0 con 0x7f9b8806f010 2024-09-11T23:18:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.761+0000 7f9b85ffb640 1 -- 172.21.15.94:0/2568036641 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800a5ca0 con 0x7f9b8806f010 2024-09-11T23:18:24.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- 172.21.15.94:0/2568036641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8806f010 msgr2=0x7f9b88166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 --2- 172.21.15.94:0/2568036641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8806f010 0x7f9b88166ff0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b8001c900 comp rx=0 tx=0).stop 2024-09-11T23:18:24.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- 172.21.15.94:0/2568036641 shutdown_connections 2024-09-11T23:18:24.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 --2- 172.21.15.94:0/2568036641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8806f010 0x7f9b88166ff0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- 172.21.15.94:0/2568036641 >> 172.21.15.94:0/2568036641 conn(0x7f9b880b1f90 msgr2=0x7f9b880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- 172.21.15.94:0/2568036641 shutdown_connections 2024-09-11T23:18:24.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- 172.21.15.94:0/2568036641 wait complete. 2024-09-11T23:18:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 Processor -- start 2024-09-11T23:18:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- start start 2024-09-11T23:18:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8806f010 0x7f9b8814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8815bec0 0x7f9b88154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8815c2a0 0x7f9b88165c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88169ed0 con 0x7f9b8815c2a0 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88169d50 con 0x7f9b8815bec0 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8816a050 con 0x7f9b8806f010 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8815c2a0 0x7f9b88165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8815c2a0 0x7f9b88165c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57318/0 (socket says 172.21.15.94:57318) 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 -- 172.21.15.94:0/3240627113 learned_addr learned my addr 172.21.15.94:0/3240627113 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:24.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b86ffd640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8806f010 0x7f9b8814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b867fc640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8815bec0 0x7f9b88154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 -- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8806f010 msgr2=0x7f9b8814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8806f010 0x7f9b8814f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 -- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8815bec0 msgr2=0x7f9b88154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8815bec0 0x7f9b88154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 -- 172.21.15.94:0/3240627113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8815d2d0 con 0x7f9b8815c2a0 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b867fc640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8815bec0 0x7f9b88154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b877fe640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8815c2a0 0x7f9b88165c10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b800196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b6f7fe640 1 -- 172.21.15.94:0/3240627113 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800b2040 con 0x7f9b8815c2a0 2024-09-11T23:18:24.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b6f7fe640 1 -- 172.21.15.94:0/3240627113 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b800bf070 con 0x7f9b8815c2a0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b88151eb0 con 0x7f9b8815c2a0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b6f7fe640 1 -- 172.21.15.94:0/3240627113 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800ad980 con 0x7f9b8815c2a0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.765+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b88152470 con 0x7f9b8815c2a0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.769+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b880ad200 con 0x7f9b8815c2a0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.769+0000 7f9b6f7fe640 1 -- 172.21.15.94:0/3240627113 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b800adb20 con 0x7f9b8815c2a0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.769+0000 7f9b6f7fe640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9b740678c0 0x7f9b74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.769+0000 7f9b6f7fe640 1 -- 172.21.15.94:0/3240627113 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f9b80121a40 con 0x7f9b8815c2a0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.769+0000 7f9b86ffd640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9b740678c0 0x7f9b74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.769+0000 7f9b86ffd640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9b740678c0 0x7f9b74069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b78004e30 tx=0x7f9b78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.773+0000 7f9b6f7fe640 1 -- 172.21.15.94:0/3240627113 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b8815d2d0 con 0x7f9b8815c2a0 2024-09-11T23:18:24.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:24.969+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9b8806fcd0 con 0x7f9b8815c2a0 2024-09-11T23:18:25.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.613+0000 7f9b6f7fe640 1 -- 172.21.15.94:0/3240627113 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f9b80016520 con 0x7f9b8815c2a0 2024-09-11T23:18:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9b740678c0 msgr2=0x7f9b74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9b740678c0 0x7f9b74069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b78004e30 tx=0x7f9b78009040 comp rx=0 tx=0).stop 2024-09-11T23:18:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8815c2a0 msgr2=0x7f9b88165c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8815c2a0 0x7f9b88165c10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b800196a0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 shutdown_connections 2024-09-11T23:18:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9b740678c0 0x7f9b74069d80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b8815c2a0 0x7f9b88165c10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8815bec0 0x7f9b88154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 --2- 172.21.15.94:0/3240627113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8806f010 0x7f9b8814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 >> 172.21.15.94:0/3240627113 conn(0x7f9b880b1f90 msgr2=0x7f9b880cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 shutdown_connections 2024-09-11T23:18:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.617+0000 7f9b8d614640 1 -- 172.21.15.94:0/3240627113 wait complete. 2024-09-11T23:18:25.639 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:18:25.640 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:25.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa668b640 1 Processor -- start 2024-09-11T23:18:25.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa668b640 1 -- start start 2024-09-11T23:18:25.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa668b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7effa0161a60 0x7effa00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa668b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 0x7effa006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa668b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00d32b0 con 0x7effa00d2e90 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa668b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7effa00d0300 con 0x7effa0161a60 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa668b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7effa00cfab0 con 0x7effa00cf620 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7effa00d2e90 0x7effa00cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44614/0 (socket says 172.21.15.94:44614) 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9f7fe640 1 -- 172.21.15.94:0/1864076522 learned_addr learned my addr 172.21.15.94:0/1864076522 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9ffff640 1 --2- 172.21.15.94:0/1864076522 >> v2:172.21.15.155:3300/0 conn(0x7effa0161a60 0x7effa00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393003079 0 0) 0x7effa00d32b0 con 0x7effa00d2e90 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa4c28640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 0x7effa006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff88003530 con 0x7effa00d2e90 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 756930642 0 0) 0x7eff88003530 con 0x7effa00d2e90 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 msgr2=0x7effa006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:25.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 0x7effa006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 >> v2:172.21.15.155:3300/0 conn(0x7effa0161a60 msgr2=0x7effa00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 --2- 172.21.15.94:0/1864076522 >> v2:172.21.15.155:3300/0 conn(0x7effa0161a60 0x7effa00d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa00b0f60 con 0x7effa00d2e90 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7eff94001680 con 0x7effa00d2e90 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 >> v1:172.21.15.94:6789/0 conn(0x7effa00d2e90 legacy=0x7effa00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff880039c0 0x7eff88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff88004810 0x7eff88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 0x7eff880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7effa00d0300 con 0x7eff880039c0 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7effa00cfab0 con 0x7eff88004810 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff8800b9d0 con 0x7effa00cf620 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9ffff640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff880039c0 0x7eff88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9ffff640 1 -- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 msgr2=0x7eff880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:25.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7effa4c28640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 0x7eff880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9f7fe640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff88004810 0x7eff88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9ffff640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa00cf620 0x7eff880051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9ffff640 1 -- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff88004810 msgr2=0x7eff88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:25.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9ffff640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff88004810 0x7eff88004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.761+0000 7eff9ffff640 1 -- 172.21.15.94:0/1864076522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff88003530 con 0x7eff880039c0 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7eff9ffff640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff880039c0 0x7eff88003de0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7eff90009b10 tx=0x7eff9001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebdac6ef2120cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff900b2070 con 0x7eff880039c0 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff900a5570 con 0x7eff880039c0 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7eff9effd640 1 -- 172.21.15.94:0/1864076522 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff900096b0 con 0x7eff880039c0 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- 172.21.15.94:0/1864076522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff880039c0 msgr2=0x7eff88003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 --2- 172.21.15.94:0/1864076522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff880039c0 0x7eff88003de0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7eff90009b10 tx=0x7eff9001ca80 comp rx=0 tx=0).stop 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa4c28640 1 -- 172.21.15.94:0/1864076522 reap_dead start 2024-09-11T23:18:25.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- 172.21.15.94:0/1864076522 shutdown_connections 2024-09-11T23:18:25.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- 172.21.15.94:0/1864076522 >> 172.21.15.94:0/1864076522 conn(0x7effa008bf90 msgr2=0x7effa009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:25.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- 172.21.15.94:0/1864076522 shutdown_connections 2024-09-11T23:18:25.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- 172.21.15.94:0/1864076522 wait complete. 2024-09-11T23:18:25.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 Processor -- start 2024-09-11T23:18:25.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- start start 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff880039c0 0x7effa00ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effa0152220 0x7effa0151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa00b8270 0x7effa00cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7effa006dec0 con 0x7effa0152220 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7effa006d190 con 0x7effa00b8270 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7effa668b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7effa006e040 con 0x7eff880039c0 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7eff9f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effa0152220 0x7effa0151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7eff9f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effa0152220 0x7effa0151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57334/0 (socket says 172.21.15.94:57334) 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.765+0000 7eff9f7fe640 1 -- 172.21.15.94:0/957678339 learned_addr learned my addr 172.21.15.94:0/957678339 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7effa4c28640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa00b8270 0x7effa00cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9ffff640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff880039c0 0x7effa00ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9f7fe640 1 -- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff880039c0 msgr2=0x7effa00ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9f7fe640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff880039c0 0x7effa00ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9f7fe640 1 -- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa00b8270 msgr2=0x7effa00cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9f7fe640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa00b8270 0x7effa00cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9f7fe640 1 -- 172.21.15.94:0/957678339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa0152030 con 0x7effa0152220 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7effa4c28640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa00b8270 0x7effa00cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9f7fe640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effa0152220 0x7effa0151af0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7eff9400d720 tx=0x7eff9400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9cff9640 1 -- 172.21.15.94:0/957678339 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94019070 con 0x7effa0152220 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9cff9640 1 -- 172.21.15.94:0/957678339 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff940072d0 con 0x7effa0152220 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa00cd300 con 0x7effa0152220 2024-09-11T23:18:25.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9cff9640 1 -- 172.21.15.94:0/957678339 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94007680 con 0x7effa0152220 2024-09-11T23:18:25.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa00c8200 con 0x7effa0152220 2024-09-11T23:18:25.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa006e400 con 0x7effa0152220 2024-09-11T23:18:25.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9cff9640 1 -- 172.21.15.94:0/957678339 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff9401c070 con 0x7effa0152220 2024-09-11T23:18:25.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9cff9640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff8c0678c0 0x7eff8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9cff9640 1 -- 172.21.15.94:0/957678339 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7eff940857d0 con 0x7effa0152220 2024-09-11T23:18:25.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9ffff640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff8c0678c0 0x7eff8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.769+0000 7eff9ffff640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff8c0678c0 0x7eff8c069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff900af000 tx=0x7eff900046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:25.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.773+0000 7eff9cff9640 1 -- 172.21.15.94:0/957678339 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff94056210 con 0x7effa0152220 2024-09-11T23:18:25.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.969+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effa00d1490 con 0x7effa0152220 2024-09-11T23:18:25.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.969+0000 7eff9cff9640 1 -- 172.21.15.94:0/957678339 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7eff94055b10 con 0x7effa0152220 2024-09-11T23:18:25.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:25.971 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:25.971 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff8c0678c0 msgr2=0x7eff8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff8c0678c0 0x7eff8c069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff900af000 tx=0x7eff900046d0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effa0152220 msgr2=0x7effa0151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effa0152220 0x7effa0151af0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7eff9400d720 tx=0x7eff9400dbe0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 shutdown_connections 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa00b8270 0x7effa00cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff8c0678c0 0x7eff8c069d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effa0152220 0x7effa0151af0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 --2- 172.21.15.94:0/957678339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff880039c0 0x7effa00ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 >> 172.21.15.94:0/957678339 conn(0x7effa008bf90 msgr2=0x7effa0074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:25.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 shutdown_connections 2024-09-11T23:18:25.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:25.973+0000 7effa668b640 1 -- 172.21.15.94:0/957678339 wait complete. 2024-09-11T23:18:25.990 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:26.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.097+0000 7fdd63b51640 1 Processor -- start 2024-09-11T23:18:26.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.097+0000 7fdd63b51640 1 -- start start 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.097+0000 7fdd63b51640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd5c15c2a0 0x7fdd5c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.097+0000 7fdd63b51640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c0b3290 con 0x7fdd5c15bec0 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.097+0000 7fdd63b51640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c0b3570 con 0x7fdd5c0af2a0 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.097+0000 7fdd63b51640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5c0b3850 con 0x7fdd5c15c2a0 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd618ed640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdd5c15bec0 0x7fdd5c0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44628/0 (socket says 172.21.15.94:44628) 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd618ed640 1 -- 172.21.15.94:0/1614412279 learned_addr learned my addr 172.21.15.94:0/1614412279 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900643011 0 0) 0x7fdd5c0b3290 con 0x7fdd5c15bec0 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd48003530 con 0x7fdd5c15bec0 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd610ec640 1 --2- 172.21.15.94:0/1614412279 >> v2:172.21.15.155:3300/0 conn(0x7fdd5c15c2a0 0x7fdd5c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2808086402 0 0) 0x7fdd48003530 con 0x7fdd5c15bec0 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 >> v2:172.21.15.155:3300/0 conn(0x7fdd5c15c2a0 msgr2=0x7fdd5c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 --2- 172.21.15.94:0/1614412279 >> v2:172.21.15.155:3300/0 conn(0x7fdd5c15c2a0 0x7fdd5c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 >> v1:172.21.15.155:6789/0 conn(0x7fdd5c0af2a0 legacy=0x7fdd5c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c0b3b30 con 0x7fdd5c15bec0 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fdd58001680 con 0x7fdd5c15bec0 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 >> v1:172.21.15.94:6789/0 conn(0x7fdd5c15bec0 legacy=0x7fdd5c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd480039c0 0x7fdd48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd48004810 0x7fdd48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd480051d0 0x7fdd4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c0b3850 con 0x7fdd480051d0 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4800c120 con 0x7fdd480039c0 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4800c320 con 0x7fdd48004810 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd480051d0 0x7fdd4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd618ed640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd480039c0 0x7fdd48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 -- 172.21.15.94:0/1614412279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd48004810 msgr2=0x7fdd48004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd48004810 0x7fdd48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 -- 172.21.15.94:0/1614412279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd480039c0 msgr2=0x7fdd48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd480039c0 0x7fdd48003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 -- 172.21.15.94:0/1614412279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd48003530 con 0x7fdd480051d0 2024-09-11T23:18:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 -- 172.21.15.94:0/1614412279 reap_dead start 2024-09-11T23:18:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd620ee640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd480051d0 0x7fdd4800b9d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdd54001e70 tx=0x7fdd5401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab182676d0e08d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd54001a90 con 0x7fdd480051d0 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd54003bc0 con 0x7fdd480051d0 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd608eb640 1 -- 172.21.15.94:0/1614412279 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd54005020 con 0x7fdd480051d0 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd63b51640 1 -- 172.21.15.94:0/1614412279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd480051d0 msgr2=0x7fdd4800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd480051d0 0x7fdd4800b9d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdd54001e70 tx=0x7fdd5401c780 comp rx=0 tx=0).stop 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd63b51640 1 -- 172.21.15.94:0/1614412279 shutdown_connections 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1614412279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd480051d0 0x7fdd4800b9d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd63b51640 1 -- 172.21.15.94:0/1614412279 >> 172.21.15.94:0/1614412279 conn(0x7fdd5c0b1f90 msgr2=0x7fdd5c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd63b51640 1 -- 172.21.15.94:0/1614412279 shutdown_connections 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.101+0000 7fdd63b51640 1 -- 172.21.15.94:0/1614412279 wait complete. 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 Processor -- start 2024-09-11T23:18:26.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 -- start start 2024-09-11T23:18:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd480051d0 0x7fdd5c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd5c09a280 0x7fdd5c14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd5c150070 0x7fdd5c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c0afc90 con 0x7fdd5c150070 2024-09-11T23:18:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c0b40f0 con 0x7fdd5c09a280 2024-09-11T23:18:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5c0af710 con 0x7fdd480051d0 2024-09-11T23:18:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd5c150070 0x7fdd5c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd5c150070 0x7fdd5c157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57352/0 (socket says 172.21.15.94:57352) 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 -- 172.21.15.94:0/1446028845 learned_addr learned my addr 172.21.15.94:0/1446028845 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd610ec640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd5c09a280 0x7fdd5c14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 -- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd480051d0 msgr2=0x7fdd5c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd618ed640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd480051d0 0x7fdd5c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd480051d0 0x7fdd5c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 -- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd5c09a280 msgr2=0x7fdd5c14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd5c09a280 0x7fdd5c14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 -- 172.21.15.94:0/1446028845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c1533e0 con 0x7fdd5c150070 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd610ec640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd5c09a280 0x7fdd5c14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd620ee640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd5c150070 0x7fdd5c157110 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdd5401cc60 tx=0x7fdd48005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd527fc640 1 -- 172.21.15.94:0/1446028845 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd54001a90 con 0x7fdd5c150070 2024-09-11T23:18:26.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd527fc640 1 -- 172.21.15.94:0/1446028845 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd54005810 con 0x7fdd5c150070 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5c1511b0 con 0x7fdd5c150070 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd527fc640 1 -- 172.21.15.94:0/1446028845 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd54007dc0 con 0x7fdd5c150070 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5c151770 con 0x7fdd5c150070 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5c0aed60 con 0x7fdd5c150070 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.105+0000 7fdd527fc640 1 -- 172.21.15.94:0/1446028845 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd540a6480 con 0x7fdd5c150070 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.109+0000 7fdd527fc640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd400678c0 0x7fdd40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.109+0000 7fdd527fc640 1 -- 172.21.15.94:0/1446028845 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fdd5411f740 con 0x7fdd5c150070 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.109+0000 7fdd618ed640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd400678c0 0x7fdd40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.109+0000 7fdd618ed640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd400678c0 0x7fdd40069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdd580078e0 tx=0x7fdd58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.113+0000 7fdd527fc640 1 -- 172.21.15.94:0/1446028845 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdd540b8060 con 0x7fdd5c150070 2024-09-11T23:18:26.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.261+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd5c06fcd0 con 0x7fdd5c150070 2024-09-11T23:18:26.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd527fc640 1 -- 172.21.15.94:0/1446028845 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17029 (secure 0 0 0) 0x7fdd54016490 con 0x7fdd5c150070 2024-09-11T23:18:26.266 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:26.266 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":75,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:18:23.566501+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:19.583667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:20.919663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd400678c0 msgr2=0x7fdd40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd400678c0 0x7fdd40069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdd580078e0 tx=0x7fdd58009040 comp rx=0 tx=0).stop 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd5c150070 msgr2=0x7fdd5c157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd5c150070 0x7fdd5c157110 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdd5401cc60 tx=0x7fdd48005840 comp rx=0 tx=0).stop 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 shutdown_connections 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd400678c0 0x7fdd40069d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd5c150070 0x7fdd5c157110 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd5c09a280 0x7fdd5c14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 --2- 172.21.15.94:0/1446028845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd480051d0 0x7fdd5c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 >> 172.21.15.94:0/1446028845 conn(0x7fdd5c0b1f90 msgr2=0x7fdd5c15a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:26.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 shutdown_connections 2024-09-11T23:18:26.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.265+0000 7fdd63b51640 1 -- 172.21.15.94:0/1446028845 wait complete. 2024-09-11T23:18:26.283 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:18:26.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:26.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.389+0000 7f46abcd9640 1 Processor -- start 2024-09-11T23:18:26.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.389+0000 7f46abcd9640 1 -- start start 2024-09-11T23:18:26.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46abcd9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46a415bec0 0x7f46a40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46abcd9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46a415c2a0 0x7f46a40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46abcd9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40af2a0 0x7f46a415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46abcd9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f46a40b3290 con 0x7f46a415bec0 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46abcd9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f46a40b3570 con 0x7f46a415c2a0 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46abcd9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46a40b3850 con 0x7f46a40af2a0 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46a415bec0 0x7f46a40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46a415bec0 0x7f46a40ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57366/0 (socket says 172.21.15.94:57366) 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 -- 172.21.15.94:0/1584670834 learned_addr learned my addr 172.21.15.94:0/1584670834 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:26.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9274640 1 --2- 172.21.15.94:0/1584670834 >> v2:172.21.15.155:3300/0 conn(0x7f46a415c2a0 0x7f46a40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 -- 172.21.15.94:0/1584670834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40af2a0 msgr2=0x7f46a415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 --2- 172.21.15.94:0/1584670834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40af2a0 0x7f46a415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 -- 172.21.15.94:0/1584670834 >> v2:172.21.15.155:3300/0 conn(0x7f46a415c2a0 msgr2=0x7f46a40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 --2- 172.21.15.94:0/1584670834 >> v2:172.21.15.155:3300/0 conn(0x7f46a415c2a0 0x7f46a40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 -- 172.21.15.94:0/1584670834 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a40b3b30 con 0x7f46a415bec0 2024-09-11T23:18:26.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a9a75640 1 --2- 172.21.15.94:0/1584670834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415bec0 0x7f46a40ad200 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f46a40ae510 tx=0x7f46a001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cf37651540037a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a8a73640 1 -- 172.21.15.94:0/1584670834 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a00a5580 con 0x7f46a415bec0 2024-09-11T23:18:26.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a8a73640 1 -- 172.21.15.94:0/1584670834 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a00a5720 con 0x7f46a415bec0 2024-09-11T23:18:26.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.393+0000 7f46a8a73640 1 -- 172.21.15.94:0/1584670834 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a00a5af0 con 0x7f46a415bec0 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/1584670834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415bec0 msgr2=0x7f46a40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 --2- 172.21.15.94:0/1584670834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415bec0 0x7f46a40ad200 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f46a40ae510 tx=0x7f46a001c700 comp rx=0 tx=0).stop 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/1584670834 shutdown_connections 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 --2- 172.21.15.94:0/1584670834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40af2a0 0x7f46a415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 --2- 172.21.15.94:0/1584670834 >> v2:172.21.15.155:3300/0 conn(0x7f46a415c2a0 0x7f46a40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 --2- 172.21.15.94:0/1584670834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415bec0 0x7f46a40ad200 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/1584670834 >> 172.21.15.94:0/1584670834 conn(0x7f46a40b1f90 msgr2=0x7f46a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/1584670834 shutdown_connections 2024-09-11T23:18:26.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/1584670834 wait complete. 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 Processor -- start 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- start start 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a40af2a0 0x7f46a414f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415bec0 0x7f46a4155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415c2a0 0x7f46a414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40ad740 con 0x7f46a415c2a0 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40af710 con 0x7f46a40af2a0 2024-09-11T23:18:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46a406e000 con 0x7f46a415bec0 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415c2a0 0x7f46a414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415c2a0 0x7f46a414dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57368/0 (socket says 172.21.15.94:57368) 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 -- 172.21.15.94:0/3358686086 learned_addr learned my addr 172.21.15.94:0/3358686086 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46a9274640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415bec0 0x7f46a4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46a9a75640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a40af2a0 0x7f46a414f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 -- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415bec0 msgr2=0x7f46a4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415bec0 0x7f46a4155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 -- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a40af2a0 msgr2=0x7f46a414f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a40af2a0 0x7f46a414f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 -- 172.21.15.94:0/3358686086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a414f570 con 0x7f46a415c2a0 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46a9274640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415bec0 0x7f46a4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46a9a75640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a40af2a0 0x7f46a414f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:26.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46aa276640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415c2a0 0x7f46a414dbe0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f469c00b430 tx=0x7f469c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f469a7fc640 1 -- 172.21.15.94:0/3358686086 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c015020 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f469a7fc640 1 -- 172.21.15.94:0/3358686086 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469c011830 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a415c780 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f469a7fc640 1 -- 172.21.15.94:0/3358686086 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c011c20 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a415cd40 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.397+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a40ad200 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.401+0000 7f469a7fc640 1 -- 172.21.15.94:0/3358686086 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f469c018020 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.401+0000 7f469a7fc640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f46880678c0 0x7f4688069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.401+0000 7f469a7fc640 1 -- 172.21.15.94:0/3358686086 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f469c085da0 con 0x7f46a415c2a0 2024-09-11T23:18:26.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.401+0000 7f46a9a75640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f46880678c0 0x7f4688069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.401+0000 7f46a9a75640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f46880678c0 0x7f4688069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f46a00ae000 tx=0x7f46a00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.405+0000 7f469a7fc640 1 -- 172.21.15.94:0/3358686086 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f469c01f020 con 0x7f46a415c2a0 2024-09-11T23:18:26.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.561+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46a406fcd0 con 0x7f46880678c0 2024-09-11T23:18:26.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.577+0000 7f469a7fc640 1 -- 172.21.15.94:0/3358686086 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246751 (secure 0 0 0) 0x7f46a406fcd0 con 0x7f46880678c0 2024-09-11T23:18:26.581 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:26.583 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:18:26.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f46880678c0 msgr2=0x7f4688069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f46880678c0 0x7f4688069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f46a00ae000 tx=0x7f46a00a7070 comp rx=0 tx=0).stop 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415c2a0 msgr2=0x7f46a414dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415c2a0 0x7f46a414dbe0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f469c00b430 tx=0x7f469c00b8f0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 shutdown_connections 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f46880678c0 0x7f4688069d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46a415c2a0 0x7f46a414dbe0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415bec0 0x7f46a4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 --2- 172.21.15.94:0/3358686086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a40af2a0 0x7f46a414f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 >> 172.21.15.94:0/3358686086 conn(0x7f46a40b1f90 msgr2=0x7f46a41532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 shutdown_connections 2024-09-11T23:18:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.581+0000 7f46abcd9640 1 -- 172.21.15.94:0/3358686086 wait complete. 2024-09-11T23:18:26.598 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-11T23:18:26.033727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278408,"kb_used_data":8052,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754696312,"statfs":{"total":773094113280,"available":772809023488,"internally_reserved":0,"allocated":8245248,"data_stored":4375995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.478190"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575141+0000","last_change":"2024-09-11T23:18:21.575141+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575141+0000","last_undegraded":"2024-09-11T23:18:21.575141+0000","last_fullsized":"2024-09-11T23:18:21.575141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576577+0000","last_change":"2024-09-11T23:18:21.576577+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576577+0000","last_undegraded":"2024-09-11T23:18:21.576577+0000","last_fullsized":"2024-09-11T23:18:21.576577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572276+0000","last_change":"2024-09-11T23:18:21.572276+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572276+0000","last_undegraded":"2024-09-11T23:18:21.572276+0000","last_fullsized":"2024-09-11T23:18:21.572276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.592440+0000","last_change":"2024-09-11T23:18:21.592440+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.592440+0000","last_undegraded":"2024-09-11T23:18:21.592440+0000","last_fullsized":"2024-09-11T23:18:21.592440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576579+0000","last_change":"2024-09-11T23:18:21.576579+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576579+0000","last_undegraded":"2024-09-11T23:18:21.576579+0000","last_fullsized":"2024-09-11T23:18:21.576579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577146+0000","last_change":"2024-09-11T23:18:21.577146+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577146+0000","last_undegraded":"2024-09-11T23:18:21.577146+0000","last_fullsized":"2024-09-11T23:18:21.577146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583012+0000","last_change":"2024-09-11T23:18:21.583012+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583012+0000","last_undegraded":"2024-09-11T23:18:21.583012+0000","last_fullsized":"2024-09-11T23:18:21.583012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573043+0000","last_change":"2024-09-11T23:18:21.573043+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573043+0000","last_undegraded":"2024-09-11T23:18:21.573043+0000","last_fullsized":"2024-09-11T23:18:21.573043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578207+0000","last_change":"2024-09-11T23:18:21.578207+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578207+0000","last_undegraded":"2024-09-11T23:18:21.578207+0000","last_fullsized":"2024-09-11T23:18:21.578207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583855+0000","last_change":"2024-09-11T23:18:21.583855+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583855+0000","last_undegraded":"2024-09-11T23:18:21.583855+0000","last_fullsized":"2024-09-11T23:18:21.583855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577081+0000","last_change":"2024-09-11T23:18:21.577081+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577081+0000","last_undegraded":"2024-09-11T23:18:21.577081+0000","last_fullsized":"2024-09-11T23:18:21.577081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.591435+0000","last_change":"2024-09-11T23:18:21.591435+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.591435+0000","last_undegraded":"2024-09-11T23:18:21.591435+0000","last_fullsized":"2024-09-11T23:18:21.591435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574657+0000","last_change":"2024-09-11T23:18:21.574657+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574657+0000","last_undegraded":"2024-09-11T23:18:21.574657+0000","last_fullsized":"2024-09-11T23:18:21.574657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576614+0000","last_change":"2024-09-11T23:18:21.576614+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576614+0000","last_undegraded":"2024-09-11T23:18:21.576614+0000","last_fullsized":"2024-09-11T23:18:21.576614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576743+0000","last_change":"2024-09-11T23:18:21.576743+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576743+0000","last_undegraded":"2024-09-11T23:18:21.576743+0000","last_fullsized":"2024-09-11T23:18:21.576743+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574980+0000","last_change":"2024-09-11T23:18:21.574980+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574980+0000","last_undegraded":"2024-09-11T23:18:21.574980+0000","last_fullsized":"2024-09-11T23:18:21.574980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573199+0000","last_change":"2024-09-11T23:18:21.573199+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573199+0000","last_undegraded":"2024-09-11T23:18:21.573199+0000","last_fullsized":"2024-09-11T23:18:21.573199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572306+0000","last_change":"2024-09-11T23:18:21.572306+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572306+0000","last_undegraded":"2024-09-11T23:18:21.572306+0000","last_fullsized":"2024-09-11T23:18:21.572306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574480+0000","last_change":"2024-09-11T23:18:21.574480+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574480+0000","last_undegraded":"2024-09-11T23:18:21.574480+0000","last_fullsized":"2024-09-11T23:18:21.574480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574942+0000","last_change":"2024-09-11T23:18:21.574942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574942+0000","last_undegraded":"2024-09-11T23:18:21.574942+0000","last_fullsized":"2024-09-11T23:18:21.574942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580987+0000","last_change":"2024-09-11T23:18:21.580987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580987+0000","last_undegraded":"2024-09-11T23:18:21.580987+0000","last_fullsized":"2024-09-11T23:18:21.580987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573853+0000","last_change":"2024-09-11T23:18:21.573853+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573853+0000","last_undegraded":"2024-09-11T23:18:21.573853+0000","last_fullsized":"2024-09-11T23:18:21.573853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576356+0000","last_change":"2024-09-11T23:18:21.576356+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576356+0000","last_undegraded":"2024-09-11T23:18:21.576356+0000","last_fullsized":"2024-09-11T23:18:21.576356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573787+0000","last_change":"2024-09-11T23:18:21.573787+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573787+0000","last_undegraded":"2024-09-11T23:18:21.573787+0000","last_fullsized":"2024-09-11T23:18:21.573787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573987+0000","last_change":"2024-09-11T23:18:21.573987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573987+0000","last_undegraded":"2024-09-11T23:18:21.573987+0000","last_fullsized":"2024-09-11T23:18:21.573987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580841+0000","last_change":"2024-09-11T23:18:21.580841+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580841+0000","last_undegraded":"2024-09-11T23:18:21.580841+0000","last_fullsized":"2024-09-11T23:18:21.580841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574395+0000","last_change":"2024-09-11T23:18:21.574395+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574395+0000","last_undegraded":"2024-09-11T23:18:21.574395+0000","last_fullsized":"2024-09-11T23:18:21.574395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574362+0000","last_change":"2024-09-11T23:18:21.574362+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574362+0000","last_undegraded":"2024-09-11T23:18:21.574362+0000","last_fullsized":"2024-09-11T23:18:21.574362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573182+0000","last_change":"2024-09-11T23:18:21.573182+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573182+0000","last_undegraded":"2024-09-11T23:18:21.573182+0000","last_fullsized":"2024-09-11T23:18:21.573182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572487+0000","last_change":"2024-09-11T23:18:21.572487+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572487+0000","last_undegraded":"2024-09-11T23:18:21.572487+0000","last_fullsized":"2024-09-11T23:18:21.572487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570942+0000","last_change":"2024-09-11T23:18:21.570942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570942+0000","last_undegraded":"2024-09-11T23:18:21.570942+0000","last_fullsized":"2024-09-11T23:18:21.570942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572484+0000","last_change":"2024-09-11T23:18:21.572484+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572484+0000","last_undegraded":"2024-09-11T23:18:21.572484+0000","last_fullsized":"2024-09-11T23:18:21.572484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571495+0000","last_change":"2024-09-11T23:18:21.571495+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571495+0000","last_undegraded":"2024-09-11T23:18:21.571495+0000","last_fullsized":"2024-09-11T23:18:21.571495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581883+0000","last_change":"2024-09-11T23:18:21.580890+0000","last_active":"2024-09-11T23:18:21.581883+0000","last_peered":"2024-09-11T23:18:21.581883+0000","last_clean":"2024-09-11T23:18:21.581883+0000","last_became_active":"2024-09-11T23:18:21.580558+0000","last_became_peered":"2024-09-11T23:18:21.580558+0000","last_unstale":"2024-09-11T23:18:21.581883+0000","last_undegraded":"2024-09-11T23:18:21.581883+0000","last_fullsized":"2024-09-11T23:18:21.581883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:59.631938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576195+0000","last_change":"2024-09-11T23:18:21.576195+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576195+0000","last_undegraded":"2024-09-11T23:18:21.576195+0000","last_fullsized":"2024-09-11T23:18:21.576195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607917+0000","last_change":"2024-09-11T23:18:21.605242+0000","last_active":"2024-09-11T23:18:21.607917+0000","last_peered":"2024-09-11T23:18:21.607917+0000","last_clean":"2024-09-11T23:18:21.607917+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.607917+0000","last_undegraded":"2024-09-11T23:18:21.607917+0000","last_fullsized":"2024-09-11T23:18:21.607917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577727+0000","last_change":"2024-09-11T23:18:21.577727+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577727+0000","last_undegraded":"2024-09-11T23:18:21.577727+0000","last_fullsized":"2024-09-11T23:18:21.577727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606516+0000","last_change":"2024-09-11T23:18:21.600136+0000","last_active":"2024-09-11T23:18:21.606516+0000","last_peered":"2024-09-11T23:18:21.606516+0000","last_clean":"2024-09-11T23:18:21.606516+0000","last_became_active":"2024-09-11T23:18:21.597138+0000","last_became_peered":"2024-09-11T23:18:21.597138+0000","last_unstale":"2024-09-11T23:18:21.606516+0000","last_undegraded":"2024-09-11T23:18:21.606516+0000","last_fullsized":"2024-09-11T23:18:21.606516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580104+0000","last_change":"2024-09-11T23:18:21.580104+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580104+0000","last_undegraded":"2024-09-11T23:18:21.580104+0000","last_fullsized":"2024-09-11T23:18:21.580104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614398+0000","last_change":"2024-09-11T23:18:21.610459+0000","last_active":"2024-09-11T23:18:21.614398+0000","last_peered":"2024-09-11T23:18:21.614398+0000","last_clean":"2024-09-11T23:18:21.614398+0000","last_became_active":"2024-09-11T23:18:21.604546+0000","last_became_peered":"2024-09-11T23:18:21.604546+0000","last_unstale":"2024-09-11T23:18:21.614398+0000","last_undegraded":"2024-09-11T23:18:21.614398+0000","last_fullsized":"2024-09-11T23:18:21.614398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:20.492447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575035+0000","last_change":"2024-09-11T23:18:21.575035+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575035+0000","last_undegraded":"2024-09-11T23:18:21.575035+0000","last_fullsized":"2024-09-11T23:18:21.575035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602182+0000","last_change":"2024-09-11T23:18:21.600764+0000","last_active":"2024-09-11T23:18:21.602182+0000","last_peered":"2024-09-11T23:18:21.602182+0000","last_clean":"2024-09-11T23:18:21.602182+0000","last_became_active":"2024-09-11T23:18:21.600043+0000","last_became_peered":"2024-09-11T23:18:21.600043+0000","last_unstale":"2024-09-11T23:18:21.602182+0000","last_undegraded":"2024-09-11T23:18:21.602182+0000","last_fullsized":"2024-09-11T23:18:21.602182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:37.130140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573003+0000","last_change":"2024-09-11T23:18:21.573003+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573003+0000","last_undegraded":"2024-09-11T23:18:21.573003+0000","last_fullsized":"2024-09-11T23:18:21.573003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605130+0000","last_change":"2024-09-11T23:18:21.597322+0000","last_active":"2024-09-11T23:18:21.605130+0000","last_peered":"2024-09-11T23:18:21.605130+0000","last_clean":"2024-09-11T23:18:21.605130+0000","last_became_active":"2024-09-11T23:18:21.596479+0000","last_became_peered":"2024-09-11T23:18:21.596479+0000","last_unstale":"2024-09-11T23:18:21.605130+0000","last_undegraded":"2024-09-11T23:18:21.605130+0000","last_fullsized":"2024-09-11T23:18:21.605130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578520+0000","last_change":"2024-09-11T23:18:21.578520+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578520+0000","last_undegraded":"2024-09-11T23:18:21.578520+0000","last_fullsized":"2024-09-11T23:18:21.578520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.598269+0000","last_change":"2024-09-11T23:18:21.597750+0000","last_active":"2024-09-11T23:18:21.598269+0000","last_peered":"2024-09-11T23:18:21.598269+0000","last_clean":"2024-09-11T23:18:21.598269+0000","last_became_active":"2024-09-11T23:18:21.597419+0000","last_became_peered":"2024-09-11T23:18:21.597419+0000","last_unstale":"2024-09-11T23:18:21.598269+0000","last_undegraded":"2024-09-11T23:18:21.598269+0000","last_fullsized":"2024-09-11T23:18:21.598269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.587465+0000","last_change":"2024-09-11T23:18:21.587465+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.587465+0000","last_undegraded":"2024-09-11T23:18:21.587465+0000","last_fullsized":"2024-09-11T23:18:21.587465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602352+0000","last_change":"2024-09-11T23:18:21.601997+0000","last_active":"2024-09-11T23:18:21.602352+0000","last_peered":"2024-09-11T23:18:21.602352+0000","last_clean":"2024-09-11T23:18:21.602352+0000","last_became_active":"2024-09-11T23:18:21.601557+0000","last_became_peered":"2024-09-11T23:18:21.601557+0000","last_unstale":"2024-09-11T23:18:21.602352+0000","last_undegraded":"2024-09-11T23:18:21.602352+0000","last_fullsized":"2024-09-11T23:18:21.602352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:39.744498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572822+0000","last_change":"2024-09-11T23:18:21.572822+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572822+0000","last_undegraded":"2024-09-11T23:18:21.572822+0000","last_fullsized":"2024-09-11T23:18:21.572822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608618+0000","last_change":"2024-09-11T23:18:21.606163+0000","last_active":"2024-09-11T23:18:21.608618+0000","last_peered":"2024-09-11T23:18:21.608618+0000","last_clean":"2024-09-11T23:18:21.608618+0000","last_became_active":"2024-09-11T23:18:21.605050+0000","last_became_peered":"2024-09-11T23:18:21.605050+0000","last_unstale":"2024-09-11T23:18:21.608618+0000","last_undegraded":"2024-09-11T23:18:21.608618+0000","last_fullsized":"2024-09-11T23:18:21.608618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588993+0000","last_change":"2024-09-11T23:18:21.588993+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588993+0000","last_undegraded":"2024-09-11T23:18:21.588993+0000","last_fullsized":"2024-09-11T23:18:21.588993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605321+0000","last_change":"2024-09-11T23:18:21.600933+0000","last_active":"2024-09-11T23:18:21.605321+0000","last_peered":"2024-09-11T23:18:21.605321+0000","last_clean":"2024-09-11T23:18:21.605321+0000","last_became_active":"2024-09-11T23:18:21.600235+0000","last_became_peered":"2024-09-11T23:18:21.600235+0000","last_unstale":"2024-09-11T23:18:21.605321+0000","last_undegraded":"2024-09-11T23:18:21.605321+0000","last_fullsized":"2024-09-11T23:18:21.605321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575987+0000","last_change":"2024-09-11T23:18:21.575987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575987+0000","last_undegraded":"2024-09-11T23:18:21.575987+0000","last_fullsized":"2024-09-11T23:18:21.575987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581754+0000","last_change":"2024-09-11T23:18:21.580034+0000","last_active":"2024-09-11T23:18:21.581754+0000","last_peered":"2024-09-11T23:18:21.581754+0000","last_clean":"2024-09-11T23:18:21.581754+0000","last_became_active":"2024-09-11T23:18:21.579736+0000","last_became_peered":"2024-09-11T23:18:21.579736+0000","last_unstale":"2024-09-11T23:18:21.581754+0000","last_undegraded":"2024-09-11T23:18:21.581754+0000","last_fullsized":"2024-09-11T23:18:21.581754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:04.945467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570534+0000","last_change":"2024-09-11T23:18:21.570534+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570534+0000","last_undegraded":"2024-09-11T23:18:21.570534+0000","last_fullsized":"2024-09-11T23:18:21.570534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.615599+0000","last_change":"2024-09-11T23:18:21.611858+0000","last_active":"2024-09-11T23:18:21.615599+0000","last_peered":"2024-09-11T23:18:21.615599+0000","last_clean":"2024-09-11T23:18:21.615599+0000","last_became_active":"2024-09-11T23:18:21.610397+0000","last_became_peered":"2024-09-11T23:18:21.610397+0000","last_unstale":"2024-09-11T23:18:21.615599+0000","last_undegraded":"2024-09-11T23:18:21.615599+0000","last_fullsized":"2024-09-11T23:18:21.615599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.087713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.581265+0000","last_change":"2024-09-11T23:18:21.581265+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.581265+0000","last_undegraded":"2024-09-11T23:18:21.581265+0000","last_fullsized":"2024-09-11T23:18:21.581265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607776+0000","last_change":"2024-09-11T23:18:21.604083+0000","last_active":"2024-09-11T23:18:21.607776+0000","last_peered":"2024-09-11T23:18:21.607776+0000","last_clean":"2024-09-11T23:18:21.607776+0000","last_became_active":"2024-09-11T23:18:21.603406+0000","last_became_peered":"2024-09-11T23:18:21.603406+0000","last_unstale":"2024-09-11T23:18:21.607776+0000","last_undegraded":"2024-09-11T23:18:21.607776+0000","last_fullsized":"2024-09-11T23:18:21.607776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.590372+0000","last_change":"2024-09-11T23:18:21.590372+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.590372+0000","last_undegraded":"2024-09-11T23:18:21.590372+0000","last_fullsized":"2024-09-11T23:18:21.590372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603108+0000","last_change":"2024-09-11T23:18:21.598505+0000","last_active":"2024-09-11T23:18:21.603108+0000","last_peered":"2024-09-11T23:18:21.603108+0000","last_clean":"2024-09-11T23:18:21.603108+0000","last_became_active":"2024-09-11T23:18:21.597672+0000","last_became_peered":"2024-09-11T23:18:21.597672+0000","last_unstale":"2024-09-11T23:18:21.603108+0000","last_undegraded":"2024-09-11T23:18:21.603108+0000","last_fullsized":"2024-09-11T23:18:21.603108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583494+0000","last_change":"2024-09-11T23:18:21.583494+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583494+0000","last_undegraded":"2024-09-11T23:18:21.583494+0000","last_fullsized":"2024-09-11T23:18:21.583494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581695+0000","last_change":"2024-09-11T23:18:21.580243+0000","last_active":"2024-09-11T23:18:21.581695+0000","last_peered":"2024-09-11T23:18:21.581695+0000","last_clean":"2024-09-11T23:18:21.581695+0000","last_became_active":"2024-09-11T23:18:21.579532+0000","last_became_peered":"2024-09-11T23:18:21.579532+0000","last_unstale":"2024-09-11T23:18:21.581695+0000","last_undegraded":"2024-09-11T23:18:21.581695+0000","last_fullsized":"2024-09-11T23:18:21.581695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.586462+0000","last_change":"2024-09-11T23:18:21.586462+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.586462+0000","last_undegraded":"2024-09-11T23:18:21.586462+0000","last_fullsized":"2024-09-11T23:18:21.586462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.601925+0000","last_change":"2024-09-11T23:18:21.601616+0000","last_active":"2024-09-11T23:18:21.601925+0000","last_peered":"2024-09-11T23:18:21.601925+0000","last_clean":"2024-09-11T23:18:21.601925+0000","last_became_active":"2024-09-11T23:18:21.601352+0000","last_became_peered":"2024-09-11T23:18:21.601352+0000","last_unstale":"2024-09-11T23:18:21.601925+0000","last_undegraded":"2024-09-11T23:18:21.601925+0000","last_fullsized":"2024-09-11T23:18:21.601925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575231+0000","last_change":"2024-09-11T23:18:21.575231+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575231+0000","last_undegraded":"2024-09-11T23:18:21.575231+0000","last_fullsized":"2024-09-11T23:18:21.575231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603371+0000","last_change":"2024-09-11T23:18:21.599580+0000","last_active":"2024-09-11T23:18:21.603371+0000","last_peered":"2024-09-11T23:18:21.603371+0000","last_clean":"2024-09-11T23:18:21.603371+0000","last_became_active":"2024-09-11T23:18:21.598795+0000","last_became_peered":"2024-09-11T23:18:21.598795+0000","last_unstale":"2024-09-11T23:18:21.603371+0000","last_undegraded":"2024-09-11T23:18:21.603371+0000","last_fullsized":"2024-09-11T23:18:21.603371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571990+0000","last_change":"2024-09-11T23:18:21.571990+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571990+0000","last_undegraded":"2024-09-11T23:18:21.571990+0000","last_fullsized":"2024-09-11T23:18:21.571990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.599994+0000","last_change":"2024-09-11T23:18:21.590812+0000","last_active":"2024-09-11T23:18:21.599994+0000","last_peered":"2024-09-11T23:18:21.599994+0000","last_clean":"2024-09-11T23:18:21.599994+0000","last_became_active":"2024-09-11T23:18:21.590053+0000","last_became_peered":"2024-09-11T23:18:21.590053+0000","last_unstale":"2024-09-11T23:18:21.599994+0000","last_undegraded":"2024-09-11T23:18:21.599994+0000","last_fullsized":"2024-09-11T23:18:21.599994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:24.137805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571868+0000","last_change":"2024-09-11T23:18:21.571868+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571868+0000","last_undegraded":"2024-09-11T23:18:21.571868+0000","last_fullsized":"2024-09-11T23:18:21.571868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.593347+0000","last_change":"2024-09-11T23:18:21.592958+0000","last_active":"2024-09-11T23:18:21.593347+0000","last_peered":"2024-09-11T23:18:21.593347+0000","last_clean":"2024-09-11T23:18:21.593347+0000","last_became_active":"2024-09-11T23:18:21.592461+0000","last_became_peered":"2024-09-11T23:18:21.592461+0000","last_unstale":"2024-09-11T23:18:21.593347+0000","last_undegraded":"2024-09-11T23:18:21.593347+0000","last_fullsized":"2024-09-11T23:18:21.593347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:59.694150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575042+0000","last_change":"2024-09-11T23:18:21.575042+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575042+0000","last_undegraded":"2024-09-11T23:18:21.575042+0000","last_fullsized":"2024-09-11T23:18:21.575042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581938+0000","last_change":"2024-09-11T23:18:21.580569+0000","last_active":"2024-09-11T23:18:21.581938+0000","last_peered":"2024-09-11T23:18:21.581938+0000","last_clean":"2024-09-11T23:18:21.581938+0000","last_became_active":"2024-09-11T23:18:21.580129+0000","last_became_peered":"2024-09-11T23:18:21.580129+0000","last_unstale":"2024-09-11T23:18:21.581938+0000","last_undegraded":"2024-09-11T23:18:21.581938+0000","last_fullsized":"2024-09-11T23:18:21.581938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:21.999989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574508+0000","last_change":"2024-09-11T23:18:21.574508+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574508+0000","last_undegraded":"2024-09-11T23:18:21.574508+0000","last_fullsized":"2024-09-11T23:18:21.574508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.584390+0000","last_change":"2024-09-11T23:18:21.582981+0000","last_active":"2024-09-11T23:18:21.584390+0000","last_peered":"2024-09-11T23:18:21.584390+0000","last_clean":"2024-09-11T23:18:21.584390+0000","last_became_active":"2024-09-11T23:18:21.582670+0000","last_became_peered":"2024-09-11T23:18:21.582670+0000","last_unstale":"2024-09-11T23:18:21.584390+0000","last_undegraded":"2024-09-11T23:18:21.584390+0000","last_fullsized":"2024-09-11T23:18:21.584390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:09.147103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576159+0000","last_change":"2024-09-11T23:18:21.576159+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576159+0000","last_undegraded":"2024-09-11T23:18:21.576159+0000","last_fullsized":"2024-09-11T23:18:21.576159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604305+0000","last_change":"2024-09-11T23:18:21.603816+0000","last_active":"2024-09-11T23:18:21.604305+0000","last_peered":"2024-09-11T23:18:21.604305+0000","last_clean":"2024-09-11T23:18:21.604305+0000","last_became_active":"2024-09-11T23:18:21.603447+0000","last_became_peered":"2024-09-11T23:18:21.603447+0000","last_unstale":"2024-09-11T23:18:21.604305+0000","last_undegraded":"2024-09-11T23:18:21.604305+0000","last_fullsized":"2024-09-11T23:18:21.604305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:05.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.585339+0000","last_change":"2024-09-11T23:18:21.585339+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.585339+0000","last_undegraded":"2024-09-11T23:18:21.585339+0000","last_fullsized":"2024-09-11T23:18:21.585339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604284+0000","last_change":"2024-09-11T23:18:21.603657+0000","last_active":"2024-09-11T23:18:21.604284+0000","last_peered":"2024-09-11T23:18:21.604284+0000","last_clean":"2024-09-11T23:18:21.604284+0000","last_became_active":"2024-09-11T23:18:21.603317+0000","last_became_peered":"2024-09-11T23:18:21.603317+0000","last_unstale":"2024-09-11T23:18:21.604284+0000","last_undegraded":"2024-09-11T23:18:21.604284+0000","last_fullsized":"2024-09-11T23:18:21.604284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:21.029059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577647+0000","last_change":"2024-09-11T23:18:21.577647+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577647+0000","last_undegraded":"2024-09-11T23:18:21.577647+0000","last_fullsized":"2024-09-11T23:18:21.577647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605048+0000","last_change":"2024-09-11T23:18:21.597127+0000","last_active":"2024-09-11T23:18:21.605048+0000","last_peered":"2024-09-11T23:18:21.605048+0000","last_clean":"2024-09-11T23:18:21.605048+0000","last_became_active":"2024-09-11T23:18:21.596156+0000","last_became_peered":"2024-09-11T23:18:21.596156+0000","last_unstale":"2024-09-11T23:18:21.605048+0000","last_undegraded":"2024-09-11T23:18:21.605048+0000","last_fullsized":"2024-09-11T23:18:21.605048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580959+0000","last_change":"2024-09-11T23:18:21.580959+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580959+0000","last_undegraded":"2024-09-11T23:18:21.580959+0000","last_fullsized":"2024-09-11T23:18:21.580959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.582034+0000","last_change":"2024-09-11T23:18:21.580858+0000","last_active":"2024-09-11T23:18:21.582034+0000","last_peered":"2024-09-11T23:18:21.582034+0000","last_clean":"2024-09-11T23:18:21.582034+0000","last_became_active":"2024-09-11T23:18:21.580498+0000","last_became_peered":"2024-09-11T23:18:21.580498+0000","last_unstale":"2024-09-11T23:18:21.582034+0000","last_undegraded":"2024-09-11T23:18:21.582034+0000","last_fullsized":"2024-09-11T23:18:21.582034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576434+0000","last_change":"2024-09-11T23:18:21.576434+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576434+0000","last_undegraded":"2024-09-11T23:18:21.576434+0000","last_fullsized":"2024-09-11T23:18:21.576434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606568+0000","last_change":"2024-09-11T23:18:21.600773+0000","last_active":"2024-09-11T23:18:21.606568+0000","last_peered":"2024-09-11T23:18:21.606568+0000","last_clean":"2024-09-11T23:18:21.606568+0000","last_became_active":"2024-09-11T23:18:21.600084+0000","last_became_peered":"2024-09-11T23:18:21.600084+0000","last_unstale":"2024-09-11T23:18:21.606568+0000","last_undegraded":"2024-09-11T23:18:21.606568+0000","last_fullsized":"2024-09-11T23:18:21.606568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572760+0000","last_change":"2024-09-11T23:18:21.572760+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572760+0000","last_undegraded":"2024-09-11T23:18:21.572760+0000","last_fullsized":"2024-09-11T23:18:21.572760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608519+0000","last_change":"2024-09-11T23:18:21.605831+0000","last_active":"2024-09-11T23:18:21.608519+0000","last_peered":"2024-09-11T23:18:21.608519+0000","last_clean":"2024-09-11T23:18:21.608519+0000","last_became_active":"2024-09-11T23:18:21.604947+0000","last_became_peered":"2024-09-11T23:18:21.604947+0000","last_unstale":"2024-09-11T23:18:21.608519+0000","last_undegraded":"2024-09-11T23:18:21.608519+0000","last_fullsized":"2024-09-11T23:18:21.608519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588889+0000","last_change":"2024-09-11T23:18:21.588889+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588889+0000","last_undegraded":"2024-09-11T23:18:21.588889+0000","last_fullsized":"2024-09-11T23:18:21.588889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614412+0000","last_change":"2024-09-11T23:18:21.610589+0000","last_active":"2024-09-11T23:18:21.614412+0000","last_peered":"2024-09-11T23:18:21.614412+0000","last_clean":"2024-09-11T23:18:21.614412+0000","last_became_active":"2024-09-11T23:18:21.604520+0000","last_became_peered":"2024-09-11T23:18:21.604520+0000","last_unstale":"2024-09-11T23:18:21.614412+0000","last_undegraded":"2024-09-11T23:18:21.614412+0000","last_fullsized":"2024-09-11T23:18:21.614412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:40.792715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583357+0000","last_change":"2024-09-11T23:18:21.583357+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583357+0000","last_undegraded":"2024-09-11T23:18:21.583357+0000","last_fullsized":"2024-09-11T23:18:21.583357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581983+0000","last_change":"2024-09-11T23:18:21.580668+0000","last_active":"2024-09-11T23:18:21.581983+0000","last_peered":"2024-09-11T23:18:21.581983+0000","last_clean":"2024-09-11T23:18:21.581983+0000","last_became_active":"2024-09-11T23:18:21.580346+0000","last_became_peered":"2024-09-11T23:18:21.580346+0000","last_unstale":"2024-09-11T23:18:21.581983+0000","last_undegraded":"2024-09-11T23:18:21.581983+0000","last_fullsized":"2024-09-11T23:18:21.581983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:26.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570640+0000","last_change":"2024-09-11T23:18:21.570640+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570640+0000","last_undegraded":"2024-09-11T23:18:21.570640+0000","last_fullsized":"2024-09-11T23:18:21.570640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614502+0000","last_change":"2024-09-11T23:18:21.610976+0000","last_active":"2024-09-11T23:18:21.614502+0000","last_peered":"2024-09-11T23:18:21.614502+0000","last_clean":"2024-09-11T23:18:21.614502+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.614502+0000","last_undegraded":"2024-09-11T23:18:21.614502+0000","last_fullsized":"2024-09-11T23:18:21.614502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:33.389328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570512+0000","last_change":"2024-09-11T23:18:21.570512+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570512+0000","last_undegraded":"2024-09-11T23:18:21.570512+0000","last_fullsized":"2024-09-11T23:18:21.570512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.583531+0000","last_change":"2024-09-11T23:18:21.582739+0000","last_active":"2024-09-11T23:18:21.583531+0000","last_peered":"2024-09-11T23:18:21.583531+0000","last_clean":"2024-09-11T23:18:21.583531+0000","last_became_active":"2024-09-11T23:18:21.582400+0000","last_became_peered":"2024-09-11T23:18:21.582400+0000","last_unstale":"2024-09-11T23:18:21.583531+0000","last_undegraded":"2024-09-11T23:18:21.583531+0000","last_fullsized":"2024-09-11T23:18:21.583531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.837002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573245+0000","last_change":"2024-09-11T23:18:21.573245+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573245+0000","last_undegraded":"2024-09-11T23:18:21.573245+0000","last_fullsized":"2024-09-11T23:18:21.573245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604294+0000","last_change":"2024-09-11T23:18:21.603704+0000","last_active":"2024-09-11T23:18:21.604294+0000","last_peered":"2024-09-11T23:18:21.604294+0000","last_clean":"2024-09-11T23:18:21.604294+0000","last_became_active":"2024-09-11T23:18:21.603309+0000","last_became_peered":"2024-09-11T23:18:21.603309+0000","last_unstale":"2024-09-11T23:18:21.604294+0000","last_undegraded":"2024-09-11T23:18:21.604294+0000","last_fullsized":"2024-09-11T23:18:21.604294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:39.912926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.577549+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:18:21.577549+0000","last_peered":"2024-09-11T23:18:21.577549+0000","last_clean":"2024-09-11T23:18:21.577549+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:18:21.577549+0000","last_undegraded":"2024-09-11T23:18:21.577549+0000","last_fullsized":"2024-09-11T23:18:21.577549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":892928,"data_stored":405241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36212,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335628,"statfs":{"total":96636764160,"available":96599683072,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:26.606 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:26.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.757+0000 7f275ca70640 1 Processor -- start 2024-09-11T23:18:26.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.757+0000 7f275ca70640 1 -- start start 2024-09-11T23:18:26.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275ca70640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 0x7f275806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275ca70640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275806ee50 con 0x7f2758073e60 2024-09-11T23:18:26.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275ca70640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275806f130 con 0x7f275806fef0 2024-09-11T23:18:26.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275ca70640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f275806f410 con 0x7f27580b4460 2024-09-11T23:18:26.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275659c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2758073e60 0x7f275815b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44642/0 (socket says 172.21.15.94:44642) 2024-09-11T23:18:26.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275659c640 1 -- 172.21.15.94:0/1304854781 learned_addr learned my addr 172.21.15.94:0/1304854781 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571292922 0 0) 0x7f275806ee50 con 0x7f2758073e60 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2740003450 con 0x7f2758073e60 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2756d9d640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 0x7f275806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4286589991 0 0) 0x7f2740003450 con 0x7f2758073e60 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 msgr2=0x7f275806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 0x7f275806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 >> v1:172.21.15.155:6789/0 conn(0x7f275806fef0 legacy=0x7f27580b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275806f6f0 con 0x7f2758073e60 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f2748001680 con 0x7f2758073e60 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 >> v1:172.21.15.94:6789/0 conn(0x7f2758073e60 legacy=0x7f275815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740003ae0 0x7f2740003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2740008860 0x7f274000acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 0x7f274000d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f275806f410 con 0x7f2740008860 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f274000dd30 con 0x7f2740003ae0 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f274000df30 con 0x7f27580b4460 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2755d9b640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2740008860 0x7f274000acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275659c640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740003ae0 0x7f2740003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2756d9d640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 0x7f274000d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2755d9b640 1 -- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 msgr2=0x7f274000d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2755d9b640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b4460 0x7f274000d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2755d9b640 1 -- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740003ae0 msgr2=0x7f2740003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:26.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2755d9b640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740003ae0 0x7f2740003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f2755d9b640 1 -- 172.21.15.94:0/1304854781 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2740003450 con 0x7f2740008860 2024-09-11T23:18:26.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.761+0000 7f275659c640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740003ae0 0x7f2740003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2740008860 0x7f274000acb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f274c001780 tx=0x7f274c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41189987e7ae0109 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0013a0 con 0x7f2740008860 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c0052f0 con 0x7f2740008860 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275559a640 1 -- 172.21.15.94:0/1304854781 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c003840 con 0x7f2740008860 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- 172.21.15.94:0/1304854781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2740008860 msgr2=0x7f274000acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 --2- 172.21.15.94:0/1304854781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2740008860 0x7f274000acb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f274c001780 tx=0x7f274c01c420 comp rx=0 tx=0).stop 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2756d9d640 1 -- 172.21.15.94:0/1304854781 reap_dead start 2024-09-11T23:18:26.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- 172.21.15.94:0/1304854781 shutdown_connections 2024-09-11T23:18:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- 172.21.15.94:0/1304854781 >> 172.21.15.94:0/1304854781 conn(0x7f27580b1f90 msgr2=0x7f27580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- 172.21.15.94:0/1304854781 shutdown_connections 2024-09-11T23:18:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- 172.21.15.94:0/1304854781 wait complete. 2024-09-11T23:18:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 Processor -- start 2024-09-11T23:18:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- start start 2024-09-11T23:18:26.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740008860 0x7f2758153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2758150e70 0x7f27581512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b0ea0 0x7f27580b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f275806eb10 con 0x7f2758150e70 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f275806e990 con 0x7f2740008860 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275ca70640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2758165790 con 0x7f27580b0ea0 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2758150e70 0x7f27581512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2758150e70 0x7f27581512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57382/0 (socket says 172.21.15.94:57382) 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 -- 172.21.15.94:0/3086380494 learned_addr learned my addr 172.21.15.94:0/3086380494 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2756d9d640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b0ea0 0x7f27580b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275659c640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740008860 0x7f2758153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 -- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b0ea0 msgr2=0x7f27580b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b0ea0 0x7f27580b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 -- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740008860 msgr2=0x7f2758153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740008860 0x7f2758153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 -- 172.21.15.94:0/3086380494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2758151830 con 0x7f2758150e70 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f275659c640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740008860 0x7f2758153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2756d9d640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b0ea0 0x7f27580b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.765+0000 7f2755d9b640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2758150e70 0x7f27581512f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f274c005040 tx=0x7f2740003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f2746ffd640 1 -- 172.21.15.94:0/3086380494 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c007a40 con 0x7f2758150e70 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f2746ffd640 1 -- 172.21.15.94:0/3086380494 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c0bb070 con 0x7f2758150e70 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27580b1890 con 0x7f2758150e70 2024-09-11T23:18:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f2746ffd640 1 -- 172.21.15.94:0/3086380494 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0013a0 con 0x7f2758150e70 2024-09-11T23:18:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27580afde0 con 0x7f2758150e70 2024-09-11T23:18:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27580b3d50 con 0x7f2758150e70 2024-09-11T23:18:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f2746ffd640 1 -- 172.21.15.94:0/3086380494 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f274c0b4040 con 0x7f2758150e70 2024-09-11T23:18:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f2746ffd640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27380678f0 0x7f2738069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f2746ffd640 1 -- 172.21.15.94:0/3086380494 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f274c11fdb0 con 0x7f2758150e70 2024-09-11T23:18:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f275659c640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27380678f0 0x7f2738069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.769+0000 7f275659c640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27380678f0 0x7f2738069db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2748001930 tx=0x7f2748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:26.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.773+0000 7f2746ffd640 1 -- 172.21.15.94:0/3086380494 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2758151830 con 0x7f2758150e70 2024-09-11T23:18:26.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.929+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f275806ced0 con 0x7f27380678f0 2024-09-11T23:18:26.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.945+0000 7f2746ffd640 1 -- 172.21.15.94:0/3086380494 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246751 (secure 0 0 0) 0x7f275806ced0 con 0x7f27380678f0 2024-09-11T23:18:26.952 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:18:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27380678f0 msgr2=0x7f2738069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27380678f0 0x7f2738069db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2748001930 tx=0x7f2748009040 comp rx=0 tx=0).stop 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2758150e70 msgr2=0x7f27581512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2758150e70 0x7f27581512f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f274c005040 tx=0x7f2740003740 comp rx=0 tx=0).stop 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 shutdown_connections 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27580b0ea0 0x7f27580b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f27380678f0 0x7f2738069db0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2758150e70 0x7f27581512f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 --2- 172.21.15.94:0/3086380494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2740008860 0x7f2758153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 >> 172.21.15.94:0/3086380494 conn(0x7f27580b1f90 msgr2=0x7f2758154790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 shutdown_connections 2024-09-11T23:18:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:26.949+0000 7f275ca70640 1 -- 172.21.15.94:0/3086380494 wait complete. 2024-09-11T23:18:26.968 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-11T23:18:26.033727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278408,"kb_used_data":8052,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754696312,"statfs":{"total":773094113280,"available":772809023488,"internally_reserved":0,"allocated":8245248,"data_stored":4375995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.478190"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575141+0000","last_change":"2024-09-11T23:18:21.575141+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575141+0000","last_undegraded":"2024-09-11T23:18:21.575141+0000","last_fullsized":"2024-09-11T23:18:21.575141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576577+0000","last_change":"2024-09-11T23:18:21.576577+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576577+0000","last_undegraded":"2024-09-11T23:18:21.576577+0000","last_fullsized":"2024-09-11T23:18:21.576577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572276+0000","last_change":"2024-09-11T23:18:21.572276+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572276+0000","last_undegraded":"2024-09-11T23:18:21.572276+0000","last_fullsized":"2024-09-11T23:18:21.572276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.592440+0000","last_change":"2024-09-11T23:18:21.592440+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.592440+0000","last_undegraded":"2024-09-11T23:18:21.592440+0000","last_fullsized":"2024-09-11T23:18:21.592440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576579+0000","last_change":"2024-09-11T23:18:21.576579+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576579+0000","last_undegraded":"2024-09-11T23:18:21.576579+0000","last_fullsized":"2024-09-11T23:18:21.576579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577146+0000","last_change":"2024-09-11T23:18:21.577146+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577146+0000","last_undegraded":"2024-09-11T23:18:21.577146+0000","last_fullsized":"2024-09-11T23:18:21.577146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583012+0000","last_change":"2024-09-11T23:18:21.583012+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583012+0000","last_undegraded":"2024-09-11T23:18:21.583012+0000","last_fullsized":"2024-09-11T23:18:21.583012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573043+0000","last_change":"2024-09-11T23:18:21.573043+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573043+0000","last_undegraded":"2024-09-11T23:18:21.573043+0000","last_fullsized":"2024-09-11T23:18:21.573043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578207+0000","last_change":"2024-09-11T23:18:21.578207+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578207+0000","last_undegraded":"2024-09-11T23:18:21.578207+0000","last_fullsized":"2024-09-11T23:18:21.578207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583855+0000","last_change":"2024-09-11T23:18:21.583855+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583855+0000","last_undegraded":"2024-09-11T23:18:21.583855+0000","last_fullsized":"2024-09-11T23:18:21.583855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577081+0000","last_change":"2024-09-11T23:18:21.577081+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577081+0000","last_undegraded":"2024-09-11T23:18:21.577081+0000","last_fullsized":"2024-09-11T23:18:21.577081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.591435+0000","last_change":"2024-09-11T23:18:21.591435+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.591435+0000","last_undegraded":"2024-09-11T23:18:21.591435+0000","last_fullsized":"2024-09-11T23:18:21.591435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574657+0000","last_change":"2024-09-11T23:18:21.574657+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574657+0000","last_undegraded":"2024-09-11T23:18:21.574657+0000","last_fullsized":"2024-09-11T23:18:21.574657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576614+0000","last_change":"2024-09-11T23:18:21.576614+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576614+0000","last_undegraded":"2024-09-11T23:18:21.576614+0000","last_fullsized":"2024-09-11T23:18:21.576614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576743+0000","last_change":"2024-09-11T23:18:21.576743+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576743+0000","last_undegraded":"2024-09-11T23:18:21.576743+0000","last_fullsized":"2024-09-11T23:18:21.576743+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574980+0000","last_change":"2024-09-11T23:18:21.574980+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574980+0000","last_undegraded":"2024-09-11T23:18:21.574980+0000","last_fullsized":"2024-09-11T23:18:21.574980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573199+0000","last_change":"2024-09-11T23:18:21.573199+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573199+0000","last_undegraded":"2024-09-11T23:18:21.573199+0000","last_fullsized":"2024-09-11T23:18:21.573199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572306+0000","last_change":"2024-09-11T23:18:21.572306+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572306+0000","last_undegraded":"2024-09-11T23:18:21.572306+0000","last_fullsized":"2024-09-11T23:18:21.572306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574480+0000","last_change":"2024-09-11T23:18:21.574480+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574480+0000","last_undegraded":"2024-09-11T23:18:21.574480+0000","last_fullsized":"2024-09-11T23:18:21.574480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574942+0000","last_change":"2024-09-11T23:18:21.574942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574942+0000","last_undegraded":"2024-09-11T23:18:21.574942+0000","last_fullsized":"2024-09-11T23:18:21.574942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580987+0000","last_change":"2024-09-11T23:18:21.580987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580987+0000","last_undegraded":"2024-09-11T23:18:21.580987+0000","last_fullsized":"2024-09-11T23:18:21.580987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573853+0000","last_change":"2024-09-11T23:18:21.573853+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573853+0000","last_undegraded":"2024-09-11T23:18:21.573853+0000","last_fullsized":"2024-09-11T23:18:21.573853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576356+0000","last_change":"2024-09-11T23:18:21.576356+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576356+0000","last_undegraded":"2024-09-11T23:18:21.576356+0000","last_fullsized":"2024-09-11T23:18:21.576356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573787+0000","last_change":"2024-09-11T23:18:21.573787+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573787+0000","last_undegraded":"2024-09-11T23:18:21.573787+0000","last_fullsized":"2024-09-11T23:18:21.573787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573987+0000","last_change":"2024-09-11T23:18:21.573987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573987+0000","last_undegraded":"2024-09-11T23:18:21.573987+0000","last_fullsized":"2024-09-11T23:18:21.573987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580841+0000","last_change":"2024-09-11T23:18:21.580841+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580841+0000","last_undegraded":"2024-09-11T23:18:21.580841+0000","last_fullsized":"2024-09-11T23:18:21.580841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574395+0000","last_change":"2024-09-11T23:18:21.574395+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574395+0000","last_undegraded":"2024-09-11T23:18:21.574395+0000","last_fullsized":"2024-09-11T23:18:21.574395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574362+0000","last_change":"2024-09-11T23:18:21.574362+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574362+0000","last_undegraded":"2024-09-11T23:18:21.574362+0000","last_fullsized":"2024-09-11T23:18:21.574362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573182+0000","last_change":"2024-09-11T23:18:21.573182+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573182+0000","last_undegraded":"2024-09-11T23:18:21.573182+0000","last_fullsized":"2024-09-11T23:18:21.573182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572487+0000","last_change":"2024-09-11T23:18:21.572487+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572487+0000","last_undegraded":"2024-09-11T23:18:21.572487+0000","last_fullsized":"2024-09-11T23:18:21.572487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570942+0000","last_change":"2024-09-11T23:18:21.570942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570942+0000","last_undegraded":"2024-09-11T23:18:21.570942+0000","last_fullsized":"2024-09-11T23:18:21.570942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572484+0000","last_change":"2024-09-11T23:18:21.572484+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572484+0000","last_undegraded":"2024-09-11T23:18:21.572484+0000","last_fullsized":"2024-09-11T23:18:21.572484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571495+0000","last_change":"2024-09-11T23:18:21.571495+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571495+0000","last_undegraded":"2024-09-11T23:18:21.571495+0000","last_fullsized":"2024-09-11T23:18:21.571495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581883+0000","last_change":"2024-09-11T23:18:21.580890+0000","last_active":"2024-09-11T23:18:21.581883+0000","last_peered":"2024-09-11T23:18:21.581883+0000","last_clean":"2024-09-11T23:18:21.581883+0000","last_became_active":"2024-09-11T23:18:21.580558+0000","last_became_peered":"2024-09-11T23:18:21.580558+0000","last_unstale":"2024-09-11T23:18:21.581883+0000","last_undegraded":"2024-09-11T23:18:21.581883+0000","last_fullsized":"2024-09-11T23:18:21.581883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:59.631938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576195+0000","last_change":"2024-09-11T23:18:21.576195+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576195+0000","last_undegraded":"2024-09-11T23:18:21.576195+0000","last_fullsized":"2024-09-11T23:18:21.576195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607917+0000","last_change":"2024-09-11T23:18:21.605242+0000","last_active":"2024-09-11T23:18:21.607917+0000","last_peered":"2024-09-11T23:18:21.607917+0000","last_clean":"2024-09-11T23:18:21.607917+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.607917+0000","last_undegraded":"2024-09-11T23:18:21.607917+0000","last_fullsized":"2024-09-11T23:18:21.607917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577727+0000","last_change":"2024-09-11T23:18:21.577727+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577727+0000","last_undegraded":"2024-09-11T23:18:21.577727+0000","last_fullsized":"2024-09-11T23:18:21.577727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606516+0000","last_change":"2024-09-11T23:18:21.600136+0000","last_active":"2024-09-11T23:18:21.606516+0000","last_peered":"2024-09-11T23:18:21.606516+0000","last_clean":"2024-09-11T23:18:21.606516+0000","last_became_active":"2024-09-11T23:18:21.597138+0000","last_became_peered":"2024-09-11T23:18:21.597138+0000","last_unstale":"2024-09-11T23:18:21.606516+0000","last_undegraded":"2024-09-11T23:18:21.606516+0000","last_fullsized":"2024-09-11T23:18:21.606516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580104+0000","last_change":"2024-09-11T23:18:21.580104+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580104+0000","last_undegraded":"2024-09-11T23:18:21.580104+0000","last_fullsized":"2024-09-11T23:18:21.580104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614398+0000","last_change":"2024-09-11T23:18:21.610459+0000","last_active":"2024-09-11T23:18:21.614398+0000","last_peered":"2024-09-11T23:18:21.614398+0000","last_clean":"2024-09-11T23:18:21.614398+0000","last_became_active":"2024-09-11T23:18:21.604546+0000","last_became_peered":"2024-09-11T23:18:21.604546+0000","last_unstale":"2024-09-11T23:18:21.614398+0000","last_undegraded":"2024-09-11T23:18:21.614398+0000","last_fullsized":"2024-09-11T23:18:21.614398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:20.492447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575035+0000","last_change":"2024-09-11T23:18:21.575035+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575035+0000","last_undegraded":"2024-09-11T23:18:21.575035+0000","last_fullsized":"2024-09-11T23:18:21.575035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602182+0000","last_change":"2024-09-11T23:18:21.600764+0000","last_active":"2024-09-11T23:18:21.602182+0000","last_peered":"2024-09-11T23:18:21.602182+0000","last_clean":"2024-09-11T23:18:21.602182+0000","last_became_active":"2024-09-11T23:18:21.600043+0000","last_became_peered":"2024-09-11T23:18:21.600043+0000","last_unstale":"2024-09-11T23:18:21.602182+0000","last_undegraded":"2024-09-11T23:18:21.602182+0000","last_fullsized":"2024-09-11T23:18:21.602182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:37.130140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573003+0000","last_change":"2024-09-11T23:18:21.573003+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573003+0000","last_undegraded":"2024-09-11T23:18:21.573003+0000","last_fullsized":"2024-09-11T23:18:21.573003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605130+0000","last_change":"2024-09-11T23:18:21.597322+0000","last_active":"2024-09-11T23:18:21.605130+0000","last_peered":"2024-09-11T23:18:21.605130+0000","last_clean":"2024-09-11T23:18:21.605130+0000","last_became_active":"2024-09-11T23:18:21.596479+0000","last_became_peered":"2024-09-11T23:18:21.596479+0000","last_unstale":"2024-09-11T23:18:21.605130+0000","last_undegraded":"2024-09-11T23:18:21.605130+0000","last_fullsized":"2024-09-11T23:18:21.605130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578520+0000","last_change":"2024-09-11T23:18:21.578520+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578520+0000","last_undegraded":"2024-09-11T23:18:21.578520+0000","last_fullsized":"2024-09-11T23:18:21.578520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.598269+0000","last_change":"2024-09-11T23:18:21.597750+0000","last_active":"2024-09-11T23:18:21.598269+0000","last_peered":"2024-09-11T23:18:21.598269+0000","last_clean":"2024-09-11T23:18:21.598269+0000","last_became_active":"2024-09-11T23:18:21.597419+0000","last_became_peered":"2024-09-11T23:18:21.597419+0000","last_unstale":"2024-09-11T23:18:21.598269+0000","last_undegraded":"2024-09-11T23:18:21.598269+0000","last_fullsized":"2024-09-11T23:18:21.598269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.587465+0000","last_change":"2024-09-11T23:18:21.587465+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.587465+0000","last_undegraded":"2024-09-11T23:18:21.587465+0000","last_fullsized":"2024-09-11T23:18:21.587465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602352+0000","last_change":"2024-09-11T23:18:21.601997+0000","last_active":"2024-09-11T23:18:21.602352+0000","last_peered":"2024-09-11T23:18:21.602352+0000","last_clean":"2024-09-11T23:18:21.602352+0000","last_became_active":"2024-09-11T23:18:21.601557+0000","last_became_peered":"2024-09-11T23:18:21.601557+0000","last_unstale":"2024-09-11T23:18:21.602352+0000","last_undegraded":"2024-09-11T23:18:21.602352+0000","last_fullsized":"2024-09-11T23:18:21.602352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:39.744498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572822+0000","last_change":"2024-09-11T23:18:21.572822+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572822+0000","last_undegraded":"2024-09-11T23:18:21.572822+0000","last_fullsized":"2024-09-11T23:18:21.572822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608618+0000","last_change":"2024-09-11T23:18:21.606163+0000","last_active":"2024-09-11T23:18:21.608618+0000","last_peered":"2024-09-11T23:18:21.608618+0000","last_clean":"2024-09-11T23:18:21.608618+0000","last_became_active":"2024-09-11T23:18:21.605050+0000","last_became_peered":"2024-09-11T23:18:21.605050+0000","last_unstale":"2024-09-11T23:18:21.608618+0000","last_undegraded":"2024-09-11T23:18:21.608618+0000","last_fullsized":"2024-09-11T23:18:21.608618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588993+0000","last_change":"2024-09-11T23:18:21.588993+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588993+0000","last_undegraded":"2024-09-11T23:18:21.588993+0000","last_fullsized":"2024-09-11T23:18:21.588993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605321+0000","last_change":"2024-09-11T23:18:21.600933+0000","last_active":"2024-09-11T23:18:21.605321+0000","last_peered":"2024-09-11T23:18:21.605321+0000","last_clean":"2024-09-11T23:18:21.605321+0000","last_became_active":"2024-09-11T23:18:21.600235+0000","last_became_peered":"2024-09-11T23:18:21.600235+0000","last_unstale":"2024-09-11T23:18:21.605321+0000","last_undegraded":"2024-09-11T23:18:21.605321+0000","last_fullsized":"2024-09-11T23:18:21.605321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575987+0000","last_change":"2024-09-11T23:18:21.575987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575987+0000","last_undegraded":"2024-09-11T23:18:21.575987+0000","last_fullsized":"2024-09-11T23:18:21.575987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581754+0000","last_change":"2024-09-11T23:18:21.580034+0000","last_active":"2024-09-11T23:18:21.581754+0000","last_peered":"2024-09-11T23:18:21.581754+0000","last_clean":"2024-09-11T23:18:21.581754+0000","last_became_active":"2024-09-11T23:18:21.579736+0000","last_became_peered":"2024-09-11T23:18:21.579736+0000","last_unstale":"2024-09-11T23:18:21.581754+0000","last_undegraded":"2024-09-11T23:18:21.581754+0000","last_fullsized":"2024-09-11T23:18:21.581754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:04.945467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570534+0000","last_change":"2024-09-11T23:18:21.570534+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570534+0000","last_undegraded":"2024-09-11T23:18:21.570534+0000","last_fullsized":"2024-09-11T23:18:21.570534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.615599+0000","last_change":"2024-09-11T23:18:21.611858+0000","last_active":"2024-09-11T23:18:21.615599+0000","last_peered":"2024-09-11T23:18:21.615599+0000","last_clean":"2024-09-11T23:18:21.615599+0000","last_became_active":"2024-09-11T23:18:21.610397+0000","last_became_peered":"2024-09-11T23:18:21.610397+0000","last_unstale":"2024-09-11T23:18:21.615599+0000","last_undegraded":"2024-09-11T23:18:21.615599+0000","last_fullsized":"2024-09-11T23:18:21.615599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.087713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.581265+0000","last_change":"2024-09-11T23:18:21.581265+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.581265+0000","last_undegraded":"2024-09-11T23:18:21.581265+0000","last_fullsized":"2024-09-11T23:18:21.581265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607776+0000","last_change":"2024-09-11T23:18:21.604083+0000","last_active":"2024-09-11T23:18:21.607776+0000","last_peered":"2024-09-11T23:18:21.607776+0000","last_clean":"2024-09-11T23:18:21.607776+0000","last_became_active":"2024-09-11T23:18:21.603406+0000","last_became_peered":"2024-09-11T23:18:21.603406+0000","last_unstale":"2024-09-11T23:18:21.607776+0000","last_undegraded":"2024-09-11T23:18:21.607776+0000","last_fullsized":"2024-09-11T23:18:21.607776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.590372+0000","last_change":"2024-09-11T23:18:21.590372+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.590372+0000","last_undegraded":"2024-09-11T23:18:21.590372+0000","last_fullsized":"2024-09-11T23:18:21.590372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603108+0000","last_change":"2024-09-11T23:18:21.598505+0000","last_active":"2024-09-11T23:18:21.603108+0000","last_peered":"2024-09-11T23:18:21.603108+0000","last_clean":"2024-09-11T23:18:21.603108+0000","last_became_active":"2024-09-11T23:18:21.597672+0000","last_became_peered":"2024-09-11T23:18:21.597672+0000","last_unstale":"2024-09-11T23:18:21.603108+0000","last_undegraded":"2024-09-11T23:18:21.603108+0000","last_fullsized":"2024-09-11T23:18:21.603108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583494+0000","last_change":"2024-09-11T23:18:21.583494+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583494+0000","last_undegraded":"2024-09-11T23:18:21.583494+0000","last_fullsized":"2024-09-11T23:18:21.583494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581695+0000","last_change":"2024-09-11T23:18:21.580243+0000","last_active":"2024-09-11T23:18:21.581695+0000","last_peered":"2024-09-11T23:18:21.581695+0000","last_clean":"2024-09-11T23:18:21.581695+0000","last_became_active":"2024-09-11T23:18:21.579532+0000","last_became_peered":"2024-09-11T23:18:21.579532+0000","last_unstale":"2024-09-11T23:18:21.581695+0000","last_undegraded":"2024-09-11T23:18:21.581695+0000","last_fullsized":"2024-09-11T23:18:21.581695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.586462+0000","last_change":"2024-09-11T23:18:21.586462+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.586462+0000","last_undegraded":"2024-09-11T23:18:21.586462+0000","last_fullsized":"2024-09-11T23:18:21.586462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.601925+0000","last_change":"2024-09-11T23:18:21.601616+0000","last_active":"2024-09-11T23:18:21.601925+0000","last_peered":"2024-09-11T23:18:21.601925+0000","last_clean":"2024-09-11T23:18:21.601925+0000","last_became_active":"2024-09-11T23:18:21.601352+0000","last_became_peered":"2024-09-11T23:18:21.601352+0000","last_unstale":"2024-09-11T23:18:21.601925+0000","last_undegraded":"2024-09-11T23:18:21.601925+0000","last_fullsized":"2024-09-11T23:18:21.601925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575231+0000","last_change":"2024-09-11T23:18:21.575231+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575231+0000","last_undegraded":"2024-09-11T23:18:21.575231+0000","last_fullsized":"2024-09-11T23:18:21.575231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603371+0000","last_change":"2024-09-11T23:18:21.599580+0000","last_active":"2024-09-11T23:18:21.603371+0000","last_peered":"2024-09-11T23:18:21.603371+0000","last_clean":"2024-09-11T23:18:21.603371+0000","last_became_active":"2024-09-11T23:18:21.598795+0000","last_became_peered":"2024-09-11T23:18:21.598795+0000","last_unstale":"2024-09-11T23:18:21.603371+0000","last_undegraded":"2024-09-11T23:18:21.603371+0000","last_fullsized":"2024-09-11T23:18:21.603371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571990+0000","last_change":"2024-09-11T23:18:21.571990+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571990+0000","last_undegraded":"2024-09-11T23:18:21.571990+0000","last_fullsized":"2024-09-11T23:18:21.571990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.599994+0000","last_change":"2024-09-11T23:18:21.590812+0000","last_active":"2024-09-11T23:18:21.599994+0000","last_peered":"2024-09-11T23:18:21.599994+0000","last_clean":"2024-09-11T23:18:21.599994+0000","last_became_active":"2024-09-11T23:18:21.590053+0000","last_became_peered":"2024-09-11T23:18:21.590053+0000","last_unstale":"2024-09-11T23:18:21.599994+0000","last_undegraded":"2024-09-11T23:18:21.599994+0000","last_fullsized":"2024-09-11T23:18:21.599994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:24.137805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571868+0000","last_change":"2024-09-11T23:18:21.571868+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571868+0000","last_undegraded":"2024-09-11T23:18:21.571868+0000","last_fullsized":"2024-09-11T23:18:21.571868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.593347+0000","last_change":"2024-09-11T23:18:21.592958+0000","last_active":"2024-09-11T23:18:21.593347+0000","last_peered":"2024-09-11T23:18:21.593347+0000","last_clean":"2024-09-11T23:18:21.593347+0000","last_became_active":"2024-09-11T23:18:21.592461+0000","last_became_peered":"2024-09-11T23:18:21.592461+0000","last_unstale":"2024-09-11T23:18:21.593347+0000","last_undegraded":"2024-09-11T23:18:21.593347+0000","last_fullsized":"2024-09-11T23:18:21.593347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:59.694150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575042+0000","last_change":"2024-09-11T23:18:21.575042+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575042+0000","last_undegraded":"2024-09-11T23:18:21.575042+0000","last_fullsized":"2024-09-11T23:18:21.575042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581938+0000","last_change":"2024-09-11T23:18:21.580569+0000","last_active":"2024-09-11T23:18:21.581938+0000","last_peered":"2024-09-11T23:18:21.581938+0000","last_clean":"2024-09-11T23:18:21.581938+0000","last_became_active":"2024-09-11T23:18:21.580129+0000","last_became_peered":"2024-09-11T23:18:21.580129+0000","last_unstale":"2024-09-11T23:18:21.581938+0000","last_undegraded":"2024-09-11T23:18:21.581938+0000","last_fullsized":"2024-09-11T23:18:21.581938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:21.999989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574508+0000","last_change":"2024-09-11T23:18:21.574508+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574508+0000","last_undegraded":"2024-09-11T23:18:21.574508+0000","last_fullsized":"2024-09-11T23:18:21.574508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.584390+0000","last_change":"2024-09-11T23:18:21.582981+0000","last_active":"2024-09-11T23:18:21.584390+0000","last_peered":"2024-09-11T23:18:21.584390+0000","last_clean":"2024-09-11T23:18:21.584390+0000","last_became_active":"2024-09-11T23:18:21.582670+0000","last_became_peered":"2024-09-11T23:18:21.582670+0000","last_unstale":"2024-09-11T23:18:21.584390+0000","last_undegraded":"2024-09-11T23:18:21.584390+0000","last_fullsized":"2024-09-11T23:18:21.584390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:09.147103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576159+0000","last_change":"2024-09-11T23:18:21.576159+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576159+0000","last_undegraded":"2024-09-11T23:18:21.576159+0000","last_fullsized":"2024-09-11T23:18:21.576159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604305+0000","last_change":"2024-09-11T23:18:21.603816+0000","last_active":"2024-09-11T23:18:21.604305+0000","last_peered":"2024-09-11T23:18:21.604305+0000","last_clean":"2024-09-11T23:18:21.604305+0000","last_became_active":"2024-09-11T23:18:21.603447+0000","last_became_peered":"2024-09-11T23:18:21.603447+0000","last_unstale":"2024-09-11T23:18:21.604305+0000","last_undegraded":"2024-09-11T23:18:21.604305+0000","last_fullsized":"2024-09-11T23:18:21.604305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:05.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.585339+0000","last_change":"2024-09-11T23:18:21.585339+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.585339+0000","last_undegraded":"2024-09-11T23:18:21.585339+0000","last_fullsized":"2024-09-11T23:18:21.585339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604284+0000","last_change":"2024-09-11T23:18:21.603657+0000","last_active":"2024-09-11T23:18:21.604284+0000","last_peered":"2024-09-11T23:18:21.604284+0000","last_clean":"2024-09-11T23:18:21.604284+0000","last_became_active":"2024-09-11T23:18:21.603317+0000","last_became_peered":"2024-09-11T23:18:21.603317+0000","last_unstale":"2024-09-11T23:18:21.604284+0000","last_undegraded":"2024-09-11T23:18:21.604284+0000","last_fullsized":"2024-09-11T23:18:21.604284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:21.029059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577647+0000","last_change":"2024-09-11T23:18:21.577647+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577647+0000","last_undegraded":"2024-09-11T23:18:21.577647+0000","last_fullsized":"2024-09-11T23:18:21.577647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605048+0000","last_change":"2024-09-11T23:18:21.597127+0000","last_active":"2024-09-11T23:18:21.605048+0000","last_peered":"2024-09-11T23:18:21.605048+0000","last_clean":"2024-09-11T23:18:21.605048+0000","last_became_active":"2024-09-11T23:18:21.596156+0000","last_became_peered":"2024-09-11T23:18:21.596156+0000","last_unstale":"2024-09-11T23:18:21.605048+0000","last_undegraded":"2024-09-11T23:18:21.605048+0000","last_fullsized":"2024-09-11T23:18:21.605048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580959+0000","last_change":"2024-09-11T23:18:21.580959+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580959+0000","last_undegraded":"2024-09-11T23:18:21.580959+0000","last_fullsized":"2024-09-11T23:18:21.580959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.582034+0000","last_change":"2024-09-11T23:18:21.580858+0000","last_active":"2024-09-11T23:18:21.582034+0000","last_peered":"2024-09-11T23:18:21.582034+0000","last_clean":"2024-09-11T23:18:21.582034+0000","last_became_active":"2024-09-11T23:18:21.580498+0000","last_became_peered":"2024-09-11T23:18:21.580498+0000","last_unstale":"2024-09-11T23:18:21.582034+0000","last_undegraded":"2024-09-11T23:18:21.582034+0000","last_fullsized":"2024-09-11T23:18:21.582034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576434+0000","last_change":"2024-09-11T23:18:21.576434+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576434+0000","last_undegraded":"2024-09-11T23:18:21.576434+0000","last_fullsized":"2024-09-11T23:18:21.576434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606568+0000","last_change":"2024-09-11T23:18:21.600773+0000","last_active":"2024-09-11T23:18:21.606568+0000","last_peered":"2024-09-11T23:18:21.606568+0000","last_clean":"2024-09-11T23:18:21.606568+0000","last_became_active":"2024-09-11T23:18:21.600084+0000","last_became_peered":"2024-09-11T23:18:21.600084+0000","last_unstale":"2024-09-11T23:18:21.606568+0000","last_undegraded":"2024-09-11T23:18:21.606568+0000","last_fullsized":"2024-09-11T23:18:21.606568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572760+0000","last_change":"2024-09-11T23:18:21.572760+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572760+0000","last_undegraded":"2024-09-11T23:18:21.572760+0000","last_fullsized":"2024-09-11T23:18:21.572760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608519+0000","last_change":"2024-09-11T23:18:21.605831+0000","last_active":"2024-09-11T23:18:21.608519+0000","last_peered":"2024-09-11T23:18:21.608519+0000","last_clean":"2024-09-11T23:18:21.608519+0000","last_became_active":"2024-09-11T23:18:21.604947+0000","last_became_peered":"2024-09-11T23:18:21.604947+0000","last_unstale":"2024-09-11T23:18:21.608519+0000","last_undegraded":"2024-09-11T23:18:21.608519+0000","last_fullsized":"2024-09-11T23:18:21.608519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588889+0000","last_change":"2024-09-11T23:18:21.588889+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588889+0000","last_undegraded":"2024-09-11T23:18:21.588889+0000","last_fullsized":"2024-09-11T23:18:21.588889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614412+0000","last_change":"2024-09-11T23:18:21.610589+0000","last_active":"2024-09-11T23:18:21.614412+0000","last_peered":"2024-09-11T23:18:21.614412+0000","last_clean":"2024-09-11T23:18:21.614412+0000","last_became_active":"2024-09-11T23:18:21.604520+0000","last_became_peered":"2024-09-11T23:18:21.604520+0000","last_unstale":"2024-09-11T23:18:21.614412+0000","last_undegraded":"2024-09-11T23:18:21.614412+0000","last_fullsized":"2024-09-11T23:18:21.614412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:40.792715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583357+0000","last_change":"2024-09-11T23:18:21.583357+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583357+0000","last_undegraded":"2024-09-11T23:18:21.583357+0000","last_fullsized":"2024-09-11T23:18:21.583357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581983+0000","last_change":"2024-09-11T23:18:21.580668+0000","last_active":"2024-09-11T23:18:21.581983+0000","last_peered":"2024-09-11T23:18:21.581983+0000","last_clean":"2024-09-11T23:18:21.581983+0000","last_became_active":"2024-09-11T23:18:21.580346+0000","last_became_peered":"2024-09-11T23:18:21.580346+0000","last_unstale":"2024-09-11T23:18:21.581983+0000","last_undegraded":"2024-09-11T23:18:21.581983+0000","last_fullsized":"2024-09-11T23:18:21.581983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:26.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570640+0000","last_change":"2024-09-11T23:18:21.570640+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570640+0000","last_undegraded":"2024-09-11T23:18:21.570640+0000","last_fullsized":"2024-09-11T23:18:21.570640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614502+0000","last_change":"2024-09-11T23:18:21.610976+0000","last_active":"2024-09-11T23:18:21.614502+0000","last_peered":"2024-09-11T23:18:21.614502+0000","last_clean":"2024-09-11T23:18:21.614502+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.614502+0000","last_undegraded":"2024-09-11T23:18:21.614502+0000","last_fullsized":"2024-09-11T23:18:21.614502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:33.389328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570512+0000","last_change":"2024-09-11T23:18:21.570512+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570512+0000","last_undegraded":"2024-09-11T23:18:21.570512+0000","last_fullsized":"2024-09-11T23:18:21.570512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.583531+0000","last_change":"2024-09-11T23:18:21.582739+0000","last_active":"2024-09-11T23:18:21.583531+0000","last_peered":"2024-09-11T23:18:21.583531+0000","last_clean":"2024-09-11T23:18:21.583531+0000","last_became_active":"2024-09-11T23:18:21.582400+0000","last_became_peered":"2024-09-11T23:18:21.582400+0000","last_unstale":"2024-09-11T23:18:21.583531+0000","last_undegraded":"2024-09-11T23:18:21.583531+0000","last_fullsized":"2024-09-11T23:18:21.583531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.837002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573245+0000","last_change":"2024-09-11T23:18:21.573245+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573245+0000","last_undegraded":"2024-09-11T23:18:21.573245+0000","last_fullsized":"2024-09-11T23:18:21.573245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604294+0000","last_change":"2024-09-11T23:18:21.603704+0000","last_active":"2024-09-11T23:18:21.604294+0000","last_peered":"2024-09-11T23:18:21.604294+0000","last_clean":"2024-09-11T23:18:21.604294+0000","last_became_active":"2024-09-11T23:18:21.603309+0000","last_became_peered":"2024-09-11T23:18:21.603309+0000","last_unstale":"2024-09-11T23:18:21.604294+0000","last_undegraded":"2024-09-11T23:18:21.604294+0000","last_fullsized":"2024-09-11T23:18:21.604294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:39.912926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.577549+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:18:21.577549+0000","last_peered":"2024-09-11T23:18:21.577549+0000","last_clean":"2024-09-11T23:18:21.577549+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:18:21.577549+0000","last_undegraded":"2024-09-11T23:18:21.577549+0000","last_fullsized":"2024-09-11T23:18:21.577549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":892928,"data_stored":405241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36212,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335628,"statfs":{"total":96636764160,"available":96599683072,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:26.972 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:27.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.121+0000 7f3ed97d2640 1 Processor -- start 2024-09-11T23:18:27.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.121+0000 7f3ed97d2640 1 -- start start 2024-09-11T23:18:27.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed97d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ed40b4510 0x7f3ed41670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed97d2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed40d27a0 con 0x7f3ed40cf800 2024-09-11T23:18:27.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed97d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed40d2a80 con 0x7f3ed41457a0 2024-09-11T23:18:27.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed97d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed40d1720 con 0x7f3ed40b4510 2024-09-11T23:18:27.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed27fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3ed40cf800 0x7f3ed40b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44648/0 (socket says 172.21.15.94:44648) 2024-09-11T23:18:27.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed27fc640 1 -- 172.21.15.94:0/3779502278 learned_addr learned my addr 172.21.15.94:0/3779502278 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:27.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172653244 0 0) 0x7f3ed40d27a0 con 0x7f3ed40cf800 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec0003530 con 0x7f3ed40cf800 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/3779502278 >> v2:172.21.15.155:3300/0 conn(0x7f3ed40b4510 0x7f3ed41670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1319175161 0 0) 0x7f3ec0003530 con 0x7f3ed40cf800 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 >> v2:172.21.15.155:3300/0 conn(0x7f3ed40b4510 msgr2=0x7f3ed41670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 --2- 172.21.15.94:0/3779502278 >> v2:172.21.15.155:3300/0 conn(0x7f3ed40b4510 0x7f3ed41670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 >> v1:172.21.15.155:6789/0 conn(0x7f3ed41457a0 legacy=0x7f3ed40d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed40d2d60 con 0x7f3ed40cf800 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f3ebc001680 con 0x7f3ed40cf800 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 >> v1:172.21.15.94:6789/0 conn(0x7f3ed40cf800 legacy=0x7f3ed40b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ec00039f0 0x7f3ec0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec0004810 0x7f3ec0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ec00052a0 0x7f3ec000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec000c1c0 con 0x7f3ec00052a0 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec000c370 con 0x7f3ec0004810 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec000c570 con 0x7f3ec00039f0 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ec00052a0 0x7f3ec000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed27fc640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec0004810 0x7f3ec0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed2ffd640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ec00039f0 0x7f3ec0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed37fe640 1 -- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ec00039f0 msgr2=0x7f3ec0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ec00039f0 0x7f3ec0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed37fe640 1 -- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec0004810 msgr2=0x7f3ec0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec0004810 0x7f3ec0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed37fe640 1 -- 172.21.15.94:0/3779502278 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec0003530 con 0x7f3ec00052a0 2024-09-11T23:18:27.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.125+0000 7f3ed27fc640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec0004810 0x7f3ec0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:27.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 -- 172.21.15.94:0/3779502278 reap_dead start 2024-09-11T23:18:27.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ec00052a0 0x7f3ec000b9d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00ba30 tx=0x7f3ecc01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a933258615230c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0b0020 con 0x7f3ec00052a0 2024-09-11T23:18:27.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc004260 con 0x7f3ec00052a0 2024-09-11T23:18:27.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed1ffb640 1 -- 172.21.15.94:0/3779502278 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00b600 con 0x7f3ec00052a0 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- 172.21.15.94:0/3779502278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ec00052a0 msgr2=0x7f3ec000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ec00052a0 0x7f3ec000b9d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00ba30 tx=0x7f3ecc01c6e0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- 172.21.15.94:0/3779502278 shutdown_connections 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/3779502278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ec00052a0 0x7f3ec000b9d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- 172.21.15.94:0/3779502278 >> 172.21.15.94:0/3779502278 conn(0x7f3ed406bcc0 msgr2=0x7f3ed406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- 172.21.15.94:0/3779502278 shutdown_connections 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- 172.21.15.94:0/3779502278 wait complete. 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 Processor -- start 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- start start 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec00052a0 0x7f3ed415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed40b6150 0x7f3ed40b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ed40d1930 0x7f3ed40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed40b52f0 con 0x7f3ed40d1930 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed40b5170 con 0x7f3ec00052a0 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed40b3e00 con 0x7f3ed40b6150 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ed40d1930 0x7f3ed40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ed40d1930 0x7f3ed40d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57406/0 (socket says 172.21.15.94:57406) 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 -- 172.21.15.94:0/2610942375 learned_addr learned my addr 172.21.15.94:0/2610942375 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 -- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed40b6150 msgr2=0x7f3ed40b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed40b6150 0x7f3ed40b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 -- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec00052a0 msgr2=0x7f3ed415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec00052a0 0x7f3ed415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 -- 172.21.15.94:0/2610942375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed415c400 con 0x7f3ed40d1930 2024-09-11T23:18:27.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed37fe640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ed40d1930 0x7f3ed40d1de0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc01cf80 tx=0x7f3ec0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ecb7fe640 1 -- 172.21.15.94:0/2610942375 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0bd070 con 0x7f3ed40d1930 2024-09-11T23:18:27.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ecb7fe640 1 -- 172.21.15.94:0/2610942375 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc0b5680 con 0x7f3ed40d1930 2024-09-11T23:18:27.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed41f1c50 con 0x7f3ed40d1930 2024-09-11T23:18:27.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ecb7fe640 1 -- 172.21.15.94:0/2610942375 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0b0030 con 0x7f3ed40d1930 2024-09-11T23:18:27.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.129+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed41f2210 con 0x7f3ed40d1930 2024-09-11T23:18:27.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.133+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed40b4130 con 0x7f3ed40d1930 2024-09-11T23:18:27.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.133+0000 7f3ecb7fe640 1 -- 172.21.15.94:0/2610942375 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ecc0c0070 con 0x7f3ed40d1930 2024-09-11T23:18:27.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.133+0000 7f3ecb7fe640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3eb40678c0 0x7f3eb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.133+0000 7f3ecb7fe640 1 -- 172.21.15.94:0/2610942375 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f3ecc11feb0 con 0x7f3ed40d1930 2024-09-11T23:18:27.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.133+0000 7f3ed2ffd640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3eb40678c0 0x7f3eb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.133+0000 7f3ed2ffd640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3eb40678c0 0x7f3eb4069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3ed413bb30 tx=0x7f3ec4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.137+0000 7f3ecb7fe640 1 -- 172.21.15.94:0/2610942375 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ecc0163f0 con 0x7f3ed40d1930 2024-09-11T23:18:27.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.281+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ed40d26f0 con 0x7f3eb40678c0 2024-09-11T23:18:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ecb7fe640 1 -- 172.21.15.94:0/2610942375 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246751 (secure 0 0 0) 0x7f3ec40017c0 con 0x7f3eb40678c0 2024-09-11T23:18:27.303 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:27.304 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:18:27.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3eb40678c0 msgr2=0x7f3eb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3eb40678c0 0x7f3eb4069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3ed413bb30 tx=0x7f3ec4009040 comp rx=0 tx=0).stop 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ed40d1930 msgr2=0x7f3ed40d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ed40d1930 0x7f3ed40d1de0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc01cf80 tx=0x7f3ec0005840 comp rx=0 tx=0).stop 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 shutdown_connections 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3eb40678c0 0x7f3eb4069d80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3ed40d1930 0x7f3ed40d1de0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed40b6150 0x7f3ed40b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 --2- 172.21.15.94:0/2610942375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ec00052a0 0x7f3ed415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 >> 172.21.15.94:0/2610942375 conn(0x7f3ed406bcc0 msgr2=0x7f3ed40cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 shutdown_connections 2024-09-11T23:18:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.301+0000 7f3ed97d2640 1 -- 172.21.15.94:0/2610942375 wait complete. 2024-09-11T23:18:27.319 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-11T23:18:26.033727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278408,"kb_used_data":8052,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754696312,"statfs":{"total":773094113280,"available":772809023488,"internally_reserved":0,"allocated":8245248,"data_stored":4375995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.478190"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575141+0000","last_change":"2024-09-11T23:18:21.575141+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575141+0000","last_undegraded":"2024-09-11T23:18:21.575141+0000","last_fullsized":"2024-09-11T23:18:21.575141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576577+0000","last_change":"2024-09-11T23:18:21.576577+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576577+0000","last_undegraded":"2024-09-11T23:18:21.576577+0000","last_fullsized":"2024-09-11T23:18:21.576577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572276+0000","last_change":"2024-09-11T23:18:21.572276+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572276+0000","last_undegraded":"2024-09-11T23:18:21.572276+0000","last_fullsized":"2024-09-11T23:18:21.572276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.592440+0000","last_change":"2024-09-11T23:18:21.592440+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.592440+0000","last_undegraded":"2024-09-11T23:18:21.592440+0000","last_fullsized":"2024-09-11T23:18:21.592440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576579+0000","last_change":"2024-09-11T23:18:21.576579+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576579+0000","last_undegraded":"2024-09-11T23:18:21.576579+0000","last_fullsized":"2024-09-11T23:18:21.576579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577146+0000","last_change":"2024-09-11T23:18:21.577146+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577146+0000","last_undegraded":"2024-09-11T23:18:21.577146+0000","last_fullsized":"2024-09-11T23:18:21.577146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583012+0000","last_change":"2024-09-11T23:18:21.583012+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583012+0000","last_undegraded":"2024-09-11T23:18:21.583012+0000","last_fullsized":"2024-09-11T23:18:21.583012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573043+0000","last_change":"2024-09-11T23:18:21.573043+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573043+0000","last_undegraded":"2024-09-11T23:18:21.573043+0000","last_fullsized":"2024-09-11T23:18:21.573043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578207+0000","last_change":"2024-09-11T23:18:21.578207+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578207+0000","last_undegraded":"2024-09-11T23:18:21.578207+0000","last_fullsized":"2024-09-11T23:18:21.578207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583855+0000","last_change":"2024-09-11T23:18:21.583855+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583855+0000","last_undegraded":"2024-09-11T23:18:21.583855+0000","last_fullsized":"2024-09-11T23:18:21.583855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577081+0000","last_change":"2024-09-11T23:18:21.577081+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577081+0000","last_undegraded":"2024-09-11T23:18:21.577081+0000","last_fullsized":"2024-09-11T23:18:21.577081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.591435+0000","last_change":"2024-09-11T23:18:21.591435+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.591435+0000","last_undegraded":"2024-09-11T23:18:21.591435+0000","last_fullsized":"2024-09-11T23:18:21.591435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574657+0000","last_change":"2024-09-11T23:18:21.574657+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574657+0000","last_undegraded":"2024-09-11T23:18:21.574657+0000","last_fullsized":"2024-09-11T23:18:21.574657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576614+0000","last_change":"2024-09-11T23:18:21.576614+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576614+0000","last_undegraded":"2024-09-11T23:18:21.576614+0000","last_fullsized":"2024-09-11T23:18:21.576614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576743+0000","last_change":"2024-09-11T23:18:21.576743+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576743+0000","last_undegraded":"2024-09-11T23:18:21.576743+0000","last_fullsized":"2024-09-11T23:18:21.576743+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574980+0000","last_change":"2024-09-11T23:18:21.574980+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574980+0000","last_undegraded":"2024-09-11T23:18:21.574980+0000","last_fullsized":"2024-09-11T23:18:21.574980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573199+0000","last_change":"2024-09-11T23:18:21.573199+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573199+0000","last_undegraded":"2024-09-11T23:18:21.573199+0000","last_fullsized":"2024-09-11T23:18:21.573199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572306+0000","last_change":"2024-09-11T23:18:21.572306+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572306+0000","last_undegraded":"2024-09-11T23:18:21.572306+0000","last_fullsized":"2024-09-11T23:18:21.572306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574480+0000","last_change":"2024-09-11T23:18:21.574480+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574480+0000","last_undegraded":"2024-09-11T23:18:21.574480+0000","last_fullsized":"2024-09-11T23:18:21.574480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574942+0000","last_change":"2024-09-11T23:18:21.574942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574942+0000","last_undegraded":"2024-09-11T23:18:21.574942+0000","last_fullsized":"2024-09-11T23:18:21.574942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580987+0000","last_change":"2024-09-11T23:18:21.580987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580987+0000","last_undegraded":"2024-09-11T23:18:21.580987+0000","last_fullsized":"2024-09-11T23:18:21.580987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573853+0000","last_change":"2024-09-11T23:18:21.573853+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573853+0000","last_undegraded":"2024-09-11T23:18:21.573853+0000","last_fullsized":"2024-09-11T23:18:21.573853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576356+0000","last_change":"2024-09-11T23:18:21.576356+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576356+0000","last_undegraded":"2024-09-11T23:18:21.576356+0000","last_fullsized":"2024-09-11T23:18:21.576356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573787+0000","last_change":"2024-09-11T23:18:21.573787+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573787+0000","last_undegraded":"2024-09-11T23:18:21.573787+0000","last_fullsized":"2024-09-11T23:18:21.573787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573987+0000","last_change":"2024-09-11T23:18:21.573987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573987+0000","last_undegraded":"2024-09-11T23:18:21.573987+0000","last_fullsized":"2024-09-11T23:18:21.573987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580841+0000","last_change":"2024-09-11T23:18:21.580841+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580841+0000","last_undegraded":"2024-09-11T23:18:21.580841+0000","last_fullsized":"2024-09-11T23:18:21.580841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574395+0000","last_change":"2024-09-11T23:18:21.574395+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574395+0000","last_undegraded":"2024-09-11T23:18:21.574395+0000","last_fullsized":"2024-09-11T23:18:21.574395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574362+0000","last_change":"2024-09-11T23:18:21.574362+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574362+0000","last_undegraded":"2024-09-11T23:18:21.574362+0000","last_fullsized":"2024-09-11T23:18:21.574362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573182+0000","last_change":"2024-09-11T23:18:21.573182+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573182+0000","last_undegraded":"2024-09-11T23:18:21.573182+0000","last_fullsized":"2024-09-11T23:18:21.573182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572487+0000","last_change":"2024-09-11T23:18:21.572487+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572487+0000","last_undegraded":"2024-09-11T23:18:21.572487+0000","last_fullsized":"2024-09-11T23:18:21.572487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570942+0000","last_change":"2024-09-11T23:18:21.570942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570942+0000","last_undegraded":"2024-09-11T23:18:21.570942+0000","last_fullsized":"2024-09-11T23:18:21.570942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572484+0000","last_change":"2024-09-11T23:18:21.572484+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572484+0000","last_undegraded":"2024-09-11T23:18:21.572484+0000","last_fullsized":"2024-09-11T23:18:21.572484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571495+0000","last_change":"2024-09-11T23:18:21.571495+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571495+0000","last_undegraded":"2024-09-11T23:18:21.571495+0000","last_fullsized":"2024-09-11T23:18:21.571495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581883+0000","last_change":"2024-09-11T23:18:21.580890+0000","last_active":"2024-09-11T23:18:21.581883+0000","last_peered":"2024-09-11T23:18:21.581883+0000","last_clean":"2024-09-11T23:18:21.581883+0000","last_became_active":"2024-09-11T23:18:21.580558+0000","last_became_peered":"2024-09-11T23:18:21.580558+0000","last_unstale":"2024-09-11T23:18:21.581883+0000","last_undegraded":"2024-09-11T23:18:21.581883+0000","last_fullsized":"2024-09-11T23:18:21.581883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:59.631938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576195+0000","last_change":"2024-09-11T23:18:21.576195+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576195+0000","last_undegraded":"2024-09-11T23:18:21.576195+0000","last_fullsized":"2024-09-11T23:18:21.576195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607917+0000","last_change":"2024-09-11T23:18:21.605242+0000","last_active":"2024-09-11T23:18:21.607917+0000","last_peered":"2024-09-11T23:18:21.607917+0000","last_clean":"2024-09-11T23:18:21.607917+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.607917+0000","last_undegraded":"2024-09-11T23:18:21.607917+0000","last_fullsized":"2024-09-11T23:18:21.607917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577727+0000","last_change":"2024-09-11T23:18:21.577727+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577727+0000","last_undegraded":"2024-09-11T23:18:21.577727+0000","last_fullsized":"2024-09-11T23:18:21.577727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606516+0000","last_change":"2024-09-11T23:18:21.600136+0000","last_active":"2024-09-11T23:18:21.606516+0000","last_peered":"2024-09-11T23:18:21.606516+0000","last_clean":"2024-09-11T23:18:21.606516+0000","last_became_active":"2024-09-11T23:18:21.597138+0000","last_became_peered":"2024-09-11T23:18:21.597138+0000","last_unstale":"2024-09-11T23:18:21.606516+0000","last_undegraded":"2024-09-11T23:18:21.606516+0000","last_fullsized":"2024-09-11T23:18:21.606516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580104+0000","last_change":"2024-09-11T23:18:21.580104+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580104+0000","last_undegraded":"2024-09-11T23:18:21.580104+0000","last_fullsized":"2024-09-11T23:18:21.580104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614398+0000","last_change":"2024-09-11T23:18:21.610459+0000","last_active":"2024-09-11T23:18:21.614398+0000","last_peered":"2024-09-11T23:18:21.614398+0000","last_clean":"2024-09-11T23:18:21.614398+0000","last_became_active":"2024-09-11T23:18:21.604546+0000","last_became_peered":"2024-09-11T23:18:21.604546+0000","last_unstale":"2024-09-11T23:18:21.614398+0000","last_undegraded":"2024-09-11T23:18:21.614398+0000","last_fullsized":"2024-09-11T23:18:21.614398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:20.492447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575035+0000","last_change":"2024-09-11T23:18:21.575035+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575035+0000","last_undegraded":"2024-09-11T23:18:21.575035+0000","last_fullsized":"2024-09-11T23:18:21.575035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602182+0000","last_change":"2024-09-11T23:18:21.600764+0000","last_active":"2024-09-11T23:18:21.602182+0000","last_peered":"2024-09-11T23:18:21.602182+0000","last_clean":"2024-09-11T23:18:21.602182+0000","last_became_active":"2024-09-11T23:18:21.600043+0000","last_became_peered":"2024-09-11T23:18:21.600043+0000","last_unstale":"2024-09-11T23:18:21.602182+0000","last_undegraded":"2024-09-11T23:18:21.602182+0000","last_fullsized":"2024-09-11T23:18:21.602182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:37.130140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573003+0000","last_change":"2024-09-11T23:18:21.573003+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573003+0000","last_undegraded":"2024-09-11T23:18:21.573003+0000","last_fullsized":"2024-09-11T23:18:21.573003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605130+0000","last_change":"2024-09-11T23:18:21.597322+0000","last_active":"2024-09-11T23:18:21.605130+0000","last_peered":"2024-09-11T23:18:21.605130+0000","last_clean":"2024-09-11T23:18:21.605130+0000","last_became_active":"2024-09-11T23:18:21.596479+0000","last_became_peered":"2024-09-11T23:18:21.596479+0000","last_unstale":"2024-09-11T23:18:21.605130+0000","last_undegraded":"2024-09-11T23:18:21.605130+0000","last_fullsized":"2024-09-11T23:18:21.605130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578520+0000","last_change":"2024-09-11T23:18:21.578520+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578520+0000","last_undegraded":"2024-09-11T23:18:21.578520+0000","last_fullsized":"2024-09-11T23:18:21.578520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.598269+0000","last_change":"2024-09-11T23:18:21.597750+0000","last_active":"2024-09-11T23:18:21.598269+0000","last_peered":"2024-09-11T23:18:21.598269+0000","last_clean":"2024-09-11T23:18:21.598269+0000","last_became_active":"2024-09-11T23:18:21.597419+0000","last_became_peered":"2024-09-11T23:18:21.597419+0000","last_unstale":"2024-09-11T23:18:21.598269+0000","last_undegraded":"2024-09-11T23:18:21.598269+0000","last_fullsized":"2024-09-11T23:18:21.598269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.587465+0000","last_change":"2024-09-11T23:18:21.587465+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.587465+0000","last_undegraded":"2024-09-11T23:18:21.587465+0000","last_fullsized":"2024-09-11T23:18:21.587465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602352+0000","last_change":"2024-09-11T23:18:21.601997+0000","last_active":"2024-09-11T23:18:21.602352+0000","last_peered":"2024-09-11T23:18:21.602352+0000","last_clean":"2024-09-11T23:18:21.602352+0000","last_became_active":"2024-09-11T23:18:21.601557+0000","last_became_peered":"2024-09-11T23:18:21.601557+0000","last_unstale":"2024-09-11T23:18:21.602352+0000","last_undegraded":"2024-09-11T23:18:21.602352+0000","last_fullsized":"2024-09-11T23:18:21.602352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:39.744498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572822+0000","last_change":"2024-09-11T23:18:21.572822+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572822+0000","last_undegraded":"2024-09-11T23:18:21.572822+0000","last_fullsized":"2024-09-11T23:18:21.572822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608618+0000","last_change":"2024-09-11T23:18:21.606163+0000","last_active":"2024-09-11T23:18:21.608618+0000","last_peered":"2024-09-11T23:18:21.608618+0000","last_clean":"2024-09-11T23:18:21.608618+0000","last_became_active":"2024-09-11T23:18:21.605050+0000","last_became_peered":"2024-09-11T23:18:21.605050+0000","last_unstale":"2024-09-11T23:18:21.608618+0000","last_undegraded":"2024-09-11T23:18:21.608618+0000","last_fullsized":"2024-09-11T23:18:21.608618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588993+0000","last_change":"2024-09-11T23:18:21.588993+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588993+0000","last_undegraded":"2024-09-11T23:18:21.588993+0000","last_fullsized":"2024-09-11T23:18:21.588993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605321+0000","last_change":"2024-09-11T23:18:21.600933+0000","last_active":"2024-09-11T23:18:21.605321+0000","last_peered":"2024-09-11T23:18:21.605321+0000","last_clean":"2024-09-11T23:18:21.605321+0000","last_became_active":"2024-09-11T23:18:21.600235+0000","last_became_peered":"2024-09-11T23:18:21.600235+0000","last_unstale":"2024-09-11T23:18:21.605321+0000","last_undegraded":"2024-09-11T23:18:21.605321+0000","last_fullsized":"2024-09-11T23:18:21.605321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575987+0000","last_change":"2024-09-11T23:18:21.575987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575987+0000","last_undegraded":"2024-09-11T23:18:21.575987+0000","last_fullsized":"2024-09-11T23:18:21.575987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581754+0000","last_change":"2024-09-11T23:18:21.580034+0000","last_active":"2024-09-11T23:18:21.581754+0000","last_peered":"2024-09-11T23:18:21.581754+0000","last_clean":"2024-09-11T23:18:21.581754+0000","last_became_active":"2024-09-11T23:18:21.579736+0000","last_became_peered":"2024-09-11T23:18:21.579736+0000","last_unstale":"2024-09-11T23:18:21.581754+0000","last_undegraded":"2024-09-11T23:18:21.581754+0000","last_fullsized":"2024-09-11T23:18:21.581754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:04.945467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570534+0000","last_change":"2024-09-11T23:18:21.570534+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570534+0000","last_undegraded":"2024-09-11T23:18:21.570534+0000","last_fullsized":"2024-09-11T23:18:21.570534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.615599+0000","last_change":"2024-09-11T23:18:21.611858+0000","last_active":"2024-09-11T23:18:21.615599+0000","last_peered":"2024-09-11T23:18:21.615599+0000","last_clean":"2024-09-11T23:18:21.615599+0000","last_became_active":"2024-09-11T23:18:21.610397+0000","last_became_peered":"2024-09-11T23:18:21.610397+0000","last_unstale":"2024-09-11T23:18:21.615599+0000","last_undegraded":"2024-09-11T23:18:21.615599+0000","last_fullsized":"2024-09-11T23:18:21.615599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.087713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.581265+0000","last_change":"2024-09-11T23:18:21.581265+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.581265+0000","last_undegraded":"2024-09-11T23:18:21.581265+0000","last_fullsized":"2024-09-11T23:18:21.581265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607776+0000","last_change":"2024-09-11T23:18:21.604083+0000","last_active":"2024-09-11T23:18:21.607776+0000","last_peered":"2024-09-11T23:18:21.607776+0000","last_clean":"2024-09-11T23:18:21.607776+0000","last_became_active":"2024-09-11T23:18:21.603406+0000","last_became_peered":"2024-09-11T23:18:21.603406+0000","last_unstale":"2024-09-11T23:18:21.607776+0000","last_undegraded":"2024-09-11T23:18:21.607776+0000","last_fullsized":"2024-09-11T23:18:21.607776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.590372+0000","last_change":"2024-09-11T23:18:21.590372+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.590372+0000","last_undegraded":"2024-09-11T23:18:21.590372+0000","last_fullsized":"2024-09-11T23:18:21.590372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603108+0000","last_change":"2024-09-11T23:18:21.598505+0000","last_active":"2024-09-11T23:18:21.603108+0000","last_peered":"2024-09-11T23:18:21.603108+0000","last_clean":"2024-09-11T23:18:21.603108+0000","last_became_active":"2024-09-11T23:18:21.597672+0000","last_became_peered":"2024-09-11T23:18:21.597672+0000","last_unstale":"2024-09-11T23:18:21.603108+0000","last_undegraded":"2024-09-11T23:18:21.603108+0000","last_fullsized":"2024-09-11T23:18:21.603108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583494+0000","last_change":"2024-09-11T23:18:21.583494+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583494+0000","last_undegraded":"2024-09-11T23:18:21.583494+0000","last_fullsized":"2024-09-11T23:18:21.583494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581695+0000","last_change":"2024-09-11T23:18:21.580243+0000","last_active":"2024-09-11T23:18:21.581695+0000","last_peered":"2024-09-11T23:18:21.581695+0000","last_clean":"2024-09-11T23:18:21.581695+0000","last_became_active":"2024-09-11T23:18:21.579532+0000","last_became_peered":"2024-09-11T23:18:21.579532+0000","last_unstale":"2024-09-11T23:18:21.581695+0000","last_undegraded":"2024-09-11T23:18:21.581695+0000","last_fullsized":"2024-09-11T23:18:21.581695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.586462+0000","last_change":"2024-09-11T23:18:21.586462+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.586462+0000","last_undegraded":"2024-09-11T23:18:21.586462+0000","last_fullsized":"2024-09-11T23:18:21.586462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.601925+0000","last_change":"2024-09-11T23:18:21.601616+0000","last_active":"2024-09-11T23:18:21.601925+0000","last_peered":"2024-09-11T23:18:21.601925+0000","last_clean":"2024-09-11T23:18:21.601925+0000","last_became_active":"2024-09-11T23:18:21.601352+0000","last_became_peered":"2024-09-11T23:18:21.601352+0000","last_unstale":"2024-09-11T23:18:21.601925+0000","last_undegraded":"2024-09-11T23:18:21.601925+0000","last_fullsized":"2024-09-11T23:18:21.601925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575231+0000","last_change":"2024-09-11T23:18:21.575231+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575231+0000","last_undegraded":"2024-09-11T23:18:21.575231+0000","last_fullsized":"2024-09-11T23:18:21.575231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603371+0000","last_change":"2024-09-11T23:18:21.599580+0000","last_active":"2024-09-11T23:18:21.603371+0000","last_peered":"2024-09-11T23:18:21.603371+0000","last_clean":"2024-09-11T23:18:21.603371+0000","last_became_active":"2024-09-11T23:18:21.598795+0000","last_became_peered":"2024-09-11T23:18:21.598795+0000","last_unstale":"2024-09-11T23:18:21.603371+0000","last_undegraded":"2024-09-11T23:18:21.603371+0000","last_fullsized":"2024-09-11T23:18:21.603371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571990+0000","last_change":"2024-09-11T23:18:21.571990+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571990+0000","last_undegraded":"2024-09-11T23:18:21.571990+0000","last_fullsized":"2024-09-11T23:18:21.571990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.599994+0000","last_change":"2024-09-11T23:18:21.590812+0000","last_active":"2024-09-11T23:18:21.599994+0000","last_peered":"2024-09-11T23:18:21.599994+0000","last_clean":"2024-09-11T23:18:21.599994+0000","last_became_active":"2024-09-11T23:18:21.590053+0000","last_became_peered":"2024-09-11T23:18:21.590053+0000","last_unstale":"2024-09-11T23:18:21.599994+0000","last_undegraded":"2024-09-11T23:18:21.599994+0000","last_fullsized":"2024-09-11T23:18:21.599994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:24.137805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571868+0000","last_change":"2024-09-11T23:18:21.571868+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571868+0000","last_undegraded":"2024-09-11T23:18:21.571868+0000","last_fullsized":"2024-09-11T23:18:21.571868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.593347+0000","last_change":"2024-09-11T23:18:21.592958+0000","last_active":"2024-09-11T23:18:21.593347+0000","last_peered":"2024-09-11T23:18:21.593347+0000","last_clean":"2024-09-11T23:18:21.593347+0000","last_became_active":"2024-09-11T23:18:21.592461+0000","last_became_peered":"2024-09-11T23:18:21.592461+0000","last_unstale":"2024-09-11T23:18:21.593347+0000","last_undegraded":"2024-09-11T23:18:21.593347+0000","last_fullsized":"2024-09-11T23:18:21.593347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:59.694150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575042+0000","last_change":"2024-09-11T23:18:21.575042+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575042+0000","last_undegraded":"2024-09-11T23:18:21.575042+0000","last_fullsized":"2024-09-11T23:18:21.575042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581938+0000","last_change":"2024-09-11T23:18:21.580569+0000","last_active":"2024-09-11T23:18:21.581938+0000","last_peered":"2024-09-11T23:18:21.581938+0000","last_clean":"2024-09-11T23:18:21.581938+0000","last_became_active":"2024-09-11T23:18:21.580129+0000","last_became_peered":"2024-09-11T23:18:21.580129+0000","last_unstale":"2024-09-11T23:18:21.581938+0000","last_undegraded":"2024-09-11T23:18:21.581938+0000","last_fullsized":"2024-09-11T23:18:21.581938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:21.999989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574508+0000","last_change":"2024-09-11T23:18:21.574508+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574508+0000","last_undegraded":"2024-09-11T23:18:21.574508+0000","last_fullsized":"2024-09-11T23:18:21.574508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.584390+0000","last_change":"2024-09-11T23:18:21.582981+0000","last_active":"2024-09-11T23:18:21.584390+0000","last_peered":"2024-09-11T23:18:21.584390+0000","last_clean":"2024-09-11T23:18:21.584390+0000","last_became_active":"2024-09-11T23:18:21.582670+0000","last_became_peered":"2024-09-11T23:18:21.582670+0000","last_unstale":"2024-09-11T23:18:21.584390+0000","last_undegraded":"2024-09-11T23:18:21.584390+0000","last_fullsized":"2024-09-11T23:18:21.584390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:09.147103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576159+0000","last_change":"2024-09-11T23:18:21.576159+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576159+0000","last_undegraded":"2024-09-11T23:18:21.576159+0000","last_fullsized":"2024-09-11T23:18:21.576159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604305+0000","last_change":"2024-09-11T23:18:21.603816+0000","last_active":"2024-09-11T23:18:21.604305+0000","last_peered":"2024-09-11T23:18:21.604305+0000","last_clean":"2024-09-11T23:18:21.604305+0000","last_became_active":"2024-09-11T23:18:21.603447+0000","last_became_peered":"2024-09-11T23:18:21.603447+0000","last_unstale":"2024-09-11T23:18:21.604305+0000","last_undegraded":"2024-09-11T23:18:21.604305+0000","last_fullsized":"2024-09-11T23:18:21.604305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:05.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.585339+0000","last_change":"2024-09-11T23:18:21.585339+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.585339+0000","last_undegraded":"2024-09-11T23:18:21.585339+0000","last_fullsized":"2024-09-11T23:18:21.585339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604284+0000","last_change":"2024-09-11T23:18:21.603657+0000","last_active":"2024-09-11T23:18:21.604284+0000","last_peered":"2024-09-11T23:18:21.604284+0000","last_clean":"2024-09-11T23:18:21.604284+0000","last_became_active":"2024-09-11T23:18:21.603317+0000","last_became_peered":"2024-09-11T23:18:21.603317+0000","last_unstale":"2024-09-11T23:18:21.604284+0000","last_undegraded":"2024-09-11T23:18:21.604284+0000","last_fullsized":"2024-09-11T23:18:21.604284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:21.029059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577647+0000","last_change":"2024-09-11T23:18:21.577647+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577647+0000","last_undegraded":"2024-09-11T23:18:21.577647+0000","last_fullsized":"2024-09-11T23:18:21.577647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605048+0000","last_change":"2024-09-11T23:18:21.597127+0000","last_active":"2024-09-11T23:18:21.605048+0000","last_peered":"2024-09-11T23:18:21.605048+0000","last_clean":"2024-09-11T23:18:21.605048+0000","last_became_active":"2024-09-11T23:18:21.596156+0000","last_became_peered":"2024-09-11T23:18:21.596156+0000","last_unstale":"2024-09-11T23:18:21.605048+0000","last_undegraded":"2024-09-11T23:18:21.605048+0000","last_fullsized":"2024-09-11T23:18:21.605048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580959+0000","last_change":"2024-09-11T23:18:21.580959+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580959+0000","last_undegraded":"2024-09-11T23:18:21.580959+0000","last_fullsized":"2024-09-11T23:18:21.580959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.582034+0000","last_change":"2024-09-11T23:18:21.580858+0000","last_active":"2024-09-11T23:18:21.582034+0000","last_peered":"2024-09-11T23:18:21.582034+0000","last_clean":"2024-09-11T23:18:21.582034+0000","last_became_active":"2024-09-11T23:18:21.580498+0000","last_became_peered":"2024-09-11T23:18:21.580498+0000","last_unstale":"2024-09-11T23:18:21.582034+0000","last_undegraded":"2024-09-11T23:18:21.582034+0000","last_fullsized":"2024-09-11T23:18:21.582034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576434+0000","last_change":"2024-09-11T23:18:21.576434+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576434+0000","last_undegraded":"2024-09-11T23:18:21.576434+0000","last_fullsized":"2024-09-11T23:18:21.576434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606568+0000","last_change":"2024-09-11T23:18:21.600773+0000","last_active":"2024-09-11T23:18:21.606568+0000","last_peered":"2024-09-11T23:18:21.606568+0000","last_clean":"2024-09-11T23:18:21.606568+0000","last_became_active":"2024-09-11T23:18:21.600084+0000","last_became_peered":"2024-09-11T23:18:21.600084+0000","last_unstale":"2024-09-11T23:18:21.606568+0000","last_undegraded":"2024-09-11T23:18:21.606568+0000","last_fullsized":"2024-09-11T23:18:21.606568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572760+0000","last_change":"2024-09-11T23:18:21.572760+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572760+0000","last_undegraded":"2024-09-11T23:18:21.572760+0000","last_fullsized":"2024-09-11T23:18:21.572760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608519+0000","last_change":"2024-09-11T23:18:21.605831+0000","last_active":"2024-09-11T23:18:21.608519+0000","last_peered":"2024-09-11T23:18:21.608519+0000","last_clean":"2024-09-11T23:18:21.608519+0000","last_became_active":"2024-09-11T23:18:21.604947+0000","last_became_peered":"2024-09-11T23:18:21.604947+0000","last_unstale":"2024-09-11T23:18:21.608519+0000","last_undegraded":"2024-09-11T23:18:21.608519+0000","last_fullsized":"2024-09-11T23:18:21.608519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588889+0000","last_change":"2024-09-11T23:18:21.588889+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588889+0000","last_undegraded":"2024-09-11T23:18:21.588889+0000","last_fullsized":"2024-09-11T23:18:21.588889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614412+0000","last_change":"2024-09-11T23:18:21.610589+0000","last_active":"2024-09-11T23:18:21.614412+0000","last_peered":"2024-09-11T23:18:21.614412+0000","last_clean":"2024-09-11T23:18:21.614412+0000","last_became_active":"2024-09-11T23:18:21.604520+0000","last_became_peered":"2024-09-11T23:18:21.604520+0000","last_unstale":"2024-09-11T23:18:21.614412+0000","last_undegraded":"2024-09-11T23:18:21.614412+0000","last_fullsized":"2024-09-11T23:18:21.614412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:40.792715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583357+0000","last_change":"2024-09-11T23:18:21.583357+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583357+0000","last_undegraded":"2024-09-11T23:18:21.583357+0000","last_fullsized":"2024-09-11T23:18:21.583357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581983+0000","last_change":"2024-09-11T23:18:21.580668+0000","last_active":"2024-09-11T23:18:21.581983+0000","last_peered":"2024-09-11T23:18:21.581983+0000","last_clean":"2024-09-11T23:18:21.581983+0000","last_became_active":"2024-09-11T23:18:21.580346+0000","last_became_peered":"2024-09-11T23:18:21.580346+0000","last_unstale":"2024-09-11T23:18:21.581983+0000","last_undegraded":"2024-09-11T23:18:21.581983+0000","last_fullsized":"2024-09-11T23:18:21.581983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:26.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570640+0000","last_change":"2024-09-11T23:18:21.570640+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570640+0000","last_undegraded":"2024-09-11T23:18:21.570640+0000","last_fullsized":"2024-09-11T23:18:21.570640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614502+0000","last_change":"2024-09-11T23:18:21.610976+0000","last_active":"2024-09-11T23:18:21.614502+0000","last_peered":"2024-09-11T23:18:21.614502+0000","last_clean":"2024-09-11T23:18:21.614502+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.614502+0000","last_undegraded":"2024-09-11T23:18:21.614502+0000","last_fullsized":"2024-09-11T23:18:21.614502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:33.389328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570512+0000","last_change":"2024-09-11T23:18:21.570512+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570512+0000","last_undegraded":"2024-09-11T23:18:21.570512+0000","last_fullsized":"2024-09-11T23:18:21.570512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.583531+0000","last_change":"2024-09-11T23:18:21.582739+0000","last_active":"2024-09-11T23:18:21.583531+0000","last_peered":"2024-09-11T23:18:21.583531+0000","last_clean":"2024-09-11T23:18:21.583531+0000","last_became_active":"2024-09-11T23:18:21.582400+0000","last_became_peered":"2024-09-11T23:18:21.582400+0000","last_unstale":"2024-09-11T23:18:21.583531+0000","last_undegraded":"2024-09-11T23:18:21.583531+0000","last_fullsized":"2024-09-11T23:18:21.583531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.837002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573245+0000","last_change":"2024-09-11T23:18:21.573245+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573245+0000","last_undegraded":"2024-09-11T23:18:21.573245+0000","last_fullsized":"2024-09-11T23:18:21.573245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604294+0000","last_change":"2024-09-11T23:18:21.603704+0000","last_active":"2024-09-11T23:18:21.604294+0000","last_peered":"2024-09-11T23:18:21.604294+0000","last_clean":"2024-09-11T23:18:21.604294+0000","last_became_active":"2024-09-11T23:18:21.603309+0000","last_became_peered":"2024-09-11T23:18:21.603309+0000","last_unstale":"2024-09-11T23:18:21.604294+0000","last_undegraded":"2024-09-11T23:18:21.604294+0000","last_fullsized":"2024-09-11T23:18:21.604294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:39.912926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.577549+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:18:21.577549+0000","last_peered":"2024-09-11T23:18:21.577549+0000","last_clean":"2024-09-11T23:18:21.577549+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:18:21.577549+0000","last_undegraded":"2024-09-11T23:18:21.577549+0000","last_fullsized":"2024-09-11T23:18:21.577549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":892928,"data_stored":405241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36212,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335628,"statfs":{"total":96636764160,"available":96599683072,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:27.327 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-09-11T23:18:27.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.575141+0000', 'last_change': '2024-09-11T23:18:21.575141+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.575141+0000', 'last_undegraded': '2024-09-11T23:18:21.575141+0000', 'last_fullsized': '2024-09-11T23:18:21.575141+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576577+0000', 'last_change': '2024-09-11T23:18:21.576577+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576577+0000', 'last_undegraded': '2024-09-11T23:18:21.576577+0000', 'last_fullsized': '2024-09-11T23:18:21.576577+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3d is not active+clean 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.572276+0000', 'last_change': '2024-09-11T23:18:21.572276+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.572276+0000', 'last_undegraded': '2024-09-11T23:18:21.572276+0000', 'last_fullsized': '2024-09-11T23:18:21.572276+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3c is not active+clean 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.592440+0000', 'last_change': '2024-09-11T23:18:21.592440+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.592440+0000', 'last_undegraded': '2024-09-11T23:18:21.592440+0000', 'last_fullsized': '2024-09-11T23:18:21.592440+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3b is not active+clean 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576579+0000', 'last_change': '2024-09-11T23:18:21.576579+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576579+0000', 'last_undegraded': '2024-09-11T23:18:21.576579+0000', 'last_fullsized': '2024-09-11T23:18:21.576579+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.328 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3a is not active+clean 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.577146+0000', 'last_change': '2024-09-11T23:18:21.577146+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.577146+0000', 'last_undegraded': '2024-09-11T23:18:21.577146+0000', 'last_fullsized': '2024-09-11T23:18:21.577146+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.583012+0000', 'last_change': '2024-09-11T23:18:21.583012+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.583012+0000', 'last_undegraded': '2024-09-11T23:18:21.583012+0000', 'last_fullsized': '2024-09-11T23:18:21.583012+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:PG 12.38 is not active+clean 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573043+0000', 'last_change': '2024-09-11T23:18:21.573043+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573043+0000', 'last_undegraded': '2024-09-11T23:18:21.573043+0000', 'last_fullsized': '2024-09-11T23:18:21.573043+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:PG 12.37 is not active+clean 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.578207+0000', 'last_change': '2024-09-11T23:18:21.578207+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.578207+0000', 'last_undegraded': '2024-09-11T23:18:21.578207+0000', 'last_fullsized': '2024-09-11T23:18:21.578207+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:PG 12.36 is not active+clean 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.583855+0000', 'last_change': '2024-09-11T23:18:21.583855+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.583855+0000', 'last_undegraded': '2024-09-11T23:18:21.583855+0000', 'last_fullsized': '2024-09-11T23:18:21.583855+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:18:27.329 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.577081+0000', 'last_change': '2024-09-11T23:18:21.577081+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.577081+0000', 'last_undegraded': '2024-09-11T23:18:21.577081+0000', 'last_fullsized': '2024-09-11T23:18:21.577081+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.591435+0000', 'last_change': '2024-09-11T23:18:21.591435+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.591435+0000', 'last_undegraded': '2024-09-11T23:18:21.591435+0000', 'last_fullsized': '2024-09-11T23:18:21.591435+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:PG 12.33 is not active+clean 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.574657+0000', 'last_change': '2024-09-11T23:18:21.574657+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.574657+0000', 'last_undegraded': '2024-09-11T23:18:21.574657+0000', 'last_fullsized': '2024-09-11T23:18:21.574657+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:PG 12.32 is not active+clean 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576614+0000', 'last_change': '2024-09-11T23:18:21.576614+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576614+0000', 'last_undegraded': '2024-09-11T23:18:21.576614+0000', 'last_fullsized': '2024-09-11T23:18:21.576614+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:PG 12.31 is not active+clean 2024-09-11T23:18:27.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576743+0000', 'last_change': '2024-09-11T23:18:21.576743+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576743+0000', 'last_undegraded': '2024-09-11T23:18:21.576743+0000', 'last_fullsized': '2024-09-11T23:18:21.576743+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.574980+0000', 'last_change': '2024-09-11T23:18:21.574980+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.574980+0000', 'last_undegraded': '2024-09-11T23:18:21.574980+0000', 'last_fullsized': '2024-09-11T23:18:21.574980+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2f is not active+clean 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573199+0000', 'last_change': '2024-09-11T23:18:21.573199+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573199+0000', 'last_undegraded': '2024-09-11T23:18:21.573199+0000', 'last_fullsized': '2024-09-11T23:18:21.573199+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2e is not active+clean 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.572306+0000', 'last_change': '2024-09-11T23:18:21.572306+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.572306+0000', 'last_undegraded': '2024-09-11T23:18:21.572306+0000', 'last_fullsized': '2024-09-11T23:18:21.572306+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2d is not active+clean 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.574480+0000', 'last_change': '2024-09-11T23:18:21.574480+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.574480+0000', 'last_undegraded': '2024-09-11T23:18:21.574480+0000', 'last_fullsized': '2024-09-11T23:18:21.574480+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:18:27.331 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2c is not active+clean 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.574942+0000', 'last_change': '2024-09-11T23:18:21.574942+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.574942+0000', 'last_undegraded': '2024-09-11T23:18:21.574942+0000', 'last_fullsized': '2024-09-11T23:18:21.574942+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.580987+0000', 'last_change': '2024-09-11T23:18:21.580987+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.580987+0000', 'last_undegraded': '2024-09-11T23:18:21.580987+0000', 'last_fullsized': '2024-09-11T23:18:21.580987+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2a is not active+clean 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573853+0000', 'last_change': '2024-09-11T23:18:21.573853+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573853+0000', 'last_undegraded': '2024-09-11T23:18:21.573853+0000', 'last_fullsized': '2024-09-11T23:18:21.573853+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:PG 12.29 is not active+clean 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576356+0000', 'last_change': '2024-09-11T23:18:21.576356+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576356+0000', 'last_undegraded': '2024-09-11T23:18:21.576356+0000', 'last_fullsized': '2024-09-11T23:18:21.576356+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573787+0000', 'last_change': '2024-09-11T23:18:21.573787+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573787+0000', 'last_undegraded': '2024-09-11T23:18:21.573787+0000', 'last_fullsized': '2024-09-11T23:18:21.573787+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.332 INFO:tasks.ceph.ceph_manager.ceph:PG 12.27 is not active+clean 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573987+0000', 'last_change': '2024-09-11T23:18:21.573987+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573987+0000', 'last_undegraded': '2024-09-11T23:18:21.573987+0000', 'last_fullsized': '2024-09-11T23:18:21.573987+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:PG 12.26 is not active+clean 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.580841+0000', 'last_change': '2024-09-11T23:18:21.580841+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.580841+0000', 'last_undegraded': '2024-09-11T23:18:21.580841+0000', 'last_fullsized': '2024-09-11T23:18:21.580841+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.574395+0000', 'last_change': '2024-09-11T23:18:21.574395+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.574395+0000', 'last_undegraded': '2024-09-11T23:18:21.574395+0000', 'last_fullsized': '2024-09-11T23:18:21.574395+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:PG 12.24 is not active+clean 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.574362+0000', 'last_change': '2024-09-11T23:18:21.574362+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.574362+0000', 'last_undegraded': '2024-09-11T23:18:21.574362+0000', 'last_fullsized': '2024-09-11T23:18:21.574362+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:PG 12.23 is not active+clean 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573182+0000', 'last_change': '2024-09-11T23:18:21.573182+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573182+0000', 'last_undegraded': '2024-09-11T23:18:21.573182+0000', 'last_fullsized': '2024-09-11T23:18:21.573182+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-09-11T23:18:27.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.572487+0000', 'last_change': '2024-09-11T23:18:21.572487+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.572487+0000', 'last_undegraded': '2024-09-11T23:18:21.572487+0000', 'last_fullsized': '2024-09-11T23:18:21.572487+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:PG 12.21 is not active+clean 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.570942+0000', 'last_change': '2024-09-11T23:18:21.570942+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.570942+0000', 'last_undegraded': '2024-09-11T23:18:21.570942+0000', 'last_fullsized': '2024-09-11T23:18:21.570942+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.572484+0000', 'last_change': '2024-09-11T23:18:21.572484+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.572484+0000', 'last_undegraded': '2024-09-11T23:18:21.572484+0000', 'last_fullsized': '2024-09-11T23:18:21.572484+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:PG 12.18 is not active+clean 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.571495+0000', 'last_change': '2024-09-11T23:18:21.571495+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.571495+0000', 'last_undegraded': '2024-09-11T23:18:21.571495+0000', 'last_fullsized': '2024-09-11T23:18:21.571495+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576195+0000', 'last_change': '2024-09-11T23:18:21.576195+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576195+0000', 'last_undegraded': '2024-09-11T23:18:21.576195+0000', 'last_fullsized': '2024-09-11T23:18:21.576195+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-11T23:18:27.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.577727+0000', 'last_change': '2024-09-11T23:18:21.577727+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.577727+0000', 'last_undegraded': '2024-09-11T23:18:21.577727+0000', 'last_fullsized': '2024-09-11T23:18:21.577727+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.580104+0000', 'last_change': '2024-09-11T23:18:21.580104+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.580104+0000', 'last_undegraded': '2024-09-11T23:18:21.580104+0000', 'last_fullsized': '2024-09-11T23:18:21.580104+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.575035+0000', 'last_change': '2024-09-11T23:18:21.575035+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.575035+0000', 'last_undegraded': '2024-09-11T23:18:21.575035+0000', 'last_fullsized': '2024-09-11T23:18:21.575035+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573003+0000', 'last_change': '2024-09-11T23:18:21.573003+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573003+0000', 'last_undegraded': '2024-09-11T23:18:21.573003+0000', 'last_fullsized': '2024-09-11T23:18:21.573003+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.578520+0000', 'last_change': '2024-09-11T23:18:21.578520+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.578520+0000', 'last_undegraded': '2024-09-11T23:18:21.578520+0000', 'last_fullsized': '2024-09-11T23:18:21.578520+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.587465+0000', 'last_change': '2024-09-11T23:18:21.587465+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.587465+0000', 'last_undegraded': '2024-09-11T23:18:21.587465+0000', 'last_fullsized': '2024-09-11T23:18:21.587465+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-11T23:18:27.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.572822+0000', 'last_change': '2024-09-11T23:18:21.572822+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.572822+0000', 'last_undegraded': '2024-09-11T23:18:21.572822+0000', 'last_fullsized': '2024-09-11T23:18:21.572822+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.588993+0000', 'last_change': '2024-09-11T23:18:21.588993+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.588993+0000', 'last_undegraded': '2024-09-11T23:18:21.588993+0000', 'last_fullsized': '2024-09-11T23:18:21.588993+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.575987+0000', 'last_change': '2024-09-11T23:18:21.575987+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.575987+0000', 'last_undegraded': '2024-09-11T23:18:21.575987+0000', 'last_fullsized': '2024-09-11T23:18:21.575987+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:PG 12.13 is not active+clean 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.570534+0000', 'last_change': '2024-09-11T23:18:21.570534+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.570534+0000', 'last_undegraded': '2024-09-11T23:18:21.570534+0000', 'last_fullsized': '2024-09-11T23:18:21.570534+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.581265+0000', 'last_change': '2024-09-11T23:18:21.581265+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.581265+0000', 'last_undegraded': '2024-09-11T23:18:21.581265+0000', 'last_fullsized': '2024-09-11T23:18:21.581265+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-11T23:18:27.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.590372+0000', 'last_change': '2024-09-11T23:18:21.590372+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.590372+0000', 'last_undegraded': '2024-09-11T23:18:21.590372+0000', 'last_fullsized': '2024-09-11T23:18:21.590372+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.583494+0000', 'last_change': '2024-09-11T23:18:21.583494+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.583494+0000', 'last_undegraded': '2024-09-11T23:18:21.583494+0000', 'last_fullsized': '2024-09-11T23:18:21.583494+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.586462+0000', 'last_change': '2024-09-11T23:18:21.586462+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.586462+0000', 'last_undegraded': '2024-09-11T23:18:21.586462+0000', 'last_fullsized': '2024-09-11T23:18:21.586462+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.575231+0000', 'last_change': '2024-09-11T23:18:21.575231+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.575231+0000', 'last_undegraded': '2024-09-11T23:18:21.575231+0000', 'last_fullsized': '2024-09-11T23:18:21.575231+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.571990+0000', 'last_change': '2024-09-11T23:18:21.571990+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.571990+0000', 'last_undegraded': '2024-09-11T23:18:21.571990+0000', 'last_fullsized': '2024-09-11T23:18:21.571990+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.571868+0000', 'last_change': '2024-09-11T23:18:21.571868+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.571868+0000', 'last_undegraded': '2024-09-11T23:18:21.571868+0000', 'last_fullsized': '2024-09-11T23:18:21.571868+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:18:27.337 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.575042+0000', 'last_change': '2024-09-11T23:18:21.575042+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.575042+0000', 'last_undegraded': '2024-09-11T23:18:21.575042+0000', 'last_fullsized': '2024-09-11T23:18:21.575042+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.574508+0000', 'last_change': '2024-09-11T23:18:21.574508+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.574508+0000', 'last_undegraded': '2024-09-11T23:18:21.574508+0000', 'last_fullsized': '2024-09-11T23:18:21.574508+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576159+0000', 'last_change': '2024-09-11T23:18:21.576159+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576159+0000', 'last_undegraded': '2024-09-11T23:18:21.576159+0000', 'last_fullsized': '2024-09-11T23:18:21.576159+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.585339+0000', 'last_change': '2024-09-11T23:18:21.585339+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.585339+0000', 'last_undegraded': '2024-09-11T23:18:21.585339+0000', 'last_fullsized': '2024-09-11T23:18:21.585339+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.577647+0000', 'last_change': '2024-09-11T23:18:21.577647+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.577647+0000', 'last_undegraded': '2024-09-11T23:18:21.577647+0000', 'last_fullsized': '2024-09-11T23:18:21.577647+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-11T23:18:27.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.580959+0000', 'last_change': '2024-09-11T23:18:21.580959+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.580959+0000', 'last_undegraded': '2024-09-11T23:18:21.580959+0000', 'last_fullsized': '2024-09-11T23:18:21.580959+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.576434+0000', 'last_change': '2024-09-11T23:18:21.576434+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.576434+0000', 'last_undegraded': '2024-09-11T23:18:21.576434+0000', 'last_fullsized': '2024-09-11T23:18:21.576434+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.572760+0000', 'last_change': '2024-09-11T23:18:21.572760+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.572760+0000', 'last_undegraded': '2024-09-11T23:18:21.572760+0000', 'last_fullsized': '2024-09-11T23:18:21.572760+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.588889+0000', 'last_change': '2024-09-11T23:18:21.588889+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.588889+0000', 'last_undegraded': '2024-09-11T23:18:21.588889+0000', 'last_fullsized': '2024-09-11T23:18:21.588889+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.583357+0000', 'last_change': '2024-09-11T23:18:21.583357+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.583357+0000', 'last_undegraded': '2024-09-11T23:18:21.583357+0000', 'last_fullsized': '2024-09-11T23:18:21.583357+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.570640+0000', 'last_change': '2024-09-11T23:18:21.570640+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.570640+0000', 'last_undegraded': '2024-09-11T23:18:21.570640+0000', 'last_fullsized': '2024-09-11T23:18:21.570640+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:27.339 INFO:tasks.ceph.ceph_manager.ceph:PG 12.7 is not active+clean 2024-09-11T23:18:27.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.570512+0000', 'last_change': '2024-09-11T23:18:21.570512+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.570512+0000', 'last_undegraded': '2024-09-11T23:18:21.570512+0000', 'last_fullsized': '2024-09-11T23:18:21.570512+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:27.340 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-11T23:18:27.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:18:21.573245+0000', 'last_change': '2024-09-11T23:18:21.573245+0000', 'last_active': '2024-09-11T23:18:21.552389+0000', 'last_peered': '2024-09-11T23:18:21.552389+0000', 'last_clean': '2024-09-11T23:18:21.552389+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:18:21.573245+0000', 'last_undegraded': '2024-09-11T23:18:21.573245+0000', 'last_fullsized': '2024-09-11T23:18:21.573245+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:21.552389+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:18:27.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:18:27.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.473+0000 7f28eeb21640 1 Processor -- start 2024-09-11T23:18:27.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.473+0000 7f28eeb21640 1 -- start start 2024-09-11T23:18:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28eeb21640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28e8161a60 0x7f28e80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28eeb21640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80d2e90 0x7f28e80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28eeb21640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28e80cf450 0x7f28e80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28eeb21640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f28e80d32b0 con 0x7f28e80cf450 2024-09-11T23:18:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28eeb21640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f28e80d0300 con 0x7f28e8161a60 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28eeb21640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28e80b0f60 con 0x7f28e80d2e90 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28e80cf450 0x7f28e80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28e80cf450 0x7f28e80d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57416/0 (socket says 172.21.15.94:57416) 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 -- 172.21.15.94:0/3965350197 learned_addr learned my addr 172.21.15.94:0/3965350197 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ec8bd640 1 --2- 172.21.15.94:0/3965350197 >> v2:172.21.15.155:3300/0 conn(0x7f28e8161a60 0x7f28e80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28e7fff640 1 --2- 172.21.15.94:0/3965350197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80d2e90 0x7f28e80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 -- 172.21.15.94:0/3965350197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80d2e90 msgr2=0x7f28e80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 --2- 172.21.15.94:0/3965350197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80d2e90 0x7f28e80cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 -- 172.21.15.94:0/3965350197 >> v2:172.21.15.155:3300/0 conn(0x7f28e8161a60 msgr2=0x7f28e80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 --2- 172.21.15.94:0/3965350197 >> v2:172.21.15.155:3300/0 conn(0x7f28e8161a60 0x7f28e80d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 -- 172.21.15.94:0/3965350197 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e80cfd40 con 0x7f28e80cf450 2024-09-11T23:18:27.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28e7fff640 1 --2- 172.21.15.94:0/3965350197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80d2e90 0x7f28e80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:27.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28ed0be640 1 --2- 172.21.15.94:0/3965350197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80cf450 0x7f28e80d0a10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f28e808e010 tx=0x7f28e001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cc311940290484 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28e77fe640 1 -- 172.21.15.94:0/3965350197 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00a57b0 con 0x7f28e80cf450 2024-09-11T23:18:27.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28e77fe640 1 -- 172.21.15.94:0/3965350197 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e00a5950 con 0x7f28e80cf450 2024-09-11T23:18:27.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.477+0000 7f28e77fe640 1 -- 172.21.15.94:0/3965350197 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00a5d20 con 0x7f28e80cf450 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3965350197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80cf450 msgr2=0x7f28e80d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3965350197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80cf450 0x7f28e80d0a10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f28e808e010 tx=0x7f28e001c930 comp rx=0 tx=0).stop 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3965350197 shutdown_connections 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3965350197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80cf450 0x7f28e80d0a10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3965350197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80d2e90 0x7f28e80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3965350197 >> v2:172.21.15.155:3300/0 conn(0x7f28e8161a60 0x7f28e80d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3965350197 >> 172.21.15.94:0/3965350197 conn(0x7f28e808bf90 msgr2=0x7f28e809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3965350197 shutdown_connections 2024-09-11T23:18:27.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3965350197 wait complete. 2024-09-11T23:18:27.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 Processor -- start 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- start start 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80cf450 0x7f28e8154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80d2e90 0x7f28e80b9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e8161a60 0x7f28e80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80cfa60 con 0x7f28e80d2e90 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80cf8e0 con 0x7f28e8161a60 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28e806d6b0 con 0x7f28e80cf450 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80d2e90 0x7f28e80b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80d2e90 0x7f28e80b9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57420/0 (socket says 172.21.15.94:57420) 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 -- 172.21.15.94:0/3670291872 learned_addr learned my addr 172.21.15.94:0/3670291872 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28ec8bd640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80cf450 0x7f28e8154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28ed0be640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e8161a60 0x7f28e80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 -- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80cf450 msgr2=0x7f28e8154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80cf450 0x7f28e8154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 -- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e8161a60 msgr2=0x7f28e80c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e8161a60 0x7f28e80c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 -- 172.21.15.94:0/3670291872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e80c9c50 con 0x7f28e80d2e90 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e7fff640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80d2e90 0x7f28e80b9390 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00c7c0 tx=0x7f28dc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e57fa640 1 -- 172.21.15.94:0/3670291872 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc015070 con 0x7f28e80d2e90 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e57fa640 1 -- 172.21.15.94:0/3670291872 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc007a30 con 0x7f28e80d2e90 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e80c9f30 con 0x7f28e80d2e90 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28e57fa640 1 -- 172.21.15.94:0/3670291872 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc007e00 con 0x7f28e80d2e90 2024-09-11T23:18:27.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e80b7340 con 0x7f28e80d2e90 2024-09-11T23:18:27.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.481+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e80ca450 con 0x7f28e80d2e90 2024-09-11T23:18:27.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.485+0000 7f28e57fa640 1 -- 172.21.15.94:0/3670291872 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28dc018070 con 0x7f28e80d2e90 2024-09-11T23:18:27.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.485+0000 7f28e57fa640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28d40678c0 0x7f28d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.485+0000 7f28e57fa640 1 -- 172.21.15.94:0/3670291872 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f28dc086130 con 0x7f28e80d2e90 2024-09-11T23:18:27.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.485+0000 7f28ec8bd640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28d40678c0 0x7f28d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.485+0000 7f28ec8bd640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28d40678c0 0x7f28d4069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f28e80b9320 tx=0x7f28d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.489+0000 7f28e57fa640 1 -- 172.21.15.94:0/3670291872 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f28e80ca450 con 0x7f28e80d2e90 2024-09-11T23:18:27.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f28e80cef10 con 0x7f28e80d2e90 2024-09-11T23:18:27.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28e57fa640 1 -- 172.21.15.94:0/3670291872 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1495 (secure 0 0 0) 0x7f28dc056bc0 con 0x7f28e80d2e90 2024-09-11T23:18:27.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:27.694 INFO:teuthology.orchestra.run.smithi094.stdout:{"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":218,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096501,"num_in_osds":8,"osd_in_since":1726096491,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":285089792,"bytes_avail":772809023488,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6024}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-11T23:17:24.011528+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:18:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28d40678c0 msgr2=0x7f28d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28d40678c0 0x7f28d4069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f28e80b9320 tx=0x7f28d8008040 comp rx=0 tx=0).stop 2024-09-11T23:18:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80d2e90 msgr2=0x7f28e80b9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80d2e90 0x7f28e80b9390 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00c7c0 tx=0x7f28dc00cc80 comp rx=0 tx=0).stop 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 shutdown_connections 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e8161a60 0x7f28e80c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f28d40678c0 0x7f28d4069d80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28e80d2e90 0x7f28e80b9390 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 --2- 172.21.15.94:0/3670291872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28e80cf450 0x7f28e8154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 >> 172.21.15.94:0/3670291872 conn(0x7f28e808bf90 msgr2=0x7f28e8160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.693+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 shutdown_connections 2024-09-11T23:18:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.697+0000 7f28eeb21640 1 -- 172.21.15.94:0/3670291872 wait complete. 2024-09-11T23:18:27.712 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:18:27.712 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:27.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.825+0000 7fb2b3c7f640 1 Processor -- start 2024-09-11T23:18:27.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.825+0000 7fb2b3c7f640 1 -- start start 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.825+0000 7fb2b3c7f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2ac161a60 0x7fb2ac0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.825+0000 7fb2b3c7f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb2ac0cf620 0x7fb2ac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.825+0000 7fb2b3c7f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac0d32b0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.825+0000 7fb2b3c7f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac0d0300 con 0x7fb2ac0cf620 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.825+0000 7fb2b3c7f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac0cfa90 con 0x7fb2ac161a60 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b221c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb2ac0cf620 0x7fb2ac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b121a640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb2ac0d2e90 0x7fb2ac0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44658/0 (socket says 172.21.15.94:44658) 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b121a640 1 -- 172.21.15.94:0/188642238 learned_addr learned my addr 172.21.15.94:0/188642238 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b1a1b640 1 --2- 172.21.15.94:0/188642238 >> v2:172.21.15.155:3300/0 conn(0x7fb2ac161a60 0x7fb2ac0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b221c640 1 -- 172.21.15.94:0/188642238 >> v2:172.21.15.155:3300/0 conn(0x7fb2ac161a60 msgr2=0x7fb2ac0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b221c640 1 --2- 172.21.15.94:0/188642238 >> v2:172.21.15.155:3300/0 conn(0x7fb2ac161a60 0x7fb2ac0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b221c640 1 -- 172.21.15.94:0/188642238 >> v1:172.21.15.94:6789/0 conn(0x7fb2ac0d2e90 legacy=0x7fb2ac0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b221c640 1 -- 172.21.15.94:0/188642238 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac0b0f60 con 0x7fb2ac0cf620 2024-09-11T23:18:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b0a19640 1 -- 172.21.15.94:0/188642238 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647877065 0 0) 0x7fb2ac0d32b0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b1a1b640 1 --2- 172.21.15.94:0/188642238 >> v2:172.21.15.155:3300/0 conn(0x7fb2ac161a60 0x7fb2ac0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b221c640 1 --2- 172.21.15.94:0/188642238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0cf620 0x7fb2ac06d6b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac08e010 tx=0x7fb2a401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd46c60f2deaff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b0a19640 1 -- 172.21.15.94:0/188642238 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40b2070 con 0x7fb2ac0cf620 2024-09-11T23:18:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b0a19640 1 -- 172.21.15.94:0/188642238 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a40a5930 con 0x7fb2ac0cf620 2024-09-11T23:18:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b0a19640 1 -- 172.21.15.94:0/188642238 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40a5d00 con 0x7fb2ac0cf620 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/188642238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0cf620 msgr2=0x7fb2ac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/188642238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0cf620 0x7fb2ac06d6b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac08e010 tx=0x7fb2a401c870 comp rx=0 tx=0).stop 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/188642238 shutdown_connections 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/188642238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0cf620 0x7fb2ac06d6b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/188642238 >> v2:172.21.15.155:3300/0 conn(0x7fb2ac161a60 0x7fb2ac0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/188642238 >> 172.21.15.94:0/188642238 conn(0x7fb2ac08bf90 msgr2=0x7fb2ac09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/188642238 shutdown_connections 2024-09-11T23:18:27.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.829+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/188642238 wait complete. 2024-09-11T23:18:27.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 Processor -- start 2024-09-11T23:18:27.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 -- start start 2024-09-11T23:18:27.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2ac0cf620 0x7fb2ac0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0d2e90 0x7fb2ac15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2ac161a60 0x7fb2ac153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac06e400 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac06d190 con 0x7fb2ac0cf620 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac06e580 con 0x7fb2ac161a60 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0d2e90 0x7fb2ac15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0d2e90 0x7fb2ac15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57430/0 (socket says 172.21.15.94:57430) 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 -- 172.21.15.94:0/3199643720 learned_addr learned my addr 172.21.15.94:0/3199643720 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 -- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2ac161a60 msgr2=0x7fb2ac153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2ac161a60 0x7fb2ac153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 -- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2ac0cf620 msgr2=0x7fb2ac0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2ac0cf620 0x7fb2ac0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 -- 172.21.15.94:0/3199643720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac0b27f0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b121a640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0d2e90 0x7fb2ac15f450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c520 tx=0x7fb29c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2a27fc640 1 -- 172.21.15.94:0/3199643720 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c018070 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2a27fc640 1 -- 172.21.15.94:0/3199643720 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c0074e0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac15f990 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2a27fc640 1 -- 172.21.15.94:0/3199643720 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0049f0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac15e6b0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac06d6b0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2a27fc640 1 -- 172.21.15.94:0/3199643720 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb29c01b070 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2a27fc640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb2900678c0 0x7fb290069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.833+0000 7fb2a27fc640 1 -- 172.21.15.94:0/3199643720 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fb29c0851e0 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.837+0000 7fb2b1a1b640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb2900678c0 0x7fb290069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.837+0000 7fb2b1a1b640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb2900678c0 0x7fb290069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800a8d0 tx=0x7fb2a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.837+0000 7fb2a27fc640 1 -- 172.21.15.94:0/3199643720 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb29c055c20 con 0x7fb2ac0d2e90 2024-09-11T23:18:27.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:27.985+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2ac0b6630 con 0x7fb2900678c0 2024-09-11T23:18:28.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.001+0000 7fb2a27fc640 1 -- 172.21.15.94:0/3199643720 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246751 (secure 0 0 0) 0x7fb2ac0b6630 con 0x7fb2900678c0 2024-09-11T23:18:28.005 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:28.007 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:18:28.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb2900678c0 msgr2=0x7fb290069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:28.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb2900678c0 0x7fb290069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800a8d0 tx=0x7fb2a8008040 comp rx=0 tx=0).stop 2024-09-11T23:18:28.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0d2e90 msgr2=0x7fb2ac15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:28.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0d2e90 0x7fb2ac15f450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c520 tx=0x7fb29c00c9e0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 shutdown_connections 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2ac161a60 0x7fb2ac153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb2900678c0 0x7fb290069d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2ac0d2e90 0x7fb2ac15f450 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 --2- 172.21.15.94:0/3199643720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2ac0cf620 0x7fb2ac0b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 >> 172.21.15.94:0/3199643720 conn(0x7fb2ac08bf90 msgr2=0x7fb2ac09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 shutdown_connections 2024-09-11T23:18:28.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:28.005+0000 7fb2b3c7f640 1 -- 172.21.15.94:0/3199643720 wait complete. 2024-09-11T23:18:28.022 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-11T23:18:26.033727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278408,"kb_used_data":8052,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754696312,"statfs":{"total":773094113280,"available":772809023488,"internally_reserved":0,"allocated":8245248,"data_stored":4375995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.478190"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575141+0000","last_change":"2024-09-11T23:18:21.575141+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575141+0000","last_undegraded":"2024-09-11T23:18:21.575141+0000","last_fullsized":"2024-09-11T23:18:21.575141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576577+0000","last_change":"2024-09-11T23:18:21.576577+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576577+0000","last_undegraded":"2024-09-11T23:18:21.576577+0000","last_fullsized":"2024-09-11T23:18:21.576577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572276+0000","last_change":"2024-09-11T23:18:21.572276+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572276+0000","last_undegraded":"2024-09-11T23:18:21.572276+0000","last_fullsized":"2024-09-11T23:18:21.572276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.592440+0000","last_change":"2024-09-11T23:18:21.592440+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.592440+0000","last_undegraded":"2024-09-11T23:18:21.592440+0000","last_fullsized":"2024-09-11T23:18:21.592440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576579+0000","last_change":"2024-09-11T23:18:21.576579+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576579+0000","last_undegraded":"2024-09-11T23:18:21.576579+0000","last_fullsized":"2024-09-11T23:18:21.576579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577146+0000","last_change":"2024-09-11T23:18:21.577146+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577146+0000","last_undegraded":"2024-09-11T23:18:21.577146+0000","last_fullsized":"2024-09-11T23:18:21.577146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583012+0000","last_change":"2024-09-11T23:18:21.583012+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583012+0000","last_undegraded":"2024-09-11T23:18:21.583012+0000","last_fullsized":"2024-09-11T23:18:21.583012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573043+0000","last_change":"2024-09-11T23:18:21.573043+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573043+0000","last_undegraded":"2024-09-11T23:18:21.573043+0000","last_fullsized":"2024-09-11T23:18:21.573043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578207+0000","last_change":"2024-09-11T23:18:21.578207+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578207+0000","last_undegraded":"2024-09-11T23:18:21.578207+0000","last_fullsized":"2024-09-11T23:18:21.578207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583855+0000","last_change":"2024-09-11T23:18:21.583855+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583855+0000","last_undegraded":"2024-09-11T23:18:21.583855+0000","last_fullsized":"2024-09-11T23:18:21.583855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577081+0000","last_change":"2024-09-11T23:18:21.577081+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577081+0000","last_undegraded":"2024-09-11T23:18:21.577081+0000","last_fullsized":"2024-09-11T23:18:21.577081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.591435+0000","last_change":"2024-09-11T23:18:21.591435+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.591435+0000","last_undegraded":"2024-09-11T23:18:21.591435+0000","last_fullsized":"2024-09-11T23:18:21.591435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574657+0000","last_change":"2024-09-11T23:18:21.574657+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574657+0000","last_undegraded":"2024-09-11T23:18:21.574657+0000","last_fullsized":"2024-09-11T23:18:21.574657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576614+0000","last_change":"2024-09-11T23:18:21.576614+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576614+0000","last_undegraded":"2024-09-11T23:18:21.576614+0000","last_fullsized":"2024-09-11T23:18:21.576614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576743+0000","last_change":"2024-09-11T23:18:21.576743+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576743+0000","last_undegraded":"2024-09-11T23:18:21.576743+0000","last_fullsized":"2024-09-11T23:18:21.576743+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574980+0000","last_change":"2024-09-11T23:18:21.574980+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574980+0000","last_undegraded":"2024-09-11T23:18:21.574980+0000","last_fullsized":"2024-09-11T23:18:21.574980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573199+0000","last_change":"2024-09-11T23:18:21.573199+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573199+0000","last_undegraded":"2024-09-11T23:18:21.573199+0000","last_fullsized":"2024-09-11T23:18:21.573199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572306+0000","last_change":"2024-09-11T23:18:21.572306+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572306+0000","last_undegraded":"2024-09-11T23:18:21.572306+0000","last_fullsized":"2024-09-11T23:18:21.572306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574480+0000","last_change":"2024-09-11T23:18:21.574480+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574480+0000","last_undegraded":"2024-09-11T23:18:21.574480+0000","last_fullsized":"2024-09-11T23:18:21.574480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574942+0000","last_change":"2024-09-11T23:18:21.574942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574942+0000","last_undegraded":"2024-09-11T23:18:21.574942+0000","last_fullsized":"2024-09-11T23:18:21.574942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580987+0000","last_change":"2024-09-11T23:18:21.580987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580987+0000","last_undegraded":"2024-09-11T23:18:21.580987+0000","last_fullsized":"2024-09-11T23:18:21.580987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573853+0000","last_change":"2024-09-11T23:18:21.573853+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573853+0000","last_undegraded":"2024-09-11T23:18:21.573853+0000","last_fullsized":"2024-09-11T23:18:21.573853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576356+0000","last_change":"2024-09-11T23:18:21.576356+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576356+0000","last_undegraded":"2024-09-11T23:18:21.576356+0000","last_fullsized":"2024-09-11T23:18:21.576356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573787+0000","last_change":"2024-09-11T23:18:21.573787+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573787+0000","last_undegraded":"2024-09-11T23:18:21.573787+0000","last_fullsized":"2024-09-11T23:18:21.573787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573987+0000","last_change":"2024-09-11T23:18:21.573987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573987+0000","last_undegraded":"2024-09-11T23:18:21.573987+0000","last_fullsized":"2024-09-11T23:18:21.573987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580841+0000","last_change":"2024-09-11T23:18:21.580841+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580841+0000","last_undegraded":"2024-09-11T23:18:21.580841+0000","last_fullsized":"2024-09-11T23:18:21.580841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574395+0000","last_change":"2024-09-11T23:18:21.574395+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574395+0000","last_undegraded":"2024-09-11T23:18:21.574395+0000","last_fullsized":"2024-09-11T23:18:21.574395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574362+0000","last_change":"2024-09-11T23:18:21.574362+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574362+0000","last_undegraded":"2024-09-11T23:18:21.574362+0000","last_fullsized":"2024-09-11T23:18:21.574362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573182+0000","last_change":"2024-09-11T23:18:21.573182+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573182+0000","last_undegraded":"2024-09-11T23:18:21.573182+0000","last_fullsized":"2024-09-11T23:18:21.573182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572487+0000","last_change":"2024-09-11T23:18:21.572487+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572487+0000","last_undegraded":"2024-09-11T23:18:21.572487+0000","last_fullsized":"2024-09-11T23:18:21.572487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570942+0000","last_change":"2024-09-11T23:18:21.570942+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570942+0000","last_undegraded":"2024-09-11T23:18:21.570942+0000","last_fullsized":"2024-09-11T23:18:21.570942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572484+0000","last_change":"2024-09-11T23:18:21.572484+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572484+0000","last_undegraded":"2024-09-11T23:18:21.572484+0000","last_fullsized":"2024-09-11T23:18:21.572484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571495+0000","last_change":"2024-09-11T23:18:21.571495+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571495+0000","last_undegraded":"2024-09-11T23:18:21.571495+0000","last_fullsized":"2024-09-11T23:18:21.571495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581883+0000","last_change":"2024-09-11T23:18:21.580890+0000","last_active":"2024-09-11T23:18:21.581883+0000","last_peered":"2024-09-11T23:18:21.581883+0000","last_clean":"2024-09-11T23:18:21.581883+0000","last_became_active":"2024-09-11T23:18:21.580558+0000","last_became_peered":"2024-09-11T23:18:21.580558+0000","last_unstale":"2024-09-11T23:18:21.581883+0000","last_undegraded":"2024-09-11T23:18:21.581883+0000","last_fullsized":"2024-09-11T23:18:21.581883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:59.631938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576195+0000","last_change":"2024-09-11T23:18:21.576195+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576195+0000","last_undegraded":"2024-09-11T23:18:21.576195+0000","last_fullsized":"2024-09-11T23:18:21.576195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607917+0000","last_change":"2024-09-11T23:18:21.605242+0000","last_active":"2024-09-11T23:18:21.607917+0000","last_peered":"2024-09-11T23:18:21.607917+0000","last_clean":"2024-09-11T23:18:21.607917+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.607917+0000","last_undegraded":"2024-09-11T23:18:21.607917+0000","last_fullsized":"2024-09-11T23:18:21.607917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577727+0000","last_change":"2024-09-11T23:18:21.577727+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577727+0000","last_undegraded":"2024-09-11T23:18:21.577727+0000","last_fullsized":"2024-09-11T23:18:21.577727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606516+0000","last_change":"2024-09-11T23:18:21.600136+0000","last_active":"2024-09-11T23:18:21.606516+0000","last_peered":"2024-09-11T23:18:21.606516+0000","last_clean":"2024-09-11T23:18:21.606516+0000","last_became_active":"2024-09-11T23:18:21.597138+0000","last_became_peered":"2024-09-11T23:18:21.597138+0000","last_unstale":"2024-09-11T23:18:21.606516+0000","last_undegraded":"2024-09-11T23:18:21.606516+0000","last_fullsized":"2024-09-11T23:18:21.606516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580104+0000","last_change":"2024-09-11T23:18:21.580104+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580104+0000","last_undegraded":"2024-09-11T23:18:21.580104+0000","last_fullsized":"2024-09-11T23:18:21.580104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614398+0000","last_change":"2024-09-11T23:18:21.610459+0000","last_active":"2024-09-11T23:18:21.614398+0000","last_peered":"2024-09-11T23:18:21.614398+0000","last_clean":"2024-09-11T23:18:21.614398+0000","last_became_active":"2024-09-11T23:18:21.604546+0000","last_became_peered":"2024-09-11T23:18:21.604546+0000","last_unstale":"2024-09-11T23:18:21.614398+0000","last_undegraded":"2024-09-11T23:18:21.614398+0000","last_fullsized":"2024-09-11T23:18:21.614398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:20.492447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575035+0000","last_change":"2024-09-11T23:18:21.575035+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575035+0000","last_undegraded":"2024-09-11T23:18:21.575035+0000","last_fullsized":"2024-09-11T23:18:21.575035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602182+0000","last_change":"2024-09-11T23:18:21.600764+0000","last_active":"2024-09-11T23:18:21.602182+0000","last_peered":"2024-09-11T23:18:21.602182+0000","last_clean":"2024-09-11T23:18:21.602182+0000","last_became_active":"2024-09-11T23:18:21.600043+0000","last_became_peered":"2024-09-11T23:18:21.600043+0000","last_unstale":"2024-09-11T23:18:21.602182+0000","last_undegraded":"2024-09-11T23:18:21.602182+0000","last_fullsized":"2024-09-11T23:18:21.602182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:37.130140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573003+0000","last_change":"2024-09-11T23:18:21.573003+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573003+0000","last_undegraded":"2024-09-11T23:18:21.573003+0000","last_fullsized":"2024-09-11T23:18:21.573003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605130+0000","last_change":"2024-09-11T23:18:21.597322+0000","last_active":"2024-09-11T23:18:21.605130+0000","last_peered":"2024-09-11T23:18:21.605130+0000","last_clean":"2024-09-11T23:18:21.605130+0000","last_became_active":"2024-09-11T23:18:21.596479+0000","last_became_peered":"2024-09-11T23:18:21.596479+0000","last_unstale":"2024-09-11T23:18:21.605130+0000","last_undegraded":"2024-09-11T23:18:21.605130+0000","last_fullsized":"2024-09-11T23:18:21.605130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.578520+0000","last_change":"2024-09-11T23:18:21.578520+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.578520+0000","last_undegraded":"2024-09-11T23:18:21.578520+0000","last_fullsized":"2024-09-11T23:18:21.578520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.598269+0000","last_change":"2024-09-11T23:18:21.597750+0000","last_active":"2024-09-11T23:18:21.598269+0000","last_peered":"2024-09-11T23:18:21.598269+0000","last_clean":"2024-09-11T23:18:21.598269+0000","last_became_active":"2024-09-11T23:18:21.597419+0000","last_became_peered":"2024-09-11T23:18:21.597419+0000","last_unstale":"2024-09-11T23:18:21.598269+0000","last_undegraded":"2024-09-11T23:18:21.598269+0000","last_fullsized":"2024-09-11T23:18:21.598269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.587465+0000","last_change":"2024-09-11T23:18:21.587465+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.587465+0000","last_undegraded":"2024-09-11T23:18:21.587465+0000","last_fullsized":"2024-09-11T23:18:21.587465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.602352+0000","last_change":"2024-09-11T23:18:21.601997+0000","last_active":"2024-09-11T23:18:21.602352+0000","last_peered":"2024-09-11T23:18:21.602352+0000","last_clean":"2024-09-11T23:18:21.602352+0000","last_became_active":"2024-09-11T23:18:21.601557+0000","last_became_peered":"2024-09-11T23:18:21.601557+0000","last_unstale":"2024-09-11T23:18:21.602352+0000","last_undegraded":"2024-09-11T23:18:21.602352+0000","last_fullsized":"2024-09-11T23:18:21.602352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:39.744498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572822+0000","last_change":"2024-09-11T23:18:21.572822+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572822+0000","last_undegraded":"2024-09-11T23:18:21.572822+0000","last_fullsized":"2024-09-11T23:18:21.572822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608618+0000","last_change":"2024-09-11T23:18:21.606163+0000","last_active":"2024-09-11T23:18:21.608618+0000","last_peered":"2024-09-11T23:18:21.608618+0000","last_clean":"2024-09-11T23:18:21.608618+0000","last_became_active":"2024-09-11T23:18:21.605050+0000","last_became_peered":"2024-09-11T23:18:21.605050+0000","last_unstale":"2024-09-11T23:18:21.608618+0000","last_undegraded":"2024-09-11T23:18:21.608618+0000","last_fullsized":"2024-09-11T23:18:21.608618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588993+0000","last_change":"2024-09-11T23:18:21.588993+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588993+0000","last_undegraded":"2024-09-11T23:18:21.588993+0000","last_fullsized":"2024-09-11T23:18:21.588993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605321+0000","last_change":"2024-09-11T23:18:21.600933+0000","last_active":"2024-09-11T23:18:21.605321+0000","last_peered":"2024-09-11T23:18:21.605321+0000","last_clean":"2024-09-11T23:18:21.605321+0000","last_became_active":"2024-09-11T23:18:21.600235+0000","last_became_peered":"2024-09-11T23:18:21.600235+0000","last_unstale":"2024-09-11T23:18:21.605321+0000","last_undegraded":"2024-09-11T23:18:21.605321+0000","last_fullsized":"2024-09-11T23:18:21.605321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:33.539899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575987+0000","last_change":"2024-09-11T23:18:21.575987+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575987+0000","last_undegraded":"2024-09-11T23:18:21.575987+0000","last_fullsized":"2024-09-11T23:18:21.575987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581754+0000","last_change":"2024-09-11T23:18:21.580034+0000","last_active":"2024-09-11T23:18:21.581754+0000","last_peered":"2024-09-11T23:18:21.581754+0000","last_clean":"2024-09-11T23:18:21.581754+0000","last_became_active":"2024-09-11T23:18:21.579736+0000","last_became_peered":"2024-09-11T23:18:21.579736+0000","last_unstale":"2024-09-11T23:18:21.581754+0000","last_undegraded":"2024-09-11T23:18:21.581754+0000","last_fullsized":"2024-09-11T23:18:21.581754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:04.945467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570534+0000","last_change":"2024-09-11T23:18:21.570534+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570534+0000","last_undegraded":"2024-09-11T23:18:21.570534+0000","last_fullsized":"2024-09-11T23:18:21.570534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.615599+0000","last_change":"2024-09-11T23:18:21.611858+0000","last_active":"2024-09-11T23:18:21.615599+0000","last_peered":"2024-09-11T23:18:21.615599+0000","last_clean":"2024-09-11T23:18:21.615599+0000","last_became_active":"2024-09-11T23:18:21.610397+0000","last_became_peered":"2024-09-11T23:18:21.610397+0000","last_unstale":"2024-09-11T23:18:21.615599+0000","last_undegraded":"2024-09-11T23:18:21.615599+0000","last_fullsized":"2024-09-11T23:18:21.615599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.087713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.581265+0000","last_change":"2024-09-11T23:18:21.581265+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.581265+0000","last_undegraded":"2024-09-11T23:18:21.581265+0000","last_fullsized":"2024-09-11T23:18:21.581265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.607776+0000","last_change":"2024-09-11T23:18:21.604083+0000","last_active":"2024-09-11T23:18:21.607776+0000","last_peered":"2024-09-11T23:18:21.607776+0000","last_clean":"2024-09-11T23:18:21.607776+0000","last_became_active":"2024-09-11T23:18:21.603406+0000","last_became_peered":"2024-09-11T23:18:21.603406+0000","last_unstale":"2024-09-11T23:18:21.607776+0000","last_undegraded":"2024-09-11T23:18:21.607776+0000","last_fullsized":"2024-09-11T23:18:21.607776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.590372+0000","last_change":"2024-09-11T23:18:21.590372+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.590372+0000","last_undegraded":"2024-09-11T23:18:21.590372+0000","last_fullsized":"2024-09-11T23:18:21.590372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603108+0000","last_change":"2024-09-11T23:18:21.598505+0000","last_active":"2024-09-11T23:18:21.603108+0000","last_peered":"2024-09-11T23:18:21.603108+0000","last_clean":"2024-09-11T23:18:21.603108+0000","last_became_active":"2024-09-11T23:18:21.597672+0000","last_became_peered":"2024-09-11T23:18:21.597672+0000","last_unstale":"2024-09-11T23:18:21.603108+0000","last_undegraded":"2024-09-11T23:18:21.603108+0000","last_fullsized":"2024-09-11T23:18:21.603108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583494+0000","last_change":"2024-09-11T23:18:21.583494+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583494+0000","last_undegraded":"2024-09-11T23:18:21.583494+0000","last_fullsized":"2024-09-11T23:18:21.583494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581695+0000","last_change":"2024-09-11T23:18:21.580243+0000","last_active":"2024-09-11T23:18:21.581695+0000","last_peered":"2024-09-11T23:18:21.581695+0000","last_clean":"2024-09-11T23:18:21.581695+0000","last_became_active":"2024-09-11T23:18:21.579532+0000","last_became_peered":"2024-09-11T23:18:21.579532+0000","last_unstale":"2024-09-11T23:18:21.581695+0000","last_undegraded":"2024-09-11T23:18:21.581695+0000","last_fullsized":"2024-09-11T23:18:21.581695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.586462+0000","last_change":"2024-09-11T23:18:21.586462+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.586462+0000","last_undegraded":"2024-09-11T23:18:21.586462+0000","last_fullsized":"2024-09-11T23:18:21.586462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.601925+0000","last_change":"2024-09-11T23:18:21.601616+0000","last_active":"2024-09-11T23:18:21.601925+0000","last_peered":"2024-09-11T23:18:21.601925+0000","last_clean":"2024-09-11T23:18:21.601925+0000","last_became_active":"2024-09-11T23:18:21.601352+0000","last_became_peered":"2024-09-11T23:18:21.601352+0000","last_unstale":"2024-09-11T23:18:21.601925+0000","last_undegraded":"2024-09-11T23:18:21.601925+0000","last_fullsized":"2024-09-11T23:18:21.601925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575231+0000","last_change":"2024-09-11T23:18:21.575231+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575231+0000","last_undegraded":"2024-09-11T23:18:21.575231+0000","last_fullsized":"2024-09-11T23:18:21.575231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.603371+0000","last_change":"2024-09-11T23:18:21.599580+0000","last_active":"2024-09-11T23:18:21.603371+0000","last_peered":"2024-09-11T23:18:21.603371+0000","last_clean":"2024-09-11T23:18:21.603371+0000","last_became_active":"2024-09-11T23:18:21.598795+0000","last_became_peered":"2024-09-11T23:18:21.598795+0000","last_unstale":"2024-09-11T23:18:21.603371+0000","last_undegraded":"2024-09-11T23:18:21.603371+0000","last_fullsized":"2024-09-11T23:18:21.603371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:31.819160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571990+0000","last_change":"2024-09-11T23:18:21.571990+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571990+0000","last_undegraded":"2024-09-11T23:18:21.571990+0000","last_fullsized":"2024-09-11T23:18:21.571990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.599994+0000","last_change":"2024-09-11T23:18:21.590812+0000","last_active":"2024-09-11T23:18:21.599994+0000","last_peered":"2024-09-11T23:18:21.599994+0000","last_clean":"2024-09-11T23:18:21.599994+0000","last_became_active":"2024-09-11T23:18:21.590053+0000","last_became_peered":"2024-09-11T23:18:21.590053+0000","last_unstale":"2024-09-11T23:18:21.599994+0000","last_undegraded":"2024-09-11T23:18:21.599994+0000","last_fullsized":"2024-09-11T23:18:21.599994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:24.137805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.571868+0000","last_change":"2024-09-11T23:18:21.571868+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.571868+0000","last_undegraded":"2024-09-11T23:18:21.571868+0000","last_fullsized":"2024-09-11T23:18:21.571868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.593347+0000","last_change":"2024-09-11T23:18:21.592958+0000","last_active":"2024-09-11T23:18:21.593347+0000","last_peered":"2024-09-11T23:18:21.593347+0000","last_clean":"2024-09-11T23:18:21.593347+0000","last_became_active":"2024-09-11T23:18:21.592461+0000","last_became_peered":"2024-09-11T23:18:21.592461+0000","last_unstale":"2024-09-11T23:18:21.593347+0000","last_undegraded":"2024-09-11T23:18:21.593347+0000","last_fullsized":"2024-09-11T23:18:21.593347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:59.694150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.575042+0000","last_change":"2024-09-11T23:18:21.575042+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.575042+0000","last_undegraded":"2024-09-11T23:18:21.575042+0000","last_fullsized":"2024-09-11T23:18:21.575042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581938+0000","last_change":"2024-09-11T23:18:21.580569+0000","last_active":"2024-09-11T23:18:21.581938+0000","last_peered":"2024-09-11T23:18:21.581938+0000","last_clean":"2024-09-11T23:18:21.581938+0000","last_became_active":"2024-09-11T23:18:21.580129+0000","last_became_peered":"2024-09-11T23:18:21.580129+0000","last_unstale":"2024-09-11T23:18:21.581938+0000","last_undegraded":"2024-09-11T23:18:21.581938+0000","last_fullsized":"2024-09-11T23:18:21.581938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:21.999989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.574508+0000","last_change":"2024-09-11T23:18:21.574508+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.574508+0000","last_undegraded":"2024-09-11T23:18:21.574508+0000","last_fullsized":"2024-09-11T23:18:21.574508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.584390+0000","last_change":"2024-09-11T23:18:21.582981+0000","last_active":"2024-09-11T23:18:21.584390+0000","last_peered":"2024-09-11T23:18:21.584390+0000","last_clean":"2024-09-11T23:18:21.584390+0000","last_became_active":"2024-09-11T23:18:21.582670+0000","last_became_peered":"2024-09-11T23:18:21.582670+0000","last_unstale":"2024-09-11T23:18:21.584390+0000","last_undegraded":"2024-09-11T23:18:21.584390+0000","last_fullsized":"2024-09-11T23:18:21.584390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:09.147103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576159+0000","last_change":"2024-09-11T23:18:21.576159+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576159+0000","last_undegraded":"2024-09-11T23:18:21.576159+0000","last_fullsized":"2024-09-11T23:18:21.576159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604305+0000","last_change":"2024-09-11T23:18:21.603816+0000","last_active":"2024-09-11T23:18:21.604305+0000","last_peered":"2024-09-11T23:18:21.604305+0000","last_clean":"2024-09-11T23:18:21.604305+0000","last_became_active":"2024-09-11T23:18:21.603447+0000","last_became_peered":"2024-09-11T23:18:21.603447+0000","last_unstale":"2024-09-11T23:18:21.604305+0000","last_undegraded":"2024-09-11T23:18:21.604305+0000","last_fullsized":"2024-09-11T23:18:21.604305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:05.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.585339+0000","last_change":"2024-09-11T23:18:21.585339+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.585339+0000","last_undegraded":"2024-09-11T23:18:21.585339+0000","last_fullsized":"2024-09-11T23:18:21.585339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604284+0000","last_change":"2024-09-11T23:18:21.603657+0000","last_active":"2024-09-11T23:18:21.604284+0000","last_peered":"2024-09-11T23:18:21.604284+0000","last_clean":"2024-09-11T23:18:21.604284+0000","last_became_active":"2024-09-11T23:18:21.603317+0000","last_became_peered":"2024-09-11T23:18:21.603317+0000","last_unstale":"2024-09-11T23:18:21.604284+0000","last_undegraded":"2024-09-11T23:18:21.604284+0000","last_fullsized":"2024-09-11T23:18:21.604284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:21.029059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.577647+0000","last_change":"2024-09-11T23:18:21.577647+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.577647+0000","last_undegraded":"2024-09-11T23:18:21.577647+0000","last_fullsized":"2024-09-11T23:18:21.577647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.605048+0000","last_change":"2024-09-11T23:18:21.597127+0000","last_active":"2024-09-11T23:18:21.605048+0000","last_peered":"2024-09-11T23:18:21.605048+0000","last_clean":"2024-09-11T23:18:21.605048+0000","last_became_active":"2024-09-11T23:18:21.596156+0000","last_became_peered":"2024-09-11T23:18:21.596156+0000","last_unstale":"2024-09-11T23:18:21.605048+0000","last_undegraded":"2024-09-11T23:18:21.605048+0000","last_fullsized":"2024-09-11T23:18:21.605048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:44.492833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.580959+0000","last_change":"2024-09-11T23:18:21.580959+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.580959+0000","last_undegraded":"2024-09-11T23:18:21.580959+0000","last_fullsized":"2024-09-11T23:18:21.580959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.582034+0000","last_change":"2024-09-11T23:18:21.580858+0000","last_active":"2024-09-11T23:18:21.582034+0000","last_peered":"2024-09-11T23:18:21.582034+0000","last_clean":"2024-09-11T23:18:21.582034+0000","last_became_active":"2024-09-11T23:18:21.580498+0000","last_became_peered":"2024-09-11T23:18:21.580498+0000","last_unstale":"2024-09-11T23:18:21.582034+0000","last_undegraded":"2024-09-11T23:18:21.582034+0000","last_fullsized":"2024-09-11T23:18:21.582034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.576434+0000","last_change":"2024-09-11T23:18:21.576434+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.576434+0000","last_undegraded":"2024-09-11T23:18:21.576434+0000","last_fullsized":"2024-09-11T23:18:21.576434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.606568+0000","last_change":"2024-09-11T23:18:21.600773+0000","last_active":"2024-09-11T23:18:21.606568+0000","last_peered":"2024-09-11T23:18:21.606568+0000","last_clean":"2024-09-11T23:18:21.606568+0000","last_became_active":"2024-09-11T23:18:21.600084+0000","last_became_peered":"2024-09-11T23:18:21.600084+0000","last_unstale":"2024-09-11T23:18:21.606568+0000","last_undegraded":"2024-09-11T23:18:21.606568+0000","last_fullsized":"2024-09-11T23:18:21.606568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.247322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.572760+0000","last_change":"2024-09-11T23:18:21.572760+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.572760+0000","last_undegraded":"2024-09-11T23:18:21.572760+0000","last_fullsized":"2024-09-11T23:18:21.572760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.608519+0000","last_change":"2024-09-11T23:18:21.605831+0000","last_active":"2024-09-11T23:18:21.608519+0000","last_peered":"2024-09-11T23:18:21.608519+0000","last_clean":"2024-09-11T23:18:21.608519+0000","last_became_active":"2024-09-11T23:18:21.604947+0000","last_became_peered":"2024-09-11T23:18:21.604947+0000","last_unstale":"2024-09-11T23:18:21.608519+0000","last_undegraded":"2024-09-11T23:18:21.608519+0000","last_fullsized":"2024-09-11T23:18:21.608519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.588889+0000","last_change":"2024-09-11T23:18:21.588889+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.588889+0000","last_undegraded":"2024-09-11T23:18:21.588889+0000","last_fullsized":"2024-09-11T23:18:21.588889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614412+0000","last_change":"2024-09-11T23:18:21.610589+0000","last_active":"2024-09-11T23:18:21.614412+0000","last_peered":"2024-09-11T23:18:21.614412+0000","last_clean":"2024-09-11T23:18:21.614412+0000","last_became_active":"2024-09-11T23:18:21.604520+0000","last_became_peered":"2024-09-11T23:18:21.604520+0000","last_unstale":"2024-09-11T23:18:21.614412+0000","last_undegraded":"2024-09-11T23:18:21.614412+0000","last_fullsized":"2024-09-11T23:18:21.614412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:40.792715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.583357+0000","last_change":"2024-09-11T23:18:21.583357+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.583357+0000","last_undegraded":"2024-09-11T23:18:21.583357+0000","last_fullsized":"2024-09-11T23:18:21.583357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.581983+0000","last_change":"2024-09-11T23:18:21.580668+0000","last_active":"2024-09-11T23:18:21.581983+0000","last_peered":"2024-09-11T23:18:21.581983+0000","last_clean":"2024-09-11T23:18:21.581983+0000","last_became_active":"2024-09-11T23:18:21.580346+0000","last_became_peered":"2024-09-11T23:18:21.580346+0000","last_unstale":"2024-09-11T23:18:21.581983+0000","last_undegraded":"2024-09-11T23:18:21.581983+0000","last_fullsized":"2024-09-11T23:18:21.581983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:26.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570640+0000","last_change":"2024-09-11T23:18:21.570640+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570640+0000","last_undegraded":"2024-09-11T23:18:21.570640+0000","last_fullsized":"2024-09-11T23:18:21.570640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.614502+0000","last_change":"2024-09-11T23:18:21.610976+0000","last_active":"2024-09-11T23:18:21.614502+0000","last_peered":"2024-09-11T23:18:21.614502+0000","last_clean":"2024-09-11T23:18:21.614502+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:21.614502+0000","last_undegraded":"2024-09-11T23:18:21.614502+0000","last_fullsized":"2024-09-11T23:18:21.614502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:33.389328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.570512+0000","last_change":"2024-09-11T23:18:21.570512+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.570512+0000","last_undegraded":"2024-09-11T23:18:21.570512+0000","last_fullsized":"2024-09-11T23:18:21.570512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.583531+0000","last_change":"2024-09-11T23:18:21.582739+0000","last_active":"2024-09-11T23:18:21.583531+0000","last_peered":"2024-09-11T23:18:21.583531+0000","last_clean":"2024-09-11T23:18:21.583531+0000","last_became_active":"2024-09-11T23:18:21.582400+0000","last_became_peered":"2024-09-11T23:18:21.582400+0000","last_unstale":"2024-09-11T23:18:21.583531+0000","last_undegraded":"2024-09-11T23:18:21.583531+0000","last_fullsized":"2024-09-11T23:18:21.583531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.837002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-11T23:18:21.573245+0000","last_change":"2024-09-11T23:18:21.573245+0000","last_active":"2024-09-11T23:18:21.552389+0000","last_peered":"2024-09-11T23:18:21.552389+0000","last_clean":"2024-09-11T23:18:21.552389+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:21.573245+0000","last_undegraded":"2024-09-11T23:18:21.573245+0000","last_fullsized":"2024-09-11T23:18:21.573245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.604294+0000","last_change":"2024-09-11T23:18:21.603704+0000","last_active":"2024-09-11T23:18:21.604294+0000","last_peered":"2024-09-11T23:18:21.604294+0000","last_clean":"2024-09-11T23:18:21.604294+0000","last_became_active":"2024-09-11T23:18:21.603309+0000","last_became_peered":"2024-09-11T23:18:21.603309+0000","last_unstale":"2024-09-11T23:18:21.604294+0000","last_undegraded":"2024-09-11T23:18:21.604294+0000","last_fullsized":"2024-09-11T23:18:21.604294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:39.912926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-11T23:18:21.577549+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:18:21.577549+0000","last_peered":"2024-09-11T23:18:21.577549+0000","last_clean":"2024-09-11T23:18:21.577549+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:18:21.577549+0000","last_undegraded":"2024-09-11T23:18:21.577549+0000","last_fullsized":"2024-09-11T23:18:21.577549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":892928,"data_stored":405241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36212,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335628,"statfs":{"total":96636764160,"available":96599683072,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":880640,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1474560,"data_stored":988942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:31.027 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:31.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a1a28a640 1 Processor -- start 2024-09-11T23:18:31.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a1a28a640 1 -- start start 2024-09-11T23:18:31.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a1a28a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7a1415bec0 0x7f7a140ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a1a28a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415c2a0 0x7f7a140aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a1a28a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a140b3290 con 0x7f7a140af2a0 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a1a28a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7a140b3570 con 0x7f7a1415bec0 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a1a28a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a140b3850 con 0x7f7a1415c2a0 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a13fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7a1415bec0 0x7f7a140ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a18827640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7a140af2a0 0x7f7a1415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47234/0 (socket says 172.21.15.94:47234) 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a18827640 1 -- 172.21.15.94:0/2082825002 learned_addr learned my addr 172.21.15.94:0/2082825002 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a137fe640 1 --2- 172.21.15.94:0/2082825002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415c2a0 0x7f7a140aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a13fff640 1 -- 172.21.15.94:0/2082825002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415c2a0 msgr2=0x7f7a140aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a13fff640 1 --2- 172.21.15.94:0/2082825002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415c2a0 0x7f7a140aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a13fff640 1 -- 172.21.15.94:0/2082825002 >> v1:172.21.15.94:6789/0 conn(0x7f7a140af2a0 legacy=0x7f7a1415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a13fff640 1 -- 172.21.15.94:0/2082825002 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a140b3b30 con 0x7f7a1415bec0 2024-09-11T23:18:31.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.161+0000 7f7a12ffd640 1 -- 172.21.15.94:0/2082825002 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374944663 0 0) 0x7f7a140b3290 con 0x7f7a140af2a0 2024-09-11T23:18:31.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a13fff640 1 --2- 172.21.15.94:0/2082825002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a1415bec0 0x7f7a140ad200 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097c0 tx=0x7f7a0401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fa0432946c6de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a12ffd640 1 -- 172.21.15.94:0/2082825002 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040a7070 con 0x7f7a1415bec0 2024-09-11T23:18:31.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a12ffd640 1 -- 172.21.15.94:0/2082825002 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a040b0070 con 0x7f7a1415bec0 2024-09-11T23:18:31.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a12ffd640 1 -- 172.21.15.94:0/2082825002 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040ab890 con 0x7f7a1415bec0 2024-09-11T23:18:31.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 -- 172.21.15.94:0/2082825002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a1415bec0 msgr2=0x7f7a140ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/2082825002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a1415bec0 0x7f7a140ad200 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097c0 tx=0x7f7a0401c470 comp rx=0 tx=0).stop 2024-09-11T23:18:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 -- 172.21.15.94:0/2082825002 shutdown_connections 2024-09-11T23:18:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/2082825002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415c2a0 0x7f7a140aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/2082825002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a1415bec0 0x7f7a140ad200 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 -- 172.21.15.94:0/2082825002 >> 172.21.15.94:0/2082825002 conn(0x7f7a140b1f90 msgr2=0x7f7a140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 -- 172.21.15.94:0/2082825002 shutdown_connections 2024-09-11T23:18:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 -- 172.21.15.94:0/2082825002 wait complete. 2024-09-11T23:18:31.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 Processor -- start 2024-09-11T23:18:31.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.165+0000 7f7a1a28a640 1 -- start start 2024-09-11T23:18:31.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a140af2a0 0x7f7a1415d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415bec0 0x7f7a1415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a1415c2a0 0x7f7a140cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7a140af6f0 con 0x7f7a140af2a0 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a140ad740 con 0x7f7a1415c2a0 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a14169000 con 0x7f7a1415bec0 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a140af2a0 0x7f7a1415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a140af2a0 0x7f7a1415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36056/0 (socket says 172.21.15.94:36056) 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 -- 172.21.15.94:0/286917168 learned_addr learned my addr 172.21.15.94:0/286917168 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a18827640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a1415c2a0 0x7f7a140cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 -- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415bec0 msgr2=0x7f7a1415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415bec0 0x7f7a1415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 -- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a1415c2a0 msgr2=0x7f7a140cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a1415c2a0 0x7f7a140cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 -- 172.21.15.94:0/286917168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a14156e30 con 0x7f7a140af2a0 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a13fff640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a140af2a0 0x7f7a1415d950 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7a0401a0a0 tx=0x7f7a0401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a10ff9640 1 -- 172.21.15.94:0/286917168 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040bf610 con 0x7f7a140af2a0 2024-09-11T23:18:31.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a10ff9640 1 -- 172.21.15.94:0/286917168 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a040bf7b0 con 0x7f7a140af2a0 2024-09-11T23:18:31.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a14157110 con 0x7f7a140af2a0 2024-09-11T23:18:31.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a10ff9640 1 -- 172.21.15.94:0/286917168 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040bfba0 con 0x7f7a140af2a0 2024-09-11T23:18:31.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a141576d0 con 0x7f7a140af2a0 2024-09-11T23:18:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a140ad200 con 0x7f7a140af2a0 2024-09-11T23:18:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a10ff9640 1 -- 172.21.15.94:0/286917168 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a040bd020 con 0x7f7a140af2a0 2024-09-11T23:18:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a10ff9640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7a000678c0 0x7f7a00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a10ff9640 1 -- 172.21.15.94:0/286917168 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f7a04120590 con 0x7f7a140af2a0 2024-09-11T23:18:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a137fe640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7a000678c0 0x7f7a00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.169+0000 7f7a137fe640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7a000678c0 0x7f7a00069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7a14159550 tx=0x7f7a08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.173+0000 7f7a10ff9640 1 -- 172.21.15.94:0/286917168 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a04016090 con 0x7f7a140af2a0 2024-09-11T23:18:31.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.329+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a1406fcd0 con 0x7f7a000678c0 2024-09-11T23:18:31.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.349+0000 7f7a10ff9640 1 -- 172.21.15.94:0/286917168 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252073 (secure 0 0 0) 0x7f7a1406fcd0 con 0x7f7a000678c0 2024-09-11T23:18:31.352 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:31.353 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7a000678c0 msgr2=0x7f7a00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7a000678c0 0x7f7a00069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7a14159550 tx=0x7f7a08008040 comp rx=0 tx=0).stop 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a140af2a0 msgr2=0x7f7a1415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a140af2a0 0x7f7a1415d950 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7a0401a0a0 tx=0x7f7a0401acb0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 shutdown_connections 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a1415c2a0 0x7f7a140cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a1415bec0 0x7f7a1415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7a000678c0 0x7f7a00069d80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 --2- 172.21.15.94:0/286917168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a140af2a0 0x7f7a1415d950 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 >> 172.21.15.94:0/286917168 conn(0x7f7a140b1f90 msgr2=0x7f7a140afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 shutdown_connections 2024-09-11T23:18:31.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.353+0000 7f7a1a28a640 1 -- 172.21.15.94:0/286917168 wait complete. 2024-09-11T23:18:31.370 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-11T23:18:30.035273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278736,"kb_used_data":8392,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695984,"statfs":{"total":773094113280,"available":772808687616,"internally_reserved":0,"allocated":8593408,"data_stored":4538356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002916"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.576350+0000","last_change":"2024-09-11T23:18:22.599060+0000","last_active":"2024-09-11T23:18:23.576350+0000","last_peered":"2024-09-11T23:18:23.576350+0000","last_clean":"2024-09-11T23:18:23.576350+0000","last_became_active":"2024-09-11T23:18:22.598385+0000","last_became_peered":"2024-09-11T23:18:22.598385+0000","last_unstale":"2024-09-11T23:18:23.576350+0000","last_undegraded":"2024-09-11T23:18:23.576350+0000","last_fullsized":"2024-09-11T23:18:23.576350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:55.506629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.601090+0000","last_change":"2024-09-11T23:18:22.613776+0000","last_active":"2024-09-11T23:18:23.601090+0000","last_peered":"2024-09-11T23:18:23.601090+0000","last_clean":"2024-09-11T23:18:23.601090+0000","last_became_active":"2024-09-11T23:18:22.612286+0000","last_became_peered":"2024-09-11T23:18:22.612286+0000","last_unstale":"2024-09-11T23:18:23.601090+0000","last_undegraded":"2024-09-11T23:18:23.601090+0000","last_fullsized":"2024-09-11T23:18:23.601090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:38.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.650954+0000","last_change":"2024-09-11T23:18:22.620491+0000","last_active":"2024-09-11T23:18:23.650954+0000","last_peered":"2024-09-11T23:18:23.650954+0000","last_clean":"2024-09-11T23:18:23.650954+0000","last_became_active":"2024-09-11T23:18:22.619932+0000","last_became_peered":"2024-09-11T23:18:22.619932+0000","last_unstale":"2024-09-11T23:18:23.650954+0000","last_undegraded":"2024-09-11T23:18:23.650954+0000","last_fullsized":"2024-09-11T23:18:23.650954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:13.165527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574800+0000","last_change":"2024-09-11T23:18:22.591227+0000","last_active":"2024-09-11T23:18:23.574800+0000","last_peered":"2024-09-11T23:18:23.574800+0000","last_clean":"2024-09-11T23:18:23.574800+0000","last_became_active":"2024-09-11T23:18:22.590546+0000","last_became_peered":"2024-09-11T23:18:22.590546+0000","last_unstale":"2024-09-11T23:18:23.574800+0000","last_undegraded":"2024-09-11T23:18:23.574800+0000","last_fullsized":"2024-09-11T23:18:23.574800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:08.307418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605527+0000","last_change":"2024-09-11T23:18:22.600727+0000","last_active":"2024-09-11T23:18:23.605527+0000","last_peered":"2024-09-11T23:18:23.605527+0000","last_clean":"2024-09-11T23:18:23.605527+0000","last_became_active":"2024-09-11T23:18:22.600280+0000","last_became_peered":"2024-09-11T23:18:22.600280+0000","last_unstale":"2024-09-11T23:18:23.605527+0000","last_undegraded":"2024-09-11T23:18:23.605527+0000","last_fullsized":"2024-09-11T23:18:23.605527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:00.924248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.572709+0000","last_change":"2024-09-11T23:18:22.609156+0000","last_active":"2024-09-11T23:18:23.572709+0000","last_peered":"2024-09-11T23:18:23.572709+0000","last_clean":"2024-09-11T23:18:23.572709+0000","last_became_active":"2024-09-11T23:18:22.602408+0000","last_became_peered":"2024-09-11T23:18:22.602408+0000","last_unstale":"2024-09-11T23:18:23.572709+0000","last_undegraded":"2024-09-11T23:18:23.572709+0000","last_fullsized":"2024-09-11T23:18:23.572709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:30.491519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187317+0000","last_change":"2024-09-11T23:18:22.606214+0000","last_active":"2024-09-11T23:18:24.187317+0000","last_peered":"2024-09-11T23:18:24.187317+0000","last_clean":"2024-09-11T23:18:24.187317+0000","last_became_active":"2024-09-11T23:18:22.605941+0000","last_became_peered":"2024-09-11T23:18:22.605941+0000","last_unstale":"2024-09-11T23:18:24.187317+0000","last_undegraded":"2024-09-11T23:18:24.187317+0000","last_fullsized":"2024-09-11T23:18:24.187317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.087892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.604987+0000","last_change":"2024-09-11T23:18:22.601815+0000","last_active":"2024-09-11T23:18:23.604987+0000","last_peered":"2024-09-11T23:18:23.604987+0000","last_clean":"2024-09-11T23:18:23.604987+0000","last_became_active":"2024-09-11T23:18:22.601503+0000","last_became_peered":"2024-09-11T23:18:22.601503+0000","last_unstale":"2024-09-11T23:18:23.604987+0000","last_undegraded":"2024-09-11T23:18:23.604987+0000","last_fullsized":"2024-09-11T23:18:23.604987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:58.559209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187196+0000","last_change":"2024-09-11T23:18:22.583725+0000","last_active":"2024-09-11T23:18:24.187196+0000","last_peered":"2024-09-11T23:18:24.187196+0000","last_clean":"2024-09-11T23:18:24.187196+0000","last_became_active":"2024-09-11T23:18:22.582853+0000","last_became_peered":"2024-09-11T23:18:22.582853+0000","last_unstale":"2024-09-11T23:18:24.187196+0000","last_undegraded":"2024-09-11T23:18:24.187196+0000","last_fullsized":"2024-09-11T23:18:24.187196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:23.011638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574499+0000","last_change":"2024-09-11T23:18:22.607555+0000","last_active":"2024-09-11T23:18:23.574499+0000","last_peered":"2024-09-11T23:18:23.574499+0000","last_clean":"2024-09-11T23:18:23.574499+0000","last_became_active":"2024-09-11T23:18:22.607180+0000","last_became_peered":"2024-09-11T23:18:22.607180+0000","last_unstale":"2024-09-11T23:18:23.574499+0000","last_undegraded":"2024-09-11T23:18:23.574499+0000","last_fullsized":"2024-09-11T23:18:23.574499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:34.818512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600733+0000","last_change":"2024-09-11T23:18:22.600487+0000","last_active":"2024-09-11T23:18:23.600733+0000","last_peered":"2024-09-11T23:18:23.600733+0000","last_clean":"2024-09-11T23:18:23.600733+0000","last_became_active":"2024-09-11T23:18:22.600098+0000","last_became_peered":"2024-09-11T23:18:22.600098+0000","last_unstale":"2024-09-11T23:18:23.600733+0000","last_undegraded":"2024-09-11T23:18:23.600733+0000","last_fullsized":"2024-09-11T23:18:23.600733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:27.598303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575160+0000","last_change":"2024-09-11T23:18:22.587504+0000","last_active":"2024-09-11T23:18:23.575160+0000","last_peered":"2024-09-11T23:18:23.575160+0000","last_clean":"2024-09-11T23:18:23.575160+0000","last_became_active":"2024-09-11T23:18:22.586792+0000","last_became_peered":"2024-09-11T23:18:22.586792+0000","last_unstale":"2024-09-11T23:18:23.575160+0000","last_undegraded":"2024-09-11T23:18:23.575160+0000","last_fullsized":"2024-09-11T23:18:23.575160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:07.365465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605688+0000","last_change":"2024-09-11T23:18:22.612521+0000","last_active":"2024-09-11T23:18:23.605688+0000","last_peered":"2024-09-11T23:18:23.605688+0000","last_clean":"2024-09-11T23:18:23.605688+0000","last_became_active":"2024-09-11T23:18:22.612087+0000","last_became_peered":"2024-09-11T23:18:22.612087+0000","last_unstale":"2024-09-11T23:18:23.605688+0000","last_undegraded":"2024-09-11T23:18:23.605688+0000","last_fullsized":"2024-09-11T23:18:23.605688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:08.678001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.573322+0000","last_change":"2024-09-11T23:18:22.617172+0000","last_active":"2024-09-11T23:18:23.573322+0000","last_peered":"2024-09-11T23:18:23.573322+0000","last_clean":"2024-09-11T23:18:23.573322+0000","last_became_active":"2024-09-11T23:18:22.607184+0000","last_became_peered":"2024-09-11T23:18:22.607184+0000","last_unstale":"2024-09-11T23:18:23.573322+0000","last_undegraded":"2024-09-11T23:18:23.573322+0000","last_fullsized":"2024-09-11T23:18:23.573322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:11.502227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600187+0000","last_change":"2024-09-11T23:18:22.613426+0000","last_active":"2024-09-11T23:18:23.600187+0000","last_peered":"2024-09-11T23:18:23.600187+0000","last_clean":"2024-09-11T23:18:23.600187+0000","last_became_active":"2024-09-11T23:18:22.612467+0000","last_became_peered":"2024-09-11T23:18:22.612467+0000","last_unstale":"2024-09-11T23:18:23.600187+0000","last_undegraded":"2024-09-11T23:18:23.600187+0000","last_fullsized":"2024-09-11T23:18:23.600187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:11.502227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575030+0000","last_change":"2024-09-11T23:18:22.603382+0000","last_active":"2024-09-11T23:18:23.575030+0000","last_peered":"2024-09-11T23:18:23.575030+0000","last_clean":"2024-09-11T23:18:23.575030+0000","last_became_active":"2024-09-11T23:18:22.602462+0000","last_became_peered":"2024-09-11T23:18:22.602462+0000","last_unstale":"2024-09-11T23:18:23.575030+0000","last_undegraded":"2024-09-11T23:18:23.575030+0000","last_fullsized":"2024-09-11T23:18:23.575030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:21.210367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.606385+0000","last_change":"2024-09-11T23:18:22.603919+0000","last_active":"2024-09-11T23:18:23.606385+0000","last_peered":"2024-09-11T23:18:23.606385+0000","last_clean":"2024-09-11T23:18:23.606385+0000","last_became_active":"2024-09-11T23:18:22.603566+0000","last_became_peered":"2024-09-11T23:18:22.603566+0000","last_unstale":"2024-09-11T23:18:23.606385+0000","last_undegraded":"2024-09-11T23:18:23.606385+0000","last_fullsized":"2024-09-11T23:18:23.606385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:54.147634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.651085+0000","last_change":"2024-09-11T23:18:22.609819+0000","last_active":"2024-09-11T23:18:23.651085+0000","last_peered":"2024-09-11T23:18:23.651085+0000","last_clean":"2024-09-11T23:18:23.651085+0000","last_became_active":"2024-09-11T23:18:22.609137+0000","last_became_peered":"2024-09-11T23:18:22.609137+0000","last_unstale":"2024-09-11T23:18:23.651085+0000","last_undegraded":"2024-09-11T23:18:23.651085+0000","last_fullsized":"2024-09-11T23:18:23.651085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:22.040708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.573324+0000","last_change":"2024-09-11T23:18:22.615748+0000","last_active":"2024-09-11T23:18:23.573324+0000","last_peered":"2024-09-11T23:18:23.573324+0000","last_clean":"2024-09-11T23:18:23.573324+0000","last_became_active":"2024-09-11T23:18:22.609786+0000","last_became_peered":"2024-09-11T23:18:22.609786+0000","last_unstale":"2024-09-11T23:18:23.573324+0000","last_undegraded":"2024-09-11T23:18:23.573324+0000","last_fullsized":"2024-09-11T23:18:23.573324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:24.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605907+0000","last_change":"2024-09-11T23:18:22.611945+0000","last_active":"2024-09-11T23:18:23.605907+0000","last_peered":"2024-09-11T23:18:23.605907+0000","last_clean":"2024-09-11T23:18:23.605907+0000","last_became_active":"2024-09-11T23:18:22.611343+0000","last_became_peered":"2024-09-11T23:18:22.611343+0000","last_unstale":"2024-09-11T23:18:23.605907+0000","last_undegraded":"2024-09-11T23:18:23.605907+0000","last_fullsized":"2024-09-11T23:18:23.605907+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:34.673457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187524+0000","last_change":"2024-09-11T23:18:22.615604+0000","last_active":"2024-09-11T23:18:24.187524+0000","last_peered":"2024-09-11T23:18:24.187524+0000","last_clean":"2024-09-11T23:18:24.187524+0000","last_became_active":"2024-09-11T23:18:22.614822+0000","last_became_peered":"2024-09-11T23:18:22.614822+0000","last_unstale":"2024-09-11T23:18:24.187524+0000","last_undegraded":"2024-09-11T23:18:24.187524+0000","last_fullsized":"2024-09-11T23:18:24.187524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:55.707446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605228+0000","last_change":"2024-09-11T23:18:22.605430+0000","last_active":"2024-09-11T23:18:23.605228+0000","last_peered":"2024-09-11T23:18:23.605228+0000","last_clean":"2024-09-11T23:18:23.605228+0000","last_became_active":"2024-09-11T23:18:22.604814+0000","last_became_peered":"2024-09-11T23:18:22.604814+0000","last_unstale":"2024-09-11T23:18:23.605228+0000","last_undegraded":"2024-09-11T23:18:23.605228+0000","last_fullsized":"2024-09-11T23:18:23.605228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.878407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.186795+0000","last_change":"2024-09-11T23:18:22.597537+0000","last_active":"2024-09-11T23:18:24.186795+0000","last_peered":"2024-09-11T23:18:24.186795+0000","last_clean":"2024-09-11T23:18:24.186795+0000","last_became_active":"2024-09-11T23:18:22.597046+0000","last_became_peered":"2024-09-11T23:18:22.597046+0000","last_unstale":"2024-09-11T23:18:24.186795+0000","last_undegraded":"2024-09-11T23:18:24.186795+0000","last_fullsized":"2024-09-11T23:18:24.186795+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:35.397291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600056+0000","last_change":"2024-09-11T23:18:22.593697+0000","last_active":"2024-09-11T23:18:23.600056+0000","last_peered":"2024-09-11T23:18:23.600056+0000","last_clean":"2024-09-11T23:18:23.600056+0000","last_became_active":"2024-09-11T23:18:22.590225+0000","last_became_peered":"2024-09-11T23:18:22.590225+0000","last_unstale":"2024-09-11T23:18:23.600056+0000","last_undegraded":"2024-09-11T23:18:23.600056+0000","last_fullsized":"2024-09-11T23:18:23.600056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:55.506629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.601170+0000","last_change":"2024-09-11T23:18:22.591154+0000","last_active":"2024-09-11T23:18:23.601170+0000","last_peered":"2024-09-11T23:18:23.601170+0000","last_clean":"2024-09-11T23:18:23.601170+0000","last_became_active":"2024-09-11T23:18:22.590665+0000","last_became_peered":"2024-09-11T23:18:22.590665+0000","last_unstale":"2024-09-11T23:18:23.601170+0000","last_undegraded":"2024-09-11T23:18:23.601170+0000","last_fullsized":"2024-09-11T23:18:23.601170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:12.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574888+0000","last_change":"2024-09-11T23:18:22.587689+0000","last_active":"2024-09-11T23:18:23.574888+0000","last_peered":"2024-09-11T23:18:23.574888+0000","last_clean":"2024-09-11T23:18:23.574888+0000","last_became_active":"2024-09-11T23:18:22.586942+0000","last_became_peered":"2024-09-11T23:18:22.586942+0000","last_unstale":"2024-09-11T23:18:23.574888+0000","last_undegraded":"2024-09-11T23:18:23.574888+0000","last_fullsized":"2024-09-11T23:18:23.574888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:11.423970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575817+0000","last_change":"2024-09-11T23:18:22.603015+0000","last_active":"2024-09-11T23:18:23.575817+0000","last_peered":"2024-09-11T23:18:23.575817+0000","last_clean":"2024-09-11T23:18:23.575817+0000","last_became_active":"2024-09-11T23:18:22.602704+0000","last_became_peered":"2024-09-11T23:18:22.602704+0000","last_unstale":"2024-09-11T23:18:23.575817+0000","last_undegraded":"2024-09-11T23:18:23.575817+0000","last_fullsized":"2024-09-11T23:18:23.575817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:30.491519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.606296+0000","last_change":"2024-09-11T23:18:22.600143+0000","last_active":"2024-09-11T23:18:23.606296+0000","last_peered":"2024-09-11T23:18:23.606296+0000","last_clean":"2024-09-11T23:18:23.606296+0000","last_became_active":"2024-09-11T23:18:22.597937+0000","last_became_peered":"2024-09-11T23:18:22.597937+0000","last_unstale":"2024-09-11T23:18:23.606296+0000","last_undegraded":"2024-09-11T23:18:23.606296+0000","last_fullsized":"2024-09-11T23:18:23.606296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:41.907392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600355+0000","last_change":"2024-09-11T23:18:22.612772+0000","last_active":"2024-09-11T23:18:23.600355+0000","last_peered":"2024-09-11T23:18:23.600355+0000","last_clean":"2024-09-11T23:18:23.600355+0000","last_became_active":"2024-09-11T23:18:22.612384+0000","last_became_peered":"2024-09-11T23:18:22.612384+0000","last_unstale":"2024-09-11T23:18:23.600355+0000","last_undegraded":"2024-09-11T23:18:23.600355+0000","last_fullsized":"2024-09-11T23:18:23.600355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:55.057869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574172+0000","last_change":"2024-09-11T23:18:22.597969+0000","last_active":"2024-09-11T23:18:23.574172+0000","last_peered":"2024-09-11T23:18:23.574172+0000","last_clean":"2024-09-11T23:18:23.574172+0000","last_became_active":"2024-09-11T23:18:22.597609+0000","last_became_peered":"2024-09-11T23:18:22.597609+0000","last_unstale":"2024-09-11T23:18:23.574172+0000","last_undegraded":"2024-09-11T23:18:23.574172+0000","last_fullsized":"2024-09-11T23:18:23.574172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:29.032270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.650628+0000","last_change":"2024-09-11T23:18:22.608163+0000","last_active":"2024-09-11T23:18:23.650628+0000","last_peered":"2024-09-11T23:18:23.650628+0000","last_clean":"2024-09-11T23:18:23.650628+0000","last_became_active":"2024-09-11T23:18:22.607555+0000","last_became_peered":"2024-09-11T23:18:22.607555+0000","last_unstale":"2024-09-11T23:18:23.650628+0000","last_undegraded":"2024-09-11T23:18:23.650628+0000","last_fullsized":"2024-09-11T23:18:23.650628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:06.561706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575164+0000","last_change":"2024-09-11T23:18:22.600703+0000","last_active":"2024-09-11T23:18:23.575164+0000","last_peered":"2024-09-11T23:18:23.575164+0000","last_clean":"2024-09-11T23:18:23.575164+0000","last_became_active":"2024-09-11T23:18:22.599960+0000","last_became_peered":"2024-09-11T23:18:22.599960+0000","last_unstale":"2024-09-11T23:18:23.575164+0000","last_undegraded":"2024-09-11T23:18:23.575164+0000","last_fullsized":"2024-09-11T23:18:23.575164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:37.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.650359+0000","last_change":"2024-09-11T23:18:22.614147+0000","last_active":"2024-09-11T23:18:23.650359+0000","last_peered":"2024-09-11T23:18:23.650359+0000","last_clean":"2024-09-11T23:18:23.650359+0000","last_became_active":"2024-09-11T23:18:22.613613+0000","last_became_peered":"2024-09-11T23:18:22.613613+0000","last_unstale":"2024-09-11T23:18:23.650359+0000","last_undegraded":"2024-09-11T23:18:23.650359+0000","last_fullsized":"2024-09-11T23:18:23.650359+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:22.413299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.606527+0000","last_change":"2024-09-11T23:18:21.580890+0000","last_active":"2024-09-11T23:18:23.606527+0000","last_peered":"2024-09-11T23:18:23.606527+0000","last_clean":"2024-09-11T23:18:23.606527+0000","last_became_active":"2024-09-11T23:18:21.580558+0000","last_became_peered":"2024-09-11T23:18:21.580558+0000","last_unstale":"2024-09-11T23:18:23.606527+0000","last_undegraded":"2024-09-11T23:18:23.606527+0000","last_fullsized":"2024-09-11T23:18:23.606527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:29.617146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600296+0000","last_change":"2024-09-11T23:18:22.582519+0000","last_active":"2024-09-11T23:18:23.600296+0000","last_peered":"2024-09-11T23:18:23.600296+0000","last_clean":"2024-09-11T23:18:23.600296+0000","last_became_active":"2024-09-11T23:18:22.581809+0000","last_became_peered":"2024-09-11T23:18:22.581809+0000","last_unstale":"2024-09-11T23:18:23.600296+0000","last_undegraded":"2024-09-11T23:18:23.600296+0000","last_fullsized":"2024-09-11T23:18:23.600296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:24.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.576029+0000","last_change":"2024-09-11T23:18:21.605242+0000","last_active":"2024-09-11T23:18:23.576029+0000","last_peered":"2024-09-11T23:18:23.576029+0000","last_clean":"2024-09-11T23:18:23.576029+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:23.576029+0000","last_undegraded":"2024-09-11T23:18:23.576029+0000","last_fullsized":"2024-09-11T23:18:23.576029+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:09.147103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187029+0000","last_change":"2024-09-11T23:18:22.596010+0000","last_active":"2024-09-11T23:18:24.187029+0000","last_peered":"2024-09-11T23:18:24.187029+0000","last_clean":"2024-09-11T23:18:24.187029+0000","last_became_active":"2024-09-11T23:18:22.595390+0000","last_became_peered":"2024-09-11T23:18:22.595390+0000","last_unstale":"2024-09-11T23:18:24.187029+0000","last_undegraded":"2024-09-11T23:18:24.187029+0000","last_fullsized":"2024-09-11T23:18:24.187029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:36.216079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575932+0000","last_change":"2024-09-11T23:18:21.600136+0000","last_active":"2024-09-11T23:18:23.575932+0000","last_peered":"2024-09-11T23:18:23.575932+0000","last_clean":"2024-09-11T23:18:23.575932+0000","last_became_active":"2024-09-11T23:18:21.597138+0000","last_became_peered":"2024-09-11T23:18:21.597138+0000","last_unstale":"2024-09-11T23:18:23.575932+0000","last_undegraded":"2024-09-11T23:18:23.575932+0000","last_fullsized":"2024-09-11T23:18:23.575932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:39.912926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187934+0000","last_change":"2024-09-11T23:18:22.615876+0000","last_active":"2024-09-11T23:18:24.187934+0000","last_peered":"2024-09-11T23:18:24.187934+0000","last_clean":"2024-09-11T23:18:24.187934+0000","last_became_active":"2024-09-11T23:18:22.615135+0000","last_became_peered":"2024-09-11T23:18:22.615135+0000","last_unstale":"2024-09-11T23:18:24.187934+0000","last_undegraded":"2024-09-11T23:18:24.187934+0000","last_fullsized":"2024-09-11T23:18:24.187934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:21.103628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188491+0000","last_change":"2024-09-11T23:18:21.610459+0000","last_active":"2024-09-11T23:18:24.188491+0000","last_peered":"2024-09-11T23:18:24.188491+0000","last_clean":"2024-09-11T23:18:24.188491+0000","last_became_active":"2024-09-11T23:18:21.604546+0000","last_became_peered":"2024-09-11T23:18:21.604546+0000","last_unstale":"2024-09-11T23:18:24.188491+0000","last_undegraded":"2024-09-11T23:18:24.188491+0000","last_fullsized":"2024-09-11T23:18:24.188491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:38.149059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600820+0000","last_change":"2024-09-11T23:18:22.613282+0000","last_active":"2024-09-11T23:18:23.600820+0000","last_peered":"2024-09-11T23:18:23.600820+0000","last_clean":"2024-09-11T23:18:23.600820+0000","last_became_active":"2024-09-11T23:18:22.612959+0000","last_became_peered":"2024-09-11T23:18:22.612959+0000","last_unstale":"2024-09-11T23:18:23.600820+0000","last_undegraded":"2024-09-11T23:18:23.600820+0000","last_fullsized":"2024-09-11T23:18:23.600820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:18.801781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188172+0000","last_change":"2024-09-11T23:18:21.600764+0000","last_active":"2024-09-11T23:18:24.188172+0000","last_peered":"2024-09-11T23:18:24.188172+0000","last_clean":"2024-09-11T23:18:24.188172+0000","last_became_active":"2024-09-11T23:18:21.600043+0000","last_became_peered":"2024-09-11T23:18:21.600043+0000","last_unstale":"2024-09-11T23:18:24.188172+0000","last_undegraded":"2024-09-11T23:18:24.188172+0000","last_fullsized":"2024-09-11T23:18:24.188172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:16.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600911+0000","last_change":"2024-09-11T23:18:22.599672+0000","last_active":"2024-09-11T23:18:23.600911+0000","last_peered":"2024-09-11T23:18:23.600911+0000","last_clean":"2024-09-11T23:18:23.600911+0000","last_became_active":"2024-09-11T23:18:22.599327+0000","last_became_peered":"2024-09-11T23:18:22.599327+0000","last_unstale":"2024-09-11T23:18:23.600911+0000","last_undegraded":"2024-09-11T23:18:23.600911+0000","last_fullsized":"2024-09-11T23:18:23.600911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:19.009982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574006+0000","last_change":"2024-09-11T23:18:21.597322+0000","last_active":"2024-09-11T23:18:23.574006+0000","last_peered":"2024-09-11T23:18:23.574006+0000","last_clean":"2024-09-11T23:18:23.574006+0000","last_became_active":"2024-09-11T23:18:21.596479+0000","last_became_peered":"2024-09-11T23:18:21.596479+0000","last_unstale":"2024-09-11T23:18:23.574006+0000","last_undegraded":"2024-09-11T23:18:23.574006+0000","last_fullsized":"2024-09-11T23:18:23.574006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:42.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187812+0000","last_change":"2024-09-11T23:18:22.591654+0000","last_active":"2024-09-11T23:18:24.187812+0000","last_peered":"2024-09-11T23:18:24.187812+0000","last_clean":"2024-09-11T23:18:24.187812+0000","last_became_active":"2024-09-11T23:18:22.590939+0000","last_became_peered":"2024-09-11T23:18:22.590939+0000","last_unstale":"2024-09-11T23:18:24.187812+0000","last_undegraded":"2024-09-11T23:18:24.187812+0000","last_fullsized":"2024-09-11T23:18:24.187812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:15.938994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600449+0000","last_change":"2024-09-11T23:18:21.597750+0000","last_active":"2024-09-11T23:18:23.600449+0000","last_peered":"2024-09-11T23:18:23.600449+0000","last_clean":"2024-09-11T23:18:23.600449+0000","last_became_active":"2024-09-11T23:18:21.597419+0000","last_became_peered":"2024-09-11T23:18:21.597419+0000","last_unstale":"2024-09-11T23:18:23.600449+0000","last_undegraded":"2024-09-11T23:18:23.600449+0000","last_fullsized":"2024-09-11T23:18:23.600449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:09.147103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188040+0000","last_change":"2024-09-11T23:18:22.606248+0000","last_active":"2024-09-11T23:18:24.188040+0000","last_peered":"2024-09-11T23:18:24.188040+0000","last_clean":"2024-09-11T23:18:24.188040+0000","last_became_active":"2024-09-11T23:18:22.605948+0000","last_became_peered":"2024-09-11T23:18:22.605948+0000","last_unstale":"2024-09-11T23:18:24.188040+0000","last_undegraded":"2024-09-11T23:18:24.188040+0000","last_fullsized":"2024-09-11T23:18:24.188040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:05.451327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605009+0000","last_change":"2024-09-11T23:18:21.601997+0000","last_active":"2024-09-11T23:18:23.605009+0000","last_peered":"2024-09-11T23:18:23.605009+0000","last_clean":"2024-09-11T23:18:23.605009+0000","last_became_active":"2024-09-11T23:18:21.601557+0000","last_became_peered":"2024-09-11T23:18:21.601557+0000","last_unstale":"2024-09-11T23:18:23.605009+0000","last_undegraded":"2024-09-11T23:18:23.605009+0000","last_fullsized":"2024-09-11T23:18:23.605009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.344377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600015+0000","last_change":"2024-09-11T23:18:22.602241+0000","last_active":"2024-09-11T23:18:23.600015+0000","last_peered":"2024-09-11T23:18:23.600015+0000","last_clean":"2024-09-11T23:18:23.600015+0000","last_became_active":"2024-09-11T23:18:22.601864+0000","last_became_peered":"2024-09-11T23:18:22.601864+0000","last_unstale":"2024-09-11T23:18:23.600015+0000","last_undegraded":"2024-09-11T23:18:23.600015+0000","last_fullsized":"2024-09-11T23:18:23.600015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:30.491519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.576818+0000","last_change":"2024-09-11T23:18:21.606163+0000","last_active":"2024-09-11T23:18:23.576818+0000","last_peered":"2024-09-11T23:18:23.576818+0000","last_clean":"2024-09-11T23:18:23.576818+0000","last_became_active":"2024-09-11T23:18:21.605050+0000","last_became_peered":"2024-09-11T23:18:21.605050+0000","last_unstale":"2024-09-11T23:18:23.576818+0000","last_undegraded":"2024-09-11T23:18:23.576818+0000","last_fullsized":"2024-09-11T23:18:23.576818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:21.029059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574406+0000","last_change":"2024-09-11T23:18:22.591845+0000","last_active":"2024-09-11T23:18:23.574406+0000","last_peered":"2024-09-11T23:18:23.574406+0000","last_clean":"2024-09-11T23:18:23.574406+0000","last_became_active":"2024-09-11T23:18:22.591164+0000","last_became_peered":"2024-09-11T23:18:22.591164+0000","last_unstale":"2024-09-11T23:18:23.574406+0000","last_undegraded":"2024-09-11T23:18:23.574406+0000","last_fullsized":"2024-09-11T23:18:23.574406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:58.575381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575132+0000","last_change":"2024-09-11T23:18:21.600933+0000","last_active":"2024-09-11T23:18:23.575132+0000","last_peered":"2024-09-11T23:18:23.575132+0000","last_clean":"2024-09-11T23:18:23.575132+0000","last_became_active":"2024-09-11T23:18:21.600235+0000","last_became_peered":"2024-09-11T23:18:21.600235+0000","last_unstale":"2024-09-11T23:18:23.575132+0000","last_undegraded":"2024-09-11T23:18:23.575132+0000","last_fullsized":"2024-09-11T23:18:23.575132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:05.550057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.573645+0000","last_change":"2024-09-11T23:18:22.622178+0000","last_active":"2024-09-11T23:18:23.573645+0000","last_peered":"2024-09-11T23:18:23.573645+0000","last_clean":"2024-09-11T23:18:23.573645+0000","last_became_active":"2024-09-11T23:18:22.621893+0000","last_became_peered":"2024-09-11T23:18:22.621893+0000","last_unstale":"2024-09-11T23:18:23.573645+0000","last_undegraded":"2024-09-11T23:18:23.573645+0000","last_fullsized":"2024-09-11T23:18:23.573645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:55.057869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.606109+0000","last_change":"2024-09-11T23:18:21.580034+0000","last_active":"2024-09-11T23:18:23.606109+0000","last_peered":"2024-09-11T23:18:23.606109+0000","last_clean":"2024-09-11T23:18:23.606109+0000","last_became_active":"2024-09-11T23:18:21.579736+0000","last_became_peered":"2024-09-11T23:18:21.579736+0000","last_unstale":"2024-09-11T23:18:23.606109+0000","last_undegraded":"2024-09-11T23:18:23.606109+0000","last_fullsized":"2024-09-11T23:18:23.606109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:42.990411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.650807+0000","last_change":"2024-09-11T23:18:22.614894+0000","last_active":"2024-09-11T23:18:23.650807+0000","last_peered":"2024-09-11T23:18:23.650807+0000","last_clean":"2024-09-11T23:18:23.650807+0000","last_became_active":"2024-09-11T23:18:22.614459+0000","last_became_peered":"2024-09-11T23:18:22.614459+0000","last_unstale":"2024-09-11T23:18:23.650807+0000","last_undegraded":"2024-09-11T23:18:23.650807+0000","last_fullsized":"2024-09-11T23:18:23.650807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:05.451327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188478+0000","last_change":"2024-09-11T23:18:21.611858+0000","last_active":"2024-09-11T23:18:24.188478+0000","last_peered":"2024-09-11T23:18:24.188478+0000","last_clean":"2024-09-11T23:18:24.188478+0000","last_became_active":"2024-09-11T23:18:21.610397+0000","last_became_peered":"2024-09-11T23:18:21.610397+0000","last_unstale":"2024-09-11T23:18:24.188478+0000","last_undegraded":"2024-09-11T23:18:24.188478+0000","last_fullsized":"2024-09-11T23:18:24.188478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:34.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575517+0000","last_change":"2024-09-11T23:18:22.598075+0000","last_active":"2024-09-11T23:18:23.575517+0000","last_peered":"2024-09-11T23:18:23.575517+0000","last_clean":"2024-09-11T23:18:23.575517+0000","last_became_active":"2024-09-11T23:18:22.597367+0000","last_became_peered":"2024-09-11T23:18:22.597367+0000","last_unstale":"2024-09-11T23:18:23.575517+0000","last_undegraded":"2024-09-11T23:18:23.575517+0000","last_fullsized":"2024-09-11T23:18:23.575517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:22.683499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.573942+0000","last_change":"2024-09-11T23:18:21.604083+0000","last_active":"2024-09-11T23:18:23.573942+0000","last_peered":"2024-09-11T23:18:23.573942+0000","last_clean":"2024-09-11T23:18:23.573942+0000","last_became_active":"2024-09-11T23:18:21.603406+0000","last_became_peered":"2024-09-11T23:18:21.603406+0000","last_unstale":"2024-09-11T23:18:23.573942+0000","last_undegraded":"2024-09-11T23:18:23.573942+0000","last_fullsized":"2024-09-11T23:18:23.573942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:04.439678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187300+0000","last_change":"2024-09-11T23:18:22.613361+0000","last_active":"2024-09-11T23:18:24.187300+0000","last_peered":"2024-09-11T23:18:24.187300+0000","last_clean":"2024-09-11T23:18:24.187300+0000","last_became_active":"2024-09-11T23:18:22.612958+0000","last_became_peered":"2024-09-11T23:18:22.612958+0000","last_unstale":"2024-09-11T23:18:24.187300+0000","last_undegraded":"2024-09-11T23:18:24.187300+0000","last_fullsized":"2024-09-11T23:18:24.187300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:15.258972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574416+0000","last_change":"2024-09-11T23:18:21.598505+0000","last_active":"2024-09-11T23:18:23.574416+0000","last_peered":"2024-09-11T23:18:23.574416+0000","last_clean":"2024-09-11T23:18:23.574416+0000","last_became_active":"2024-09-11T23:18:21.597672+0000","last_became_peered":"2024-09-11T23:18:21.597672+0000","last_unstale":"2024-09-11T23:18:23.574416+0000","last_undegraded":"2024-09-11T23:18:23.574416+0000","last_fullsized":"2024-09-11T23:18:23.574416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.153878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188881+0000","last_change":"2024-09-11T23:18:22.605477+0000","last_active":"2024-09-11T23:18:24.188881+0000","last_peered":"2024-09-11T23:18:24.188881+0000","last_clean":"2024-09-11T23:18:24.188881+0000","last_became_active":"2024-09-11T23:18:22.604850+0000","last_became_peered":"2024-09-11T23:18:22.604850+0000","last_unstale":"2024-09-11T23:18:24.188881+0000","last_undegraded":"2024-09-11T23:18:24.188881+0000","last_fullsized":"2024-09-11T23:18:24.188881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:40.924575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605284+0000","last_change":"2024-09-11T23:18:21.580243+0000","last_active":"2024-09-11T23:18:23.605284+0000","last_peered":"2024-09-11T23:18:23.605284+0000","last_clean":"2024-09-11T23:18:23.605284+0000","last_became_active":"2024-09-11T23:18:21.579532+0000","last_became_peered":"2024-09-11T23:18:21.579532+0000","last_unstale":"2024-09-11T23:18:23.605284+0000","last_undegraded":"2024-09-11T23:18:23.605284+0000","last_fullsized":"2024-09-11T23:18:23.605284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:19.686615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188250+0000","last_change":"2024-09-11T23:18:22.612740+0000","last_active":"2024-09-11T23:18:24.188250+0000","last_peered":"2024-09-11T23:18:24.188250+0000","last_clean":"2024-09-11T23:18:24.188250+0000","last_became_active":"2024-09-11T23:18:22.609141+0000","last_became_peered":"2024-09-11T23:18:22.609141+0000","last_unstale":"2024-09-11T23:18:24.188250+0000","last_undegraded":"2024-09-11T23:18:24.188250+0000","last_fullsized":"2024-09-11T23:18:24.188250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:13.165527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600131+0000","last_change":"2024-09-11T23:18:21.601616+0000","last_active":"2024-09-11T23:18:23.600131+0000","last_peered":"2024-09-11T23:18:23.600131+0000","last_clean":"2024-09-11T23:18:23.600131+0000","last_became_active":"2024-09-11T23:18:21.601352+0000","last_became_peered":"2024-09-11T23:18:21.601352+0000","last_unstale":"2024-09-11T23:18:23.600131+0000","last_undegraded":"2024-09-11T23:18:23.600131+0000","last_fullsized":"2024-09-11T23:18:23.600131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.153878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.572509+0000","last_change":"2024-09-11T23:18:22.607898+0000","last_active":"2024-09-11T23:18:23.572509+0000","last_peered":"2024-09-11T23:18:23.572509+0000","last_clean":"2024-09-11T23:18:23.572509+0000","last_became_active":"2024-09-11T23:18:22.607546+0000","last_became_peered":"2024-09-11T23:18:22.607546+0000","last_unstale":"2024-09-11T23:18:23.572509+0000","last_undegraded":"2024-09-11T23:18:23.572509+0000","last_fullsized":"2024-09-11T23:18:23.572509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:37.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.576889+0000","last_change":"2024-09-11T23:18:21.599580+0000","last_active":"2024-09-11T23:18:23.576889+0000","last_peered":"2024-09-11T23:18:23.576889+0000","last_clean":"2024-09-11T23:18:23.576889+0000","last_became_active":"2024-09-11T23:18:21.598795+0000","last_became_peered":"2024-09-11T23:18:21.598795+0000","last_unstale":"2024-09-11T23:18:23.576889+0000","last_undegraded":"2024-09-11T23:18:23.576889+0000","last_fullsized":"2024-09-11T23:18:23.576889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:05.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605228+0000","last_change":"2024-09-11T23:18:22.604822+0000","last_active":"2024-09-11T23:18:23.605228+0000","last_peered":"2024-09-11T23:18:23.605228+0000","last_clean":"2024-09-11T23:18:23.605228+0000","last_became_active":"2024-09-11T23:18:22.603764+0000","last_became_peered":"2024-09-11T23:18:22.603764+0000","last_unstale":"2024-09-11T23:18:23.605228+0000","last_undegraded":"2024-09-11T23:18:23.605228+0000","last_fullsized":"2024-09-11T23:18:23.605228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:17.789124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188049+0000","last_change":"2024-09-11T23:18:21.590812+0000","last_active":"2024-09-11T23:18:24.188049+0000","last_peered":"2024-09-11T23:18:24.188049+0000","last_clean":"2024-09-11T23:18:24.188049+0000","last_became_active":"2024-09-11T23:18:21.590053+0000","last_became_peered":"2024-09-11T23:18:21.590053+0000","last_unstale":"2024-09-11T23:18:24.188049+0000","last_undegraded":"2024-09-11T23:18:24.188049+0000","last_fullsized":"2024-09-11T23:18:24.188049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:48.299787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605638+0000","last_change":"2024-09-11T23:18:22.599581+0000","last_active":"2024-09-11T23:18:23.605638+0000","last_peered":"2024-09-11T23:18:23.605638+0000","last_clean":"2024-09-11T23:18:23.605638+0000","last_became_active":"2024-09-11T23:18:22.598140+0000","last_became_peered":"2024-09-11T23:18:22.598140+0000","last_unstale":"2024-09-11T23:18:23.605638+0000","last_undegraded":"2024-09-11T23:18:23.605638+0000","last_fullsized":"2024-09-11T23:18:23.605638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:18.122890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.606186+0000","last_change":"2024-09-11T23:18:21.592958+0000","last_active":"2024-09-11T23:18:23.606186+0000","last_peered":"2024-09-11T23:18:23.606186+0000","last_clean":"2024-09-11T23:18:23.606186+0000","last_became_active":"2024-09-11T23:18:21.592461+0000","last_became_peered":"2024-09-11T23:18:21.592461+0000","last_unstale":"2024-09-11T23:18:23.606186+0000","last_undegraded":"2024-09-11T23:18:23.606186+0000","last_fullsized":"2024-09-11T23:18:23.606186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:27.150475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.573004+0000","last_change":"2024-09-11T23:18:22.608644+0000","last_active":"2024-09-11T23:18:23.573004+0000","last_peered":"2024-09-11T23:18:23.573004+0000","last_clean":"2024-09-11T23:18:23.573004+0000","last_became_active":"2024-09-11T23:18:22.608190+0000","last_became_peered":"2024-09-11T23:18:22.608190+0000","last_unstale":"2024-09-11T23:18:23.573004+0000","last_undegraded":"2024-09-11T23:18:23.573004+0000","last_fullsized":"2024-09-11T23:18:23.573004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:55.506629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.650760+0000","last_change":"2024-09-11T23:18:21.580569+0000","last_active":"2024-09-11T23:18:23.650760+0000","last_peered":"2024-09-11T23:18:23.650760+0000","last_clean":"2024-09-11T23:18:23.650760+0000","last_became_active":"2024-09-11T23:18:21.580129+0000","last_became_peered":"2024-09-11T23:18:21.580129+0000","last_unstale":"2024-09-11T23:18:23.650760+0000","last_undegraded":"2024-09-11T23:18:23.650760+0000","last_fullsized":"2024-09-11T23:18:23.650760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:54.695797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.601109+0000","last_change":"2024-09-11T23:18:22.590697+0000","last_active":"2024-09-11T23:18:23.601109+0000","last_peered":"2024-09-11T23:18:23.601109+0000","last_clean":"2024-09-11T23:18:23.601109+0000","last_became_active":"2024-09-11T23:18:22.589619+0000","last_became_peered":"2024-09-11T23:18:22.589619+0000","last_unstale":"2024-09-11T23:18:23.601109+0000","last_undegraded":"2024-09-11T23:18:23.601109+0000","last_fullsized":"2024-09-11T23:18:23.601109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:31.800921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.572898+0000","last_change":"2024-09-11T23:18:21.582981+0000","last_active":"2024-09-11T23:18:23.572898+0000","last_peered":"2024-09-11T23:18:23.572898+0000","last_clean":"2024-09-11T23:18:23.572898+0000","last_became_active":"2024-09-11T23:18:21.582670+0000","last_became_peered":"2024-09-11T23:18:21.582670+0000","last_unstale":"2024-09-11T23:18:23.572898+0000","last_undegraded":"2024-09-11T23:18:23.572898+0000","last_fullsized":"2024-09-11T23:18:23.572898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:57.563732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.601368+0000","last_change":"2024-09-11T23:18:22.584364+0000","last_active":"2024-09-11T23:18:23.601368+0000","last_peered":"2024-09-11T23:18:23.601368+0000","last_clean":"2024-09-11T23:18:23.601368+0000","last_became_active":"2024-09-11T23:18:22.583630+0000","last_became_peered":"2024-09-11T23:18:22.583630+0000","last_unstale":"2024-09-11T23:18:23.601368+0000","last_undegraded":"2024-09-11T23:18:23.601368+0000","last_fullsized":"2024-09-11T23:18:23.601368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:00.412207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.572825+0000","last_change":"2024-09-11T23:18:21.603816+0000","last_active":"2024-09-11T23:18:23.572825+0000","last_peered":"2024-09-11T23:18:23.572825+0000","last_clean":"2024-09-11T23:18:23.572825+0000","last_became_active":"2024-09-11T23:18:21.603447+0000","last_became_peered":"2024-09-11T23:18:21.603447+0000","last_unstale":"2024-09-11T23:18:23.572825+0000","last_undegraded":"2024-09-11T23:18:23.572825+0000","last_fullsized":"2024-09-11T23:18:23.572825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:33.855175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188459+0000","last_change":"2024-09-11T23:18:22.608400+0000","last_active":"2024-09-11T23:18:24.188459+0000","last_peered":"2024-09-11T23:18:24.188459+0000","last_clean":"2024-09-11T23:18:24.188459+0000","last_became_active":"2024-09-11T23:18:22.608136+0000","last_became_peered":"2024-09-11T23:18:22.608136+0000","last_unstale":"2024-09-11T23:18:24.188459+0000","last_undegraded":"2024-09-11T23:18:24.188459+0000","last_fullsized":"2024-09-11T23:18:24.188459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:22.040708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.572665+0000","last_change":"2024-09-11T23:18:21.603657+0000","last_active":"2024-09-11T23:18:23.572665+0000","last_peered":"2024-09-11T23:18:23.572665+0000","last_clean":"2024-09-11T23:18:23.572665+0000","last_became_active":"2024-09-11T23:18:21.603317+0000","last_became_peered":"2024-09-11T23:18:21.603317+0000","last_unstale":"2024-09-11T23:18:23.572665+0000","last_undegraded":"2024-09-11T23:18:23.572665+0000","last_fullsized":"2024-09-11T23:18:23.572665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:47.043813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.186611+0000","last_change":"2024-09-11T23:18:22.604928+0000","last_active":"2024-09-11T23:18:24.186611+0000","last_peered":"2024-09-11T23:18:24.186611+0000","last_clean":"2024-09-11T23:18:24.186611+0000","last_became_active":"2024-09-11T23:18:22.604477+0000","last_became_peered":"2024-09-11T23:18:22.604477+0000","last_unstale":"2024-09-11T23:18:24.186611+0000","last_undegraded":"2024-09-11T23:18:24.186611+0000","last_fullsized":"2024-09-11T23:18:24.186611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:39.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.574488+0000","last_change":"2024-09-11T23:18:21.597127+0000","last_active":"2024-09-11T23:18:23.574488+0000","last_peered":"2024-09-11T23:18:23.574488+0000","last_clean":"2024-09-11T23:18:23.574488+0000","last_became_active":"2024-09-11T23:18:21.596156+0000","last_became_peered":"2024-09-11T23:18:21.596156+0000","last_unstale":"2024-09-11T23:18:23.574488+0000","last_undegraded":"2024-09-11T23:18:23.574488+0000","last_fullsized":"2024-09-11T23:18:23.574488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:21.401650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187916+0000","last_change":"2024-09-11T23:18:22.609693+0000","last_active":"2024-09-11T23:18:24.187916+0000","last_peered":"2024-09-11T23:18:24.187916+0000","last_clean":"2024-09-11T23:18:24.187916+0000","last_became_active":"2024-09-11T23:18:22.608959+0000","last_became_peered":"2024-09-11T23:18:22.608959+0000","last_unstale":"2024-09-11T23:18:24.187916+0000","last_undegraded":"2024-09-11T23:18:24.187916+0000","last_fullsized":"2024-09-11T23:18:24.187916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:06.561706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.601442+0000","last_change":"2024-09-11T23:18:21.580858+0000","last_active":"2024-09-11T23:18:23.601442+0000","last_peered":"2024-09-11T23:18:23.601442+0000","last_clean":"2024-09-11T23:18:23.601442+0000","last_became_active":"2024-09-11T23:18:21.580498+0000","last_became_peered":"2024-09-11T23:18:21.580498+0000","last_unstale":"2024-09-11T23:18:23.601442+0000","last_undegraded":"2024-09-11T23:18:23.601442+0000","last_fullsized":"2024-09-11T23:18:23.601442+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:21.029059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187440+0000","last_change":"2024-09-11T23:18:22.595734+0000","last_active":"2024-09-11T23:18:24.187440+0000","last_peered":"2024-09-11T23:18:24.187440+0000","last_clean":"2024-09-11T23:18:24.187440+0000","last_became_active":"2024-09-11T23:18:22.594908+0000","last_became_peered":"2024-09-11T23:18:22.594908+0000","last_unstale":"2024-09-11T23:18:24.187440+0000","last_undegraded":"2024-09-11T23:18:24.187440+0000","last_fullsized":"2024-09-11T23:18:24.187440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:55.848651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.576633+0000","last_change":"2024-09-11T23:18:21.600773+0000","last_active":"2024-09-11T23:18:23.576633+0000","last_peered":"2024-09-11T23:18:23.576633+0000","last_clean":"2024-09-11T23:18:23.576633+0000","last_became_active":"2024-09-11T23:18:21.600084+0000","last_became_peered":"2024-09-11T23:18:21.600084+0000","last_unstale":"2024-09-11T23:18:23.576633+0000","last_undegraded":"2024-09-11T23:18:23.576633+0000","last_fullsized":"2024-09-11T23:18:23.576633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:33.855175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.600530+0000","last_change":"2024-09-11T23:18:22.602059+0000","last_active":"2024-09-11T23:18:23.600530+0000","last_peered":"2024-09-11T23:18:23.600530+0000","last_clean":"2024-09-11T23:18:23.600530+0000","last_became_active":"2024-09-11T23:18:22.601346+0000","last_became_peered":"2024-09-11T23:18:22.601346+0000","last_unstale":"2024-09-11T23:18:23.600530+0000","last_undegraded":"2024-09-11T23:18:23.600530+0000","last_fullsized":"2024-09-11T23:18:23.600530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.661851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575565+0000","last_change":"2024-09-11T23:18:21.605831+0000","last_active":"2024-09-11T23:18:23.575565+0000","last_peered":"2024-09-11T23:18:23.575565+0000","last_clean":"2024-09-11T23:18:23.575565+0000","last_became_active":"2024-09-11T23:18:21.604947+0000","last_became_peered":"2024-09-11T23:18:21.604947+0000","last_unstale":"2024-09-11T23:18:23.575565+0000","last_undegraded":"2024-09-11T23:18:23.575565+0000","last_fullsized":"2024-09-11T23:18:23.575565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:04.439678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188284+0000","last_change":"2024-09-11T23:18:22.609837+0000","last_active":"2024-09-11T23:18:24.188284+0000","last_peered":"2024-09-11T23:18:24.188284+0000","last_clean":"2024-09-11T23:18:24.188284+0000","last_became_active":"2024-09-11T23:18:22.609309+0000","last_became_peered":"2024-09-11T23:18:22.609309+0000","last_unstale":"2024-09-11T23:18:24.188284+0000","last_undegraded":"2024-09-11T23:18:24.188284+0000","last_fullsized":"2024-09-11T23:18:24.188284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:10.158752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.189055+0000","last_change":"2024-09-11T23:18:21.610589+0000","last_active":"2024-09-11T23:18:24.189055+0000","last_peered":"2024-09-11T23:18:24.189055+0000","last_clean":"2024-09-11T23:18:24.189055+0000","last_became_active":"2024-09-11T23:18:21.604520+0000","last_became_peered":"2024-09-11T23:18:21.604520+0000","last_unstale":"2024-09-11T23:18:24.189055+0000","last_undegraded":"2024-09-11T23:18:24.189055+0000","last_fullsized":"2024-09-11T23:18:24.189055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:34.916821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.187587+0000","last_change":"2024-09-11T23:18:22.607645+0000","last_active":"2024-09-11T23:18:24.187587+0000","last_peered":"2024-09-11T23:18:24.187587+0000","last_clean":"2024-09-11T23:18:24.187587+0000","last_became_active":"2024-09-11T23:18:22.607345+0000","last_became_peered":"2024-09-11T23:18:22.607345+0000","last_unstale":"2024-09-11T23:18:24.187587+0000","last_undegraded":"2024-09-11T23:18:24.187587+0000","last_fullsized":"2024-09-11T23:18:24.187587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:22.413299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.605864+0000","last_change":"2024-09-11T23:18:21.580668+0000","last_active":"2024-09-11T23:18:23.605864+0000","last_peered":"2024-09-11T23:18:23.605864+0000","last_clean":"2024-09-11T23:18:23.605864+0000","last_became_active":"2024-09-11T23:18:21.580346+0000","last_became_peered":"2024-09-11T23:18:21.580346+0000","last_unstale":"2024-09-11T23:18:23.605864+0000","last_undegraded":"2024-09-11T23:18:23.605864+0000","last_fullsized":"2024-09-11T23:18:23.605864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:33.782065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.651131+0000","last_change":"2024-09-11T23:18:22.620495+0000","last_active":"2024-09-11T23:18:23.651131+0000","last_peered":"2024-09-11T23:18:23.651131+0000","last_clean":"2024-09-11T23:18:23.651131+0000","last_became_active":"2024-09-11T23:18:22.620140+0000","last_became_peered":"2024-09-11T23:18:22.620140+0000","last_unstale":"2024-09-11T23:18:23.651131+0000","last_undegraded":"2024-09-11T23:18:23.651131+0000","last_fullsized":"2024-09-11T23:18:23.651131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:40.924575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:24.188143+0000","last_change":"2024-09-11T23:18:21.610976+0000","last_active":"2024-09-11T23:18:24.188143+0000","last_peered":"2024-09-11T23:18:24.188143+0000","last_clean":"2024-09-11T23:18:24.188143+0000","last_became_active":"2024-09-11T23:18:21.604466+0000","last_became_peered":"2024-09-11T23:18:21.604466+0000","last_unstale":"2024-09-11T23:18:24.188143+0000","last_undegraded":"2024-09-11T23:18:24.188143+0000","last_fullsized":"2024-09-11T23:18:24.188143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:35.204430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.651067+0000","last_change":"2024-09-11T23:18:22.608375+0000","last_active":"2024-09-11T23:18:23.651067+0000","last_peered":"2024-09-11T23:18:23.651067+0000","last_clean":"2024-09-11T23:18:23.651067+0000","last_became_active":"2024-09-11T23:18:22.607719+0000","last_became_peered":"2024-09-11T23:18:22.607719+0000","last_unstale":"2024-09-11T23:18:23.651067+0000","last_undegraded":"2024-09-11T23:18:23.651067+0000","last_fullsized":"2024-09-11T23:18:23.651067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:10.158752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.650415+0000","last_change":"2024-09-11T23:18:21.582739+0000","last_active":"2024-09-11T23:18:23.650415+0000","last_peered":"2024-09-11T23:18:23.650415+0000","last_clean":"2024-09-11T23:18:23.650415+0000","last_became_active":"2024-09-11T23:18:21.582400+0000","last_became_peered":"2024-09-11T23:18:21.582400+0000","last_unstale":"2024-09-11T23:18:23.650415+0000","last_undegraded":"2024-09-11T23:18:23.650415+0000","last_fullsized":"2024-09-11T23:18:23.650415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:14.927345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.576386+0000","last_change":"2024-09-11T23:18:22.614856+0000","last_active":"2024-09-11T23:18:23.576386+0000","last_peered":"2024-09-11T23:18:23.576386+0000","last_clean":"2024-09-11T23:18:23.576386+0000","last_became_active":"2024-09-11T23:18:22.614535+0000","last_became_peered":"2024-09-11T23:18:22.614535+0000","last_unstale":"2024-09-11T23:18:23.576386+0000","last_undegraded":"2024-09-11T23:18:23.576386+0000","last_fullsized":"2024-09-11T23:18:23.576386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:21.552389+0000","last_clean_scrub_stamp":"2024-09-11T23:18:21.552389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:11.502227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.573787+0000","last_change":"2024-09-11T23:18:21.603704+0000","last_active":"2024-09-11T23:18:23.573787+0000","last_peered":"2024-09-11T23:18:23.573787+0000","last_clean":"2024-09-11T23:18:23.573787+0000","last_became_active":"2024-09-11T23:18:21.603309+0000","last_became_peered":"2024-09-11T23:18:21.603309+0000","last_unstale":"2024-09-11T23:18:23.573787+0000","last_undegraded":"2024-09-11T23:18:23.573787+0000","last_fullsized":"2024-09-11T23:18:23.573787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:20.540739+0000","last_clean_scrub_stamp":"2024-09-11T23:18:20.540739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:33.806862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":273,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T23:18:23.575270+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:18:23.575270+0000","last_peered":"2024-09-11T23:18:23.575270+0000","last_clean":"2024-09-11T23:18:23.575270+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:18:23.575270+0000","last_undegraded":"2024-09-11T23:18:23.575270+0000","last_fullsized":"2024-09-11T23:18:23.575270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1515520,"data_stored":1009490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":929792,"data_stored":420712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":921600,"data_stored":419134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":420816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335588,"statfs":{"total":96636764160,"available":96599642112,"internally_reserved":0,"allocated":921600,"data_stored":419682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36264,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335576,"statfs":{"total":96636764160,"available":96599629824,"internally_reserved":0,"allocated":929792,"data_stored":419842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40412,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331428,"statfs":{"total":96636764160,"available":96595382272,"internally_reserved":0,"allocated":925696,"data_stored":419212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36832,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335008,"statfs":{"total":96636764160,"available":96599048192,"internally_reserved":0,"allocated":1511424,"data_stored":1009468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:31.430 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:18:31.431 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:18:31.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.557+0000 7fdd3848c640 1 Processor -- start 2024-09-11T23:18:31.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.557+0000 7fdd3848c640 1 -- start start 2024-09-11T23:18:31.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.557+0000 7fdd3848c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 0x7fdd3015df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.557+0000 7fdd3848c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd300b58a0 con 0x7fdd300b5c10 2024-09-11T23:18:31.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.557+0000 7fdd3848c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3009ab80 con 0x7fdd30159d30 2024-09-11T23:18:31.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.557+0000 7fdd3848c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3015a110 con 0x7fdd300b6060 2024-09-11T23:18:31.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35a27640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdd300b5c10 0x7fdd3015d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47250/0 (socket says 172.21.15.94:47250) 2024-09-11T23:18:31.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35a27640 1 -- 172.21.15.94:0/1796181103 learned_addr learned my addr 172.21.15.94:0/1796181103 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91917929 0 0) 0x7fdd300b58a0 con 0x7fdd300b5c10 2024-09-11T23:18:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd1c003530 con 0x7fdd300b5c10 2024-09-11T23:18:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 0x7fdd3015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3934075314 0 0) 0x7fdd1c003530 con 0x7fdd300b5c10 2024-09-11T23:18:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 msgr2=0x7fdd3015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 0x7fdd3015df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 >> v1:172.21.15.155:6789/0 conn(0x7fdd30159d30 legacy=0x7fdd300b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3009ae60 con 0x7fdd300b5c10 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fdd20001680 con 0x7fdd300b5c10 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 >> v1:172.21.15.94:6789/0 conn(0x7fdd300b5c10 legacy=0x7fdd3015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 0x7fdd1c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004020 0x7fdd1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd1c004d50 0x7fdd1c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3015a110 con 0x7fdd1c004d50 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c00bb90 con 0x7fdd1c004020 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c00bd90 con 0x7fdd300b6060 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd1c004d50 0x7fdd1c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35a27640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004020 0x7fdd1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36228640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 0x7fdd1c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 -- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 msgr2=0x7fdd1c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd300b6060 0x7fdd1c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 -- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004020 msgr2=0x7fdd1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004020 0x7fdd1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 -- 172.21.15.94:0/1796181103 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c003530 con 0x7fdd1c004d50 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd36a29640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd1c004d50 0x7fdd1c0051d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdd28007360 tx=0x7fdd2801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52e2d52e08d07f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd280b2070 con 0x7fdd1c004d50 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd280a5d40 con 0x7fdd1c004d50 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd35226640 1 -- 172.21.15.94:0/1796181103 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28009be0 con 0x7fdd1c004d50 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd3848c640 1 -- 172.21.15.94:0/1796181103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd1c004d50 msgr2=0x7fdd1c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.561+0000 7fdd3848c640 1 --2- 172.21.15.94:0/1796181103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd1c004d50 0x7fdd1c0051d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdd28007360 tx=0x7fdd2801ce40 comp rx=0 tx=0).stop 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 -- 172.21.15.94:0/1796181103 reap_dead start 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- 172.21.15.94:0/1796181103 shutdown_connections 2024-09-11T23:18:31.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- 172.21.15.94:0/1796181103 >> 172.21.15.94:0/1796181103 conn(0x7fdd300b3e90 msgr2=0x7fdd300b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- 172.21.15.94:0/1796181103 shutdown_connections 2024-09-11T23:18:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- 172.21.15.94:0/1796181103 wait complete. 2024-09-11T23:18:31.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 Processor -- start 2024-09-11T23:18:31.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- start start 2024-09-11T23:18:31.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004d50 0x7fdd3014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3006cdd0 0x7fdd30155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd30156510 0x7fdd300cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3009b420 con 0x7fdd30156510 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3009b790 con 0x7fdd1c004d50 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd300b64b0 con 0x7fdd3006cdd0 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd30156510 0x7fdd300cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd30156510 0x7fdd300cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36072/0 (socket says 172.21.15.94:36072) 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 -- 172.21.15.94:0/3691235191 learned_addr learned my addr 172.21.15.94:0/3691235191 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36228640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004d50 0x7fdd3014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd35a27640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3006cdd0 0x7fdd30155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 -- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3006cdd0 msgr2=0x7fdd30155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3006cdd0 0x7fdd30155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 -- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004d50 msgr2=0x7fdd3014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004d50 0x7fdd3014ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 -- 172.21.15.94:0/3691235191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd30159380 con 0x7fdd30156510 2024-09-11T23:18:31.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd36a29640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd30156510 0x7fdd300cd9d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdd280b0040 tx=0x7fdd1c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd26ffd640 1 -- 172.21.15.94:0/3691235191 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd280b2040 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd26ffd640 1 -- 172.21.15.94:0/3691235191 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd280a5b40 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd300cbd10 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd26ffd640 1 -- 172.21.15.94:0/3691235191 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28009be0 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.565+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd30158da0 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.569+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3015d580 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.569+0000 7fdd26ffd640 1 -- 172.21.15.94:0/3691235191 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd280bf060 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.569+0000 7fdd26ffd640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd140678f0 0x7fdd14069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.569+0000 7fdd26ffd640 1 -- 172.21.15.94:0/3691235191 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fdd2811fed0 con 0x7fdd30156510 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.569+0000 7fdd36228640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd140678f0 0x7fdd14069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.569+0000 7fdd36228640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd140678f0 0x7fdd14069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c000c10 tx=0x7fdd2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.573+0000 7fdd26ffd640 1 -- 172.21.15.94:0/3691235191 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdd28016b50 con 0x7fdd30156510 2024-09-11T23:18:31.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.793+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdd300b4b60 con 0x7fdd30156510 2024-09-11T23:18:31.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.797+0000 7fdd26ffd640 1 -- 172.21.15.94:0/3691235191 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fdd280f0880 con 0x7fdd30156510 2024-09-11T23:18:31.800 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:18:31.800 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:18:31.800 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2024-09-11T23:18:31.800 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2024-09-11T23:18:31.800 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:18:31.800 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2024-09-11T23:18:31.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd140678f0 msgr2=0x7fdd14069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd140678f0 0x7fdd14069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c000c10 tx=0x7fdd2c009040 comp rx=0 tx=0).stop 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd30156510 msgr2=0x7fdd300cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd30156510 0x7fdd300cd9d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdd280b0040 tx=0x7fdd1c005840 comp rx=0 tx=0).stop 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 shutdown_connections 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdd140678f0 0x7fdd14069db0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd30156510 0x7fdd300cd9d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3006cdd0 0x7fdd30155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 --2- 172.21.15.94:0/3691235191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1c004d50 0x7fdd3014ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 >> 172.21.15.94:0/3691235191 conn(0x7fdd300b3e90 msgr2=0x7fdd300750c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 shutdown_connections 2024-09-11T23:18:31.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.801+0000 7fdd3848c640 1 -- 172.21.15.94:0/3691235191 wait complete. 2024-09-11T23:18:31.823 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:31.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c8452e640 1 Processor -- start 2024-09-11T23:18:31.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c8452e640 1 -- start start 2024-09-11T23:18:31.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c8452e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c7c06f010 0x7f4c7c166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c8452e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c0b3290 con 0x7f4c7c15bec0 2024-09-11T23:18:31.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c8452e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c0b3570 con 0x7f4c7c15c2a0 2024-09-11T23:18:31.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c8452e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7c0b3850 con 0x7f4c7c06f010 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c82acb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c7c06f010 0x7f4c7c166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c822ca640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4c7c15bec0 0x7f4c7c0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47260/0 (socket says 172.21.15.94:47260) 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c822ca640 1 -- 172.21.15.94:0/675852802 learned_addr learned my addr 172.21.15.94:0/675852802 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c82acb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c7c06f010 0x7f4c7c166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36086/0 (socket says 172.21.15.94:36086) 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c82acb640 1 -- 172.21.15.94:0/675852802 >> v1:172.21.15.155:6789/0 conn(0x7f4c7c15c2a0 legacy=0x7f4c7c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c82acb640 1 -- 172.21.15.94:0/675852802 >> v1:172.21.15.94:6789/0 conn(0x7f4c7c15bec0 legacy=0x7f4c7c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c82acb640 1 -- 172.21.15.94:0/675852802 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c0b3b30 con 0x7f4c7c06f010 2024-09-11T23:18:31.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.933+0000 7f4c812c8640 1 -- 172.21.15.94:0/675852802 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94624362 0 0) 0x7f4c7c0b3290 con 0x7f4c7c15bec0 2024-09-11T23:18:31.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c82acb640 1 --2- 172.21.15.94:0/675852802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c06f010 0x7f4c7c166ff0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009d90 tx=0x7f4c7401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f72d5e6bac8b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c812c8640 1 -- 172.21.15.94:0/675852802 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c740b2070 con 0x7f4c7c06f010 2024-09-11T23:18:31.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c812c8640 1 -- 172.21.15.94:0/675852802 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c740a58d0 con 0x7f4c7c06f010 2024-09-11T23:18:31.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c812c8640 1 -- 172.21.15.94:0/675852802 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c740a5ca0 con 0x7f4c7c06f010 2024-09-11T23:18:31.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- 172.21.15.94:0/675852802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c06f010 msgr2=0x7f4c7c166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 --2- 172.21.15.94:0/675852802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c06f010 0x7f4c7c166ff0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009d90 tx=0x7f4c7401c900 comp rx=0 tx=0).stop 2024-09-11T23:18:31.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- 172.21.15.94:0/675852802 shutdown_connections 2024-09-11T23:18:31.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 --2- 172.21.15.94:0/675852802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c06f010 0x7f4c7c166ff0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- 172.21.15.94:0/675852802 >> 172.21.15.94:0/675852802 conn(0x7f4c7c0b1f90 msgr2=0x7f4c7c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- 172.21.15.94:0/675852802 shutdown_connections 2024-09-11T23:18:31.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- 172.21.15.94:0/675852802 wait complete. 2024-09-11T23:18:31.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 Processor -- start 2024-09-11T23:18:31.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- start start 2024-09-11T23:18:31.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c7c06f010 0x7f4c7c14ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c15bec0 0x7f4c7c1661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7c15c2a0 0x7f4c7c071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c169ed0 con 0x7f4c7c15bec0 2024-09-11T23:18:31.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c169d50 con 0x7f4c7c15c2a0 2024-09-11T23:18:31.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.937+0000 7f4c8452e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c16a050 con 0x7f4c7c06f010 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c15bec0 0x7f4c7c1661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c15bec0 0x7f4c7c1661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36094/0 (socket says 172.21.15.94:36094) 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 -- 172.21.15.94:0/3507166117 learned_addr learned my addr 172.21.15.94:0/3507166117 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c82acb640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7c15c2a0 0x7f4c7c071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 -- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c7c06f010 msgr2=0x7f4c7c14ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c7c06f010 0x7f4c7c14ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 -- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7c15c2a0 msgr2=0x7f4c7c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7c15c2a0 0x7f4c7c071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 -- 172.21.15.94:0/3507166117 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c073b00 con 0x7f4c7c15bec0 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c82acb640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7c15c2a0 0x7f4c7c071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c81ac9640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c15bec0 0x7f4c7c1661c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800b410 tx=0x7f4c7800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c72ffd640 1 -- 172.21.15.94:0/3507166117 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78015030 con 0x7f4c7c15bec0 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c72ffd640 1 -- 172.21.15.94:0/3507166117 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78004020 con 0x7f4c7c15bec0 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c073de0 con 0x7f4c7c15bec0 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c72ffd640 1 -- 172.21.15.94:0/3507166117 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78004410 con 0x7f4c7c15bec0 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1659c0 con 0x7f4c7c15bec0 2024-09-11T23:18:31.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7c0ad200 con 0x7f4c7c15bec0 2024-09-11T23:18:31.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c72ffd640 1 -- 172.21.15.94:0/3507166117 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c78018070 con 0x7f4c7c15bec0 2024-09-11T23:18:31.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c72ffd640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c600678c0 0x7f4c60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c72ffd640 1 -- 172.21.15.94:0/3507166117 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f4c78085990 con 0x7f4c7c15bec0 2024-09-11T23:18:31.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c822ca640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c600678c0 0x7f4c60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.941+0000 7f4c822ca640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c600678c0 0x7f4c60069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0011f0 tx=0x7f4c6c007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:31.945+0000 7f4c72ffd640 1 -- 172.21.15.94:0/3507166117 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c78056340 con 0x7f4c7c15bec0 2024-09-11T23:18:32.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.137+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c7c0d0bf0 con 0x7f4c7c15bec0 2024-09-11T23:18:32.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.137+0000 7f4c72ffd640 1 -- 172.21.15.94:0/3507166117 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f4c78055c40 con 0x7f4c7c15bec0 2024-09-11T23:18:32.138 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:32.139 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c600678c0 msgr2=0x7f4c60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c600678c0 0x7f4c60069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0011f0 tx=0x7f4c6c007930 comp rx=0 tx=0).stop 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c15bec0 msgr2=0x7f4c7c1661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c15bec0 0x7f4c7c1661c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800b410 tx=0x7f4c7800b8d0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 shutdown_connections 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c7c15c2a0 0x7f4c7c071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4c600678c0 0x7f4c60069d80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c7c15bec0 0x7f4c7c1661c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 --2- 172.21.15.94:0/3507166117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c7c06f010 0x7f4c7c14ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 >> 172.21.15.94:0/3507166117 conn(0x7f4c7c0b1f90 msgr2=0x7f4c7c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 shutdown_connections 2024-09-11T23:18:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.141+0000 7f4c8452e640 1 -- 172.21.15.94:0/3507166117 wait complete. 2024-09-11T23:18:32.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:18:21.939012+0000', 'modified': '2024-09-11T23:18:24.973316+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6024}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6024': {'gid': 6024, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/100688804', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 100688804}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 100688804}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6024, 'qdb_cluster': [6024]} 2024-09-11T23:18:32.560 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:18:32.560 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T23:18:32.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f10776c8640 1 Processor -- start 2024-09-11T23:18:32.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f10776c8640 1 -- start start 2024-09-11T23:18:32.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f10776c8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f10700adad0 0x7f107015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f10776c8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1070155450 0x7f10700cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f10776c8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10700af300 con 0x7f10700aee70 2024-09-11T23:18:32.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f10776c8640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f10700af5e0 con 0x7f10700adad0 2024-09-11T23:18:32.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f10776c8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f10700af8c0 con 0x7f1070155450 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075464640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f10700adad0 0x7f107015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075464640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f10700adad0 0x7f107015f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36098/0 (socket says 172.21.15.94:36098) 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075464640 1 -- 172.21.15.94:0/1441433507 learned_addr learned my addr 172.21.15.94:0/1441433507 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075c65640 1 --2- 172.21.15.94:0/1441433507 >> v2:172.21.15.155:3300/0 conn(0x7f1070155450 0x7f10700cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075464640 1 -- 172.21.15.94:0/1441433507 >> v2:172.21.15.155:3300/0 conn(0x7f1070155450 msgr2=0x7f10700cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075464640 1 --2- 172.21.15.94:0/1441433507 >> v2:172.21.15.155:3300/0 conn(0x7f1070155450 0x7f10700cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075464640 1 -- 172.21.15.94:0/1441433507 >> v1:172.21.15.94:6789/0 conn(0x7f10700aee70 legacy=0x7f1070154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1075464640 1 -- 172.21.15.94:0/1441433507 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10700afba0 con 0x7f10700adad0 2024-09-11T23:18:32.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.693+0000 7f1067fff640 1 -- 172.21.15.94:0/1441433507 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548064890 0 0) 0x7f10700af300 con 0x7f10700aee70 2024-09-11T23:18:32.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f1075464640 1 --2- 172.21.15.94:0/1441433507 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107015f320 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f10700b4470 tx=0x7f106c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa54180f64bbd77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f1067fff640 1 -- 172.21.15.94:0/1441433507 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b0070 con 0x7f10700adad0 2024-09-11T23:18:32.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f1067fff640 1 -- 172.21.15.94:0/1441433507 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c0ab600 con 0x7f10700adad0 2024-09-11T23:18:32.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f1067fff640 1 -- 172.21.15.94:0/1441433507 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0ab9d0 con 0x7f10700adad0 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 -- 172.21.15.94:0/1441433507 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 msgr2=0x7f107015f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 --2- 172.21.15.94:0/1441433507 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107015f320 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f10700b4470 tx=0x7f106c01c520 comp rx=0 tx=0).stop 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 -- 172.21.15.94:0/1441433507 shutdown_connections 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 --2- 172.21.15.94:0/1441433507 >> v2:172.21.15.155:3300/0 conn(0x7f1070155450 0x7f10700cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 --2- 172.21.15.94:0/1441433507 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107015f320 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 -- 172.21.15.94:0/1441433507 >> 172.21.15.94:0/1441433507 conn(0x7f10700736d0 msgr2=0x7f107006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 -- 172.21.15.94:0/1441433507 shutdown_connections 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 -- 172.21.15.94:0/1441433507 wait complete. 2024-09-11T23:18:32.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 Processor -- start 2024-09-11T23:18:32.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 -- start start 2024-09-11T23:18:32.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.697+0000 7f10776c8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f10776c8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1070155450 0x7f107014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f10776c8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107015d6e0 0x7f1070159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f10776c8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f10700d0790 con 0x7f10700adad0 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f10776c8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10700d0610 con 0x7f107015d6e0 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f10776c8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f107006f070 con 0x7f1070155450 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107014e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36112/0 (socket says 172.21.15.94:36112) 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 -- 172.21.15.94:0/2459667324 learned_addr learned my addr 172.21.15.94:0/2459667324 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 -- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1070155450 msgr2=0x7f107014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1070155450 0x7f107014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 -- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107015d6e0 msgr2=0x7f1070159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107015d6e0 0x7f1070159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 -- 172.21.15.94:0/2459667324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107015b780 con 0x7f10700adad0 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1075464640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107014e2b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f106c01abd0 tx=0x7f106c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1065ffb640 1 -- 172.21.15.94:0/2459667324 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b0040 con 0x7f10700adad0 2024-09-11T23:18:32.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1065ffb640 1 -- 172.21.15.94:0/2459667324 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c0b6420 con 0x7f10700adad0 2024-09-11T23:18:32.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107015ba60 con 0x7f10700adad0 2024-09-11T23:18:32.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107015d1c0 con 0x7f10700adad0 2024-09-11T23:18:32.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1065ffb640 1 -- 172.21.15.94:0/2459667324 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b67f0 con 0x7f10700adad0 2024-09-11T23:18:32.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1065ffb640 1 -- 172.21.15.94:0/2459667324 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f106c0be030 con 0x7f10700adad0 2024-09-11T23:18:32.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1065ffb640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10540678c0 0x7f1054069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1065ffb640 1 -- 172.21.15.94:0/2459667324 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f106c11f870 con 0x7f10700adad0 2024-09-11T23:18:32.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1074c63640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10540678c0 0x7f1054069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f107a784000 1 Processor -- start 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f107a784000 1 -- start start 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.701+0000 7f1074c63640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10540678c0 0x7f1054069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1060007fd0 tx=0x7f1060007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acaf2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acaa8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaa9290 0x5600acaa9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5600ac990b60 con 0x5600acaf3440 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5600ac8f7c70 con 0x5600acaf2b20 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5600ac89ded0 con 0x5600acaa9290 2024-09-11T23:18:32.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acaa8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acaa8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36118/0 (socket says 172.21.15.94:36118) 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 -- 172.21.15.94:0/3618373549 learned_addr learned my addr 172.21.15.94:0/3618373549 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaa9290 0x5600acaa9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 -- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaa9290 msgr2=0x5600acaa9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075464640 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acaf2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaa9290 0x5600acaa9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 -- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 msgr2=0x5600acaf2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acaf2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 -- 172.21.15.94:0/3618373549 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600ac8afe50 con 0x5600acaf3440 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acaa8d50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1060005500 tx=0x7f106000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7e9e77f3b4a74c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f105affd640 1 -- 172.21.15.94:0/3618373549 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060012650 con 0x5600acaf3440 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f105affd640 1 -- 172.21.15.94:0/3618373549 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10600127f0 con 0x5600acaf3440 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f105affd640 1 -- 172.21.15.94:0/3618373549 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060012bc0 con 0x5600acaf3440 2024-09-11T23:18:32.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- 172.21.15.94:0/3618373549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 msgr2=0x5600acaa8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acaa8d50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1060005500 tx=0x7f106000f000 comp rx=0 tx=0).stop 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- 172.21.15.94:0/3618373549 shutdown_connections 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaa9290 0x5600acaa9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acaa8d50 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- 172.21.15.94:0/3618373549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acaf2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- 172.21.15.94:0/3618373549 >> 172.21.15.94:0/3618373549 conn(0x5600acaaf600 msgr2=0x5600acaa7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- 172.21.15.94:0/3618373549 shutdown_connections 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- 172.21.15.94:0/3618373549 wait complete. 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- start start 2024-09-11T23:18:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 Processor -- start 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaf2b20 0x5600acaade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 0x5600acab3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaae390 0x5600acab4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5600ac959b00 con 0x5600acaae390 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5600ac8d2360 con 0x5600acaf3440 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5600ac8cf2d0 con 0x5600acaf2b20 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f107a784000 10 client.0 _ll_register_callbacks cb 0x5600aca94820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaae390 0x5600acab4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaae390 0x5600acab4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36132/0 (socket says 172.21.15.94:36132) 2024-09-11T23:18:32.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 -- 172.21.15.94:0/3871741666 learned_addr learned my addr 172.21.15.94:0/3871741666 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075464640 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaf2b20 0x5600acaade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1074c63640 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 0x5600acab3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 -- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaf2b20 msgr2=0x5600acaade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaf2b20 0x5600acaade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 -- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 msgr2=0x5600acab3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 0x5600acab3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.705+0000 7f1075c65640 1 -- 172.21.15.94:0/3871741666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600ac89e120 con 0x5600acaae390 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f1075c65640 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaae390 0x5600acab4230 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f106800d610 tx=0x7f106800dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41896e644539656 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 1 -- 172.21.15.94:0/3871741666 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106800f690 con 0x5600acaae390 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 1 -- 172.21.15.94:0/3871741666 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f106800f830 con 0x5600acaae390 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10600127f0 con 0x5600acaae390 2024-09-11T23:18:32.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 1 -- 172.21.15.94:0/3871741666 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f1068021050 con 0x5600acaae390 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 10 client.6177 fetch_fsmap learned FSMap version 40 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5600ac897450 con 0x5600acaae390 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 1 -- 172.21.15.94:0/3871741666 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10600127f0 con 0x5600acaae390 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 1 -- 172.21.15.94:0/3871741666 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f1068024020 con 0x5600acaae390 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 10 client.6177 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 10 client.6177 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 20 client.6177 populate_metadata read hostname 'smithi094' 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acaf8f50 0x5600acaf9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 4 client.6177 mds_command: new command op to 6024 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 --> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600ac891c00 con 0x5600acaf8f50 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f1075464640 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acaf8f50 0x5600acaf9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 10 client.6177 ms_handle_connect on v2:172.21.15.155:6836/100688804 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f1075464640 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acaf8f50 0x5600acaf9330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ed25f518fd6bf7 server_cookie=dff386aa5a51a2fe in_seq=0 out_seq=0 2024-09-11T23:18:32.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 1 -- 172.21.15.94:0/3871741666 <== mds.0 v2:172.21.15.155:6836/100688804 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600ac891c00 con 0x5600acaf8f50 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 10 client.6177 handle_command_reply: tid=0 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 client.6177 shutdown 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaae390 msgr2=0x5600acab4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaae390 0x5600acab4230 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f106800d610 tx=0x7f106800dad0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 shutdown_connections 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaae390 0x5600acab4230 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acaf8f50 0x5600acaf9330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 0x5600acab3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 --2- 172.21.15.94:0/3871741666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaf2b20 0x5600acaade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f104ffff640 0 client.6177 ms_handle_reset on v2:172.21.15.155:6836/100688804 2024-09-11T23:18:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 >> 172.21.15.94:0/3871741666 conn(0x5600acaa9290 msgr2=0x5600acaa7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 shutdown_connections 2024-09-11T23:18:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.709+0000 7f107a784000 1 -- 172.21.15.94:0/3871741666 wait complete. 2024-09-11T23:18:32.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.713+0000 7f107a784000 20 client.6177 trim_cache size 0 max 16384 2024-09-11T23:18:32.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 Processor -- start 2024-09-11T23:18:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 -- start start 2024-09-11T23:18:32.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 0x5600acb09850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf2b20 0x5600acaf1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 0x5600acaf21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f105000be80 con 0x5600acaf2b20 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f105000b140 con 0x5600acaf3440 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f105000b7b0 con 0x5600acaae390 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf2b20 0x5600acaf1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf2b20 0x5600acaf1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36144/0 (socket says 172.21.15.94:36144) 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 -- 172.21.15.94:0/3238340869 learned_addr learned my addr 172.21.15.94:0/3238340869 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 -- 172.21.15.94:0/3238340869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 msgr2=0x5600acb09850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 --2- 172.21.15.94:0/3238340869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 0x5600acb09850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 -- 172.21.15.94:0/3238340869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 msgr2=0x5600acaf21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 --2- 172.21.15.94:0/3238340869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 0x5600acaf21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 -- 172.21.15.94:0/3238340869 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600ac87efd0 con 0x5600acaf2b20 2024-09-11T23:18:32.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f1074c63640 1 --2- 172.21.15.94:0/3238340869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf2b20 0x5600acaf1c90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1060015000 tx=0x7f1060005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d558af128d3c7e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f105a7fc640 1 -- 172.21.15.94:0/3238340869 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060013920 con 0x5600acaf2b20 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f105a7fc640 1 -- 172.21.15.94:0/3238340869 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060013ac0 con 0x5600acaf2b20 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.729+0000 7f105a7fc640 1 -- 172.21.15.94:0/3238340869 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060013c70 con 0x5600acaf2b20 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3238340869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf2b20 msgr2=0x5600acaf1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- 172.21.15.94:0/3238340869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf2b20 0x5600acaf1c90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1060015000 tx=0x7f1060005000 comp rx=0 tx=0).stop 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3238340869 shutdown_connections 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- 172.21.15.94:0/3238340869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf3440 0x5600acaf21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- 172.21.15.94:0/3238340869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf2b20 0x5600acaf1c90 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- 172.21.15.94:0/3238340869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 0x5600acb09850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3238340869 >> 172.21.15.94:0/3238340869 conn(0x5600acaa9290 msgr2=0x5600acaad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3238340869 shutdown_connections 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3238340869 wait complete. 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- start start 2024-09-11T23:18:32.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 Processor -- start 2024-09-11T23:18:32.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 0x5600acb65f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acb664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acafc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5600ac8f6f80 con 0x5600acaf3440 2024-09-11T23:18:32.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5600ac8afca0 con 0x5600acaf2b20 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5600ac8fc2a0 con 0x5600acaae390 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 10 client.0 _ll_register_callbacks cb 0x7f1068008600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acafc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acafc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36148/0 (socket says 172.21.15.94:36148) 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 -- 172.21.15.94:0/3025485851 learned_addr learned my addr 172.21.15.94:0/3025485851 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1074c63640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acb664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075464640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 0x5600acb65f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 -- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 msgr2=0x5600acb65f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 0x5600acb65f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 -- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 msgr2=0x5600acb664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acb664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 -- 172.21.15.94:0/3025485851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600ac97a750 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1074c63640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acb664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075c65640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acafc7f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f106800ffd0 tx=0x7f1068004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bf1941f52aca6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f104ffff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f104ffff640 1 -- 172.21.15.94:0/3025485851 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068003db0 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f104ffff640 1 -- 172.21.15.94:0/3025485851 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f1068004040 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1060013ac0 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f104ffff640 1 -- 172.21.15.94:0/3025485851 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f1068035050 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 10 client.6183 fetch_fsmap learned FSMap version 40 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5600ac885a30 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f104ffff640 1 -- 172.21.15.94:0/3025485851 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060013ac0 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f104ffff640 1 -- 172.21.15.94:0/3025485851 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f1068038020 con 0x5600acaf3440 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 10 client.6183 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 10 client.6183 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:18:32.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 20 client.6183 populate_metadata read hostname 'smithi094' 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acafcd30 0x5600acafd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 4 client.6183 mds_command: new command op to 6024 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 --> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] -- command(tid 0: {"prefix": "status"}) -- 0x5600ac9053a0 con 0x5600acafcd30 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.733+0000 7f1075464640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acafcd30 0x5600acafd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f1075464640 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acafcd30 0x5600acafd110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72cf54c7c85297d3 server_cookie=f497965645c38588 in_seq=0 out_seq=0 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f104ffff640 10 client.6183 ms_handle_connect on v2:172.21.15.155:6836/100688804 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f104ffff640 1 -- 172.21.15.94:0/3025485851 <== mds.0 v2:172.21.15.155:6836/100688804 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5600ac9053a0 con 0x5600acafcd30 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f104ffff640 10 client.6183 handle_command_reply: tid=0 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 client.6183 shutdown 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 msgr2=0x5600acafc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acafc7f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f106800ffd0 tx=0x7f1068004a50 comp rx=0 tx=0).stop 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 shutdown_connections 2024-09-11T23:18:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5600acaf3440 0x5600acafc7f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:6836/100688804,v1:172.21.15.155:6837/100688804] conn(0x5600acafcd30 0x5600acafd110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600acaf2b20 0x5600acb664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 --2- 172.21.15.94:0/3025485851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5600acaae390 0x5600acb65f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f104ffff640 0 client.6183 ms_handle_reset on v2:172.21.15.155:6836/100688804 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 >> 172.21.15.94:0/3025485851 conn(0x5600acaa9290 msgr2=0x5600acaf0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 shutdown_connections 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 1 -- 172.21.15.94:0/3025485851 wait complete. 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f107a784000 20 client.6183 trim_cache size 0 max 16384 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:18:32.743 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6024, 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 10.146072433000001, 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 40, 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 75, 2024-09-11T23:18:32.744 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 75, 2024-09-11T23:18:32.745 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 15.13068078 2024-09-11T23:18:32.745 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:18:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10540678c0 msgr2=0x7f1054069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10540678c0 0x7f1054069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1060007fd0 tx=0x7f1060007920 comp rx=0 tx=0).stop 2024-09-11T23:18:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 msgr2=0x7f107014e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107014e2b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f106c01abd0 tx=0x7f106c01ad60 comp rx=0 tx=0).stop 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 shutdown_connections 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f107015d6e0 0x7f1070159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1070155450 0x7f107014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10540678c0 0x7f1054069d80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 --2- 172.21.15.94:0/2459667324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10700adad0 0x7f107014e2b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 >> 172.21.15.94:0/2459667324 conn(0x7f10700736d0 msgr2=0x7f107006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 shutdown_connections 2024-09-11T23:18:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.737+0000 7f10776c8640 1 -- 172.21.15.94:0/2459667324 wait complete. 2024-09-11T23:18:32.753 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:18:32.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 Processor -- start 2024-09-11T23:18:32.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 -- start start 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a1015bec0 0x7f8a100ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a1015c2a0 0x7f8a100aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8a100b3290 con 0x7f8a1015bec0 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8a100b3570 con 0x7f8a1015c2a0 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a16903640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a100b3850 con 0x7f8a100af2a0 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a1015bec0 0x7f8a100ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a1015bec0 0x7f8a100ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36150/0 (socket says 172.21.15.94:36150) 2024-09-11T23:18:32.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 -- 172.21.15.94:0/2957089398 learned_addr learned my addr 172.21.15.94:0/2957089398 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a14ea0640 1 --2- 172.21.15.94:0/2957089398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0f7fe640 1 --2- 172.21.15.94:0/2957089398 >> v2:172.21.15.155:3300/0 conn(0x7f8a1015c2a0 0x7f8a100aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 -- 172.21.15.94:0/2957089398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 msgr2=0x7f8a1015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 --2- 172.21.15.94:0/2957089398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 -- 172.21.15.94:0/2957089398 >> v2:172.21.15.155:3300/0 conn(0x7f8a1015c2a0 msgr2=0x7f8a100aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 --2- 172.21.15.94:0/2957089398 >> v2:172.21.15.155:3300/0 conn(0x7f8a1015c2a0 0x7f8a100aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.865+0000 7f8a0ffff640 1 -- 172.21.15.94:0/2957089398 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a100b3b30 con 0x7f8a1015bec0 2024-09-11T23:18:32.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a0ffff640 1 --2- 172.21.15.94:0/2957089398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015bec0 0x7f8a100ad200 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8a100ae510 tx=0x7f8a0001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1e55cee6b18f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a0effd640 1 -- 172.21.15.94:0/2957089398 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000b0070 con 0x7f8a1015bec0 2024-09-11T23:18:32.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a0effd640 1 -- 172.21.15.94:0/2957089398 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a000ab600 con 0x7f8a1015bec0 2024-09-11T23:18:32.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a0effd640 1 -- 172.21.15.94:0/2957089398 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000ab9d0 con 0x7f8a1015bec0 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 -- 172.21.15.94:0/2957089398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015bec0 msgr2=0x7f8a100ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 --2- 172.21.15.94:0/2957089398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015bec0 0x7f8a100ad200 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8a100ae510 tx=0x7f8a0001c230 comp rx=0 tx=0).stop 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 -- 172.21.15.94:0/2957089398 shutdown_connections 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 --2- 172.21.15.94:0/2957089398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 --2- 172.21.15.94:0/2957089398 >> v2:172.21.15.155:3300/0 conn(0x7f8a1015c2a0 0x7f8a100aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 --2- 172.21.15.94:0/2957089398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015bec0 0x7f8a100ad200 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 -- 172.21.15.94:0/2957089398 >> 172.21.15.94:0/2957089398 conn(0x7f8a100b1f90 msgr2=0x7f8a100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 -- 172.21.15.94:0/2957089398 shutdown_connections 2024-09-11T23:18:32.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 -- 172.21.15.94:0/2957089398 wait complete. 2024-09-11T23:18:32.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 Processor -- start 2024-09-11T23:18:32.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.869+0000 7f8a16903640 1 -- start start 2024-09-11T23:18:32.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1015bec0 0x7f8a101f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015c2a0 0x7f8a101f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8a100af6b0 con 0x7f8a1015c2a0 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a100ad740 con 0x7f8a1015bec0 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1006e000 con 0x7f8a100af2a0 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015c2a0 0x7f8a101f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015c2a0 0x7f8a101f8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36154/0 (socket says 172.21.15.94:36154) 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 -- 172.21.15.94:0/2246417347 learned_addr learned my addr 172.21.15.94:0/2246417347 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0f7fe640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1015bec0 0x7f8a101f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0ffff640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 -- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 msgr2=0x7f8a1014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1014dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 -- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1015bec0 msgr2=0x7f8a101f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1015bec0 0x7f8a101f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 -- 172.21.15.94:0/2246417347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a101527a0 con 0x7f8a1015c2a0 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0f7fe640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1015bec0 0x7f8a101f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a14ea0640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015c2a0 0x7f8a101f8e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800cd70 tx=0x7f8a0800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0cff9640 1 -- 172.21.15.94:0/2246417347 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08003ba0 con 0x7f8a1015c2a0 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0cff9640 1 -- 172.21.15.94:0/2246417347 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a08003d40 con 0x7f8a1015c2a0 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a10151700 con 0x7f8a1015c2a0 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0cff9640 1 -- 172.21.15.94:0/2246417347 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08004240 con 0x7f8a1015c2a0 2024-09-11T23:18:32.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a10151cc0 con 0x7f8a1015c2a0 2024-09-11T23:18:32.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a100ad200 con 0x7f8a1015c2a0 2024-09-11T23:18:32.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0cff9640 1 -- 172.21.15.94:0/2246417347 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a080043e0 con 0x7f8a1015c2a0 2024-09-11T23:18:32.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0cff9640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89fc0678c0 0x7f89fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0cff9640 1 -- 172.21.15.94:0/2246417347 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8a08086920 con 0x7f8a1015c2a0 2024-09-11T23:18:32.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.873+0000 7f8a0ffff640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89fc0678c0 0x7f89fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.877+0000 7f8a0ffff640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89fc0678c0 0x7f89fc069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8a000ad000 tx=0x7f8a00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:32.877+0000 7f8a0cff9640 1 -- 172.21.15.94:0/2246417347 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8a101527a0 con 0x7f8a1015c2a0 2024-09-11T23:18:33.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.061+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8a1006fcd0 con 0x7f8a1015c2a0 2024-09-11T23:18:33.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.061+0000 7f8a0cff9640 1 -- 172.21.15.94:0/2246417347 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7f8a0801d340 con 0x7f8a1015c2a0 2024-09-11T23:18:33.062 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:18:33.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89fc0678c0 msgr2=0x7f89fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89fc0678c0 0x7f89fc069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8a000ad000 tx=0x7f8a00008040 comp rx=0 tx=0).stop 2024-09-11T23:18:33.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015c2a0 msgr2=0x7f8a101f8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015c2a0 0x7f8a101f8e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800cd70 tx=0x7f8a0800a660 comp rx=0 tx=0).stop 2024-09-11T23:18:33.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 shutdown_connections 2024-09-11T23:18:33.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89fc0678c0 0x7f89fc069d80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a1015c2a0 0x7f8a101f8e70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1015bec0 0x7f8a101f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 --2- 172.21.15.94:0/2246417347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a100af2a0 0x7f8a1014dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 >> 172.21.15.94:0/2246417347 conn(0x7f8a100b1f90 msgr2=0x7f8a100b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:33.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 shutdown_connections 2024-09-11T23:18:33.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33.065+0000 7f8a16903640 1 -- 172.21.15.94:0/2246417347 wait complete. 2024-09-11T23:18:33.080 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:18:33.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:18:33.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:18:33.081 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:18:33.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:33.081 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:18:33.081 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:18:33.081 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:18:33.081 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:33.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.081 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:18:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:33.087 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42275sec preferred_lft 42275sec 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.088 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:33.089 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:18:33.090 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:33.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.090 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:18:33.140 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:18:33.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.141 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:18:33.197 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:18:33.198 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:18:33.198 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:18:33.198 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:33.198 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:18:33.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:18:33.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:18:33.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:18:33.198 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:18:33.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:33.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:33.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.315 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:18:33.361 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:18:33.362 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:18:33.362 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:33.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:18:33.421 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:18:33.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:33.421 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:33.469 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:33.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:33.470 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:33.517 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:18:33.574 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:18:33.623 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:18:33.624 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:18:33.625 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:33.626 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:33.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.627 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:18:33.673 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:18:33.674 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:18:33.718 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:18:33.733 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:18:33.781 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:18:33.781 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:18:33.781 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:18:33.782 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:18:33.783 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:33.784 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:33.784 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:33.784 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:33.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.785 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:18:33.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:18:33.797+0000 7f1c45671580 -1 init, newargv = 0x55fe7915a090 newargc=15 2024-09-11T23:18:33.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[42459]: starting ceph client 2024-09-11T23:18:33.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[42459]: starting fuse 2024-09-11T23:18:34.902 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:18:34.918 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:18:34.966 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:18:34.966 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:18:34.966 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:18:34.966 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:18:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:18:34.968 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:18:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:18:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:18:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:34.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:34.970 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:18:35.017 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:18:35.018 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:18:35.018 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:18:35.019 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:18:35.020 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:18:35.020 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:18:35.020 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:18:35.020 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:35.020 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:18:35.020 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:18:35.142 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.42459.asok 2024-09-11T23:18:35.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:35.153 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42459.asok 2024-09-11T23:18:35.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:35.154 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42459.asok status 2024-09-11T23:18:35.305 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:18:35.305 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:18:35.305 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:18:35.305 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:18:35.305 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:18:35.305 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "42459", 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6195, 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:18:35.306 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 6195 2024-09-11T23:18:35.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:35.307 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:18:35.307 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:18:35.307 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:18:35.307 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 4012039900 2024-09-11T23:18:35.307 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:18:35.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 4012039900 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.6195 192.168.0.1:0/4012039900", 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/4012039900", 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 40, 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 75, 2024-09-11T23:18:35.308 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:18:35.309 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:18:35.309 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:18:35.309 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:18:35.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:35.319 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:18:35.319 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:35.326 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:18:35.326 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:35.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:35.326 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:35.382 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_fragment_size_max 10 2024-09-11T23:18:35.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.549+0000 7f0af970b640 1 Processor -- start 2024-09-11T23:18:35.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af970b640 1 -- start start 2024-09-11T23:18:35.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af970b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0af415bec0 0x7f0af40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af970b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 0x7f0af40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af970b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af40b3290 con 0x7f0af40af2a0 2024-09-11T23:18:35.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af970b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0af40b3570 con 0x7f0af415bec0 2024-09-11T23:18:35.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af970b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0af40b3850 con 0x7f0af415c2a0 2024-09-11T23:18:35.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af37fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0af40af2a0 0x7f0af415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47286/0 (socket says 172.21.15.94:47286) 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af37fe640 1 -- 172.21.15.94:0/3371479006 learned_addr learned my addr 172.21.15.94:0/3371479006 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af27fc640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 0x7f0af40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af2ffd640 1 --2- 172.21.15.94:0/3371479006 >> v2:172.21.15.155:3300/0 conn(0x7f0af415bec0 0x7f0af40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695592248 0 0) 0x7f0af40b3290 con 0x7f0af40af2a0 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0adc003530 con 0x7f0af40af2a0 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 569353790 0 0) 0x7f0adc003530 con 0x7f0af40af2a0 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 msgr2=0x7f0af40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 0x7f0af40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 >> v2:172.21.15.155:3300/0 conn(0x7f0af415bec0 msgr2=0x7f0af40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 --2- 172.21.15.94:0/3371479006 >> v2:172.21.15.155:3300/0 conn(0x7f0af415bec0 0x7f0af40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af40b3b30 con 0x7f0af40af2a0 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f0ae4001680 con 0x7f0af40af2a0 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 >> v1:172.21.15.94:6789/0 conn(0x7f0af40af2a0 legacy=0x7f0af415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 0x7f0adc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0adc003f90 0x7f0adc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc004d50 0x7f0adc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0af40b3570 con 0x7f0adc003f90 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0af40b3850 con 0x7f0adc004d50 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0adc00b9d0 con 0x7f0af415c2a0 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af27fc640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0adc003f90 0x7f0adc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af37fe640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc004d50 0x7f0adc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af2ffd640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 0x7f0adc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af27fc640 1 -- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 msgr2=0x7f0adc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af27fc640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 0x7f0adc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af27fc640 1 -- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc004d50 msgr2=0x7f0adc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af27fc640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc004d50 0x7f0adc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af27fc640 1 -- 172.21.15.94:0/3371479006 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc003530 con 0x7f0adc003f90 2024-09-11T23:18:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af37fe640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc004d50 0x7f0adc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.553+0000 7f0af2ffd640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af415c2a0 0x7f0adc0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:35.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af27fc640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0adc003f90 0x7f0adc004810 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800e170 tx=0x7f0ae801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288404174441a081 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80b2070 con 0x7f0adc003f90 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae80a5c70 con 0x7f0adc003f90 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af1ffb640 1 -- 172.21.15.94:0/3371479006 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8009c10 con 0x7f0adc003f90 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- 172.21.15.94:0/3371479006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0adc003f90 msgr2=0x7f0adc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 --2- 172.21.15.94:0/3371479006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0adc003f90 0x7f0adc004810 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800e170 tx=0x7f0ae801cc60 comp rx=0 tx=0).stop 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 -- 172.21.15.94:0/3371479006 reap_dead start 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- 172.21.15.94:0/3371479006 shutdown_connections 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- 172.21.15.94:0/3371479006 >> 172.21.15.94:0/3371479006 conn(0x7f0af40b1f90 msgr2=0x7f0af40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- 172.21.15.94:0/3371479006 shutdown_connections 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- 172.21.15.94:0/3371479006 wait complete. 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 Processor -- start 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- start start 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc003f90 0x7f0af4151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af41516b0 0x7f0af4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0af414e130 0x7f0af414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0af40af730 con 0x7f0af414e130 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0af40b40f0 con 0x7f0adc003f90 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af970b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0af40afc90 con 0x7f0af41516b0 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0af414e130 0x7f0af414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0af414e130 0x7f0af414e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36178/0 (socket says 172.21.15.94:36178) 2024-09-11T23:18:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 -- 172.21.15.94:0/720704959 learned_addr learned my addr 172.21.15.94:0/720704959 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af2ffd640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc003f90 0x7f0af4151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af27fc640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af41516b0 0x7f0af4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 -- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af41516b0 msgr2=0x7f0af4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af41516b0 0x7f0af4151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 -- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc003f90 msgr2=0x7f0af4151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc003f90 0x7f0af4151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.557+0000 7f0af37fe640 1 -- 172.21.15.94:0/720704959 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af40b1820 con 0x7f0af414e130 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0af37fe640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0af414e130 0x7f0af414e5b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0af40b39d0 tx=0x7f0ae4010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0adb7fe640 1 -- 172.21.15.94:0/720704959 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae401a070 con 0x7f0af414e130 2024-09-11T23:18:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0adb7fe640 1 -- 172.21.15.94:0/720704959 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae4011040 con 0x7f0af414e130 2024-09-11T23:18:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af4152170 con 0x7f0af414e130 2024-09-11T23:18:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0adb7fe640 1 -- 172.21.15.94:0/720704959 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400ec60 con 0x7f0af414e130 2024-09-11T23:18:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af4152730 con 0x7f0af414e130 2024-09-11T23:18:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af40aed60 con 0x7f0af414e130 2024-09-11T23:18:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0adb7fe640 1 -- 172.21.15.94:0/720704959 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ae401d070 con 0x7f0af414e130 2024-09-11T23:18:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0adb7fe640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ae00678f0 0x7f0ae0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0adb7fe640 1 -- 172.21.15.94:0/720704959 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f0ae40884d0 con 0x7f0af414e130 2024-09-11T23:18:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0af2ffd640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ae00678f0 0x7f0ae0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.561+0000 7f0af2ffd640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ae00678f0 0x7f0ae0069db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009b40 tx=0x7f0aec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.565+0000 7f0adb7fe640 1 -- 172.21.15.94:0/720704959 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ae40587b0 con 0x7f0af414e130 2024-09-11T23:18:35.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.721+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f0af4159fc0 con 0x7f0af414e130 2024-09-11T23:18:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.725+0000 7f0adb7fe640 1 -- 172.21.15.94:0/720704959 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v23)=0 v23) ==== 124+0+0 (secure 0 0 0) 0x7f0ae405cab0 con 0x7f0af414e130 2024-09-11T23:18:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ae00678f0 msgr2=0x7f0ae0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ae00678f0 0x7f0ae0069db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009b40 tx=0x7f0aec008040 comp rx=0 tx=0).stop 2024-09-11T23:18:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0af414e130 msgr2=0x7f0af414e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0af414e130 0x7f0af414e5b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0af40b39d0 tx=0x7f0ae4010d70 comp rx=0 tx=0).stop 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 shutdown_connections 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0ae00678f0 0x7f0ae0069db0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0af414e130 0x7f0af414e5b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0af41516b0 0x7f0af4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 --2- 172.21.15.94:0/720704959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0adc003f90 0x7f0af4151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 >> 172.21.15.94:0/720704959 conn(0x7f0af40b1f90 msgr2=0x7f0af40b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 shutdown_connections 2024-09-11T23:18:35.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:35.729+0000 7f0af970b640 1 -- 172.21.15.94:0/720704959 wait complete. 2024-09-11T23:18:44.217 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:44.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:45.747 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:45.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.873+0000 7f8650e94640 1 Processor -- start 2024-09-11T23:18:45.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.873+0000 7f8650e94640 1 -- start start 2024-09-11T23:18:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f8650e94640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f864c1520a0 0x7f864c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f8650e94640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f8650e94640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864c070250 con 0x7f864c06fe50 2024-09-11T23:18:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f8650e94640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f864c152480 con 0x7f864c1520a0 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f8650e94640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f864c0aede0 con 0x7f864c15f3a0 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f864c1520a0 0x7f864c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f864c1520a0 0x7f864c06f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54700/0 (socket says 172.21.15.94:54700) 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 -- 172.21.15.94:0/4273183435 learned_addr learned my addr 172.21.15.94:0/4273183435 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 -- 172.21.15.94:0/4273183435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 msgr2=0x7f864c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 --2- 172.21.15.94:0/4273183435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 -- 172.21.15.94:0/4273183435 >> v1:172.21.15.94:6789/0 conn(0x7f864c06fe50 legacy=0x7f864c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864959a640 1 -- 172.21.15.94:0/4273183435 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973895680 0 0) 0x7f864c070250 con 0x7f864c06fe50 2024-09-11T23:18:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 -- 172.21.15.94:0/4273183435 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c15fa10 con 0x7f864c1520a0 2024-09-11T23:18:45.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864a59c640 1 --2- 172.21.15.94:0/4273183435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c06f910 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f863c009870 tx=0x7f863c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b880ffd3589edb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864959a640 1 -- 172.21.15.94:0/4273183435 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c0ab650 con 0x7f864c1520a0 2024-09-11T23:18:45.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864959a640 1 -- 172.21.15.94:0/4273183435 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c0b0070 con 0x7f864c1520a0 2024-09-11T23:18:45.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f864959a640 1 -- 172.21.15.94:0/4273183435 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c0aba10 con 0x7f864c1520a0 2024-09-11T23:18:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f8650e94640 1 -- 172.21.15.94:0/4273183435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 msgr2=0x7f864c06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.877+0000 7f8650e94640 1 --2- 172.21.15.94:0/4273183435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c06f910 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f863c009870 tx=0x7f863c01c560 comp rx=0 tx=0).stop 2024-09-11T23:18:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- 172.21.15.94:0/4273183435 shutdown_connections 2024-09-11T23:18:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 --2- 172.21.15.94:0/4273183435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 --2- 172.21.15.94:0/4273183435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c06f910 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- 172.21.15.94:0/4273183435 >> 172.21.15.94:0/4273183435 conn(0x7f864c0b1f90 msgr2=0x7f864c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- 172.21.15.94:0/4273183435 shutdown_connections 2024-09-11T23:18:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- 172.21.15.94:0/4273183435 wait complete. 2024-09-11T23:18:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 Processor -- start 2024-09-11T23:18:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- start start 2024-09-11T23:18:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864c06fe50 0x7f864c14e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f864c073d30 con 0x7f864c1520a0 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f864c073a50 con 0x7f864c06fe50 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f864c167f10 con 0x7f864c15f3a0 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c1464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54712/0 (socket says 172.21.15.94:54712) 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 -- 172.21.15.94:0/1911250315 learned_addr learned my addr 172.21.15.94:0/1911250315 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f864ad9d640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f864a59c640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864c06fe50 0x7f864c14e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 -- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 msgr2=0x7f864c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c15d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 -- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864c06fe50 msgr2=0x7f864c14e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864c06fe50 0x7f864c14e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 -- 172.21.15.94:0/1911250315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c150300 con 0x7f864c1520a0 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f864ad9d640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f864a59c640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864c06fe50 0x7f864c14e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8649d9b640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c1464b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f864000c450 tx=0x7f864000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f863affd640 1 -- 172.21.15.94:0/1911250315 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640017070 con 0x7f864c1520a0 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f863affd640 1 -- 172.21.15.94:0/1911250315 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8640005480 con 0x7f864c1520a0 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f863affd640 1 -- 172.21.15.94:0/1911250315 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640003840 con 0x7f864c1520a0 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c14b8a0 con 0x7f864c1520a0 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.881+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c14be60 con 0x7f864c1520a0 2024-09-11T23:18:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.885+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c06f910 con 0x7f864c1520a0 2024-09-11T23:18:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.885+0000 7f863affd640 1 -- 172.21.15.94:0/1911250315 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f864001a070 con 0x7f864c1520a0 2024-09-11T23:18:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.885+0000 7f863affd640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.885+0000 7f863affd640 1 -- 172.21.15.94:0/1911250315 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8640085100 con 0x7f864c1520a0 2024-09-11T23:18:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.885+0000 7f864a59c640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.885+0000 7f864a59c640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f863c0af000 tx=0x7f863c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:45.889+0000 7f863affd640 1 -- 172.21.15.94:0/1911250315 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8640055ab0 con 0x7f864c1520a0 2024-09-11T23:18:46.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.085+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f864c06e540 con 0x7f864c1520a0 2024-09-11T23:18:46.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f863affd640 1 -- 172.21.15.94:0/1911250315 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f86400553b0 con 0x7f864c1520a0 2024-09-11T23:18:46.089 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:46.089 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:46.089 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:46.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 msgr2=0x7f862c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f863c0af000 tx=0x7f863c008040 comp rx=0 tx=0).stop 2024-09-11T23:18:46.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 msgr2=0x7f864c1464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c1464b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f864000c450 tx=0x7f864000c910 comp rx=0 tx=0).stop 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 shutdown_connections 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864c15f3a0 0x7f864c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c1520a0 0x7f864c1464b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 --2- 172.21.15.94:0/1911250315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864c06fe50 0x7f864c14e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 >> 172.21.15.94:0/1911250315 conn(0x7f864c0b1f90 msgr2=0x7f864c15b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 shutdown_connections 2024-09-11T23:18:46.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.089+0000 7f8650e94640 1 -- 172.21.15.94:0/1911250315 wait complete. 2024-09-11T23:18:46.109 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump mds_cache strays_created 2024-09-11T23:18:46.256 INFO:teuthology.orchestra.run.smithi155.stdout:{"mds_cache":{"strays_created":0}} 2024-09-11T23:18:46.257 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_created": 0 } } 2024-09-11T23:18:46.257 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:46.257 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:46.263 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> import uuid 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> n = 100 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = False 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> if 0 > 0: 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = True 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> dpath = os.path.dirname(path) 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> fnameprefix = os.path.basename(path) 2024-09-11T23:18:46.264 DEBUG:teuthology.orchestra.run.smithi094:> os.makedirs(dpath, exist_ok=True) 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> try: 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> for i in range(n): 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> f.write(f"{i}") 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> f.flush() 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(f.fileno()) 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> if True: 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> os.unlink(fpath) 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:18:46.265 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> if create_hard_links: 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> for j in range(0): 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> if True: 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> finally: 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> os.close(dirfd) 2024-09-11T23:18:46.266 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:18:46.491 INFO:teuthology.orchestra.run.smithi094.stderr:Traceback (most recent call last): 2024-09-11T23:18:46.491 INFO:teuthology.orchestra.run.smithi094.stderr: File "", line 26, in 2024-09-11T23:18:46.491 INFO:teuthology.orchestra.run.smithi094.stderr:OSError: [Errno 28] No space left on device: '/home/ubuntu/cephtest/mnt.0/subdir/file_10' 2024-09-11T23:18:46.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-09-11T23:18:46.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:46.508 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:46.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.681+0000 7f2b9ff1a640 1 Processor -- start 2024-09-11T23:18:46.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.681+0000 7f2b9ff1a640 1 -- start start 2024-09-11T23:18:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9ff1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9815bec0 0x7f2b980ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9ff1a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b980af470 0x7f2b9806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9ff1a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b980b3290 con 0x7f2b9815c2a0 2024-09-11T23:18:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9ff1a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2b980b3570 con 0x7f2b980af470 2024-09-11T23:18:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9ff1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b980b3850 con 0x7f2b9815bec0 2024-09-11T23:18:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9e4b7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b980af470 0x7f2b9806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9dcb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9815bec0 0x7f2b980ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9dcb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9815bec0 0x7f2b980ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:34658/0 (socket says 172.21.15.94:34658) 2024-09-11T23:18:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9dcb6640 1 -- 172.21.15.94:0/3324835693 learned_addr learned my addr 172.21.15.94:0/3324835693 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9d4b5640 1 --1- 172.21.15.94:0/3324835693 >> v1:172.21.15.155:6789/0 conn(0x7f2b9815c2a0 0x7f2b980aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:44764/0 (socket says 172.21.15.94:44764) 2024-09-11T23:18:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9dcb6640 1 -- 172.21.15.94:0/3324835693 >> v2:172.21.15.155:3300/0 conn(0x7f2b980af470 msgr2=0x7f2b9806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9dcb6640 1 --2- 172.21.15.94:0/3324835693 >> v2:172.21.15.155:3300/0 conn(0x7f2b980af470 0x7f2b9806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9dcb6640 1 -- 172.21.15.94:0/3324835693 >> v1:172.21.15.155:6789/0 conn(0x7f2b9815c2a0 legacy=0x7f2b980aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.685+0000 7f2b9dcb6640 1 -- 172.21.15.94:0/3324835693 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b980b3b30 con 0x7f2b9815bec0 2024-09-11T23:18:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9dcb6640 1 --2- 172.21.15.94:0/3324835693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9815bec0 0x7f2b980ad200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63462df19bcf97a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ccb4640 1 -- 172.21.15.94:0/3324835693 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0a95f0 con 0x7f2b9815bec0 2024-09-11T23:18:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ccb4640 1 -- 172.21.15.94:0/3324835693 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0a9790 con 0x7f2b9815bec0 2024-09-11T23:18:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ccb4640 1 -- 172.21.15.94:0/3324835693 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0a9b60 con 0x7f2b9815bec0 2024-09-11T23:18:46.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/3324835693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9815bec0 msgr2=0x7f2b980ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/3324835693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9815bec0 0x7f2b980ad200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c01c530 comp rx=0 tx=0).stop 2024-09-11T23:18:46.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/3324835693 shutdown_connections 2024-09-11T23:18:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/3324835693 >> v2:172.21.15.155:3300/0 conn(0x7f2b980af470 0x7f2b9806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/3324835693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b9815bec0 0x7f2b980ad200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/3324835693 >> 172.21.15.94:0/3324835693 conn(0x7f2b980b1f90 msgr2=0x7f2b980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/3324835693 shutdown_connections 2024-09-11T23:18:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/3324835693 wait complete. 2024-09-11T23:18:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 Processor -- start 2024-09-11T23:18:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 -- start start 2024-09-11T23:18:46.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.689+0000 7f2b9ff1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b980af470 0x7f2b9809cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9815bec0 0x7f2b981504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9815c2a0 0x7f2b98150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9806ed50 con 0x7f2b9815bec0 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980ad740 con 0x7f2b9815c2a0 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9806eed0 con 0x7f2b980af470 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9815bec0 0x7f2b981504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9815bec0 0x7f2b981504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54720/0 (socket says 172.21.15.94:54720) 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 -- 172.21.15.94:0/1547759657 learned_addr learned my addr 172.21.15.94:0/1547759657 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:46.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9dcb6640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b980af470 0x7f2b9809cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9e4b7640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9815c2a0 0x7f2b98150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 -- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b980af470 msgr2=0x7f2b9809cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b980af470 0x7f2b9809cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 -- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9815c2a0 msgr2=0x7f2b98150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9815c2a0 0x7f2b98150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 -- 172.21.15.94:0/1547759657 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9809d630 con 0x7f2b9815bec0 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9dcb6640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b980af470 0x7f2b9809cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9d4b5640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9815bec0 0x7f2b981504f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c340 tx=0x7f2b9400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b8a7fc640 1 -- 172.21.15.94:0/1547759657 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b940074e0 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b8a7fc640 1 -- 172.21.15.94:0/1547759657 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b94007680 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9809d910 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b8a7fc640 1 -- 172.21.15.94:0/1547759657 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94004a30 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9809ded0 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b98068e50 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b8a7fc640 1 -- 172.21.15.94:0/1547759657 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b9401a020 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b8a7fc640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b7c0678f0 0x7f2b7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b8a7fc640 1 -- 172.21.15.94:0/1547759657 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2b94085570 con 0x7f2b9815bec0 2024-09-11T23:18:46.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.693+0000 7f2b9dcb6640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b7c0678f0 0x7f2b7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.697+0000 7f2b9dcb6640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b7c0678f0 0x7f2b7c069db0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ae000 tx=0x7f2b8c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.697+0000 7f2b8a7fc640 1 -- 172.21.15.94:0/1547759657 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2b94055f20 con 0x7f2b9815bec0 2024-09-11T23:18:46.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.897+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b9814fcc0 con 0x7f2b9815bec0 2024-09-11T23:18:46.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.897+0000 7f2b8a7fc640 1 -- 172.21.15.94:0/1547759657 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f2b94055820 con 0x7f2b9815bec0 2024-09-11T23:18:46.905 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:46.905 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:46.905 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:46.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b7c0678f0 msgr2=0x7f2b7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b7c0678f0 0x7f2b7c069db0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ae000 tx=0x7f2b8c0b3040 comp rx=0 tx=0).stop 2024-09-11T23:18:46.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9815bec0 msgr2=0x7f2b981504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9815bec0 0x7f2b981504f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c340 tx=0x7f2b9400c800 comp rx=0 tx=0).stop 2024-09-11T23:18:46.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 shutdown_connections 2024-09-11T23:18:46.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b9815c2a0 0x7f2b98150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2b7c0678f0 0x7f2b7c069db0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b9815bec0 0x7f2b981504f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 --2- 172.21.15.94:0/1547759657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b980af470 0x7f2b9809cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 >> 172.21.15.94:0/1547759657 conn(0x7f2b980b1f90 msgr2=0x7f2b980b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 shutdown_connections 2024-09-11T23:18:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:46.901+0000 7f2b9ff1a640 1 -- 172.21.15.94:0/1547759657 wait complete. 2024-09-11T23:18:46.927 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump mds_cache strays_created 2024-09-11T23:18:47.082 INFO:teuthology.orchestra.run.smithi155.stdout:{"mds_cache":{"strays_created":10}} 2024-09-11T23:18:47.083 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_created": 10 } } 2024-09-11T23:18:47.083 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ec77640 1 Processor -- start 2024-09-11T23:18:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ec77640 1 -- start start 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ec77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 0x7f16780d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ec77640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16780d32b0 con 0x7f16780d2e90 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ec77640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16780cfad0 con 0x7f16780cf620 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ec77640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f16780d0300 con 0x7f1678161a60 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f16780d2e90 0x7f16780cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55488/0 (socket says 172.21.15.94:55488) 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 -- 172.21.15.94:0/1220974793 learned_addr learned my addr 172.21.15.94:0/1220974793 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ca13640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 0x7f16780d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807716896 0 0) 0x7f16780d32b0 con 0x7f16780d2e90 2024-09-11T23:18:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1660003530 con 0x7f16780d2e90 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3690542072 0 0) 0x7f1660003530 con 0x7f16780d2e90 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 msgr2=0x7f16780d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 0x7f16780d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 >> v1:172.21.15.155:6789/0 conn(0x7f16780cf620 legacy=0x7f167806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16780b0f60 con 0x7f16780d2e90 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f1668001680 con 0x7f16780d2e90 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 >> v1:172.21.15.94:6789/0 conn(0x7f16780d2e90 legacy=0x7f16780cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16600039f0 0x7f1660003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16600043a0 0x7f1660004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 0x7f1660005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f16780d0300 con 0x7f16600043a0 2024-09-11T23:18:47.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f166000ba80 con 0x7f16600039f0 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f166000bc80 con 0x7f1678161a60 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16600043a0 0x7f1660004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167ca13640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16600039f0 0x7f1660003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f167d214640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 0x7f1660005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 -- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 msgr2=0x7f1660005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1678161a60 0x7f1660005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 -- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16600039f0 msgr2=0x7f1660003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16600039f0 0x7f1660003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.217+0000 7f1677fff640 1 -- 172.21.15.94:0/1220974793 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1660003530 con 0x7f16600043a0 2024-09-11T23:18:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f1677fff640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16600043a0 0x7f1660004870 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f166800c290 tx=0x7f166801cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0e9a63f33d4232 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668007d60 con 0x7f16600043a0 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16680a9070 con 0x7f16600043a0 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f16777fe640 1 -- 172.21.15.94:0/1220974793 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16680a5dd0 con 0x7f16600043a0 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 -- 172.21.15.94:0/1220974793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16600043a0 msgr2=0x7f1660004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 --2- 172.21.15.94:0/1220974793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16600043a0 0x7f1660004870 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f166800c290 tx=0x7f166801cd00 comp rx=0 tx=0).stop 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167d214640 1 -- 172.21.15.94:0/1220974793 reap_dead start 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 -- 172.21.15.94:0/1220974793 shutdown_connections 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 -- 172.21.15.94:0/1220974793 >> 172.21.15.94:0/1220974793 conn(0x7f167808bf90 msgr2=0x7f167809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 -- 172.21.15.94:0/1220974793 shutdown_connections 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 -- 172.21.15.94:0/1220974793 wait complete. 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 Processor -- start 2024-09-11T23:18:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.221+0000 7f167ec77640 1 -- start start 2024-09-11T23:18:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16600043a0 0x7f16781566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678156c00 0x7f16780cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16780cb980 0x7f16780cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f167806ceb0 con 0x7f16780cb980 2024-09-11T23:18:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16780d0020 con 0x7f1678156c00 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f167806d190 con 0x7f16600043a0 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16780cb980 0x7f16780cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16780cb980 0x7f16780cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54734/0 (socket says 172.21.15.94:54734) 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 -- 172.21.15.94:0/2056782204 learned_addr learned my addr 172.21.15.94:0/2056782204 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ca13640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16600043a0 0x7f16781566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f1677fff640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678156c00 0x7f16780cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 -- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16600043a0 msgr2=0x7f16781566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16600043a0 0x7f16781566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 -- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678156c00 msgr2=0x7f16780cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678156c00 0x7f16780cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 -- 172.21.15.94:0/2056782204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1678157080 con 0x7f16780cb980 2024-09-11T23:18:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167d214640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16780cb980 0x7f16780cbe30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f16780d5320 tx=0x7f1670010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f16757fa640 1 -- 172.21.15.94:0/2056782204 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670003d90 con 0x7f16780cb980 2024-09-11T23:18:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f16757fa640 1 -- 172.21.15.94:0/2056782204 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1670019070 con 0x7f16780cb980 2024-09-11T23:18:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16780b93f0 con 0x7f16780cb980 2024-09-11T23:18:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f16757fa640 1 -- 172.21.15.94:0/2056782204 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167000ea10 con 0x7f16780cb980 2024-09-11T23:18:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16780b99b0 con 0x7f16780cb980 2024-09-11T23:18:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16780d1560 con 0x7f16780cb980 2024-09-11T23:18:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f16757fa640 1 -- 172.21.15.94:0/2056782204 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1670013070 con 0x7f16780cb980 2024-09-11T23:18:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f16757fa640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16640678c0 0x7f1664069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f16757fa640 1 -- 172.21.15.94:0/2056782204 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f1670088ce0 con 0x7f16780cb980 2024-09-11T23:18:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.225+0000 7f167ca13640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16640678c0 0x7f1664069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.229+0000 7f167ca13640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16640678c0 0x7f1664069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f16780b5450 tx=0x7f166c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:47.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.229+0000 7f16757fa640 1 -- 172.21.15.94:0/2056782204 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1670059690 con 0x7f16780cb980 2024-09-11T23:18:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.425+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16780d0fa0 con 0x7f16780cb980 2024-09-11T23:18:47.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.425+0000 7f16757fa640 1 -- 172.21.15.94:0/2056782204 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f1670058f90 con 0x7f16780cb980 2024-09-11T23:18:47.428 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:47.429 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16640678c0 msgr2=0x7f1664069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16640678c0 0x7f1664069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f16780b5450 tx=0x7f166c008040 comp rx=0 tx=0).stop 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16780cb980 msgr2=0x7f16780cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16780cb980 0x7f16780cbe30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f16780d5320 tx=0x7f1670010eb0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 shutdown_connections 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16640678c0 0x7f1664069d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16780cb980 0x7f16780cbe30 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678156c00 0x7f16780cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 --2- 172.21.15.94:0/2056782204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16600043a0 0x7f16781566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 >> 172.21.15.94:0/2056782204 conn(0x7f167808bf90 msgr2=0x7f16780d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 shutdown_connections 2024-09-11T23:18:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:47.429+0000 7f167ec77640 1 -- 172.21.15.94:0/2056782204 wait complete. 2024-09-11T23:18:47.448 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump mds_cache strays_enqueued 2024-09-11T23:18:47.596 INFO:teuthology.orchestra.run.smithi155.stdout:{"mds_cache":{"strays_enqueued":0}} 2024-09-11T23:18:47.596 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 0 } } 2024-09-11T23:18:47.596 DEBUG:tasks.ceph_test_case:wait_until_equal: 0 != 10, waiting (timeout=60)... 2024-09-11T23:18:52.597 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:52.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40816f640 1 Processor -- start 2024-09-11T23:18:52.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40816f640 1 -- start start 2024-09-11T23:18:52.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40816f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 0x7fb40006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40816f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb40006fe50 0x7fb40015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40816f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb400070250 con 0x7fb40015f1d0 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40816f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb400152480 con 0x7fb40006fe50 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40816f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb4000aede0 con 0x7fb4001520a0 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40670c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb40015f1d0 0x7fb400071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40334/0 (socket says 172.21.15.94:40334) 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40670c640 1 -- 172.21.15.94:0/1102082877 learned_addr learned my addr 172.21.15.94:0/1102082877 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb405f0b640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 0x7fb40006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40570a640 1 --2- 172.21.15.94:0/1102082877 >> v2:172.21.15.155:3300/0 conn(0x7fb40006fe50 0x7fb40015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2337877467 0 0) 0x7fb400070250 con 0x7fb40015f1d0 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3ec003530 con 0x7fb40015f1d0 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063567916 0 0) 0x7fb3ec003530 con 0x7fb40015f1d0 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 msgr2=0x7fb40006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 0x7fb40006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 >> v2:172.21.15.155:3300/0 conn(0x7fb40006fe50 msgr2=0x7fb40015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 --2- 172.21.15.94:0/1102082877 >> v2:172.21.15.155:3300/0 conn(0x7fb40006fe50 0x7fb40015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40015fa10 con 0x7fb40015f1d0 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fb3f8001a00 con 0x7fb40015f1d0 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 >> v1:172.21.15.94:6789/0 conn(0x7fb40015f1d0 legacy=0x7fb400071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3ec0039c0 0x7fb3ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3ec004810 0x7fb3ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 0x7fb3ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb4000aede0 con 0x7fb3ec0039c0 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec00b9d0 con 0x7fb3ec004810 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ec00bb50 con 0x7fb4001520a0 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb405f0b640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3ec0039c0 0x7fb3ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40570a640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3ec004810 0x7fb3ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40670c640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 0x7fb3ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb405f0b640 1 -- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 msgr2=0x7fb3ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb405f0b640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4001520a0 0x7fb3ec0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb405f0b640 1 -- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3ec004810 msgr2=0x7fb3ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb405f0b640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3ec004810 0x7fb3ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb405f0b640 1 -- 172.21.15.94:0/1102082877 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec003530 con 0x7fb3ec0039c0 2024-09-11T23:18:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.729+0000 7fb40570a640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3ec004810 0x7fb3ec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb405f0b640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3ec0039c0 0x7fb3ec003de0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009ae0 tx=0x7fb3fc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06932ccd36b5eff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0096b0 con 0x7fb3ec0039c0 2024-09-11T23:18:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0a6460 con 0x7fb3ec0039c0 2024-09-11T23:18:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb404f09640 1 -- 172.21.15.94:0/1102082877 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0a6850 con 0x7fb3ec0039c0 2024-09-11T23:18:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 -- 172.21.15.94:0/1102082877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3ec0039c0 msgr2=0x7fb3ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 --2- 172.21.15.94:0/1102082877 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb3ec0039c0 0x7fb3ec003de0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009ae0 tx=0x7fb3fc01ca50 comp rx=0 tx=0).stop 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40670c640 1 -- 172.21.15.94:0/1102082877 reap_dead start 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 -- 172.21.15.94:0/1102082877 shutdown_connections 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 -- 172.21.15.94:0/1102082877 >> 172.21.15.94:0/1102082877 conn(0x7fb4000b1f90 msgr2=0x7fb4000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 -- 172.21.15.94:0/1102082877 shutdown_connections 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 -- 172.21.15.94:0/1102082877 wait complete. 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 Processor -- start 2024-09-11T23:18:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.733+0000 7fb40816f640 1 -- start start 2024-09-11T23:18:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3ec0039c0 0x7fb400144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb400153b50 0x7fb400152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb40014ff70 0x7fb40015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb400073d30 con 0x7fb40014ff70 2024-09-11T23:18:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb400073a50 con 0x7fb400153b50 2024-09-11T23:18:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb40015f620 con 0x7fb3ec0039c0 2024-09-11T23:18:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb40014ff70 0x7fb40015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb40014ff70 0x7fb40015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51538/0 (socket says 172.21.15.94:51538) 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 -- 172.21.15.94:0/2302052914 learned_addr learned my addr 172.21.15.94:0/2302052914 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40570a640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb400153b50 0x7fb400152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb405f0b640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3ec0039c0 0x7fb400144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 -- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3ec0039c0 msgr2=0x7fb400144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3ec0039c0 0x7fb400144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 -- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb400153b50 msgr2=0x7fb400152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb400153b50 0x7fb400152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 -- 172.21.15.94:0/2302052914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4001529c0 con 0x7fb40014ff70 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40670c640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb40014ff70 0x7fb40015c6b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb40015f5b0 tx=0x7fb3f800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb3f67fc640 1 -- 172.21.15.94:0/2302052914 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8004d70 con 0x7fb40014ff70 2024-09-11T23:18:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb3f67fc640 1 -- 172.21.15.94:0/2302052914 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f800bb20 con 0x7fb40014ff70 2024-09-11T23:18:52.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40014eed0 con 0x7fb40014ff70 2024-09-11T23:18:52.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb3f67fc640 1 -- 172.21.15.94:0/2302052914 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8007070 con 0x7fb40014ff70 2024-09-11T23:18:52.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40014f490 con 0x7fb40014ff70 2024-09-11T23:18:52.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb40015ec90 con 0x7fb40014ff70 2024-09-11T23:18:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb3f67fc640 1 -- 172.21.15.94:0/2302052914 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3f801b020 con 0x7fb40014ff70 2024-09-11T23:18:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb3f67fc640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb3e40678f0 0x7fb3e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb3f67fc640 1 -- 172.21.15.94:0/2302052914 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fb3f8086540 con 0x7fb40014ff70 2024-09-11T23:18:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.737+0000 7fb405f0b640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb3e40678f0 0x7fb3e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.741+0000 7fb405f0b640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb3e40678f0 0x7fb3e4069db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0ad000 tx=0x7fb3fc0b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.741+0000 7fb3f67fc640 1 -- 172.21.15.94:0/2302052914 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb3f8022070 con 0x7fb40014ff70 2024-09-11T23:18:52.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb40006ed30 con 0x7fb40014ff70 2024-09-11T23:18:52.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb3f67fc640 1 -- 172.21.15.94:0/2302052914 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7fb3f8056fd0 con 0x7fb40014ff70 2024-09-11T23:18:52.941 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:52.941 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:52.942 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb3e40678f0 msgr2=0x7fb3e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb3e40678f0 0x7fb3e4069db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0ad000 tx=0x7fb3fc0b2040 comp rx=0 tx=0).stop 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb40014ff70 msgr2=0x7fb40015c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb40014ff70 0x7fb40015c6b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb40015f5b0 tx=0x7fb3f800b4a0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 shutdown_connections 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb3e40678f0 0x7fb3e4069db0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb40014ff70 0x7fb40015c6b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb400153b50 0x7fb400152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 --2- 172.21.15.94:0/2302052914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3ec0039c0 0x7fb400144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 >> 172.21.15.94:0/2302052914 conn(0x7fb4000b1f90 msgr2=0x7fb40015d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 shutdown_connections 2024-09-11T23:18:52.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:52.941+0000 7fb40816f640 1 -- 172.21.15.94:0/2302052914 wait complete. 2024-09-11T23:18:52.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump mds_cache strays_enqueued 2024-09-11T23:18:53.110 INFO:teuthology.orchestra.run.smithi155.stdout:{"mds_cache":{"strays_enqueued":10}} 2024-09-11T23:18:53.110 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 10 } } 2024-09-11T23:18:53.111 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:53.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.233+0000 7fd9ce3b9640 1 Processor -- start 2024-09-11T23:18:53.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.233+0000 7fd9ce3b9640 1 -- start start 2024-09-11T23:18:53.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.233+0000 7fd9ce3b9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fef0 0x7fd9c806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9ce3b9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c806ee50 con 0x7fd9c80b3d50 2024-09-11T23:18:53.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9ce3b9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c806f130 con 0x7fd9c8073e60 2024-09-11T23:18:53.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9ce3b9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c806f410 con 0x7fd9c806fef0 2024-09-11T23:18:53.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9cc956640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd9c80b3d50 0x7fd9c8072610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40348/0 (socket says 172.21.15.94:40348) 2024-09-11T23:18:53.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9cc956640 1 -- 172.21.15.94:0/3607062595 learned_addr learned my addr 172.21.15.94:0/3607062595 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:53.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 --2- 172.21.15.94:0/3607062595 >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fef0 0x7fd9c806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426239152 0 0) 0x7fd9c806ee50 con 0x7fd9c80b3d50 2024-09-11T23:18:53.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9b4003530 con 0x7fd9c80b3d50 2024-09-11T23:18:53.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1082537023 0 0) 0x7fd9b4003530 con 0x7fd9c80b3d50 2024-09-11T23:18:53.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fef0 msgr2=0x7fd9c806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 --2- 172.21.15.94:0/3607062595 >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fef0 0x7fd9c806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 >> v1:172.21.15.155:6789/0 conn(0x7fd9c8073e60 legacy=0x7fd9c815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c806f6f0 con 0x7fd9c80b3d50 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fd9c0001a00 con 0x7fd9c80b3d50 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 >> v1:172.21.15.94:6789/0 conn(0x7fd9c80b3d50 legacy=0x7fd9c8072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b4003a10 0x7fd9b4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4005220 0x7fd9b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c806f410 con 0x7fd9b4004810 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b400c170 con 0x7fd9b4003a10 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b400c370 con 0x7fd9b4005220 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c7fff640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b4003a10 0x7fd9b4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 -- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4005220 msgr2=0x7fd9b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4005220 0x7fd9b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 -- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b4003a10 msgr2=0x7fd9b4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b4003a10 0x7fd9b4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 -- 172.21.15.94:0/3607062595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4003530 con 0x7fd9b4004810 2024-09-11T23:18:53.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9cc956640 1 -- 172.21.15.94:0/3607062595 reap_dead start 2024-09-11T23:18:53.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c7fff640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b4003a10 0x7fd9b4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:53.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9bffff640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9b4004c90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000aa90 tx=0x7fd9b001df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2363517b0d682627 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00b3070 con 0x7fd9b4004810 2024-09-11T23:18:53.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b00a6d50 con 0x7fd9b4004810 2024-09-11T23:18:53.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9c77fe640 1 -- 172.21.15.94:0/3607062595 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000b040 con 0x7fd9b4004810 2024-09-11T23:18:53.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.237+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/3607062595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 msgr2=0x7fd9b4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9b4004c90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000aa90 tx=0x7fd9b001df60 comp rx=0 tx=0).stop 2024-09-11T23:18:53.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/3607062595 shutdown_connections 2024-09-11T23:18:53.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/3607062595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9b4004c90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/3607062595 >> 172.21.15.94:0/3607062595 conn(0x7fd9c80b1f90 msgr2=0x7fd9c80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:53.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/3607062595 shutdown_connections 2024-09-11T23:18:53.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/3607062595 wait complete. 2024-09-11T23:18:53.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 Processor -- start 2024-09-11T23:18:53.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- start start 2024-09-11T23:18:53.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9c80b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c8146100 0x7fd9c8146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81f5a40 0x7fd9c81f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c806e900 con 0x7fd9b4004810 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c806e780 con 0x7fd9c8146100 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c806ea80 con 0x7fd9c81f5a40 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9c80b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9c80b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51566/0 (socket says 172.21.15.94:51566) 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 -- 172.21.15.94:0/389874660 learned_addr learned my addr 172.21.15.94:0/389874660 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9bffff640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c8146100 0x7fd9c8146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9cc956640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81f5a40 0x7fd9c81f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 -- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81f5a40 msgr2=0x7fd9c81f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81f5a40 0x7fd9c81f5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 -- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c8146100 msgr2=0x7fd9c8146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c8146100 0x7fd9c8146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 -- 172.21.15.94:0/389874660 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c81f8cb0 con 0x7fd9b4004810 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9bffff640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c8146100 0x7fd9c8146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c7fff640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9c80b1060 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800d4d0 tx=0x7fd9b800d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c57fa640 1 -- 172.21.15.94:0/389874660 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8005480 con 0x7fd9b4004810 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c57fa640 1 -- 172.21.15.94:0/389874660 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b8017070 con 0x7fd9b4004810 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c81f8f70 con 0x7fd9b4004810 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9c57fa640 1 -- 172.21.15.94:0/389874660 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8003860 con 0x7fd9b4004810 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.241+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c81f9530 con 0x7fd9b4004810 2024-09-11T23:18:53.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.245+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c815e400 con 0x7fd9b4004810 2024-09-11T23:18:53.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.245+0000 7fd9c57fa640 1 -- 172.21.15.94:0/389874660 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9b8003a00 con 0x7fd9b4004810 2024-09-11T23:18:53.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.245+0000 7fd9c57fa640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9a80678c0 0x7fd9a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.245+0000 7fd9c57fa640 1 -- 172.21.15.94:0/389874660 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd9b8085b30 con 0x7fd9b4004810 2024-09-11T23:18:53.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.245+0000 7fd9bffff640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9a80678c0 0x7fd9a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.245+0000 7fd9bffff640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9a80678c0 0x7fd9a8069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00b0000 tx=0x7fd9b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.249+0000 7fd9c57fa640 1 -- 172.21.15.94:0/389874660 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd9b800f2f0 con 0x7fd9b4004810 2024-09-11T23:18:53.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.437+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c80723f0 con 0x7fd9b4004810 2024-09-11T23:18:53.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9c57fa640 1 -- 172.21.15.94:0/389874660 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7fd9b8056570 con 0x7fd9b4004810 2024-09-11T23:18:53.441 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:53.441 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:53.441 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9a80678c0 msgr2=0x7fd9a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9a80678c0 0x7fd9a8069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00b0000 tx=0x7fd9b0008040 comp rx=0 tx=0).stop 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 msgr2=0x7fd9c80b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9c80b1060 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800d4d0 tx=0x7fd9b800d990 comp rx=0 tx=0).stop 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 shutdown_connections 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81f5a40 0x7fd9c81f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c8146100 0x7fd9c8146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9a80678c0 0x7fd9a8069d80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 --2- 172.21.15.94:0/389874660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9b4004810 0x7fd9c80b1060 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 >> 172.21.15.94:0/389874660 conn(0x7fd9c80b1f90 msgr2=0x7fd9c80cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:53.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 shutdown_connections 2024-09-11T23:18:53.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53.441+0000 7fd9ce3b9640 1 -- 172.21.15.94:0/389874660 wait complete. 2024-09-11T23:18:53.458 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump purge_queue pq_executed 2024-09-11T23:18:53.608 INFO:teuthology.orchestra.run.smithi155.stdout:{"purge_queue":{"pq_executed":10}} 2024-09-11T23:18:53.608 DEBUG:tasks.cephfs.filesystem:_json_asok output { "purge_queue": { "pq_executed": 10 } } 2024-09-11T23:18:53.609 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:53.609 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> import uuid 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> n = 10 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = False 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> if 0 > 0: 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> create_hard_links = True 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:53.615 DEBUG:teuthology.orchestra.run.smithi094:> dpath = os.path.dirname(path) 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> fnameprefix = os.path.basename(path) 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> os.makedirs(dpath, exist_ok=True) 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> try: 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> for i in range(n): 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> f.write(f"{i}") 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> f.flush() 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(f.fileno()) 2024-09-11T23:18:53.616 DEBUG:teuthology.orchestra.run.smithi094:> if True: 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> os.unlink(fpath) 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> if True: 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> if create_hard_links: 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> for j in range(0): 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> if False: 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> os.fsync(dirfd) 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> finally: 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> os.close(dirfd) 2024-09-11T23:18:53.617 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:18:53.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:53.891 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:18:53.891 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:53.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:54.029 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:18:54.029 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:54.029 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:54.029 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:54.035 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:18:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a7b71640 1 Processor -- start 2024-09-11T23:18:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a7b71640 1 -- start start 2024-09-11T23:18:54.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a7b71640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 0x7f71a00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a7b71640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a00b3290 con 0x7f71a00af470 2024-09-11T23:18:54.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a7b71640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a00b3570 con 0x7f71a015c2a0 2024-09-11T23:18:54.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a7b71640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71a00b3850 con 0x7f71a015bec0 2024-09-11T23:18:54.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a610e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f71a00af470 0x7f71a006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40352/0 (socket says 172.21.15.94:40352) 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a610e640 1 -- 172.21.15.94:0/2461683239 learned_addr learned my addr 172.21.15.94:0/2461683239 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a590d640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 0x7f71a00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435000433 0 0) 0x7f71a00b3290 con 0x7f71a00af470 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f718c003530 con 0x7f71a00af470 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3401479778 0 0) 0x7f718c003530 con 0x7f71a00af470 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 msgr2=0x7f71a00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 0x7f71a00ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 >> v1:172.21.15.155:6789/0 conn(0x7f71a015c2a0 legacy=0x7f71a00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a00b3b30 con 0x7f71a00af470 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7198001a00 con 0x7f71a00af470 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 >> v1:172.21.15.94:6789/0 conn(0x7f71a00af470 legacy=0x7f71a006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f718c0039f0 0x7f718c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f718c004810 0x7f718c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 0x7f718c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f71a00b3850 con 0x7f718c004810 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f718c00ba80 con 0x7f718c0039f0 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.205+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f718c00bc80 con 0x7f71a015bec0 2024-09-11T23:18:54.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a510c640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f718c004810 0x7f718c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a590d640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f718c0039f0 0x7f718c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a610e640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 0x7f718c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a510c640 1 -- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 msgr2=0x7f718c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a510c640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71a015bec0 0x7f718c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a510c640 1 -- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f718c0039f0 msgr2=0x7f718c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a510c640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f718c0039f0 0x7f718c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a510c640 1 -- 172.21.15.94:0/2461683239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718c003530 con 0x7f718c004810 2024-09-11T23:18:54.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a510c640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f718c004810 0x7f718c004c90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71a00ae510 tx=0x7f719c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c35bafae6384535 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c0013a0 con 0x7f718c004810 2024-09-11T23:18:54.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719c0052f0 con 0x7f718c004810 2024-09-11T23:18:54.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a490b640 1 -- 172.21.15.94:0/2461683239 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c003840 con 0x7f718c004810 2024-09-11T23:18:54.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a7b71640 1 -- 172.21.15.94:0/2461683239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f718c004810 msgr2=0x7f718c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a7b71640 1 --2- 172.21.15.94:0/2461683239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f718c004810 0x7f718c004c90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71a00ae510 tx=0x7f719c01c360 comp rx=0 tx=0).stop 2024-09-11T23:18:54.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a610e640 1 -- 172.21.15.94:0/2461683239 reap_dead start 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a7b71640 1 -- 172.21.15.94:0/2461683239 shutdown_connections 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a7b71640 1 -- 172.21.15.94:0/2461683239 >> 172.21.15.94:0/2461683239 conn(0x7f71a00b1f90 msgr2=0x7f71a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a7b71640 1 -- 172.21.15.94:0/2461683239 shutdown_connections 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.209+0000 7f71a7b71640 1 -- 172.21.15.94:0/2461683239 wait complete. 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 Processor -- start 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 -- start start 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c004810 0x7f71a014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71a01505c0 0x7f71a0150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71a0153060 0x7f71a01534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f71a00afc90 con 0x7f71a01505c0 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71a00b40f0 con 0x7f71a0153060 2024-09-11T23:18:54.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71a00ad200 con 0x7f718c004810 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71a01505c0 0x7f71a0150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71a01505c0 0x7f71a0150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51592/0 (socket says 172.21.15.94:51592) 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 -- 172.21.15.94:0/887074067 learned_addr learned my addr 172.21.15.94:0/887074067 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a590d640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c004810 0x7f71a014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a610e640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71a0153060 0x7f71a01534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 -- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c004810 msgr2=0x7f71a014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c004810 0x7f71a014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 -- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71a0153060 msgr2=0x7f71a01534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71a0153060 0x7f71a01534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 -- 172.21.15.94:0/887074067 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a01e13f0 con 0x7f71a01505c0 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a510c640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71a01505c0 0x7f71a0150a40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f719c005040 tx=0x7f718c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71967fc640 1 -- 172.21.15.94:0/887074067 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c0054a0 con 0x7f71a01505c0 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71967fc640 1 -- 172.21.15.94:0/887074067 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719c0bb070 con 0x7f71a01505c0 2024-09-11T23:18:54.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a01e16d0 con 0x7f71a01505c0 2024-09-11T23:18:54.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71967fc640 1 -- 172.21.15.94:0/887074067 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c0069e0 con 0x7f71a01505c0 2024-09-11T23:18:54.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a01e1c90 con 0x7f71a01505c0 2024-09-11T23:18:54.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a00ad630 con 0x7f71a01505c0 2024-09-11T23:18:54.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.213+0000 7f71967fc640 1 -- 172.21.15.94:0/887074067 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f719c0b4040 con 0x7f71a01505c0 2024-09-11T23:18:54.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.217+0000 7f71967fc640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f71840678c0 0x7f7184069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.217+0000 7f71967fc640 1 -- 172.21.15.94:0/887074067 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f719c120220 con 0x7f71a01505c0 2024-09-11T23:18:54.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.217+0000 7f71a590d640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f71840678c0 0x7f7184069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.217+0000 7f71a590d640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f71840678c0 0x7f7184069d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f71a015aa30 tx=0x7f7190008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.221+0000 7f71967fc640 1 -- 172.21.15.94:0/887074067 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f719c0a4e20 con 0x7f71a01505c0 2024-09-11T23:18:54.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.381+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f71a006efe0 con 0x7f71a01505c0 2024-09-11T23:18:54.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.381+0000 7f71967fc640 1 -- 172.21.15.94:0/887074067 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f719c016070 con 0x7f71a01505c0 2024-09-11T23:18:54.384 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:18:54.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f71840678c0 msgr2=0x7f7184069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f71840678c0 0x7f7184069d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f71a015aa30 tx=0x7f7190008040 comp rx=0 tx=0).stop 2024-09-11T23:18:54.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71a01505c0 msgr2=0x7f71a0150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71a01505c0 0x7f71a0150a40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f719c005040 tx=0x7f718c005840 comp rx=0 tx=0).stop 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 shutdown_connections 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71a0153060 0x7f71a01534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f71840678c0 0x7f7184069d80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71a01505c0 0x7f71a0150a40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 --2- 172.21.15.94:0/887074067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c004810 0x7f71a014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 >> 172.21.15.94:0/887074067 conn(0x7f71a00b1f90 msgr2=0x7f71a006df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 shutdown_connections 2024-09-11T23:18:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.385+0000 7f71a7b71640 1 -- 172.21.15.94:0/887074067 wait complete. 2024-09-11T23:18:54.401 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:18:54.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:54.401 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:54.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[42459]: fuse finished with error 0 and tester_r 0 2024-09-11T23:18:54.412 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:18:54.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:54.413 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:18:54.583 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:54.583 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:18:54.583 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:54.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:18:54.590 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:18:54.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:54.590 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:18:54.640 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T23:18:54.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:54.641 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:54.641 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:18:54.641 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:54.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:18:54.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:18:54.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:54.647 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:18:54.693 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T23:18:54.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:54.694 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:18:54.694 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:18:54.694 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:54.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:18:54.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:18:54.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:54.700 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:18:54.747 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T23:18:54.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:54.748 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:54.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc279af640 1 Processor -- start 2024-09-11T23:18:54.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc279af640 1 -- start start 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc279af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2015e5f0 0x7fcc2006d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc279af640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc200cfaf0 0x7fcc200d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc279af640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc2006d9c0 con 0x7fcc200ce9d0 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc279af640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcc2006dca0 con 0x7fcc200cfaf0 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc279af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2006df80 con 0x7fcc2015e5f0 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc24f4a640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcc200ce9d0 0x7fcc200cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40356/0 (socket says 172.21.15.94:40356) 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc24f4a640 1 -- 172.21.15.94:0/3807647372 learned_addr learned my addr 172.21.15.94:0/3807647372 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:54.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc25f4c640 1 --2- 172.21.15.94:0/3807647372 >> v2:172.21.15.155:3300/0 conn(0x7fcc200cfaf0 0x7fcc200d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704189472 0 0) 0x7fcc2006d9c0 con 0x7fcc200ce9d0 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc2574b640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2015e5f0 0x7fcc2006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc0c003530 con 0x7fcc200ce9d0 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3763610231 0 0) 0x7fcc0c003530 con 0x7fcc200ce9d0 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2015e5f0 msgr2=0x7fcc2006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2015e5f0 0x7fcc2006d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 >> v2:172.21.15.155:3300/0 conn(0x7fcc200cfaf0 msgr2=0x7fcc200d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 --2- 172.21.15.94:0/3807647372 >> v2:172.21.15.155:3300/0 conn(0x7fcc200cfaf0 0x7fcc200d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2006e260 con 0x7fcc200ce9d0 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fcc10001680 con 0x7fcc200ce9d0 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 >> v1:172.21.15.94:6789/0 conn(0x7fcc200ce9d0 legacy=0x7fcc200cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc0c0039c0 0x7fcc0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc0c004810 0x7fcc0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc0c005190 0x7fcc0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2006dca0 con 0x7fcc0c005190 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2006df80 con 0x7fcc0c0039c0 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c00bf10 con 0x7fcc0c004810 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc25f4c640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc0c005190 0x7fcc0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc2574b640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc0c0039c0 0x7fcc0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc25f4c640 1 -- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc0c004810 msgr2=0x7fcc0c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc25f4c640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc0c004810 0x7fcc0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc25f4c640 1 -- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc0c0039c0 msgr2=0x7fcc0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc25f4c640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc0c0039c0 0x7fcc0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.877+0000 7fcc25f4c640 1 -- 172.21.15.94:0/3807647372 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c003530 con 0x7fcc0c005190 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc25f4c640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc0c005190 0x7fcc0c00b9d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009f90 tx=0x7fcc1801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0311007e98fbbd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc180b2070 con 0x7fcc0c005190 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc180a5c90 con 0x7fcc0c005190 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc17fff640 1 -- 172.21.15.94:0/3807647372 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18009c10 con 0x7fcc0c005190 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 -- 172.21.15.94:0/3807647372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc0c005190 msgr2=0x7fcc0c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 --2- 172.21.15.94:0/3807647372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc0c005190 0x7fcc0c00b9d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009f90 tx=0x7fcc1801cc80 comp rx=0 tx=0).stop 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc25f4c640 1 -- 172.21.15.94:0/3807647372 reap_dead start 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 -- 172.21.15.94:0/3807647372 shutdown_connections 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 -- 172.21.15.94:0/3807647372 >> 172.21.15.94:0/3807647372 conn(0x7fcc20074030 msgr2=0x7fcc2009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 -- 172.21.15.94:0/3807647372 shutdown_connections 2024-09-11T23:18:54.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 -- 172.21.15.94:0/3807647372 wait complete. 2024-09-11T23:18:54.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 Processor -- start 2024-09-11T23:18:54.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.881+0000 7fcc279af640 1 -- start start 2024-09-11T23:18:54.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc20158820 0x7fcc20156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc200b71d0 0x7fcc2015ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc201604b0 0x7fcc200b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2006d420 con 0x7fcc200b71d0 2024-09-11T23:18:54.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2006d2a0 con 0x7fcc201604b0 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2006d5a0 con 0x7fcc20158820 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc200b71d0 0x7fcc2015ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc200b71d0 0x7fcc2015ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51610/0 (socket says 172.21.15.94:51610) 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 -- 172.21.15.94:0/4275750986 learned_addr learned my addr 172.21.15.94:0/4275750986 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc2574b640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc20158820 0x7fcc20156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc25f4c640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc201604b0 0x7fcc200b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 -- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc20158820 msgr2=0x7fcc20156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc20158820 0x7fcc20156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 -- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc201604b0 msgr2=0x7fcc200b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc201604b0 0x7fcc200b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 -- 172.21.15.94:0/4275750986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc200b7690 con 0x7fcc200b71d0 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc25f4c640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc201604b0 0x7fcc200b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:54.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc24f4a640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc200b71d0 0x7fcc2015ff70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000caa0 tx=0x7fcc1000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc15ffb640 1 -- 172.21.15.94:0/4275750986 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10018070 con 0x7fcc200b71d0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc15ffb640 1 -- 172.21.15.94:0/4275750986 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc10004ce0 con 0x7fcc200b71d0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc200b7970 con 0x7fcc200b71d0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc15ffb640 1 -- 172.21.15.94:0/4275750986 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10007310 con 0x7fcc200b71d0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc200b7f30 con 0x7fcc200b71d0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2015e5f0 con 0x7fcc200b71d0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc15ffb640 1 -- 172.21.15.94:0/4275750986 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc1001b070 con 0x7fcc200b71d0 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc15ffb640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcc040678c0 0x7fcc04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc15ffb640 1 -- 172.21.15.94:0/4275750986 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fcc10085700 con 0x7fcc200b71d0 2024-09-11T23:18:54.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.885+0000 7fcc2574b640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcc040678c0 0x7fcc04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.889+0000 7fcc2574b640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcc040678c0 0x7fcc04069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009a30 tx=0x7fcc1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:54.889+0000 7fcc15ffb640 1 -- 172.21.15.94:0/4275750986 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcc10056190 con 0x7fcc200b71d0 2024-09-11T23:18:55.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.085+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc200d0a10 con 0x7fcc200b71d0 2024-09-11T23:18:55.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.085+0000 7fcc15ffb640 1 -- 172.21.15.94:0/4275750986 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7fcc10055a90 con 0x7fcc200b71d0 2024-09-11T23:18:55.087 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:55.087 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:55.087 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcc040678c0 msgr2=0x7fcc04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcc040678c0 0x7fcc04069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009a30 tx=0x7fcc1c008040 comp rx=0 tx=0).stop 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc200b71d0 msgr2=0x7fcc2015ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc200b71d0 0x7fcc2015ff70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000caa0 tx=0x7fcc1000cf60 comp rx=0 tx=0).stop 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 shutdown_connections 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc201604b0 0x7fcc200b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcc040678c0 0x7fcc04069d80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc200b71d0 0x7fcc2015ff70 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 --2- 172.21.15.94:0/4275750986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc20158820 0x7fcc20156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 >> 172.21.15.94:0/4275750986 conn(0x7fcc200b3730 msgr2=0x7fcc200c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 shutdown_connections 2024-09-11T23:18:55.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.089+0000 7fcc279af640 1 -- 172.21.15.94:0/4275750986 wait complete. 2024-09-11T23:18:55.105 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:55.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.225+0000 7f9a27be3640 1 Processor -- start 2024-09-11T23:18:55.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.225+0000 7f9a27be3640 1 -- start start 2024-09-11T23:18:55.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.225+0000 7f9a27be3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015bec0 0x7f9a200ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.225+0000 7f9a27be3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a200af470 0x7f9a2006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.225+0000 7f9a27be3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a200b3290 con 0x7f9a2015c2a0 2024-09-11T23:18:55.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.225+0000 7f9a27be3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9a200b3570 con 0x7f9a200af470 2024-09-11T23:18:55.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.225+0000 7f9a27be3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a200b3850 con 0x7f9a2015bec0 2024-09-11T23:18:55.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a2597f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015bec0 0x7f9a200ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a26180640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a200af470 0x7f9a2006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a2517e640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9a2015c2a0 0x7f9a200aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:54824/0 (socket says 172.21.15.94:54824) 2024-09-11T23:18:55.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a2517e640 1 -- 172.21.15.94:0/2634713783 learned_addr learned my addr 172.21.15.94:0/2634713783 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:55.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a26180640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a200af470 0x7f9a2006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:56860/0 (socket says 172.21.15.94:56860) 2024-09-11T23:18:55.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a26180640 1 -- 172.21.15.94:0/2634713783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015bec0 msgr2=0x7f9a200ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:55.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a26180640 1 --2- 172.21.15.94:0/2634713783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015bec0 0x7f9a200ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a26180640 1 -- 172.21.15.94:0/2634713783 >> v1:172.21.15.155:6789/0 conn(0x7f9a2015c2a0 legacy=0x7f9a200aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a2497d640 1 -- 172.21.15.94:0/2634713783 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965722209 0 0) 0x7f9a200b3290 con 0x7f9a2015c2a0 2024-09-11T23:18:55.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a26180640 1 -- 172.21.15.94:0/2634713783 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a200b3b30 con 0x7f9a200af470 2024-09-11T23:18:55.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a26180640 1 --2- 172.21.15.94:0/2634713783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 0x7f9a2006e000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009d90 tx=0x7f9a1801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf0f5cdd36f953c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a2497d640 1 -- 172.21.15.94:0/2634713783 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a180b2070 con 0x7f9a200af470 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a2497d640 1 -- 172.21.15.94:0/2634713783 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a180a5a00 con 0x7f9a200af470 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.229+0000 7f9a2497d640 1 -- 172.21.15.94:0/2634713783 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a180a5dd0 con 0x7f9a200af470 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- 172.21.15.94:0/2634713783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 msgr2=0x7f9a2006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 --2- 172.21.15.94:0/2634713783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 0x7f9a2006e000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009d90 tx=0x7f9a1801c940 comp rx=0 tx=0).stop 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- 172.21.15.94:0/2634713783 shutdown_connections 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 --2- 172.21.15.94:0/2634713783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 0x7f9a2006e000 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 --2- 172.21.15.94:0/2634713783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015bec0 0x7f9a200ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- 172.21.15.94:0/2634713783 >> 172.21.15.94:0/2634713783 conn(0x7f9a200b1f90 msgr2=0x7f9a200b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- 172.21.15.94:0/2634713783 shutdown_connections 2024-09-11T23:18:55.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- 172.21.15.94:0/2634713783 wait complete. 2024-09-11T23:18:55.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 Processor -- start 2024-09-11T23:18:55.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- start start 2024-09-11T23:18:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 0x7f9a201f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a2015bec0 0x7f9a201f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015c2a0 0x7f9a201fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2006ed50 con 0x7f9a2015bec0 2024-09-11T23:18:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a200ad740 con 0x7f9a200af470 2024-09-11T23:18:55.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2006eed0 con 0x7f9a2015c2a0 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a2015bec0 0x7f9a201f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a2015bec0 0x7f9a201f9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51620/0 (socket says 172.21.15.94:51620) 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 -- 172.21.15.94:0/3167841233 learned_addr learned my addr 172.21.15.94:0/3167841233 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2597f640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 0x7f9a201f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a26180640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015c2a0 0x7f9a201fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 -- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015c2a0 msgr2=0x7f9a201fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015c2a0 0x7f9a201fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 -- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 msgr2=0x7f9a201f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 0x7f9a201f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 -- 172.21.15.94:0/3167841233 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2014f840 con 0x7f9a2015bec0 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a26180640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015c2a0 0x7f9a201fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a2517e640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a2015bec0 0x7f9a201f9f30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c3e0 tx=0x7f9a1c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a167fc640 1 -- 172.21.15.94:0/3167841233 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0074e0 con 0x7f9a2015bec0 2024-09-11T23:18:55.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a167fc640 1 -- 172.21.15.94:0/3167841233 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1c0047f0 con 0x7f9a2015bec0 2024-09-11T23:18:55.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2014fb20 con 0x7f9a2015bec0 2024-09-11T23:18:55.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a167fc640 1 -- 172.21.15.94:0/3167841233 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c004be0 con 0x7f9a2015bec0 2024-09-11T23:18:55.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.233+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a201500e0 con 0x7f9a2015bec0 2024-09-11T23:18:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.237+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a2006f250 con 0x7f9a2015bec0 2024-09-11T23:18:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.237+0000 7f9a167fc640 1 -- 172.21.15.94:0/3167841233 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a1c011070 con 0x7f9a2015bec0 2024-09-11T23:18:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.237+0000 7f9a167fc640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a040678c0 0x7f9a04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.237+0000 7f9a167fc640 1 -- 172.21.15.94:0/3167841233 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f9a1c085aa0 con 0x7f9a2015bec0 2024-09-11T23:18:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.237+0000 7f9a2597f640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a040678c0 0x7f9a04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.237+0000 7f9a2597f640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a040678c0 0x7f9a04069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009af0 tx=0x7f9a10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.241+0000 7f9a167fc640 1 -- 172.21.15.94:0/3167841233 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a1c056450 con 0x7f9a2015bec0 2024-09-11T23:18:55.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a201502b0 con 0x7f9a2015bec0 2024-09-11T23:18:55.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a167fc640 1 -- 172.21.15.94:0/3167841233 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f9a1c055d50 con 0x7f9a2015bec0 2024-09-11T23:18:55.442 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:55.442 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:55.442 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:55.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a040678c0 msgr2=0x7f9a04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a040678c0 0x7f9a04069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009af0 tx=0x7f9a10008040 comp rx=0 tx=0).stop 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a2015bec0 msgr2=0x7f9a201f9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a2015bec0 0x7f9a201f9f30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c3e0 tx=0x7f9a1c00c8a0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 shutdown_connections 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a2015c2a0 0x7f9a201fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a040678c0 0x7f9a04069d80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a2015bec0 0x7f9a201f9f30 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.441+0000 7f9a27be3640 1 --2- 172.21.15.94:0/3167841233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a200af470 0x7f9a201f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.445+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 >> 172.21.15.94:0/3167841233 conn(0x7f9a200b1f90 msgr2=0x7f9a200cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.445+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 shutdown_connections 2024-09-11T23:18:55.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.445+0000 7f9a27be3640 1 -- 172.21.15.94:0/3167841233 wait complete. 2024-09-11T23:18:55.461 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:55.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa20a156640 1 Processor -- start 2024-09-11T23:18:55.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa20a156640 1 -- start start 2024-09-11T23:18:55.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa20a156640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa20415c2a0 0x7fa2040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa20a156640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040af2a0 0x7fa20406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa20a156640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2040b3290 con 0x7fa20415bec0 2024-09-11T23:18:55.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa20a156640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa2040b3570 con 0x7fa20415c2a0 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa20a156640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2040b3850 con 0x7fa2040af2a0 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa202ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa20415c2a0 0x7fa2040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa2037fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa20415bec0 0x7fa2040ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40366/0 (socket says 172.21.15.94:40366) 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa2037fe640 1 -- 172.21.15.94:0/3566549729 learned_addr learned my addr 172.21.15.94:0/3566549729 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa203fff640 1 --2- 172.21.15.94:0/3566549729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040af2a0 0x7fa20406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa202ffd640 1 -- 172.21.15.94:0/3566549729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040af2a0 msgr2=0x7fa20406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa202ffd640 1 --2- 172.21.15.94:0/3566549729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040af2a0 0x7fa20406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa202ffd640 1 -- 172.21.15.94:0/3566549729 >> v1:172.21.15.94:6789/0 conn(0x7fa20415bec0 legacy=0x7fa2040ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa2027fc640 1 -- 172.21.15.94:0/3566549729 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992918407 0 0) 0x7fa2040b3290 con 0x7fa20415bec0 2024-09-11T23:18:55.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.581+0000 7fa202ffd640 1 -- 172.21.15.94:0/3566549729 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2040b3b30 con 0x7fa20415c2a0 2024-09-11T23:18:55.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa202ffd640 1 --2- 172.21.15.94:0/3566549729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa20415c2a0 0x7fa2040aed60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80097c0 tx=0x7fa1f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284a11900c667040 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2027fc640 1 -- 172.21.15.94:0/3566549729 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80a7070 con 0x7fa20415c2a0 2024-09-11T23:18:55.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2027fc640 1 -- 172.21.15.94:0/3566549729 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f80b0070 con 0x7fa20415c2a0 2024-09-11T23:18:55.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2027fc640 1 -- 172.21.15.94:0/3566549729 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80ab890 con 0x7fa20415c2a0 2024-09-11T23:18:55.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- 172.21.15.94:0/3566549729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa20415c2a0 msgr2=0x7fa2040aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 --2- 172.21.15.94:0/3566549729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa20415c2a0 0x7fa2040aed60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80097c0 tx=0x7fa1f801c470 comp rx=0 tx=0).stop 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- 172.21.15.94:0/3566549729 shutdown_connections 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 --2- 172.21.15.94:0/3566549729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040af2a0 0x7fa20406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 --2- 172.21.15.94:0/3566549729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa20415c2a0 0x7fa2040aed60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- 172.21.15.94:0/3566549729 >> 172.21.15.94:0/3566549729 conn(0x7fa2040b1f90 msgr2=0x7fa2040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- 172.21.15.94:0/3566549729 shutdown_connections 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- 172.21.15.94:0/3566549729 wait complete. 2024-09-11T23:18:55.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 Processor -- start 2024-09-11T23:18:55.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- start start 2024-09-11T23:18:55.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2040af2a0 0x7fa20415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415bec0 0x7fa2041578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa20415c2a0 0x7fa20414a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa20406ed50 con 0x7fa2040af2a0 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2040af6b0 con 0x7fa20415c2a0 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa20a156640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa20406eed0 con 0x7fa20415bec0 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2040af2a0 0x7fa20415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2040af2a0 0x7fa20415edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51636/0 (socket says 172.21.15.94:51636) 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 -- 172.21.15.94:0/3279591795 learned_addr learned my addr 172.21.15.94:0/3279591795 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 -- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415bec0 msgr2=0x7fa2041578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415bec0 0x7fa2041578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 -- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa20415c2a0 msgr2=0x7fa20414a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa20415c2a0 0x7fa20414a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 -- 172.21.15.94:0/3279591795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa204150b00 con 0x7fa2040af2a0 2024-09-11T23:18:55.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.585+0000 7fa2037fe640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2040af2a0 0x7fa20415edc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40011f0 tx=0x7fa1f400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa1ebfff640 1 -- 172.21.15.94:0/3279591795 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4018070 con 0x7fa2040af2a0 2024-09-11T23:18:55.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa1ebfff640 1 -- 172.21.15.94:0/3279591795 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f40074e0 con 0x7fa2040af2a0 2024-09-11T23:18:55.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa204150de0 con 0x7fa2040af2a0 2024-09-11T23:18:55.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa1ebfff640 1 -- 172.21.15.94:0/3279591795 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4004a10 con 0x7fa2040af2a0 2024-09-11T23:18:55.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2041513a0 con 0x7fa2040af2a0 2024-09-11T23:18:55.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20406e000 con 0x7fa2040af2a0 2024-09-11T23:18:55.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa1ebfff640 1 -- 172.21.15.94:0/3279591795 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1f401b070 con 0x7fa2040af2a0 2024-09-11T23:18:55.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa1ebfff640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1f00678c0 0x7fa1f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa1ebfff640 1 -- 172.21.15.94:0/3279591795 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fa1f40851c0 con 0x7fa2040af2a0 2024-09-11T23:18:55.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa202ffd640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1f00678c0 0x7fa1f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.589+0000 7fa202ffd640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1f00678c0 0x7fa1f0069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80af000 tx=0x7fa1f8004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.593+0000 7fa1ebfff640 1 -- 172.21.15.94:0/3279591795 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa1f4055b70 con 0x7fa2040af2a0 2024-09-11T23:18:55.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.757+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa20406fcd0 con 0x7fa2040af2a0 2024-09-11T23:18:55.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa1ebfff640 1 -- 172.21.15.94:0/3279591795 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17029 (secure 0 0 0) 0x7fa1f4055470 con 0x7fa2040af2a0 2024-09-11T23:18:55.761 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:55.761 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":75,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:18:23.566501+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:19.583667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:20.919663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:55.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1f00678c0 msgr2=0x7fa1f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1f00678c0 0x7fa1f0069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80af000 tx=0x7fa1f8004740 comp rx=0 tx=0).stop 2024-09-11T23:18:55.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2040af2a0 msgr2=0x7fa20415edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2040af2a0 0x7fa20415edc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40011f0 tx=0x7fa1f400c9b0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 shutdown_connections 2024-09-11T23:18:55.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa20415c2a0 0x7fa20414a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415bec0 0x7fa2041578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa1f00678c0 0x7fa1f0069d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 --2- 172.21.15.94:0/3279591795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa2040af2a0 0x7fa20415edc0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 >> 172.21.15.94:0/3279591795 conn(0x7fa2040b1f90 msgr2=0x7fa2040b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 shutdown_connections 2024-09-11T23:18:55.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.761+0000 7fa20a156640 1 -- 172.21.15.94:0/3279591795 wait complete. 2024-09-11T23:18:55.780 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:18:55.780 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:55.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8988d2f640 1 Processor -- start 2024-09-11T23:18:55.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8988d2f640 1 -- start start 2024-09-11T23:18:55.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8988d2f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 0x7f898406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8988d2f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f898406fe50 0x7f898415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8988d2f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8984070250 con 0x7f898415f1d0 2024-09-11T23:18:55.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8988d2f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8984152480 con 0x7f898406fe50 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8988d2f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89840aede0 con 0x7f89841520a0 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8981d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f898406fe50 0x7f898415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8982d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f898415f1d0 0x7f8984071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40378/0 (socket says 172.21.15.94:40378) 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8981d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f898406fe50 0x7f898415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51646/0 (socket says 172.21.15.94:51646) 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8982d9d640 1 -- 172.21.15.94:0/370657587 learned_addr learned my addr 172.21.15.94:0/370657587 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f898259c640 1 --2- 172.21.15.94:0/370657587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 0x7f898406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f898159a640 1 -- 172.21.15.94:0/370657587 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856542846 0 0) 0x7f8984070250 con 0x7f898415f1d0 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8981d9b640 1 -- 172.21.15.94:0/370657587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 msgr2=0x7f898406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8981d9b640 1 --2- 172.21.15.94:0/370657587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 0x7f898406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8981d9b640 1 -- 172.21.15.94:0/370657587 >> v1:172.21.15.94:6789/0 conn(0x7f898415f1d0 legacy=0x7f8984071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.897+0000 7f8981d9b640 1 -- 172.21.15.94:0/370657587 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898415fa10 con 0x7f898406fe50 2024-09-11T23:18:55.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8981d9b640 1 --2- 172.21.15.94:0/370657587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898415ec90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f89780097c0 tx=0x7f897801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc073a3a8cfc239 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898159a640 1 -- 172.21.15.94:0/370657587 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89780b1070 con 0x7f898406fe50 2024-09-11T23:18:55.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898159a640 1 -- 172.21.15.94:0/370657587 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89780ac600 con 0x7f898406fe50 2024-09-11T23:18:55.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898159a640 1 -- 172.21.15.94:0/370657587 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89780ac9d0 con 0x7f898406fe50 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- 172.21.15.94:0/370657587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 msgr2=0x7f898415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 --2- 172.21.15.94:0/370657587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898415ec90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f89780097c0 tx=0x7f897801c480 comp rx=0 tx=0).stop 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- 172.21.15.94:0/370657587 shutdown_connections 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 --2- 172.21.15.94:0/370657587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898415ec90 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 --2- 172.21.15.94:0/370657587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 0x7f898406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- 172.21.15.94:0/370657587 >> 172.21.15.94:0/370657587 conn(0x7f89840b1f90 msgr2=0x7f89840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- 172.21.15.94:0/370657587 shutdown_connections 2024-09-11T23:18:55.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- 172.21.15.94:0/370657587 wait complete. 2024-09-11T23:18:55.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 Processor -- start 2024-09-11T23:18:55.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- start start 2024-09-11T23:18:55.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 0x7f898409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f898415f1d0 0x7f898409afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8984073d30 con 0x7f898406fe50 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8984073a50 con 0x7f898415f1d0 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f8988d2f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f898415f640 con 0x7f89841520a0 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898414ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51652/0 (socket says 172.21.15.94:51652) 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 -- 172.21.15.94:0/1082333821 learned_addr learned my addr 172.21.15.94:0/1082333821 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 -- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 msgr2=0x7f898409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 0x7f898409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 -- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f898415f1d0 msgr2=0x7f898409afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f898415f1d0 0x7f898409afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.901+0000 7f898259c640 1 -- 172.21.15.94:0/1082333821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8984164ae0 con 0x7f898406fe50 2024-09-11T23:18:55.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f898259c640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898414ff20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f897400efc0 tx=0x7f897400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8972ffd640 1 -- 172.21.15.94:0/1082333821 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974018020 con 0x7f898406fe50 2024-09-11T23:18:55.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8972ffd640 1 -- 172.21.15.94:0/1082333821 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974014480 con 0x7f898406fe50 2024-09-11T23:18:55.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8984164dc0 con 0x7f898406fe50 2024-09-11T23:18:55.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8972ffd640 1 -- 172.21.15.94:0/1082333821 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974014850 con 0x7f898406fe50 2024-09-11T23:18:55.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8984165380 con 0x7f898406fe50 2024-09-11T23:18:55.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898415ec90 con 0x7f898406fe50 2024-09-11T23:18:55.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8972ffd640 1 -- 172.21.15.94:0/1082333821 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f897401b020 con 0x7f898406fe50 2024-09-11T23:18:55.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8972ffd640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89640678c0 0x7f8964069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8972ffd640 1 -- 172.21.15.94:0/1082333821 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8974086980 con 0x7f898406fe50 2024-09-11T23:18:55.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8981d9b640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89640678c0 0x7f8964069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.905+0000 7f8981d9b640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89640678c0 0x7f8964069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f89780ae000 tx=0x7f8978008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:55.909+0000 7f8972ffd640 1 -- 172.21.15.94:0/1082333821 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8974022070 con 0x7f898406fe50 2024-09-11T23:18:56.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.105+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89840ad810 con 0x7f898406fe50 2024-09-11T23:18:56.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8972ffd640 1 -- 172.21.15.94:0/1082333821 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f8974010040 con 0x7f898406fe50 2024-09-11T23:18:56.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:56.109 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:56.109 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89640678c0 msgr2=0x7f8964069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89640678c0 0x7f8964069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f89780ae000 tx=0x7f8978008040 comp rx=0 tx=0).stop 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 msgr2=0x7f898414ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898414ff20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f897400efc0 tx=0x7f897400c490 comp rx=0 tx=0).stop 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 shutdown_connections 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f898415f1d0 0x7f898409afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89841520a0 0x7f898409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f89640678c0 0x7f8964069d80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 --2- 172.21.15.94:0/1082333821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f898406fe50 0x7f898414ff20 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 >> 172.21.15.94:0/1082333821 conn(0x7f89840b1f90 msgr2=0x7f898415c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:56.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 shutdown_connections 2024-09-11T23:18:56.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.109+0000 7f8988d2f640 1 -- 172.21.15.94:0/1082333821 wait complete. 2024-09-11T23:18:56.128 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:56.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7063abc640 1 Processor -- start 2024-09-11T23:18:56.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7063abc640 1 -- start start 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7063abc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f705c15bec0 0x7f705c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7063abc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15c2a0 0x7f705c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7063abc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705c0b3290 con 0x7f705c0af2a0 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7063abc640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f705c0b3570 con 0x7f705c15bec0 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7063abc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f705c0b3850 con 0x7f705c15c2a0 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061858640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f705c15bec0 0x7f705c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061858640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f705c15bec0 0x7f705c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51662/0 (socket says 172.21.15.94:51662) 2024-09-11T23:18:56.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061858640 1 -- 172.21.15.94:0/2838772429 learned_addr learned my addr 172.21.15.94:0/2838772429 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061057640 1 --2- 172.21.15.94:0/2838772429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15c2a0 0x7f705c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061858640 1 -- 172.21.15.94:0/2838772429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15c2a0 msgr2=0x7f705c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061858640 1 --2- 172.21.15.94:0/2838772429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15c2a0 0x7f705c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061858640 1 -- 172.21.15.94:0/2838772429 >> v1:172.21.15.155:6789/0 conn(0x7f705c0af2a0 legacy=0x7f705c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.249+0000 7f7061858640 1 -- 172.21.15.94:0/2838772429 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c0b3b30 con 0x7f705c15bec0 2024-09-11T23:18:56.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7061858640 1 --2- 172.21.15.94:0/2838772429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15bec0 0x7f705c0ad200 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f705801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74c7741fd23f7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7060856640 1 -- 172.21.15.94:0/2838772429 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70580aa610 con 0x7f705c15bec0 2024-09-11T23:18:56.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7060856640 1 -- 172.21.15.94:0/2838772429 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70580af070 con 0x7f705c15bec0 2024-09-11T23:18:56.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7060856640 1 -- 172.21.15.94:0/2838772429 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70580aa9d0 con 0x7f705c15bec0 2024-09-11T23:18:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- 172.21.15.94:0/2838772429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15bec0 msgr2=0x7f705c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 --2- 172.21.15.94:0/2838772429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15bec0 0x7f705c0ad200 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f705801c4f0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- 172.21.15.94:0/2838772429 shutdown_connections 2024-09-11T23:18:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 --2- 172.21.15.94:0/2838772429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15c2a0 0x7f705c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 --2- 172.21.15.94:0/2838772429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15bec0 0x7f705c0ad200 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- 172.21.15.94:0/2838772429 >> 172.21.15.94:0/2838772429 conn(0x7f705c0b1f90 msgr2=0x7f705c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- 172.21.15.94:0/2838772429 shutdown_connections 2024-09-11T23:18:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- 172.21.15.94:0/2838772429 wait complete. 2024-09-11T23:18:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 Processor -- start 2024-09-11T23:18:56.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- start start 2024-09-11T23:18:56.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f705c0af2a0 0x7f705c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15bec0 0x7f705c152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15c2a0 0x7f705c1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f705c0ad740 con 0x7f705c15c2a0 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f705c0afc90 con 0x7f705c0af2a0 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7063abc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f705c169000 con 0x7f705c15bec0 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7062059640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15c2a0 0x7f705c1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7062059640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15c2a0 0x7f705c1430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51668/0 (socket says 172.21.15.94:51668) 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.253+0000 7f7062059640 1 -- 172.21.15.94:0/2833154036 learned_addr learned my addr 172.21.15.94:0/2833154036 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7061858640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f705c0af2a0 0x7f705c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7061057640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15bec0 0x7f705c152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7062059640 1 -- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15bec0 msgr2=0x7f705c152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7062059640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15bec0 0x7f705c152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7062059640 1 -- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f705c0af2a0 msgr2=0x7f705c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7062059640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f705c0af2a0 0x7f705c15ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7062059640 1 -- 172.21.15.94:0/2833154036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c150a30 con 0x7f705c15c2a0 2024-09-11T23:18:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7062059640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15c2a0 0x7f705c1430d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f705400c780 tx=0x7f705400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f70527fc640 1 -- 172.21.15.94:0/2833154036 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054004b70 con 0x7f705c15c2a0 2024-09-11T23:18:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f70527fc640 1 -- 172.21.15.94:0/2833154036 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7054004d10 con 0x7f705c15c2a0 2024-09-11T23:18:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f70527fc640 1 -- 172.21.15.94:0/2833154036 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705400aa90 con 0x7f705c15c2a0 2024-09-11T23:18:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705c150ef0 con 0x7f705c15c2a0 2024-09-11T23:18:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f705c1514b0 con 0x7f705c15c2a0 2024-09-11T23:18:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705c0ad200 con 0x7f705c15c2a0 2024-09-11T23:18:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f70527fc640 1 -- 172.21.15.94:0/2833154036 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f705400ac30 con 0x7f705c15c2a0 2024-09-11T23:18:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f70527fc640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70400678c0 0x7f7040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f70527fc640 1 -- 172.21.15.94:0/2833154036 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f70540860c0 con 0x7f705c15c2a0 2024-09-11T23:18:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.257+0000 7f7061858640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70400678c0 0x7f7040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.261+0000 7f7061858640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70400678c0 0x7f7040069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f70580ae000 tx=0x7f7058008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.261+0000 7f70527fc640 1 -- 172.21.15.94:0/2833154036 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7054020070 con 0x7f705c15c2a0 2024-09-11T23:18:56.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.449+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f705c06fcd0 con 0x7f705c15c2a0 2024-09-11T23:18:56.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f70527fc640 1 -- 172.21.15.94:0/2833154036 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f7054056a70 con 0x7f705c15c2a0 2024-09-11T23:18:56.453 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:56.453 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"btime":"2024-09-11T23:18:25:607913+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:21.939012+0000","modified":"2024-09-11T23:18:24.973316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/100688804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":100688804},{"type":"v1","addr":"172.21.15.155:6837","nonce":100688804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6024,"qdb_cluster":[6024]},"id":5}]} 2024-09-11T23:18:56.453 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 40 2024-09-11T23:18:56.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70400678c0 msgr2=0x7f7040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70400678c0 0x7f7040069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f70580ae000 tx=0x7f7058008040 comp rx=0 tx=0).stop 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15c2a0 msgr2=0x7f705c1430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15c2a0 0x7f705c1430d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f705400c780 tx=0x7f705400cc40 comp rx=0 tx=0).stop 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 shutdown_connections 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70400678c0 0x7f7040069d80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f705c15c2a0 0x7f705c1430d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f705c15bec0 0x7f705c152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 --2- 172.21.15.94:0/2833154036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f705c0af2a0 0x7f705c15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 >> 172.21.15.94:0/2833154036 conn(0x7f705c0b1f90 msgr2=0x7f705c153890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 shutdown_connections 2024-09-11T23:18:56.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.453+0000 7f7063abc640 1 -- 172.21.15.94:0/2833154036 wait complete. 2024-09-11T23:18:56.471 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:56.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.589+0000 7f63d472b640 1 Processor -- start 2024-09-11T23:18:56.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d472b640 1 -- start start 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d472b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63cc161a60 0x7f63cc0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d472b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63cc0d2e90 0x7f63cc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d472b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63cc0d32b0 con 0x7f63cc0cf450 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d472b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f63cc0d0300 con 0x7f63cc161a60 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d472b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f63cc06e6c0 con 0x7f63cc0d2e90 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d24c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63cc161a60 0x7f63cc0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d24c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63cc161a60 0x7f63cc0d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51672/0 (socket says 172.21.15.94:51672) 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d24c7640 1 -- 172.21.15.94:0/2265235228 learned_addr learned my addr 172.21.15.94:0/2265235228 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d1cc6640 1 --2- 172.21.15.94:0/2265235228 >> v2:172.21.15.155:3300/0 conn(0x7f63cc0d2e90 0x7f63cc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d24c7640 1 -- 172.21.15.94:0/2265235228 >> v2:172.21.15.155:3300/0 conn(0x7f63cc0d2e90 msgr2=0x7f63cc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d24c7640 1 --2- 172.21.15.94:0/2265235228 >> v2:172.21.15.155:3300/0 conn(0x7f63cc0d2e90 0x7f63cc0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d24c7640 1 -- 172.21.15.94:0/2265235228 >> v1:172.21.15.155:6789/0 conn(0x7f63cc0cf450 legacy=0x7f63cc0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:56.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.593+0000 7f63d24c7640 1 -- 172.21.15.94:0/2265235228 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc0b0f60 con 0x7f63cc161a60 2024-09-11T23:18:56.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d24c7640 1 --2- 172.21.15.94:0/2265235228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc161a60 0x7f63cc0d2950 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f63cc08d850 tx=0x7f63c801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4022cdba5991660 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d14c5640 1 -- 172.21.15.94:0/2265235228 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0d1930 con 0x7f63cc161a60 2024-09-11T23:18:56.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d14c5640 1 -- 172.21.15.94:0/2265235228 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c80b0070 con 0x7f63cc161a60 2024-09-11T23:18:56.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d14c5640 1 -- 172.21.15.94:0/2265235228 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c80ab840 con 0x7f63cc161a60 2024-09-11T23:18:56.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- 172.21.15.94:0/2265235228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc161a60 msgr2=0x7f63cc0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 --2- 172.21.15.94:0/2265235228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc161a60 0x7f63cc0d2950 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f63cc08d850 tx=0x7f63c801c420 comp rx=0 tx=0).stop 2024-09-11T23:18:56.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- 172.21.15.94:0/2265235228 shutdown_connections 2024-09-11T23:18:56.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 --2- 172.21.15.94:0/2265235228 >> v2:172.21.15.155:3300/0 conn(0x7f63cc0d2e90 0x7f63cc0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 --2- 172.21.15.94:0/2265235228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc161a60 0x7f63cc0d2950 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- 172.21.15.94:0/2265235228 >> 172.21.15.94:0/2265235228 conn(0x7f63cc08bf90 msgr2=0x7f63cc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:56.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- 172.21.15.94:0/2265235228 shutdown_connections 2024-09-11T23:18:56.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- 172.21.15.94:0/2265235228 wait complete. 2024-09-11T23:18:56.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 Processor -- start 2024-09-11T23:18:56.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- start start 2024-09-11T23:18:56.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63cc0cf450 0x7f63cc0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc0d2e90 0x7f63cc1fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63cc161a60 0x7f63cc1fad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0cf8c0 con 0x7f63cc0d2e90 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc06d190 con 0x7f63cc161a60 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d472b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63cc0cfa40 con 0x7f63cc0cf450 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc0d2e90 0x7f63cc1fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc0d2e90 0x7f63cc1fa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51682/0 (socket says 172.21.15.94:51682) 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 -- 172.21.15.94:0/1395532935 learned_addr learned my addr 172.21.15.94:0/1395532935 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d24c7640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63cc0cf450 0x7f63cc0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d2cc8640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63cc161a60 0x7f63cc1fad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 -- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63cc0cf450 msgr2=0x7f63cc0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63cc0cf450 0x7f63cc0b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 -- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63cc161a60 msgr2=0x7f63cc1fad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63cc161a60 0x7f63cc1fad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d1cc6640 1 -- 172.21.15.94:0/1395532935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc0b7330 con 0x7f63cc0d2e90 2024-09-11T23:18:56.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.597+0000 7f63d2cc8640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63cc161a60 0x7f63cc1fad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:56.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63d1cc6640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc0d2e90 0x7f63cc1fa7e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00d800 tx=0x7f63bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63c2ffd640 1 -- 172.21.15.94:0/1395532935 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00b6c0 con 0x7f63cc0d2e90 2024-09-11T23:18:56.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63c2ffd640 1 -- 172.21.15.94:0/1395532935 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63bc019070 con 0x7f63cc0d2e90 2024-09-11T23:18:56.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc0b7720 con 0x7f63cc0d2e90 2024-09-11T23:18:56.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63c2ffd640 1 -- 172.21.15.94:0/1395532935 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00ba60 con 0x7f63cc0d2e90 2024-09-11T23:18:56.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc160df0 con 0x7f63cc0d2e90 2024-09-11T23:18:56.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc0ce080 con 0x7f63cc0d2e90 2024-09-11T23:18:56.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63c2ffd640 1 -- 172.21.15.94:0/1395532935 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63bc00bc00 con 0x7f63cc0d2e90 2024-09-11T23:18:56.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63c2ffd640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b00678c0 0x7f63b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63c2ffd640 1 -- 172.21.15.94:0/1395532935 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f63bc0862f0 con 0x7f63cc0d2e90 2024-09-11T23:18:56.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63d24c7640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b00678c0 0x7f63b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.601+0000 7f63d24c7640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b00678c0 0x7f63b0069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f63c80af000 tx=0x7f63c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.605+0000 7f63c2ffd640 1 -- 172.21.15.94:0/1395532935 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63bc056ca0 con 0x7f63cc0d2e90 2024-09-11T23:18:56.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.761+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63cc0cef10 con 0x7f63cc0d2e90 2024-09-11T23:18:56.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.765+0000 7f63c2ffd640 1 -- 172.21.15.94:0/1395532935 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17029 (secure 0 0 0) 0x7f63bc0565a0 con 0x7f63cc0d2e90 2024-09-11T23:18:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:18:56.767 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":75,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:18:23.566501+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:19.583667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:20.919663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:56.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b00678c0 msgr2=0x7f63b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b00678c0 0x7f63b0069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f63c80af000 tx=0x7f63c8008040 comp rx=0 tx=0).stop 2024-09-11T23:18:56.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc0d2e90 msgr2=0x7f63cc1fa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc0d2e90 0x7f63cc1fa7e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00d800 tx=0x7f63bc00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 shutdown_connections 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63cc161a60 0x7f63cc1fad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f63b00678c0 0x7f63b0069d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63cc0d2e90 0x7f63cc1fa7e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 --2- 172.21.15.94:0/1395532935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63cc0cf450 0x7f63cc0b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 >> 172.21.15.94:0/1395532935 conn(0x7f63cc08bf90 msgr2=0x7f63cc15b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 shutdown_connections 2024-09-11T23:18:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.769+0000 7f63d472b640 1 -- 172.21.15.94:0/1395532935 wait complete. 2024-09-11T23:18:56.785 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:18:56.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.893+0000 7fb513c01640 1 Processor -- start 2024-09-11T23:18:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.893+0000 7fb513c01640 1 -- start start 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb50c161a60 0x7fb50c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0cf620 0x7fb50c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c0d32b0 con 0x7fb50c0d2e90 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb50c0d0300 con 0x7fb50c161a60 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb50c0cfab0 con 0x7fb50c0cf620 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb50c161a60 0x7fb50c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb50c161a60 0x7fb50c0d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51694/0 (socket says 172.21.15.94:51694) 2024-09-11T23:18:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 -- 172.21.15.94:0/856373245 learned_addr learned my addr 172.21.15.94:0/856373245 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 -- 172.21.15.94:0/856373245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0cf620 msgr2=0x7fb50c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 --2- 172.21.15.94:0/856373245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0cf620 0x7fb50c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 -- 172.21.15.94:0/856373245 >> v1:172.21.15.155:6789/0 conn(0x7fb50c0d2e90 legacy=0x7fb50c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 -- 172.21.15.94:0/856373245 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c0b0f60 con 0x7fb50c161a60 2024-09-11T23:18:56.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51199d640 1 --2- 172.21.15.94:0/856373245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0d2950 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009870 tx=0x7fb4fc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb369ca58ff5cc28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51099b640 1 -- 172.21.15.94:0/856373245 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0ab620 con 0x7fb50c161a60 2024-09-11T23:18:56.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51099b640 1 -- 172.21.15.94:0/856373245 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc0b0070 con 0x7fb50c161a60 2024-09-11T23:18:56.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb51099b640 1 -- 172.21.15.94:0/856373245 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0ab9e0 con 0x7fb50c161a60 2024-09-11T23:18:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- 172.21.15.94:0/856373245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 msgr2=0x7fb50c0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 --2- 172.21.15.94:0/856373245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0d2950 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009870 tx=0x7fb4fc01c460 comp rx=0 tx=0).stop 2024-09-11T23:18:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- 172.21.15.94:0/856373245 shutdown_connections 2024-09-11T23:18:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 --2- 172.21.15.94:0/856373245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0cf620 0x7fb50c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 --2- 172.21.15.94:0/856373245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0d2950 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- 172.21.15.94:0/856373245 >> 172.21.15.94:0/856373245 conn(0x7fb50c08bf90 msgr2=0x7fb50c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- 172.21.15.94:0/856373245 shutdown_connections 2024-09-11T23:18:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.897+0000 7fb513c01640 1 -- 172.21.15.94:0/856373245 wait complete. 2024-09-11T23:18:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 Processor -- start 2024-09-11T23:18:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 -- start start 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb50c0cf620 0x7fb50c14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0d2e90 0x7fb50c0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c06e400 con 0x7fb50c161a60 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c06d190 con 0x7fb50c0cf620 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb50c06e580 con 0x7fb50c0d2e90 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51702/0 (socket says 172.21.15.94:51702) 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 -- 172.21.15.94:0/2997398805 learned_addr learned my addr 172.21.15.94:0/2997398805 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51119c640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0d2e90 0x7fb50c0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51199d640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb50c0cf620 0x7fb50c14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 -- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0d2e90 msgr2=0x7fb50c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0d2e90 0x7fb50c0b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 -- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb50c0cf620 msgr2=0x7fb50c14c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb50c0cf620 0x7fb50c14c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 -- 172.21.15.94:0/2997398805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c0c7e80 con 0x7fb50c161a60 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb51219e640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0b2670 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb50400b970 tx=0x7fb50400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb5027fc640 1 -- 172.21.15.94:0/2997398805 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504019070 con 0x7fb50c161a60 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb5027fc640 1 -- 172.21.15.94:0/2997398805 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50400cb60 con 0x7fb50c161a60 2024-09-11T23:18:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50c0c8160 con 0x7fb50c161a60 2024-09-11T23:18:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb5027fc640 1 -- 172.21.15.94:0/2997398805 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504014440 con 0x7fb50c161a60 2024-09-11T23:18:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50c0c8720 con 0x7fb50c161a60 2024-09-11T23:18:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50c06d6b0 con 0x7fb50c161a60 2024-09-11T23:18:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.901+0000 7fb5027fc640 1 -- 172.21.15.94:0/2997398805 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb50401c070 con 0x7fb50c161a60 2024-09-11T23:18:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.905+0000 7fb5027fc640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4f00678c0 0x7fb4f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.905+0000 7fb5027fc640 1 -- 172.21.15.94:0/2997398805 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fb504085b10 con 0x7fb50c161a60 2024-09-11T23:18:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.905+0000 7fb51199d640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4f00678c0 0x7fb4f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.905+0000 7fb51199d640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4f00678c0 0x7fb4f0069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0af000 tx=0x7fb4fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:56.909+0000 7fb5027fc640 1 -- 172.21.15.94:0/2997398805 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb504056550 con 0x7fb50c161a60 2024-09-11T23:18:57.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.097+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb50c06bcc0 con 0x7fb50c161a60 2024-09-11T23:18:57.101 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:18:57.101+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:18:57.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.101+0000 7fb5027fc640 1 -- 172.21.15.94:0/2997398805 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7fb504055e50 con 0x7fb50c161a60 2024-09-11T23:18:57.104 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:18:57.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4f00678c0 msgr2=0x7fb4f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4f00678c0 0x7fb4f0069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0af000 tx=0x7fb4fc008040 comp rx=0 tx=0).stop 2024-09-11T23:18:57.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 msgr2=0x7fb50c0b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0b2670 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb50400b970 tx=0x7fb50400be30 comp rx=0 tx=0).stop 2024-09-11T23:18:57.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 shutdown_connections 2024-09-11T23:18:57.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4f00678c0 0x7fb4f0069d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb50c161a60 0x7fb50c0b2670 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb50c0d2e90 0x7fb50c0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 --2- 172.21.15.94:0/2997398805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb50c0cf620 0x7fb50c14c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 >> 172.21.15.94:0/2997398805 conn(0x7fb50c08bf90 msgr2=0x7fb50c0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:57.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 shutdown_connections 2024-09-11T23:18:57.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.105+0000 7fb513c01640 1 -- 172.21.15.94:0/2997398805 wait complete. 2024-09-11T23:18:57.122 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:18:57.199 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:18:57.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.237+0000 7f24da001640 1 Processor -- start 2024-09-11T23:18:57.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.237+0000 7f24da001640 1 -- start start 2024-09-11T23:18:57.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f24d415f3a0 0x7f24d4165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d40aede0 con 0x7f24d4070020 2024-09-11T23:18:57.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d415fa10 con 0x7f24d41520a0 2024-09-11T23:18:57.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f24d4152480 con 0x7f24d415f3a0 2024-09-11T23:18:57.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d2ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f24d4070020 0x7f24d415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40380/0 (socket says 172.21.15.94:40380) 2024-09-11T23:18:57.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d2ffd640 1 -- 172.21.15.94:0/22495751 learned_addr learned my addr 172.21.15.94:0/22495751 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:57.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d3fff640 1 --2- 172.21.15.94:0/22495751 >> v2:172.21.15.94:3300/0 conn(0x7f24d415f3a0 0x7f24d4165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:57.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d3fff640 1 -- 172.21.15.94:0/22495751 >> v1:172.21.15.155:6789/0 conn(0x7f24d41520a0 legacy=0x7f24d406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:57.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d3fff640 1 -- 172.21.15.94:0/22495751 >> v1:172.21.15.94:6789/0 conn(0x7f24d4070020 legacy=0x7f24d415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d27fc640 1 -- 172.21.15.94:0/22495751 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187042942 0 0) 0x7f24d40aede0 con 0x7f24d4070020 2024-09-11T23:18:57.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d3fff640 1 -- 172.21.15.94:0/22495751 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d4074250 con 0x7f24d415f3a0 2024-09-11T23:18:57.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d3fff640 1 --2- 172.21.15.94:0/22495751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d415f3a0 0x7f24d4165f00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0097c0 tx=0x7f24cc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4881ae53544227 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:57.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d27fc640 1 -- 172.21.15.94:0/22495751 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0ab660 con 0x7f24d415f3a0 2024-09-11T23:18:57.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d27fc640 1 -- 172.21.15.94:0/22495751 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc0b0070 con 0x7f24d415f3a0 2024-09-11T23:18:57.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24d27fc640 1 -- 172.21.15.94:0/22495751 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0aba20 con 0x7f24d415f3a0 2024-09-11T23:18:57.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- 172.21.15.94:0/22495751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d415f3a0 msgr2=0x7f24d4165f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 --2- 172.21.15.94:0/22495751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d415f3a0 0x7f24d4165f00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0097c0 tx=0x7f24cc01c460 comp rx=0 tx=0).stop 2024-09-11T23:18:57.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- 172.21.15.94:0/22495751 shutdown_connections 2024-09-11T23:18:57.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 --2- 172.21.15.94:0/22495751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d415f3a0 0x7f24d4165f00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- 172.21.15.94:0/22495751 >> 172.21.15.94:0/22495751 conn(0x7f24d40b1f90 msgr2=0x7f24d40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:57.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- 172.21.15.94:0/22495751 shutdown_connections 2024-09-11T23:18:57.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.241+0000 7f24da001640 1 -- 172.21.15.94:0/22495751 wait complete. 2024-09-11T23:18:57.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 Processor -- start 2024-09-11T23:18:57.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 -- start start 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d4070020 0x7f24d4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d41520a0 0x7f24d41455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d415f3a0 0x7f24d40997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4168c60 con 0x7f24d4070020 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4073d30 con 0x7f24d415f3a0 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24d4168de0 con 0x7f24d41520a0 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d4070020 0x7f24d4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d4070020 0x7f24d4151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51726/0 (socket says 172.21.15.94:51726) 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 -- 172.21.15.94:0/2919514884 learned_addr learned my addr 172.21.15.94:0/2919514884 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d2ffd640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d41520a0 0x7f24d41455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:57.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d3fff640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d415f3a0 0x7f24d40997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 -- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d41520a0 msgr2=0x7f24d41455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d41520a0 0x7f24d41455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 -- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d415f3a0 msgr2=0x7f24d40997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d415f3a0 0x7f24d40997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 -- 172.21.15.94:0/2919514884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d4144b90 con 0x7f24d4070020 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d3fff640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d415f3a0 0x7f24d40997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d2ffd640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d41520a0 0x7f24d41455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24d37fe640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d4070020 0x7f24d4151a50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c7c0 tx=0x7f24c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24bbfff640 1 -- 172.21.15.94:0/2919514884 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4016020 con 0x7f24d4070020 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24bbfff640 1 -- 172.21.15.94:0/2919514884 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c400aa50 con 0x7f24d4070020 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24bbfff640 1 -- 172.21.15.94:0/2919514884 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c400ae40 con 0x7f24d4070020 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d406f580 con 0x7f24d4070020 2024-09-11T23:18:57.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d4144e00 con 0x7f24d4070020 2024-09-11T23:18:57.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.245+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d415ec90 con 0x7f24d4070020 2024-09-11T23:18:57.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.249+0000 7f24bbfff640 1 -- 172.21.15.94:0/2919514884 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24c4019020 con 0x7f24d4070020 2024-09-11T23:18:57.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.249+0000 7f24bbfff640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f24c00678c0 0x7f24c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.249+0000 7f24bbfff640 1 -- 172.21.15.94:0/2919514884 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f24c4085fd0 con 0x7f24d4070020 2024-09-11T23:18:57.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.249+0000 7f24d2ffd640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f24c00678c0 0x7f24c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:57.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.249+0000 7f24d2ffd640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f24c00678c0 0x7f24c0069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f24c8000f70 tx=0x7f24c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:57.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.253+0000 7f24bbfff640 1 -- 172.21.15.94:0/2919514884 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24c4020030 con 0x7f24d4070020 2024-09-11T23:18:57.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:57.433+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f24d406e540 con 0x7f24d4070020 2024-09-11T23:18:58.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24bbfff640 1 -- 172.21.15.94:0/2919514884 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f24c4056810 con 0x7f24d4070020 2024-09-11T23:18:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f24c00678c0 msgr2=0x7f24c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f24c00678c0 0x7f24c0069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f24c8000f70 tx=0x7f24c8009040 comp rx=0 tx=0).stop 2024-09-11T23:18:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d4070020 msgr2=0x7f24d4151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d4070020 0x7f24d4151a50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c7c0 tx=0x7f24c400cc80 comp rx=0 tx=0).stop 2024-09-11T23:18:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 shutdown_connections 2024-09-11T23:18:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d415f3a0 0x7f24d40997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d41520a0 0x7f24d41455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f24c00678c0 0x7f24c0069d80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 --2- 172.21.15.94:0/2919514884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24d4070020 0x7f24d4151a50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.169+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 >> 172.21.15.94:0/2919514884 conn(0x7f24d40b1f90 msgr2=0x7f24d4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.173+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 shutdown_connections 2024-09-11T23:18:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.173+0000 7f24da001640 1 -- 172.21.15.94:0/2919514884 wait complete. 2024-09-11T23:18:58.197 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:18:58.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd430afa640 1 Processor -- start 2024-09-11T23:18:58.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd430afa640 1 -- start start 2024-09-11T23:18:58.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd430afa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c0ce0a0 0x7fd42c0d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd430afa640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42c15c040 con 0x7fd42c0b5560 2024-09-11T23:18:58.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd430afa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42c15c320 con 0x7fd42c15b5a0 2024-09-11T23:18:58.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd430afa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd42c0cfe00 con 0x7fd42c0ce0a0 2024-09-11T23:18:58.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd42ad9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd42c0b5560 0x7fd42c15c600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:40386/0 (socket says 172.21.15.94:40386) 2024-09-11T23:18:58.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd42ad9d640 1 -- 172.21.15.94:0/3241967333 learned_addr learned my addr 172.21.15.94:0/3241967333 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:18:58.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320753130 0 0) 0x7fd42c15c040 con 0x7fd42c0b5560 2024-09-11T23:18:58.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.321+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd414003530 con 0x7fd42c0b5560 2024-09-11T23:18:58.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1081051242 0 0) 0x7fd414003530 con 0x7fd42c0b5560 2024-09-11T23:18:58.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c0ce0a0 msgr2=0x7fd42c0d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c0ce0a0 0x7fd42c0d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 >> v1:172.21.15.155:6789/0 conn(0x7fd42c15b5a0 legacy=0x7fd42c0b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c0cfa90 con 0x7fd42c0b5560 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fd424001a00 con 0x7fd42c0b5560 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 >> v1:172.21.15.94:6789/0 conn(0x7fd42c0b5560 legacy=0x7fd42c15c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4140039f0 0x7fd414003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c0ce0a0 0x7fd414004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd414004e70 0x7fd41400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c0cfe00 con 0x7fd4140039f0 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4140054f0 con 0x7fd414004e70 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd41400bf10 con 0x7fd42c0ce0a0 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42a59c640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4140039f0 0x7fd414003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42ad9d640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd414004e70 0x7fd41400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd429d9b640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c0ce0a0 0x7fd414004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42a59c640 1 -- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c0ce0a0 msgr2=0x7fd414004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:58.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42a59c640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c0ce0a0 0x7fd414004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42a59c640 1 -- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd414004e70 msgr2=0x7fd41400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:58.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42a59c640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd414004e70 0x7fd41400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42a59c640 1 -- 172.21.15.94:0/3241967333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd414003530 con 0x7fd4140039f0 2024-09-11T23:18:58.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42a59c640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4140039f0 0x7fd414003e10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009890 tx=0x7fd41c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed1bc875c1c962e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0b0070 con 0x7fd4140039f0 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41c0ab620 con 0x7fd4140039f0 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42959a640 1 -- 172.21.15.94:0/3241967333 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c009460 con 0x7fd4140039f0 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd430afa640 1 -- 172.21.15.94:0/3241967333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4140039f0 msgr2=0x7fd414003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd430afa640 1 --2- 172.21.15.94:0/3241967333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4140039f0 0x7fd414003e10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009890 tx=0x7fd41c01c380 comp rx=0 tx=0).stop 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd42ad9d640 1 -- 172.21.15.94:0/3241967333 reap_dead start 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd430afa640 1 -- 172.21.15.94:0/3241967333 shutdown_connections 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd430afa640 1 -- 172.21.15.94:0/3241967333 >> 172.21.15.94:0/3241967333 conn(0x7fd42c073580 msgr2=0x7fd42c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd430afa640 1 -- 172.21.15.94:0/3241967333 shutdown_connections 2024-09-11T23:18:58.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.325+0000 7fd430afa640 1 -- 172.21.15.94:0/3241967333 wait complete. 2024-09-11T23:18:58.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 Processor -- start 2024-09-11T23:18:58.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 -- start start 2024-09-11T23:18:58.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4140039f0 0x7fd42c165ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42c1644a0 0x7fd42c161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c140430 0x7fd42c13dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c067ed0 con 0x7fd42c1644a0 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c067d50 con 0x7fd4140039f0 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd42c0d0290 con 0x7fd42c140430 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42c1644a0 0x7fd42c161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42c1644a0 0x7fd42c161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51748/0 (socket says 172.21.15.94:51748) 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 -- 172.21.15.94:0/1540548066 learned_addr learned my addr 172.21.15.94:0/1540548066 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd42ad9d640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c140430 0x7fd42c13dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd42a59c640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4140039f0 0x7fd42c165ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 -- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c140430 msgr2=0x7fd42c13dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c140430 0x7fd42c13dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 -- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4140039f0 msgr2=0x7fd42c165ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4140039f0 0x7fd42c165ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 -- 172.21.15.94:0/1540548066 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c164a40 con 0x7fd42c1644a0 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd42ad9d640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c140430 0x7fd42c13dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd42a59c640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4140039f0 0x7fd42c165ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd429d9b640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42c1644a0 0x7fd42c161ec0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd42000e4d0 tx=0x7fd42000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd41affd640 1 -- 172.21.15.94:0/1540548066 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4200053a0 con 0x7fd42c1644a0 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd41affd640 1 -- 172.21.15.94:0/1540548066 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd420018070 con 0x7fd42c1644a0 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42c164d20 con 0x7fd42c1644a0 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd41affd640 1 -- 172.21.15.94:0/1540548066 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420003820 con 0x7fd42c1644a0 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42c1652e0 con 0x7fd42c1644a0 2024-09-11T23:18:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.329+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42c0d0730 con 0x7fd42c1644a0 2024-09-11T23:18:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.333+0000 7fd41affd640 1 -- 172.21.15.94:0/1540548066 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4200039c0 con 0x7fd42c1644a0 2024-09-11T23:18:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.333+0000 7fd41affd640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd40c0678c0 0x7fd40c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.333+0000 7fd41affd640 1 -- 172.21.15.94:0/1540548066 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fd420085ae0 con 0x7fd42c1644a0 2024-09-11T23:18:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.333+0000 7fd42a59c640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd40c0678c0 0x7fd40c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.333+0000 7fd42a59c640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd40c0678c0 0x7fd40c069d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0ad000 tx=0x7fd41c004850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.337+0000 7fd41affd640 1 -- 172.21.15.94:0/1540548066 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd4200564d0 con 0x7fd42c1644a0 2024-09-11T23:18:58.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:58.489+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd42c15f9d0 con 0x7fd42c1644a0 2024-09-11T23:18:59.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.177+0000 7fd41affd640 1 -- 172.21.15.94:0/1540548066 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7fd420055dd0 con 0x7fd42c1644a0 2024-09-11T23:18:59.179 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:18:59.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd40c0678c0 msgr2=0x7fd40c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd40c0678c0 0x7fd40c069d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0ad000 tx=0x7fd41c004850 comp rx=0 tx=0).stop 2024-09-11T23:18:59.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42c1644a0 msgr2=0x7fd42c161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42c1644a0 0x7fd42c161ec0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd42000e4d0 tx=0x7fd42000e990 comp rx=0 tx=0).stop 2024-09-11T23:18:59.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 shutdown_connections 2024-09-11T23:18:59.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd42c140430 0x7fd42c13dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd40c0678c0 0x7fd40c069d80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42c1644a0 0x7fd42c161ec0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 --2- 172.21.15.94:0/1540548066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4140039f0 0x7fd42c165ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 >> 172.21.15.94:0/1540548066 conn(0x7fd42c073580 msgr2=0x7fd42c06cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 shutdown_connections 2024-09-11T23:18:59.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.181+0000 7fd430afa640 1 -- 172.21.15.94:0/1540548066 wait complete. 2024-09-11T23:18:59.204 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:18:59.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.329+0000 7fc9d3cd3640 1 Processor -- start 2024-09-11T23:18:59.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.329+0000 7fc9d3cd3640 1 -- start start 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15bec0 0x7fc9cc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9cc15c2a0 0x7fc9cc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0b3290 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc9cc0b3570 con 0x7fc9cc15c2a0 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc0b3850 con 0x7fc9cc15bec0 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9cc15c2a0 0x7fc9cc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9cc15c2a0 0x7fc9cc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51754/0 (socket says 172.21.15.94:51754) 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 -- 172.21.15.94:0/3786070015 learned_addr learned my addr 172.21.15.94:0/3786070015 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d1a6f640 1 --2- 172.21.15.94:0/3786070015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15bec0 0x7fc9cc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 -- 172.21.15.94:0/3786070015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15bec0 msgr2=0x7fc9cc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 --2- 172.21.15.94:0/3786070015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15bec0 0x7fc9cc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 -- 172.21.15.94:0/3786070015 >> v1:172.21.15.155:6789/0 conn(0x7fc9cc0af2a0 legacy=0x7fc9cc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 -- 172.21.15.94:0/3786070015 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc0b3b30 con 0x7fc9cc15c2a0 2024-09-11T23:18:59.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d126e640 1 --2- 172.21.15.94:0/3786070015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc15c2a0 0x7fc9cc0aed60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009870 tx=0x7fc9bc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5d94aa8c20f8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d0a6d640 1 -- 172.21.15.94:0/3786070015 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0a95f0 con 0x7fc9cc15c2a0 2024-09-11T23:18:59.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d0a6d640 1 -- 172.21.15.94:0/3786070015 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc0a9790 con 0x7fc9cc15c2a0 2024-09-11T23:18:59.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d0a6d640 1 -- 172.21.15.94:0/3786070015 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0a9b60 con 0x7fc9cc15c2a0 2024-09-11T23:18:59.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/3786070015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc15c2a0 msgr2=0x7fc9cc0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/3786070015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc15c2a0 0x7fc9cc0aed60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009870 tx=0x7fc9bc01c530 comp rx=0 tx=0).stop 2024-09-11T23:18:59.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/3786070015 shutdown_connections 2024-09-11T23:18:59.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/3786070015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc15c2a0 0x7fc9cc0aed60 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/3786070015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15bec0 0x7fc9cc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/3786070015 >> 172.21.15.94:0/3786070015 conn(0x7fc9cc0b1f90 msgr2=0x7fc9cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/3786070015 shutdown_connections 2024-09-11T23:18:59.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.333+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/3786070015 wait complete. 2024-09-11T23:18:59.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 Processor -- start 2024-09-11T23:18:59.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 -- start start 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc0af2a0 0x7fc9cc153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9cc15bec0 0x7fc9cc09dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15c2a0 0x7fc9cc156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc0af6b0 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc0ad740 con 0x7fc9cc15bec0 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc169000 con 0x7fc9cc15c2a0 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc0af2a0 0x7fc9cc153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc0af2a0 0x7fc9cc153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51758/0 (socket says 172.21.15.94:51758) 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 -- 172.21.15.94:0/2679612986 learned_addr learned my addr 172.21.15.94:0/2679612986 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d126e640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9cc15bec0 0x7fc9cc09dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d2270640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15c2a0 0x7fc9cc156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 -- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15c2a0 msgr2=0x7fc9cc156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15c2a0 0x7fc9cc156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 -- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9cc15bec0 msgr2=0x7fc9cc09dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9cc15bec0 0x7fc9cc09dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 -- 172.21.15.94:0/2679612986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc152590 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d1a6f640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc0af2a0 0x7fc9cc153310 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800d800 tx=0x7fc9c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9c27fc640 1 -- 172.21.15.94:0/2679612986 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800b6c0 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9c27fc640 1 -- 172.21.15.94:0/2679612986 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c8019070 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc152830 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9c27fc640 1 -- 172.21.15.94:0/2679612986 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800ba60 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc152df0 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.337+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc0ad200 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.341+0000 7fc9c27fc640 1 -- 172.21.15.94:0/2679612986 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9c800bc00 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.341+0000 7fc9c27fc640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc9b00678c0 0x7fc9b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.341+0000 7fc9c27fc640 1 -- 172.21.15.94:0/2679612986 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5749+0+0 (secure 0 0 0) 0x7fc9c8086180 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.341+0000 7fc9d126e640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc9b00678c0 0x7fc9b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.341+0000 7fc9d126e640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc9b00678c0 0x7fc9b0069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0ae000 tx=0x7fc9bc0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.345+0000 7fc9c27fc640 1 -- 172.21.15.94:0/2679612986 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc9c8056c90 con 0x7fc9cc0af2a0 2024-09-11T23:18:59.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:18:59.505+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9cc06fcd0 con 0x7fc9cc0af2a0 2024-09-11T23:19:00.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.185+0000 7fc9c27fc640 1 -- 172.21.15.94:0/2679612986 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7fc9c8056590 con 0x7fc9cc0af2a0 2024-09-11T23:19:00.187 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:19:00.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.189+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc9b00678c0 msgr2=0x7fc9b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.189+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc9b00678c0 0x7fc9b0069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0ae000 tx=0x7fc9bc0b3040 comp rx=0 tx=0).stop 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.189+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc0af2a0 msgr2=0x7fc9cc153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.189+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc0af2a0 0x7fc9cc153310 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800d800 tx=0x7fc9c800dcc0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 shutdown_connections 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9cc15c2a0 0x7fc9cc156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9cc15bec0 0x7fc9cc09dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc9b00678c0 0x7fc9b0069d80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 --2- 172.21.15.94:0/2679612986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9cc0af2a0 0x7fc9cc153310 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 >> 172.21.15.94:0/2679612986 conn(0x7fc9cc0b1f90 msgr2=0x7fc9cc158320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:00.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 shutdown_connections 2024-09-11T23:19:00.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.193+0000 7fc9d3cd3640 1 -- 172.21.15.94:0/2679612986 wait complete. 2024-09-11T23:19:00.214 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_fragment_size_max 2024-09-11T23:19:00.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.333+0000 7f3ea21ae640 1 Processor -- start 2024-09-11T23:19:00.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.333+0000 7f3ea21ae640 1 -- start start 2024-09-11T23:19:00.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3ea21ae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e9c161a60 0x7f3e9c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3ea21ae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0d2e90 0x7f3e9c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3ea21ae640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9c0d32b0 con 0x7f3e9c0cf450 2024-09-11T23:19:00.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3ea21ae640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3e9c0d0300 con 0x7f3e9c161a60 2024-09-11T23:19:00.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3ea21ae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c06e6c0 con 0x7f3e9c0d2e90 2024-09-11T23:19:00.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e9c161a60 0x7f3e9c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9bfff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f3e9c0cf450 0x7f3e9c0d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:35162/0 (socket says 172.21.15.94:35162) 2024-09-11T23:19:00.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9bfff640 1 -- 172.21.15.94:0/2312849079 learned_addr learned my addr 172.21.15.94:0/2312849079 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:00.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9affd640 1 --2- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0d2e90 0x7f3e9c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9b7fe640 1 -- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0d2e90 msgr2=0x7f3e9c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:00.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9b7fe640 1 --2- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0d2e90 0x7f3e9c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9b7fe640 1 -- 172.21.15.94:0/2312849079 >> v1:172.21.15.155:6789/0 conn(0x7f3e9c0cf450 legacy=0x7f3e9c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.337+0000 7f3e9b7fe640 1 -- 172.21.15.94:0/2312849079 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c0b0f60 con 0x7f3e9c161a60 2024-09-11T23:19:00.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3e9b7fe640 1 --2- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c161a60 0x7f3e9c0d2950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0097c0 tx=0x7f3e8c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380d8a3721a8f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3e9a7fc640 1 -- 172.21.15.94:0/2312849079 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0b1070 con 0x7f3e9c161a60 2024-09-11T23:19:00.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3e9a7fc640 1 -- 172.21.15.94:0/2312849079 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c0a8050 con 0x7f3e9c161a60 2024-09-11T23:19:00.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3e9a7fc640 1 -- 172.21.15.94:0/2312849079 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0d1930 con 0x7f3e9c161a60 2024-09-11T23:19:00.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 -- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c161a60 msgr2=0x7f3e9c0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c161a60 0x7f3e9c0d2950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0097c0 tx=0x7f3e8c01c3e0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 -- 172.21.15.94:0/2312849079 shutdown_connections 2024-09-11T23:19:00.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0d2e90 0x7f3e9c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/2312849079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c161a60 0x7f3e9c0d2950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 -- 172.21.15.94:0/2312849079 >> 172.21.15.94:0/2312849079 conn(0x7f3e9c08bf90 msgr2=0x7f3e9c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:00.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 -- 172.21.15.94:0/2312849079 shutdown_connections 2024-09-11T23:19:00.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 -- 172.21.15.94:0/2312849079 wait complete. 2024-09-11T23:19:00.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 Processor -- start 2024-09-11T23:19:00.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.341+0000 7f3ea21ae640 1 -- start start 2024-09-11T23:19:00.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0cf450 0x7f3e9c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c0d2e90 0x7f3e9c0b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e9c161a60 0x7f3e9c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c16af20 con 0x7f3e9c161a60 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c06d190 con 0x7f3e9c0d2e90 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c16b0a0 con 0x7f3e9c0cf450 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c0d2e90 0x7f3e9c0b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0cf450 0x7f3e9c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c0d2e90 0x7f3e9c0b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:43910/0 (socket says 172.21.15.94:43910) 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9affd640 1 -- 172.21.15.94:0/1957149175 learned_addr learned my addr 172.21.15.94:0/1957149175 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:00.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9bfff640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e9c161a60 0x7f3e9c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9bfff640 1 -- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0cf450 msgr2=0x7f3e9c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9bfff640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0cf450 0x7f3e9c15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9bfff640 1 -- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c0d2e90 msgr2=0x7f3e9c0b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9bfff640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c0d2e90 0x7f3e9c0b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9bfff640 1 -- 172.21.15.94:0/1957149175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c15cd20 con 0x7f3e9c161a60 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e9bfff640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e9c161a60 0x7f3e9c150400 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400cad0 tx=0x7f3e9400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e83fff640 1 -- 172.21.15.94:0/1957149175 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94017070 con 0x7f3e9c161a60 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e83fff640 1 -- 172.21.15.94:0/1957149175 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9400ac30 con 0x7f3e9c161a60 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c15d000 con 0x7f3e9c161a60 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e83fff640 1 -- 172.21.15.94:0/1957149175 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94012400 con 0x7f3e9c161a60 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c15d5c0 con 0x7f3e9c161a60 2024-09-11T23:19:00.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c0cef10 con 0x7f3e9c161a60 2024-09-11T23:19:00.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e83fff640 1 -- 172.21.15.94:0/1957149175 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e9401a070 con 0x7f3e9c161a60 2024-09-11T23:19:00.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e83fff640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e880678c0 0x7f3e88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.345+0000 7f3e83fff640 1 -- 172.21.15.94:0/1957149175 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f3e94085b30 con 0x7f3e9c161a60 2024-09-11T23:19:00.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.349+0000 7f3e9b7fe640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e880678c0 0x7f3e88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.349+0000 7f3e9b7fe640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e880678c0 0x7f3e88069d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0ae000 tx=0x7f3e8c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.349+0000 7f3e83fff640 1 -- 172.21.15.94:0/1957149175 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e94056270 con 0x7f3e9c161a60 2024-09-11T23:19:00.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.501+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"} v 0) -- 0x7f3e9c15b760 con 0x7f3e9c161a60 2024-09-11T23:19:00.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.505+0000 7f3e83fff640 1 -- 172.21.15.94:0/1957149175 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"}]=0 v24) ==== 108+0+0 (secure 0 0 0) 0x7f3e9405a570 con 0x7f3e9c161a60 2024-09-11T23:19:00.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e880678c0 msgr2=0x7f3e88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e880678c0 0x7f3e88069d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0ae000 tx=0x7f3e8c0a7000 comp rx=0 tx=0).stop 2024-09-11T23:19:00.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e9c161a60 msgr2=0x7f3e9c150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e9c161a60 0x7f3e9c150400 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400cad0 tx=0x7f3e9400cf90 comp rx=0 tx=0).stop 2024-09-11T23:19:00.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 shutdown_connections 2024-09-11T23:19:00.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f3e880678c0 0x7f3e88069d80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e9c161a60 0x7f3e9c150400 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e9c0d2e90 0x7f3e9c0b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 --2- 172.21.15.94:0/1957149175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e9c0cf450 0x7f3e9c15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 >> 172.21.15.94:0/1957149175 conn(0x7f3e9c08bf90 msgr2=0x7f3e9c15ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:00.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 shutdown_connections 2024-09-11T23:19:00.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.509+0000 7f3ea21ae640 1 -- 172.21.15.94:0/1957149175 wait complete. 2024-09-11T23:19:00.524 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:19:00.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.629+0000 7f11ab662640 1 Processor -- start 2024-09-11T23:19:00.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.629+0000 7f11ab662640 1 -- start start 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11ab662640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a4073e60 0x7f11a406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11ab662640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11a406fef0 0x7f11a415b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11ab662640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f11a40b3d50 0x7f11a40b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11ab662640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f11a40b46a0 con 0x7f11a40b3d50 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11ab662640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f11a415bda0 con 0x7f11a406fef0 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11ab662640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f11a406ee50 con 0x7f11a4073e60 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f11a40b3d50 0x7f11a40b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f11a40b3d50 0x7f11a40b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32798/0 (socket says 172.21.15.94:32798) 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 -- 172.21.15.94:0/3983757400 learned_addr learned my addr 172.21.15.94:0/3983757400 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:00.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a8bfd640 1 --2- 172.21.15.94:0/3983757400 >> v2:172.21.15.155:3300/0 conn(0x7f11a406fef0 0x7f11a415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a93fe640 1 --2- 172.21.15.94:0/3983757400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a4073e60 0x7f11a406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 -- 172.21.15.94:0/3983757400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a4073e60 msgr2=0x7f11a406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:00.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 --2- 172.21.15.94:0/3983757400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a4073e60 0x7f11a406e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 -- 172.21.15.94:0/3983757400 >> v2:172.21.15.155:3300/0 conn(0x7f11a406fef0 msgr2=0x7f11a415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:00.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 --2- 172.21.15.94:0/3983757400 >> v2:172.21.15.155:3300/0 conn(0x7f11a406fef0 0x7f11a415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 -- 172.21.15.94:0/3983757400 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a406f130 con 0x7f11a40b3d50 2024-09-11T23:19:00.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a8bfd640 1 --2- 172.21.15.94:0/3983757400 >> v2:172.21.15.155:3300/0 conn(0x7f11a406fef0 0x7f11a415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:00.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f11a9bff640 1 --2- 172.21.15.94:0/3983757400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4160 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f11a406dd30 tx=0x7f119c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212db95ffd145b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f119bfff640 1 -- 172.21.15.94:0/3983757400 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0a56d0 con 0x7f11a40b3d50 2024-09-11T23:19:00.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f119bfff640 1 -- 172.21.15.94:0/3983757400 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c0a5870 con 0x7f11a40b3d50 2024-09-11T23:19:00.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.633+0000 7f119bfff640 1 -- 172.21.15.94:0/3983757400 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0a5c40 con 0x7f11a40b3d50 2024-09-11T23:19:00.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/3983757400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a40b3d50 msgr2=0x7f11a40b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 --2- 172.21.15.94:0/3983757400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4160 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f11a406dd30 tx=0x7f119c01c960 comp rx=0 tx=0).stop 2024-09-11T23:19:00.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/3983757400 shutdown_connections 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 --2- 172.21.15.94:0/3983757400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4160 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 --2- 172.21.15.94:0/3983757400 >> v2:172.21.15.155:3300/0 conn(0x7f11a406fef0 0x7f11a415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 --2- 172.21.15.94:0/3983757400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a4073e60 0x7f11a406e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/3983757400 >> 172.21.15.94:0/3983757400 conn(0x7f11a40b1f90 msgr2=0x7f11a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/3983757400 shutdown_connections 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/3983757400 wait complete. 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 Processor -- start 2024-09-11T23:19:00.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- start start 2024-09-11T23:19:00.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a406fef0 0x7f11a409ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a4073e60 0x7f11a4151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f11a415ed90 con 0x7f11a4073e60 2024-09-11T23:19:00.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f11a415ec10 con 0x7f11a40b3d50 2024-09-11T23:19:00.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f11a415ef10 con 0x7f11a406fef0 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a4073e60 0x7f11a4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a4073e60 0x7f11a4151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32806/0 (socket says 172.21.15.94:32806) 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 -- 172.21.15.94:0/1412714326 learned_addr learned my addr 172.21.15.94:0/1412714326 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a9bff640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a93fe640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a406fef0 0x7f11a409ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 -- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a406fef0 msgr2=0x7f11a409ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a406fef0 0x7f11a409ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 -- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11a40b3d50 msgr2=0x7f11a40b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 -- 172.21.15.94:0/1412714326 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a409e310 con 0x7f11a4073e60 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a9bff640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11a8bfd640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a4073e60 0x7f11a4151510 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f119400c7f0 tx=0x7f119400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f1199ffb640 1 -- 172.21.15.94:0/1412714326 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194015070 con 0x7f11a4073e60 2024-09-11T23:19:00.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f1199ffb640 1 -- 172.21.15.94:0/1412714326 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1194007820 con 0x7f11a4073e60 2024-09-11T23:19:00.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a4153640 con 0x7f11a4073e60 2024-09-11T23:19:00.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f1199ffb640 1 -- 172.21.15.94:0/1412714326 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194007c10 con 0x7f11a4073e60 2024-09-11T23:19:00.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a4153c00 con 0x7f11a4073e60 2024-09-11T23:19:00.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.637+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a415b860 con 0x7f11a4073e60 2024-09-11T23:19:00.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.641+0000 7f1199ffb640 1 -- 172.21.15.94:0/1412714326 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1194018070 con 0x7f11a4073e60 2024-09-11T23:19:00.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.641+0000 7f1199ffb640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11880678c0 0x7f1188069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.641+0000 7f1199ffb640 1 -- 172.21.15.94:0/1412714326 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f1194085b00 con 0x7f11a4073e60 2024-09-11T23:19:00.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.641+0000 7f11a93fe640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11880678c0 0x7f1188069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.641+0000 7f11a93fe640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11880678c0 0x7f1188069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f11a000b800 tx=0x7f11a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.645+0000 7f1199ffb640 1 -- 172.21.15.94:0/1412714326 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f119408b020 con 0x7f11a4073e60 2024-09-11T23:19:00.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.805+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f11a4153fa0 con 0x7f11a4073e60 2024-09-11T23:19:00.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f1199ffb640 1 -- 172.21.15.94:0/1412714326 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f1194056680 con 0x7f11a4073e60 2024-09-11T23:19:00.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11880678c0 msgr2=0x7f1188069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11880678c0 0x7f1188069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f11a000b800 tx=0x7f11a0008040 comp rx=0 tx=0).stop 2024-09-11T23:19:00.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a4073e60 msgr2=0x7f11a4151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a4073e60 0x7f11a4151510 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f119400c7f0 tx=0x7f119400ccb0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 shutdown_connections 2024-09-11T23:19:00.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11a40b3d50 0x7f11a40b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11880678c0 0x7f1188069d80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11a4073e60 0x7f11a4151510 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 --2- 172.21.15.94:0/1412714326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a406fef0 0x7f11a409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.809+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 >> 172.21.15.94:0/1412714326 conn(0x7f11a40b1f90 msgr2=0x7f11a415c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:00.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.813+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 shutdown_connections 2024-09-11T23:19:00.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.813+0000 7f11ab662640 1 -- 172.21.15.94:0/1412714326 wait complete. 2024-09-11T23:19:00.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays' 2024-09-11T23:19:00.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 Processor -- start 2024-09-11T23:19:00.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 -- start start 2024-09-11T23:19:00.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f70901457a0 0x7f70900d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900cf800 0x7f70900b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f70900b4340 0x7f709015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f70900b47b0 con 0x7f70900b4340 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f70900d27a0 con 0x7f70901457a0 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7096ee4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70900d2a80 con 0x7f70900cf800 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f70900b4340 0x7f709015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f70900b4340 0x7f709015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32820/0 (socket says 172.21.15.94:32820) 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 -- 172.21.15.94:0/1275748661 learned_addr learned my addr 172.21.15.94:0/1275748661 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f708ffff640 1 --2- 172.21.15.94:0/1275748661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900cf800 0x7f70900b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7094c80640 1 --2- 172.21.15.94:0/1275748661 >> v2:172.21.15.155:3300/0 conn(0x7f70901457a0 0x7f70900d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 -- 172.21.15.94:0/1275748661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900cf800 msgr2=0x7f70900b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 --2- 172.21.15.94:0/1275748661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900cf800 0x7f70900b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 -- 172.21.15.94:0/1275748661 >> v2:172.21.15.155:3300/0 conn(0x7f70901457a0 msgr2=0x7f70900d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:00.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 --2- 172.21.15.94:0/1275748661 >> v2:172.21.15.155:3300/0 conn(0x7f70901457a0 0x7f70900d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.941+0000 7f7095481640 1 -- 172.21.15.94:0/1275748661 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70900d2d60 con 0x7f70900b4340 2024-09-11T23:19:00.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7095481640 1 --2- 172.21.15.94:0/1275748661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70900b4340 0x7f709015ff20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7090068500 tx=0x7f708801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2343bfe1dd8820 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f708f7fe640 1 -- 172.21.15.94:0/1275748661 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70880a9430 con 0x7f70900b4340 2024-09-11T23:19:00.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f708f7fe640 1 -- 172.21.15.94:0/1275748661 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70880ae070 con 0x7f70900b4340 2024-09-11T23:19:00.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f708f7fe640 1 -- 172.21.15.94:0/1275748661 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70880a97f0 con 0x7f70900b4340 2024-09-11T23:19:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- 172.21.15.94:0/1275748661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70900b4340 msgr2=0x7f709015ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 --2- 172.21.15.94:0/1275748661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70900b4340 0x7f709015ff20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7090068500 tx=0x7f708801c6a0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- 172.21.15.94:0/1275748661 shutdown_connections 2024-09-11T23:19:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 --2- 172.21.15.94:0/1275748661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70900b4340 0x7f709015ff20 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 --2- 172.21.15.94:0/1275748661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900cf800 0x7f70900b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 --2- 172.21.15.94:0/1275748661 >> v2:172.21.15.155:3300/0 conn(0x7f70901457a0 0x7f70900d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- 172.21.15.94:0/1275748661 >> 172.21.15.94:0/1275748661 conn(0x7f709006bcc0 msgr2=0x7f709006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- 172.21.15.94:0/1275748661 shutdown_connections 2024-09-11T23:19:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- 172.21.15.94:0/1275748661 wait complete. 2024-09-11T23:19:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 Processor -- start 2024-09-11T23:19:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- start start 2024-09-11T23:19:00.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900b4340 0x7f709015e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70900cf800 0x7f709015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70901457a0 0x7f70901f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f70900d0890 con 0x7f70901457a0 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70900d0710 con 0x7f70900cf800 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.945+0000 7f7096ee4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70900d0a10 con 0x7f70900b4340 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70901457a0 0x7f70901f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70901457a0 0x7f70901f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32822/0 (socket says 172.21.15.94:32822) 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 -- 172.21.15.94:0/3127407744 learned_addr learned my addr 172.21.15.94:0/3127407744 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7094c80640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900b4340 0x7f709015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708ffff640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70900cf800 0x7f709015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 -- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900b4340 msgr2=0x7f709015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900b4340 0x7f709015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 -- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70900cf800 msgr2=0x7f709015b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70900cf800 0x7f709015b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 -- 172.21.15.94:0/3127407744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709015eb40 con 0x7f70901457a0 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7094c80640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900b4340 0x7f709015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708ffff640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70900cf800 0x7f709015b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7095481640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70901457a0 0x7f70901f88f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f70880ab040 tx=0x7f7088019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708d7fa640 1 -- 172.21.15.94:0/3127407744 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70880b8070 con 0x7f70901457a0 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708d7fa640 1 -- 172.21.15.94:0/3127407744 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70880a9840 con 0x7f70901457a0 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709015ee20 con 0x7f70901457a0 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708d7fa640 1 -- 172.21.15.94:0/3127407744 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70880a9c30 con 0x7f70901457a0 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709015f3e0 con 0x7f70901457a0 2024-09-11T23:19:00.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70900b3e00 con 0x7f70901457a0 2024-09-11T23:19:00.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708d7fa640 1 -- 172.21.15.94:0/3127407744 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70880c5430 con 0x7f70901457a0 2024-09-11T23:19:00.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708d7fa640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70700678c0 0x7f7070069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:00.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f708d7fa640 1 -- 172.21.15.94:0/3127407744 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f708811fe60 con 0x7f70901457a0 2024-09-11T23:19:00.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7094c80640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70700678c0 0x7f7070069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:00.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.949+0000 7f7094c80640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70700678c0 0x7f7070069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f70800097a0 tx=0x7f7080008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:00.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:00.953+0000 7f708d7fa640 1 -- 172.21.15.94:0/3127407744 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f70880165e0 con 0x7f70901457a0 2024-09-11T23:19:01.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.173+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]} v 0) -- 0x7f70900d1350 con 0x7f70901457a0 2024-09-11T23:19:01.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f708d7fa640 1 -- 172.21.15.94:0/3127407744 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]}]=0 v212) ==== 140+0+0 (secure 0 0 0) 0x7f70880f04c0 con 0x7f70901457a0 2024-09-11T23:19:01.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70700678c0 msgr2=0x7f7070069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70700678c0 0x7f7070069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f70800097a0 tx=0x7f7080008040 comp rx=0 tx=0).stop 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70901457a0 msgr2=0x7f70901f88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70901457a0 0x7f70901f88f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f70880ab040 tx=0x7f7088019440 comp rx=0 tx=0).stop 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 shutdown_connections 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70700678c0 0x7f7070069d80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70901457a0 0x7f70901f88f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70900cf800 0x7f709015b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 --2- 172.21.15.94:0/3127407744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70900b4340 0x7f709015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 >> 172.21.15.94:0/3127407744 conn(0x7f709006bcc0 msgr2=0x7f70900b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 shutdown_connections 2024-09-11T23:19:01.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.189+0000 7f7096ee4640 1 -- 172.21.15.94:0/3127407744 wait complete. 2024-09-11T23:19:01.207 INFO:tasks.cephfs_test_runner:That unlinking fails when the stray directory fragment becomes too ... ok 2024-09-11T23:19:01.208 INFO:tasks.cephfs_test_runner:Starting test: test_fancy_layout (tasks.cephfs.test_strays.TestStrays) purge stray file with fancy layout 2024-09-11T23:19:01.208 INFO:tasks.cephfs_test_runner:test_fancy_layout (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:19:01.208 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:01.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.321+0000 7fba9f7a5640 1 Processor -- start 2024-09-11T23:19:01.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.321+0000 7fba9f7a5640 1 -- start start 2024-09-11T23:19:01.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9f7a5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba9815c2a0 0x7fba980aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9f7a5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba980b3290 con 0x7fba980af2a0 2024-09-11T23:19:01.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9f7a5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba980b3570 con 0x7fba9815bec0 2024-09-11T23:19:01.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9f7a5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fba980b3850 con 0x7fba9815c2a0 2024-09-11T23:19:01.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9cd40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba9815c2a0 0x7fba980aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9dd42640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fba980af2a0 0x7fba9806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60296/0 (socket says 172.21.15.94:60296) 2024-09-11T23:19:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9cd40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba9815c2a0 0x7fba980aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32832/0 (socket says 172.21.15.94:32832) 2024-09-11T23:19:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9dd42640 1 -- 172.21.15.94:0/3476511202 learned_addr learned my addr 172.21.15.94:0/3476511202 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9cd40640 1 -- 172.21.15.94:0/3476511202 >> v1:172.21.15.155:6789/0 conn(0x7fba9815bec0 legacy=0x7fba980ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9cd40640 1 -- 172.21.15.94:0/3476511202 >> v1:172.21.15.94:6789/0 conn(0x7fba980af2a0 legacy=0x7fba9806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9cd40640 1 -- 172.21.15.94:0/3476511202 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980b3b30 con 0x7fba9815c2a0 2024-09-11T23:19:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba8ffff640 1 -- 172.21.15.94:0/3476511202 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582599376 0 0) 0x7fba980b3290 con 0x7fba980af2a0 2024-09-11T23:19:01.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9cd40640 1 --2- 172.21.15.94:0/3476511202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815c2a0 0x7fba980aed60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fba940097c0 tx=0x7fba9401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6813b8aaad3453c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba8ffff640 1 -- 172.21.15.94:0/3476511202 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940ab430 con 0x7fba9815c2a0 2024-09-11T23:19:01.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba8ffff640 1 -- 172.21.15.94:0/3476511202 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940b0070 con 0x7fba9815c2a0 2024-09-11T23:19:01.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba8ffff640 1 -- 172.21.15.94:0/3476511202 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940ab7f0 con 0x7fba9815c2a0 2024-09-11T23:19:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3476511202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815c2a0 msgr2=0x7fba980aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.325+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3476511202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815c2a0 0x7fba980aed60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fba940097c0 tx=0x7fba9401c430 comp rx=0 tx=0).stop 2024-09-11T23:19:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3476511202 shutdown_connections 2024-09-11T23:19:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3476511202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815c2a0 0x7fba980aed60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3476511202 >> 172.21.15.94:0/3476511202 conn(0x7fba980b1f90 msgr2=0x7fba980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3476511202 shutdown_connections 2024-09-11T23:19:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3476511202 wait complete. 2024-09-11T23:19:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 Processor -- start 2024-09-11T23:19:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- start start 2024-09-11T23:19:01.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba980af2a0 0x7fba98148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815bec0 0x7fba9814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba9815c2a0 0x7fba98157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fba9806ef20 con 0x7fba9815bec0 2024-09-11T23:19:01.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba980af6d0 con 0x7fba980af2a0 2024-09-11T23:19:01.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba9806f0a0 con 0x7fba9815c2a0 2024-09-11T23:19:01.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815bec0 0x7fba9814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815bec0 0x7fba9814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32846/0 (socket says 172.21.15.94:32846) 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 -- 172.21.15.94:0/3366765616 learned_addr learned my addr 172.21.15.94:0/3366765616 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9d541640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba980af2a0 0x7fba98148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9dd42640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba9815c2a0 0x7fba98157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 -- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba9815c2a0 msgr2=0x7fba98157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba9815c2a0 0x7fba98157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 -- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba980af2a0 msgr2=0x7fba98148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba980af2a0 0x7fba98148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 -- 172.21.15.94:0/3366765616 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba981509f0 con 0x7fba9815bec0 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9d541640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba980af2a0 0x7fba98148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9dd42640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba9815c2a0 0x7fba98157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9cd40640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815bec0 0x7fba9814ff50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fba9401a060 tx=0x7fba940191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba8dffb640 1 -- 172.21.15.94:0/3366765616 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940bf450 con 0x7fba9815bec0 2024-09-11T23:19:01.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba8dffb640 1 -- 172.21.15.94:0/3366765616 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940bf5f0 con 0x7fba9815bec0 2024-09-11T23:19:01.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba8dffb640 1 -- 172.21.15.94:0/3366765616 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940bf9e0 con 0x7fba9815bec0 2024-09-11T23:19:01.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba98150cd0 con 0x7fba9815bec0 2024-09-11T23:19:01.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.329+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9814f750 con 0x7fba9815bec0 2024-09-11T23:19:01.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.333+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba980aed60 con 0x7fba9815bec0 2024-09-11T23:19:01.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.333+0000 7fba8dffb640 1 -- 172.21.15.94:0/3366765616 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba940bfb80 con 0x7fba9815bec0 2024-09-11T23:19:01.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.333+0000 7fba8dffb640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba7c0678c0 0x7fba7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.333+0000 7fba8dffb640 1 -- 172.21.15.94:0/3366765616 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fba940a8020 con 0x7fba9815bec0 2024-09-11T23:19:01.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.333+0000 7fba9d541640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba7c0678c0 0x7fba7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.333+0000 7fba9d541640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba7c0678c0 0x7fba7c069d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fba880016e0 tx=0x7fba88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.337+0000 7fba8dffb640 1 -- 172.21.15.94:0/3366765616 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba94016050 con 0x7fba9815bec0 2024-09-11T23:19:01.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.485+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba980750d0 con 0x7fba9815bec0 2024-09-11T23:19:01.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba8dffb640 1 -- 172.21.15.94:0/3366765616 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13330 (secure 0 0 0) 0x7fba940f0ea0 con 0x7fba9815bec0 2024-09-11T23:19:01.489 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:01.489 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":78,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:00.181508+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6837/100688804":"2024-09-12T23:18:57.102512+0000","172.21.15.155:6836/100688804":"2024-09-12T23:18:57.102512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba7c0678c0 msgr2=0x7fba7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba7c0678c0 0x7fba7c069d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fba880016e0 tx=0x7fba88009040 comp rx=0 tx=0).stop 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815bec0 msgr2=0x7fba9814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815bec0 0x7fba9814ff50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fba9401a060 tx=0x7fba940191d0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 shutdown_connections 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba9815c2a0 0x7fba98157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fba7c0678c0 0x7fba7c069d80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9815bec0 0x7fba9814ff50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 --2- 172.21.15.94:0/3366765616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba980af2a0 0x7fba98148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 >> 172.21.15.94:0/3366765616 conn(0x7fba980b1f90 msgr2=0x7fba981597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 shutdown_connections 2024-09-11T23:19:01.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.489+0000 7fba9f7a5640 1 -- 172.21.15.94:0/3366765616 wait complete. 2024-09-11T23:19:01.507 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:15:02.040073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:19:01.507 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:19:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3729667640 1 Processor -- start 2024-09-11T23:19:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3729667640 1 -- start start 2024-09-11T23:19:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3729667640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 0x7f37240cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3729667640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37240d2880 0x7f37240d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3729667640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37240cf4f0 con 0x7f37240d4300 2024-09-11T23:19:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3729667640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f37240d0100 con 0x7f37240d2880 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3729667640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f37240cf7d0 con 0x7f37240d24a0 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37227fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f37240d4300 0x7f37240d4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60308/0 (socket says 172.21.15.94:60308) 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37227fc640 1 -- 172.21.15.94:0/3694369253 learned_addr learned my addr 172.21.15.94:0/3694369253 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162265075 0 0) 0x7f37240cf4f0 con 0x7f37240d4300 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3722ffd640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 0x7f37240cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 --2- 172.21.15.94:0/3694369253 >> v2:172.21.15.155:3300/0 conn(0x7f37240d2880 0x7f37240d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f370c003530 con 0x7f37240d4300 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2150481551 0 0) 0x7f370c003530 con 0x7f37240d4300 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 msgr2=0x7f37240cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 0x7f37240cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 >> v2:172.21.15.155:3300/0 conn(0x7f37240d2880 msgr2=0x7f37240d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 --2- 172.21.15.94:0/3694369253 >> v2:172.21.15.155:3300/0 conn(0x7f37240d2880 0x7f37240d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37240cfab0 con 0x7f37240d4300 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f3718001680 con 0x7f37240d4300 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 --2- 172.21.15.94:0/3694369253 >> v2:172.21.15.155:3300/0 conn(0x7f37240d2880 0x7f37240d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 >> v1:172.21.15.94:6789/0 conn(0x7f37240d4300 legacy=0x7f37240d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0039c0 0x7f370c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 0x7f370c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f370c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f37240d0100 con 0x7f370c004d50 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37240cf7d0 con 0x7f370c0039c0 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f370c00b9d0 con 0x7f37240d24a0 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f370c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f3722ffd640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0039c0 0x7f370c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37227fc640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 0x7f370c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 -- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 msgr2=0x7f370c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37240d24a0 0x7f370c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 -- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0039c0 msgr2=0x7f370c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0039c0 0x7f370c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.621+0000 7f37237fe640 1 -- 172.21.15.94:0/3694369253 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c003530 con 0x7f370c004d50 2024-09-11T23:19:01.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f37237fe640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f370c0051d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f371c009900 tx=0x7f371c01c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d153e36c70024b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0ac070 con 0x7f370c004d50 2024-09-11T23:19:01.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c0a6640 con 0x7f370c004d50 2024-09-11T23:19:01.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3721ffb640 1 -- 172.21.15.94:0/3694369253 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f040 con 0x7f370c004d50 2024-09-11T23:19:01.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- 172.21.15.94:0/3694369253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 msgr2=0x7f370c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 --2- 172.21.15.94:0/3694369253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f370c0051d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f371c009900 tx=0x7f371c01c630 comp rx=0 tx=0).stop 2024-09-11T23:19:01.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f37237fe640 1 -- 172.21.15.94:0/3694369253 reap_dead start 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- 172.21.15.94:0/3694369253 shutdown_connections 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- 172.21.15.94:0/3694369253 >> 172.21.15.94:0/3694369253 conn(0x7f372408bf90 msgr2=0x7f372409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- 172.21.15.94:0/3694369253 shutdown_connections 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- 172.21.15.94:0/3694369253 wait complete. 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 Processor -- start 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- start start 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f37240cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f372415c200 0x7f37240ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37240ca9d0 0x7f3724163130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f37240cef10 con 0x7f370c004d50 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37240d3250 con 0x7f37240ca9d0 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f37240cf090 con 0x7f372415c200 2024-09-11T23:19:01.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f37240cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f37240cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32854/0 (socket says 172.21.15.94:32854) 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 -- 172.21.15.94:0/3121739550 learned_addr learned my addr 172.21.15.94:0/3121739550 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f37227fc640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f372415c200 0x7f37240ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 -- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f372415c200 msgr2=0x7f37240ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f37237fe640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37240ca9d0 0x7f3724163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f372415c200 0x7f37240ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 -- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37240ca9d0 msgr2=0x7f3724163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37240ca9d0 0x7f3724163130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 -- 172.21.15.94:0/3121739550 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37240cb030 con 0x7f370c004d50 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3722ffd640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f37240cc3b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3714009fb0 tx=0x7f37140115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f370b7fe640 1 -- 172.21.15.94:0/3121739550 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371401a020 con 0x7f370c004d50 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f370b7fe640 1 -- 172.21.15.94:0/3121739550 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3714016470 con 0x7f370c004d50 2024-09-11T23:19:01.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37240b8890 con 0x7f370c004d50 2024-09-11T23:19:01.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f370b7fe640 1 -- 172.21.15.94:0/3121739550 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714016840 con 0x7f370c004d50 2024-09-11T23:19:01.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.625+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37240b8e50 con 0x7f370c004d50 2024-09-11T23:19:01.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.629+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37240cf3e0 con 0x7f370c004d50 2024-09-11T23:19:01.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.629+0000 7f370b7fe640 1 -- 172.21.15.94:0/3121739550 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f371401d020 con 0x7f370c004d50 2024-09-11T23:19:01.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.629+0000 7f370b7fe640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37100678c0 0x7f3710069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.629+0000 7f370b7fe640 1 -- 172.21.15.94:0/3121739550 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f3714086990 con 0x7f370c004d50 2024-09-11T23:19:01.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.629+0000 7f37227fc640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37100678c0 0x7f3710069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.629+0000 7f37227fc640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37100678c0 0x7f3710069d80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3718001ec0 tx=0x7f3718000f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.633+0000 7f370b7fe640 1 -- 172.21.15.94:0/3121739550 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3714024030 con 0x7f370c004d50 2024-09-11T23:19:01.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3724165eb0 con 0x7f370c004d50 2024-09-11T23:19:01.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f370b7fe640 1 -- 172.21.15.94:0/3121739550 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f37140576d0 con 0x7f370c004d50 2024-09-11T23:19:01.782 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-09-11T23:19:01.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37100678c0 msgr2=0x7f3710069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37100678c0 0x7f3710069d80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3718001ec0 tx=0x7f3718000f00 comp rx=0 tx=0).stop 2024-09-11T23:19:01.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 msgr2=0x7f37240cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f37240cc3b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3714009fb0 tx=0x7f37140115a0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 shutdown_connections 2024-09-11T23:19:01.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37240ca9d0 0x7f3724163130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f372415c200 0x7f37240ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f37100678c0 0x7f3710069d80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 --2- 172.21.15.94:0/3121739550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f370c004d50 0x7f37240cc3b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 >> 172.21.15.94:0/3121739550 conn(0x7f372408bf90 msgr2=0x7f37240b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 shutdown_connections 2024-09-11T23:19:01.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.781+0000 7f3729667640 1 -- 172.21.15.94:0/3121739550 wait complete. 2024-09-11T23:19:01.800 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout' 2024-09-11T23:19:01.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.905+0000 7eff77da4640 1 Processor -- start 2024-09-11T23:19:01.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.905+0000 7eff77da4640 1 -- start start 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.905+0000 7eff77da4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff70161a60 0x7eff700d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.905+0000 7eff77da4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff700d2e90 0x7eff700cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.905+0000 7eff77da4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff700d32b0 con 0x7eff700cf450 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.905+0000 7eff77da4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7eff700d0300 con 0x7eff700d2e90 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.905+0000 7eff77da4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7eff7006e6c0 con 0x7eff70161a60 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff700d2e90 0x7eff700cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7eff700d2e90 0x7eff700cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32862/0 (socket says 172.21.15.94:32862) 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 -- 172.21.15.94:0/2355525720 learned_addr learned my addr 172.21.15.94:0/2355525720 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff75b40640 1 --2- 172.21.15.94:0/2355525720 >> v2:172.21.15.155:3300/0 conn(0x7eff70161a60 0x7eff700d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 -- 172.21.15.94:0/2355525720 >> v2:172.21.15.155:3300/0 conn(0x7eff70161a60 msgr2=0x7eff700d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 --2- 172.21.15.94:0/2355525720 >> v2:172.21.15.155:3300/0 conn(0x7eff70161a60 0x7eff700d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 -- 172.21.15.94:0/2355525720 >> v1:172.21.15.155:6789/0 conn(0x7eff700cf450 legacy=0x7eff700d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 -- 172.21.15.94:0/2355525720 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff700b0f60 con 0x7eff700d2e90 2024-09-11T23:19:01.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff7533f640 1 --2- 172.21.15.94:0/2355525720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700cef10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7eff7008e010 tx=0x7eff6001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a592911ddff979 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff74b3e640 1 -- 172.21.15.94:0/2355525720 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff700d1930 con 0x7eff700d2e90 2024-09-11T23:19:01.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff74b3e640 1 -- 172.21.15.94:0/2355525720 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff600b0070 con 0x7eff700d2e90 2024-09-11T23:19:01.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff74b3e640 1 -- 172.21.15.94:0/2355525720 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff600ab840 con 0x7eff700d2e90 2024-09-11T23:19:01.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 -- 172.21.15.94:0/2355525720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 msgr2=0x7eff700cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 --2- 172.21.15.94:0/2355525720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700cef10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7eff7008e010 tx=0x7eff6001c420 comp rx=0 tx=0).stop 2024-09-11T23:19:01.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 -- 172.21.15.94:0/2355525720 shutdown_connections 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 --2- 172.21.15.94:0/2355525720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700cef10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 --2- 172.21.15.94:0/2355525720 >> v2:172.21.15.155:3300/0 conn(0x7eff70161a60 0x7eff700d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 -- 172.21.15.94:0/2355525720 >> 172.21.15.94:0/2355525720 conn(0x7eff7008bf90 msgr2=0x7eff7009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 -- 172.21.15.94:0/2355525720 shutdown_connections 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.909+0000 7eff77da4640 1 -- 172.21.15.94:0/2355525720 wait complete. 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 Processor -- start 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 -- start start 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff700cf450 0x7eff7015d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff70161a60 0x7eff701f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7eff700cf8c0 con 0x7eff700d2e90 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff7006d190 con 0x7eff700cf450 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff700cfa40 con 0x7eff70161a60 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32872/0 (socket says 172.21.15.94:32872) 2024-09-11T23:19:01.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 -- 172.21.15.94:0/713977455 learned_addr learned my addr 172.21.15.94:0/713977455 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 -- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff70161a60 msgr2=0x7eff701f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff76341640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff70161a60 0x7eff701f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff70161a60 0x7eff701f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 -- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff700cf450 msgr2=0x7eff7015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff75b40640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff700cf450 0x7eff7015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff700cf450 0x7eff7015d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 -- 172.21.15.94:0/713977455 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7015dbc0 con 0x7eff700d2e90 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff7533f640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700c7e80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7eff6001c900 tx=0x7eff6001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff667fc640 1 -- 172.21.15.94:0/713977455 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff600abd70 con 0x7eff700d2e90 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff667fc640 1 -- 172.21.15.94:0/713977455 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff600be3f0 con 0x7eff700d2e90 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff700c83c0 con 0x7eff700d2e90 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff667fc640 1 -- 172.21.15.94:0/713977455 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff600be7e0 con 0x7eff700d2e90 2024-09-11T23:19:01.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff700c8f00 con 0x7eff700d2e90 2024-09-11T23:19:01.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff700cef10 con 0x7eff700d2e90 2024-09-11T23:19:01.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff667fc640 1 -- 172.21.15.94:0/713977455 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff600b43f0 con 0x7eff700d2e90 2024-09-11T23:19:01.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff667fc640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff540678c0 0x7eff54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.913+0000 7eff667fc640 1 -- 172.21.15.94:0/713977455 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7eff6011ff00 con 0x7eff700d2e90 2024-09-11T23:19:01.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.917+0000 7eff75b40640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff540678c0 0x7eff54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.917+0000 7eff75b40640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff540678c0 0x7eff54069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7eff700cc770 tx=0x7eff6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:01.917+0000 7eff667fc640 1 -- 172.21.15.94:0/713977455 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff600c4060 con 0x7eff700d2e90 2024-09-11T23:19:02.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.141+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]} v 0) -- 0x7eff70160c20 con 0x7eff700d2e90 2024-09-11T23:19:02.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff667fc640 1 -- 172.21.15.94:0/713977455 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]}]=0 v213) ==== 135+0+0 (secure 0 0 0) 0x7eff7015dbc0 con 0x7eff700d2e90 2024-09-11T23:19:02.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff540678c0 msgr2=0x7eff54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff540678c0 0x7eff54069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7eff700cc770 tx=0x7eff6c008040 comp rx=0 tx=0).stop 2024-09-11T23:19:02.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 msgr2=0x7eff700c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700c7e80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7eff6001c900 tx=0x7eff6001ac60 comp rx=0 tx=0).stop 2024-09-11T23:19:02.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 shutdown_connections 2024-09-11T23:19:02.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff70161a60 0x7eff701f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7eff540678c0 0x7eff54069d80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff700d2e90 0x7eff700c7e80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 --2- 172.21.15.94:0/713977455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff700cf450 0x7eff7015d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 >> 172.21.15.94:0/713977455 conn(0x7eff7008bf90 msgr2=0x7eff7006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:02.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 shutdown_connections 2024-09-11T23:19:02.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.197+0000 7eff77da4640 1 -- 172.21.15.94:0/713977455 wait complete. 2024-09-11T23:19:02.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:19:02.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.333+0000 7fc7be2d2640 1 Processor -- start 2024-09-11T23:19:02.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7be2d2640 1 -- start start 2024-09-11T23:19:02.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7be2d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7b81520a0 0x7fc7b806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7be2d2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b8070250 con 0x7fc7b806fe50 2024-09-11T23:19:02.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7be2d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b80aede0 con 0x7fc7b815f3a0 2024-09-11T23:19:02.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7be2d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b8152480 con 0x7fc7b81520a0 2024-09-11T23:19:02.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b77fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc7b806fe50 0x7fc7b815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60320/0 (socket says 172.21.15.94:60320) 2024-09-11T23:19:02.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b77fe640 1 -- 172.21.15.94:0/3966989136 learned_addr learned my addr 172.21.15.94:0/3966989136 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:02.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890615836 0 0) 0x7fc7b8070250 con 0x7fc7b806fe50 2024-09-11T23:19:02.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a4003530 con 0x7fc7b806fe50 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b7fff640 1 --2- 172.21.15.94:0/3966989136 >> v2:172.21.15.155:3300/0 conn(0x7fc7b81520a0 0x7fc7b806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1688185621 0 0) 0x7fc7a4003530 con 0x7fc7b806fe50 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 >> v2:172.21.15.155:3300/0 conn(0x7fc7b81520a0 msgr2=0x7fc7b806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 --2- 172.21.15.94:0/3966989136 >> v2:172.21.15.155:3300/0 conn(0x7fc7b81520a0 0x7fc7b806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 >> v1:172.21.15.155:6789/0 conn(0x7fc7b815f3a0 legacy=0x7fc7b80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b815fa10 con 0x7fc7b806fe50 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fc7a0001680 con 0x7fc7b806fe50 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 >> v1:172.21.15.94:6789/0 conn(0x7fc7b806fe50 legacy=0x7fc7b815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4003a10 0x7fc7a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7a4004810 0x7fc7a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7a4005220 0x7fc7a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a400c120 con 0x7fc7a4005220 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a400c2d0 con 0x7fc7a4004810 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a400c4d0 con 0x7fc7a4003a10 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b7fff640 1 --2- 172.21.15.94:0/3966989136 >> v2:172.21.15.155:3300/0 conn(0x7fc7b81520a0 0x7fc7b806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7bc86f640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7a4005220 0x7fc7a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7b77fe640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7a4004810 0x7fc7a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7bc86f640 1 -- 172.21.15.94:0/3966989136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4003a10 msgr2=0x7fc7a4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7bc86f640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4003a10 0x7fc7a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7bc86f640 1 -- 172.21.15.94:0/3966989136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7a4004810 msgr2=0x7fc7a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7bc86f640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7a4004810 0x7fc7a4004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.337+0000 7fc7bc86f640 1 -- 172.21.15.94:0/3966989136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a4003530 con 0x7fc7a4005220 2024-09-11T23:19:02.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 -- 172.21.15.94:0/3966989136 reap_dead start 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7a4005220 0x7fc7a400b9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007fd0 tx=0x7fc7b001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3578e90257f5db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00039b0 con 0x7fc7a4005220 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b00ab640 con 0x7fc7a4005220 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b6ffd640 1 -- 172.21.15.94:0/3966989136 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00aba30 con 0x7fc7a4005220 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- 172.21.15.94:0/3966989136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7a4005220 msgr2=0x7fc7a400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7a4005220 0x7fc7a400b9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007fd0 tx=0x7fc7b001c300 comp rx=0 tx=0).stop 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- 172.21.15.94:0/3966989136 shutdown_connections 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/3966989136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7a4005220 0x7fc7a400b9d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- 172.21.15.94:0/3966989136 >> 172.21.15.94:0/3966989136 conn(0x7fc7b80b1f90 msgr2=0x7fc7b80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- 172.21.15.94:0/3966989136 shutdown_connections 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- 172.21.15.94:0/3966989136 wait complete. 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 Processor -- start 2024-09-11T23:19:02.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- start start 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4005220 0x7fc7b8149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b816ac10 0x7fc7b80adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7b80ae3e0 0x7fc7b81f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b8073490 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b815f830 con 0x7fc7b816ac10 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b8073770 con 0x7fc7a4005220 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7b80ae3e0 0x7fc7b81f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7b80ae3e0 0x7fc7b81f7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32888/0 (socket says 172.21.15.94:32888) 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 -- 172.21.15.94:0/499303564 learned_addr learned my addr 172.21.15.94:0/499303564 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b7fff640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4005220 0x7fc7b8149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b77fe640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b816ac10 0x7fc7b80adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 -- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4005220 msgr2=0x7fc7b8149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4005220 0x7fc7b8149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 -- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b816ac10 msgr2=0x7fc7b80adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b816ac10 0x7fc7b80adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 -- 172.21.15.94:0/499303564 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b80ccd50 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b77fe640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b816ac10 0x7fc7b80adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7bc86f640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7b80ae3e0 0x7fc7b81f7fb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc7b001c7e0 tx=0x7fc7a4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b4ff9640 1 -- 172.21.15.94:0/499303564 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00b37d0 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b4ff9640 1 -- 172.21.15.94:0/499303564 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b00b9070 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b80ccff0 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7b4ff9640 1 -- 172.21.15.94:0/499303564 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00b3b70 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.341+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b80cd2d0 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.345+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b8068e50 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.345+0000 7fc7b4ff9640 1 -- 172.21.15.94:0/499303564 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7b00b3d10 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.345+0000 7fc7b4ff9640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7980678c0 0x7fc798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.345+0000 7fc7b4ff9640 1 -- 172.21.15.94:0/499303564 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fc7b0120210 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.345+0000 7fc7b7fff640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7980678c0 0x7fc798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.345+0000 7fc7b7fff640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7980678c0 0x7fc798069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009f10 tx=0x7fc7a800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.349+0000 7fc7b4ff9640 1 -- 172.21.15.94:0/499303564 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc7b0016010 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.501+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc7b80aede0 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.505+0000 7fc7b4ff9640 1 -- 172.21.15.94:0/499303564 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fc7b00f0f50 con 0x7fc7b80ae3e0 2024-09-11T23:19:02.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7980678c0 msgr2=0x7fc798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7980678c0 0x7fc798069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009f10 tx=0x7fc7a800b040 comp rx=0 tx=0).stop 2024-09-11T23:19:02.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7b80ae3e0 msgr2=0x7fc7b81f7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7b80ae3e0 0x7fc7b81f7fb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc7b001c7e0 tx=0x7fc7a4005840 comp rx=0 tx=0).stop 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 shutdown_connections 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7980678c0 0x7fc798069d80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7b80ae3e0 0x7fc7b81f7fb0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b816ac10 0x7fc7b80adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 --2- 172.21.15.94:0/499303564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7a4005220 0x7fc7b8149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 >> 172.21.15.94:0/499303564 conn(0x7fc7b80b1f90 msgr2=0x7fc7b806f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 shutdown_connections 2024-09-11T23:19:02.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.509+0000 7fc7be2d2640 1 -- 172.21.15.94:0/499303564 wait complete. 2024-09-11T23:19:02.524 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:19:02.525 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:02.582 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:02.628 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:19:02.629 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:19:02.629 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:02.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:02.634 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:19:02.634 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:02.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:02.640 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:19:02.640 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:02.681 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:02.681 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:19:02.681 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:02.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:02.687 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:19:02.687 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.845+0000 7ff558ad2640 1 Processor -- start 2024-09-11T23:19:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.845+0000 7ff558ad2640 1 -- start start 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff558ad2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff5541587a0 0x7ff5540b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff558ad2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 0x7ff55406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff558ad2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff55406e4b0 0x7ff554161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff558ad2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff55406f870 con 0x7ff55406e4b0 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff558ad2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff5540b3c10 con 0x7ff5541587a0 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff558ad2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff55406ec60 con 0x7ff5540b37d0 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff55406e4b0 0x7ff554161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff55406e4b0 0x7ff554161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32892/0 (socket says 172.21.15.94:32892) 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 -- 172.21.15.94:0/4197414836 learned_addr learned my addr 172.21.15.94:0/4197414836 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff551d9b640 1 --2- 172.21.15.94:0/4197414836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 0x7ff55406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff55259c640 1 --2- 172.21.15.94:0/4197414836 >> v2:172.21.15.155:3300/0 conn(0x7ff5541587a0 0x7ff5540b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 -- 172.21.15.94:0/4197414836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 msgr2=0x7ff55406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 --2- 172.21.15.94:0/4197414836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 0x7ff55406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 -- 172.21.15.94:0/4197414836 >> v2:172.21.15.155:3300/0 conn(0x7ff5541587a0 msgr2=0x7ff5540b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 --2- 172.21.15.94:0/4197414836 >> v2:172.21.15.155:3300/0 conn(0x7ff5541587a0 0x7ff5540b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.849+0000 7ff552d9d640 1 -- 172.21.15.94:0/4197414836 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55406ef40 con 0x7ff55406e4b0 2024-09-11T23:19:02.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff552d9d640 1 --2- 172.21.15.94:0/4197414836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff554161e50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff554071710 tx=0x7ff53c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392adde575f152c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55159a640 1 -- 172.21.15.94:0/4197414836 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0b0070 con 0x7ff55406e4b0 2024-09-11T23:19:02.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55159a640 1 -- 172.21.15.94:0/4197414836 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c0ab600 con 0x7ff55406e4b0 2024-09-11T23:19:02.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55159a640 1 -- 172.21.15.94:0/4197414836 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0ab9d0 con 0x7ff55406e4b0 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- 172.21.15.94:0/4197414836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 msgr2=0x7ff554161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 --2- 172.21.15.94:0/4197414836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff554161e50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff554071710 tx=0x7ff53c01c230 comp rx=0 tx=0).stop 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- 172.21.15.94:0/4197414836 shutdown_connections 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 --2- 172.21.15.94:0/4197414836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff554161e50 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 --2- 172.21.15.94:0/4197414836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 0x7ff55406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 --2- 172.21.15.94:0/4197414836 >> v2:172.21.15.155:3300/0 conn(0x7ff5541587a0 0x7ff5540b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- 172.21.15.94:0/4197414836 >> 172.21.15.94:0/4197414836 conn(0x7ff5540b1f90 msgr2=0x7ff5540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:02.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- 172.21.15.94:0/4197414836 shutdown_connections 2024-09-11T23:19:02.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- 172.21.15.94:0/4197414836 wait complete. 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 Processor -- start 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- start start 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff55414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 0x7ff554150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5541587a0 0x7ff55414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff554158b80 con 0x7ff55406e4b0 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff554072160 con 0x7ff5541587a0 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff558ad2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5541508d0 con 0x7ff5540b37d0 2024-09-11T23:19:02.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff55414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff55414c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32906/0 (socket says 172.21.15.94:32906) 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 -- 172.21.15.94:0/1067621458 learned_addr learned my addr 172.21.15.94:0/1067621458 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 -- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 msgr2=0x7ff554150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 0x7ff554150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 -- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5541587a0 msgr2=0x7ff55414df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5541587a0 0x7ff55414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.853+0000 7ff55259c640 1 -- 172.21.15.94:0/1067621458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55414ebf0 con 0x7ff55406e4b0 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff55259c640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff55414c2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007e40 tx=0x7ff54c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff54affd640 1 -- 172.21.15.94:0/1067621458 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c014620 con 0x7ff55406e4b0 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff54affd640 1 -- 172.21.15.94:0/1067621458 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c019070 con 0x7ff55406e4b0 2024-09-11T23:19:02.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55414eed0 con 0x7ff55406e4b0 2024-09-11T23:19:02.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff54affd640 1 -- 172.21.15.94:0/1067621458 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c014a00 con 0x7ff55406e4b0 2024-09-11T23:19:02.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff554150560 con 0x7ff55406e4b0 2024-09-11T23:19:02.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff554070080 con 0x7ff55406e4b0 2024-09-11T23:19:02.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff54affd640 1 -- 172.21.15.94:0/1067621458 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff54c014ba0 con 0x7ff55406e4b0 2024-09-11T23:19:02.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff54affd640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5380678f0 0x7ff538069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff54affd640 1 -- 172.21.15.94:0/1067621458 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7ff54c0863d0 con 0x7ff55406e4b0 2024-09-11T23:19:02.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff551d9b640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5380678f0 0x7ff538069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.857+0000 7ff551d9b640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5380678f0 0x7ff538069db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff55414f800 tx=0x7ff544008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:02.861+0000 7ff54affd640 1 -- 172.21.15.94:0/1067621458 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff54c057080 con 0x7ff55406e4b0 2024-09-11T23:19:03.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.041+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff554073050 con 0x7ff55406e4b0 2024-09-11T23:19:03.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff54affd640 1 -- 172.21.15.94:0/1067621458 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+3911 (secure 0 0 0) 0x7ff54c056980 con 0x7ff55406e4b0 2024-09-11T23:19:03.044 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:03.044 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":42,"btime":"2024-09-11T23:18:58:163549+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3206103646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3206103646},{"type":"v1","addr":"172.21.15.94:6833","nonce":3206103646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593709074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593709074},{"type":"v1","addr":"172.21.15.155:6835","nonce":593709074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/916311563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":916311563},{"type":"v1","addr":"172.21.15.155:6837","nonce":916311563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1434225597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1434225597},{"type":"v1","addr":"172.21.15.94:6835","nonce":1434225597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[]} 2024-09-11T23:19:03.045 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 42 2024-09-11T23:19:03.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5380678f0 msgr2=0x7ff538069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5380678f0 0x7ff538069db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff55414f800 tx=0x7ff544008040 comp rx=0 tx=0).stop 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 msgr2=0x7ff55414c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff55414c2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007e40 tx=0x7ff54c00e4b0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 shutdown_connections 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5541587a0 0x7ff55414df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5540b37d0 0x7ff554150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff5380678f0 0x7ff538069db0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 --2- 172.21.15.94:0/1067621458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff55406e4b0 0x7ff55414c2f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 >> 172.21.15.94:0/1067621458 conn(0x7ff5540b1f90 msgr2=0x7ff554155140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 shutdown_connections 2024-09-11T23:19:03.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.045+0000 7ff558ad2640 1 -- 172.21.15.94:0/1067621458 wait complete. 2024-09-11T23:19:03.062 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:19:03.062 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:19:03.062 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:19:03.062 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:03.062 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:19:03.063 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:19:03.063 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:19:03.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:03.063 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:19:03.063 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:19:03.063 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:19:03.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:03.063 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:19:03.064 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:19:03.064 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:19:03.064 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:03.077 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:19:03.077 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:19:03.078 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:19:03.079 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:19:03.079 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:19:03.079 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:19:03.080 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:19:03.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:19:03.121 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:19:03.122 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:03.122 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:19:03.123 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:03.125 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:19:03.125 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:03.125 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:19:03.126 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:03.126 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:19:03.180 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:19:03.187 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:19:03.196 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:19:03.196 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:19:03.196 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-09-11T23:19:03.195+0000 7fdd36a8e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b734d9640 1 Processor -- start 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b734d9640 1 -- start start 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b734d9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4b6c0ce9d0 0x7f4b6c0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b734d9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c0cf920 0x7f4b6c0d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b734d9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c06d9c0 con 0x7f4b6c15e5f0 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b734d9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c06d7a0 con 0x7f4b6c0ce9d0 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b734d9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c06dca0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b70a74640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4b6c0ce9d0 0x7f4b6c0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71275640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4b6c15e5f0 0x7f4b6c06d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:35218/0 (socket says 172.21.15.94:35218) 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71a76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c0cf920 0x7f4b6c0d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71275640 1 -- 172.21.15.94:0/493124590 learned_addr learned my addr 172.21.15.94:0/493124590 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b63fff640 1 -- 172.21.15.94:0/493124590 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739756220 0 0) 0x7f4b6c06d9c0 con 0x7f4b6c15e5f0 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b63fff640 1 -- 172.21.15.94:0/493124590 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b58003530 con 0x7f4b6c15e5f0 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71a76640 1 -- 172.21.15.94:0/493124590 >> v2:172.21.15.155:3300/0 conn(0x7f4b6c0ce9d0 msgr2=0x7f4b6c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71a76640 1 --2- 172.21.15.94:0/493124590 >> v2:172.21.15.155:3300/0 conn(0x7f4b6c0ce9d0 0x7f4b6c0cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71a76640 1 -- 172.21.15.94:0/493124590 >> v1:172.21.15.155:6789/0 conn(0x7f4b6c15e5f0 legacy=0x7f4b6c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71a76640 1 -- 172.21.15.94:0/493124590 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c06df80 con 0x7f4b6c0cf920 2024-09-11T23:19:03.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.237+0000 7f4b71a76640 1 --2- 172.21.15.94:0/493124590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c0cf920 0x7f4b6c0d2b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009d90 tx=0x7f4b6401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12328df8a14387a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b63fff640 1 -- 172.21.15.94:0/493124590 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b640b2070 con 0x7f4b6c0cf920 2024-09-11T23:19:03.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b63fff640 1 -- 172.21.15.94:0/493124590 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b640a5940 con 0x7f4b6c0cf920 2024-09-11T23:19:03.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b63fff640 1 -- 172.21.15.94:0/493124590 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b640a5cf0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- 172.21.15.94:0/493124590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c0cf920 msgr2=0x7f4b6c0d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 --2- 172.21.15.94:0/493124590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c0cf920 0x7f4b6c0d2b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009d90 tx=0x7f4b6401c970 comp rx=0 tx=0).stop 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- 172.21.15.94:0/493124590 shutdown_connections 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 --2- 172.21.15.94:0/493124590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c0cf920 0x7f4b6c0d2b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 --2- 172.21.15.94:0/493124590 >> v2:172.21.15.155:3300/0 conn(0x7f4b6c0ce9d0 0x7f4b6c0cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- 172.21.15.94:0/493124590 >> 172.21.15.94:0/493124590 conn(0x7f4b6c074030 msgr2=0x7f4b6c09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- 172.21.15.94:0/493124590 shutdown_connections 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- 172.21.15.94:0/493124590 wait complete. 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 Processor -- start 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- start start 2024-09-11T23:19:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b6c0cf920 0x7f4b6c14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b6c0b8630 0x7f4b6c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c157470 0x7f4b6c157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d3c80 con 0x7f4b6c0cf920 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d3b00 con 0x7f4b6c0b8630 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c16afa0 con 0x7f4b6c157470 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b6c0cf920 0x7f4b6c14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b6c0cf920 0x7f4b6c14dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32930/0 (socket says 172.21.15.94:32930) 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 -- 172.21.15.94:0/3049440548 learned_addr learned my addr 172.21.15.94:0/3049440548 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71a76640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c157470 0x7f4b6c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b70a74640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b6c0b8630 0x7f4b6c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 -- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c157470 msgr2=0x7f4b6c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c157470 0x7f4b6c157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 -- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b6c0b8630 msgr2=0x7f4b6c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b6c0b8630 0x7f4b6c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 -- 172.21.15.94:0/3049440548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c14e2a0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b71275640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b6c0cf920 0x7f4b6c14dd60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c3c0 tx=0x7f4b6800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b61ffb640 1 -- 172.21.15.94:0/3049440548 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68017070 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b61ffb640 1 -- 172.21.15.94:0/3049440548 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b68005cf0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c0b7590 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b61ffb640 1 -- 172.21.15.94:0/3049440548 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b680072f0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.241+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c0b7b50 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.245+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c0d40e0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.245+0000 7f4b61ffb640 1 -- 172.21.15.94:0/3049440548 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b6801a070 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.245+0000 7f4b61ffb640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b500678c0 0x7f4b50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.245+0000 7f4b61ffb640 1 -- 172.21.15.94:0/3049440548 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f4b68084ed0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.245+0000 7f4b70a74640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b500678c0 0x7f4b50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.245+0000 7f4b70a74640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b500678c0 0x7f4b50069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c1580e0 tx=0x7f4b5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.249+0000 7f4b61ffb640 1 -- 172.21.15.94:0/3049440548 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b680554a0 con 0x7f4b6c0cf920 2024-09-11T23:19:03.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:03.409+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4b6c075760 con 0x7f4b6c0cf920 2024-09-11T23:19:04.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.205+0000 7f4b61ffb640 1 -- 172.21.15.94:0/3049440548 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) ==== 97+0+0 (secure 0 0 0) 0x7f4b680597a0 con 0x7f4b6c0cf920 2024-09-11T23:19:04.207 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2024-09-11T23:19:04.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b500678c0 msgr2=0x7f4b50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b500678c0 0x7f4b50069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c1580e0 tx=0x7f4b5c008040 comp rx=0 tx=0).stop 2024-09-11T23:19:04.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b6c0cf920 msgr2=0x7f4b6c14dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b6c0cf920 0x7f4b6c14dd60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c3c0 tx=0x7f4b6800c880 comp rx=0 tx=0).stop 2024-09-11T23:19:04.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 shutdown_connections 2024-09-11T23:19:04.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b6c157470 0x7f4b6c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b6c0b8630 0x7f4b6c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4b500678c0 0x7f4b50069d80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 --2- 172.21.15.94:0/3049440548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b6c0cf920 0x7f4b6c14dd60 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 >> 172.21.15.94:0/3049440548 conn(0x7f4b6c0ce9d0 msgr2=0x7f4b6c15b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 shutdown_connections 2024-09-11T23:19:04.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.209+0000 7f4b734d9640 1 -- 172.21.15.94:0/3049440548 wait complete. 2024-09-11T23:19:04.231 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:19:04.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb38cfd640 1 Processor -- start 2024-09-11T23:19:04.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb38cfd640 1 -- start start 2024-09-11T23:19:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb38cfd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdb3415c2a0 0x7fdb340aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb38cfd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb340b3290 con 0x7fdb340af2a0 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb38cfd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb340b3570 con 0x7fdb3415bec0 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb38cfd640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fdb340b3850 con 0x7fdb3415c2a0 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb32d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdb340af2a0 0x7fdb3406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60338/0 (socket says 172.21.15.94:60338) 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb32d9d640 1 -- 172.21.15.94:0/296686326 learned_addr learned my addr 172.21.15.94:0/296686326 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb29d9b640 1 --2- 172.21.15.94:0/296686326 >> v2:172.21.15.94:3300/0 conn(0x7fdb3415c2a0 0x7fdb340aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb31d9b640 1 -- 172.21.15.94:0/296686326 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034421857 0 0) 0x7fdb340b3290 con 0x7fdb340af2a0 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb31d9b640 1 -- 172.21.15.94:0/296686326 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb20003530 con 0x7fdb340af2a0 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb29d9b640 1 -- 172.21.15.94:0/296686326 >> v1:172.21.15.155:6789/0 conn(0x7fdb3415bec0 legacy=0x7fdb340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb29d9b640 1 -- 172.21.15.94:0/296686326 >> v1:172.21.15.94:6789/0 conn(0x7fdb340af2a0 legacy=0x7fdb3406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.349+0000 7fdb29d9b640 1 -- 172.21.15.94:0/296686326 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb340b3b30 con 0x7fdb3415c2a0 2024-09-11T23:19:04.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb29d9b640 1 --2- 172.21.15.94:0/296686326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb3415c2a0 0x7fdb340aed60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0097c0 tx=0x7fdb1c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a431ff090ea4bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb31d9b640 1 -- 172.21.15.94:0/296686326 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0a7070 con 0x7fdb3415c2a0 2024-09-11T23:19:04.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb31d9b640 1 -- 172.21.15.94:0/296686326 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0b0070 con 0x7fdb3415c2a0 2024-09-11T23:19:04.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb31d9b640 1 -- 172.21.15.94:0/296686326 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0ab890 con 0x7fdb3415c2a0 2024-09-11T23:19:04.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- 172.21.15.94:0/296686326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb3415c2a0 msgr2=0x7fdb340aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/296686326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb3415c2a0 0x7fdb340aed60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0097c0 tx=0x7fdb1c01c470 comp rx=0 tx=0).stop 2024-09-11T23:19:04.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- 172.21.15.94:0/296686326 shutdown_connections 2024-09-11T23:19:04.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/296686326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb3415c2a0 0x7fdb340aed60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- 172.21.15.94:0/296686326 >> 172.21.15.94:0/296686326 conn(0x7fdb340b1f90 msgr2=0x7fdb340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- 172.21.15.94:0/296686326 shutdown_connections 2024-09-11T23:19:04.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- 172.21.15.94:0/296686326 wait complete. 2024-09-11T23:19:04.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 Processor -- start 2024-09-11T23:19:04.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- start start 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb340af2a0 0x7fdb3409a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb3415bec0 0x7fdb34155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb3415c2a0 0x7fdb3414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3406ef20 con 0x7fdb340af2a0 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340af6b0 con 0x7fdb3415bec0 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb38cfd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3406f0a0 con 0x7fdb3415c2a0 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb340af2a0 0x7fdb3409a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb340af2a0 0x7fdb3409a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32946/0 (socket says 172.21.15.94:32946) 2024-09-11T23:19:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 -- 172.21.15.94:0/3085676348 learned_addr learned my addr 172.21.15.94:0/3085676348 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:04.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb29d9b640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb3415bec0 0x7fdb34155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb32d9d640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb3415c2a0 0x7fdb3414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 -- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb3415c2a0 msgr2=0x7fdb3414a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb3415c2a0 0x7fdb3414a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 -- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb3415bec0 msgr2=0x7fdb34155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb3415bec0 0x7fdb34155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.353+0000 7fdb3259c640 1 -- 172.21.15.94:0/3085676348 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb34068e50 con 0x7fdb340af2a0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb3259c640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb340af2a0 0x7fdb3409a280 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c530 tx=0x7fdb2400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb2b7fe640 1 -- 172.21.15.94:0/3085676348 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24016020 con 0x7fdb340af2a0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb2b7fe640 1 -- 172.21.15.94:0/3085676348 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb24005220 con 0x7fdb340af2a0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3414ae40 con 0x7fdb340af2a0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb2b7fe640 1 -- 172.21.15.94:0/3085676348 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24007030 con 0x7fdb340af2a0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb34152c40 con 0x7fdb340af2a0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb340aed60 con 0x7fdb340af2a0 2024-09-11T23:19:04.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb2b7fe640 1 -- 172.21.15.94:0/3085676348 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb240071d0 con 0x7fdb340af2a0 2024-09-11T23:19:04.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb2b7fe640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb140678c0 0x7fdb14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb2b7fe640 1 -- 172.21.15.94:0/3085676348 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7fdb240853f0 con 0x7fdb340af2a0 2024-09-11T23:19:04.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb29d9b640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb140678c0 0x7fdb14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.357+0000 7fdb29d9b640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb140678c0 0x7fdb14069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0af000 tx=0x7fdb1c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.361+0000 7fdb2b7fe640 1 -- 172.21.15.94:0/3085676348 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdb24020020 con 0x7fdb340af2a0 2024-09-11T23:19:04.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.577+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdb34075470 con 0x7fdb340af2a0 2024-09-11T23:19:04.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.577+0000 7fdb2b7fe640 1 -- 172.21.15.94:0/3085676348 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fdb3414ae40 con 0x7fdb340af2a0 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg==", 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:04.579 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ==", 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ==", 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2024-09-11T23:19:04.581 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg==", 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ==", 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g==", 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow==", 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.584 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA==", 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw==", 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.585 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g==", 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA==", 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2024-09-11T23:19:04.587 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA==", 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ==", 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.588 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow r", 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw==", 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ==", 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2024-09-11T23:19:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw==", 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmAziHChAAz9c8+z77RX+g6eeV2hnBGA==", 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:19:04.591 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA==", 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg==", 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:19:04.593 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb140678c0 msgr2=0x7fdb14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb140678c0 0x7fdb14069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0af000 tx=0x7fdb1c0b6040 comp rx=0 tx=0).stop 2024-09-11T23:19:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb340af2a0 msgr2=0x7fdb3409a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb340af2a0 0x7fdb3409a280 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c530 tx=0x7fdb2400c9f0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 shutdown_connections 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb3415c2a0 0x7fdb3414a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb3415bec0 0x7fdb34155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb140678c0 0x7fdb14069d80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 --2- 172.21.15.94:0/3085676348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb340af2a0 0x7fdb3409a280 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 >> 172.21.15.94:0/3085676348 conn(0x7fdb340b1f90 msgr2=0x7fdb340b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 shutdown_connections 2024-09-11T23:19:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.581+0000 7fdb38cfd640 1 -- 172.21.15.94:0/3085676348 wait complete. 2024-09-11T23:19:04.596 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:19:04.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.701+0000 7ff18f0a5640 1 Processor -- start 2024-09-11T23:19:04.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.701+0000 7ff18f0a5640 1 -- start start 2024-09-11T23:19:04.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18f0a5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 0x7ff18806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18f0a5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff188070250 con 0x7ff18815f3a0 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18f0a5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1880aede0 con 0x7ff18806fe50 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18f0a5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff188152480 con 0x7ff1881520a0 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18d642640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff18815f3a0 0x7ff1880adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60342/0 (socket says 172.21.15.94:60342) 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18d642640 1 -- 172.21.15.94:0/1084753727 learned_addr learned my addr 172.21.15.94:0/1084753727 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644976202 0 0) 0x7ff188070250 con 0x7ff18815f3a0 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff170005740 con 0x7ff18815f3a0 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18ce41640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 0x7ff18806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2522321091 0 0) 0x7ff170005740 con 0x7ff18815f3a0 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 msgr2=0x7ff18806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 0x7ff18806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 >> v1:172.21.15.155:6789/0 conn(0x7ff18806fe50 legacy=0x7ff18815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18815fa10 con 0x7ff18815f3a0 2024-09-11T23:19:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7ff180001a00 con 0x7ff18815f3a0 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 >> v1:172.21.15.94:6789/0 conn(0x7ff18815f3a0 legacy=0x7ff1880adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 0x7ff170005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff170006230 0x7ff170006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006f60 0x7ff1700073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff17000dd70 con 0x7ff170006230 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff17000df20 con 0x7ff170006f60 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff17000e120 con 0x7ff1881520a0 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff187fff640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff170006230 0x7ff170006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18ce41640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 0x7ff170005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18d642640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006f60 0x7ff1700073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff187fff640 1 -- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 msgr2=0x7ff170005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff187fff640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1881520a0 0x7ff170005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff187fff640 1 -- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006f60 msgr2=0x7ff1700073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff187fff640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006f60 0x7ff1700073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff187fff640 1 -- 172.21.15.94:0/1084753727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff170005740 con 0x7ff170006230 2024-09-11T23:19:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff18d642640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006f60 0x7ff1700073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:04.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff187fff640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff170006230 0x7ff170006a20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff17c001750 tx=0x7ff17c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313c876eb4cd673e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0013a0 con 0x7ff170006230 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c0052f0 con 0x7ff170006230 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.705+0000 7ff1877fe640 1 -- 172.21.15.94:0/1084753727 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c003840 con 0x7ff170006230 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1084753727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff170006230 msgr2=0x7ff170006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 --2- 172.21.15.94:0/1084753727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff170006230 0x7ff170006a20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff17c001750 tx=0x7ff17c01c3e0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18d642640 1 -- 172.21.15.94:0/1084753727 reap_dead start 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1084753727 shutdown_connections 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1084753727 >> 172.21.15.94:0/1084753727 conn(0x7ff1880b1f90 msgr2=0x7ff1880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1084753727 shutdown_connections 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1084753727 wait complete. 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 Processor -- start 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- start start 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006230 0x7ff188148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff18815ddc0 0x7ff18815e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff188152480 0x7ff188152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff188073770 con 0x7ff18815ddc0 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff188073490 con 0x7ff170006230 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff188073a50 con 0x7ff188152480 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff18815ddc0 0x7ff18815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff18815ddc0 0x7ff18815e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32958/0 (socket says 172.21.15.94:32958) 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 -- 172.21.15.94:0/1222409815 learned_addr learned my addr 172.21.15.94:0/1222409815 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18ce41640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006230 0x7ff188148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 -- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff188152480 msgr2=0x7ff188152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff188152480 0x7ff188152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 -- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006230 msgr2=0x7ff188148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006230 0x7ff188148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 -- 172.21.15.94:0/1222409815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff188154d30 con 0x7ff18815ddc0 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18ce41640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006230 0x7ff188148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff187fff640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff18815ddc0 0x7ff18815e240 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff17c005040 tx=0x7ff170007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff1857fa640 1 -- 172.21.15.94:0/1222409815 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0013a0 con 0x7ff18815ddc0 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff1857fa640 1 -- 172.21.15.94:0/1222409815 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c0bb070 con 0x7ff18815ddc0 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff1857fa640 1 -- 172.21.15.94:0/1222409815 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007a40 con 0x7ff18815ddc0 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff188154490 con 0x7ff18815ddc0 2024-09-11T23:19:04.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.709+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff188154a50 con 0x7ff18815ddc0 2024-09-11T23:19:04.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.713+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff188073d30 con 0x7ff18815ddc0 2024-09-11T23:19:04.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.713+0000 7ff1857fa640 1 -- 172.21.15.94:0/1222409815 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff17c0b4040 con 0x7ff18815ddc0 2024-09-11T23:19:04.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.713+0000 7ff1857fa640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1740678f0 0x7ff174069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.713+0000 7ff1857fa640 1 -- 172.21.15.94:0/1222409815 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7ff17c11fab0 con 0x7ff18815ddc0 2024-09-11T23:19:04.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.713+0000 7ff18ce41640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1740678f0 0x7ff174069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.713+0000 7ff18ce41640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1740678f0 0x7ff174069db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff188155690 tx=0x7ff178008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.717+0000 7ff1857fa640 1 -- 172.21.15.94:0/1222409815 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff17c0160f0 con 0x7ff18815ddc0 2024-09-11T23:19:04.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.865+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff18815b5f0 con 0x7ff18815ddc0 2024-09-11T23:19:04.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff1857fa640 1 -- 172.21.15.94:0/1222409815 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7ff17c0f0840 con 0x7ff18815ddc0 2024-09-11T23:19:04.868 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:04.868 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:19:04.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:04.868 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:19:04.868 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:19:04.869 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:04.869 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:19:04.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1740678f0 msgr2=0x7ff174069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1740678f0 0x7ff174069db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff188155690 tx=0x7ff178008040 comp rx=0 tx=0).stop 2024-09-11T23:19:04.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff18815ddc0 msgr2=0x7ff18815e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff18815ddc0 0x7ff18815e240 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff17c005040 tx=0x7ff170007a50 comp rx=0 tx=0).stop 2024-09-11T23:19:04.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 shutdown_connections 2024-09-11T23:19:04.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff188152480 0x7ff188152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1740678f0 0x7ff174069db0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff18815ddc0 0x7ff18815e240 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 --2- 172.21.15.94:0/1222409815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff170006230 0x7ff188148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 >> 172.21.15.94:0/1222409815 conn(0x7ff1880b1f90 msgr2=0x7ff1880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 shutdown_connections 2024-09-11T23:19:04.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:04.869+0000 7ff18f0a5640 1 -- 172.21.15.94:0/1222409815 wait complete. 2024-09-11T23:19:04.885 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:19:04.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:19:05.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc314b1f640 1 Processor -- start 2024-09-11T23:19:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc314b1f640 1 -- start start 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc314b1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100b38e0 0x7fc3100d4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc314b1f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc3100d4750 0x7fc31006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc314b1f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3100d2b20 con 0x7fc31015e470 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc314b1f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc3100d3bc0 con 0x7fc3100d4750 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc314b1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc3100d3730 con 0x7fc3100b38e0 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30e59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc31015e470 0x7fc3100d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60354/0 (socket says 172.21.15.94:60354) 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30e59c640 1 -- 172.21.15.94:0/428160154 learned_addr learned my addr 172.21.15.94:0/428160154 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30ed9d640 1 --2- 172.21.15.94:0/428160154 >> v2:172.21.15.94:3300/0 conn(0x7fc3100d4750 0x7fc31006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30d59a640 1 -- 172.21.15.94:0/428160154 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661265448 0 0) 0x7fc3100d2b20 con 0x7fc31015e470 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30d59a640 1 -- 172.21.15.94:0/428160154 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f0003530 con 0x7fc31015e470 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30dd9b640 1 --2- 172.21.15.94:0/428160154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100b38e0 0x7fc3100d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30d59a640 1 -- 172.21.15.94:0/428160154 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 849275936 0 0) 0x7fc2f0003530 con 0x7fc31015e470 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30ed9d640 1 -- 172.21.15.94:0/428160154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100b38e0 msgr2=0x7fc3100d4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30ed9d640 1 --2- 172.21.15.94:0/428160154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100b38e0 0x7fc3100d4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30ed9d640 1 -- 172.21.15.94:0/428160154 >> v1:172.21.15.94:6789/0 conn(0x7fc31015e470 legacy=0x7fc3100d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.009+0000 7fc30ed9d640 1 -- 172.21.15.94:0/428160154 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3100d2e00 con 0x7fc3100d4750 2024-09-11T23:19:05.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc30ed9d640 1 --2- 172.21.15.94:0/428160154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3100d4750 0x7fc31006d1b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097c0 tx=0x7fc30001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cc9a4bb61be225 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc30d59a640 1 -- 172.21.15.94:0/428160154 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3000b0070 con 0x7fc3100d4750 2024-09-11T23:19:05.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc30d59a640 1 -- 172.21.15.94:0/428160154 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3000ab400 con 0x7fc3100d4750 2024-09-11T23:19:05.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc30d59a640 1 -- 172.21.15.94:0/428160154 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8001680 con 0x7fc3100d4750 2024-09-11T23:19:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- 172.21.15.94:0/428160154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3100d4750 msgr2=0x7fc31006d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 --2- 172.21.15.94:0/428160154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3100d4750 0x7fc31006d1b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097c0 tx=0x7fc30001c330 comp rx=0 tx=0).stop 2024-09-11T23:19:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- 172.21.15.94:0/428160154 shutdown_connections 2024-09-11T23:19:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 --2- 172.21.15.94:0/428160154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3100d4750 0x7fc31006d1b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 --2- 172.21.15.94:0/428160154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100b38e0 0x7fc3100d4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- 172.21.15.94:0/428160154 >> 172.21.15.94:0/428160154 conn(0x7fc31009d730 msgr2=0x7fc31008bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- 172.21.15.94:0/428160154 shutdown_connections 2024-09-11T23:19:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- 172.21.15.94:0/428160154 wait complete. 2024-09-11T23:19:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 Processor -- start 2024-09-11T23:19:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- start start 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3100b38e0 0x7fc3100b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100d4750 0x7fc3100b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc31015e470 0x7fc3100b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc31006e290 con 0x7fc31015e470 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc31006e110 con 0x7fc3100b38e0 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc314b1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc31006e410 con 0x7fc3100d4750 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc30ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc31015e470 0x7fc3100b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc30ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc31015e470 0x7fc3100b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32970/0 (socket says 172.21.15.94:32970) 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.013+0000 7fc30ed9d640 1 -- 172.21.15.94:0/722023597 learned_addr learned my addr 172.21.15.94:0/722023597 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30ed9d640 1 -- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100d4750 msgr2=0x7fc3100b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30ed9d640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100d4750 0x7fc3100b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30e59c640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3100b38e0 0x7fc3100b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30ed9d640 1 -- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3100b38e0 msgr2=0x7fc3100b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30ed9d640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3100b38e0 0x7fc3100b71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30ed9d640 1 -- 172.21.15.94:0/722023597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3100b9030 con 0x7fc31015e470 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30ed9d640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc31015e470 0x7fc3100b5420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc30001a9e0 tx=0x7fc30001ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc306ffd640 1 -- 172.21.15.94:0/722023597 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3000b0050 con 0x7fc31015e470 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc306ffd640 1 -- 172.21.15.94:0/722023597 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3000bc070 con 0x7fc31015e470 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc306ffd640 1 -- 172.21.15.94:0/722023597 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3000b7850 con 0x7fc31015e470 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3100b9310 con 0x7fc31015e470 2024-09-11T23:19:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3100b98d0 con 0x7fc31015e470 2024-09-11T23:19:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3100d4210 con 0x7fc31015e470 2024-09-11T23:19:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc306ffd640 1 -- 172.21.15.94:0/722023597 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3000b79f0 con 0x7fc31015e470 2024-09-11T23:19:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc306ffd640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2f40678f0 0x7fc2f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc306ffd640 1 -- 172.21.15.94:0/722023597 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7fc30011fcf0 con 0x7fc31015e470 2024-09-11T23:19:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30e59c640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2f40678f0 0x7fc2f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.017+0000 7fc30e59c640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2f40678f0 0x7fc2f4069db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8005890 tx=0x7fc2f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.021+0000 7fc306ffd640 1 -- 172.21.15.94:0/722023597 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc300124070 con 0x7fc31015e470 2024-09-11T23:19:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.185+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc3100d2420 con 0x7fc31015e470 2024-09-11T23:19:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.513+0000 7fc306ffd640 1 -- 172.21.15.94:0/722023597 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7fc3000c5020 con 0x7fc31015e470 2024-09-11T23:19:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:19:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2f40678f0 msgr2=0x7fc2f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2f40678f0 0x7fc2f4069db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8005890 tx=0x7fc2f8009040 comp rx=0 tx=0).stop 2024-09-11T23:19:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc31015e470 msgr2=0x7fc3100b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc31015e470 0x7fc3100b5420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc30001a9e0 tx=0x7fc30001ab70 comp rx=0 tx=0).stop 2024-09-11T23:19:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 shutdown_connections 2024-09-11T23:19:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc2f40678f0 0x7fc2f4069db0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc31015e470 0x7fc3100b5420 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3100d4750 0x7fc3100b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 --2- 172.21.15.94:0/722023597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3100b38e0 0x7fc3100b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 >> 172.21.15.94:0/722023597 conn(0x7fc31009d730 msgr2=0x7fc31015d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:05.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 shutdown_connections 2024-09-11T23:19:05.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.517+0000 7fc314b1f640 1 -- 172.21.15.94:0/722023597 wait complete. 2024-09-11T23:19:05.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:19:05.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.673+0000 7f41492fa640 1 Processor -- start 2024-09-11T23:19:05.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.673+0000 7f41492fa640 1 -- start start 2024-09-11T23:19:05.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41492fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41440cc870 0x7f41440cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41492fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f41440ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41492fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41440cd190 con 0x7f41440cdfd0 2024-09-11T23:19:05.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41492fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f41440ce8d0 con 0x7f41440cc870 2024-09-11T23:19:05.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41492fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f41440cebb0 con 0x7f4144073100 2024-09-11T23:19:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41427fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f41440ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f4142ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41440cc870 0x7f41440cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41437fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f41440cdfd0 0x7f414406de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:35250/0 (socket says 172.21.15.94:35250) 2024-09-11T23:19:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41437fe640 1 -- 172.21.15.94:0/3965339387 learned_addr learned my addr 172.21.15.94:0/3965339387 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41427fc640 1 -- 172.21.15.94:0/3965339387 >> v2:172.21.15.155:3300/0 conn(0x7f41440cc870 msgr2=0x7f41440cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41427fc640 1 --2- 172.21.15.94:0/3965339387 >> v2:172.21.15.155:3300/0 conn(0x7f41440cc870 0x7f41440cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41427fc640 1 -- 172.21.15.94:0/3965339387 >> v1:172.21.15.155:6789/0 conn(0x7f41440cdfd0 legacy=0x7f414406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f41427fc640 1 -- 172.21.15.94:0/3965339387 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41440cee90 con 0x7f4144073100 2024-09-11T23:19:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.677+0000 7f4142ffd640 1 --2- 172.21.15.94:0/3965339387 >> v2:172.21.15.155:3300/0 conn(0x7f41440cc870 0x7f41440cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:05.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41427fc640 1 --2- 172.21.15.94:0/3965339387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f41440ccc50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41380097c0 tx=0x7f414406ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=954ebf7174bcd001 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f4141ffb640 1 -- 172.21.15.94:0/3965339387 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380a7070 con 0x7f4144073100 2024-09-11T23:19:05.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f4141ffb640 1 -- 172.21.15.94:0/3965339387 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41380b0070 con 0x7f4144073100 2024-09-11T23:19:05.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f4141ffb640 1 -- 172.21.15.94:0/3965339387 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380ab890 con 0x7f4144073100 2024-09-11T23:19:05.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- 172.21.15.94:0/3965339387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 msgr2=0x7f41440ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 --2- 172.21.15.94:0/3965339387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f41440ccc50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41380097c0 tx=0x7f414406ed20 comp rx=0 tx=0).stop 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- 172.21.15.94:0/3965339387 shutdown_connections 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 --2- 172.21.15.94:0/3965339387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f41440ccc50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 --2- 172.21.15.94:0/3965339387 >> v2:172.21.15.155:3300/0 conn(0x7f41440cc870 0x7f41440cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- 172.21.15.94:0/3965339387 >> 172.21.15.94:0/3965339387 conn(0x7f41440b1c80 msgr2=0x7f41440b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- 172.21.15.94:0/3965339387 shutdown_connections 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- 172.21.15.94:0/3965339387 wait complete. 2024-09-11T23:19:05.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 Processor -- start 2024-09-11T23:19:05.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- start start 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f414413d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41440cc870 0x7f41441662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41440cdfd0 0x7f41441667f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4144169310 con 0x7f41440cdfd0 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4144169190 con 0x7f41440cc870 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41492fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4144169490 con 0x7f4144073100 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41437fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41440cdfd0 0x7f41441667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41437fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41440cdfd0 0x7f41441667f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32974/0 (socket says 172.21.15.94:32974) 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41437fe640 1 -- 172.21.15.94:0/2371614947 learned_addr learned my addr 172.21.15.94:0/2371614947 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f4142ffd640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f414413d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.681+0000 7f41427fc640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41440cc870 0x7f41441662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41437fe640 1 -- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 msgr2=0x7f414413d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41437fe640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f414413d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41437fe640 1 -- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41440cc870 msgr2=0x7f41441662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41437fe640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41440cc870 0x7f41441662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41437fe640 1 -- 172.21.15.94:0/2371614947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41440adf60 con 0x7f41440cdfd0 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41437fe640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41440cdfd0 0x7f41441667f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f413c00c9f0 tx=0x7f413c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f412b7fe640 1 -- 172.21.15.94:0/2371614947 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c017070 con 0x7f41440cdfd0 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f412b7fe640 1 -- 172.21.15.94:0/2371614947 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c00ab70 con 0x7f41440cdfd0 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41441439d0 con 0x7f41440cdfd0 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f412b7fe640 1 -- 172.21.15.94:0/2371614947 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c012400 con 0x7f41440cdfd0 2024-09-11T23:19:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4144143f90 con 0x7f41440cdfd0 2024-09-11T23:19:05.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41440ae130 con 0x7f41440cdfd0 2024-09-11T23:19:05.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f412b7fe640 1 -- 172.21.15.94:0/2371614947 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f413c01a070 con 0x7f41440cdfd0 2024-09-11T23:19:05.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f412b7fe640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f41300678c0 0x7f4130069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f412b7fe640 1 -- 172.21.15.94:0/2371614947 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5619+0+0 (secure 0 0 0) 0x7f413c085780 con 0x7f41440cdfd0 2024-09-11T23:19:05.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f4142ffd640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f41300678c0 0x7f4130069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.685+0000 7f4142ffd640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f41300678c0 0x7f4130069d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4134009580 tx=0x7f4134008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.689+0000 7f412b7fe640 1 -- 172.21.15.94:0/2371614947 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f413c055cc0 con 0x7f41440cdfd0 2024-09-11T23:19:05.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:05.853+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f41440ccc50 con 0x7f41440cdfd0 2024-09-11T23:19:06.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.525+0000 7f412b7fe640 1 -- 172.21.15.94:0/2371614947 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7f413c059fc0 con 0x7f41440cdfd0 2024-09-11T23:19:06.526 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:19:06.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f41300678c0 msgr2=0x7f4130069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f41300678c0 0x7f4130069d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4134009580 tx=0x7f4134008040 comp rx=0 tx=0).stop 2024-09-11T23:19:06.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41440cdfd0 msgr2=0x7f41441667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41440cdfd0 0x7f41441667f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f413c00c9f0 tx=0x7f413c00ceb0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 shutdown_connections 2024-09-11T23:19:06.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f41300678c0 0x7f4130069d80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41440cdfd0 0x7f41441667f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41440cc870 0x7f41441662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 --2- 172.21.15.94:0/2371614947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4144073100 0x7f414413d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.529+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 >> 172.21.15.94:0/2371614947 conn(0x7f41440b1c80 msgr2=0x7f414406de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:06.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.533+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 shutdown_connections 2024-09-11T23:19:06.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.533+0000 7f41492fa640 1 -- 172.21.15.94:0/2371614947 wait complete. 2024-09-11T23:19:06.568 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:19:06.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9fa5a2e640 1 Processor -- start 2024-09-11T23:19:06.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9fa5a2e640 1 -- start start 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9fa5a2e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fa0161a60 0x7f9fa00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9fa5a2e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9fa00d2e90 0x7f9fa00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9fa5a2e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa00d32b0 con 0x7f9fa00cf450 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9fa5a2e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa00d0300 con 0x7f9fa00d2e90 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9fa5a2e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa006e6c0 con 0x7f9fa0161a60 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f967fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9fa00d2e90 0x7f9fa00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f9f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9fa00cf450 0x7f9fa00d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60356/0 (socket says 172.21.15.94:60356) 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f9f7fe640 1 -- 172.21.15.94:0/2202644581 learned_addr learned my addr 172.21.15.94:0/2202644581 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f9effd640 1 --2- 172.21.15.94:0/2202644581 >> v2:172.21.15.155:3300/0 conn(0x7f9fa0161a60 0x7f9fa00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f967fc640 1 -- 172.21.15.94:0/2202644581 >> v2:172.21.15.155:3300/0 conn(0x7f9fa0161a60 msgr2=0x7f9fa00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f967fc640 1 --2- 172.21.15.94:0/2202644581 >> v2:172.21.15.155:3300/0 conn(0x7f9fa0161a60 0x7f9fa00d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f967fc640 1 -- 172.21.15.94:0/2202644581 >> v1:172.21.15.94:6789/0 conn(0x7f9fa00cf450 legacy=0x7f9fa00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.689+0000 7f9f967fc640 1 -- 172.21.15.94:0/2202644581 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa00b0f60 con 0x7f9fa00d2e90 2024-09-11T23:19:06.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 --2- 172.21.15.94:0/2202644581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa00cef10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9fa008e010 tx=0x7f9f8801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474bb7825acbe14e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f9e7fc640 1 -- 172.21.15.94:0/2202644581 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f880b1070 con 0x7f9fa00d2e90 2024-09-11T23:19:06.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f9e7fc640 1 -- 172.21.15.94:0/2202644581 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880ac620 con 0x7f9fa00d2e90 2024-09-11T23:19:06.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f9e7fc640 1 -- 172.21.15.94:0/2202644581 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00d1930 con 0x7f9fa00d2e90 2024-09-11T23:19:06.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2202644581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 msgr2=0x7f9fa00cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2202644581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa00cef10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9fa008e010 tx=0x7f9f8801c3c0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2202644581 shutdown_connections 2024-09-11T23:19:06.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2202644581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa00cef10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2202644581 >> v2:172.21.15.155:3300/0 conn(0x7f9fa0161a60 0x7f9fa00d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2202644581 >> 172.21.15.94:0/2202644581 conn(0x7f9fa008bf90 msgr2=0x7f9fa009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:06.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2202644581 shutdown_connections 2024-09-11T23:19:06.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2202644581 wait complete. 2024-09-11T23:19:06.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 Processor -- start 2024-09-11T23:19:06.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- start start 2024-09-11T23:19:06.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00cf450 0x7f9fa00cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0161a60 0x7f9fa0157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa016af20 con 0x7f9fa00d2e90 2024-09-11T23:19:06.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa006d190 con 0x7f9fa0161a60 2024-09-11T23:19:06.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa016b0a0 con 0x7f9fa00cf450 2024-09-11T23:19:06.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa015bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32988/0 (socket says 172.21.15.94:32988) 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 -- 172.21.15.94:0/2138873148 learned_addr learned my addr 172.21.15.94:0/2138873148 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f9effd640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00cf450 0x7f9fa00cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 -- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00cf450 msgr2=0x7f9fa00cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00cf450 0x7f9fa00cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 -- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0161a60 msgr2=0x7f9fa0157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0161a60 0x7f9fa0157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 -- 172.21.15.94:0/2138873148 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa01596e0 con 0x7f9fa00d2e90 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f967fc640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa015bfd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f880af040 tx=0x7f9f88019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f9cff9640 1 -- 172.21.15.94:0/2138873148 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f880b9020 con 0x7f9fa00d2e90 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f9cff9640 1 -- 172.21.15.94:0/2138873148 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880b5630 con 0x7f9fa00d2e90 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9f9cff9640 1 -- 172.21.15.94:0/2138873148 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f880b1040 con 0x7f9fa00d2e90 2024-09-11T23:19:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.693+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa00cb940 con 0x7f9fa00d2e90 2024-09-11T23:19:06.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.697+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa00b12d0 con 0x7f9fa00d2e90 2024-09-11T23:19:06.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.697+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa00cef10 con 0x7f9fa00d2e90 2024-09-11T23:19:06.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.697+0000 7f9f9cff9640 1 -- 172.21.15.94:0/2138873148 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f880bc020 con 0x7f9fa00d2e90 2024-09-11T23:19:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.697+0000 7f9f9cff9640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9f800678c0 0x7f9f80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.697+0000 7f9f9cff9640 1 -- 172.21.15.94:0/2138873148 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6001+0+0 (secure 0 0 0) 0x7f9f8811fb00 con 0x7f9fa00d2e90 2024-09-11T23:19:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.697+0000 7f9f9effd640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9f800678c0 0x7f9f80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.697+0000 7f9f9effd640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9f800678c0 0x7f9f80069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f900096f0 tx=0x7f9f90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.701+0000 7f9f9cff9640 1 -- 172.21.15.94:0/2138873148 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9f880c3030 con 0x7f9fa00d2e90 2024-09-11T23:19:06.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:06.897+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9fa009d8a0 con 0x7f9fa00d2e90 2024-09-11T23:19:07.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.529+0000 7f9f9cff9640 1 -- 172.21.15.94:0/2138873148 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v45) ==== 174+0+0 (secure 0 0 0) 0x7f9f88016070 con 0x7f9fa00d2e90 2024-09-11T23:19:07.528 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 13 and data pool 14 2024-09-11T23:19:07.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9f800678c0 msgr2=0x7f9f80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9f800678c0 0x7f9f80069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f900096f0 tx=0x7f9f90008040 comp rx=0 tx=0).stop 2024-09-11T23:19:07.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 msgr2=0x7f9fa015bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa015bfd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f880af040 tx=0x7f9f88019160 comp rx=0 tx=0).stop 2024-09-11T23:19:07.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 shutdown_connections 2024-09-11T23:19:07.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0161a60 0x7f9fa0157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9f800678c0 0x7f9f80069d80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fa00d2e90 0x7f9fa015bfd0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 --2- 172.21.15.94:0/2138873148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00cf450 0x7f9fa00cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 >> 172.21.15.94:0/2138873148 conn(0x7f9fa008bf90 msgr2=0x7f9fa00b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:07.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 shutdown_connections 2024-09-11T23:19:07.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.533+0000 7f9fa5a2e640 1 -- 172.21.15.94:0/2138873148 wait complete. 2024-09-11T23:19:07.559 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:07.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.677+0000 7f0dc8927640 1 Processor -- start 2024-09-11T23:19:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.677+0000 7f0dc8927640 1 -- start start 2024-09-11T23:19:07.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc8927640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0dc4073e60 0x7f0dc406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc8927640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0dc40b3d50 0x7f0dc40b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc8927640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc40b4670 con 0x7f0dc406fef0 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc8927640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc406ee50 con 0x7f0dc40b3d50 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc8927640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc406f130 con 0x7f0dc4073e60 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0db9d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0dc406fef0 0x7f0dc415b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60360/0 (socket says 172.21.15.94:60360) 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0db9d9b640 1 -- 172.21.15.94:0/849880440 learned_addr learned my addr 172.21.15.94:0/849880440 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc2d9d640 1 --2- 172.21.15.94:0/849880440 >> v2:172.21.15.94:3300/0 conn(0x7f0dc40b3d50 0x7f0dc40b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc259c640 1 --2- 172.21.15.94:0/849880440 >> v2:172.21.15.155:3300/0 conn(0x7f0dc4073e60 0x7f0dc406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc1d9b640 1 -- 172.21.15.94:0/849880440 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794160046 0 0) 0x7f0dc40b4670 con 0x7f0dc406fef0 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc1d9b640 1 -- 172.21.15.94:0/849880440 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0db0003530 con 0x7f0dc406fef0 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc2d9d640 1 -- 172.21.15.94:0/849880440 >> v2:172.21.15.155:3300/0 conn(0x7f0dc4073e60 msgr2=0x7f0dc406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc2d9d640 1 --2- 172.21.15.94:0/849880440 >> v2:172.21.15.155:3300/0 conn(0x7f0dc4073e60 0x7f0dc406e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc2d9d640 1 -- 172.21.15.94:0/849880440 >> v1:172.21.15.94:6789/0 conn(0x7f0dc406fef0 legacy=0x7f0dc415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc2d9d640 1 -- 172.21.15.94:0/849880440 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc406f410 con 0x7f0dc40b3d50 2024-09-11T23:19:07.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc2d9d640 1 --2- 172.21.15.94:0/849880440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc40b3d50 0x7f0dc40b4130 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4070340 tx=0x7f0dbc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41da2df9aed2f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc1d9b640 1 -- 172.21.15.94:0/849880440 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b2070 con 0x7f0dc40b3d50 2024-09-11T23:19:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc1d9b640 1 -- 172.21.15.94:0/849880440 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0a5770 con 0x7f0dc40b3d50 2024-09-11T23:19:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.681+0000 7f0dc1d9b640 1 -- 172.21.15.94:0/849880440 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0a5b20 con 0x7f0dc40b3d50 2024-09-11T23:19:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- 172.21.15.94:0/849880440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc40b3d50 msgr2=0x7f0dc40b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 --2- 172.21.15.94:0/849880440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc40b3d50 0x7f0dc40b4130 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4070340 tx=0x7f0dbc01c8a0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- 172.21.15.94:0/849880440 shutdown_connections 2024-09-11T23:19:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 --2- 172.21.15.94:0/849880440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc40b3d50 0x7f0dc40b4130 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 --2- 172.21.15.94:0/849880440 >> v2:172.21.15.155:3300/0 conn(0x7f0dc4073e60 0x7f0dc406e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- 172.21.15.94:0/849880440 >> 172.21.15.94:0/849880440 conn(0x7f0dc40b1f90 msgr2=0x7f0dc40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- 172.21.15.94:0/849880440 shutdown_connections 2024-09-11T23:19:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- 172.21.15.94:0/849880440 wait complete. 2024-09-11T23:19:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 Processor -- start 2024-09-11T23:19:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- start start 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc406fef0 0x7f0dc40b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc4073e60 0x7f0dc41503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc40b3d50 0x7f0dc415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc40729a0 con 0x7f0dc4073e60 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4072820 con 0x7f0dc406fef0 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc4072b20 con 0x7f0dc40b3d50 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc4073e60 0x7f0dc41503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc4073e60 0x7f0dc41503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32998/0 (socket says 172.21.15.94:32998) 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 -- 172.21.15.94:0/295071524 learned_addr learned my addr 172.21.15.94:0/295071524 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 -- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc40b3d50 msgr2=0x7f0dc415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc40b3d50 0x7f0dc415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 -- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc406fef0 msgr2=0x7f0dc40b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc406fef0 0x7f0dc40b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 -- 172.21.15.94:0/295071524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc41542d0 con 0x7f0dc4073e60 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0db9d9b640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc4073e60 0x7f0dc41503e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c390 tx=0x7f0dac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dbb7fe640 1 -- 172.21.15.94:0/295071524 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac017070 con 0x7f0dc4073e60 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dbb7fe640 1 -- 172.21.15.94:0/295071524 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac005d10 con 0x7f0dc4073e60 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc4155fd0 con 0x7f0dc4073e60 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dbb7fe640 1 -- 172.21.15.94:0/295071524 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac007310 con 0x7f0dc4073e60 2024-09-11T23:19:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.685+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc4156590 con 0x7f0dc4073e60 2024-09-11T23:19:07.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.689+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc406e800 con 0x7f0dc4073e60 2024-09-11T23:19:07.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.689+0000 7f0dbb7fe640 1 -- 172.21.15.94:0/295071524 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0dac01a070 con 0x7f0dc4073e60 2024-09-11T23:19:07.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.689+0000 7f0dbb7fe640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0da40678f0 0x7f0da4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.689+0000 7f0dbb7fe640 1 -- 172.21.15.94:0/295071524 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f0dac085160 con 0x7f0dc4073e60 2024-09-11T23:19:07.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.689+0000 7f0dc259c640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0da40678f0 0x7f0da4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.689+0000 7f0dc259c640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0da40678f0 0x7f0da4069db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0db40098f0 tx=0x7f0db4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.693+0000 7f0dbb7fe640 1 -- 172.21.15.94:0/295071524 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0dac055c60 con 0x7f0dc4073e60 2024-09-11T23:19:07.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.857+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0dc40723f0 con 0x7f0dc4073e60 2024-09-11T23:19:07.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dbb7fe640 1 -- 172.21.15.94:0/295071524 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16982 (secure 0 0 0) 0x7f0dac055560 con 0x7f0dc4073e60 2024-09-11T23:19:07.861 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:07.861 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":85,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:06.902293+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:05.228050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:05.892122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0da40678f0 msgr2=0x7f0da4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0da40678f0 0x7f0da4069db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0db40098f0 tx=0x7f0db4008040 comp rx=0 tx=0).stop 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc4073e60 msgr2=0x7f0dc41503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc4073e60 0x7f0dc41503e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c390 tx=0x7f0dac00c850 comp rx=0 tx=0).stop 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 shutdown_connections 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc40b3d50 0x7f0dc415d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0da40678f0 0x7f0da4069db0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc4073e60 0x7f0dc41503e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 --2- 172.21.15.94:0/295071524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc406fef0 0x7f0dc40b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 >> 172.21.15.94:0/295071524 conn(0x7f0dc40b1f90 msgr2=0x7f0dc40b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:07.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 shutdown_connections 2024-09-11T23:19:07.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:07.861+0000 7f0dc8927640 1 -- 172.21.15.94:0/295071524 wait complete. 2024-09-11T23:19:07.880 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb3357640 1 Processor -- start 2024-09-11T23:19:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb3357640 1 -- start start 2024-09-11T23:19:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb3357640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac06f010 0x7f2fac166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb3357640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fac0b3290 con 0x7f2fac15bec0 2024-09-11T23:19:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb3357640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fac0b3570 con 0x7f2fac15c2a0 2024-09-11T23:19:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb3357640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2fac0b3850 con 0x7f2fac06f010 2024-09-11T23:19:08.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb10f3640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2fac15bec0 0x7f2fac0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60366/0 (socket says 172.21.15.94:60366) 2024-09-11T23:19:08.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb10f3640 1 -- 172.21.15.94:0/130495202 learned_addr learned my addr 172.21.15.94:0/130495202 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:08.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fb18f4640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac06f010 0x7f2fac166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949440281 0 0) 0x7f2fac0b3290 con 0x7f2fac15bec0 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.001+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f98003530 con 0x7f2fac15bec0 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3296887178 0 0) 0x7f2f98003530 con 0x7f2fac15bec0 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac06f010 msgr2=0x7f2fac166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac06f010 0x7f2fac166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 >> v1:172.21.15.155:6789/0 conn(0x7f2fac15c2a0 legacy=0x7f2fac0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac0b3b30 con 0x7f2fac15bec0 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f2fa4001680 con 0x7f2fac15bec0 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 >> v1:172.21.15.94:6789/0 conn(0x7f2fac15bec0 legacy=0x7f2fac0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2f98003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac06f010 0x7f2f98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f98004d50 0x7f2f980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac0b3850 con 0x7f2f980039f0 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9800ba80 con 0x7f2f98004d50 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9800bc80 con 0x7f2fac06f010 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb10f3640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2f98003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb18f4640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f98004d50 0x7f2f980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb10f3640 1 -- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac06f010 msgr2=0x7f2f98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb10f3640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac06f010 0x7f2f98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb10f3640 1 -- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f98004d50 msgr2=0x7f2f980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb10f3640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f98004d50 0x7f2f980051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb10f3640 1 -- 172.21.15.94:0/130495202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f98003530 con 0x7f2f980039f0 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb10f3640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2f98003e10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c190 tx=0x7f2fa401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2c5aaa773b392d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4007d00 con 0x7f2f980039f0 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa40a9020 con 0x7f2f980039f0 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fa3fff640 1 -- 172.21.15.94:0/130495202 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4005ae0 con 0x7f2f980039f0 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb3357640 1 -- 172.21.15.94:0/130495202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 msgr2=0x7f2f98003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb3357640 1 --2- 172.21.15.94:0/130495202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2f98003e10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c190 tx=0x7f2fa401cc10 comp rx=0 tx=0).stop 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb18f4640 1 -- 172.21.15.94:0/130495202 reap_dead start 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb3357640 1 -- 172.21.15.94:0/130495202 shutdown_connections 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb3357640 1 -- 172.21.15.94:0/130495202 >> 172.21.15.94:0/130495202 conn(0x7f2fac0b1f90 msgr2=0x7f2fac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb3357640 1 -- 172.21.15.94:0/130495202 shutdown_connections 2024-09-11T23:19:08.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.005+0000 7f2fb3357640 1 -- 172.21.15.94:0/130495202 wait complete. 2024-09-11T23:19:08.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 Processor -- start 2024-09-11T23:19:08.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 -- start start 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2fac15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac15b4c0 0x7f2fac14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fac14f7a0 0x7f2fac14fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac167980 con 0x7f2f980039f0 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac167800 con 0x7f2fac14f7a0 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2fac167b00 con 0x7f2fac15b4c0 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2fac15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2fac15af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33016/0 (socket says 172.21.15.94:33016) 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 -- 172.21.15.94:0/3427518603 learned_addr learned my addr 172.21.15.94:0/3427518603 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:08.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb08f2640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac15b4c0 0x7f2fac14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb18f4640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fac14f7a0 0x7f2fac14fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 -- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac15b4c0 msgr2=0x7f2fac14f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac15b4c0 0x7f2fac14f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 -- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fac14f7a0 msgr2=0x7f2fac14fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fac14f7a0 0x7f2fac14fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 -- 172.21.15.94:0/3427518603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac09d2b0 con 0x7f2f980039f0 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb08f2640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac15b4c0 0x7f2fac14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb18f4640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fac14f7a0 0x7f2fac14fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb10f3640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2fac15af80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2fa401ca40 tx=0x7f2f98005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fa1ffb640 1 -- 172.21.15.94:0/3427518603 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40a5a00 con 0x7f2f980039f0 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fa1ffb640 1 -- 172.21.15.94:0/3427518603 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa40a5ba0 con 0x7f2f980039f0 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fac09d590 con 0x7f2f980039f0 2024-09-11T23:19:08.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fa1ffb640 1 -- 172.21.15.94:0/3427518603 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40047f0 con 0x7f2f980039f0 2024-09-11T23:19:08.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fac09db50 con 0x7f2f980039f0 2024-09-11T23:19:08.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fac0ad200 con 0x7f2f980039f0 2024-09-11T23:19:08.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.009+0000 7f2fa1ffb640 1 -- 172.21.15.94:0/3427518603 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fa4004990 con 0x7f2f980039f0 2024-09-11T23:19:08.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.013+0000 7f2fa1ffb640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f900678f0 0x7f2f90069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.013+0000 7f2fa1ffb640 1 -- 172.21.15.94:0/3427518603 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f2fa411f570 con 0x7f2f980039f0 2024-09-11T23:19:08.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.013+0000 7f2fb08f2640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f900678f0 0x7f2f90069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.013+0000 7f2fb08f2640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f900678f0 0x7f2f90069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2fac1502c0 tx=0x7f2f9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.017+0000 7f2fa1ffb640 1 -- 172.21.15.94:0/3427518603 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fa4016950 con 0x7f2f980039f0 2024-09-11T23:19:08.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.177+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fac15b8a0 con 0x7f2f980039f0 2024-09-11T23:19:08.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.181+0000 7f2fa1ffb640 1 -- 172.21.15.94:0/3427518603 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16982 (secure 0 0 0) 0x7f2fa40b73a0 con 0x7f2f980039f0 2024-09-11T23:19:08.183 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:08.183 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":85,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:06.902293+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:05.228050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:05.892122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:08.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f900678f0 msgr2=0x7f2f90069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f900678f0 0x7f2f90069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2fac1502c0 tx=0x7f2f9c009040 comp rx=0 tx=0).stop 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 msgr2=0x7f2fac15af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2fac15af80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2fa401ca40 tx=0x7f2f98005840 comp rx=0 tx=0).stop 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 shutdown_connections 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fac14f7a0 0x7f2fac14fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fac15b4c0 0x7f2fac14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f900678f0 0x7f2f90069db0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 --2- 172.21.15.94:0/3427518603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f980039f0 0x7f2fac15af80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 >> 172.21.15.94:0/3427518603 conn(0x7f2fac0b1f90 msgr2=0x7f2fac0b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 shutdown_connections 2024-09-11T23:19:08.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.185+0000 7f2fb3357640 1 -- 172.21.15.94:0/3427518603 wait complete. 2024-09-11T23:19:08.203 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:19:08.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.321+0000 7f7c1bd65640 1 Processor -- start 2024-09-11T23:19:08.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.321+0000 7f7c1bd65640 1 -- start start 2024-09-11T23:19:08.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c1bd65640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c1415bec0 0x7f7c140ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c1bd65640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415c2a0 0x7f7c140aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c1bd65640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c140b3290 con 0x7f7c140af2a0 2024-09-11T23:19:08.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c1bd65640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7c140b3570 con 0x7f7c1415bec0 2024-09-11T23:19:08.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c1bd65640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c140b3850 con 0x7f7c1415c2a0 2024-09-11T23:19:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c19300640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415c2a0 0x7f7c140aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c19b01640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c1415bec0 0x7f7c140ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c1a302640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7c140af2a0 0x7f7c1415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:35270/0 (socket says 172.21.15.94:35270) 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c1a302640 1 -- 172.21.15.94:0/1028652968 learned_addr learned my addr 172.21.15.94:0/1028652968 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c19300640 1 -- 172.21.15.94:0/1028652968 >> v2:172.21.15.155:3300/0 conn(0x7f7c1415bec0 msgr2=0x7f7c140ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c19300640 1 --2- 172.21.15.94:0/1028652968 >> v2:172.21.15.155:3300/0 conn(0x7f7c1415bec0 0x7f7c140ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c19300640 1 -- 172.21.15.94:0/1028652968 >> v1:172.21.15.155:6789/0 conn(0x7f7c140af2a0 legacy=0x7f7c1415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c19300640 1 -- 172.21.15.94:0/1028652968 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c140b3b30 con 0x7f7c1415c2a0 2024-09-11T23:19:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.325+0000 7f7c19b01640 1 --2- 172.21.15.94:0/1028652968 >> v2:172.21.15.155:3300/0 conn(0x7f7c1415bec0 0x7f7c140ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:08.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c19300640 1 --2- 172.21.15.94:0/1028652968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415c2a0 0x7f7c140aed60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009d90 tx=0x7f7c1001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e75a1d11fd072f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c18aff640 1 -- 172.21.15.94:0/1028652968 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c100b2070 con 0x7f7c1415c2a0 2024-09-11T23:19:08.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c18aff640 1 -- 172.21.15.94:0/1028652968 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c100a5a00 con 0x7f7c1415c2a0 2024-09-11T23:19:08.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c18aff640 1 -- 172.21.15.94:0/1028652968 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c100a5dd0 con 0x7f7c1415c2a0 2024-09-11T23:19:08.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1028652968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415c2a0 msgr2=0x7f7c140aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1028652968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415c2a0 0x7f7c140aed60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009d90 tx=0x7f7c1001c940 comp rx=0 tx=0).stop 2024-09-11T23:19:08.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1028652968 shutdown_connections 2024-09-11T23:19:08.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1028652968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415c2a0 0x7f7c140aed60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1028652968 >> v2:172.21.15.155:3300/0 conn(0x7f7c1415bec0 0x7f7c140ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1028652968 >> 172.21.15.94:0/1028652968 conn(0x7f7c140b1f90 msgr2=0x7f7c140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1028652968 shutdown_connections 2024-09-11T23:19:08.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1028652968 wait complete. 2024-09-11T23:19:08.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 Processor -- start 2024-09-11T23:19:08.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- start start 2024-09-11T23:19:08.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c140af2a0 0x7f7c1415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415bec0 0x7f7c141543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c1415c2a0 0x7f7c14154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7c140af6b0 con 0x7f7c1415c2a0 2024-09-11T23:19:08.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c140ad740 con 0x7f7c140af2a0 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1bd65640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c14169000 con 0x7f7c1415bec0 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.329+0000 7f7c1a302640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c1415c2a0 0x7f7c14154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c1415c2a0 0x7f7c14154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33028/0 (socket says 172.21.15.94:33028) 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 -- 172.21.15.94:0/1624494042 learned_addr learned my addr 172.21.15.94:0/1624494042 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c19b01640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c140af2a0 0x7f7c1415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c19300640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415bec0 0x7f7c141543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 -- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415bec0 msgr2=0x7f7c141543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415bec0 0x7f7c141543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 -- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c140af2a0 msgr2=0x7f7c1415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c140af2a0 0x7f7c1415b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 -- 172.21.15.94:0/1624494042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1415d880 con 0x7f7c1415c2a0 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1a302640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c1415c2a0 0x7f7c14154920 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c430 tx=0x7f7c0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c0a7fc640 1 -- 172.21.15.94:0/1624494042 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c017070 con 0x7f7c1415c2a0 2024-09-11T23:19:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c0a7fc640 1 -- 172.21.15.94:0/1624494042 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c005cf0 con 0x7f7c1415c2a0 2024-09-11T23:19:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1415db60 con 0x7f7c1415c2a0 2024-09-11T23:19:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c0a7fc640 1 -- 172.21.15.94:0/1624494042 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0072d0 con 0x7f7c1415c2a0 2024-09-11T23:19:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1415a970 con 0x7f7c1415c2a0 2024-09-11T23:19:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c140ad200 con 0x7f7c1415c2a0 2024-09-11T23:19:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c0a7fc640 1 -- 172.21.15.94:0/1624494042 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c0c01a070 con 0x7f7c1415c2a0 2024-09-11T23:19:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c0a7fc640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7bf80678c0 0x7f7bf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c0a7fc640 1 -- 172.21.15.94:0/1624494042 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f7c0c085150 con 0x7f7c1415c2a0 2024-09-11T23:19:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c19b01640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7bf80678c0 0x7f7bf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.333+0000 7f7c19b01640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7bf80678c0 0x7f7bf8069d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009580 tx=0x7f7c04009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.337+0000 7f7c0a7fc640 1 -- 172.21.15.94:0/1624494042 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7c0c055410 con 0x7f7c1415c2a0 2024-09-11T23:19:08.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:08.537+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7c1406fcd0 con 0x7f7c1415c2a0 2024-09-11T23:19:09.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.545+0000 7f7c0a7fc640 1 -- 172.21.15.94:0/1624494042 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) ==== 118+0+0 (secure 0 0 0) 0x7f7c0c059710 con 0x7f7c1415c2a0 2024-09-11T23:19:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7bf80678c0 msgr2=0x7f7bf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7bf80678c0 0x7f7bf8069d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009580 tx=0x7f7c04009190 comp rx=0 tx=0).stop 2024-09-11T23:19:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c1415c2a0 msgr2=0x7f7c14154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c1415c2a0 0x7f7c14154920 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c430 tx=0x7f7c0c00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 shutdown_connections 2024-09-11T23:19:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7bf80678c0 0x7f7bf8069d80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c1415c2a0 0x7f7c14154920 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c1415bec0 0x7f7c141543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 --2- 172.21.15.94:0/1624494042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c140af2a0 0x7f7c1415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 >> 172.21.15.94:0/1624494042 conn(0x7f7c140b1f90 msgr2=0x7f7c14165fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 shutdown_connections 2024-09-11T23:19:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.549+0000 7f7c1bd65640 1 -- 172.21.15.94:0/1624494042 wait complete. 2024-09-11T23:19:09.571 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:19:09.572 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:19:09.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.701+0000 7f31a9d56640 1 Processor -- start 2024-09-11T23:19:09.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.701+0000 7f31a9d56640 1 -- start start 2024-09-11T23:19:09.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a9d56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f31a4073170 0x7f31a406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a9d56640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a406ec60 con 0x7f31a41587a0 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a9d56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a406ef40 con 0x7f31a40b39a0 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a9d56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f31a406f870 con 0x7f31a4073170 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a37fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f31a41587a0 0x7f31a40b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60376/0 (socket says 172.21.15.94:60376) 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a37fe640 1 -- 172.21.15.94:0/1886324459 learned_addr learned my addr 172.21.15.94:0/1886324459 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a3fff640 1 --2- 172.21.15.94:0/1886324459 >> v2:172.21.15.155:3300/0 conn(0x7f31a4073170 0x7f31a406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990457033 0 0) 0x7f31a406ec60 con 0x7f31a41587a0 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f318c003530 con 0x7f31a41587a0 2024-09-11T23:19:09.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4100292697 0 0) 0x7f318c003530 con 0x7f31a41587a0 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 >> v2:172.21.15.155:3300/0 conn(0x7f31a4073170 msgr2=0x7f31a406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 --2- 172.21.15.94:0/1886324459 >> v2:172.21.15.155:3300/0 conn(0x7f31a4073170 0x7f31a406e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 >> v1:172.21.15.155:6789/0 conn(0x7f31a40b39a0 legacy=0x7f31a406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a406f220 con 0x7f31a41587a0 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f3198001680 con 0x7f31a41587a0 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 >> v1:172.21.15.94:6789/0 conn(0x7f31a41587a0 legacy=0x7f31a40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0039c0 0x7f318c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f318c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0051d0 0x7f318c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f31a406f870 con 0x7f318c004810 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f318c00c020 con 0x7f318c0051d0 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f318c00c220 con 0x7f318c0039c0 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f318c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a2ffd640 1 -- 172.21.15.94:0/1886324459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0039c0 msgr2=0x7f318c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0039c0 0x7f318c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a2ffd640 1 -- 172.21.15.94:0/1886324459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0051d0 msgr2=0x7f318c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0051d0 0x7f318c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a3fff640 1 -- 172.21.15.94:0/1886324459 reap_dead start 2024-09-11T23:19:09.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.705+0000 7f31a2ffd640 1 -- 172.21.15.94:0/1886324459 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c003530 con 0x7f318c004810 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f318c004c90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3194001780 tx=0x7f319401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a978d20ad06ad18f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194001380 con 0x7f318c004810 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31940052f0 con 0x7f318c004810 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a27fc640 1 -- 172.21.15.94:0/1886324459 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194003860 con 0x7f318c004810 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- 172.21.15.94:0/1886324459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 msgr2=0x7f318c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f318c004c90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3194001780 tx=0x7f319401c440 comp rx=0 tx=0).stop 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- 172.21.15.94:0/1886324459 shutdown_connections 2024-09-11T23:19:09.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 --2- 172.21.15.94:0/1886324459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f318c004c90 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- 172.21.15.94:0/1886324459 >> 172.21.15.94:0/1886324459 conn(0x7f31a40b1f90 msgr2=0x7f31a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- 172.21.15.94:0/1886324459 shutdown_connections 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- 172.21.15.94:0/1886324459 wait complete. 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 Processor -- start 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- start start 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f31a40999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31a4152650 0x7f31a4154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31a41545a0 0x7f31a4154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4158b80 con 0x7f318c004810 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31a40b3290 con 0x7f31a4152650 2024-09-11T23:19:09.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f31a4099ef0 con 0x7f31a41545a0 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f31a40999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f31a40999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33052/0 (socket says 172.21.15.94:33052) 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 -- 172.21.15.94:0/755200057 learned_addr learned my addr 172.21.15.94:0/755200057 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31a4152650 0x7f31a4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a3fff640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31a41545a0 0x7f31a4154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 -- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31a41545a0 msgr2=0x7f31a4154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31a41545a0 0x7f31a4154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 -- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31a4152650 msgr2=0x7f31a4154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31a4152650 0x7f31a4154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 -- 172.21.15.94:0/755200057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a4152fc0 con 0x7f318c004810 2024-09-11T23:19:09.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31a4152650 0x7f31a4154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:09.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a37fe640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f31a40999b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f319800f3c0 tx=0x7f319800f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f318bfff640 1 -- 172.21.15.94:0/755200057 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3198007d00 con 0x7f318c004810 2024-09-11T23:19:09.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f318bfff640 1 -- 172.21.15.94:0/755200057 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319800a0d0 con 0x7f318c004810 2024-09-11T23:19:09.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a41532a0 con 0x7f318c004810 2024-09-11T23:19:09.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f318bfff640 1 -- 172.21.15.94:0/755200057 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319800a4c0 con 0x7f318c004810 2024-09-11T23:19:09.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.709+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a4153860 con 0x7f318c004810 2024-09-11T23:19:09.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.713+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a40b3620 con 0x7f318c004810 2024-09-11T23:19:09.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.713+0000 7f318bfff640 1 -- 172.21.15.94:0/755200057 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3198014070 con 0x7f318c004810 2024-09-11T23:19:09.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.713+0000 7f318bfff640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31900678c0 0x7f3190069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.713+0000 7f318bfff640 1 -- 172.21.15.94:0/755200057 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f31980888a0 con 0x7f318c004810 2024-09-11T23:19:09.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.713+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31900678c0 0x7f3190069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.713+0000 7f31a2ffd640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31900678c0 0x7f3190069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31940ad000 tx=0x7f3194001140 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.717+0000 7f318bfff640 1 -- 172.21.15.94:0/755200057 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31980592e0 con 0x7f318c004810 2024-09-11T23:19:09.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:09.913+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f31a4070080 con 0x7f318c004810 2024-09-11T23:19:10.240 INFO:tasks.ceph.mds.d.smithi155.stderr:2024-09-11T23:19:10.239+0000 7f1d4b07b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:19:10.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.553+0000 7f318bfff640 1 -- 172.21.15.94:0/755200057 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) ==== 122+0+0 (secure 0 0 0) 0x7f3198058be0 con 0x7f318c004810 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31900678c0 msgr2=0x7f3190069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31900678c0 0x7f3190069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31940ad000 tx=0x7f3194001140 comp rx=0 tx=0).stop 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 msgr2=0x7f31a40999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f31a40999b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f319800f3c0 tx=0x7f319800f880 comp rx=0 tx=0).stop 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 shutdown_connections 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31a41545a0 0x7f31a4154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31a4152650 0x7f31a4154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31900678c0 0x7f3190069d80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 --2- 172.21.15.94:0/755200057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f318c004810 0x7f31a40999b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 >> 172.21.15.94:0/755200057 conn(0x7f31a40b1f90 msgr2=0x7f31a40d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 shutdown_connections 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.557+0000 7f31a9d56640 1 -- 172.21.15.94:0/755200057 wait complete. 2024-09-11T23:19:10.579 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:19:10.580 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc443f640 1 Processor -- start 2024-09-11T23:19:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc443f640 1 -- start start 2024-09-11T23:19:10.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc443f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdfbc0b4240 0x7fdfbc0d20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc443f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc06e7a0 con 0x7fdfbc15e650 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc443f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc0d0f00 con 0x7fdfbc0b3e00 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc443f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fdfbc0d1550 con 0x7fdfbc0b4240 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc21db640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdfbc15e650 0x7fdfbc06dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47078/0 (socket says 172.21.15.94:47078) 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc21db640 1 -- 172.21.15.94:0/3252867737 learned_addr learned my addr 172.21.15.94:0/3252867737 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc29dc640 1 --2- 172.21.15.94:0/3252867737 >> v2:172.21.15.94:3300/0 conn(0x7fdfbc0b4240 0x7fdfbc0d20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc11d9640 1 -- 172.21.15.94:0/3252867737 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093224010 0 0) 0x7fdfbc06e7a0 con 0x7fdfbc15e650 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc11d9640 1 -- 172.21.15.94:0/3252867737 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfa8003530 con 0x7fdfbc15e650 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc29dc640 1 -- 172.21.15.94:0/3252867737 >> v1:172.21.15.155:6789/0 conn(0x7fdfbc0b3e00 legacy=0x7fdfbc0d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc29dc640 1 -- 172.21.15.94:0/3252867737 >> v1:172.21.15.94:6789/0 conn(0x7fdfbc15e650 legacy=0x7fdfbc06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc29dc640 1 -- 172.21.15.94:0/3252867737 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc0d11e0 con 0x7fdfbc0b4240 2024-09-11T23:19:10.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc29dc640 1 --2- 172.21.15.94:0/3252867737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc0d20f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0d16d0 tx=0x7fdfb401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dfa6bfdafd8c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc11d9640 1 -- 172.21.15.94:0/3252867737 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40b2070 con 0x7fdfbc0b4240 2024-09-11T23:19:10.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc11d9640 1 -- 172.21.15.94:0/3252867737 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb40a5850 con 0x7fdfbc0b4240 2024-09-11T23:19:10.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.705+0000 7fdfc11d9640 1 -- 172.21.15.94:0/3252867737 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40a5c20 con 0x7fdfbc0b4240 2024-09-11T23:19:10.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- 172.21.15.94:0/3252867737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 msgr2=0x7fdfbc0d20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 --2- 172.21.15.94:0/3252867737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc0d20f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0d16d0 tx=0x7fdfb401c910 comp rx=0 tx=0).stop 2024-09-11T23:19:10.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- 172.21.15.94:0/3252867737 shutdown_connections 2024-09-11T23:19:10.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 --2- 172.21.15.94:0/3252867737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc0d20f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- 172.21.15.94:0/3252867737 >> 172.21.15.94:0/3252867737 conn(0x7fdfbc06bcc0 msgr2=0x7fdfbc06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:10.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- 172.21.15.94:0/3252867737 shutdown_connections 2024-09-11T23:19:10.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- 172.21.15.94:0/3252867737 wait complete. 2024-09-11T23:19:10.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 Processor -- start 2024-09-11T23:19:10.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- start start 2024-09-11T23:19:10.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b3e00 0x7fdfbc1600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfbc15e650 0x7fdfbc1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc06e4c0 con 0x7fdfbc0b4240 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc06e340 con 0x7fdfbc15e650 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc16c290 con 0x7fdfbc0b3e00 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc14ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59364/0 (socket says 172.21.15.94:59364) 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 -- 172.21.15.94:0/2813982942 learned_addr learned my addr 172.21.15.94:0/2813982942 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc21db640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b3e00 0x7fdfbc1600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc29dc640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfbc15e650 0x7fdfbc1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 -- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b3e00 msgr2=0x7fdfbc1600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b3e00 0x7fdfbc1600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 -- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfbc15e650 msgr2=0x7fdfbc1506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfbc15e650 0x7fdfbc1506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 -- 172.21.15.94:0/2813982942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc15f020 con 0x7fdfbc0b4240 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc21db640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b3e00 0x7fdfbc1600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc19da640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc14ff40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c450 tx=0x7fdfac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfb2ffd640 1 -- 172.21.15.94:0/2813982942 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac012830 con 0x7fdfbc0b4240 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfb2ffd640 1 -- 172.21.15.94:0/2813982942 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac017070 con 0x7fdfbc0b4240 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc15f300 con 0x7fdfbc0b4240 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfb2ffd640 1 -- 172.21.15.94:0/2813982942 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac012c30 con 0x7fdfbc0b4240 2024-09-11T23:19:10.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.709+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc15f8c0 con 0x7fdfbc0b4240 2024-09-11T23:19:10.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.713+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc06dc30 con 0x7fdfbc0b4240 2024-09-11T23:19:10.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.713+0000 7fdfb2ffd640 1 -- 172.21.15.94:0/2813982942 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdfac01c460 con 0x7fdfbc0b4240 2024-09-11T23:19:10.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.713+0000 7fdfb2ffd640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa00678c0 0x7fdfa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.713+0000 7fdfb2ffd640 1 -- 172.21.15.94:0/2813982942 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fdfac085c50 con 0x7fdfbc0b4240 2024-09-11T23:19:10.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.713+0000 7fdfc21db640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa00678c0 0x7fdfa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.713+0000 7fdfc21db640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa00678c0 0x7fdfa0069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005890 tx=0x7fdfb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.717+0000 7fdfb2ffd640 1 -- 172.21.15.94:0/2813982942 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdfac08b020 con 0x7fdfbc0b4240 2024-09-11T23:19:10.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.909+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfbc0b1ac0 con 0x7fdfbc0b4240 2024-09-11T23:19:10.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.909+0000 7fdfb2ffd640 1 -- 172.21.15.94:0/2813982942 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7fdfac056600 con 0x7fdfbc0b4240 2024-09-11T23:19:10.912 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:10.912 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:06.902722+0000","modified":"2024-09-11T23:19:09.918807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/3079112947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3079112947},{"type":"v1","addr":"172.21.15.155:6836","nonce":3079112947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":6}]} 2024-09-11T23:19:10.912 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 49 2024-09-11T23:19:10.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa00678c0 msgr2=0x7fdfa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa00678c0 0x7fdfa0069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005890 tx=0x7fdfb8009040 comp rx=0 tx=0).stop 2024-09-11T23:19:10.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 msgr2=0x7fdfbc14ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc14ff40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c450 tx=0x7fdfac00c910 comp rx=0 tx=0).stop 2024-09-11T23:19:10.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 shutdown_connections 2024-09-11T23:19:10.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfbc15e650 0x7fdfbc1506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa00678c0 0x7fdfa0069d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfbc0b4240 0x7fdfbc14ff40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 --2- 172.21.15.94:0/2813982942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b3e00 0x7fdfbc1600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 >> 172.21.15.94:0/2813982942 conn(0x7fdfbc06bcc0 msgr2=0x7fdfbc0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:10.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 shutdown_connections 2024-09-11T23:19:10.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:10.913+0000 7fdfc443f640 1 -- 172.21.15.94:0/2813982942 wait complete. 2024-09-11T23:19:10.930 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:11.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d21358640 1 Processor -- start 2024-09-11T23:19:11.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d21358640 1 -- start start 2024-09-11T23:19:11.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d21358640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d21358640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1c0b3290 con 0x7f4d1c0af2a0 2024-09-11T23:19:11.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d21358640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1c0b3570 con 0x7f4d1c15bec0 2024-09-11T23:19:11.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d21358640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c0b3850 con 0x7f4d1c15c2a0 2024-09-11T23:19:11.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d1a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d1b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4d1c0af2a0 0x7f4d1c06e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47094/0 (socket says 172.21.15.94:47094) 2024-09-11T23:19:11.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d1b7fe640 1 -- 172.21.15.94:0/3534306184 learned_addr learned my addr 172.21.15.94:0/3534306184 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:11.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d1a7fc640 1 -- 172.21.15.94:0/3534306184 >> v1:172.21.15.155:6789/0 conn(0x7f4d1c15bec0 legacy=0x7f4d1c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d1a7fc640 1 -- 172.21.15.94:0/3534306184 >> v1:172.21.15.94:6789/0 conn(0x7f4d1c0af2a0 legacy=0x7f4d1c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.049+0000 7f4d1a7fc640 1 -- 172.21.15.94:0/3534306184 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c0b3b30 con 0x7f4d1c15c2a0 2024-09-11T23:19:11.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d1a7fc640 1 --2- 172.21.15.94:0/3534306184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4d100097c0 tx=0x7f4d1001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbdb25c5f1b9882 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d19ffb640 1 -- 172.21.15.94:0/3534306184 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d100a7070 con 0x7f4d1c15c2a0 2024-09-11T23:19:11.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d19ffb640 1 -- 172.21.15.94:0/3534306184 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d100b0070 con 0x7f4d1c15c2a0 2024-09-11T23:19:11.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d19ffb640 1 -- 172.21.15.94:0/3534306184 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d100ab890 con 0x7f4d1c15c2a0 2024-09-11T23:19:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- 172.21.15.94:0/3534306184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15c2a0 msgr2=0x7f4d1c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 --2- 172.21.15.94:0/3534306184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4d100097c0 tx=0x7f4d1001c470 comp rx=0 tx=0).stop 2024-09-11T23:19:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- 172.21.15.94:0/3534306184 shutdown_connections 2024-09-11T23:19:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 --2- 172.21.15.94:0/3534306184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- 172.21.15.94:0/3534306184 >> 172.21.15.94:0/3534306184 conn(0x7f4d1c0b1f90 msgr2=0x7f4d1c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- 172.21.15.94:0/3534306184 shutdown_connections 2024-09-11T23:19:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- 172.21.15.94:0/3534306184 wait complete. 2024-09-11T23:19:11.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 Processor -- start 2024-09-11T23:19:11.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- start start 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c06ef20 con 0x7f4d1c15bec0 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0af6b0 con 0x7f4d1c0af2a0 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d21358640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c06f0a0 con 0x7f4d1c15c2a0 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59386/0 (socket says 172.21.15.94:59386) 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.053+0000 7f4d1a7fc640 1 -- 172.21.15.94:0/2831980928 learned_addr learned my addr 172.21.15.94:0/2831980928 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1b7fe640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1affd640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1a7fc640 1 -- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d1c15c2a0 msgr2=0x7f4d1c154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1a7fc640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1a7fc640 1 -- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c0af2a0 msgr2=0x7f4d1c146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1a7fc640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1a7fc640 1 -- 172.21.15.94:0/2831980928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c15f070 con 0x7f4d1c15bec0 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1a7fc640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15eb30 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4d10019080 tx=0x7f4d10019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d037fe640 1 -- 172.21.15.94:0/2831980928 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d100abd50 con 0x7f4d1c15bec0 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d037fe640 1 -- 172.21.15.94:0/2831980928 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d100be3f0 con 0x7f4d1c15bec0 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c15da90 con 0x7f4d1c15bec0 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d037fe640 1 -- 172.21.15.94:0/2831980928 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d100be7e0 con 0x7f4d1c15bec0 2024-09-11T23:19:11.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c15e050 con 0x7f4d1c15bec0 2024-09-11T23:19:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c0aed60 con 0x7f4d1c15bec0 2024-09-11T23:19:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d037fe640 1 -- 172.21.15.94:0/2831980928 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d100c63f0 con 0x7f4d1c15bec0 2024-09-11T23:19:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d037fe640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4d080678c0 0x7f4d08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d037fe640 1 -- 172.21.15.94:0/2831980928 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f4d10120230 con 0x7f4d1c15bec0 2024-09-11T23:19:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1affd640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4d080678c0 0x7f4d08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.057+0000 7f4d1affd640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4d080678c0 0x7f4d08069d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c001650 tx=0x7f4d0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.061+0000 7f4d037fe640 1 -- 172.21.15.94:0/2831980928 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4d1c15f070 con 0x7f4d1c15bec0 2024-09-11T23:19:11.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.225+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d1c06fcd0 con 0x7f4d1c15bec0 2024-09-11T23:19:11.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d037fe640 1 -- 172.21.15.94:0/2831980928 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16969 (secure 0 0 0) 0x7f4d100b9070 con 0x7f4d1c15bec0 2024-09-11T23:19:11.230 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:11.230 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":86,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:08.242191+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:05.228050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:05.892122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:11.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4d080678c0 msgr2=0x7f4d08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4d080678c0 0x7f4d08069d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c001650 tx=0x7f4d0c009040 comp rx=0 tx=0).stop 2024-09-11T23:19:11.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15bec0 msgr2=0x7f4d1c15eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15eb30 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4d10019080 tx=0x7f4d10019210 comp rx=0 tx=0).stop 2024-09-11T23:19:11.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 shutdown_connections 2024-09-11T23:19:11.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4d080678c0 0x7f4d08069d80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15eb30 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 --2- 172.21.15.94:0/2831980928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.229+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 >> 172.21.15.94:0/2831980928 conn(0x7f4d1c0b1f90 msgr2=0x7f4d1c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.233+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 shutdown_connections 2024-09-11T23:19:11.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.233+0000 7f4d21358640 1 -- 172.21.15.94:0/2831980928 wait complete. 2024-09-11T23:19:11.249 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:19:11.249 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:11.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.361+0000 7fc2088e3640 1 Processor -- start 2024-09-11T23:19:11.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.361+0000 7fc2088e3640 1 -- start start 2024-09-11T23:19:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc2088e3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20415bec0 0x7fc2040ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc2088e3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc20415c2a0 0x7fc2040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc2088e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc2040af2a0 0x7fc20415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc2088e3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc2040b3290 con 0x7fc2040af2a0 2024-09-11T23:19:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc2088e3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc2040b3570 con 0x7fc20415c2a0 2024-09-11T23:19:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc2088e3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2040b3850 con 0x7fc20415bec0 2024-09-11T23:19:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc2040af2a0 0x7fc20415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc2040af2a0 0x7fc20415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59396/0 (socket says 172.21.15.94:59396) 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 -- 172.21.15.94:0/4001968550 learned_addr learned my addr 172.21.15.94:0/4001968550 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc20259c640 1 --2- 172.21.15.94:0/4001968550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20415bec0 0x7fc2040ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 -- 172.21.15.94:0/4001968550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20415bec0 msgr2=0x7fc2040ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 --2- 172.21.15.94:0/4001968550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20415bec0 0x7fc2040ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc201d9b640 1 --2- 172.21.15.94:0/4001968550 >> v2:172.21.15.155:3300/0 conn(0x7fc20415c2a0 0x7fc2040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 -- 172.21.15.94:0/4001968550 >> v2:172.21.15.155:3300/0 conn(0x7fc20415c2a0 msgr2=0x7fc2040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 --2- 172.21.15.94:0/4001968550 >> v2:172.21.15.155:3300/0 conn(0x7fc20415c2a0 0x7fc2040aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 -- 172.21.15.94:0/4001968550 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2040b3b30 con 0x7fc2040af2a0 2024-09-11T23:19:11.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc201d9b640 1 --2- 172.21.15.94:0/4001968550 >> v2:172.21.15.155:3300/0 conn(0x7fc20415c2a0 0x7fc2040aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc202d9d640 1 --2- 172.21.15.94:0/4001968550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2040af2a0 0x7fc20415fc60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc20406de20 tx=0x7fc1fc01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c17b08d7e7291 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc20159a640 1 -- 172.21.15.94:0/4001968550 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0a5580 con 0x7fc2040af2a0 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc20159a640 1 -- 172.21.15.94:0/4001968550 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0a5720 con 0x7fc2040af2a0 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.365+0000 7fc20159a640 1 -- 172.21.15.94:0/4001968550 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0a5af0 con 0x7fc2040af2a0 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- 172.21.15.94:0/4001968550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2040af2a0 msgr2=0x7fc20415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 --2- 172.21.15.94:0/4001968550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2040af2a0 0x7fc20415fc60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc20406de20 tx=0x7fc1fc01c700 comp rx=0 tx=0).stop 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- 172.21.15.94:0/4001968550 shutdown_connections 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 --2- 172.21.15.94:0/4001968550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc2040af2a0 0x7fc20415fc60 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 --2- 172.21.15.94:0/4001968550 >> v2:172.21.15.155:3300/0 conn(0x7fc20415c2a0 0x7fc2040aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 --2- 172.21.15.94:0/4001968550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc20415bec0 0x7fc2040ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- 172.21.15.94:0/4001968550 >> 172.21.15.94:0/4001968550 conn(0x7fc2040b1f90 msgr2=0x7fc2040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- 172.21.15.94:0/4001968550 shutdown_connections 2024-09-11T23:19:11.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- 172.21.15.94:0/4001968550 wait complete. 2024-09-11T23:19:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 Processor -- start 2024-09-11T23:19:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- start start 2024-09-11T23:19:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040af2a0 0x7fc20415e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20415bec0 0x7fc20406e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20415c2a0 0x7fc2041534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc2040ad740 con 0x7fc20415bec0 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2040afc90 con 0x7fc20415c2a0 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc20406e000 con 0x7fc2040af2a0 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20415bec0 0x7fc20406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20415bec0 0x7fc20406e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59402/0 (socket says 172.21.15.94:59402) 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 -- 172.21.15.94:0/795264689 learned_addr learned my addr 172.21.15.94:0/795264689 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc20259c640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040af2a0 0x7fc20415e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc202d9d640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20415c2a0 0x7fc2041534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 -- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040af2a0 msgr2=0x7fc20415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040af2a0 0x7fc20415e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 -- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20415c2a0 msgr2=0x7fc2041534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20415c2a0 0x7fc2041534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 -- 172.21.15.94:0/795264689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20415d860 con 0x7fc20415bec0 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc202d9d640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20415c2a0 0x7fc2041534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc201d9b640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20415bec0 0x7fc20406e690 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800c820 tx=0x7fc1f800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc1f2ffd640 1 -- 172.21.15.94:0/795264689 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8015070 con 0x7fc20415bec0 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc1f2ffd640 1 -- 172.21.15.94:0/795264689 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f8007a30 con 0x7fc20415bec0 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20415db40 con 0x7fc20415bec0 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc1f2ffd640 1 -- 172.21.15.94:0/795264689 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8007e00 con 0x7fc20415bec0 2024-09-11T23:19:11.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.369+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20415e100 con 0x7fc20415bec0 2024-09-11T23:19:11.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.373+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2040ad200 con 0x7fc20415bec0 2024-09-11T23:19:11.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.373+0000 7fc1f2ffd640 1 -- 172.21.15.94:0/795264689 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1f8018070 con 0x7fc20415bec0 2024-09-11T23:19:11.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.373+0000 7fc1f2ffd640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1e40678c0 0x7fc1e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.373+0000 7fc1f2ffd640 1 -- 172.21.15.94:0/795264689 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fc1f8085fb0 con 0x7fc20415bec0 2024-09-11T23:19:11.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.373+0000 7fc20259c640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1e40678c0 0x7fc1e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.373+0000 7fc20259c640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1e40678c0 0x7fc1e4069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400a970 tx=0x7fc1f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.377+0000 7fc1f2ffd640 1 -- 172.21.15.94:0/795264689 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc1f8056ad0 con 0x7fc20415bec0 2024-09-11T23:19:11.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.525+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc20406fcd0 con 0x7fc1e40678c0 2024-09-11T23:19:11.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.541+0000 7fc1f2ffd640 1 -- 172.21.15.94:0/795264689 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246768 (secure 0 0 0) 0x7fc20406fcd0 con 0x7fc1e40678c0 2024-09-11T23:19:11.544 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:11.546 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:19:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1e40678c0 msgr2=0x7fc1e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1e40678c0 0x7fc1e4069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400a970 tx=0x7fc1f4008040 comp rx=0 tx=0).stop 2024-09-11T23:19:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20415bec0 msgr2=0x7fc20406e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20415bec0 0x7fc20406e690 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800c820 tx=0x7fc1f800cce0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 shutdown_connections 2024-09-11T23:19:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20415c2a0 0x7fc2041534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc1e40678c0 0x7fc1e4069d80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc20415bec0 0x7fc20406e690 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 --2- 172.21.15.94:0/795264689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040af2a0 0x7fc20415e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 >> 172.21.15.94:0/795264689 conn(0x7fc2040b1f90 msgr2=0x7fc2040d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 shutdown_connections 2024-09-11T23:19:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.545+0000 7fc2088e3640 1 -- 172.21.15.94:0/795264689 wait complete. 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-11T23:19:10.048642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279556,"kb_used_data":9208,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695164,"statfs":{"total":773094113280,"available":772807847936,"internally_reserved":0,"allocated":9428992,"data_stored":4936780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527087"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.534076+0000","last_change":"2024-09-11T23:19:06.534076+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.534076+0000","last_undegraded":"2024-09-11T23:19:06.534076+0000","last_fullsized":"2024-09-11T23:19:06.534076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539932+0000","last_change":"2024-09-11T23:19:06.539932+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539932+0000","last_undegraded":"2024-09-11T23:19:06.539932+0000","last_fullsized":"2024-09-11T23:19:06.539932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.534092+0000","last_change":"2024-09-11T23:19:06.534092+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.534092+0000","last_undegraded":"2024-09-11T23:19:06.534092+0000","last_fullsized":"2024-09-11T23:19:06.534092+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544473+0000","last_change":"2024-09-11T23:19:06.544473+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544473+0000","last_undegraded":"2024-09-11T23:19:06.544473+0000","last_fullsized":"2024-09-11T23:19:06.544473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.559703+0000","last_change":"2024-09-11T23:19:06.559703+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.559703+0000","last_undegraded":"2024-09-11T23:19:06.559703+0000","last_fullsized":"2024-09-11T23:19:06.559703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542402+0000","last_change":"2024-09-11T23:19:06.542402+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542402+0000","last_undegraded":"2024-09-11T23:19:06.542402+0000","last_fullsized":"2024-09-11T23:19:06.542402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538073+0000","last_change":"2024-09-11T23:19:06.538073+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538073+0000","last_undegraded":"2024-09-11T23:19:06.538073+0000","last_fullsized":"2024-09-11T23:19:06.538073+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544073+0000","last_change":"2024-09-11T23:19:06.544073+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544073+0000","last_undegraded":"2024-09-11T23:19:06.544073+0000","last_fullsized":"2024-09-11T23:19:06.544073+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.556883+0000","last_change":"2024-09-11T23:19:06.556883+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.556883+0000","last_undegraded":"2024-09-11T23:19:06.556883+0000","last_fullsized":"2024-09-11T23:19:06.556883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.541712+0000","last_change":"2024-09-11T23:19:06.541712+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.541712+0000","last_undegraded":"2024-09-11T23:19:06.541712+0000","last_fullsized":"2024-09-11T23:19:06.541712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.556721+0000","last_change":"2024-09-11T23:19:06.556721+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.556721+0000","last_undegraded":"2024-09-11T23:19:06.556721+0000","last_fullsized":"2024-09-11T23:19:06.556721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540640+0000","last_change":"2024-09-11T23:19:06.540640+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540640+0000","last_undegraded":"2024-09-11T23:19:06.540640+0000","last_fullsized":"2024-09-11T23:19:06.540640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538125+0000","last_change":"2024-09-11T23:19:06.538125+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538125+0000","last_undegraded":"2024-09-11T23:19:06.538125+0000","last_fullsized":"2024-09-11T23:19:06.538125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.557550+0000","last_change":"2024-09-11T23:19:06.557550+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.557550+0000","last_undegraded":"2024-09-11T23:19:06.557550+0000","last_fullsized":"2024-09-11T23:19:06.557550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544007+0000","last_change":"2024-09-11T23:19:06.544007+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544007+0000","last_undegraded":"2024-09-11T23:19:06.544007+0000","last_fullsized":"2024-09-11T23:19:06.544007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537821+0000","last_change":"2024-09-11T23:19:06.537821+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537821+0000","last_undegraded":"2024-09-11T23:19:06.537821+0000","last_fullsized":"2024-09-11T23:19:06.537821+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539707+0000","last_change":"2024-09-11T23:19:06.539707+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539707+0000","last_undegraded":"2024-09-11T23:19:06.539707+0000","last_fullsized":"2024-09-11T23:19:06.539707+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535980+0000","last_change":"2024-09-11T23:19:06.535980+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535980+0000","last_undegraded":"2024-09-11T23:19:06.535980+0000","last_fullsized":"2024-09-11T23:19:06.535980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.555007+0000","last_change":"2024-09-11T23:19:06.555007+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.555007+0000","last_undegraded":"2024-09-11T23:19:06.555007+0000","last_fullsized":"2024-09-11T23:19:06.555007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538706+0000","last_change":"2024-09-11T23:19:06.538706+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538706+0000","last_undegraded":"2024-09-11T23:19:06.538706+0000","last_fullsized":"2024-09-11T23:19:06.538706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.557954+0000","last_change":"2024-09-11T23:19:06.557954+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.557954+0000","last_undegraded":"2024-09-11T23:19:06.557954+0000","last_fullsized":"2024-09-11T23:19:06.557954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.550676+0000","last_change":"2024-09-11T23:19:06.550676+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.550676+0000","last_undegraded":"2024-09-11T23:19:06.550676+0000","last_fullsized":"2024-09-11T23:19:06.550676+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.549710+0000","last_change":"2024-09-11T23:19:06.549710+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.549710+0000","last_undegraded":"2024-09-11T23:19:06.549710+0000","last_fullsized":"2024-09-11T23:19:06.549710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.534514+0000","last_change":"2024-09-11T23:19:06.534514+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.534514+0000","last_undegraded":"2024-09-11T23:19:06.534514+0000","last_fullsized":"2024-09-11T23:19:06.534514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540912+0000","last_change":"2024-09-11T23:19:06.540912+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540912+0000","last_undegraded":"2024-09-11T23:19:06.540912+0000","last_fullsized":"2024-09-11T23:19:06.540912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.548446+0000","last_change":"2024-09-11T23:19:06.548446+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.548446+0000","last_undegraded":"2024-09-11T23:19:06.548446+0000","last_fullsized":"2024-09-11T23:19:06.548446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539926+0000","last_change":"2024-09-11T23:19:06.539926+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539926+0000","last_undegraded":"2024-09-11T23:19:06.539926+0000","last_fullsized":"2024-09-11T23:19:06.539926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538229+0000","last_change":"2024-09-11T23:19:06.538229+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538229+0000","last_undegraded":"2024-09-11T23:19:06.538229+0000","last_fullsized":"2024-09-11T23:19:06.538229+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535915+0000","last_change":"2024-09-11T23:19:06.535915+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535915+0000","last_undegraded":"2024-09-11T23:19:06.535915+0000","last_fullsized":"2024-09-11T23:19:06.535915+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542959+0000","last_change":"2024-09-11T23:19:06.542959+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542959+0000","last_undegraded":"2024-09-11T23:19:06.542959+0000","last_fullsized":"2024-09-11T23:19:06.542959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.551841+0000","last_change":"2024-09-11T23:19:06.551841+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.551841+0000","last_undegraded":"2024-09-11T23:19:06.551841+0000","last_fullsized":"2024-09-11T23:19:06.551841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537422+0000","last_change":"2024-09-11T23:19:06.537422+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537422+0000","last_undegraded":"2024-09-11T23:19:06.537422+0000","last_fullsized":"2024-09-11T23:19:06.537422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537529+0000","last_change":"2024-09-11T23:19:06.537529+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537529+0000","last_undegraded":"2024-09-11T23:19:06.537529+0000","last_fullsized":"2024-09-11T23:19:06.537529+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.566026+0000","last_change":"2024-09-11T23:19:06.560592+0000","last_active":"2024-09-11T23:19:06.566026+0000","last_peered":"2024-09-11T23:19:06.566026+0000","last_clean":"2024-09-11T23:19:06.566026+0000","last_became_active":"2024-09-11T23:19:06.559887+0000","last_became_peered":"2024-09-11T23:19:06.559887+0000","last_unstale":"2024-09-11T23:19:06.566026+0000","last_undegraded":"2024-09-11T23:19:06.566026+0000","last_fullsized":"2024-09-11T23:19:06.566026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:39.017205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538383+0000","last_change":"2024-09-11T23:19:06.538383+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538383+0000","last_undegraded":"2024-09-11T23:19:06.538383+0000","last_fullsized":"2024-09-11T23:19:06.538383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.578442+0000","last_change":"2024-09-11T23:19:06.575536+0000","last_active":"2024-09-11T23:19:06.578442+0000","last_peered":"2024-09-11T23:19:06.578442+0000","last_clean":"2024-09-11T23:19:06.578442+0000","last_became_active":"2024-09-11T23:19:06.574927+0000","last_became_peered":"2024-09-11T23:19:06.574927+0000","last_unstale":"2024-09-11T23:19:06.578442+0000","last_undegraded":"2024-09-11T23:19:06.578442+0000","last_fullsized":"2024-09-11T23:19:06.578442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:24.883911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539554+0000","last_change":"2024-09-11T23:19:06.539554+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539554+0000","last_undegraded":"2024-09-11T23:19:06.539554+0000","last_fullsized":"2024-09-11T23:19:06.539554+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.567939+0000","last_change":"2024-09-11T23:19:06.553845+0000","last_active":"2024-09-11T23:19:06.567939+0000","last_peered":"2024-09-11T23:19:06.567939+0000","last_clean":"2024-09-11T23:19:06.567939+0000","last_became_active":"2024-09-11T23:19:06.552969+0000","last_became_peered":"2024-09-11T23:19:06.552969+0000","last_unstale":"2024-09-11T23:19:06.567939+0000","last_undegraded":"2024-09-11T23:19:06.567939+0000","last_fullsized":"2024-09-11T23:19:06.567939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:28.270481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539283+0000","last_change":"2024-09-11T23:19:06.539283+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539283+0000","last_undegraded":"2024-09-11T23:19:06.539283+0000","last_fullsized":"2024-09-11T23:19:06.539283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.567017+0000","last_change":"2024-09-11T23:19:06.564108+0000","last_active":"2024-09-11T23:19:06.567017+0000","last_peered":"2024-09-11T23:19:06.567017+0000","last_clean":"2024-09-11T23:19:06.567017+0000","last_became_active":"2024-09-11T23:19:06.563110+0000","last_became_peered":"2024-09-11T23:19:06.563110+0000","last_unstale":"2024-09-11T23:19:06.567017+0000","last_undegraded":"2024-09-11T23:19:06.567017+0000","last_fullsized":"2024-09-11T23:19:06.567017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:11.557639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538775+0000","last_change":"2024-09-11T23:19:06.538775+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538775+0000","last_undegraded":"2024-09-11T23:19:06.538775+0000","last_fullsized":"2024-09-11T23:19:06.538775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.576460+0000","last_change":"2024-09-11T23:19:06.561822+0000","last_active":"2024-09-11T23:19:06.576460+0000","last_peered":"2024-09-11T23:19:06.576460+0000","last_clean":"2024-09-11T23:19:06.576460+0000","last_became_active":"2024-09-11T23:19:06.560453+0000","last_became_peered":"2024-09-11T23:19:06.560453+0000","last_unstale":"2024-09-11T23:19:06.576460+0000","last_undegraded":"2024-09-11T23:19:06.576460+0000","last_fullsized":"2024-09-11T23:19:06.576460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:49.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.548200+0000","last_change":"2024-09-11T23:19:06.548200+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.548200+0000","last_undegraded":"2024-09-11T23:19:06.548200+0000","last_fullsized":"2024-09-11T23:19:06.548200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.553501+0000","last_change":"2024-09-11T23:19:06.552799+0000","last_active":"2024-09-11T23:19:06.553501+0000","last_peered":"2024-09-11T23:19:06.553501+0000","last_clean":"2024-09-11T23:19:06.553501+0000","last_became_active":"2024-09-11T23:19:06.551350+0000","last_became_peered":"2024-09-11T23:19:06.551350+0000","last_unstale":"2024-09-11T23:19:06.553501+0000","last_undegraded":"2024-09-11T23:19:06.553501+0000","last_fullsized":"2024-09-11T23:19:06.553501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:11.557639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.541977+0000","last_change":"2024-09-11T23:19:06.541977+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.541977+0000","last_undegraded":"2024-09-11T23:19:06.541977+0000","last_fullsized":"2024-09-11T23:19:06.541977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.555503+0000","last_change":"2024-09-11T23:19:06.554582+0000","last_active":"2024-09-11T23:19:06.555503+0000","last_peered":"2024-09-11T23:19:06.555503+0000","last_clean":"2024-09-11T23:19:06.555503+0000","last_became_active":"2024-09-11T23:19:06.554159+0000","last_became_peered":"2024-09-11T23:19:06.554159+0000","last_unstale":"2024-09-11T23:19:06.555503+0000","last_undegraded":"2024-09-11T23:19:06.555503+0000","last_fullsized":"2024-09-11T23:19:06.555503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.758800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537775+0000","last_change":"2024-09-11T23:19:06.537775+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537775+0000","last_undegraded":"2024-09-11T23:19:06.537775+0000","last_fullsized":"2024-09-11T23:19:06.537775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.559809+0000","last_change":"2024-09-11T23:19:06.545476+0000","last_active":"2024-09-11T23:19:06.559809+0000","last_peered":"2024-09-11T23:19:06.559809+0000","last_clean":"2024-09-11T23:19:06.559809+0000","last_became_active":"2024-09-11T23:19:06.544759+0000","last_became_peered":"2024-09-11T23:19:06.544759+0000","last_unstale":"2024-09-11T23:19:06.559809+0000","last_undegraded":"2024-09-11T23:19:06.559809+0000","last_fullsized":"2024-09-11T23:19:06.559809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:41.685199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544287+0000","last_change":"2024-09-11T23:19:06.544287+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544287+0000","last_undegraded":"2024-09-11T23:19:06.544287+0000","last_fullsized":"2024-09-11T23:19:06.544287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568240+0000","last_change":"2024-09-11T23:19:06.562370+0000","last_active":"2024-09-11T23:19:06.568240+0000","last_peered":"2024-09-11T23:19:06.568240+0000","last_clean":"2024-09-11T23:19:06.568240+0000","last_became_active":"2024-09-11T23:19:06.561679+0000","last_became_peered":"2024-09-11T23:19:06.561679+0000","last_unstale":"2024-09-11T23:19:06.568240+0000","last_undegraded":"2024-09-11T23:19:06.568240+0000","last_fullsized":"2024-09-11T23:19:06.568240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:16.621187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537034+0000","last_change":"2024-09-11T23:19:06.537034+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537034+0000","last_undegraded":"2024-09-11T23:19:06.537034+0000","last_fullsized":"2024-09-11T23:19:06.537034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.548413+0000","last_change":"2024-09-11T23:19:06.547195+0000","last_active":"2024-09-11T23:19:06.548413+0000","last_peered":"2024-09-11T23:19:06.548413+0000","last_clean":"2024-09-11T23:19:06.548413+0000","last_became_active":"2024-09-11T23:19:06.546903+0000","last_became_peered":"2024-09-11T23:19:06.546903+0000","last_unstale":"2024-09-11T23:19:06.548413+0000","last_undegraded":"2024-09-11T23:19:06.548413+0000","last_fullsized":"2024-09-11T23:19:06.548413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535327+0000","last_change":"2024-09-11T23:19:06.535327+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535327+0000","last_undegraded":"2024-09-11T23:19:06.535327+0000","last_fullsized":"2024-09-11T23:19:06.535327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.578693+0000","last_change":"2024-09-11T23:19:06.576092+0000","last_active":"2024-09-11T23:19:06.578693+0000","last_peered":"2024-09-11T23:19:06.578693+0000","last_clean":"2024-09-11T23:19:06.578693+0000","last_became_active":"2024-09-11T23:19:06.574510+0000","last_became_peered":"2024-09-11T23:19:06.574510+0000","last_unstale":"2024-09-11T23:19:06.578693+0000","last_undegraded":"2024-09-11T23:19:06.578693+0000","last_fullsized":"2024-09-11T23:19:06.578693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:50.041152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535692+0000","last_change":"2024-09-11T23:19:06.535692+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535692+0000","last_undegraded":"2024-09-11T23:19:06.535692+0000","last_fullsized":"2024-09-11T23:19:06.535692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.563299+0000","last_change":"2024-09-11T23:19:06.562096+0000","last_active":"2024-09-11T23:19:06.563299+0000","last_peered":"2024-09-11T23:19:06.563299+0000","last_clean":"2024-09-11T23:19:06.563299+0000","last_became_active":"2024-09-11T23:19:06.561837+0000","last_became_peered":"2024-09-11T23:19:06.561837+0000","last_unstale":"2024-09-11T23:19:06.563299+0000","last_undegraded":"2024-09-11T23:19:06.563299+0000","last_fullsized":"2024-09-11T23:19:06.563299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.715563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535251+0000","last_change":"2024-09-11T23:19:06.535251+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535251+0000","last_undegraded":"2024-09-11T23:19:06.535251+0000","last_fullsized":"2024-09-11T23:19:06.535251+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568176+0000","last_change":"2024-09-11T23:19:06.556199+0000","last_active":"2024-09-11T23:19:06.568176+0000","last_peered":"2024-09-11T23:19:06.568176+0000","last_clean":"2024-09-11T23:19:06.568176+0000","last_became_active":"2024-09-11T23:19:06.555517+0000","last_became_peered":"2024-09-11T23:19:06.555517+0000","last_unstale":"2024-09-11T23:19:06.568176+0000","last_undegraded":"2024-09-11T23:19:06.568176+0000","last_fullsized":"2024-09-11T23:19:06.568176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542537+0000","last_change":"2024-09-11T23:19:06.542537+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542537+0000","last_undegraded":"2024-09-11T23:19:06.542537+0000","last_fullsized":"2024-09-11T23:19:06.542537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577563+0000","last_change":"2024-09-11T23:19:06.577144+0000","last_active":"2024-09-11T23:19:06.577563+0000","last_peered":"2024-09-11T23:19:06.577563+0000","last_clean":"2024-09-11T23:19:06.577563+0000","last_became_active":"2024-09-11T23:19:06.576853+0000","last_became_peered":"2024-09-11T23:19:06.576853+0000","last_unstale":"2024-09-11T23:19:06.577563+0000","last_undegraded":"2024-09-11T23:19:06.577563+0000","last_fullsized":"2024-09-11T23:19:06.577563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:41.995704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538417+0000","last_change":"2024-09-11T23:19:06.538417+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538417+0000","last_undegraded":"2024-09-11T23:19:06.538417+0000","last_fullsized":"2024-09-11T23:19:06.538417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.563795+0000","last_change":"2024-09-11T23:19:06.563280+0000","last_active":"2024-09-11T23:19:06.563795+0000","last_peered":"2024-09-11T23:19:06.563795+0000","last_clean":"2024-09-11T23:19:06.563795+0000","last_became_active":"2024-09-11T23:19:06.562981+0000","last_became_peered":"2024-09-11T23:19:06.562981+0000","last_unstale":"2024-09-11T23:19:06.563795+0000","last_undegraded":"2024-09-11T23:19:06.563795+0000","last_fullsized":"2024-09-11T23:19:06.563795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:02.969318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538885+0000","last_change":"2024-09-11T23:19:06.538885+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538885+0000","last_undegraded":"2024-09-11T23:19:06.538885+0000","last_fullsized":"2024-09-11T23:19:06.538885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.551417+0000","last_change":"2024-09-11T23:19:06.550310+0000","last_active":"2024-09-11T23:19:06.551417+0000","last_peered":"2024-09-11T23:19:06.551417+0000","last_clean":"2024-09-11T23:19:06.551417+0000","last_became_active":"2024-09-11T23:19:06.550073+0000","last_became_peered":"2024-09-11T23:19:06.550073+0000","last_unstale":"2024-09-11T23:19:06.551417+0000","last_undegraded":"2024-09-11T23:19:06.551417+0000","last_fullsized":"2024-09-11T23:19:06.551417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:39.017205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537052+0000","last_change":"2024-09-11T23:19:06.537052+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537052+0000","last_undegraded":"2024-09-11T23:19:06.537052+0000","last_fullsized":"2024-09-11T23:19:06.537052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.572941+0000","last_change":"2024-09-11T23:19:06.569779+0000","last_active":"2024-09-11T23:19:06.572941+0000","last_peered":"2024-09-11T23:19:06.572941+0000","last_clean":"2024-09-11T23:19:06.572941+0000","last_became_active":"2024-09-11T23:19:06.569044+0000","last_became_peered":"2024-09-11T23:19:06.569044+0000","last_unstale":"2024-09-11T23:19:06.572941+0000","last_undegraded":"2024-09-11T23:19:06.572941+0000","last_fullsized":"2024-09-11T23:19:06.572941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:02.969318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.545858+0000","last_change":"2024-09-11T23:19:06.545858+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.545858+0000","last_undegraded":"2024-09-11T23:19:06.545858+0000","last_fullsized":"2024-09-11T23:19:06.545858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568414+0000","last_change":"2024-09-11T23:19:06.566301+0000","last_active":"2024-09-11T23:19:06.568414+0000","last_peered":"2024-09-11T23:19:06.568414+0000","last_clean":"2024-09-11T23:19:06.568414+0000","last_became_active":"2024-09-11T23:19:06.565597+0000","last_became_peered":"2024-09-11T23:19:06.565597+0000","last_unstale":"2024-09-11T23:19:06.568414+0000","last_undegraded":"2024-09-11T23:19:06.568414+0000","last_fullsized":"2024-09-11T23:19:06.568414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:27.606512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.547489+0000","last_change":"2024-09-11T23:19:06.547489+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.547489+0000","last_undegraded":"2024-09-11T23:19:06.547489+0000","last_fullsized":"2024-09-11T23:19:06.547489+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.576520+0000","last_change":"2024-09-11T23:19:06.571225+0000","last_active":"2024-09-11T23:19:06.576520+0000","last_peered":"2024-09-11T23:19:06.576520+0000","last_clean":"2024-09-11T23:19:06.576520+0000","last_became_active":"2024-09-11T23:19:06.570625+0000","last_became_peered":"2024-09-11T23:19:06.570625+0000","last_unstale":"2024-09-11T23:19:06.576520+0000","last_undegraded":"2024-09-11T23:19:06.576520+0000","last_fullsized":"2024-09-11T23:19:06.576520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:57.124863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.536900+0000","last_change":"2024-09-11T23:19:06.536900+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.536900+0000","last_undegraded":"2024-09-11T23:19:06.536900+0000","last_fullsized":"2024-09-11T23:19:06.536900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.565094+0000","last_change":"2024-09-11T23:19:06.554094+0000","last_active":"2024-09-11T23:19:06.565094+0000","last_peered":"2024-09-11T23:19:06.565094+0000","last_clean":"2024-09-11T23:19:06.565094+0000","last_became_active":"2024-09-11T23:19:06.553375+0000","last_became_peered":"2024-09-11T23:19:06.553375+0000","last_unstale":"2024-09-11T23:19:06.565094+0000","last_undegraded":"2024-09-11T23:19:06.565094+0000","last_fullsized":"2024-09-11T23:19:06.565094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542178+0000","last_change":"2024-09-11T23:19:06.542178+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542178+0000","last_undegraded":"2024-09-11T23:19:06.542178+0000","last_fullsized":"2024-09-11T23:19:06.542178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.551184+0000","last_change":"2024-09-11T23:19:06.546448+0000","last_active":"2024-09-11T23:19:06.551184+0000","last_peered":"2024-09-11T23:19:06.551184+0000","last_clean":"2024-09-11T23:19:06.551184+0000","last_became_active":"2024-09-11T23:19:06.545743+0000","last_became_peered":"2024-09-11T23:19:06.545743+0000","last_unstale":"2024-09-11T23:19:06.551184+0000","last_undegraded":"2024-09-11T23:19:06.551184+0000","last_fullsized":"2024-09-11T23:19:06.551184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:35.266194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538492+0000","last_change":"2024-09-11T23:19:06.538492+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538492+0000","last_undegraded":"2024-09-11T23:19:06.538492+0000","last_fullsized":"2024-09-11T23:19:06.538492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.566272+0000","last_change":"2024-09-11T23:19:06.558413+0000","last_active":"2024-09-11T23:19:06.566272+0000","last_peered":"2024-09-11T23:19:06.566272+0000","last_clean":"2024-09-11T23:19:06.566272+0000","last_became_active":"2024-09-11T23:19:06.557721+0000","last_became_peered":"2024-09-11T23:19:06.557721+0000","last_unstale":"2024-09-11T23:19:06.566272+0000","last_undegraded":"2024-09-11T23:19:06.566272+0000","last_fullsized":"2024-09-11T23:19:06.566272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540633+0000","last_change":"2024-09-11T23:19:06.540633+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540633+0000","last_undegraded":"2024-09-11T23:19:06.540633+0000","last_fullsized":"2024-09-11T23:19:06.540633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.557827+0000","last_change":"2024-09-11T23:19:06.557333+0000","last_active":"2024-09-11T23:19:06.557827+0000","last_peered":"2024-09-11T23:19:06.557827+0000","last_clean":"2024-09-11T23:19:06.557827+0000","last_became_active":"2024-09-11T23:19:06.556598+0000","last_became_peered":"2024-09-11T23:19:06.556598+0000","last_unstale":"2024-09-11T23:19:06.557827+0000","last_undegraded":"2024-09-11T23:19:06.557827+0000","last_fullsized":"2024-09-11T23:19:06.557827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:15.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.551122+0000","last_change":"2024-09-11T23:19:06.551122+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.551122+0000","last_undegraded":"2024-09-11T23:19:06.551122+0000","last_fullsized":"2024-09-11T23:19:06.551122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568330+0000","last_change":"2024-09-11T23:19:06.565340+0000","last_active":"2024-09-11T23:19:06.568330+0000","last_peered":"2024-09-11T23:19:06.568330+0000","last_clean":"2024-09-11T23:19:06.568330+0000","last_became_active":"2024-09-11T23:19:06.564535+0000","last_became_peered":"2024-09-11T23:19:06.564535+0000","last_unstale":"2024-09-11T23:19:06.568330+0000","last_undegraded":"2024-09-11T23:19:06.568330+0000","last_fullsized":"2024-09-11T23:19:06.568330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.758800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537276+0000","last_change":"2024-09-11T23:19:06.537276+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537276+0000","last_undegraded":"2024-09-11T23:19:06.537276+0000","last_fullsized":"2024-09-11T23:19:06.537276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577450+0000","last_change":"2024-09-11T23:19:06.574920+0000","last_active":"2024-09-11T23:19:06.577450+0000","last_peered":"2024-09-11T23:19:06.577450+0000","last_clean":"2024-09-11T23:19:06.577450+0000","last_became_active":"2024-09-11T23:19:06.571154+0000","last_became_peered":"2024-09-11T23:19:06.571154+0000","last_unstale":"2024-09-11T23:19:06.577450+0000","last_undegraded":"2024-09-11T23:19:06.577450+0000","last_fullsized":"2024-09-11T23:19:06.577450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:54.118088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.541487+0000","last_change":"2024-09-11T23:19:06.541487+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.541487+0000","last_undegraded":"2024-09-11T23:19:06.541487+0000","last_fullsized":"2024-09-11T23:19:06.541487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577522+0000","last_change":"2024-09-11T23:19:06.575470+0000","last_active":"2024-09-11T23:19:06.577522+0000","last_peered":"2024-09-11T23:19:06.577522+0000","last_clean":"2024-09-11T23:19:06.577522+0000","last_became_active":"2024-09-11T23:19:06.572387+0000","last_became_peered":"2024-09-11T23:19:06.572387+0000","last_unstale":"2024-09-11T23:19:06.577522+0000","last_undegraded":"2024-09-11T23:19:06.577522+0000","last_fullsized":"2024-09-11T23:19:06.577522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:06.000044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539784+0000","last_change":"2024-09-11T23:19:06.539784+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539784+0000","last_undegraded":"2024-09-11T23:19:06.539784+0000","last_fullsized":"2024-09-11T23:19:06.539784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.564472+0000","last_change":"2024-09-11T23:19:06.559238+0000","last_active":"2024-09-11T23:19:06.564472+0000","last_peered":"2024-09-11T23:19:06.564472+0000","last_clean":"2024-09-11T23:19:06.564472+0000","last_became_active":"2024-09-11T23:19:06.558411+0000","last_became_peered":"2024-09-11T23:19:06.558411+0000","last_unstale":"2024-09-11T23:19:06.564472+0000","last_undegraded":"2024-09-11T23:19:06.564472+0000","last_fullsized":"2024-09-11T23:19:06.564472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:08.837460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537496+0000","last_change":"2024-09-11T23:19:06.537496+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537496+0000","last_undegraded":"2024-09-11T23:19:06.537496+0000","last_fullsized":"2024-09-11T23:19:06.537496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577569+0000","last_change":"2024-09-11T23:19:06.577115+0000","last_active":"2024-09-11T23:19:06.577569+0000","last_peered":"2024-09-11T23:19:06.577569+0000","last_clean":"2024-09-11T23:19:06.577569+0000","last_became_active":"2024-09-11T23:19:06.576829+0000","last_became_peered":"2024-09-11T23:19:06.576829+0000","last_unstale":"2024-09-11T23:19:06.577569+0000","last_undegraded":"2024-09-11T23:19:06.577569+0000","last_fullsized":"2024-09-11T23:19:06.577569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:41.152414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535774+0000","last_change":"2024-09-11T23:19:06.535774+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535774+0000","last_undegraded":"2024-09-11T23:19:06.535774+0000","last_fullsized":"2024-09-11T23:19:06.535774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.564950+0000","last_change":"2024-09-11T23:19:06.556306+0000","last_active":"2024-09-11T23:19:06.564950+0000","last_peered":"2024-09-11T23:19:06.564950+0000","last_clean":"2024-09-11T23:19:06.564950+0000","last_became_active":"2024-09-11T23:19:06.555615+0000","last_became_peered":"2024-09-11T23:19:06.555615+0000","last_unstale":"2024-09-11T23:19:06.564950+0000","last_undegraded":"2024-09-11T23:19:06.564950+0000","last_fullsized":"2024-09-11T23:19:06.564950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.546518+0000","last_change":"2024-09-11T23:19:06.546518+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.546518+0000","last_undegraded":"2024-09-11T23:19:06.546518+0000","last_fullsized":"2024-09-11T23:19:06.546518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568273+0000","last_change":"2024-09-11T23:19:06.566084+0000","last_active":"2024-09-11T23:19:06.568273+0000","last_peered":"2024-09-11T23:19:06.568273+0000","last_clean":"2024-09-11T23:19:06.568273+0000","last_became_active":"2024-09-11T23:19:06.563321+0000","last_became_peered":"2024-09-11T23:19:06.563321+0000","last_unstale":"2024-09-11T23:19:06.568273+0000","last_undegraded":"2024-09-11T23:19:06.568273+0000","last_fullsized":"2024-09-11T23:19:06.568273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:02.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539659+0000","last_change":"2024-09-11T23:19:06.539659+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539659+0000","last_undegraded":"2024-09-11T23:19:06.539659+0000","last_fullsized":"2024-09-11T23:19:06.539659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568093+0000","last_change":"2024-09-11T23:19:06.554823+0000","last_active":"2024-09-11T23:19:06.568093+0000","last_peered":"2024-09-11T23:19:06.568093+0000","last_clean":"2024-09-11T23:19:06.568093+0000","last_became_active":"2024-09-11T23:19:06.554113+0000","last_became_peered":"2024-09-11T23:19:06.554113+0000","last_unstale":"2024-09-11T23:19:06.568093+0000","last_undegraded":"2024-09-11T23:19:06.568093+0000","last_fullsized":"2024-09-11T23:19:06.568093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:08.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535655+0000","last_change":"2024-09-11T23:19:06.535655+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535655+0000","last_undegraded":"2024-09-11T23:19:06.535655+0000","last_fullsized":"2024-09-11T23:19:06.535655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.555320+0000","last_change":"2024-09-11T23:19:06.554819+0000","last_active":"2024-09-11T23:19:06.555320+0000","last_peered":"2024-09-11T23:19:06.555320+0000","last_clean":"2024-09-11T23:19:06.555320+0000","last_became_active":"2024-09-11T23:19:06.554385+0000","last_became_peered":"2024-09-11T23:19:06.554385+0000","last_unstale":"2024-09-11T23:19:06.555320+0000","last_undegraded":"2024-09-11T23:19:06.555320+0000","last_fullsized":"2024-09-11T23:19:06.555320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:02.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.536639+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:19:06.536639+0000","last_peered":"2024-09-11T23:19:06.536639+0000","last_clean":"2024-09-11T23:19:06.536639+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:19:06.536639+0000","last_undegraded":"2024-09-11T23:19:06.536639+0000","last_fullsized":"2024-09-11T23:19:06.536639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1063207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1024000,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1024000,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36940,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334900,"statfs":{"total":96636764160,"available":96598937600,"internally_reserved":0,"allocated":1617920,"data_stored":1056540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:11.567 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:11.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.721+0000 7f3667936640 1 Processor -- start 2024-09-11T23:19:11.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3667936640 1 -- start start 2024-09-11T23:19:11.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3667936640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3660071e40 0x7f3660141350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3667936640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3660072380 con 0x7f3660140f70 2024-09-11T23:19:11.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3667936640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36600d0f90 con 0x7f3660141890 2024-09-11T23:19:11.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3667936640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3660072660 con 0x7f3660071e40 2024-09-11T23:19:11.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f36656d2640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3660140f70 0x7f3660071730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47098/0 (socket says 172.21.15.94:47098) 2024-09-11T23:19:11.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f36656d2640 1 -- 172.21.15.94:0/2739586256 learned_addr learned my addr 172.21.15.94:0/2739586256 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959086564 0 0) 0x7f3660072380 con 0x7f3660140f70 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f364c003530 con 0x7f3660140f70 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3664ed1640 1 --2- 172.21.15.94:0/2739586256 >> v2:172.21.15.155:3300/0 conn(0x7f3660071e40 0x7f3660141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3497890038 0 0) 0x7f364c003530 con 0x7f3660140f70 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 >> v2:172.21.15.155:3300/0 conn(0x7f3660071e40 msgr2=0x7f3660141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 --2- 172.21.15.94:0/2739586256 >> v2:172.21.15.155:3300/0 conn(0x7f3660071e40 0x7f3660141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 >> v1:172.21.15.155:6789/0 conn(0x7f3660141890 legacy=0x7f36600d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36600d1270 con 0x7f3660140f70 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f365c001680 con 0x7f3660140f70 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 >> v1:172.21.15.94:6789/0 conn(0x7f3660140f70 legacy=0x7f3660071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f364c0039c0 0x7f364c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f364c004810 0x7f364c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f364c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3660072660 con 0x7f364c0051d0 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f364c00c070 con 0x7f364c004810 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f364c00c270 con 0x7f364c0039c0 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3665ed3640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f364c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f36656d2640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f364c0039c0 0x7f364c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3665ed3640 1 -- 172.21.15.94:0/2739586256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f364c0039c0 msgr2=0x7f364c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:11.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3665ed3640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f364c0039c0 0x7f364c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3665ed3640 1 -- 172.21.15.94:0/2739586256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f364c004810 msgr2=0x7f364c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:11.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3665ed3640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f364c004810 0x7f364c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.725+0000 7f3665ed3640 1 -- 172.21.15.94:0/2739586256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c003530 con 0x7f364c0051d0 2024-09-11T23:19:11.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3665ed3640 1 -- 172.21.15.94:0/2739586256 reap_dead start 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3665ed3640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f364c00b9d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3658001e70 tx=0x7f365801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412d2d1af524e29c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658001a90 con 0x7f364c0051d0 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658003ba0 con 0x7f364c0051d0 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3657fff640 1 -- 172.21.15.94:0/2739586256 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658005020 con 0x7f364c0051d0 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- 172.21.15.94:0/2739586256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 msgr2=0x7f364c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f364c00b9d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3658001e70 tx=0x7f365801c780 comp rx=0 tx=0).stop 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- 172.21.15.94:0/2739586256 shutdown_connections 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 --2- 172.21.15.94:0/2739586256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f364c00b9d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- 172.21.15.94:0/2739586256 >> 172.21.15.94:0/2739586256 conn(0x7f36600b3e70 msgr2=0x7f36600b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- 172.21.15.94:0/2739586256 shutdown_connections 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- 172.21.15.94:0/2739586256 wait complete. 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 Processor -- start 2024-09-11T23:19:11.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- start start 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f36601584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f366013eb50 0x7f366015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f366015dc30 0x7f366015e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f36601416e0 con 0x7f364c0051d0 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3660141560 con 0x7f366015dc30 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3667936640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36600d15e0 con 0x7f366013eb50 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f36601584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f36601584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59412/0 (socket says 172.21.15.94:59412) 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 -- 172.21.15.94:0/1424138339 learned_addr learned my addr 172.21.15.94:0/1424138339 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3664ed1640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f366013eb50 0x7f366015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3665ed3640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f366015dc30 0x7f366015e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 -- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f366013eb50 msgr2=0x7f366015d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f366013eb50 0x7f366015d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 -- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f366015dc30 msgr2=0x7f366015e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f366015dc30 0x7f366015e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 -- 172.21.15.94:0/1424138339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3660157140 con 0x7f364c0051d0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f3665ed3640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f366015dc30 0x7f366015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.729+0000 7f36656d2640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f36601584c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f365c00d770 tx=0x7f365c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3655ffb640 1 -- 172.21.15.94:0/1424138339 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c019070 con 0x7f364c0051d0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3655ffb640 1 -- 172.21.15.94:0/1424138339 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c0074e0 con 0x7f364c0051d0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3660157420 con 0x7f364c0051d0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3655ffb640 1 -- 172.21.15.94:0/1424138339 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c004a10 con 0x7f364c0051d0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36601579e0 con 0x7f364c0051d0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3660072340 con 0x7f364c0051d0 2024-09-11T23:19:11.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3655ffb640 1 -- 172.21.15.94:0/1424138339 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f365c004bb0 con 0x7f364c0051d0 2024-09-11T23:19:11.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3655ffb640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36440678f0 0x7f3644069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3655ffb640 1 -- 172.21.15.94:0/1424138339 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f365c085730 con 0x7f364c0051d0 2024-09-11T23:19:11.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3664ed1640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36440678f0 0x7f3644069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.733+0000 7f3664ed1640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36440678f0 0x7f3644069db0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f36500047c0 tx=0x7f3650008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.737+0000 7f3655ffb640 1 -- 172.21.15.94:0/1424138339 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f365c0560e0 con 0x7f364c0051d0 2024-09-11T23:19:11.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.889+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36600b3a90 con 0x7f36440678f0 2024-09-11T23:19:11.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.909+0000 7f3655ffb640 1 -- 172.21.15.94:0/1424138339 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246768 (secure 0 0 0) 0x7f36600b3a90 con 0x7f36440678f0 2024-09-11T23:19:11.910 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:11.913 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:19:11.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36440678f0 msgr2=0x7f3644069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36440678f0 0x7f3644069db0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f36500047c0 tx=0x7f3650008040 comp rx=0 tx=0).stop 2024-09-11T23:19:11.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 msgr2=0x7f36601584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f36601584c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f365c00d770 tx=0x7f365c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:19:11.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 shutdown_connections 2024-09-11T23:19:11.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f366015dc30 0x7f366015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f366013eb50 0x7f366015d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f36440678f0 0x7f3644069db0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 --2- 172.21.15.94:0/1424138339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f364c0051d0 0x7f36601584c0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 >> 172.21.15.94:0/1424138339 conn(0x7f36600b3e70 msgr2=0x7f366013f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 shutdown_connections 2024-09-11T23:19:11.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:11.913+0000 7f3667936640 1 -- 172.21.15.94:0/1424138339 wait complete. 2024-09-11T23:19:11.929 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-11T23:19:10.048642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279556,"kb_used_data":9208,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695164,"statfs":{"total":773094113280,"available":772807847936,"internally_reserved":0,"allocated":9428992,"data_stored":4936780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527087"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.534076+0000","last_change":"2024-09-11T23:19:06.534076+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.534076+0000","last_undegraded":"2024-09-11T23:19:06.534076+0000","last_fullsized":"2024-09-11T23:19:06.534076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539932+0000","last_change":"2024-09-11T23:19:06.539932+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539932+0000","last_undegraded":"2024-09-11T23:19:06.539932+0000","last_fullsized":"2024-09-11T23:19:06.539932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.534092+0000","last_change":"2024-09-11T23:19:06.534092+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.534092+0000","last_undegraded":"2024-09-11T23:19:06.534092+0000","last_fullsized":"2024-09-11T23:19:06.534092+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544473+0000","last_change":"2024-09-11T23:19:06.544473+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544473+0000","last_undegraded":"2024-09-11T23:19:06.544473+0000","last_fullsized":"2024-09-11T23:19:06.544473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.559703+0000","last_change":"2024-09-11T23:19:06.559703+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.559703+0000","last_undegraded":"2024-09-11T23:19:06.559703+0000","last_fullsized":"2024-09-11T23:19:06.559703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542402+0000","last_change":"2024-09-11T23:19:06.542402+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542402+0000","last_undegraded":"2024-09-11T23:19:06.542402+0000","last_fullsized":"2024-09-11T23:19:06.542402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538073+0000","last_change":"2024-09-11T23:19:06.538073+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538073+0000","last_undegraded":"2024-09-11T23:19:06.538073+0000","last_fullsized":"2024-09-11T23:19:06.538073+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544073+0000","last_change":"2024-09-11T23:19:06.544073+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544073+0000","last_undegraded":"2024-09-11T23:19:06.544073+0000","last_fullsized":"2024-09-11T23:19:06.544073+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.556883+0000","last_change":"2024-09-11T23:19:06.556883+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.556883+0000","last_undegraded":"2024-09-11T23:19:06.556883+0000","last_fullsized":"2024-09-11T23:19:06.556883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.541712+0000","last_change":"2024-09-11T23:19:06.541712+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.541712+0000","last_undegraded":"2024-09-11T23:19:06.541712+0000","last_fullsized":"2024-09-11T23:19:06.541712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.556721+0000","last_change":"2024-09-11T23:19:06.556721+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.556721+0000","last_undegraded":"2024-09-11T23:19:06.556721+0000","last_fullsized":"2024-09-11T23:19:06.556721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540640+0000","last_change":"2024-09-11T23:19:06.540640+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540640+0000","last_undegraded":"2024-09-11T23:19:06.540640+0000","last_fullsized":"2024-09-11T23:19:06.540640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538125+0000","last_change":"2024-09-11T23:19:06.538125+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538125+0000","last_undegraded":"2024-09-11T23:19:06.538125+0000","last_fullsized":"2024-09-11T23:19:06.538125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.557550+0000","last_change":"2024-09-11T23:19:06.557550+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.557550+0000","last_undegraded":"2024-09-11T23:19:06.557550+0000","last_fullsized":"2024-09-11T23:19:06.557550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544007+0000","last_change":"2024-09-11T23:19:06.544007+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544007+0000","last_undegraded":"2024-09-11T23:19:06.544007+0000","last_fullsized":"2024-09-11T23:19:06.544007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537821+0000","last_change":"2024-09-11T23:19:06.537821+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537821+0000","last_undegraded":"2024-09-11T23:19:06.537821+0000","last_fullsized":"2024-09-11T23:19:06.537821+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539707+0000","last_change":"2024-09-11T23:19:06.539707+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539707+0000","last_undegraded":"2024-09-11T23:19:06.539707+0000","last_fullsized":"2024-09-11T23:19:06.539707+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535980+0000","last_change":"2024-09-11T23:19:06.535980+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535980+0000","last_undegraded":"2024-09-11T23:19:06.535980+0000","last_fullsized":"2024-09-11T23:19:06.535980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.555007+0000","last_change":"2024-09-11T23:19:06.555007+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.555007+0000","last_undegraded":"2024-09-11T23:19:06.555007+0000","last_fullsized":"2024-09-11T23:19:06.555007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538706+0000","last_change":"2024-09-11T23:19:06.538706+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538706+0000","last_undegraded":"2024-09-11T23:19:06.538706+0000","last_fullsized":"2024-09-11T23:19:06.538706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.557954+0000","last_change":"2024-09-11T23:19:06.557954+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.557954+0000","last_undegraded":"2024-09-11T23:19:06.557954+0000","last_fullsized":"2024-09-11T23:19:06.557954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.550676+0000","last_change":"2024-09-11T23:19:06.550676+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.550676+0000","last_undegraded":"2024-09-11T23:19:06.550676+0000","last_fullsized":"2024-09-11T23:19:06.550676+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.549710+0000","last_change":"2024-09-11T23:19:06.549710+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.549710+0000","last_undegraded":"2024-09-11T23:19:06.549710+0000","last_fullsized":"2024-09-11T23:19:06.549710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.534514+0000","last_change":"2024-09-11T23:19:06.534514+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.534514+0000","last_undegraded":"2024-09-11T23:19:06.534514+0000","last_fullsized":"2024-09-11T23:19:06.534514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540912+0000","last_change":"2024-09-11T23:19:06.540912+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540912+0000","last_undegraded":"2024-09-11T23:19:06.540912+0000","last_fullsized":"2024-09-11T23:19:06.540912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.548446+0000","last_change":"2024-09-11T23:19:06.548446+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.548446+0000","last_undegraded":"2024-09-11T23:19:06.548446+0000","last_fullsized":"2024-09-11T23:19:06.548446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539926+0000","last_change":"2024-09-11T23:19:06.539926+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539926+0000","last_undegraded":"2024-09-11T23:19:06.539926+0000","last_fullsized":"2024-09-11T23:19:06.539926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538229+0000","last_change":"2024-09-11T23:19:06.538229+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538229+0000","last_undegraded":"2024-09-11T23:19:06.538229+0000","last_fullsized":"2024-09-11T23:19:06.538229+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535915+0000","last_change":"2024-09-11T23:19:06.535915+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535915+0000","last_undegraded":"2024-09-11T23:19:06.535915+0000","last_fullsized":"2024-09-11T23:19:06.535915+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542959+0000","last_change":"2024-09-11T23:19:06.542959+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542959+0000","last_undegraded":"2024-09-11T23:19:06.542959+0000","last_fullsized":"2024-09-11T23:19:06.542959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.551841+0000","last_change":"2024-09-11T23:19:06.551841+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.551841+0000","last_undegraded":"2024-09-11T23:19:06.551841+0000","last_fullsized":"2024-09-11T23:19:06.551841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537422+0000","last_change":"2024-09-11T23:19:06.537422+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537422+0000","last_undegraded":"2024-09-11T23:19:06.537422+0000","last_fullsized":"2024-09-11T23:19:06.537422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537529+0000","last_change":"2024-09-11T23:19:06.537529+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537529+0000","last_undegraded":"2024-09-11T23:19:06.537529+0000","last_fullsized":"2024-09-11T23:19:06.537529+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.566026+0000","last_change":"2024-09-11T23:19:06.560592+0000","last_active":"2024-09-11T23:19:06.566026+0000","last_peered":"2024-09-11T23:19:06.566026+0000","last_clean":"2024-09-11T23:19:06.566026+0000","last_became_active":"2024-09-11T23:19:06.559887+0000","last_became_peered":"2024-09-11T23:19:06.559887+0000","last_unstale":"2024-09-11T23:19:06.566026+0000","last_undegraded":"2024-09-11T23:19:06.566026+0000","last_fullsized":"2024-09-11T23:19:06.566026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:39.017205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538383+0000","last_change":"2024-09-11T23:19:06.538383+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538383+0000","last_undegraded":"2024-09-11T23:19:06.538383+0000","last_fullsized":"2024-09-11T23:19:06.538383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.578442+0000","last_change":"2024-09-11T23:19:06.575536+0000","last_active":"2024-09-11T23:19:06.578442+0000","last_peered":"2024-09-11T23:19:06.578442+0000","last_clean":"2024-09-11T23:19:06.578442+0000","last_became_active":"2024-09-11T23:19:06.574927+0000","last_became_peered":"2024-09-11T23:19:06.574927+0000","last_unstale":"2024-09-11T23:19:06.578442+0000","last_undegraded":"2024-09-11T23:19:06.578442+0000","last_fullsized":"2024-09-11T23:19:06.578442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:24.883911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539554+0000","last_change":"2024-09-11T23:19:06.539554+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539554+0000","last_undegraded":"2024-09-11T23:19:06.539554+0000","last_fullsized":"2024-09-11T23:19:06.539554+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.567939+0000","last_change":"2024-09-11T23:19:06.553845+0000","last_active":"2024-09-11T23:19:06.567939+0000","last_peered":"2024-09-11T23:19:06.567939+0000","last_clean":"2024-09-11T23:19:06.567939+0000","last_became_active":"2024-09-11T23:19:06.552969+0000","last_became_peered":"2024-09-11T23:19:06.552969+0000","last_unstale":"2024-09-11T23:19:06.567939+0000","last_undegraded":"2024-09-11T23:19:06.567939+0000","last_fullsized":"2024-09-11T23:19:06.567939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:28.270481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539283+0000","last_change":"2024-09-11T23:19:06.539283+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539283+0000","last_undegraded":"2024-09-11T23:19:06.539283+0000","last_fullsized":"2024-09-11T23:19:06.539283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.567017+0000","last_change":"2024-09-11T23:19:06.564108+0000","last_active":"2024-09-11T23:19:06.567017+0000","last_peered":"2024-09-11T23:19:06.567017+0000","last_clean":"2024-09-11T23:19:06.567017+0000","last_became_active":"2024-09-11T23:19:06.563110+0000","last_became_peered":"2024-09-11T23:19:06.563110+0000","last_unstale":"2024-09-11T23:19:06.567017+0000","last_undegraded":"2024-09-11T23:19:06.567017+0000","last_fullsized":"2024-09-11T23:19:06.567017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:11.557639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538775+0000","last_change":"2024-09-11T23:19:06.538775+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538775+0000","last_undegraded":"2024-09-11T23:19:06.538775+0000","last_fullsized":"2024-09-11T23:19:06.538775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.576460+0000","last_change":"2024-09-11T23:19:06.561822+0000","last_active":"2024-09-11T23:19:06.576460+0000","last_peered":"2024-09-11T23:19:06.576460+0000","last_clean":"2024-09-11T23:19:06.576460+0000","last_became_active":"2024-09-11T23:19:06.560453+0000","last_became_peered":"2024-09-11T23:19:06.560453+0000","last_unstale":"2024-09-11T23:19:06.576460+0000","last_undegraded":"2024-09-11T23:19:06.576460+0000","last_fullsized":"2024-09-11T23:19:06.576460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:49.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.548200+0000","last_change":"2024-09-11T23:19:06.548200+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.548200+0000","last_undegraded":"2024-09-11T23:19:06.548200+0000","last_fullsized":"2024-09-11T23:19:06.548200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.553501+0000","last_change":"2024-09-11T23:19:06.552799+0000","last_active":"2024-09-11T23:19:06.553501+0000","last_peered":"2024-09-11T23:19:06.553501+0000","last_clean":"2024-09-11T23:19:06.553501+0000","last_became_active":"2024-09-11T23:19:06.551350+0000","last_became_peered":"2024-09-11T23:19:06.551350+0000","last_unstale":"2024-09-11T23:19:06.553501+0000","last_undegraded":"2024-09-11T23:19:06.553501+0000","last_fullsized":"2024-09-11T23:19:06.553501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:11.557639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.541977+0000","last_change":"2024-09-11T23:19:06.541977+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.541977+0000","last_undegraded":"2024-09-11T23:19:06.541977+0000","last_fullsized":"2024-09-11T23:19:06.541977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.555503+0000","last_change":"2024-09-11T23:19:06.554582+0000","last_active":"2024-09-11T23:19:06.555503+0000","last_peered":"2024-09-11T23:19:06.555503+0000","last_clean":"2024-09-11T23:19:06.555503+0000","last_became_active":"2024-09-11T23:19:06.554159+0000","last_became_peered":"2024-09-11T23:19:06.554159+0000","last_unstale":"2024-09-11T23:19:06.555503+0000","last_undegraded":"2024-09-11T23:19:06.555503+0000","last_fullsized":"2024-09-11T23:19:06.555503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.758800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537775+0000","last_change":"2024-09-11T23:19:06.537775+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537775+0000","last_undegraded":"2024-09-11T23:19:06.537775+0000","last_fullsized":"2024-09-11T23:19:06.537775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.559809+0000","last_change":"2024-09-11T23:19:06.545476+0000","last_active":"2024-09-11T23:19:06.559809+0000","last_peered":"2024-09-11T23:19:06.559809+0000","last_clean":"2024-09-11T23:19:06.559809+0000","last_became_active":"2024-09-11T23:19:06.544759+0000","last_became_peered":"2024-09-11T23:19:06.544759+0000","last_unstale":"2024-09-11T23:19:06.559809+0000","last_undegraded":"2024-09-11T23:19:06.559809+0000","last_fullsized":"2024-09-11T23:19:06.559809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:41.685199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.544287+0000","last_change":"2024-09-11T23:19:06.544287+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.544287+0000","last_undegraded":"2024-09-11T23:19:06.544287+0000","last_fullsized":"2024-09-11T23:19:06.544287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568240+0000","last_change":"2024-09-11T23:19:06.562370+0000","last_active":"2024-09-11T23:19:06.568240+0000","last_peered":"2024-09-11T23:19:06.568240+0000","last_clean":"2024-09-11T23:19:06.568240+0000","last_became_active":"2024-09-11T23:19:06.561679+0000","last_became_peered":"2024-09-11T23:19:06.561679+0000","last_unstale":"2024-09-11T23:19:06.568240+0000","last_undegraded":"2024-09-11T23:19:06.568240+0000","last_fullsized":"2024-09-11T23:19:06.568240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:16.621187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537034+0000","last_change":"2024-09-11T23:19:06.537034+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537034+0000","last_undegraded":"2024-09-11T23:19:06.537034+0000","last_fullsized":"2024-09-11T23:19:06.537034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.548413+0000","last_change":"2024-09-11T23:19:06.547195+0000","last_active":"2024-09-11T23:19:06.548413+0000","last_peered":"2024-09-11T23:19:06.548413+0000","last_clean":"2024-09-11T23:19:06.548413+0000","last_became_active":"2024-09-11T23:19:06.546903+0000","last_became_peered":"2024-09-11T23:19:06.546903+0000","last_unstale":"2024-09-11T23:19:06.548413+0000","last_undegraded":"2024-09-11T23:19:06.548413+0000","last_fullsized":"2024-09-11T23:19:06.548413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535327+0000","last_change":"2024-09-11T23:19:06.535327+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535327+0000","last_undegraded":"2024-09-11T23:19:06.535327+0000","last_fullsized":"2024-09-11T23:19:06.535327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.578693+0000","last_change":"2024-09-11T23:19:06.576092+0000","last_active":"2024-09-11T23:19:06.578693+0000","last_peered":"2024-09-11T23:19:06.578693+0000","last_clean":"2024-09-11T23:19:06.578693+0000","last_became_active":"2024-09-11T23:19:06.574510+0000","last_became_peered":"2024-09-11T23:19:06.574510+0000","last_unstale":"2024-09-11T23:19:06.578693+0000","last_undegraded":"2024-09-11T23:19:06.578693+0000","last_fullsized":"2024-09-11T23:19:06.578693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:50.041152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535692+0000","last_change":"2024-09-11T23:19:06.535692+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535692+0000","last_undegraded":"2024-09-11T23:19:06.535692+0000","last_fullsized":"2024-09-11T23:19:06.535692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.563299+0000","last_change":"2024-09-11T23:19:06.562096+0000","last_active":"2024-09-11T23:19:06.563299+0000","last_peered":"2024-09-11T23:19:06.563299+0000","last_clean":"2024-09-11T23:19:06.563299+0000","last_became_active":"2024-09-11T23:19:06.561837+0000","last_became_peered":"2024-09-11T23:19:06.561837+0000","last_unstale":"2024-09-11T23:19:06.563299+0000","last_undegraded":"2024-09-11T23:19:06.563299+0000","last_fullsized":"2024-09-11T23:19:06.563299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.715563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535251+0000","last_change":"2024-09-11T23:19:06.535251+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535251+0000","last_undegraded":"2024-09-11T23:19:06.535251+0000","last_fullsized":"2024-09-11T23:19:06.535251+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568176+0000","last_change":"2024-09-11T23:19:06.556199+0000","last_active":"2024-09-11T23:19:06.568176+0000","last_peered":"2024-09-11T23:19:06.568176+0000","last_clean":"2024-09-11T23:19:06.568176+0000","last_became_active":"2024-09-11T23:19:06.555517+0000","last_became_peered":"2024-09-11T23:19:06.555517+0000","last_unstale":"2024-09-11T23:19:06.568176+0000","last_undegraded":"2024-09-11T23:19:06.568176+0000","last_fullsized":"2024-09-11T23:19:06.568176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542537+0000","last_change":"2024-09-11T23:19:06.542537+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542537+0000","last_undegraded":"2024-09-11T23:19:06.542537+0000","last_fullsized":"2024-09-11T23:19:06.542537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577563+0000","last_change":"2024-09-11T23:19:06.577144+0000","last_active":"2024-09-11T23:19:06.577563+0000","last_peered":"2024-09-11T23:19:06.577563+0000","last_clean":"2024-09-11T23:19:06.577563+0000","last_became_active":"2024-09-11T23:19:06.576853+0000","last_became_peered":"2024-09-11T23:19:06.576853+0000","last_unstale":"2024-09-11T23:19:06.577563+0000","last_undegraded":"2024-09-11T23:19:06.577563+0000","last_fullsized":"2024-09-11T23:19:06.577563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:41.995704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538417+0000","last_change":"2024-09-11T23:19:06.538417+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538417+0000","last_undegraded":"2024-09-11T23:19:06.538417+0000","last_fullsized":"2024-09-11T23:19:06.538417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.563795+0000","last_change":"2024-09-11T23:19:06.563280+0000","last_active":"2024-09-11T23:19:06.563795+0000","last_peered":"2024-09-11T23:19:06.563795+0000","last_clean":"2024-09-11T23:19:06.563795+0000","last_became_active":"2024-09-11T23:19:06.562981+0000","last_became_peered":"2024-09-11T23:19:06.562981+0000","last_unstale":"2024-09-11T23:19:06.563795+0000","last_undegraded":"2024-09-11T23:19:06.563795+0000","last_fullsized":"2024-09-11T23:19:06.563795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:02.969318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538885+0000","last_change":"2024-09-11T23:19:06.538885+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538885+0000","last_undegraded":"2024-09-11T23:19:06.538885+0000","last_fullsized":"2024-09-11T23:19:06.538885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.551417+0000","last_change":"2024-09-11T23:19:06.550310+0000","last_active":"2024-09-11T23:19:06.551417+0000","last_peered":"2024-09-11T23:19:06.551417+0000","last_clean":"2024-09-11T23:19:06.551417+0000","last_became_active":"2024-09-11T23:19:06.550073+0000","last_became_peered":"2024-09-11T23:19:06.550073+0000","last_unstale":"2024-09-11T23:19:06.551417+0000","last_undegraded":"2024-09-11T23:19:06.551417+0000","last_fullsized":"2024-09-11T23:19:06.551417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:39.017205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537052+0000","last_change":"2024-09-11T23:19:06.537052+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537052+0000","last_undegraded":"2024-09-11T23:19:06.537052+0000","last_fullsized":"2024-09-11T23:19:06.537052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.572941+0000","last_change":"2024-09-11T23:19:06.569779+0000","last_active":"2024-09-11T23:19:06.572941+0000","last_peered":"2024-09-11T23:19:06.572941+0000","last_clean":"2024-09-11T23:19:06.572941+0000","last_became_active":"2024-09-11T23:19:06.569044+0000","last_became_peered":"2024-09-11T23:19:06.569044+0000","last_unstale":"2024-09-11T23:19:06.572941+0000","last_undegraded":"2024-09-11T23:19:06.572941+0000","last_fullsized":"2024-09-11T23:19:06.572941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:02.969318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.545858+0000","last_change":"2024-09-11T23:19:06.545858+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.545858+0000","last_undegraded":"2024-09-11T23:19:06.545858+0000","last_fullsized":"2024-09-11T23:19:06.545858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568414+0000","last_change":"2024-09-11T23:19:06.566301+0000","last_active":"2024-09-11T23:19:06.568414+0000","last_peered":"2024-09-11T23:19:06.568414+0000","last_clean":"2024-09-11T23:19:06.568414+0000","last_became_active":"2024-09-11T23:19:06.565597+0000","last_became_peered":"2024-09-11T23:19:06.565597+0000","last_unstale":"2024-09-11T23:19:06.568414+0000","last_undegraded":"2024-09-11T23:19:06.568414+0000","last_fullsized":"2024-09-11T23:19:06.568414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:27.606512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.547489+0000","last_change":"2024-09-11T23:19:06.547489+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.547489+0000","last_undegraded":"2024-09-11T23:19:06.547489+0000","last_fullsized":"2024-09-11T23:19:06.547489+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.576520+0000","last_change":"2024-09-11T23:19:06.571225+0000","last_active":"2024-09-11T23:19:06.576520+0000","last_peered":"2024-09-11T23:19:06.576520+0000","last_clean":"2024-09-11T23:19:06.576520+0000","last_became_active":"2024-09-11T23:19:06.570625+0000","last_became_peered":"2024-09-11T23:19:06.570625+0000","last_unstale":"2024-09-11T23:19:06.576520+0000","last_undegraded":"2024-09-11T23:19:06.576520+0000","last_fullsized":"2024-09-11T23:19:06.576520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:57.124863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.536900+0000","last_change":"2024-09-11T23:19:06.536900+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.536900+0000","last_undegraded":"2024-09-11T23:19:06.536900+0000","last_fullsized":"2024-09-11T23:19:06.536900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.565094+0000","last_change":"2024-09-11T23:19:06.554094+0000","last_active":"2024-09-11T23:19:06.565094+0000","last_peered":"2024-09-11T23:19:06.565094+0000","last_clean":"2024-09-11T23:19:06.565094+0000","last_became_active":"2024-09-11T23:19:06.553375+0000","last_became_peered":"2024-09-11T23:19:06.553375+0000","last_unstale":"2024-09-11T23:19:06.565094+0000","last_undegraded":"2024-09-11T23:19:06.565094+0000","last_fullsized":"2024-09-11T23:19:06.565094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542178+0000","last_change":"2024-09-11T23:19:06.542178+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542178+0000","last_undegraded":"2024-09-11T23:19:06.542178+0000","last_fullsized":"2024-09-11T23:19:06.542178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.551184+0000","last_change":"2024-09-11T23:19:06.546448+0000","last_active":"2024-09-11T23:19:06.551184+0000","last_peered":"2024-09-11T23:19:06.551184+0000","last_clean":"2024-09-11T23:19:06.551184+0000","last_became_active":"2024-09-11T23:19:06.545743+0000","last_became_peered":"2024-09-11T23:19:06.545743+0000","last_unstale":"2024-09-11T23:19:06.551184+0000","last_undegraded":"2024-09-11T23:19:06.551184+0000","last_fullsized":"2024-09-11T23:19:06.551184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:35.266194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538492+0000","last_change":"2024-09-11T23:19:06.538492+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538492+0000","last_undegraded":"2024-09-11T23:19:06.538492+0000","last_fullsized":"2024-09-11T23:19:06.538492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.566272+0000","last_change":"2024-09-11T23:19:06.558413+0000","last_active":"2024-09-11T23:19:06.566272+0000","last_peered":"2024-09-11T23:19:06.566272+0000","last_clean":"2024-09-11T23:19:06.566272+0000","last_became_active":"2024-09-11T23:19:06.557721+0000","last_became_peered":"2024-09-11T23:19:06.557721+0000","last_unstale":"2024-09-11T23:19:06.566272+0000","last_undegraded":"2024-09-11T23:19:06.566272+0000","last_fullsized":"2024-09-11T23:19:06.566272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540633+0000","last_change":"2024-09-11T23:19:06.540633+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540633+0000","last_undegraded":"2024-09-11T23:19:06.540633+0000","last_fullsized":"2024-09-11T23:19:06.540633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.557827+0000","last_change":"2024-09-11T23:19:06.557333+0000","last_active":"2024-09-11T23:19:06.557827+0000","last_peered":"2024-09-11T23:19:06.557827+0000","last_clean":"2024-09-11T23:19:06.557827+0000","last_became_active":"2024-09-11T23:19:06.556598+0000","last_became_peered":"2024-09-11T23:19:06.556598+0000","last_unstale":"2024-09-11T23:19:06.557827+0000","last_undegraded":"2024-09-11T23:19:06.557827+0000","last_fullsized":"2024-09-11T23:19:06.557827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:15.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.551122+0000","last_change":"2024-09-11T23:19:06.551122+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.551122+0000","last_undegraded":"2024-09-11T23:19:06.551122+0000","last_fullsized":"2024-09-11T23:19:06.551122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568330+0000","last_change":"2024-09-11T23:19:06.565340+0000","last_active":"2024-09-11T23:19:06.568330+0000","last_peered":"2024-09-11T23:19:06.568330+0000","last_clean":"2024-09-11T23:19:06.568330+0000","last_became_active":"2024-09-11T23:19:06.564535+0000","last_became_peered":"2024-09-11T23:19:06.564535+0000","last_unstale":"2024-09-11T23:19:06.568330+0000","last_undegraded":"2024-09-11T23:19:06.568330+0000","last_fullsized":"2024-09-11T23:19:06.568330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.758800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537276+0000","last_change":"2024-09-11T23:19:06.537276+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537276+0000","last_undegraded":"2024-09-11T23:19:06.537276+0000","last_fullsized":"2024-09-11T23:19:06.537276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577450+0000","last_change":"2024-09-11T23:19:06.574920+0000","last_active":"2024-09-11T23:19:06.577450+0000","last_peered":"2024-09-11T23:19:06.577450+0000","last_clean":"2024-09-11T23:19:06.577450+0000","last_became_active":"2024-09-11T23:19:06.571154+0000","last_became_peered":"2024-09-11T23:19:06.571154+0000","last_unstale":"2024-09-11T23:19:06.577450+0000","last_undegraded":"2024-09-11T23:19:06.577450+0000","last_fullsized":"2024-09-11T23:19:06.577450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:54.118088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.541487+0000","last_change":"2024-09-11T23:19:06.541487+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.541487+0000","last_undegraded":"2024-09-11T23:19:06.541487+0000","last_fullsized":"2024-09-11T23:19:06.541487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577522+0000","last_change":"2024-09-11T23:19:06.575470+0000","last_active":"2024-09-11T23:19:06.577522+0000","last_peered":"2024-09-11T23:19:06.577522+0000","last_clean":"2024-09-11T23:19:06.577522+0000","last_became_active":"2024-09-11T23:19:06.572387+0000","last_became_peered":"2024-09-11T23:19:06.572387+0000","last_unstale":"2024-09-11T23:19:06.577522+0000","last_undegraded":"2024-09-11T23:19:06.577522+0000","last_fullsized":"2024-09-11T23:19:06.577522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:06.000044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539784+0000","last_change":"2024-09-11T23:19:06.539784+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539784+0000","last_undegraded":"2024-09-11T23:19:06.539784+0000","last_fullsized":"2024-09-11T23:19:06.539784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.564472+0000","last_change":"2024-09-11T23:19:06.559238+0000","last_active":"2024-09-11T23:19:06.564472+0000","last_peered":"2024-09-11T23:19:06.564472+0000","last_clean":"2024-09-11T23:19:06.564472+0000","last_became_active":"2024-09-11T23:19:06.558411+0000","last_became_peered":"2024-09-11T23:19:06.558411+0000","last_unstale":"2024-09-11T23:19:06.564472+0000","last_undegraded":"2024-09-11T23:19:06.564472+0000","last_fullsized":"2024-09-11T23:19:06.564472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:08.837460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.537496+0000","last_change":"2024-09-11T23:19:06.537496+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.537496+0000","last_undegraded":"2024-09-11T23:19:06.537496+0000","last_fullsized":"2024-09-11T23:19:06.537496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.577569+0000","last_change":"2024-09-11T23:19:06.577115+0000","last_active":"2024-09-11T23:19:06.577569+0000","last_peered":"2024-09-11T23:19:06.577569+0000","last_clean":"2024-09-11T23:19:06.577569+0000","last_became_active":"2024-09-11T23:19:06.576829+0000","last_became_peered":"2024-09-11T23:19:06.576829+0000","last_unstale":"2024-09-11T23:19:06.577569+0000","last_undegraded":"2024-09-11T23:19:06.577569+0000","last_fullsized":"2024-09-11T23:19:06.577569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:41.152414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535774+0000","last_change":"2024-09-11T23:19:06.535774+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535774+0000","last_undegraded":"2024-09-11T23:19:06.535774+0000","last_fullsized":"2024-09-11T23:19:06.535774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.564950+0000","last_change":"2024-09-11T23:19:06.556306+0000","last_active":"2024-09-11T23:19:06.564950+0000","last_peered":"2024-09-11T23:19:06.564950+0000","last_clean":"2024-09-11T23:19:06.564950+0000","last_became_active":"2024-09-11T23:19:06.555615+0000","last_became_peered":"2024-09-11T23:19:06.555615+0000","last_unstale":"2024-09-11T23:19:06.564950+0000","last_undegraded":"2024-09-11T23:19:06.564950+0000","last_fullsized":"2024-09-11T23:19:06.564950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.546518+0000","last_change":"2024-09-11T23:19:06.546518+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.546518+0000","last_undegraded":"2024-09-11T23:19:06.546518+0000","last_fullsized":"2024-09-11T23:19:06.546518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568273+0000","last_change":"2024-09-11T23:19:06.566084+0000","last_active":"2024-09-11T23:19:06.568273+0000","last_peered":"2024-09-11T23:19:06.568273+0000","last_clean":"2024-09-11T23:19:06.568273+0000","last_became_active":"2024-09-11T23:19:06.563321+0000","last_became_peered":"2024-09-11T23:19:06.563321+0000","last_unstale":"2024-09-11T23:19:06.568273+0000","last_undegraded":"2024-09-11T23:19:06.568273+0000","last_fullsized":"2024-09-11T23:19:06.568273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:02.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539659+0000","last_change":"2024-09-11T23:19:06.539659+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539659+0000","last_undegraded":"2024-09-11T23:19:06.539659+0000","last_fullsized":"2024-09-11T23:19:06.539659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568093+0000","last_change":"2024-09-11T23:19:06.554823+0000","last_active":"2024-09-11T23:19:06.568093+0000","last_peered":"2024-09-11T23:19:06.568093+0000","last_clean":"2024-09-11T23:19:06.568093+0000","last_became_active":"2024-09-11T23:19:06.554113+0000","last_became_peered":"2024-09-11T23:19:06.554113+0000","last_unstale":"2024-09-11T23:19:06.568093+0000","last_undegraded":"2024-09-11T23:19:06.568093+0000","last_fullsized":"2024-09-11T23:19:06.568093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:08.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.535655+0000","last_change":"2024-09-11T23:19:06.535655+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.535655+0000","last_undegraded":"2024-09-11T23:19:06.535655+0000","last_fullsized":"2024-09-11T23:19:06.535655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.555320+0000","last_change":"2024-09-11T23:19:06.554819+0000","last_active":"2024-09-11T23:19:06.555320+0000","last_peered":"2024-09-11T23:19:06.555320+0000","last_clean":"2024-09-11T23:19:06.555320+0000","last_became_active":"2024-09-11T23:19:06.554385+0000","last_became_peered":"2024-09-11T23:19:06.554385+0000","last_unstale":"2024-09-11T23:19:06.555320+0000","last_undegraded":"2024-09-11T23:19:06.555320+0000","last_fullsized":"2024-09-11T23:19:06.555320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:02.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.536639+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:19:06.536639+0000","last_peered":"2024-09-11T23:19:06.536639+0000","last_clean":"2024-09-11T23:19:06.536639+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:19:06.536639+0000","last_undegraded":"2024-09-11T23:19:06.536639+0000","last_fullsized":"2024-09-11T23:19:06.536639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1063207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1024000,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1024000,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36940,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334900,"statfs":{"total":96636764160,"available":96598937600,"internally_reserved":0,"allocated":1617920,"data_stored":1056540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:11.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:12.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.089+0000 7f34bac28640 1 Processor -- start 2024-09-11T23:19:12.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.089+0000 7f34bac28640 1 -- start start 2024-09-11T23:19:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34bac28640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f34b415c2a0 0x7f34b40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34bac28640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34bac28640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b40b3290 con 0x7f34b415bec0 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34bac28640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f34b40b3570 con 0x7f34b415c2a0 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34bac28640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34b40b3850 con 0x7f34b40af2a0 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f34b415c2a0 0x7f34b40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b89c4640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f34b415bec0 0x7f34b40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47112/0 (socket says 172.21.15.94:47112) 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b89c4640 1 -- 172.21.15.94:0/3640298899 learned_addr learned my addr 172.21.15.94:0/3640298899 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b3fff640 1 -- 172.21.15.94:0/3640298899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 msgr2=0x7f34b406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b91c5640 1 --2- 172.21.15.94:0/3640298899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b3fff640 1 --2- 172.21.15.94:0/3640298899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b3fff640 1 -- 172.21.15.94:0/3640298899 >> v1:172.21.15.94:6789/0 conn(0x7f34b415bec0 legacy=0x7f34b40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b3fff640 1 -- 172.21.15.94:0/3640298899 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b40b3b30 con 0x7f34b415c2a0 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b37fe640 1 -- 172.21.15.94:0/3640298899 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910231285 0 0) 0x7f34b40b3290 con 0x7f34b415bec0 2024-09-11T23:19:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b91c5640 1 --2- 172.21.15.94:0/3640298899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:12.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b3fff640 1 --2- 172.21.15.94:0/3640298899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b40aed60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96211b6456d5432 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b37fe640 1 -- 172.21.15.94:0/3640298899 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0a7070 con 0x7f34b415c2a0 2024-09-11T23:19:12.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b37fe640 1 -- 172.21.15.94:0/3640298899 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349c0b0070 con 0x7f34b415c2a0 2024-09-11T23:19:12.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.093+0000 7f34b37fe640 1 -- 172.21.15.94:0/3640298899 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0ab890 con 0x7f34b415c2a0 2024-09-11T23:19:12.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/3640298899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 msgr2=0x7f34b40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 --2- 172.21.15.94:0/3640298899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b40aed60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c470 comp rx=0 tx=0).stop 2024-09-11T23:19:12.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/3640298899 shutdown_connections 2024-09-11T23:19:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 --2- 172.21.15.94:0/3640298899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 --2- 172.21.15.94:0/3640298899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b40aed60 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/3640298899 >> 172.21.15.94:0/3640298899 conn(0x7f34b40b1f90 msgr2=0x7f34b40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/3640298899 shutdown_connections 2024-09-11T23:19:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/3640298899 wait complete. 2024-09-11T23:19:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 Processor -- start 2024-09-11T23:19:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- start start 2024-09-11T23:19:12.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b413f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b415bec0 0x7f34b41f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f34b406ed50 con 0x7f34b415c2a0 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34b40af6b0 con 0x7f34b415bec0 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34b406eed0 con 0x7f34b40af2a0 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b415ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59426/0 (socket says 172.21.15.94:59426) 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 -- 172.21.15.94:0/97539913 learned_addr learned my addr 172.21.15.94:0/97539913 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b3fff640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b415bec0 0x7f34b41f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b89c4640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b413f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 -- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 msgr2=0x7f34b413f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b413f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 -- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b415bec0 msgr2=0x7f34b41f70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b415bec0 0x7f34b41f70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 -- 172.21.15.94:0/97539913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b41546a0 con 0x7f34b415c2a0 2024-09-11T23:19:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b91c5640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b415ed80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00cf20 tx=0x7f34ac00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b17fa640 1 -- 172.21.15.94:0/97539913 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac01a070 con 0x7f34b415c2a0 2024-09-11T23:19:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b17fa640 1 -- 172.21.15.94:0/97539913 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac00d840 con 0x7f34b415c2a0 2024-09-11T23:19:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b415d240 con 0x7f34b415c2a0 2024-09-11T23:19:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34b17fa640 1 -- 172.21.15.94:0/97539913 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00dc30 con 0x7f34b415c2a0 2024-09-11T23:19:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b4154960 con 0x7f34b415c2a0 2024-09-11T23:19:12.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.097+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b406e000 con 0x7f34b415c2a0 2024-09-11T23:19:12.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.101+0000 7f34b17fa640 1 -- 172.21.15.94:0/97539913 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34ac01d070 con 0x7f34b415c2a0 2024-09-11T23:19:12.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.101+0000 7f34b17fa640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34940678c0 0x7f3494069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.101+0000 7f34b17fa640 1 -- 172.21.15.94:0/97539913 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f34ac0866d0 con 0x7f34b415c2a0 2024-09-11T23:19:12.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.101+0000 7f34b89c4640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34940678c0 0x7f3494069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.101+0000 7f34b89c4640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34940678c0 0x7f3494069d80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f34a4000f70 tx=0x7f34a4007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.105+0000 7f34b17fa640 1 -- 172.21.15.94:0/97539913 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34ac057080 con 0x7f34b415c2a0 2024-09-11T23:19:12.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.261+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34b41f7610 con 0x7f34940678c0 2024-09-11T23:19:12.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.277+0000 7f34b17fa640 1 -- 172.21.15.94:0/97539913 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251583 (secure 0 0 0) 0x7f34a40071f0 con 0x7f34940678c0 2024-09-11T23:19:12.281 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:19:12.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34940678c0 msgr2=0x7f3494069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34940678c0 0x7f3494069d80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f34a4000f70 tx=0x7f34a4007b60 comp rx=0 tx=0).stop 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 msgr2=0x7f34b415ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b415ed80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00cf20 tx=0x7f34ac00a7d0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 shutdown_connections 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34940678c0 0x7f3494069d80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34b415c2a0 0x7f34b415ed80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b415bec0 0x7f34b41f70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 --2- 172.21.15.94:0/97539913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b40af2a0 0x7f34b413f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 >> 172.21.15.94:0/97539913 conn(0x7f34b40b1f90 msgr2=0x7f34b40cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 shutdown_connections 2024-09-11T23:19:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.281+0000 7f34bac28640 1 -- 172.21.15.94:0/97539913 wait complete. 2024-09-11T23:19:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-11T23:19:12.049337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279824,"kb_used_data":9488,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754694896,"statfs":{"total":773094113280,"available":772807573504,"internally_reserved":0,"allocated":9715712,"data_stored":5065281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001885"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720142+0000","last_change":"2024-09-11T23:19:07.295568+0000","last_active":"2024-09-11T23:19:08.720142+0000","last_peered":"2024-09-11T23:19:08.720142+0000","last_clean":"2024-09-11T23:19:08.720142+0000","last_became_active":"2024-09-11T23:19:07.294521+0000","last_became_peered":"2024-09-11T23:19:07.294521+0000","last_unstale":"2024-09-11T23:19:08.720142+0000","last_undegraded":"2024-09-11T23:19:08.720142+0000","last_fullsized":"2024-09-11T23:19:08.720142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539932+0000","last_change":"2024-09-11T23:19:06.539932+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539932+0000","last_undegraded":"2024-09-11T23:19:06.539932+0000","last_fullsized":"2024-09-11T23:19:06.539932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717804+0000","last_change":"2024-09-11T23:19:07.287941+0000","last_active":"2024-09-11T23:19:08.717804+0000","last_peered":"2024-09-11T23:19:08.717804+0000","last_clean":"2024-09-11T23:19:08.717804+0000","last_became_active":"2024-09-11T23:19:07.287130+0000","last_became_peered":"2024-09-11T23:19:07.287130+0000","last_unstale":"2024-09-11T23:19:08.717804+0000","last_undegraded":"2024-09-11T23:19:08.717804+0000","last_fullsized":"2024-09-11T23:19:08.717804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720523+0000","last_change":"2024-09-11T23:19:07.285031+0000","last_active":"2024-09-11T23:19:08.720523+0000","last_peered":"2024-09-11T23:19:08.720523+0000","last_clean":"2024-09-11T23:19:08.720523+0000","last_became_active":"2024-09-11T23:19:07.284370+0000","last_became_peered":"2024-09-11T23:19:07.284370+0000","last_unstale":"2024-09-11T23:19:08.720523+0000","last_undegraded":"2024-09-11T23:19:08.720523+0000","last_fullsized":"2024-09-11T23:19:08.720523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:42.999802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716775+0000","last_change":"2024-09-11T23:19:07.280084+0000","last_active":"2024-09-11T23:19:08.716775+0000","last_peered":"2024-09-11T23:19:08.716775+0000","last_clean":"2024-09-11T23:19:08.716775+0000","last_became_active":"2024-09-11T23:19:07.279421+0000","last_became_peered":"2024-09-11T23:19:07.279421+0000","last_unstale":"2024-09-11T23:19:08.716775+0000","last_undegraded":"2024-09-11T23:19:08.716775+0000","last_fullsized":"2024-09-11T23:19:08.716775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.375641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718675+0000","last_change":"2024-09-11T23:19:07.300361+0000","last_active":"2024-09-11T23:19:08.718675+0000","last_peered":"2024-09-11T23:19:08.718675+0000","last_clean":"2024-09-11T23:19:08.718675+0000","last_became_active":"2024-09-11T23:19:07.296623+0000","last_became_peered":"2024-09-11T23:19:07.296623+0000","last_unstale":"2024-09-11T23:19:08.718675+0000","last_undegraded":"2024-09-11T23:19:08.718675+0000","last_fullsized":"2024-09-11T23:19:08.718675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:45.889124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251055+0000","last_change":"2024-09-11T23:19:07.292327+0000","last_active":"2024-09-11T23:19:08.251055+0000","last_peered":"2024-09-11T23:19:08.251055+0000","last_clean":"2024-09-11T23:19:08.251055+0000","last_became_active":"2024-09-11T23:19:07.291672+0000","last_became_peered":"2024-09-11T23:19:07.291672+0000","last_unstale":"2024-09-11T23:19:08.251055+0000","last_undegraded":"2024-09-11T23:19:08.251055+0000","last_fullsized":"2024-09-11T23:19:08.251055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717953+0000","last_change":"2024-09-11T23:19:07.276414+0000","last_active":"2024-09-11T23:19:08.717953+0000","last_peered":"2024-09-11T23:19:08.717953+0000","last_clean":"2024-09-11T23:19:08.717953+0000","last_became_active":"2024-09-11T23:19:07.275687+0000","last_became_peered":"2024-09-11T23:19:07.275687+0000","last_unstale":"2024-09-11T23:19:08.717953+0000","last_undegraded":"2024-09-11T23:19:08.717953+0000","last_fullsized":"2024-09-11T23:19:08.717953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:52.848080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717538+0000","last_change":"2024-09-11T23:19:07.267908+0000","last_active":"2024-09-11T23:19:08.717538+0000","last_peered":"2024-09-11T23:19:08.717538+0000","last_clean":"2024-09-11T23:19:08.717538+0000","last_became_active":"2024-09-11T23:19:07.267171+0000","last_became_peered":"2024-09-11T23:19:07.267171+0000","last_unstale":"2024-09-11T23:19:08.717538+0000","last_undegraded":"2024-09-11T23:19:08.717538+0000","last_fullsized":"2024-09-11T23:19:08.717538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.610610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246777+0000","last_change":"2024-09-11T23:19:07.273226+0000","last_active":"2024-09-11T23:19:08.246777+0000","last_peered":"2024-09-11T23:19:08.246777+0000","last_clean":"2024-09-11T23:19:08.246777+0000","last_became_active":"2024-09-11T23:19:07.272377+0000","last_became_peered":"2024-09-11T23:19:07.272377+0000","last_unstale":"2024-09-11T23:19:08.246777+0000","last_undegraded":"2024-09-11T23:19:08.246777+0000","last_fullsized":"2024-09-11T23:19:08.246777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:39.062796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717353+0000","last_change":"2024-09-11T23:19:07.293403+0000","last_active":"2024-09-11T23:19:08.717353+0000","last_peered":"2024-09-11T23:19:08.717353+0000","last_clean":"2024-09-11T23:19:08.717353+0000","last_became_active":"2024-09-11T23:19:07.292837+0000","last_became_peered":"2024-09-11T23:19:07.292837+0000","last_unstale":"2024-09-11T23:19:08.717353+0000","last_undegraded":"2024-09-11T23:19:08.717353+0000","last_fullsized":"2024-09-11T23:19:08.717353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:31.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246344+0000","last_change":"2024-09-11T23:19:07.267658+0000","last_active":"2024-09-11T23:19:08.246344+0000","last_peered":"2024-09-11T23:19:08.246344+0000","last_clean":"2024-09-11T23:19:08.246344+0000","last_became_active":"2024-09-11T23:19:07.266815+0000","last_became_peered":"2024-09-11T23:19:07.266815+0000","last_unstale":"2024-09-11T23:19:08.246344+0000","last_undegraded":"2024-09-11T23:19:08.246344+0000","last_fullsized":"2024-09-11T23:19:08.246344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:06.467531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721392+0000","last_change":"2024-09-11T23:19:07.276219+0000","last_active":"2024-09-11T23:19:08.721392+0000","last_peered":"2024-09-11T23:19:08.721392+0000","last_clean":"2024-09-11T23:19:08.721392+0000","last_became_active":"2024-09-11T23:19:07.275423+0000","last_became_peered":"2024-09-11T23:19:07.275423+0000","last_unstale":"2024-09-11T23:19:08.721392+0000","last_undegraded":"2024-09-11T23:19:08.721392+0000","last_fullsized":"2024-09-11T23:19:08.721392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716361+0000","last_change":"2024-09-11T23:19:07.287604+0000","last_active":"2024-09-11T23:19:08.716361+0000","last_peered":"2024-09-11T23:19:08.716361+0000","last_clean":"2024-09-11T23:19:08.716361+0000","last_became_active":"2024-09-11T23:19:07.286892+0000","last_became_peered":"2024-09-11T23:19:07.286892+0000","last_unstale":"2024-09-11T23:19:08.716361+0000","last_undegraded":"2024-09-11T23:19:08.716361+0000","last_fullsized":"2024-09-11T23:19:08.716361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:23.840157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718884+0000","last_change":"2024-09-11T23:19:07.294812+0000","last_active":"2024-09-11T23:19:08.718884+0000","last_peered":"2024-09-11T23:19:08.718884+0000","last_clean":"2024-09-11T23:19:08.718884+0000","last_became_active":"2024-09-11T23:19:07.293948+0000","last_became_peered":"2024-09-11T23:19:07.293948+0000","last_unstale":"2024-09-11T23:19:08.718884+0000","last_undegraded":"2024-09-11T23:19:08.718884+0000","last_fullsized":"2024-09-11T23:19:08.718884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:42.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718340+0000","last_change":"2024-09-11T23:19:07.301020+0000","last_active":"2024-09-11T23:19:08.718340+0000","last_peered":"2024-09-11T23:19:08.718340+0000","last_clean":"2024-09-11T23:19:08.718340+0000","last_became_active":"2024-09-11T23:19:07.300426+0000","last_became_peered":"2024-09-11T23:19:07.300426+0000","last_unstale":"2024-09-11T23:19:08.718340+0000","last_undegraded":"2024-09-11T23:19:08.718340+0000","last_fullsized":"2024-09-11T23:19:08.718340+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:36.980299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721070+0000","last_change":"2024-09-11T23:19:07.301254+0000","last_active":"2024-09-11T23:19:08.721070+0000","last_peered":"2024-09-11T23:19:08.721070+0000","last_clean":"2024-09-11T23:19:08.721070+0000","last_became_active":"2024-09-11T23:19:07.300503+0000","last_became_peered":"2024-09-11T23:19:07.300503+0000","last_unstale":"2024-09-11T23:19:08.721070+0000","last_undegraded":"2024-09-11T23:19:08.721070+0000","last_fullsized":"2024-09-11T23:19:08.721070+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:46.323833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719762+0000","last_change":"2024-09-11T23:19:07.279737+0000","last_active":"2024-09-11T23:19:08.719762+0000","last_peered":"2024-09-11T23:19:08.719762+0000","last_clean":"2024-09-11T23:19:08.719762+0000","last_became_active":"2024-09-11T23:19:07.278906+0000","last_became_peered":"2024-09-11T23:19:07.278906+0000","last_unstale":"2024-09-11T23:19:08.719762+0000","last_undegraded":"2024-09-11T23:19:08.719762+0000","last_fullsized":"2024-09-11T23:19:08.719762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717617+0000","last_change":"2024-09-11T23:19:07.273684+0000","last_active":"2024-09-11T23:19:08.717617+0000","last_peered":"2024-09-11T23:19:08.717617+0000","last_clean":"2024-09-11T23:19:08.717617+0000","last_became_active":"2024-09-11T23:19:07.272918+0000","last_became_peered":"2024-09-11T23:19:07.272918+0000","last_unstale":"2024-09-11T23:19:08.717617+0000","last_undegraded":"2024-09-11T23:19:08.717617+0000","last_fullsized":"2024-09-11T23:19:08.717617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:15.825107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720941+0000","last_change":"2024-09-11T23:19:07.269726+0000","last_active":"2024-09-11T23:19:08.720941+0000","last_peered":"2024-09-11T23:19:08.720941+0000","last_clean":"2024-09-11T23:19:08.720941+0000","last_became_active":"2024-09-11T23:19:07.267916+0000","last_became_peered":"2024-09-11T23:19:07.267916+0000","last_unstale":"2024-09-11T23:19:08.720941+0000","last_undegraded":"2024-09-11T23:19:08.720941+0000","last_fullsized":"2024-09-11T23:19:08.720941+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:50.199522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717217+0000","last_change":"2024-09-11T23:19:07.274965+0000","last_active":"2024-09-11T23:19:08.717217+0000","last_peered":"2024-09-11T23:19:08.717217+0000","last_clean":"2024-09-11T23:19:08.717217+0000","last_became_active":"2024-09-11T23:19:07.274264+0000","last_became_peered":"2024-09-11T23:19:07.274264+0000","last_unstale":"2024-09-11T23:19:08.717217+0000","last_undegraded":"2024-09-11T23:19:08.717217+0000","last_fullsized":"2024-09-11T23:19:08.717217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:09.238424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716465+0000","last_change":"2024-09-11T23:19:07.276419+0000","last_active":"2024-09-11T23:19:08.716465+0000","last_peered":"2024-09-11T23:19:08.716465+0000","last_clean":"2024-09-11T23:19:08.716465+0000","last_became_active":"2024-09-11T23:19:07.275680+0000","last_became_peered":"2024-09-11T23:19:07.275680+0000","last_unstale":"2024-09-11T23:19:08.716465+0000","last_undegraded":"2024-09-11T23:19:08.716465+0000","last_fullsized":"2024-09-11T23:19:08.716465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:57.679979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487637+0000","last_change":"2024-09-11T23:19:07.285483+0000","last_active":"2024-09-11T23:19:08.487637+0000","last_peered":"2024-09-11T23:19:08.487637+0000","last_clean":"2024-09-11T23:19:08.487637+0000","last_became_active":"2024-09-11T23:19:07.284797+0000","last_became_peered":"2024-09-11T23:19:07.284797+0000","last_unstale":"2024-09-11T23:19:08.487637+0000","last_undegraded":"2024-09-11T23:19:08.487637+0000","last_fullsized":"2024-09-11T23:19:08.487637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:55.113683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716877+0000","last_change":"2024-09-11T23:19:07.294453+0000","last_active":"2024-09-11T23:19:08.716877+0000","last_peered":"2024-09-11T23:19:08.716877+0000","last_clean":"2024-09-11T23:19:08.716877+0000","last_became_active":"2024-09-11T23:19:07.289149+0000","last_became_peered":"2024-09-11T23:19:07.289149+0000","last_unstale":"2024-09-11T23:19:08.716877+0000","last_undegraded":"2024-09-11T23:19:08.716877+0000","last_fullsized":"2024-09-11T23:19:08.716877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:42.999802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540912+0000","last_change":"2024-09-11T23:19:06.540912+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540912+0000","last_undegraded":"2024-09-11T23:19:06.540912+0000","last_fullsized":"2024-09-11T23:19:06.540912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716908+0000","last_change":"2024-09-11T23:19:07.272645+0000","last_active":"2024-09-11T23:19:08.716908+0000","last_peered":"2024-09-11T23:19:08.716908+0000","last_clean":"2024-09-11T23:19:08.716908+0000","last_became_active":"2024-09-11T23:19:07.271605+0000","last_became_peered":"2024-09-11T23:19:07.271605+0000","last_unstale":"2024-09-11T23:19:08.716908+0000","last_undegraded":"2024-09-11T23:19:08.716908+0000","last_fullsized":"2024-09-11T23:19:08.716908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:17.625285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246485+0000","last_change":"2024-09-11T23:19:07.273847+0000","last_active":"2024-09-11T23:19:08.246485+0000","last_peered":"2024-09-11T23:19:08.246485+0000","last_clean":"2024-09-11T23:19:08.246485+0000","last_became_active":"2024-09-11T23:19:07.273002+0000","last_became_peered":"2024-09-11T23:19:07.273002+0000","last_unstale":"2024-09-11T23:19:08.246485+0000","last_undegraded":"2024-09-11T23:19:08.246485+0000","last_fullsized":"2024-09-11T23:19:08.246485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:26.767798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720999+0000","last_change":"2024-09-11T23:19:07.270430+0000","last_active":"2024-09-11T23:19:08.720999+0000","last_peered":"2024-09-11T23:19:08.720999+0000","last_clean":"2024-09-11T23:19:08.720999+0000","last_became_active":"2024-09-11T23:19:07.268975+0000","last_became_peered":"2024-09-11T23:19:07.268975+0000","last_unstale":"2024-09-11T23:19:08.720999+0000","last_undegraded":"2024-09-11T23:19:08.720999+0000","last_fullsized":"2024-09-11T23:19:08.720999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251523+0000","last_change":"2024-09-11T23:19:07.281880+0000","last_active":"2024-09-11T23:19:08.251523+0000","last_peered":"2024-09-11T23:19:08.251523+0000","last_clean":"2024-09-11T23:19:08.251523+0000","last_became_active":"2024-09-11T23:19:07.281103+0000","last_became_peered":"2024-09-11T23:19:07.281103+0000","last_unstale":"2024-09-11T23:19:08.251523+0000","last_undegraded":"2024-09-11T23:19:08.251523+0000","last_fullsized":"2024-09-11T23:19:08.251523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:48.744420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716951+0000","last_change":"2024-09-11T23:19:07.262326+0000","last_active":"2024-09-11T23:19:08.716951+0000","last_peered":"2024-09-11T23:19:08.716951+0000","last_clean":"2024-09-11T23:19:08.716951+0000","last_became_active":"2024-09-11T23:19:07.261757+0000","last_became_peered":"2024-09-11T23:19:07.261757+0000","last_unstale":"2024-09-11T23:19:08.716951+0000","last_undegraded":"2024-09-11T23:19:08.716951+0000","last_fullsized":"2024-09-11T23:19:08.716951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:42.689297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.551841+0000","last_change":"2024-09-11T23:19:06.551841+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.551841+0000","last_undegraded":"2024-09-11T23:19:06.551841+0000","last_fullsized":"2024-09-11T23:19:06.551841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718731+0000","last_change":"2024-09-11T23:19:07.300317+0000","last_active":"2024-09-11T23:19:08.718731+0000","last_peered":"2024-09-11T23:19:08.718731+0000","last_clean":"2024-09-11T23:19:08.718731+0000","last_became_active":"2024-09-11T23:19:07.295215+0000","last_became_peered":"2024-09-11T23:19:07.295215+0000","last_unstale":"2024-09-11T23:19:08.718731+0000","last_undegraded":"2024-09-11T23:19:08.718731+0000","last_fullsized":"2024-09-11T23:19:08.718731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:21:48.158519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719309+0000","last_change":"2024-09-11T23:19:07.301395+0000","last_active":"2024-09-11T23:19:08.719309+0000","last_peered":"2024-09-11T23:19:08.719309+0000","last_clean":"2024-09-11T23:19:08.719309+0000","last_became_active":"2024-09-11T23:19:07.296132+0000","last_became_peered":"2024-09-11T23:19:07.296132+0000","last_unstale":"2024-09-11T23:19:08.719309+0000","last_undegraded":"2024-09-11T23:19:08.719309+0000","last_fullsized":"2024-09-11T23:19:08.719309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:34.490776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487914+0000","last_change":"2024-09-11T23:19:06.560592+0000","last_active":"2024-09-11T23:19:08.487914+0000","last_peered":"2024-09-11T23:19:08.487914+0000","last_clean":"2024-09-11T23:19:08.487914+0000","last_became_active":"2024-09-11T23:19:06.559887+0000","last_became_peered":"2024-09-11T23:19:06.559887+0000","last_unstale":"2024-09-11T23:19:08.487914+0000","last_undegraded":"2024-09-11T23:19:08.487914+0000","last_fullsized":"2024-09-11T23:19:08.487914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720626+0000","last_change":"2024-09-11T23:19:07.276328+0000","last_active":"2024-09-11T23:19:08.720626+0000","last_peered":"2024-09-11T23:19:08.720626+0000","last_clean":"2024-09-11T23:19:08.720626+0000","last_became_active":"2024-09-11T23:19:07.275546+0000","last_became_peered":"2024-09-11T23:19:07.275546+0000","last_unstale":"2024-09-11T23:19:08.720626+0000","last_undegraded":"2024-09-11T23:19:08.720626+0000","last_fullsized":"2024-09-11T23:19:08.720626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:10.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717286+0000","last_change":"2024-09-11T23:19:06.575536+0000","last_active":"2024-09-11T23:19:08.717286+0000","last_peered":"2024-09-11T23:19:08.717286+0000","last_clean":"2024-09-11T23:19:08.717286+0000","last_became_active":"2024-09-11T23:19:06.574927+0000","last_became_peered":"2024-09-11T23:19:06.574927+0000","last_unstale":"2024-09-11T23:19:08.717286+0000","last_undegraded":"2024-09-11T23:19:08.717286+0000","last_fullsized":"2024-09-11T23:19:08.717286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:18.826160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251446+0000","last_change":"2024-09-11T23:19:07.287664+0000","last_active":"2024-09-11T23:19:08.251446+0000","last_peered":"2024-09-11T23:19:08.251446+0000","last_clean":"2024-09-11T23:19:08.251446+0000","last_became_active":"2024-09-11T23:19:07.286718+0000","last_became_peered":"2024-09-11T23:19:07.286718+0000","last_unstale":"2024-09-11T23:19:08.251446+0000","last_undegraded":"2024-09-11T23:19:08.251446+0000","last_fullsized":"2024-09-11T23:19:08.251446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:15.768732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251333+0000","last_change":"2024-09-11T23:19:06.553845+0000","last_active":"2024-09-11T23:19:08.251333+0000","last_peered":"2024-09-11T23:19:08.251333+0000","last_clean":"2024-09-11T23:19:08.251333+0000","last_became_active":"2024-09-11T23:19:06.552969+0000","last_became_peered":"2024-09-11T23:19:06.552969+0000","last_unstale":"2024-09-11T23:19:08.251333+0000","last_undegraded":"2024-09-11T23:19:08.251333+0000","last_fullsized":"2024-09-11T23:19:08.251333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:54.109585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721265+0000","last_change":"2024-09-11T23:19:07.297005+0000","last_active":"2024-09-11T23:19:08.721265+0000","last_peered":"2024-09-11T23:19:08.721265+0000","last_clean":"2024-09-11T23:19:08.721265+0000","last_became_active":"2024-09-11T23:19:07.289993+0000","last_became_peered":"2024-09-11T23:19:07.289993+0000","last_unstale":"2024-09-11T23:19:08.721265+0000","last_undegraded":"2024-09-11T23:19:08.721265+0000","last_fullsized":"2024-09-11T23:19:08.721265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:54.378314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488127+0000","last_change":"2024-09-11T23:19:06.564108+0000","last_active":"2024-09-11T23:19:08.488127+0000","last_peered":"2024-09-11T23:19:08.488127+0000","last_clean":"2024-09-11T23:19:08.488127+0000","last_became_active":"2024-09-11T23:19:06.563110+0000","last_became_peered":"2024-09-11T23:19:06.563110+0000","last_unstale":"2024-09-11T23:19:08.488127+0000","last_undegraded":"2024-09-11T23:19:08.488127+0000","last_fullsized":"2024-09-11T23:19:08.488127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:16.621187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718545+0000","last_change":"2024-09-11T23:19:07.268437+0000","last_active":"2024-09-11T23:19:08.718545+0000","last_peered":"2024-09-11T23:19:08.718545+0000","last_clean":"2024-09-11T23:19:08.718545+0000","last_became_active":"2024-09-11T23:19:07.267670+0000","last_became_peered":"2024-09-11T23:19:07.267670+0000","last_unstale":"2024-09-11T23:19:08.718545+0000","last_undegraded":"2024-09-11T23:19:08.718545+0000","last_fullsized":"2024-09-11T23:19:08.718545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:41.868692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717280+0000","last_change":"2024-09-11T23:19:06.561822+0000","last_active":"2024-09-11T23:19:08.717280+0000","last_peered":"2024-09-11T23:19:08.717280+0000","last_clean":"2024-09-11T23:19:08.717280+0000","last_became_active":"2024-09-11T23:19:06.560453+0000","last_became_peered":"2024-09-11T23:19:06.560453+0000","last_unstale":"2024-09-11T23:19:08.717280+0000","last_undegraded":"2024-09-11T23:19:08.717280+0000","last_fullsized":"2024-09-11T23:19:08.717280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:32.014798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487855+0000","last_change":"2024-09-11T23:19:07.291025+0000","last_active":"2024-09-11T23:19:08.487855+0000","last_peered":"2024-09-11T23:19:08.487855+0000","last_clean":"2024-09-11T23:19:08.487855+0000","last_became_active":"2024-09-11T23:19:07.290507+0000","last_became_peered":"2024-09-11T23:19:07.290507+0000","last_unstale":"2024-09-11T23:19:08.487855+0000","last_undegraded":"2024-09-11T23:19:08.487855+0000","last_fullsized":"2024-09-11T23:19:08.487855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:52.848080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718826+0000","last_change":"2024-09-11T23:19:06.552799+0000","last_active":"2024-09-11T23:19:08.718826+0000","last_peered":"2024-09-11T23:19:08.718826+0000","last_clean":"2024-09-11T23:19:08.718826+0000","last_became_active":"2024-09-11T23:19:06.551350+0000","last_became_peered":"2024-09-11T23:19:06.551350+0000","last_unstale":"2024-09-11T23:19:08.718826+0000","last_undegraded":"2024-09-11T23:19:08.718826+0000","last_fullsized":"2024-09-11T23:19:08.718826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719052+0000","last_change":"2024-09-11T23:19:07.301013+0000","last_active":"2024-09-11T23:19:08.719052+0000","last_peered":"2024-09-11T23:19:08.719052+0000","last_clean":"2024-09-11T23:19:08.719052+0000","last_became_active":"2024-09-11T23:19:07.296834+0000","last_became_peered":"2024-09-11T23:19:07.296834+0000","last_unstale":"2024-09-11T23:19:08.719052+0000","last_undegraded":"2024-09-11T23:19:08.719052+0000","last_fullsized":"2024-09-11T23:19:08.719052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:34.486984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717697+0000","last_change":"2024-09-11T23:19:06.554582+0000","last_active":"2024-09-11T23:19:08.717697+0000","last_peered":"2024-09-11T23:19:08.717697+0000","last_clean":"2024-09-11T23:19:08.717697+0000","last_became_active":"2024-09-11T23:19:06.554159+0000","last_became_peered":"2024-09-11T23:19:06.554159+0000","last_unstale":"2024-09-11T23:19:08.717697+0000","last_undegraded":"2024-09-11T23:19:08.717697+0000","last_fullsized":"2024-09-11T23:19:08.717697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:14.821009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721572+0000","last_change":"2024-09-11T23:19:07.281622+0000","last_active":"2024-09-11T23:19:08.721572+0000","last_peered":"2024-09-11T23:19:08.721572+0000","last_clean":"2024-09-11T23:19:08.721572+0000","last_became_active":"2024-09-11T23:19:07.280852+0000","last_became_peered":"2024-09-11T23:19:07.280852+0000","last_unstale":"2024-09-11T23:19:08.721572+0000","last_undegraded":"2024-09-11T23:19:08.721572+0000","last_fullsized":"2024-09-11T23:19:08.721572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250674+0000","last_change":"2024-09-11T23:19:06.545476+0000","last_active":"2024-09-11T23:19:08.250674+0000","last_peered":"2024-09-11T23:19:08.250674+0000","last_clean":"2024-09-11T23:19:08.250674+0000","last_became_active":"2024-09-11T23:19:06.544759+0000","last_became_peered":"2024-09-11T23:19:06.544759+0000","last_unstale":"2024-09-11T23:19:08.250674+0000","last_undegraded":"2024-09-11T23:19:08.250674+0000","last_fullsized":"2024-09-11T23:19:08.250674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:14.821009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717008+0000","last_change":"2024-09-11T23:19:07.291721+0000","last_active":"2024-09-11T23:19:08.717008+0000","last_peered":"2024-09-11T23:19:08.717008+0000","last_clean":"2024-09-11T23:19:08.717008+0000","last_became_active":"2024-09-11T23:19:07.289118+0000","last_became_peered":"2024-09-11T23:19:07.289118+0000","last_unstale":"2024-09-11T23:19:08.717008+0000","last_undegraded":"2024-09-11T23:19:08.717008+0000","last_fullsized":"2024-09-11T23:19:08.717008+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:29.274579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568240+0000","last_change":"2024-09-11T23:19:06.562370+0000","last_active":"2024-09-11T23:19:06.568240+0000","last_peered":"2024-09-11T23:19:06.568240+0000","last_clean":"2024-09-11T23:19:06.568240+0000","last_became_active":"2024-09-11T23:19:06.561679+0000","last_became_peered":"2024-09-11T23:19:06.561679+0000","last_unstale":"2024-09-11T23:19:06.568240+0000","last_undegraded":"2024-09-11T23:19:06.568240+0000","last_fullsized":"2024-09-11T23:19:06.568240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:16.621187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251226+0000","last_change":"2024-09-11T23:19:07.284495+0000","last_active":"2024-09-11T23:19:08.251226+0000","last_peered":"2024-09-11T23:19:08.251226+0000","last_clean":"2024-09-11T23:19:08.251226+0000","last_became_active":"2024-09-11T23:19:07.283741+0000","last_became_peered":"2024-09-11T23:19:07.283741+0000","last_unstale":"2024-09-11T23:19:08.251226+0000","last_undegraded":"2024-09-11T23:19:08.251226+0000","last_fullsized":"2024-09-11T23:19:08.251226+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720405+0000","last_change":"2024-09-11T23:19:06.547195+0000","last_active":"2024-09-11T23:19:08.720405+0000","last_peered":"2024-09-11T23:19:08.720405+0000","last_clean":"2024-09-11T23:19:08.720405+0000","last_became_active":"2024-09-11T23:19:06.546903+0000","last_became_peered":"2024-09-11T23:19:06.546903+0000","last_unstale":"2024-09-11T23:19:08.720405+0000","last_undegraded":"2024-09-11T23:19:08.720405+0000","last_fullsized":"2024-09-11T23:19:08.720405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:27.606512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720154+0000","last_change":"2024-09-11T23:19:07.294643+0000","last_active":"2024-09-11T23:19:08.720154+0000","last_peered":"2024-09-11T23:19:08.720154+0000","last_clean":"2024-09-11T23:19:08.720154+0000","last_became_active":"2024-09-11T23:19:07.289722+0000","last_became_peered":"2024-09-11T23:19:07.289722+0000","last_unstale":"2024-09-11T23:19:08.720154+0000","last_undegraded":"2024-09-11T23:19:08.720154+0000","last_fullsized":"2024-09-11T23:19:08.720154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:15.768732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717786+0000","last_change":"2024-09-11T23:19:06.576092+0000","last_active":"2024-09-11T23:19:08.717786+0000","last_peered":"2024-09-11T23:19:08.717786+0000","last_clean":"2024-09-11T23:19:08.717786+0000","last_became_active":"2024-09-11T23:19:06.574510+0000","last_became_peered":"2024-09-11T23:19:06.574510+0000","last_unstale":"2024-09-11T23:19:08.717786+0000","last_undegraded":"2024-09-11T23:19:08.717786+0000","last_fullsized":"2024-09-11T23:19:08.717786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:18.777847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718263+0000","last_change":"2024-09-11T23:19:07.261367+0000","last_active":"2024-09-11T23:19:08.718263+0000","last_peered":"2024-09-11T23:19:08.718263+0000","last_clean":"2024-09-11T23:19:08.718263+0000","last_became_active":"2024-09-11T23:19:07.260600+0000","last_became_peered":"2024-09-11T23:19:07.260600+0000","last_unstale":"2024-09-11T23:19:08.718263+0000","last_undegraded":"2024-09-11T23:19:08.718263+0000","last_fullsized":"2024-09-11T23:19:08.718263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.343457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719902+0000","last_change":"2024-09-11T23:19:06.562096+0000","last_active":"2024-09-11T23:19:08.719902+0000","last_peered":"2024-09-11T23:19:08.719902+0000","last_clean":"2024-09-11T23:19:08.719902+0000","last_became_active":"2024-09-11T23:19:06.561837+0000","last_became_peered":"2024-09-11T23:19:06.561837+0000","last_unstale":"2024-09-11T23:19:08.719902+0000","last_undegraded":"2024-09-11T23:19:08.719902+0000","last_fullsized":"2024-09-11T23:19:08.719902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:57.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718600+0000","last_change":"2024-09-11T23:19:07.276560+0000","last_active":"2024-09-11T23:19:08.718600+0000","last_peered":"2024-09-11T23:19:08.718600+0000","last_clean":"2024-09-11T23:19:08.718600+0000","last_became_active":"2024-09-11T23:19:07.275806+0000","last_became_peered":"2024-09-11T23:19:07.275806+0000","last_unstale":"2024-09-11T23:19:08.718600+0000","last_undegraded":"2024-09-11T23:19:08.718600+0000","last_fullsized":"2024-09-11T23:19:08.718600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.719661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251219+0000","last_change":"2024-09-11T23:19:06.556199+0000","last_active":"2024-09-11T23:19:08.251219+0000","last_peered":"2024-09-11T23:19:08.251219+0000","last_clean":"2024-09-11T23:19:08.251219+0000","last_became_active":"2024-09-11T23:19:06.555517+0000","last_became_peered":"2024-09-11T23:19:06.555517+0000","last_unstale":"2024-09-11T23:19:08.251219+0000","last_undegraded":"2024-09-11T23:19:08.251219+0000","last_fullsized":"2024-09-11T23:19:08.251219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:51.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716393+0000","last_change":"2024-09-11T23:19:07.277492+0000","last_active":"2024-09-11T23:19:08.716393+0000","last_peered":"2024-09-11T23:19:08.716393+0000","last_clean":"2024-09-11T23:19:08.716393+0000","last_became_active":"2024-09-11T23:19:07.276783+0000","last_became_peered":"2024-09-11T23:19:07.276783+0000","last_unstale":"2024-09-11T23:19:08.716393+0000","last_undegraded":"2024-09-11T23:19:08.716393+0000","last_fullsized":"2024-09-11T23:19:08.716393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:16.764355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719304+0000","last_change":"2024-09-11T23:19:06.577144+0000","last_active":"2024-09-11T23:19:08.719304+0000","last_peered":"2024-09-11T23:19:08.719304+0000","last_clean":"2024-09-11T23:19:08.719304+0000","last_became_active":"2024-09-11T23:19:06.576853+0000","last_became_peered":"2024-09-11T23:19:06.576853+0000","last_unstale":"2024-09-11T23:19:08.719304+0000","last_undegraded":"2024-09-11T23:19:08.719304+0000","last_fullsized":"2024-09-11T23:19:08.719304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:40.810413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246156+0000","last_change":"2024-09-11T23:19:07.274484+0000","last_active":"2024-09-11T23:19:08.246156+0000","last_peered":"2024-09-11T23:19:08.246156+0000","last_clean":"2024-09-11T23:19:08.246156+0000","last_became_active":"2024-09-11T23:19:07.273727+0000","last_became_peered":"2024-09-11T23:19:07.273727+0000","last_unstale":"2024-09-11T23:19:08.246156+0000","last_undegraded":"2024-09-11T23:19:08.246156+0000","last_fullsized":"2024-09-11T23:19:08.246156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:13.646710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719299+0000","last_change":"2024-09-11T23:19:06.563280+0000","last_active":"2024-09-11T23:19:08.719299+0000","last_peered":"2024-09-11T23:19:08.719299+0000","last_clean":"2024-09-11T23:19:08.719299+0000","last_became_active":"2024-09-11T23:19:06.562981+0000","last_became_peered":"2024-09-11T23:19:06.562981+0000","last_unstale":"2024-09-11T23:19:08.719299+0000","last_undegraded":"2024-09-11T23:19:08.719299+0000","last_fullsized":"2024-09-11T23:19:08.719299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:22.836059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246572+0000","last_change":"2024-09-11T23:19:07.266185+0000","last_active":"2024-09-11T23:19:08.246572+0000","last_peered":"2024-09-11T23:19:08.246572+0000","last_clean":"2024-09-11T23:19:08.246572+0000","last_became_active":"2024-09-11T23:19:07.265430+0000","last_became_peered":"2024-09-11T23:19:07.265430+0000","last_unstale":"2024-09-11T23:19:08.246572+0000","last_undegraded":"2024-09-11T23:19:08.246572+0000","last_fullsized":"2024-09-11T23:19:08.246572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:19.364412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718804+0000","last_change":"2024-09-11T23:19:06.550310+0000","last_active":"2024-09-11T23:19:08.718804+0000","last_peered":"2024-09-11T23:19:08.718804+0000","last_clean":"2024-09-11T23:19:08.718804+0000","last_became_active":"2024-09-11T23:19:06.550073+0000","last_became_peered":"2024-09-11T23:19:06.550073+0000","last_unstale":"2024-09-11T23:19:08.718804+0000","last_undegraded":"2024-09-11T23:19:08.718804+0000","last_fullsized":"2024-09-11T23:19:08.718804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719683+0000","last_change":"2024-09-11T23:19:07.287532+0000","last_active":"2024-09-11T23:19:08.719683+0000","last_peered":"2024-09-11T23:19:08.719683+0000","last_clean":"2024-09-11T23:19:08.719683+0000","last_became_active":"2024-09-11T23:19:07.286814+0000","last_became_peered":"2024-09-11T23:19:07.286814+0000","last_unstale":"2024-09-11T23:19:08.719683+0000","last_undegraded":"2024-09-11T23:19:08.719683+0000","last_fullsized":"2024-09-11T23:19:08.719683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:03.369383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488242+0000","last_change":"2024-09-11T23:19:06.569779+0000","last_active":"2024-09-11T23:19:08.488242+0000","last_peered":"2024-09-11T23:19:08.488242+0000","last_clean":"2024-09-11T23:19:08.488242+0000","last_became_active":"2024-09-11T23:19:06.569044+0000","last_became_peered":"2024-09-11T23:19:06.569044+0000","last_unstale":"2024-09-11T23:19:08.488242+0000","last_undegraded":"2024-09-11T23:19:08.488242+0000","last_fullsized":"2024-09-11T23:19:08.488242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488112+0000","last_change":"2024-09-11T23:19:07.278428+0000","last_active":"2024-09-11T23:19:08.488112+0000","last_peered":"2024-09-11T23:19:08.488112+0000","last_clean":"2024-09-11T23:19:08.488112+0000","last_became_active":"2024-09-11T23:19:07.277629+0000","last_became_peered":"2024-09-11T23:19:07.277629+0000","last_unstale":"2024-09-11T23:19:08.488112+0000","last_undegraded":"2024-09-11T23:19:08.488112+0000","last_fullsized":"2024-09-11T23:19:08.488112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:41.868692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251292+0000","last_change":"2024-09-11T23:19:06.566301+0000","last_active":"2024-09-11T23:19:08.251292+0000","last_peered":"2024-09-11T23:19:08.251292+0000","last_clean":"2024-09-11T23:19:08.251292+0000","last_became_active":"2024-09-11T23:19:06.565597+0000","last_became_peered":"2024-09-11T23:19:06.565597+0000","last_unstale":"2024-09-11T23:19:08.251292+0000","last_undegraded":"2024-09-11T23:19:08.251292+0000","last_fullsized":"2024-09-11T23:19:08.251292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:40.864594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717388+0000","last_change":"2024-09-11T23:19:07.266323+0000","last_active":"2024-09-11T23:19:08.717388+0000","last_peered":"2024-09-11T23:19:08.717388+0000","last_clean":"2024-09-11T23:19:08.717388+0000","last_became_active":"2024-09-11T23:19:07.265654+0000","last_became_peered":"2024-09-11T23:19:07.265654+0000","last_unstale":"2024-09-11T23:19:08.717388+0000","last_undegraded":"2024-09-11T23:19:08.717388+0000","last_fullsized":"2024-09-11T23:19:08.717388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:29.762898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717820+0000","last_change":"2024-09-11T23:19:06.571225+0000","last_active":"2024-09-11T23:19:08.717820+0000","last_peered":"2024-09-11T23:19:08.717820+0000","last_clean":"2024-09-11T23:19:08.717820+0000","last_became_active":"2024-09-11T23:19:06.570625+0000","last_became_peered":"2024-09-11T23:19:06.570625+0000","last_unstale":"2024-09-11T23:19:08.717820+0000","last_undegraded":"2024-09-11T23:19:08.717820+0000","last_fullsized":"2024-09-11T23:19:08.717820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:52.266753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719074+0000","last_change":"2024-09-11T23:19:07.301782+0000","last_active":"2024-09-11T23:19:08.719074+0000","last_peered":"2024-09-11T23:19:08.719074+0000","last_clean":"2024-09-11T23:19:08.719074+0000","last_became_active":"2024-09-11T23:19:07.301074+0000","last_became_peered":"2024-09-11T23:19:07.301074+0000","last_unstale":"2024-09-11T23:19:08.719074+0000","last_undegraded":"2024-09-11T23:19:08.719074+0000","last_fullsized":"2024-09-11T23:19:08.719074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.541770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.565094+0000","last_change":"2024-09-11T23:19:06.554094+0000","last_active":"2024-09-11T23:19:06.565094+0000","last_peered":"2024-09-11T23:19:06.565094+0000","last_clean":"2024-09-11T23:19:06.565094+0000","last_became_active":"2024-09-11T23:19:06.553375+0000","last_became_peered":"2024-09-11T23:19:06.553375+0000","last_unstale":"2024-09-11T23:19:06.565094+0000","last_undegraded":"2024-09-11T23:19:06.565094+0000","last_fullsized":"2024-09-11T23:19:06.565094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542178+0000","last_change":"2024-09-11T23:19:06.542178+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542178+0000","last_undegraded":"2024-09-11T23:19:06.542178+0000","last_fullsized":"2024-09-11T23:19:06.542178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246260+0000","last_change":"2024-09-11T23:19:06.546448+0000","last_active":"2024-09-11T23:19:08.246260+0000","last_peered":"2024-09-11T23:19:08.246260+0000","last_clean":"2024-09-11T23:19:08.246260+0000","last_became_active":"2024-09-11T23:19:06.545743+0000","last_became_peered":"2024-09-11T23:19:06.545743+0000","last_unstale":"2024-09-11T23:19:08.246260+0000","last_undegraded":"2024-09-11T23:19:08.246260+0000","last_fullsized":"2024-09-11T23:19:08.246260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:56.814459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538492+0000","last_change":"2024-09-11T23:19:06.538492+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538492+0000","last_undegraded":"2024-09-11T23:19:06.538492+0000","last_fullsized":"2024-09-11T23:19:06.538492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.566272+0000","last_change":"2024-09-11T23:19:06.558413+0000","last_active":"2024-09-11T23:19:06.566272+0000","last_peered":"2024-09-11T23:19:06.566272+0000","last_clean":"2024-09-11T23:19:06.566272+0000","last_became_active":"2024-09-11T23:19:06.557721+0000","last_became_peered":"2024-09-11T23:19:06.557721+0000","last_unstale":"2024-09-11T23:19:06.566272+0000","last_undegraded":"2024-09-11T23:19:06.566272+0000","last_fullsized":"2024-09-11T23:19:06.566272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717570+0000","last_change":"2024-09-11T23:19:07.276883+0000","last_active":"2024-09-11T23:19:08.717570+0000","last_peered":"2024-09-11T23:19:08.717570+0000","last_clean":"2024-09-11T23:19:08.717570+0000","last_became_active":"2024-09-11T23:19:07.276122+0000","last_became_peered":"2024-09-11T23:19:07.276122+0000","last_unstale":"2024-09-11T23:19:08.717570+0000","last_undegraded":"2024-09-11T23:19:08.717570+0000","last_fullsized":"2024-09-11T23:19:08.717570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:23.794337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246124+0000","last_change":"2024-09-11T23:19:06.557333+0000","last_active":"2024-09-11T23:19:08.246124+0000","last_peered":"2024-09-11T23:19:08.246124+0000","last_clean":"2024-09-11T23:19:08.246124+0000","last_became_active":"2024-09-11T23:19:06.556598+0000","last_became_peered":"2024-09-11T23:19:06.556598+0000","last_unstale":"2024-09-11T23:19:08.246124+0000","last_undegraded":"2024-09-11T23:19:08.246124+0000","last_fullsized":"2024-09-11T23:19:08.246124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:53.373475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487902+0000","last_change":"2024-09-11T23:19:07.281019+0000","last_active":"2024-09-11T23:19:08.487902+0000","last_peered":"2024-09-11T23:19:08.487902+0000","last_clean":"2024-09-11T23:19:08.487902+0000","last_became_active":"2024-09-11T23:19:07.280262+0000","last_became_peered":"2024-09-11T23:19:07.280262+0000","last_unstale":"2024-09-11T23:19:08.487902+0000","last_undegraded":"2024-09-11T23:19:08.487902+0000","last_fullsized":"2024-09-11T23:19:08.487902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.343457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251500+0000","last_change":"2024-09-11T23:19:06.565340+0000","last_active":"2024-09-11T23:19:08.251500+0000","last_peered":"2024-09-11T23:19:08.251500+0000","last_clean":"2024-09-11T23:19:08.251500+0000","last_became_active":"2024-09-11T23:19:06.564535+0000","last_became_peered":"2024-09-11T23:19:06.564535+0000","last_unstale":"2024-09-11T23:19:08.251500+0000","last_undegraded":"2024-09-11T23:19:08.251500+0000","last_fullsized":"2024-09-11T23:19:08.251500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:55.339358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720919+0000","last_change":"2024-09-11T23:19:07.301239+0000","last_active":"2024-09-11T23:19:08.720919+0000","last_peered":"2024-09-11T23:19:08.720919+0000","last_clean":"2024-09-11T23:19:08.720919+0000","last_became_active":"2024-09-11T23:19:07.300498+0000","last_became_peered":"2024-09-11T23:19:07.300498+0000","last_unstale":"2024-09-11T23:19:08.720919+0000","last_undegraded":"2024-09-11T23:19:08.720919+0000","last_fullsized":"2024-09-11T23:19:08.720919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:39.010094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717660+0000","last_change":"2024-09-11T23:19:06.574920+0000","last_active":"2024-09-11T23:19:08.717660+0000","last_peered":"2024-09-11T23:19:08.717660+0000","last_clean":"2024-09-11T23:19:08.717660+0000","last_became_active":"2024-09-11T23:19:06.571154+0000","last_became_peered":"2024-09-11T23:19:06.571154+0000","last_unstale":"2024-09-11T23:19:08.717660+0000","last_undegraded":"2024-09-11T23:19:08.717660+0000","last_fullsized":"2024-09-11T23:19:08.717660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:42.534717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719894+0000","last_change":"2024-09-11T23:19:07.301730+0000","last_active":"2024-09-11T23:19:08.719894+0000","last_peered":"2024-09-11T23:19:08.719894+0000","last_clean":"2024-09-11T23:19:08.719894+0000","last_became_active":"2024-09-11T23:19:07.296015+0000","last_became_peered":"2024-09-11T23:19:07.296015+0000","last_unstale":"2024-09-11T23:19:08.719894+0000","last_undegraded":"2024-09-11T23:19:08.719894+0000","last_fullsized":"2024-09-11T23:19:08.719894+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:09.839853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717944+0000","last_change":"2024-09-11T23:19:06.575470+0000","last_active":"2024-09-11T23:19:08.717944+0000","last_peered":"2024-09-11T23:19:08.717944+0000","last_clean":"2024-09-11T23:19:08.717944+0000","last_became_active":"2024-09-11T23:19:06.572387+0000","last_became_peered":"2024-09-11T23:19:06.572387+0000","last_unstale":"2024-09-11T23:19:08.717944+0000","last_undegraded":"2024-09-11T23:19:08.717944+0000","last_fullsized":"2024-09-11T23:19:08.717944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:55.383306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539784+0000","last_change":"2024-09-11T23:19:06.539784+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539784+0000","last_undegraded":"2024-09-11T23:19:06.539784+0000","last_fullsized":"2024-09-11T23:19:06.539784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488209+0000","last_change":"2024-09-11T23:19:06.559238+0000","last_active":"2024-09-11T23:19:08.488209+0000","last_peered":"2024-09-11T23:19:08.488209+0000","last_clean":"2024-09-11T23:19:08.488209+0000","last_became_active":"2024-09-11T23:19:06.558411+0000","last_became_peered":"2024-09-11T23:19:06.558411+0000","last_unstale":"2024-09-11T23:19:08.488209+0000","last_undegraded":"2024-09-11T23:19:08.488209+0000","last_fullsized":"2024-09-11T23:19:08.488209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:41.685199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246297+0000","last_change":"2024-09-11T23:19:07.281067+0000","last_active":"2024-09-11T23:19:08.246297+0000","last_peered":"2024-09-11T23:19:08.246297+0000","last_clean":"2024-09-11T23:19:08.246297+0000","last_became_active":"2024-09-11T23:19:07.280376+0000","last_became_peered":"2024-09-11T23:19:07.280376+0000","last_unstale":"2024-09-11T23:19:08.246297+0000","last_undegraded":"2024-09-11T23:19:08.246297+0000","last_fullsized":"2024-09-11T23:19:08.246297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:59.009388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718197+0000","last_change":"2024-09-11T23:19:06.577115+0000","last_active":"2024-09-11T23:19:08.718197+0000","last_peered":"2024-09-11T23:19:08.718197+0000","last_clean":"2024-09-11T23:19:08.718197+0000","last_became_active":"2024-09-11T23:19:06.576829+0000","last_became_peered":"2024-09-11T23:19:06.576829+0000","last_unstale":"2024-09-11T23:19:08.718197+0000","last_undegraded":"2024-09-11T23:19:08.718197+0000","last_fullsized":"2024-09-11T23:19:08.718197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.195424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717288+0000","last_change":"2024-09-11T23:19:07.300922+0000","last_active":"2024-09-11T23:19:08.717288+0000","last_peered":"2024-09-11T23:19:08.717288+0000","last_clean":"2024-09-11T23:19:08.717288+0000","last_became_active":"2024-09-11T23:19:07.298799+0000","last_became_peered":"2024-09-11T23:19:07.298799+0000","last_unstale":"2024-09-11T23:19:08.717288+0000","last_undegraded":"2024-09-11T23:19:08.717288+0000","last_fullsized":"2024-09-11T23:19:08.717288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:50.199522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.564950+0000","last_change":"2024-09-11T23:19:06.556306+0000","last_active":"2024-09-11T23:19:06.564950+0000","last_peered":"2024-09-11T23:19:06.564950+0000","last_clean":"2024-09-11T23:19:06.564950+0000","last_became_active":"2024-09-11T23:19:06.555615+0000","last_became_peered":"2024-09-11T23:19:06.555615+0000","last_unstale":"2024-09-11T23:19:06.564950+0000","last_undegraded":"2024-09-11T23:19:06.564950+0000","last_fullsized":"2024-09-11T23:19:06.564950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487575+0000","last_change":"2024-09-11T23:19:07.287433+0000","last_active":"2024-09-11T23:19:08.487575+0000","last_peered":"2024-09-11T23:19:08.487575+0000","last_clean":"2024-09-11T23:19:08.487575+0000","last_became_active":"2024-09-11T23:19:07.285837+0000","last_became_peered":"2024-09-11T23:19:07.285837+0000","last_unstale":"2024-09-11T23:19:08.487575+0000","last_undegraded":"2024-09-11T23:19:08.487575+0000","last_fullsized":"2024-09-11T23:19:08.487575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:43.077313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488122+0000","last_change":"2024-09-11T23:19:06.566084+0000","last_active":"2024-09-11T23:19:08.488122+0000","last_peered":"2024-09-11T23:19:08.488122+0000","last_clean":"2024-09-11T23:19:08.488122+0000","last_became_active":"2024-09-11T23:19:06.563321+0000","last_became_peered":"2024-09-11T23:19:06.563321+0000","last_unstale":"2024-09-11T23:19:08.488122+0000","last_undegraded":"2024-09-11T23:19:08.488122+0000","last_fullsized":"2024-09-11T23:19:08.488122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717968+0000","last_change":"2024-09-11T23:19:07.287130+0000","last_active":"2024-09-11T23:19:08.717968+0000","last_peered":"2024-09-11T23:19:08.717968+0000","last_clean":"2024-09-11T23:19:08.717968+0000","last_became_active":"2024-09-11T23:19:07.286410+0000","last_became_peered":"2024-09-11T23:19:07.286410+0000","last_unstale":"2024-09-11T23:19:08.717968+0000","last_undegraded":"2024-09-11T23:19:08.717968+0000","last_fullsized":"2024-09-11T23:19:08.717968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:38.849234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250769+0000","last_change":"2024-09-11T23:19:06.554823+0000","last_active":"2024-09-11T23:19:08.250769+0000","last_peered":"2024-09-11T23:19:08.250769+0000","last_clean":"2024-09-11T23:19:08.250769+0000","last_became_active":"2024-09-11T23:19:06.554113+0000","last_became_peered":"2024-09-11T23:19:06.554113+0000","last_unstale":"2024-09-11T23:19:08.250769+0000","last_undegraded":"2024-09-11T23:19:08.250769+0000","last_fullsized":"2024-09-11T23:19:08.250769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:42.073215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251719+0000","last_change":"2024-09-11T23:19:07.296848+0000","last_active":"2024-09-11T23:19:08.251719+0000","last_peered":"2024-09-11T23:19:08.251719+0000","last_clean":"2024-09-11T23:19:08.251719+0000","last_became_active":"2024-09-11T23:19:07.296316+0000","last_became_peered":"2024-09-11T23:19:07.296316+0000","last_unstale":"2024-09-11T23:19:08.251719+0000","last_undegraded":"2024-09-11T23:19:08.251719+0000","last_fullsized":"2024-09-11T23:19:08.251719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:02.464388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721192+0000","last_change":"2024-09-11T23:19:06.554819+0000","last_active":"2024-09-11T23:19:08.721192+0000","last_peered":"2024-09-11T23:19:08.721192+0000","last_clean":"2024-09-11T23:19:08.721192+0000","last_became_active":"2024-09-11T23:19:06.554385+0000","last_became_peered":"2024-09-11T23:19:06.554385+0000","last_unstale":"2024-09-11T23:19:08.721192+0000","last_undegraded":"2024-09-11T23:19:08.721192+0000","last_fullsized":"2024-09-11T23:19:08.721192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":295,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250983+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:19:08.250983+0000","last_peered":"2024-09-11T23:19:08.250983+0000","last_clean":"2024-09-11T23:19:08.250983+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:19:08.250983+0000","last_undegraded":"2024-09-11T23:19:08.250983+0000","last_fullsized":"2024-09-11T23:19:08.250983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1662976,"data_stored":1077122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1081344,"data_stored":488914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":486858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1060864,"data_stored":486698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1060864,"data_stored":486698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40548,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331292,"statfs":{"total":96636764160,"available":96595243008,"internally_reserved":0,"allocated":1064960,"data_stored":486768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1679360,"data_stored":1079384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:12.303 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3e is not active+clean 2024-09-11T23:19:12.303 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:19:06.539932+0000', 'last_change': '2024-09-11T23:19:06.539932+0000', 'last_active': '2024-09-11T23:19:06.515823+0000', 'last_peered': '2024-09-11T23:19:06.515823+0000', 'last_clean': '2024-09-11T23:19:06.515823+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:19:06.539932+0000', 'last_undegraded': '2024-09-11T23:19:06.539932+0000', 'last_fullsized': '2024-09-11T23:19:06.539932+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_clean_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:19:12.303 INFO:tasks.ceph.ceph_manager.ceph:PG 14.27 is not active+clean 2024-09-11T23:19:12.303 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:19:06.540912+0000', 'last_change': '2024-09-11T23:19:06.540912+0000', 'last_active': '2024-09-11T23:19:06.515823+0000', 'last_peered': '2024-09-11T23:19:06.515823+0000', 'last_clean': '2024-09-11T23:19:06.515823+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:19:06.540912+0000', 'last_undegraded': '2024-09-11T23:19:06.540912+0000', 'last_fullsized': '2024-09-11T23:19:06.540912+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_clean_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:19:12.303 INFO:tasks.ceph.ceph_manager.ceph:PG 14.21 is not active+clean 2024-09-11T23:19:12.303 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:19:06.551841+0000', 'last_change': '2024-09-11T23:19:06.551841+0000', 'last_active': '2024-09-11T23:19:06.515823+0000', 'last_peered': '2024-09-11T23:19:06.515823+0000', 'last_clean': '2024-09-11T23:19:06.515823+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:19:06.551841+0000', 'last_undegraded': '2024-09-11T23:19:06.551841+0000', 'last_fullsized': '2024-09-11T23:19:06.551841+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_clean_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:19:12.304 INFO:tasks.ceph.ceph_manager.ceph:PG 14.9 is not active+clean 2024-09-11T23:19:12.304 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:19:06.542178+0000', 'last_change': '2024-09-11T23:19:06.542178+0000', 'last_active': '2024-09-11T23:19:06.515823+0000', 'last_peered': '2024-09-11T23:19:06.515823+0000', 'last_clean': '2024-09-11T23:19:06.515823+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:19:06.542178+0000', 'last_undegraded': '2024-09-11T23:19:06.542178+0000', 'last_fullsized': '2024-09-11T23:19:06.542178+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_clean_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:19:12.304 INFO:tasks.ceph.ceph_manager.ceph:PG 14.a is not active+clean 2024-09-11T23:19:12.304 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:19:06.538492+0000', 'last_change': '2024-09-11T23:19:06.538492+0000', 'last_active': '2024-09-11T23:19:06.515823+0000', 'last_peered': '2024-09-11T23:19:06.515823+0000', 'last_clean': '2024-09-11T23:19:06.515823+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:19:06.538492+0000', 'last_undegraded': '2024-09-11T23:19:06.538492+0000', 'last_fullsized': '2024-09-11T23:19:06.538492+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_clean_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:19:12.304 INFO:tasks.ceph.ceph_manager.ceph:PG 14.7 is not active+clean 2024-09-11T23:19:12.304 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:19:06.539784+0000', 'last_change': '2024-09-11T23:19:06.539784+0000', 'last_active': '2024-09-11T23:19:06.515823+0000', 'last_peered': '2024-09-11T23:19:06.515823+0000', 'last_clean': '2024-09-11T23:19:06.515823+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:19:06.539784+0000', 'last_undegraded': '2024-09-11T23:19:06.539784+0000', 'last_fullsized': '2024-09-11T23:19:06.539784+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'last_clean_scrub_stamp': '2024-09-11T23:19:06.515823+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:19:12.304 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:19:12.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7b020b3640 1 Processor -- start 2024-09-11T23:19:12.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7b020b3640 1 -- start start 2024-09-11T23:19:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7b020b3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7afc15c2a0 0x7f7afc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7b020b3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7afc0af2a0 0x7f7afc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7b020b3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7afc0b3290 con 0x7f7afc15bec0 2024-09-11T23:19:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7b020b3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7afc0b3570 con 0x7f7afc0af2a0 2024-09-11T23:19:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7b020b3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7afc0b3850 con 0x7f7afc15c2a0 2024-09-11T23:19:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7afbfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7afc0af2a0 0x7f7afc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7afbfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7afc0af2a0 0x7f7afc06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59428/0 (socket says 172.21.15.94:59428) 2024-09-11T23:19:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.453+0000 7f7afbfff640 1 -- 172.21.15.94:0/3692687367 learned_addr learned my addr 172.21.15.94:0/3692687367 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afaffd640 1 --2- 172.21.15.94:0/3692687367 >> v2:172.21.15.155:3300/0 conn(0x7f7afc15c2a0 0x7f7afc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afbfff640 1 -- 172.21.15.94:0/3692687367 >> v2:172.21.15.155:3300/0 conn(0x7f7afc15c2a0 msgr2=0x7f7afc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afbfff640 1 --2- 172.21.15.94:0/3692687367 >> v2:172.21.15.155:3300/0 conn(0x7f7afc15c2a0 0x7f7afc0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afbfff640 1 -- 172.21.15.94:0/3692687367 >> v1:172.21.15.155:6789/0 conn(0x7f7afc15bec0 legacy=0x7f7afc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:12.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afbfff640 1 -- 172.21.15.94:0/3692687367 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc0b3b30 con 0x7f7afc0af2a0 2024-09-11T23:19:12.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afbfff640 1 --2- 172.21.15.94:0/3692687367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc06e000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0ae510 tx=0x7f7af401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4d837dacb23fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afa7fc640 1 -- 172.21.15.94:0/3692687367 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af40a5840 con 0x7f7afc0af2a0 2024-09-11T23:19:12.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afa7fc640 1 -- 172.21.15.94:0/3692687367 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af40a59e0 con 0x7f7afc0af2a0 2024-09-11T23:19:12.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7afa7fc640 1 -- 172.21.15.94:0/3692687367 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af40a5db0 con 0x7f7afc0af2a0 2024-09-11T23:19:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 -- 172.21.15.94:0/3692687367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 msgr2=0x7f7afc06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 --2- 172.21.15.94:0/3692687367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc06e000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0ae510 tx=0x7f7af401c980 comp rx=0 tx=0).stop 2024-09-11T23:19:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 -- 172.21.15.94:0/3692687367 shutdown_connections 2024-09-11T23:19:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 --2- 172.21.15.94:0/3692687367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc06e000 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 --2- 172.21.15.94:0/3692687367 >> v2:172.21.15.155:3300/0 conn(0x7f7afc15c2a0 0x7f7afc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 -- 172.21.15.94:0/3692687367 >> 172.21.15.94:0/3692687367 conn(0x7f7afc0b1f90 msgr2=0x7f7afc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 -- 172.21.15.94:0/3692687367 shutdown_connections 2024-09-11T23:19:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.457+0000 7f7b020b3640 1 -- 172.21.15.94:0/3692687367 wait complete. 2024-09-11T23:19:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 Processor -- start 2024-09-11T23:19:12.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 -- start start 2024-09-11T23:19:12.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc15d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7afc15bec0 0x7f7afc155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7afc15c2a0 0x7f7afc14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc06ed50 con 0x7f7afc0af2a0 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc0af710 con 0x7f7afc15bec0 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc06eed0 con 0x7f7afc15c2a0 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc15d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59438/0 (socket says 172.21.15.94:59438) 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 -- 172.21.15.94:0/850200296 learned_addr learned my addr 172.21.15.94:0/850200296 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 -- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7afc15c2a0 msgr2=0x7f7afc14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7afc15c2a0 0x7f7afc14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 -- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7afc15bec0 msgr2=0x7f7afc155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7afc15bec0 0x7f7afc155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 -- 172.21.15.94:0/850200296 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc156790 con 0x7f7afc0af2a0 2024-09-11T23:19:12.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7afb7fe640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc15d280 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c450 tx=0x7f7aec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7ae3fff640 1 -- 172.21.15.94:0/850200296 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec012830 con 0x7f7afc0af2a0 2024-09-11T23:19:12.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7ae3fff640 1 -- 172.21.15.94:0/850200296 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aec017070 con 0x7f7afc0af2a0 2024-09-11T23:19:12.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc156a70 con 0x7f7afc0af2a0 2024-09-11T23:19:12.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7ae3fff640 1 -- 172.21.15.94:0/850200296 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec012c30 con 0x7f7afc0af2a0 2024-09-11T23:19:12.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc157030 con 0x7f7afc0af2a0 2024-09-11T23:19:12.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc06f260 con 0x7f7afc0af2a0 2024-09-11T23:19:12.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.461+0000 7f7ae3fff640 1 -- 172.21.15.94:0/850200296 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7aec01c460 con 0x7f7afc0af2a0 2024-09-11T23:19:12.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.465+0000 7f7ae3fff640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7ae80678c0 0x7f7ae8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.465+0000 7f7ae3fff640 1 -- 172.21.15.94:0/850200296 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f7aec085c50 con 0x7f7afc0af2a0 2024-09-11T23:19:12.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.465+0000 7f7afaffd640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7ae80678c0 0x7f7ae8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.465+0000 7f7afaffd640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7ae80678c0 0x7f7ae8069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7afc06d2a0 tx=0x7f7af0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.469+0000 7f7ae3fff640 1 -- 172.21.15.94:0/850200296 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7aec08b020 con 0x7f7afc0af2a0 2024-09-11T23:19:12.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.673+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7afc06fcd0 con 0x7f7afc0af2a0 2024-09-11T23:19:12.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.673+0000 7f7ae3fff640 1 -- 172.21.15.94:0/850200296 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f7aec056600 con 0x7f7afc0af2a0 2024-09-11T23:19:12.674 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:12.674 INFO:teuthology.orchestra.run.smithi094.stdout:{"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":263,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":86,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096501,"num_in_osds":8,"osd_in_since":1726096491,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":286539776,"bytes_avail":772807573504,"bytes_total":773094113280,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":6381}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-11T23:18:58.045202+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:19:12.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7ae80678c0 msgr2=0x7f7ae8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7ae80678c0 0x7f7ae8069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7afc06d2a0 tx=0x7f7af0008040 comp rx=0 tx=0).stop 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 msgr2=0x7f7afc15d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc15d280 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c450 tx=0x7f7aec00c910 comp rx=0 tx=0).stop 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 shutdown_connections 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7afc15c2a0 0x7f7afc14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7afc15bec0 0x7f7afc155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7ae80678c0 0x7f7ae8069d80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 --2- 172.21.15.94:0/850200296 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7afc0af2a0 0x7f7afc15d280 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 >> 172.21.15.94:0/850200296 conn(0x7f7afc0b1f90 msgr2=0x7f7afc0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 shutdown_connections 2024-09-11T23:19:12.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.677+0000 7f7b020b3640 1 -- 172.21.15.94:0/850200296 wait complete. 2024-09-11T23:19:12.692 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:19:12.692 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:12.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbec0b5d640 1 Processor -- start 2024-09-11T23:19:12.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbec0b5d640 1 -- start start 2024-09-11T23:19:12.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbec0b5d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbebc15bec0 0x7fbebc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbec0b5d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbec0b5d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbebc0b3290 con 0x7fbebc15c2a0 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbec0b5d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fbebc0b3570 con 0x7fbebc15bec0 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbec0b5d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbebc0b3850 con 0x7fbebc0af470 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbeba59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbebc15bec0 0x7fbebc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbeba59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbebc15bec0 0x7fbebc0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59446/0 (socket says 172.21.15.94:59446) 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbeba59c640 1 -- 172.21.15.94:0/72348486 learned_addr learned my addr 172.21.15.94:0/72348486 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbebad9d640 1 --2- 172.21.15.94:0/72348486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbeba59c640 1 -- 172.21.15.94:0/72348486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 msgr2=0x7fbebc06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbeba59c640 1 --2- 172.21.15.94:0/72348486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbeba59c640 1 -- 172.21.15.94:0/72348486 >> v1:172.21.15.155:6789/0 conn(0x7fbebc15c2a0 legacy=0x7fbebc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:12.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.813+0000 7fbeba59c640 1 -- 172.21.15.94:0/72348486 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc0b3b30 con 0x7fbebc15bec0 2024-09-11T23:19:12.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbeba59c640 1 --2- 172.21.15.94:0/72348486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0ad200 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009870 tx=0x7fbea401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc70882b8e386d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbeb959a640 1 -- 172.21.15.94:0/72348486 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea40ab620 con 0x7fbebc15bec0 2024-09-11T23:19:12.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbeb959a640 1 -- 172.21.15.94:0/72348486 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea40b0070 con 0x7fbebc15bec0 2024-09-11T23:19:12.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbeb959a640 1 -- 172.21.15.94:0/72348486 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea40ab9e0 con 0x7fbebc15bec0 2024-09-11T23:19:12.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 -- 172.21.15.94:0/72348486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 msgr2=0x7fbebc0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/72348486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0ad200 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009870 tx=0x7fbea401c460 comp rx=0 tx=0).stop 2024-09-11T23:19:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 -- 172.21.15.94:0/72348486 shutdown_connections 2024-09-11T23:19:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/72348486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/72348486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0ad200 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 -- 172.21.15.94:0/72348486 >> 172.21.15.94:0/72348486 conn(0x7fbebc0b1f90 msgr2=0x7fbebc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 -- 172.21.15.94:0/72348486 shutdown_connections 2024-09-11T23:19:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 -- 172.21.15.94:0/72348486 wait complete. 2024-09-11T23:19:12.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.817+0000 7fbec0b5d640 1 Processor -- start 2024-09-11T23:19:12.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 -- start start 2024-09-11T23:19:12.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbebc15c2a0 0x7fbebc0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc06ed50 con 0x7fbebc15bec0 2024-09-11T23:19:12.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc0ad740 con 0x7fbebc15c2a0 2024-09-11T23:19:12.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbebc06eed0 con 0x7fbebc0af470 2024-09-11T23:19:12.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0738a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59452/0 (socket says 172.21.15.94:59452) 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 -- 172.21.15.94:0/4191111822 learned_addr learned my addr 172.21.15.94:0/4191111822 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbebad9d640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbebc15c2a0 0x7fbebc0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeba59c640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 -- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 msgr2=0x7fbebc157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 -- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbebc15c2a0 msgr2=0x7fbebc0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbebc15c2a0 0x7fbebc0aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 -- 172.21.15.94:0/4191111822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc0729c0 con 0x7fbebc15bec0 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb9d9b640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0738a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00b3e0 tx=0x7fbeac00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb2ffd640 1 -- 172.21.15.94:0/4191111822 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac015020 con 0x7fbebc15bec0 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb2ffd640 1 -- 172.21.15.94:0/4191111822 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac011830 con 0x7fbebc15bec0 2024-09-11T23:19:12.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb2ffd640 1 -- 172.21.15.94:0/4191111822 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac011c60 con 0x7fbebc15bec0 2024-09-11T23:19:12.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbebc072ca0 con 0x7fbebc15bec0 2024-09-11T23:19:12.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbebc157160 con 0x7fbebc15bec0 2024-09-11T23:19:12.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbebc06e000 con 0x7fbebc15bec0 2024-09-11T23:19:12.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb2ffd640 1 -- 172.21.15.94:0/4191111822 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbeac018020 con 0x7fbebc15bec0 2024-09-11T23:19:12.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb2ffd640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbe9c0678c0 0x7fbe9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.821+0000 7fbeb2ffd640 1 -- 172.21.15.94:0/4191111822 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fbeac085a70 con 0x7fbebc15bec0 2024-09-11T23:19:12.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.825+0000 7fbeba59c640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbe9c0678c0 0x7fbe9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.825+0000 7fbeba59c640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbe9c0678c0 0x7fbe9c069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbea40af000 tx=0x7fbea40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.829+0000 7fbeb2ffd640 1 -- 172.21.15.94:0/4191111822 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbeac01f030 con 0x7fbebc15bec0 2024-09-11T23:19:12.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:12.985+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbebc06fcd0 con 0x7fbe9c0678c0 2024-09-11T23:19:13.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbeb2ffd640 1 -- 172.21.15.94:0/4191111822 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251583 (secure 0 0 0) 0x7fbebc06fcd0 con 0x7fbe9c0678c0 2024-09-11T23:19:13.007 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:13.008 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:19:13.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbe9c0678c0 msgr2=0x7fbe9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbe9c0678c0 0x7fbe9c069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbea40af000 tx=0x7fbea40a7000 comp rx=0 tx=0).stop 2024-09-11T23:19:13.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 msgr2=0x7fbebc0738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0738a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00b3e0 tx=0x7fbeac00b8a0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 shutdown_connections 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbebc15c2a0 0x7fbebc0aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbe9c0678c0 0x7fbe9c069d80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbebc15bec0 0x7fbebc0738a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 --2- 172.21.15.94:0/4191111822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbebc0af470 0x7fbebc157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 >> 172.21.15.94:0/4191111822 conn(0x7fbebc0b1f90 msgr2=0x7fbebc159ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.005+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 shutdown_connections 2024-09-11T23:19:13.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:13.009+0000 7fbec0b5d640 1 -- 172.21.15.94:0/4191111822 wait complete. 2024-09-11T23:19:13.023 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-11T23:19:12.049337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279824,"kb_used_data":9488,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754694896,"statfs":{"total":773094113280,"available":772807573504,"internally_reserved":0,"allocated":9715712,"data_stored":5065281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001885"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720142+0000","last_change":"2024-09-11T23:19:07.295568+0000","last_active":"2024-09-11T23:19:08.720142+0000","last_peered":"2024-09-11T23:19:08.720142+0000","last_clean":"2024-09-11T23:19:08.720142+0000","last_became_active":"2024-09-11T23:19:07.294521+0000","last_became_peered":"2024-09-11T23:19:07.294521+0000","last_unstale":"2024-09-11T23:19:08.720142+0000","last_undegraded":"2024-09-11T23:19:08.720142+0000","last_fullsized":"2024-09-11T23:19:08.720142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539932+0000","last_change":"2024-09-11T23:19:06.539932+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539932+0000","last_undegraded":"2024-09-11T23:19:06.539932+0000","last_fullsized":"2024-09-11T23:19:06.539932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717804+0000","last_change":"2024-09-11T23:19:07.287941+0000","last_active":"2024-09-11T23:19:08.717804+0000","last_peered":"2024-09-11T23:19:08.717804+0000","last_clean":"2024-09-11T23:19:08.717804+0000","last_became_active":"2024-09-11T23:19:07.287130+0000","last_became_peered":"2024-09-11T23:19:07.287130+0000","last_unstale":"2024-09-11T23:19:08.717804+0000","last_undegraded":"2024-09-11T23:19:08.717804+0000","last_fullsized":"2024-09-11T23:19:08.717804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720523+0000","last_change":"2024-09-11T23:19:07.285031+0000","last_active":"2024-09-11T23:19:08.720523+0000","last_peered":"2024-09-11T23:19:08.720523+0000","last_clean":"2024-09-11T23:19:08.720523+0000","last_became_active":"2024-09-11T23:19:07.284370+0000","last_became_peered":"2024-09-11T23:19:07.284370+0000","last_unstale":"2024-09-11T23:19:08.720523+0000","last_undegraded":"2024-09-11T23:19:08.720523+0000","last_fullsized":"2024-09-11T23:19:08.720523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:42.999802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716775+0000","last_change":"2024-09-11T23:19:07.280084+0000","last_active":"2024-09-11T23:19:08.716775+0000","last_peered":"2024-09-11T23:19:08.716775+0000","last_clean":"2024-09-11T23:19:08.716775+0000","last_became_active":"2024-09-11T23:19:07.279421+0000","last_became_peered":"2024-09-11T23:19:07.279421+0000","last_unstale":"2024-09-11T23:19:08.716775+0000","last_undegraded":"2024-09-11T23:19:08.716775+0000","last_fullsized":"2024-09-11T23:19:08.716775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.375641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718675+0000","last_change":"2024-09-11T23:19:07.300361+0000","last_active":"2024-09-11T23:19:08.718675+0000","last_peered":"2024-09-11T23:19:08.718675+0000","last_clean":"2024-09-11T23:19:08.718675+0000","last_became_active":"2024-09-11T23:19:07.296623+0000","last_became_peered":"2024-09-11T23:19:07.296623+0000","last_unstale":"2024-09-11T23:19:08.718675+0000","last_undegraded":"2024-09-11T23:19:08.718675+0000","last_fullsized":"2024-09-11T23:19:08.718675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:45.889124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251055+0000","last_change":"2024-09-11T23:19:07.292327+0000","last_active":"2024-09-11T23:19:08.251055+0000","last_peered":"2024-09-11T23:19:08.251055+0000","last_clean":"2024-09-11T23:19:08.251055+0000","last_became_active":"2024-09-11T23:19:07.291672+0000","last_became_peered":"2024-09-11T23:19:07.291672+0000","last_unstale":"2024-09-11T23:19:08.251055+0000","last_undegraded":"2024-09-11T23:19:08.251055+0000","last_fullsized":"2024-09-11T23:19:08.251055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717953+0000","last_change":"2024-09-11T23:19:07.276414+0000","last_active":"2024-09-11T23:19:08.717953+0000","last_peered":"2024-09-11T23:19:08.717953+0000","last_clean":"2024-09-11T23:19:08.717953+0000","last_became_active":"2024-09-11T23:19:07.275687+0000","last_became_peered":"2024-09-11T23:19:07.275687+0000","last_unstale":"2024-09-11T23:19:08.717953+0000","last_undegraded":"2024-09-11T23:19:08.717953+0000","last_fullsized":"2024-09-11T23:19:08.717953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:52.848080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717538+0000","last_change":"2024-09-11T23:19:07.267908+0000","last_active":"2024-09-11T23:19:08.717538+0000","last_peered":"2024-09-11T23:19:08.717538+0000","last_clean":"2024-09-11T23:19:08.717538+0000","last_became_active":"2024-09-11T23:19:07.267171+0000","last_became_peered":"2024-09-11T23:19:07.267171+0000","last_unstale":"2024-09-11T23:19:08.717538+0000","last_undegraded":"2024-09-11T23:19:08.717538+0000","last_fullsized":"2024-09-11T23:19:08.717538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.610610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246777+0000","last_change":"2024-09-11T23:19:07.273226+0000","last_active":"2024-09-11T23:19:08.246777+0000","last_peered":"2024-09-11T23:19:08.246777+0000","last_clean":"2024-09-11T23:19:08.246777+0000","last_became_active":"2024-09-11T23:19:07.272377+0000","last_became_peered":"2024-09-11T23:19:07.272377+0000","last_unstale":"2024-09-11T23:19:08.246777+0000","last_undegraded":"2024-09-11T23:19:08.246777+0000","last_fullsized":"2024-09-11T23:19:08.246777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:39.062796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717353+0000","last_change":"2024-09-11T23:19:07.293403+0000","last_active":"2024-09-11T23:19:08.717353+0000","last_peered":"2024-09-11T23:19:08.717353+0000","last_clean":"2024-09-11T23:19:08.717353+0000","last_became_active":"2024-09-11T23:19:07.292837+0000","last_became_peered":"2024-09-11T23:19:07.292837+0000","last_unstale":"2024-09-11T23:19:08.717353+0000","last_undegraded":"2024-09-11T23:19:08.717353+0000","last_fullsized":"2024-09-11T23:19:08.717353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:31.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246344+0000","last_change":"2024-09-11T23:19:07.267658+0000","last_active":"2024-09-11T23:19:08.246344+0000","last_peered":"2024-09-11T23:19:08.246344+0000","last_clean":"2024-09-11T23:19:08.246344+0000","last_became_active":"2024-09-11T23:19:07.266815+0000","last_became_peered":"2024-09-11T23:19:07.266815+0000","last_unstale":"2024-09-11T23:19:08.246344+0000","last_undegraded":"2024-09-11T23:19:08.246344+0000","last_fullsized":"2024-09-11T23:19:08.246344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:06.467531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721392+0000","last_change":"2024-09-11T23:19:07.276219+0000","last_active":"2024-09-11T23:19:08.721392+0000","last_peered":"2024-09-11T23:19:08.721392+0000","last_clean":"2024-09-11T23:19:08.721392+0000","last_became_active":"2024-09-11T23:19:07.275423+0000","last_became_peered":"2024-09-11T23:19:07.275423+0000","last_unstale":"2024-09-11T23:19:08.721392+0000","last_undegraded":"2024-09-11T23:19:08.721392+0000","last_fullsized":"2024-09-11T23:19:08.721392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716361+0000","last_change":"2024-09-11T23:19:07.287604+0000","last_active":"2024-09-11T23:19:08.716361+0000","last_peered":"2024-09-11T23:19:08.716361+0000","last_clean":"2024-09-11T23:19:08.716361+0000","last_became_active":"2024-09-11T23:19:07.286892+0000","last_became_peered":"2024-09-11T23:19:07.286892+0000","last_unstale":"2024-09-11T23:19:08.716361+0000","last_undegraded":"2024-09-11T23:19:08.716361+0000","last_fullsized":"2024-09-11T23:19:08.716361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:23.840157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718884+0000","last_change":"2024-09-11T23:19:07.294812+0000","last_active":"2024-09-11T23:19:08.718884+0000","last_peered":"2024-09-11T23:19:08.718884+0000","last_clean":"2024-09-11T23:19:08.718884+0000","last_became_active":"2024-09-11T23:19:07.293948+0000","last_became_peered":"2024-09-11T23:19:07.293948+0000","last_unstale":"2024-09-11T23:19:08.718884+0000","last_undegraded":"2024-09-11T23:19:08.718884+0000","last_fullsized":"2024-09-11T23:19:08.718884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:42.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718340+0000","last_change":"2024-09-11T23:19:07.301020+0000","last_active":"2024-09-11T23:19:08.718340+0000","last_peered":"2024-09-11T23:19:08.718340+0000","last_clean":"2024-09-11T23:19:08.718340+0000","last_became_active":"2024-09-11T23:19:07.300426+0000","last_became_peered":"2024-09-11T23:19:07.300426+0000","last_unstale":"2024-09-11T23:19:08.718340+0000","last_undegraded":"2024-09-11T23:19:08.718340+0000","last_fullsized":"2024-09-11T23:19:08.718340+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:36.980299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721070+0000","last_change":"2024-09-11T23:19:07.301254+0000","last_active":"2024-09-11T23:19:08.721070+0000","last_peered":"2024-09-11T23:19:08.721070+0000","last_clean":"2024-09-11T23:19:08.721070+0000","last_became_active":"2024-09-11T23:19:07.300503+0000","last_became_peered":"2024-09-11T23:19:07.300503+0000","last_unstale":"2024-09-11T23:19:08.721070+0000","last_undegraded":"2024-09-11T23:19:08.721070+0000","last_fullsized":"2024-09-11T23:19:08.721070+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:46.323833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719762+0000","last_change":"2024-09-11T23:19:07.279737+0000","last_active":"2024-09-11T23:19:08.719762+0000","last_peered":"2024-09-11T23:19:08.719762+0000","last_clean":"2024-09-11T23:19:08.719762+0000","last_became_active":"2024-09-11T23:19:07.278906+0000","last_became_peered":"2024-09-11T23:19:07.278906+0000","last_unstale":"2024-09-11T23:19:08.719762+0000","last_undegraded":"2024-09-11T23:19:08.719762+0000","last_fullsized":"2024-09-11T23:19:08.719762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717617+0000","last_change":"2024-09-11T23:19:07.273684+0000","last_active":"2024-09-11T23:19:08.717617+0000","last_peered":"2024-09-11T23:19:08.717617+0000","last_clean":"2024-09-11T23:19:08.717617+0000","last_became_active":"2024-09-11T23:19:07.272918+0000","last_became_peered":"2024-09-11T23:19:07.272918+0000","last_unstale":"2024-09-11T23:19:08.717617+0000","last_undegraded":"2024-09-11T23:19:08.717617+0000","last_fullsized":"2024-09-11T23:19:08.717617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:15.825107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720941+0000","last_change":"2024-09-11T23:19:07.269726+0000","last_active":"2024-09-11T23:19:08.720941+0000","last_peered":"2024-09-11T23:19:08.720941+0000","last_clean":"2024-09-11T23:19:08.720941+0000","last_became_active":"2024-09-11T23:19:07.267916+0000","last_became_peered":"2024-09-11T23:19:07.267916+0000","last_unstale":"2024-09-11T23:19:08.720941+0000","last_undegraded":"2024-09-11T23:19:08.720941+0000","last_fullsized":"2024-09-11T23:19:08.720941+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:50.199522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717217+0000","last_change":"2024-09-11T23:19:07.274965+0000","last_active":"2024-09-11T23:19:08.717217+0000","last_peered":"2024-09-11T23:19:08.717217+0000","last_clean":"2024-09-11T23:19:08.717217+0000","last_became_active":"2024-09-11T23:19:07.274264+0000","last_became_peered":"2024-09-11T23:19:07.274264+0000","last_unstale":"2024-09-11T23:19:08.717217+0000","last_undegraded":"2024-09-11T23:19:08.717217+0000","last_fullsized":"2024-09-11T23:19:08.717217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:09.238424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716465+0000","last_change":"2024-09-11T23:19:07.276419+0000","last_active":"2024-09-11T23:19:08.716465+0000","last_peered":"2024-09-11T23:19:08.716465+0000","last_clean":"2024-09-11T23:19:08.716465+0000","last_became_active":"2024-09-11T23:19:07.275680+0000","last_became_peered":"2024-09-11T23:19:07.275680+0000","last_unstale":"2024-09-11T23:19:08.716465+0000","last_undegraded":"2024-09-11T23:19:08.716465+0000","last_fullsized":"2024-09-11T23:19:08.716465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:57.679979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487637+0000","last_change":"2024-09-11T23:19:07.285483+0000","last_active":"2024-09-11T23:19:08.487637+0000","last_peered":"2024-09-11T23:19:08.487637+0000","last_clean":"2024-09-11T23:19:08.487637+0000","last_became_active":"2024-09-11T23:19:07.284797+0000","last_became_peered":"2024-09-11T23:19:07.284797+0000","last_unstale":"2024-09-11T23:19:08.487637+0000","last_undegraded":"2024-09-11T23:19:08.487637+0000","last_fullsized":"2024-09-11T23:19:08.487637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:55.113683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716877+0000","last_change":"2024-09-11T23:19:07.294453+0000","last_active":"2024-09-11T23:19:08.716877+0000","last_peered":"2024-09-11T23:19:08.716877+0000","last_clean":"2024-09-11T23:19:08.716877+0000","last_became_active":"2024-09-11T23:19:07.289149+0000","last_became_peered":"2024-09-11T23:19:07.289149+0000","last_unstale":"2024-09-11T23:19:08.716877+0000","last_undegraded":"2024-09-11T23:19:08.716877+0000","last_fullsized":"2024-09-11T23:19:08.716877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:42.999802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.540912+0000","last_change":"2024-09-11T23:19:06.540912+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.540912+0000","last_undegraded":"2024-09-11T23:19:06.540912+0000","last_fullsized":"2024-09-11T23:19:06.540912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716908+0000","last_change":"2024-09-11T23:19:07.272645+0000","last_active":"2024-09-11T23:19:08.716908+0000","last_peered":"2024-09-11T23:19:08.716908+0000","last_clean":"2024-09-11T23:19:08.716908+0000","last_became_active":"2024-09-11T23:19:07.271605+0000","last_became_peered":"2024-09-11T23:19:07.271605+0000","last_unstale":"2024-09-11T23:19:08.716908+0000","last_undegraded":"2024-09-11T23:19:08.716908+0000","last_fullsized":"2024-09-11T23:19:08.716908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:17.625285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246485+0000","last_change":"2024-09-11T23:19:07.273847+0000","last_active":"2024-09-11T23:19:08.246485+0000","last_peered":"2024-09-11T23:19:08.246485+0000","last_clean":"2024-09-11T23:19:08.246485+0000","last_became_active":"2024-09-11T23:19:07.273002+0000","last_became_peered":"2024-09-11T23:19:07.273002+0000","last_unstale":"2024-09-11T23:19:08.246485+0000","last_undegraded":"2024-09-11T23:19:08.246485+0000","last_fullsized":"2024-09-11T23:19:08.246485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:26.767798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720999+0000","last_change":"2024-09-11T23:19:07.270430+0000","last_active":"2024-09-11T23:19:08.720999+0000","last_peered":"2024-09-11T23:19:08.720999+0000","last_clean":"2024-09-11T23:19:08.720999+0000","last_became_active":"2024-09-11T23:19:07.268975+0000","last_became_peered":"2024-09-11T23:19:07.268975+0000","last_unstale":"2024-09-11T23:19:08.720999+0000","last_undegraded":"2024-09-11T23:19:08.720999+0000","last_fullsized":"2024-09-11T23:19:08.720999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251523+0000","last_change":"2024-09-11T23:19:07.281880+0000","last_active":"2024-09-11T23:19:08.251523+0000","last_peered":"2024-09-11T23:19:08.251523+0000","last_clean":"2024-09-11T23:19:08.251523+0000","last_became_active":"2024-09-11T23:19:07.281103+0000","last_became_peered":"2024-09-11T23:19:07.281103+0000","last_unstale":"2024-09-11T23:19:08.251523+0000","last_undegraded":"2024-09-11T23:19:08.251523+0000","last_fullsized":"2024-09-11T23:19:08.251523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:48.744420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716951+0000","last_change":"2024-09-11T23:19:07.262326+0000","last_active":"2024-09-11T23:19:08.716951+0000","last_peered":"2024-09-11T23:19:08.716951+0000","last_clean":"2024-09-11T23:19:08.716951+0000","last_became_active":"2024-09-11T23:19:07.261757+0000","last_became_peered":"2024-09-11T23:19:07.261757+0000","last_unstale":"2024-09-11T23:19:08.716951+0000","last_undegraded":"2024-09-11T23:19:08.716951+0000","last_fullsized":"2024-09-11T23:19:08.716951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:42.689297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.551841+0000","last_change":"2024-09-11T23:19:06.551841+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.551841+0000","last_undegraded":"2024-09-11T23:19:06.551841+0000","last_fullsized":"2024-09-11T23:19:06.551841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718731+0000","last_change":"2024-09-11T23:19:07.300317+0000","last_active":"2024-09-11T23:19:08.718731+0000","last_peered":"2024-09-11T23:19:08.718731+0000","last_clean":"2024-09-11T23:19:08.718731+0000","last_became_active":"2024-09-11T23:19:07.295215+0000","last_became_peered":"2024-09-11T23:19:07.295215+0000","last_unstale":"2024-09-11T23:19:08.718731+0000","last_undegraded":"2024-09-11T23:19:08.718731+0000","last_fullsized":"2024-09-11T23:19:08.718731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:21:48.158519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719309+0000","last_change":"2024-09-11T23:19:07.301395+0000","last_active":"2024-09-11T23:19:08.719309+0000","last_peered":"2024-09-11T23:19:08.719309+0000","last_clean":"2024-09-11T23:19:08.719309+0000","last_became_active":"2024-09-11T23:19:07.296132+0000","last_became_peered":"2024-09-11T23:19:07.296132+0000","last_unstale":"2024-09-11T23:19:08.719309+0000","last_undegraded":"2024-09-11T23:19:08.719309+0000","last_fullsized":"2024-09-11T23:19:08.719309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:34.490776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487914+0000","last_change":"2024-09-11T23:19:06.560592+0000","last_active":"2024-09-11T23:19:08.487914+0000","last_peered":"2024-09-11T23:19:08.487914+0000","last_clean":"2024-09-11T23:19:08.487914+0000","last_became_active":"2024-09-11T23:19:06.559887+0000","last_became_peered":"2024-09-11T23:19:06.559887+0000","last_unstale":"2024-09-11T23:19:08.487914+0000","last_undegraded":"2024-09-11T23:19:08.487914+0000","last_fullsized":"2024-09-11T23:19:08.487914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720626+0000","last_change":"2024-09-11T23:19:07.276328+0000","last_active":"2024-09-11T23:19:08.720626+0000","last_peered":"2024-09-11T23:19:08.720626+0000","last_clean":"2024-09-11T23:19:08.720626+0000","last_became_active":"2024-09-11T23:19:07.275546+0000","last_became_peered":"2024-09-11T23:19:07.275546+0000","last_unstale":"2024-09-11T23:19:08.720626+0000","last_undegraded":"2024-09-11T23:19:08.720626+0000","last_fullsized":"2024-09-11T23:19:08.720626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:10.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717286+0000","last_change":"2024-09-11T23:19:06.575536+0000","last_active":"2024-09-11T23:19:08.717286+0000","last_peered":"2024-09-11T23:19:08.717286+0000","last_clean":"2024-09-11T23:19:08.717286+0000","last_became_active":"2024-09-11T23:19:06.574927+0000","last_became_peered":"2024-09-11T23:19:06.574927+0000","last_unstale":"2024-09-11T23:19:08.717286+0000","last_undegraded":"2024-09-11T23:19:08.717286+0000","last_fullsized":"2024-09-11T23:19:08.717286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:18.826160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251446+0000","last_change":"2024-09-11T23:19:07.287664+0000","last_active":"2024-09-11T23:19:08.251446+0000","last_peered":"2024-09-11T23:19:08.251446+0000","last_clean":"2024-09-11T23:19:08.251446+0000","last_became_active":"2024-09-11T23:19:07.286718+0000","last_became_peered":"2024-09-11T23:19:07.286718+0000","last_unstale":"2024-09-11T23:19:08.251446+0000","last_undegraded":"2024-09-11T23:19:08.251446+0000","last_fullsized":"2024-09-11T23:19:08.251446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:15.768732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251333+0000","last_change":"2024-09-11T23:19:06.553845+0000","last_active":"2024-09-11T23:19:08.251333+0000","last_peered":"2024-09-11T23:19:08.251333+0000","last_clean":"2024-09-11T23:19:08.251333+0000","last_became_active":"2024-09-11T23:19:06.552969+0000","last_became_peered":"2024-09-11T23:19:06.552969+0000","last_unstale":"2024-09-11T23:19:08.251333+0000","last_undegraded":"2024-09-11T23:19:08.251333+0000","last_fullsized":"2024-09-11T23:19:08.251333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:54.109585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721265+0000","last_change":"2024-09-11T23:19:07.297005+0000","last_active":"2024-09-11T23:19:08.721265+0000","last_peered":"2024-09-11T23:19:08.721265+0000","last_clean":"2024-09-11T23:19:08.721265+0000","last_became_active":"2024-09-11T23:19:07.289993+0000","last_became_peered":"2024-09-11T23:19:07.289993+0000","last_unstale":"2024-09-11T23:19:08.721265+0000","last_undegraded":"2024-09-11T23:19:08.721265+0000","last_fullsized":"2024-09-11T23:19:08.721265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:54.378314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488127+0000","last_change":"2024-09-11T23:19:06.564108+0000","last_active":"2024-09-11T23:19:08.488127+0000","last_peered":"2024-09-11T23:19:08.488127+0000","last_clean":"2024-09-11T23:19:08.488127+0000","last_became_active":"2024-09-11T23:19:06.563110+0000","last_became_peered":"2024-09-11T23:19:06.563110+0000","last_unstale":"2024-09-11T23:19:08.488127+0000","last_undegraded":"2024-09-11T23:19:08.488127+0000","last_fullsized":"2024-09-11T23:19:08.488127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:16.621187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718545+0000","last_change":"2024-09-11T23:19:07.268437+0000","last_active":"2024-09-11T23:19:08.718545+0000","last_peered":"2024-09-11T23:19:08.718545+0000","last_clean":"2024-09-11T23:19:08.718545+0000","last_became_active":"2024-09-11T23:19:07.267670+0000","last_became_peered":"2024-09-11T23:19:07.267670+0000","last_unstale":"2024-09-11T23:19:08.718545+0000","last_undegraded":"2024-09-11T23:19:08.718545+0000","last_fullsized":"2024-09-11T23:19:08.718545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:41.868692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717280+0000","last_change":"2024-09-11T23:19:06.561822+0000","last_active":"2024-09-11T23:19:08.717280+0000","last_peered":"2024-09-11T23:19:08.717280+0000","last_clean":"2024-09-11T23:19:08.717280+0000","last_became_active":"2024-09-11T23:19:06.560453+0000","last_became_peered":"2024-09-11T23:19:06.560453+0000","last_unstale":"2024-09-11T23:19:08.717280+0000","last_undegraded":"2024-09-11T23:19:08.717280+0000","last_fullsized":"2024-09-11T23:19:08.717280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:32.014798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487855+0000","last_change":"2024-09-11T23:19:07.291025+0000","last_active":"2024-09-11T23:19:08.487855+0000","last_peered":"2024-09-11T23:19:08.487855+0000","last_clean":"2024-09-11T23:19:08.487855+0000","last_became_active":"2024-09-11T23:19:07.290507+0000","last_became_peered":"2024-09-11T23:19:07.290507+0000","last_unstale":"2024-09-11T23:19:08.487855+0000","last_undegraded":"2024-09-11T23:19:08.487855+0000","last_fullsized":"2024-09-11T23:19:08.487855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:52.848080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718826+0000","last_change":"2024-09-11T23:19:06.552799+0000","last_active":"2024-09-11T23:19:08.718826+0000","last_peered":"2024-09-11T23:19:08.718826+0000","last_clean":"2024-09-11T23:19:08.718826+0000","last_became_active":"2024-09-11T23:19:06.551350+0000","last_became_peered":"2024-09-11T23:19:06.551350+0000","last_unstale":"2024-09-11T23:19:08.718826+0000","last_undegraded":"2024-09-11T23:19:08.718826+0000","last_fullsized":"2024-09-11T23:19:08.718826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719052+0000","last_change":"2024-09-11T23:19:07.301013+0000","last_active":"2024-09-11T23:19:08.719052+0000","last_peered":"2024-09-11T23:19:08.719052+0000","last_clean":"2024-09-11T23:19:08.719052+0000","last_became_active":"2024-09-11T23:19:07.296834+0000","last_became_peered":"2024-09-11T23:19:07.296834+0000","last_unstale":"2024-09-11T23:19:08.719052+0000","last_undegraded":"2024-09-11T23:19:08.719052+0000","last_fullsized":"2024-09-11T23:19:08.719052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:34.486984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717697+0000","last_change":"2024-09-11T23:19:06.554582+0000","last_active":"2024-09-11T23:19:08.717697+0000","last_peered":"2024-09-11T23:19:08.717697+0000","last_clean":"2024-09-11T23:19:08.717697+0000","last_became_active":"2024-09-11T23:19:06.554159+0000","last_became_peered":"2024-09-11T23:19:06.554159+0000","last_unstale":"2024-09-11T23:19:08.717697+0000","last_undegraded":"2024-09-11T23:19:08.717697+0000","last_fullsized":"2024-09-11T23:19:08.717697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:14.821009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721572+0000","last_change":"2024-09-11T23:19:07.281622+0000","last_active":"2024-09-11T23:19:08.721572+0000","last_peered":"2024-09-11T23:19:08.721572+0000","last_clean":"2024-09-11T23:19:08.721572+0000","last_became_active":"2024-09-11T23:19:07.280852+0000","last_became_peered":"2024-09-11T23:19:07.280852+0000","last_unstale":"2024-09-11T23:19:08.721572+0000","last_undegraded":"2024-09-11T23:19:08.721572+0000","last_fullsized":"2024-09-11T23:19:08.721572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250674+0000","last_change":"2024-09-11T23:19:06.545476+0000","last_active":"2024-09-11T23:19:08.250674+0000","last_peered":"2024-09-11T23:19:08.250674+0000","last_clean":"2024-09-11T23:19:08.250674+0000","last_became_active":"2024-09-11T23:19:06.544759+0000","last_became_peered":"2024-09-11T23:19:06.544759+0000","last_unstale":"2024-09-11T23:19:08.250674+0000","last_undegraded":"2024-09-11T23:19:08.250674+0000","last_fullsized":"2024-09-11T23:19:08.250674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:14.821009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717008+0000","last_change":"2024-09-11T23:19:07.291721+0000","last_active":"2024-09-11T23:19:08.717008+0000","last_peered":"2024-09-11T23:19:08.717008+0000","last_clean":"2024-09-11T23:19:08.717008+0000","last_became_active":"2024-09-11T23:19:07.289118+0000","last_became_peered":"2024-09-11T23:19:07.289118+0000","last_unstale":"2024-09-11T23:19:08.717008+0000","last_undegraded":"2024-09-11T23:19:08.717008+0000","last_fullsized":"2024-09-11T23:19:08.717008+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:29.274579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.568240+0000","last_change":"2024-09-11T23:19:06.562370+0000","last_active":"2024-09-11T23:19:06.568240+0000","last_peered":"2024-09-11T23:19:06.568240+0000","last_clean":"2024-09-11T23:19:06.568240+0000","last_became_active":"2024-09-11T23:19:06.561679+0000","last_became_peered":"2024-09-11T23:19:06.561679+0000","last_unstale":"2024-09-11T23:19:06.568240+0000","last_undegraded":"2024-09-11T23:19:06.568240+0000","last_fullsized":"2024-09-11T23:19:06.568240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:16.621187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251226+0000","last_change":"2024-09-11T23:19:07.284495+0000","last_active":"2024-09-11T23:19:08.251226+0000","last_peered":"2024-09-11T23:19:08.251226+0000","last_clean":"2024-09-11T23:19:08.251226+0000","last_became_active":"2024-09-11T23:19:07.283741+0000","last_became_peered":"2024-09-11T23:19:07.283741+0000","last_unstale":"2024-09-11T23:19:08.251226+0000","last_undegraded":"2024-09-11T23:19:08.251226+0000","last_fullsized":"2024-09-11T23:19:08.251226+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720405+0000","last_change":"2024-09-11T23:19:06.547195+0000","last_active":"2024-09-11T23:19:08.720405+0000","last_peered":"2024-09-11T23:19:08.720405+0000","last_clean":"2024-09-11T23:19:08.720405+0000","last_became_active":"2024-09-11T23:19:06.546903+0000","last_became_peered":"2024-09-11T23:19:06.546903+0000","last_unstale":"2024-09-11T23:19:08.720405+0000","last_undegraded":"2024-09-11T23:19:08.720405+0000","last_fullsized":"2024-09-11T23:19:08.720405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:27.606512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720154+0000","last_change":"2024-09-11T23:19:07.294643+0000","last_active":"2024-09-11T23:19:08.720154+0000","last_peered":"2024-09-11T23:19:08.720154+0000","last_clean":"2024-09-11T23:19:08.720154+0000","last_became_active":"2024-09-11T23:19:07.289722+0000","last_became_peered":"2024-09-11T23:19:07.289722+0000","last_unstale":"2024-09-11T23:19:08.720154+0000","last_undegraded":"2024-09-11T23:19:08.720154+0000","last_fullsized":"2024-09-11T23:19:08.720154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:15.768732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717786+0000","last_change":"2024-09-11T23:19:06.576092+0000","last_active":"2024-09-11T23:19:08.717786+0000","last_peered":"2024-09-11T23:19:08.717786+0000","last_clean":"2024-09-11T23:19:08.717786+0000","last_became_active":"2024-09-11T23:19:06.574510+0000","last_became_peered":"2024-09-11T23:19:06.574510+0000","last_unstale":"2024-09-11T23:19:08.717786+0000","last_undegraded":"2024-09-11T23:19:08.717786+0000","last_fullsized":"2024-09-11T23:19:08.717786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:18.777847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718263+0000","last_change":"2024-09-11T23:19:07.261367+0000","last_active":"2024-09-11T23:19:08.718263+0000","last_peered":"2024-09-11T23:19:08.718263+0000","last_clean":"2024-09-11T23:19:08.718263+0000","last_became_active":"2024-09-11T23:19:07.260600+0000","last_became_peered":"2024-09-11T23:19:07.260600+0000","last_unstale":"2024-09-11T23:19:08.718263+0000","last_undegraded":"2024-09-11T23:19:08.718263+0000","last_fullsized":"2024-09-11T23:19:08.718263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.343457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719902+0000","last_change":"2024-09-11T23:19:06.562096+0000","last_active":"2024-09-11T23:19:08.719902+0000","last_peered":"2024-09-11T23:19:08.719902+0000","last_clean":"2024-09-11T23:19:08.719902+0000","last_became_active":"2024-09-11T23:19:06.561837+0000","last_became_peered":"2024-09-11T23:19:06.561837+0000","last_unstale":"2024-09-11T23:19:08.719902+0000","last_undegraded":"2024-09-11T23:19:08.719902+0000","last_fullsized":"2024-09-11T23:19:08.719902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:57.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718600+0000","last_change":"2024-09-11T23:19:07.276560+0000","last_active":"2024-09-11T23:19:08.718600+0000","last_peered":"2024-09-11T23:19:08.718600+0000","last_clean":"2024-09-11T23:19:08.718600+0000","last_became_active":"2024-09-11T23:19:07.275806+0000","last_became_peered":"2024-09-11T23:19:07.275806+0000","last_unstale":"2024-09-11T23:19:08.718600+0000","last_undegraded":"2024-09-11T23:19:08.718600+0000","last_fullsized":"2024-09-11T23:19:08.718600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.719661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251219+0000","last_change":"2024-09-11T23:19:06.556199+0000","last_active":"2024-09-11T23:19:08.251219+0000","last_peered":"2024-09-11T23:19:08.251219+0000","last_clean":"2024-09-11T23:19:08.251219+0000","last_became_active":"2024-09-11T23:19:06.555517+0000","last_became_peered":"2024-09-11T23:19:06.555517+0000","last_unstale":"2024-09-11T23:19:08.251219+0000","last_undegraded":"2024-09-11T23:19:08.251219+0000","last_fullsized":"2024-09-11T23:19:08.251219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:51.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716393+0000","last_change":"2024-09-11T23:19:07.277492+0000","last_active":"2024-09-11T23:19:08.716393+0000","last_peered":"2024-09-11T23:19:08.716393+0000","last_clean":"2024-09-11T23:19:08.716393+0000","last_became_active":"2024-09-11T23:19:07.276783+0000","last_became_peered":"2024-09-11T23:19:07.276783+0000","last_unstale":"2024-09-11T23:19:08.716393+0000","last_undegraded":"2024-09-11T23:19:08.716393+0000","last_fullsized":"2024-09-11T23:19:08.716393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:16.764355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719304+0000","last_change":"2024-09-11T23:19:06.577144+0000","last_active":"2024-09-11T23:19:08.719304+0000","last_peered":"2024-09-11T23:19:08.719304+0000","last_clean":"2024-09-11T23:19:08.719304+0000","last_became_active":"2024-09-11T23:19:06.576853+0000","last_became_peered":"2024-09-11T23:19:06.576853+0000","last_unstale":"2024-09-11T23:19:08.719304+0000","last_undegraded":"2024-09-11T23:19:08.719304+0000","last_fullsized":"2024-09-11T23:19:08.719304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:40.810413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246156+0000","last_change":"2024-09-11T23:19:07.274484+0000","last_active":"2024-09-11T23:19:08.246156+0000","last_peered":"2024-09-11T23:19:08.246156+0000","last_clean":"2024-09-11T23:19:08.246156+0000","last_became_active":"2024-09-11T23:19:07.273727+0000","last_became_peered":"2024-09-11T23:19:07.273727+0000","last_unstale":"2024-09-11T23:19:08.246156+0000","last_undegraded":"2024-09-11T23:19:08.246156+0000","last_fullsized":"2024-09-11T23:19:08.246156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:13.646710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719299+0000","last_change":"2024-09-11T23:19:06.563280+0000","last_active":"2024-09-11T23:19:08.719299+0000","last_peered":"2024-09-11T23:19:08.719299+0000","last_clean":"2024-09-11T23:19:08.719299+0000","last_became_active":"2024-09-11T23:19:06.562981+0000","last_became_peered":"2024-09-11T23:19:06.562981+0000","last_unstale":"2024-09-11T23:19:08.719299+0000","last_undegraded":"2024-09-11T23:19:08.719299+0000","last_fullsized":"2024-09-11T23:19:08.719299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:22.836059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246572+0000","last_change":"2024-09-11T23:19:07.266185+0000","last_active":"2024-09-11T23:19:08.246572+0000","last_peered":"2024-09-11T23:19:08.246572+0000","last_clean":"2024-09-11T23:19:08.246572+0000","last_became_active":"2024-09-11T23:19:07.265430+0000","last_became_peered":"2024-09-11T23:19:07.265430+0000","last_unstale":"2024-09-11T23:19:08.246572+0000","last_undegraded":"2024-09-11T23:19:08.246572+0000","last_fullsized":"2024-09-11T23:19:08.246572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:19.364412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718804+0000","last_change":"2024-09-11T23:19:06.550310+0000","last_active":"2024-09-11T23:19:08.718804+0000","last_peered":"2024-09-11T23:19:08.718804+0000","last_clean":"2024-09-11T23:19:08.718804+0000","last_became_active":"2024-09-11T23:19:06.550073+0000","last_became_peered":"2024-09-11T23:19:06.550073+0000","last_unstale":"2024-09-11T23:19:08.718804+0000","last_undegraded":"2024-09-11T23:19:08.718804+0000","last_fullsized":"2024-09-11T23:19:08.718804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719683+0000","last_change":"2024-09-11T23:19:07.287532+0000","last_active":"2024-09-11T23:19:08.719683+0000","last_peered":"2024-09-11T23:19:08.719683+0000","last_clean":"2024-09-11T23:19:08.719683+0000","last_became_active":"2024-09-11T23:19:07.286814+0000","last_became_peered":"2024-09-11T23:19:07.286814+0000","last_unstale":"2024-09-11T23:19:08.719683+0000","last_undegraded":"2024-09-11T23:19:08.719683+0000","last_fullsized":"2024-09-11T23:19:08.719683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:03.369383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488242+0000","last_change":"2024-09-11T23:19:06.569779+0000","last_active":"2024-09-11T23:19:08.488242+0000","last_peered":"2024-09-11T23:19:08.488242+0000","last_clean":"2024-09-11T23:19:08.488242+0000","last_became_active":"2024-09-11T23:19:06.569044+0000","last_became_peered":"2024-09-11T23:19:06.569044+0000","last_unstale":"2024-09-11T23:19:08.488242+0000","last_undegraded":"2024-09-11T23:19:08.488242+0000","last_fullsized":"2024-09-11T23:19:08.488242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488112+0000","last_change":"2024-09-11T23:19:07.278428+0000","last_active":"2024-09-11T23:19:08.488112+0000","last_peered":"2024-09-11T23:19:08.488112+0000","last_clean":"2024-09-11T23:19:08.488112+0000","last_became_active":"2024-09-11T23:19:07.277629+0000","last_became_peered":"2024-09-11T23:19:07.277629+0000","last_unstale":"2024-09-11T23:19:08.488112+0000","last_undegraded":"2024-09-11T23:19:08.488112+0000","last_fullsized":"2024-09-11T23:19:08.488112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:41.868692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251292+0000","last_change":"2024-09-11T23:19:06.566301+0000","last_active":"2024-09-11T23:19:08.251292+0000","last_peered":"2024-09-11T23:19:08.251292+0000","last_clean":"2024-09-11T23:19:08.251292+0000","last_became_active":"2024-09-11T23:19:06.565597+0000","last_became_peered":"2024-09-11T23:19:06.565597+0000","last_unstale":"2024-09-11T23:19:08.251292+0000","last_undegraded":"2024-09-11T23:19:08.251292+0000","last_fullsized":"2024-09-11T23:19:08.251292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:40.864594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717388+0000","last_change":"2024-09-11T23:19:07.266323+0000","last_active":"2024-09-11T23:19:08.717388+0000","last_peered":"2024-09-11T23:19:08.717388+0000","last_clean":"2024-09-11T23:19:08.717388+0000","last_became_active":"2024-09-11T23:19:07.265654+0000","last_became_peered":"2024-09-11T23:19:07.265654+0000","last_unstale":"2024-09-11T23:19:08.717388+0000","last_undegraded":"2024-09-11T23:19:08.717388+0000","last_fullsized":"2024-09-11T23:19:08.717388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:29.762898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717820+0000","last_change":"2024-09-11T23:19:06.571225+0000","last_active":"2024-09-11T23:19:08.717820+0000","last_peered":"2024-09-11T23:19:08.717820+0000","last_clean":"2024-09-11T23:19:08.717820+0000","last_became_active":"2024-09-11T23:19:06.570625+0000","last_became_peered":"2024-09-11T23:19:06.570625+0000","last_unstale":"2024-09-11T23:19:08.717820+0000","last_undegraded":"2024-09-11T23:19:08.717820+0000","last_fullsized":"2024-09-11T23:19:08.717820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:52.266753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719074+0000","last_change":"2024-09-11T23:19:07.301782+0000","last_active":"2024-09-11T23:19:08.719074+0000","last_peered":"2024-09-11T23:19:08.719074+0000","last_clean":"2024-09-11T23:19:08.719074+0000","last_became_active":"2024-09-11T23:19:07.301074+0000","last_became_peered":"2024-09-11T23:19:07.301074+0000","last_unstale":"2024-09-11T23:19:08.719074+0000","last_undegraded":"2024-09-11T23:19:08.719074+0000","last_fullsized":"2024-09-11T23:19:08.719074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.541770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.565094+0000","last_change":"2024-09-11T23:19:06.554094+0000","last_active":"2024-09-11T23:19:06.565094+0000","last_peered":"2024-09-11T23:19:06.565094+0000","last_clean":"2024-09-11T23:19:06.565094+0000","last_became_active":"2024-09-11T23:19:06.553375+0000","last_became_peered":"2024-09-11T23:19:06.553375+0000","last_unstale":"2024-09-11T23:19:06.565094+0000","last_undegraded":"2024-09-11T23:19:06.565094+0000","last_fullsized":"2024-09-11T23:19:06.565094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.542178+0000","last_change":"2024-09-11T23:19:06.542178+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.542178+0000","last_undegraded":"2024-09-11T23:19:06.542178+0000","last_fullsized":"2024-09-11T23:19:06.542178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246260+0000","last_change":"2024-09-11T23:19:06.546448+0000","last_active":"2024-09-11T23:19:08.246260+0000","last_peered":"2024-09-11T23:19:08.246260+0000","last_clean":"2024-09-11T23:19:08.246260+0000","last_became_active":"2024-09-11T23:19:06.545743+0000","last_became_peered":"2024-09-11T23:19:06.545743+0000","last_unstale":"2024-09-11T23:19:08.246260+0000","last_undegraded":"2024-09-11T23:19:08.246260+0000","last_fullsized":"2024-09-11T23:19:08.246260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:56.814459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.538492+0000","last_change":"2024-09-11T23:19:06.538492+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.538492+0000","last_undegraded":"2024-09-11T23:19:06.538492+0000","last_fullsized":"2024-09-11T23:19:06.538492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.566272+0000","last_change":"2024-09-11T23:19:06.558413+0000","last_active":"2024-09-11T23:19:06.566272+0000","last_peered":"2024-09-11T23:19:06.566272+0000","last_clean":"2024-09-11T23:19:06.566272+0000","last_became_active":"2024-09-11T23:19:06.557721+0000","last_became_peered":"2024-09-11T23:19:06.557721+0000","last_unstale":"2024-09-11T23:19:06.566272+0000","last_undegraded":"2024-09-11T23:19:06.566272+0000","last_fullsized":"2024-09-11T23:19:06.566272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717570+0000","last_change":"2024-09-11T23:19:07.276883+0000","last_active":"2024-09-11T23:19:08.717570+0000","last_peered":"2024-09-11T23:19:08.717570+0000","last_clean":"2024-09-11T23:19:08.717570+0000","last_became_active":"2024-09-11T23:19:07.276122+0000","last_became_peered":"2024-09-11T23:19:07.276122+0000","last_unstale":"2024-09-11T23:19:08.717570+0000","last_undegraded":"2024-09-11T23:19:08.717570+0000","last_fullsized":"2024-09-11T23:19:08.717570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:23.794337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246124+0000","last_change":"2024-09-11T23:19:06.557333+0000","last_active":"2024-09-11T23:19:08.246124+0000","last_peered":"2024-09-11T23:19:08.246124+0000","last_clean":"2024-09-11T23:19:08.246124+0000","last_became_active":"2024-09-11T23:19:06.556598+0000","last_became_peered":"2024-09-11T23:19:06.556598+0000","last_unstale":"2024-09-11T23:19:08.246124+0000","last_undegraded":"2024-09-11T23:19:08.246124+0000","last_fullsized":"2024-09-11T23:19:08.246124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:53.373475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487902+0000","last_change":"2024-09-11T23:19:07.281019+0000","last_active":"2024-09-11T23:19:08.487902+0000","last_peered":"2024-09-11T23:19:08.487902+0000","last_clean":"2024-09-11T23:19:08.487902+0000","last_became_active":"2024-09-11T23:19:07.280262+0000","last_became_peered":"2024-09-11T23:19:07.280262+0000","last_unstale":"2024-09-11T23:19:08.487902+0000","last_undegraded":"2024-09-11T23:19:08.487902+0000","last_fullsized":"2024-09-11T23:19:08.487902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.343457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251500+0000","last_change":"2024-09-11T23:19:06.565340+0000","last_active":"2024-09-11T23:19:08.251500+0000","last_peered":"2024-09-11T23:19:08.251500+0000","last_clean":"2024-09-11T23:19:08.251500+0000","last_became_active":"2024-09-11T23:19:06.564535+0000","last_became_peered":"2024-09-11T23:19:06.564535+0000","last_unstale":"2024-09-11T23:19:08.251500+0000","last_undegraded":"2024-09-11T23:19:08.251500+0000","last_fullsized":"2024-09-11T23:19:08.251500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:55.339358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720919+0000","last_change":"2024-09-11T23:19:07.301239+0000","last_active":"2024-09-11T23:19:08.720919+0000","last_peered":"2024-09-11T23:19:08.720919+0000","last_clean":"2024-09-11T23:19:08.720919+0000","last_became_active":"2024-09-11T23:19:07.300498+0000","last_became_peered":"2024-09-11T23:19:07.300498+0000","last_unstale":"2024-09-11T23:19:08.720919+0000","last_undegraded":"2024-09-11T23:19:08.720919+0000","last_fullsized":"2024-09-11T23:19:08.720919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:39.010094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717660+0000","last_change":"2024-09-11T23:19:06.574920+0000","last_active":"2024-09-11T23:19:08.717660+0000","last_peered":"2024-09-11T23:19:08.717660+0000","last_clean":"2024-09-11T23:19:08.717660+0000","last_became_active":"2024-09-11T23:19:06.571154+0000","last_became_peered":"2024-09-11T23:19:06.571154+0000","last_unstale":"2024-09-11T23:19:08.717660+0000","last_undegraded":"2024-09-11T23:19:08.717660+0000","last_fullsized":"2024-09-11T23:19:08.717660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:42.534717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719894+0000","last_change":"2024-09-11T23:19:07.301730+0000","last_active":"2024-09-11T23:19:08.719894+0000","last_peered":"2024-09-11T23:19:08.719894+0000","last_clean":"2024-09-11T23:19:08.719894+0000","last_became_active":"2024-09-11T23:19:07.296015+0000","last_became_peered":"2024-09-11T23:19:07.296015+0000","last_unstale":"2024-09-11T23:19:08.719894+0000","last_undegraded":"2024-09-11T23:19:08.719894+0000","last_fullsized":"2024-09-11T23:19:08.719894+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:09.839853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717944+0000","last_change":"2024-09-11T23:19:06.575470+0000","last_active":"2024-09-11T23:19:08.717944+0000","last_peered":"2024-09-11T23:19:08.717944+0000","last_clean":"2024-09-11T23:19:08.717944+0000","last_became_active":"2024-09-11T23:19:06.572387+0000","last_became_peered":"2024-09-11T23:19:06.572387+0000","last_unstale":"2024-09-11T23:19:08.717944+0000","last_undegraded":"2024-09-11T23:19:08.717944+0000","last_fullsized":"2024-09-11T23:19:08.717944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:55.383306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-11T23:19:06.539784+0000","last_change":"2024-09-11T23:19:06.539784+0000","last_active":"2024-09-11T23:19:06.515823+0000","last_peered":"2024-09-11T23:19:06.515823+0000","last_clean":"2024-09-11T23:19:06.515823+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:19:06.539784+0000","last_undegraded":"2024-09-11T23:19:06.539784+0000","last_fullsized":"2024-09-11T23:19:06.539784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488209+0000","last_change":"2024-09-11T23:19:06.559238+0000","last_active":"2024-09-11T23:19:08.488209+0000","last_peered":"2024-09-11T23:19:08.488209+0000","last_clean":"2024-09-11T23:19:08.488209+0000","last_became_active":"2024-09-11T23:19:06.558411+0000","last_became_peered":"2024-09-11T23:19:06.558411+0000","last_unstale":"2024-09-11T23:19:08.488209+0000","last_undegraded":"2024-09-11T23:19:08.488209+0000","last_fullsized":"2024-09-11T23:19:08.488209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:41.685199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246297+0000","last_change":"2024-09-11T23:19:07.281067+0000","last_active":"2024-09-11T23:19:08.246297+0000","last_peered":"2024-09-11T23:19:08.246297+0000","last_clean":"2024-09-11T23:19:08.246297+0000","last_became_active":"2024-09-11T23:19:07.280376+0000","last_became_peered":"2024-09-11T23:19:07.280376+0000","last_unstale":"2024-09-11T23:19:08.246297+0000","last_undegraded":"2024-09-11T23:19:08.246297+0000","last_fullsized":"2024-09-11T23:19:08.246297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:59.009388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718197+0000","last_change":"2024-09-11T23:19:06.577115+0000","last_active":"2024-09-11T23:19:08.718197+0000","last_peered":"2024-09-11T23:19:08.718197+0000","last_clean":"2024-09-11T23:19:08.718197+0000","last_became_active":"2024-09-11T23:19:06.576829+0000","last_became_peered":"2024-09-11T23:19:06.576829+0000","last_unstale":"2024-09-11T23:19:08.718197+0000","last_undegraded":"2024-09-11T23:19:08.718197+0000","last_fullsized":"2024-09-11T23:19:08.718197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.195424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717288+0000","last_change":"2024-09-11T23:19:07.300922+0000","last_active":"2024-09-11T23:19:08.717288+0000","last_peered":"2024-09-11T23:19:08.717288+0000","last_clean":"2024-09-11T23:19:08.717288+0000","last_became_active":"2024-09-11T23:19:07.298799+0000","last_became_peered":"2024-09-11T23:19:07.298799+0000","last_unstale":"2024-09-11T23:19:08.717288+0000","last_undegraded":"2024-09-11T23:19:08.717288+0000","last_fullsized":"2024-09-11T23:19:08.717288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:50.199522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T23:19:06.564950+0000","last_change":"2024-09-11T23:19:06.556306+0000","last_active":"2024-09-11T23:19:06.564950+0000","last_peered":"2024-09-11T23:19:06.564950+0000","last_clean":"2024-09-11T23:19:06.564950+0000","last_became_active":"2024-09-11T23:19:06.555615+0000","last_became_peered":"2024-09-11T23:19:06.555615+0000","last_unstale":"2024-09-11T23:19:06.564950+0000","last_undegraded":"2024-09-11T23:19:06.564950+0000","last_fullsized":"2024-09-11T23:19:06.564950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487575+0000","last_change":"2024-09-11T23:19:07.287433+0000","last_active":"2024-09-11T23:19:08.487575+0000","last_peered":"2024-09-11T23:19:08.487575+0000","last_clean":"2024-09-11T23:19:08.487575+0000","last_became_active":"2024-09-11T23:19:07.285837+0000","last_became_peered":"2024-09-11T23:19:07.285837+0000","last_unstale":"2024-09-11T23:19:08.487575+0000","last_undegraded":"2024-09-11T23:19:08.487575+0000","last_fullsized":"2024-09-11T23:19:08.487575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:43.077313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488122+0000","last_change":"2024-09-11T23:19:06.566084+0000","last_active":"2024-09-11T23:19:08.488122+0000","last_peered":"2024-09-11T23:19:08.488122+0000","last_clean":"2024-09-11T23:19:08.488122+0000","last_became_active":"2024-09-11T23:19:06.563321+0000","last_became_peered":"2024-09-11T23:19:06.563321+0000","last_unstale":"2024-09-11T23:19:08.488122+0000","last_undegraded":"2024-09-11T23:19:08.488122+0000","last_fullsized":"2024-09-11T23:19:08.488122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717968+0000","last_change":"2024-09-11T23:19:07.287130+0000","last_active":"2024-09-11T23:19:08.717968+0000","last_peered":"2024-09-11T23:19:08.717968+0000","last_clean":"2024-09-11T23:19:08.717968+0000","last_became_active":"2024-09-11T23:19:07.286410+0000","last_became_peered":"2024-09-11T23:19:07.286410+0000","last_unstale":"2024-09-11T23:19:08.717968+0000","last_undegraded":"2024-09-11T23:19:08.717968+0000","last_fullsized":"2024-09-11T23:19:08.717968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:38.849234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250769+0000","last_change":"2024-09-11T23:19:06.554823+0000","last_active":"2024-09-11T23:19:08.250769+0000","last_peered":"2024-09-11T23:19:08.250769+0000","last_clean":"2024-09-11T23:19:08.250769+0000","last_became_active":"2024-09-11T23:19:06.554113+0000","last_became_peered":"2024-09-11T23:19:06.554113+0000","last_unstale":"2024-09-11T23:19:08.250769+0000","last_undegraded":"2024-09-11T23:19:08.250769+0000","last_fullsized":"2024-09-11T23:19:08.250769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:42.073215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251719+0000","last_change":"2024-09-11T23:19:07.296848+0000","last_active":"2024-09-11T23:19:08.251719+0000","last_peered":"2024-09-11T23:19:08.251719+0000","last_clean":"2024-09-11T23:19:08.251719+0000","last_became_active":"2024-09-11T23:19:07.296316+0000","last_became_peered":"2024-09-11T23:19:07.296316+0000","last_unstale":"2024-09-11T23:19:08.251719+0000","last_undegraded":"2024-09-11T23:19:08.251719+0000","last_fullsized":"2024-09-11T23:19:08.251719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:02.464388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721192+0000","last_change":"2024-09-11T23:19:06.554819+0000","last_active":"2024-09-11T23:19:08.721192+0000","last_peered":"2024-09-11T23:19:08.721192+0000","last_clean":"2024-09-11T23:19:08.721192+0000","last_became_active":"2024-09-11T23:19:06.554385+0000","last_became_peered":"2024-09-11T23:19:06.554385+0000","last_unstale":"2024-09-11T23:19:08.721192+0000","last_undegraded":"2024-09-11T23:19:08.721192+0000","last_fullsized":"2024-09-11T23:19:08.721192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":295,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250983+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:19:08.250983+0000","last_peered":"2024-09-11T23:19:08.250983+0000","last_clean":"2024-09-11T23:19:08.250983+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:19:08.250983+0000","last_undegraded":"2024-09-11T23:19:08.250983+0000","last_fullsized":"2024-09-11T23:19:08.250983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1662976,"data_stored":1077122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1081344,"data_stored":488914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1036288,"data_stored":472839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":486858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1060864,"data_stored":486698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1060864,"data_stored":486698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40548,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331292,"statfs":{"total":96636764160,"available":96595243008,"internally_reserved":0,"allocated":1064960,"data_stored":486768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1679360,"data_stored":1079384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:14.296 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:14.299 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:16.029 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:16.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f3216640 1 Processor -- start 2024-09-11T23:19:16.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f3216640 1 -- start start 2024-09-11T23:19:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f3216640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 0x7f58ec0d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f3216640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ec0d1f70 con 0x7f58ec15e450 2024-09-11T23:19:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f3216640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ec0b58d0 con 0x7f58ec0d4130 2024-09-11T23:19:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f3216640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58ec0b55f0 con 0x7f58ec0d2a10 2024-09-11T23:19:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f0fb2640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f58ec15e450 0x7f58ec0b7130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47126/0 (socket says 172.21.15.94:47126) 2024-09-11T23:19:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f0fb2640 1 -- 172.21.15.94:0/4178992952 learned_addr learned my addr 172.21.15.94:0/4178992952 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:16.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 0x7f58ec0d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383402925 0 0) 0x7f58ec0d1f70 con 0x7f58ec15e450 2024-09-11T23:19:16.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d8003530 con 0x7f58ec15e450 2024-09-11T23:19:16.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3386170229 0 0) 0x7f58d8003530 con 0x7f58ec15e450 2024-09-11T23:19:16.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 msgr2=0x7f58ec0d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:16.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 0x7f58ec0d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 >> v1:172.21.15.155:6789/0 conn(0x7f58ec0d4130 legacy=0x7f58ec0d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec0d2210 con 0x7f58ec15e450 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f58dc0016a0 con 0x7f58ec15e450 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 >> v1:172.21.15.94:6789/0 conn(0x7f58ec15e450 legacy=0x7f58ec0b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 0x7f58d80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8003f70 0x7f58d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d8004d50 0x7f58d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0b55f0 con 0x7f58d8004d50 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58d800bab0 con 0x7f58d8003f70 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58d800bcb0 con 0x7f58ec0d2a10 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d8004d50 0x7f58d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58ebfff640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8003f70 0x7f58d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f0fb2640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 0x7f58d80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f17b3640 1 -- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 msgr2=0x7f58d80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:16.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec0d2a10 0x7f58d80039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f17b3640 1 -- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8003f70 msgr2=0x7f58d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:16.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8003f70 0x7f58d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58f17b3640 1 -- 172.21.15.94:0/4178992952 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d8003530 con 0x7f58d8004d50 2024-09-11T23:19:16.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.161+0000 7f58ebfff640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8003f70 0x7f58d8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:16.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d8004d50 0x7f58d80051d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009fa0 tx=0x7f58e401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b18d8fe2c400dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40b2070 con 0x7f58d8004d50 2024-09-11T23:19:16.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e40a5d10 con 0x7f58d8004d50 2024-09-11T23:19:16.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58eb7fe640 1 -- 172.21.15.94:0/4178992952 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4009bf0 con 0x7f58d8004d50 2024-09-11T23:19:16.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- 172.21.15.94:0/4178992952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d8004d50 msgr2=0x7f58d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 --2- 172.21.15.94:0/4178992952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d8004d50 0x7f58d80051d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009fa0 tx=0x7f58e401cc40 comp rx=0 tx=0).stop 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 -- 172.21.15.94:0/4178992952 reap_dead start 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- 172.21.15.94:0/4178992952 shutdown_connections 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- 172.21.15.94:0/4178992952 >> 172.21.15.94:0/4178992952 conn(0x7f58ec08bf90 msgr2=0x7f58ec09d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- 172.21.15.94:0/4178992952 shutdown_connections 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- 172.21.15.94:0/4178992952 wait complete. 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 Processor -- start 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- start start 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8004d50 0x7f58ec15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec155150 0x7f58ec0cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58ec1549b0 0x7f58ec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec15e830 con 0x7f58ec1549b0 2024-09-11T23:19:16.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0b7840 con 0x7f58d8004d50 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f3216640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58ec15e9b0 con 0x7f58ec155150 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58ec1549b0 0x7f58ec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58ec1549b0 0x7f58ec0b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59458/0 (socket says 172.21.15.94:59458) 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 -- 172.21.15.94:0/4036129300 learned_addr learned my addr 172.21.15.94:0/4036129300 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f0fb2640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8004d50 0x7f58ec15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58ebfff640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec155150 0x7f58ec0cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 -- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec155150 msgr2=0x7f58ec0cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec155150 0x7f58ec0cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 -- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8004d50 msgr2=0x7f58ec15c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8004d50 0x7f58ec15c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58f17b3640 1 -- 172.21.15.94:0/4036129300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec0b3110 con 0x7f58ec1549b0 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.165+0000 7f58ebfff640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec155150 0x7f58ec0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58f17b3640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58ec1549b0 0x7f58ec0b8aa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f58e4002240 tx=0x7f58e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58e97fa640 1 -- 172.21.15.94:0/4036129300 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40b2040 con 0x7f58ec1549b0 2024-09-11T23:19:16.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58e97fa640 1 -- 172.21.15.94:0/4036129300 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e40a5b10 con 0x7f58ec1549b0 2024-09-11T23:19:16.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58e97fa640 1 -- 172.21.15.94:0/4036129300 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4009bf0 con 0x7f58ec1549b0 2024-09-11T23:19:16.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec0b33f0 con 0x7f58ec1549b0 2024-09-11T23:19:16.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec0b39b0 con 0x7f58ec1549b0 2024-09-11T23:19:16.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ec0d45a0 con 0x7f58ec1549b0 2024-09-11T23:19:16.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58e97fa640 1 -- 172.21.15.94:0/4036129300 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58e40c0030 con 0x7f58ec1549b0 2024-09-11T23:19:16.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58e97fa640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f58cc0678f0 0x7f58cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58e97fa640 1 -- 172.21.15.94:0/4036129300 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f58e41205b0 con 0x7f58ec1549b0 2024-09-11T23:19:16.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58f0fb2640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f58cc0678f0 0x7f58cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.169+0000 7f58f0fb2640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f58cc0678f0 0x7f58cc069db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0d2140 tx=0x7f58dc001580 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.173+0000 7f58e97fa640 1 -- 172.21.15.94:0/4036129300 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f58e40c7060 con 0x7f58ec1549b0 2024-09-11T23:19:16.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.333+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58ec0d2fb0 con 0x7f58cc0678f0 2024-09-11T23:19:16.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.353+0000 7f58e97fa640 1 -- 172.21.15.94:0/4036129300 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252074 (secure 0 0 0) 0x7f58ec0d2fb0 con 0x7f58cc0678f0 2024-09-11T23:19:16.357 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:16.358 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:19:16.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f58cc0678f0 msgr2=0x7f58cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f58cc0678f0 0x7f58cc069db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0d2140 tx=0x7f58dc001580 comp rx=0 tx=0).stop 2024-09-11T23:19:16.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58ec1549b0 msgr2=0x7f58ec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58ec1549b0 0x7f58ec0b8aa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f58e4002240 tx=0x7f58e4009750 comp rx=0 tx=0).stop 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 shutdown_connections 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f58cc0678f0 0x7f58cc069db0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58ec1549b0 0x7f58ec0b8aa0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec155150 0x7f58ec0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 --2- 172.21.15.94:0/4036129300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d8004d50 0x7f58ec15c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 >> 172.21.15.94:0/4036129300 conn(0x7f58ec08bf90 msgr2=0x7f58ec0b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 shutdown_connections 2024-09-11T23:19:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.357+0000 7f58f3216640 1 -- 172.21.15.94:0/4036129300 wait complete. 2024-09-11T23:19:16.375 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-11T23:19:16.050916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279856,"kb_used_data":9512,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754694864,"statfs":{"total":773094113280,"available":772807540736,"internally_reserved":0,"allocated":9740288,"data_stored":5079140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.805973"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720142+0000","last_change":"2024-09-11T23:19:07.295568+0000","last_active":"2024-09-11T23:19:08.720142+0000","last_peered":"2024-09-11T23:19:08.720142+0000","last_clean":"2024-09-11T23:19:08.720142+0000","last_became_active":"2024-09-11T23:19:07.294521+0000","last_became_peered":"2024-09-11T23:19:07.294521+0000","last_unstale":"2024-09-11T23:19:08.720142+0000","last_undegraded":"2024-09-11T23:19:08.720142+0000","last_fullsized":"2024-09-11T23:19:08.720142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.253455+0000","last_change":"2024-09-11T23:19:07.281286+0000","last_active":"2024-09-11T23:19:08.253455+0000","last_peered":"2024-09-11T23:19:08.253455+0000","last_clean":"2024-09-11T23:19:08.253455+0000","last_became_active":"2024-09-11T23:19:07.280445+0000","last_became_peered":"2024-09-11T23:19:07.280445+0000","last_unstale":"2024-09-11T23:19:08.253455+0000","last_undegraded":"2024-09-11T23:19:08.253455+0000","last_fullsized":"2024-09-11T23:19:08.253455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:42.999802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717804+0000","last_change":"2024-09-11T23:19:07.287941+0000","last_active":"2024-09-11T23:19:08.717804+0000","last_peered":"2024-09-11T23:19:08.717804+0000","last_clean":"2024-09-11T23:19:08.717804+0000","last_became_active":"2024-09-11T23:19:07.287130+0000","last_became_peered":"2024-09-11T23:19:07.287130+0000","last_unstale":"2024-09-11T23:19:08.717804+0000","last_undegraded":"2024-09-11T23:19:08.717804+0000","last_fullsized":"2024-09-11T23:19:08.717804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720523+0000","last_change":"2024-09-11T23:19:07.285031+0000","last_active":"2024-09-11T23:19:08.720523+0000","last_peered":"2024-09-11T23:19:08.720523+0000","last_clean":"2024-09-11T23:19:08.720523+0000","last_became_active":"2024-09-11T23:19:07.284370+0000","last_became_peered":"2024-09-11T23:19:07.284370+0000","last_unstale":"2024-09-11T23:19:08.720523+0000","last_undegraded":"2024-09-11T23:19:08.720523+0000","last_fullsized":"2024-09-11T23:19:08.720523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:42.999802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716775+0000","last_change":"2024-09-11T23:19:07.280084+0000","last_active":"2024-09-11T23:19:08.716775+0000","last_peered":"2024-09-11T23:19:08.716775+0000","last_clean":"2024-09-11T23:19:08.716775+0000","last_became_active":"2024-09-11T23:19:07.279421+0000","last_became_peered":"2024-09-11T23:19:07.279421+0000","last_unstale":"2024-09-11T23:19:08.716775+0000","last_undegraded":"2024-09-11T23:19:08.716775+0000","last_fullsized":"2024-09-11T23:19:08.716775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.375641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718675+0000","last_change":"2024-09-11T23:19:07.300361+0000","last_active":"2024-09-11T23:19:08.718675+0000","last_peered":"2024-09-11T23:19:08.718675+0000","last_clean":"2024-09-11T23:19:08.718675+0000","last_became_active":"2024-09-11T23:19:07.296623+0000","last_became_peered":"2024-09-11T23:19:07.296623+0000","last_unstale":"2024-09-11T23:19:08.718675+0000","last_undegraded":"2024-09-11T23:19:08.718675+0000","last_fullsized":"2024-09-11T23:19:08.718675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:45.889124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251055+0000","last_change":"2024-09-11T23:19:07.292327+0000","last_active":"2024-09-11T23:19:08.251055+0000","last_peered":"2024-09-11T23:19:08.251055+0000","last_clean":"2024-09-11T23:19:08.251055+0000","last_became_active":"2024-09-11T23:19:07.291672+0000","last_became_peered":"2024-09-11T23:19:07.291672+0000","last_unstale":"2024-09-11T23:19:08.251055+0000","last_undegraded":"2024-09-11T23:19:08.251055+0000","last_fullsized":"2024-09-11T23:19:08.251055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717953+0000","last_change":"2024-09-11T23:19:07.276414+0000","last_active":"2024-09-11T23:19:08.717953+0000","last_peered":"2024-09-11T23:19:08.717953+0000","last_clean":"2024-09-11T23:19:08.717953+0000","last_became_active":"2024-09-11T23:19:07.275687+0000","last_became_peered":"2024-09-11T23:19:07.275687+0000","last_unstale":"2024-09-11T23:19:08.717953+0000","last_undegraded":"2024-09-11T23:19:08.717953+0000","last_fullsized":"2024-09-11T23:19:08.717953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:52.848080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717538+0000","last_change":"2024-09-11T23:19:07.267908+0000","last_active":"2024-09-11T23:19:08.717538+0000","last_peered":"2024-09-11T23:19:08.717538+0000","last_clean":"2024-09-11T23:19:08.717538+0000","last_became_active":"2024-09-11T23:19:07.267171+0000","last_became_peered":"2024-09-11T23:19:07.267171+0000","last_unstale":"2024-09-11T23:19:08.717538+0000","last_undegraded":"2024-09-11T23:19:08.717538+0000","last_fullsized":"2024-09-11T23:19:08.717538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.610610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246777+0000","last_change":"2024-09-11T23:19:07.273226+0000","last_active":"2024-09-11T23:19:08.246777+0000","last_peered":"2024-09-11T23:19:08.246777+0000","last_clean":"2024-09-11T23:19:08.246777+0000","last_became_active":"2024-09-11T23:19:07.272377+0000","last_became_peered":"2024-09-11T23:19:07.272377+0000","last_unstale":"2024-09-11T23:19:08.246777+0000","last_undegraded":"2024-09-11T23:19:08.246777+0000","last_fullsized":"2024-09-11T23:19:08.246777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:39.062796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717353+0000","last_change":"2024-09-11T23:19:07.293403+0000","last_active":"2024-09-11T23:19:08.717353+0000","last_peered":"2024-09-11T23:19:08.717353+0000","last_clean":"2024-09-11T23:19:08.717353+0000","last_became_active":"2024-09-11T23:19:07.292837+0000","last_became_peered":"2024-09-11T23:19:07.292837+0000","last_unstale":"2024-09-11T23:19:08.717353+0000","last_undegraded":"2024-09-11T23:19:08.717353+0000","last_fullsized":"2024-09-11T23:19:08.717353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:31.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246344+0000","last_change":"2024-09-11T23:19:07.267658+0000","last_active":"2024-09-11T23:19:08.246344+0000","last_peered":"2024-09-11T23:19:08.246344+0000","last_clean":"2024-09-11T23:19:08.246344+0000","last_became_active":"2024-09-11T23:19:07.266815+0000","last_became_peered":"2024-09-11T23:19:07.266815+0000","last_unstale":"2024-09-11T23:19:08.246344+0000","last_undegraded":"2024-09-11T23:19:08.246344+0000","last_fullsized":"2024-09-11T23:19:08.246344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:06.467531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721392+0000","last_change":"2024-09-11T23:19:07.276219+0000","last_active":"2024-09-11T23:19:08.721392+0000","last_peered":"2024-09-11T23:19:08.721392+0000","last_clean":"2024-09-11T23:19:08.721392+0000","last_became_active":"2024-09-11T23:19:07.275423+0000","last_became_peered":"2024-09-11T23:19:07.275423+0000","last_unstale":"2024-09-11T23:19:08.721392+0000","last_undegraded":"2024-09-11T23:19:08.721392+0000","last_fullsized":"2024-09-11T23:19:08.721392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716361+0000","last_change":"2024-09-11T23:19:07.287604+0000","last_active":"2024-09-11T23:19:08.716361+0000","last_peered":"2024-09-11T23:19:08.716361+0000","last_clean":"2024-09-11T23:19:08.716361+0000","last_became_active":"2024-09-11T23:19:07.286892+0000","last_became_peered":"2024-09-11T23:19:07.286892+0000","last_unstale":"2024-09-11T23:19:08.716361+0000","last_undegraded":"2024-09-11T23:19:08.716361+0000","last_fullsized":"2024-09-11T23:19:08.716361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:23.840157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718884+0000","last_change":"2024-09-11T23:19:07.294812+0000","last_active":"2024-09-11T23:19:08.718884+0000","last_peered":"2024-09-11T23:19:08.718884+0000","last_clean":"2024-09-11T23:19:08.718884+0000","last_became_active":"2024-09-11T23:19:07.293948+0000","last_became_peered":"2024-09-11T23:19:07.293948+0000","last_unstale":"2024-09-11T23:19:08.718884+0000","last_undegraded":"2024-09-11T23:19:08.718884+0000","last_fullsized":"2024-09-11T23:19:08.718884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:42.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718340+0000","last_change":"2024-09-11T23:19:07.301020+0000","last_active":"2024-09-11T23:19:08.718340+0000","last_peered":"2024-09-11T23:19:08.718340+0000","last_clean":"2024-09-11T23:19:08.718340+0000","last_became_active":"2024-09-11T23:19:07.300426+0000","last_became_peered":"2024-09-11T23:19:07.300426+0000","last_unstale":"2024-09-11T23:19:08.718340+0000","last_undegraded":"2024-09-11T23:19:08.718340+0000","last_fullsized":"2024-09-11T23:19:08.718340+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:36.980299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721070+0000","last_change":"2024-09-11T23:19:07.301254+0000","last_active":"2024-09-11T23:19:08.721070+0000","last_peered":"2024-09-11T23:19:08.721070+0000","last_clean":"2024-09-11T23:19:08.721070+0000","last_became_active":"2024-09-11T23:19:07.300503+0000","last_became_peered":"2024-09-11T23:19:07.300503+0000","last_unstale":"2024-09-11T23:19:08.721070+0000","last_undegraded":"2024-09-11T23:19:08.721070+0000","last_fullsized":"2024-09-11T23:19:08.721070+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:46.323833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719762+0000","last_change":"2024-09-11T23:19:07.279737+0000","last_active":"2024-09-11T23:19:08.719762+0000","last_peered":"2024-09-11T23:19:08.719762+0000","last_clean":"2024-09-11T23:19:08.719762+0000","last_became_active":"2024-09-11T23:19:07.278906+0000","last_became_peered":"2024-09-11T23:19:07.278906+0000","last_unstale":"2024-09-11T23:19:08.719762+0000","last_undegraded":"2024-09-11T23:19:08.719762+0000","last_fullsized":"2024-09-11T23:19:08.719762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.794582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717617+0000","last_change":"2024-09-11T23:19:07.273684+0000","last_active":"2024-09-11T23:19:08.717617+0000","last_peered":"2024-09-11T23:19:08.717617+0000","last_clean":"2024-09-11T23:19:08.717617+0000","last_became_active":"2024-09-11T23:19:07.272918+0000","last_became_peered":"2024-09-11T23:19:07.272918+0000","last_unstale":"2024-09-11T23:19:08.717617+0000","last_undegraded":"2024-09-11T23:19:08.717617+0000","last_fullsized":"2024-09-11T23:19:08.717617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:15.825107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720941+0000","last_change":"2024-09-11T23:19:07.269726+0000","last_active":"2024-09-11T23:19:08.720941+0000","last_peered":"2024-09-11T23:19:08.720941+0000","last_clean":"2024-09-11T23:19:08.720941+0000","last_became_active":"2024-09-11T23:19:07.267916+0000","last_became_peered":"2024-09-11T23:19:07.267916+0000","last_unstale":"2024-09-11T23:19:08.720941+0000","last_undegraded":"2024-09-11T23:19:08.720941+0000","last_fullsized":"2024-09-11T23:19:08.720941+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:50.199522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717217+0000","last_change":"2024-09-11T23:19:07.274965+0000","last_active":"2024-09-11T23:19:08.717217+0000","last_peered":"2024-09-11T23:19:08.717217+0000","last_clean":"2024-09-11T23:19:08.717217+0000","last_became_active":"2024-09-11T23:19:07.274264+0000","last_became_peered":"2024-09-11T23:19:07.274264+0000","last_unstale":"2024-09-11T23:19:08.717217+0000","last_undegraded":"2024-09-11T23:19:08.717217+0000","last_fullsized":"2024-09-11T23:19:08.717217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:09.238424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716465+0000","last_change":"2024-09-11T23:19:07.276419+0000","last_active":"2024-09-11T23:19:08.716465+0000","last_peered":"2024-09-11T23:19:08.716465+0000","last_clean":"2024-09-11T23:19:08.716465+0000","last_became_active":"2024-09-11T23:19:07.275680+0000","last_became_peered":"2024-09-11T23:19:07.275680+0000","last_unstale":"2024-09-11T23:19:08.716465+0000","last_undegraded":"2024-09-11T23:19:08.716465+0000","last_fullsized":"2024-09-11T23:19:08.716465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:57.679979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487637+0000","last_change":"2024-09-11T23:19:07.285483+0000","last_active":"2024-09-11T23:19:08.487637+0000","last_peered":"2024-09-11T23:19:08.487637+0000","last_clean":"2024-09-11T23:19:08.487637+0000","last_became_active":"2024-09-11T23:19:07.284797+0000","last_became_peered":"2024-09-11T23:19:07.284797+0000","last_unstale":"2024-09-11T23:19:08.487637+0000","last_undegraded":"2024-09-11T23:19:08.487637+0000","last_fullsized":"2024-09-11T23:19:08.487637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:55.113683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716877+0000","last_change":"2024-09-11T23:19:07.294453+0000","last_active":"2024-09-11T23:19:08.716877+0000","last_peered":"2024-09-11T23:19:08.716877+0000","last_clean":"2024-09-11T23:19:08.716877+0000","last_became_active":"2024-09-11T23:19:07.289149+0000","last_became_peered":"2024-09-11T23:19:07.289149+0000","last_unstale":"2024-09-11T23:19:08.716877+0000","last_undegraded":"2024-09-11T23:19:08.716877+0000","last_fullsized":"2024-09-11T23:19:08.716877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:42.999802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.253561+0000","last_change":"2024-09-11T23:19:07.285202+0000","last_active":"2024-09-11T23:19:08.253561+0000","last_peered":"2024-09-11T23:19:08.253561+0000","last_clean":"2024-09-11T23:19:08.253561+0000","last_became_active":"2024-09-11T23:19:07.284537+0000","last_became_peered":"2024-09-11T23:19:07.284537+0000","last_unstale":"2024-09-11T23:19:08.253561+0000","last_undegraded":"2024-09-11T23:19:08.253561+0000","last_fullsized":"2024-09-11T23:19:08.253561+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:50.199522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716908+0000","last_change":"2024-09-11T23:19:07.272645+0000","last_active":"2024-09-11T23:19:08.716908+0000","last_peered":"2024-09-11T23:19:08.716908+0000","last_clean":"2024-09-11T23:19:08.716908+0000","last_became_active":"2024-09-11T23:19:07.271605+0000","last_became_peered":"2024-09-11T23:19:07.271605+0000","last_unstale":"2024-09-11T23:19:08.716908+0000","last_undegraded":"2024-09-11T23:19:08.716908+0000","last_fullsized":"2024-09-11T23:19:08.716908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:17.625285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246485+0000","last_change":"2024-09-11T23:19:07.273847+0000","last_active":"2024-09-11T23:19:08.246485+0000","last_peered":"2024-09-11T23:19:08.246485+0000","last_clean":"2024-09-11T23:19:08.246485+0000","last_became_active":"2024-09-11T23:19:07.273002+0000","last_became_peered":"2024-09-11T23:19:07.273002+0000","last_unstale":"2024-09-11T23:19:08.246485+0000","last_undegraded":"2024-09-11T23:19:08.246485+0000","last_fullsized":"2024-09-11T23:19:08.246485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:26.767798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720999+0000","last_change":"2024-09-11T23:19:07.270430+0000","last_active":"2024-09-11T23:19:08.720999+0000","last_peered":"2024-09-11T23:19:08.720999+0000","last_clean":"2024-09-11T23:19:08.720999+0000","last_became_active":"2024-09-11T23:19:07.268975+0000","last_became_peered":"2024-09-11T23:19:07.268975+0000","last_unstale":"2024-09-11T23:19:08.720999+0000","last_undegraded":"2024-09-11T23:19:08.720999+0000","last_fullsized":"2024-09-11T23:19:08.720999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251523+0000","last_change":"2024-09-11T23:19:07.281880+0000","last_active":"2024-09-11T23:19:08.251523+0000","last_peered":"2024-09-11T23:19:08.251523+0000","last_clean":"2024-09-11T23:19:08.251523+0000","last_became_active":"2024-09-11T23:19:07.281103+0000","last_became_peered":"2024-09-11T23:19:07.281103+0000","last_unstale":"2024-09-11T23:19:08.251523+0000","last_undegraded":"2024-09-11T23:19:08.251523+0000","last_fullsized":"2024-09-11T23:19:08.251523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:48.744420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716951+0000","last_change":"2024-09-11T23:19:07.262326+0000","last_active":"2024-09-11T23:19:08.716951+0000","last_peered":"2024-09-11T23:19:08.716951+0000","last_clean":"2024-09-11T23:19:08.716951+0000","last_became_active":"2024-09-11T23:19:07.261757+0000","last_became_peered":"2024-09-11T23:19:07.261757+0000","last_unstale":"2024-09-11T23:19:08.716951+0000","last_undegraded":"2024-09-11T23:19:08.716951+0000","last_fullsized":"2024-09-11T23:19:08.716951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:42.689297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.252467+0000","last_change":"2024-09-11T23:19:07.270146+0000","last_active":"2024-09-11T23:19:08.252467+0000","last_peered":"2024-09-11T23:19:08.252467+0000","last_clean":"2024-09-11T23:19:08.252467+0000","last_became_active":"2024-09-11T23:19:07.269444+0000","last_became_peered":"2024-09-11T23:19:07.269444+0000","last_unstale":"2024-09-11T23:19:08.252467+0000","last_undegraded":"2024-09-11T23:19:08.252467+0000","last_fullsized":"2024-09-11T23:19:08.252467+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:41.868692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718731+0000","last_change":"2024-09-11T23:19:07.300317+0000","last_active":"2024-09-11T23:19:08.718731+0000","last_peered":"2024-09-11T23:19:08.718731+0000","last_clean":"2024-09-11T23:19:08.718731+0000","last_became_active":"2024-09-11T23:19:07.295215+0000","last_became_peered":"2024-09-11T23:19:07.295215+0000","last_unstale":"2024-09-11T23:19:08.718731+0000","last_undegraded":"2024-09-11T23:19:08.718731+0000","last_fullsized":"2024-09-11T23:19:08.718731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:21:48.158519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719309+0000","last_change":"2024-09-11T23:19:07.301395+0000","last_active":"2024-09-11T23:19:08.719309+0000","last_peered":"2024-09-11T23:19:08.719309+0000","last_clean":"2024-09-11T23:19:08.719309+0000","last_became_active":"2024-09-11T23:19:07.296132+0000","last_became_peered":"2024-09-11T23:19:07.296132+0000","last_unstale":"2024-09-11T23:19:08.719309+0000","last_undegraded":"2024-09-11T23:19:08.719309+0000","last_fullsized":"2024-09-11T23:19:08.719309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:34.490776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487914+0000","last_change":"2024-09-11T23:19:06.560592+0000","last_active":"2024-09-11T23:19:08.487914+0000","last_peered":"2024-09-11T23:19:08.487914+0000","last_clean":"2024-09-11T23:19:08.487914+0000","last_became_active":"2024-09-11T23:19:06.559887+0000","last_became_peered":"2024-09-11T23:19:06.559887+0000","last_unstale":"2024-09-11T23:19:08.487914+0000","last_undegraded":"2024-09-11T23:19:08.487914+0000","last_fullsized":"2024-09-11T23:19:08.487914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720626+0000","last_change":"2024-09-11T23:19:07.276328+0000","last_active":"2024-09-11T23:19:08.720626+0000","last_peered":"2024-09-11T23:19:08.720626+0000","last_clean":"2024-09-11T23:19:08.720626+0000","last_became_active":"2024-09-11T23:19:07.275546+0000","last_became_peered":"2024-09-11T23:19:07.275546+0000","last_unstale":"2024-09-11T23:19:08.720626+0000","last_undegraded":"2024-09-11T23:19:08.720626+0000","last_fullsized":"2024-09-11T23:19:08.720626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:10.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717286+0000","last_change":"2024-09-11T23:19:06.575536+0000","last_active":"2024-09-11T23:19:08.717286+0000","last_peered":"2024-09-11T23:19:08.717286+0000","last_clean":"2024-09-11T23:19:08.717286+0000","last_became_active":"2024-09-11T23:19:06.574927+0000","last_became_peered":"2024-09-11T23:19:06.574927+0000","last_unstale":"2024-09-11T23:19:08.717286+0000","last_undegraded":"2024-09-11T23:19:08.717286+0000","last_fullsized":"2024-09-11T23:19:08.717286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:18.826160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251446+0000","last_change":"2024-09-11T23:19:07.287664+0000","last_active":"2024-09-11T23:19:08.251446+0000","last_peered":"2024-09-11T23:19:08.251446+0000","last_clean":"2024-09-11T23:19:08.251446+0000","last_became_active":"2024-09-11T23:19:07.286718+0000","last_became_peered":"2024-09-11T23:19:07.286718+0000","last_unstale":"2024-09-11T23:19:08.251446+0000","last_undegraded":"2024-09-11T23:19:08.251446+0000","last_fullsized":"2024-09-11T23:19:08.251446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:15.768732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251333+0000","last_change":"2024-09-11T23:19:06.553845+0000","last_active":"2024-09-11T23:19:08.251333+0000","last_peered":"2024-09-11T23:19:08.251333+0000","last_clean":"2024-09-11T23:19:08.251333+0000","last_became_active":"2024-09-11T23:19:06.552969+0000","last_became_peered":"2024-09-11T23:19:06.552969+0000","last_unstale":"2024-09-11T23:19:08.251333+0000","last_undegraded":"2024-09-11T23:19:08.251333+0000","last_fullsized":"2024-09-11T23:19:08.251333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:54.109585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721265+0000","last_change":"2024-09-11T23:19:07.297005+0000","last_active":"2024-09-11T23:19:08.721265+0000","last_peered":"2024-09-11T23:19:08.721265+0000","last_clean":"2024-09-11T23:19:08.721265+0000","last_became_active":"2024-09-11T23:19:07.289993+0000","last_became_peered":"2024-09-11T23:19:07.289993+0000","last_unstale":"2024-09-11T23:19:08.721265+0000","last_undegraded":"2024-09-11T23:19:08.721265+0000","last_fullsized":"2024-09-11T23:19:08.721265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:54.378314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488127+0000","last_change":"2024-09-11T23:19:06.564108+0000","last_active":"2024-09-11T23:19:08.488127+0000","last_peered":"2024-09-11T23:19:08.488127+0000","last_clean":"2024-09-11T23:19:08.488127+0000","last_became_active":"2024-09-11T23:19:06.563110+0000","last_became_peered":"2024-09-11T23:19:06.563110+0000","last_unstale":"2024-09-11T23:19:08.488127+0000","last_undegraded":"2024-09-11T23:19:08.488127+0000","last_fullsized":"2024-09-11T23:19:08.488127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:16.621187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718545+0000","last_change":"2024-09-11T23:19:07.268437+0000","last_active":"2024-09-11T23:19:08.718545+0000","last_peered":"2024-09-11T23:19:08.718545+0000","last_clean":"2024-09-11T23:19:08.718545+0000","last_became_active":"2024-09-11T23:19:07.267670+0000","last_became_peered":"2024-09-11T23:19:07.267670+0000","last_unstale":"2024-09-11T23:19:08.718545+0000","last_undegraded":"2024-09-11T23:19:08.718545+0000","last_fullsized":"2024-09-11T23:19:08.718545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:41.868692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717280+0000","last_change":"2024-09-11T23:19:06.561822+0000","last_active":"2024-09-11T23:19:08.717280+0000","last_peered":"2024-09-11T23:19:08.717280+0000","last_clean":"2024-09-11T23:19:08.717280+0000","last_became_active":"2024-09-11T23:19:06.560453+0000","last_became_peered":"2024-09-11T23:19:06.560453+0000","last_unstale":"2024-09-11T23:19:08.717280+0000","last_undegraded":"2024-09-11T23:19:08.717280+0000","last_fullsized":"2024-09-11T23:19:08.717280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:32.014798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487855+0000","last_change":"2024-09-11T23:19:07.291025+0000","last_active":"2024-09-11T23:19:08.487855+0000","last_peered":"2024-09-11T23:19:08.487855+0000","last_clean":"2024-09-11T23:19:08.487855+0000","last_became_active":"2024-09-11T23:19:07.290507+0000","last_became_peered":"2024-09-11T23:19:07.290507+0000","last_unstale":"2024-09-11T23:19:08.487855+0000","last_undegraded":"2024-09-11T23:19:08.487855+0000","last_fullsized":"2024-09-11T23:19:08.487855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:52.848080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718826+0000","last_change":"2024-09-11T23:19:06.552799+0000","last_active":"2024-09-11T23:19:08.718826+0000","last_peered":"2024-09-11T23:19:08.718826+0000","last_clean":"2024-09-11T23:19:08.718826+0000","last_became_active":"2024-09-11T23:19:06.551350+0000","last_became_peered":"2024-09-11T23:19:06.551350+0000","last_unstale":"2024-09-11T23:19:08.718826+0000","last_undegraded":"2024-09-11T23:19:08.718826+0000","last_fullsized":"2024-09-11T23:19:08.718826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719052+0000","last_change":"2024-09-11T23:19:07.301013+0000","last_active":"2024-09-11T23:19:08.719052+0000","last_peered":"2024-09-11T23:19:08.719052+0000","last_clean":"2024-09-11T23:19:08.719052+0000","last_became_active":"2024-09-11T23:19:07.296834+0000","last_became_peered":"2024-09-11T23:19:07.296834+0000","last_unstale":"2024-09-11T23:19:08.719052+0000","last_undegraded":"2024-09-11T23:19:08.719052+0000","last_fullsized":"2024-09-11T23:19:08.719052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:34.486984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717697+0000","last_change":"2024-09-11T23:19:06.554582+0000","last_active":"2024-09-11T23:19:08.717697+0000","last_peered":"2024-09-11T23:19:08.717697+0000","last_clean":"2024-09-11T23:19:08.717697+0000","last_became_active":"2024-09-11T23:19:06.554159+0000","last_became_peered":"2024-09-11T23:19:06.554159+0000","last_unstale":"2024-09-11T23:19:08.717697+0000","last_undegraded":"2024-09-11T23:19:08.717697+0000","last_fullsized":"2024-09-11T23:19:08.717697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:14.821009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721572+0000","last_change":"2024-09-11T23:19:07.281622+0000","last_active":"2024-09-11T23:19:08.721572+0000","last_peered":"2024-09-11T23:19:08.721572+0000","last_clean":"2024-09-11T23:19:08.721572+0000","last_became_active":"2024-09-11T23:19:07.280852+0000","last_became_peered":"2024-09-11T23:19:07.280852+0000","last_unstale":"2024-09-11T23:19:08.721572+0000","last_undegraded":"2024-09-11T23:19:08.721572+0000","last_fullsized":"2024-09-11T23:19:08.721572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250674+0000","last_change":"2024-09-11T23:19:06.545476+0000","last_active":"2024-09-11T23:19:08.250674+0000","last_peered":"2024-09-11T23:19:08.250674+0000","last_clean":"2024-09-11T23:19:08.250674+0000","last_became_active":"2024-09-11T23:19:06.544759+0000","last_became_peered":"2024-09-11T23:19:06.544759+0000","last_unstale":"2024-09-11T23:19:08.250674+0000","last_undegraded":"2024-09-11T23:19:08.250674+0000","last_fullsized":"2024-09-11T23:19:08.250674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:14.821009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717008+0000","last_change":"2024-09-11T23:19:07.291721+0000","last_active":"2024-09-11T23:19:08.717008+0000","last_peered":"2024-09-11T23:19:08.717008+0000","last_clean":"2024-09-11T23:19:08.717008+0000","last_became_active":"2024-09-11T23:19:07.289118+0000","last_became_peered":"2024-09-11T23:19:07.289118+0000","last_unstale":"2024-09-11T23:19:08.717008+0000","last_undegraded":"2024-09-11T23:19:08.717008+0000","last_fullsized":"2024-09-11T23:19:08.717008+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:29.274579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.253809+0000","last_change":"2024-09-11T23:19:06.562370+0000","last_active":"2024-09-11T23:19:08.253809+0000","last_peered":"2024-09-11T23:19:08.253809+0000","last_clean":"2024-09-11T23:19:08.253809+0000","last_became_active":"2024-09-11T23:19:06.561679+0000","last_became_peered":"2024-09-11T23:19:06.561679+0000","last_unstale":"2024-09-11T23:19:08.253809+0000","last_undegraded":"2024-09-11T23:19:08.253809+0000","last_fullsized":"2024-09-11T23:19:08.253809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.758800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251226+0000","last_change":"2024-09-11T23:19:07.284495+0000","last_active":"2024-09-11T23:19:08.251226+0000","last_peered":"2024-09-11T23:19:08.251226+0000","last_clean":"2024-09-11T23:19:08.251226+0000","last_became_active":"2024-09-11T23:19:07.283741+0000","last_became_peered":"2024-09-11T23:19:07.283741+0000","last_unstale":"2024-09-11T23:19:08.251226+0000","last_undegraded":"2024-09-11T23:19:08.251226+0000","last_fullsized":"2024-09-11T23:19:08.251226+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:59.138653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720405+0000","last_change":"2024-09-11T23:19:06.547195+0000","last_active":"2024-09-11T23:19:08.720405+0000","last_peered":"2024-09-11T23:19:08.720405+0000","last_clean":"2024-09-11T23:19:08.720405+0000","last_became_active":"2024-09-11T23:19:06.546903+0000","last_became_peered":"2024-09-11T23:19:06.546903+0000","last_unstale":"2024-09-11T23:19:08.720405+0000","last_undegraded":"2024-09-11T23:19:08.720405+0000","last_fullsized":"2024-09-11T23:19:08.720405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:27.606512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720154+0000","last_change":"2024-09-11T23:19:07.294643+0000","last_active":"2024-09-11T23:19:08.720154+0000","last_peered":"2024-09-11T23:19:08.720154+0000","last_clean":"2024-09-11T23:19:08.720154+0000","last_became_active":"2024-09-11T23:19:07.289722+0000","last_became_peered":"2024-09-11T23:19:07.289722+0000","last_unstale":"2024-09-11T23:19:08.720154+0000","last_undegraded":"2024-09-11T23:19:08.720154+0000","last_fullsized":"2024-09-11T23:19:08.720154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:15.768732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717786+0000","last_change":"2024-09-11T23:19:06.576092+0000","last_active":"2024-09-11T23:19:08.717786+0000","last_peered":"2024-09-11T23:19:08.717786+0000","last_clean":"2024-09-11T23:19:08.717786+0000","last_became_active":"2024-09-11T23:19:06.574510+0000","last_became_peered":"2024-09-11T23:19:06.574510+0000","last_unstale":"2024-09-11T23:19:08.717786+0000","last_undegraded":"2024-09-11T23:19:08.717786+0000","last_fullsized":"2024-09-11T23:19:08.717786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:18.777847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718263+0000","last_change":"2024-09-11T23:19:07.261367+0000","last_active":"2024-09-11T23:19:08.718263+0000","last_peered":"2024-09-11T23:19:08.718263+0000","last_clean":"2024-09-11T23:19:08.718263+0000","last_became_active":"2024-09-11T23:19:07.260600+0000","last_became_peered":"2024-09-11T23:19:07.260600+0000","last_unstale":"2024-09-11T23:19:08.718263+0000","last_undegraded":"2024-09-11T23:19:08.718263+0000","last_fullsized":"2024-09-11T23:19:08.718263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.343457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719902+0000","last_change":"2024-09-11T23:19:06.562096+0000","last_active":"2024-09-11T23:19:08.719902+0000","last_peered":"2024-09-11T23:19:08.719902+0000","last_clean":"2024-09-11T23:19:08.719902+0000","last_became_active":"2024-09-11T23:19:06.561837+0000","last_became_peered":"2024-09-11T23:19:06.561837+0000","last_unstale":"2024-09-11T23:19:08.719902+0000","last_undegraded":"2024-09-11T23:19:08.719902+0000","last_fullsized":"2024-09-11T23:19:08.719902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:57.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718600+0000","last_change":"2024-09-11T23:19:07.276560+0000","last_active":"2024-09-11T23:19:08.718600+0000","last_peered":"2024-09-11T23:19:08.718600+0000","last_clean":"2024-09-11T23:19:08.718600+0000","last_became_active":"2024-09-11T23:19:07.275806+0000","last_became_peered":"2024-09-11T23:19:07.275806+0000","last_unstale":"2024-09-11T23:19:08.718600+0000","last_undegraded":"2024-09-11T23:19:08.718600+0000","last_fullsized":"2024-09-11T23:19:08.718600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.719661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251219+0000","last_change":"2024-09-11T23:19:06.556199+0000","last_active":"2024-09-11T23:19:08.251219+0000","last_peered":"2024-09-11T23:19:08.251219+0000","last_clean":"2024-09-11T23:19:08.251219+0000","last_became_active":"2024-09-11T23:19:06.555517+0000","last_became_peered":"2024-09-11T23:19:06.555517+0000","last_unstale":"2024-09-11T23:19:08.251219+0000","last_undegraded":"2024-09-11T23:19:08.251219+0000","last_fullsized":"2024-09-11T23:19:08.251219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:51.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.716393+0000","last_change":"2024-09-11T23:19:07.277492+0000","last_active":"2024-09-11T23:19:08.716393+0000","last_peered":"2024-09-11T23:19:08.716393+0000","last_clean":"2024-09-11T23:19:08.716393+0000","last_became_active":"2024-09-11T23:19:07.276783+0000","last_became_peered":"2024-09-11T23:19:07.276783+0000","last_unstale":"2024-09-11T23:19:08.716393+0000","last_undegraded":"2024-09-11T23:19:08.716393+0000","last_fullsized":"2024-09-11T23:19:08.716393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:16.764355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719304+0000","last_change":"2024-09-11T23:19:06.577144+0000","last_active":"2024-09-11T23:19:08.719304+0000","last_peered":"2024-09-11T23:19:08.719304+0000","last_clean":"2024-09-11T23:19:08.719304+0000","last_became_active":"2024-09-11T23:19:06.576853+0000","last_became_peered":"2024-09-11T23:19:06.576853+0000","last_unstale":"2024-09-11T23:19:08.719304+0000","last_undegraded":"2024-09-11T23:19:08.719304+0000","last_fullsized":"2024-09-11T23:19:08.719304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:40.810413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246156+0000","last_change":"2024-09-11T23:19:07.274484+0000","last_active":"2024-09-11T23:19:08.246156+0000","last_peered":"2024-09-11T23:19:08.246156+0000","last_clean":"2024-09-11T23:19:08.246156+0000","last_became_active":"2024-09-11T23:19:07.273727+0000","last_became_peered":"2024-09-11T23:19:07.273727+0000","last_unstale":"2024-09-11T23:19:08.246156+0000","last_undegraded":"2024-09-11T23:19:08.246156+0000","last_fullsized":"2024-09-11T23:19:08.246156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:13.646710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719299+0000","last_change":"2024-09-11T23:19:06.563280+0000","last_active":"2024-09-11T23:19:08.719299+0000","last_peered":"2024-09-11T23:19:08.719299+0000","last_clean":"2024-09-11T23:19:08.719299+0000","last_became_active":"2024-09-11T23:19:06.562981+0000","last_became_peered":"2024-09-11T23:19:06.562981+0000","last_unstale":"2024-09-11T23:19:08.719299+0000","last_undegraded":"2024-09-11T23:19:08.719299+0000","last_fullsized":"2024-09-11T23:19:08.719299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:22.836059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246572+0000","last_change":"2024-09-11T23:19:07.266185+0000","last_active":"2024-09-11T23:19:08.246572+0000","last_peered":"2024-09-11T23:19:08.246572+0000","last_clean":"2024-09-11T23:19:08.246572+0000","last_became_active":"2024-09-11T23:19:07.265430+0000","last_became_peered":"2024-09-11T23:19:07.265430+0000","last_unstale":"2024-09-11T23:19:08.246572+0000","last_undegraded":"2024-09-11T23:19:08.246572+0000","last_fullsized":"2024-09-11T23:19:08.246572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:19.364412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718804+0000","last_change":"2024-09-11T23:19:06.550310+0000","last_active":"2024-09-11T23:19:08.718804+0000","last_peered":"2024-09-11T23:19:08.718804+0000","last_clean":"2024-09-11T23:19:08.718804+0000","last_became_active":"2024-09-11T23:19:06.550073+0000","last_became_peered":"2024-09-11T23:19:06.550073+0000","last_unstale":"2024-09-11T23:19:08.718804+0000","last_undegraded":"2024-09-11T23:19:08.718804+0000","last_fullsized":"2024-09-11T23:19:08.718804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:56.675881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719683+0000","last_change":"2024-09-11T23:19:07.287532+0000","last_active":"2024-09-11T23:19:08.719683+0000","last_peered":"2024-09-11T23:19:08.719683+0000","last_clean":"2024-09-11T23:19:08.719683+0000","last_became_active":"2024-09-11T23:19:07.286814+0000","last_became_peered":"2024-09-11T23:19:07.286814+0000","last_unstale":"2024-09-11T23:19:08.719683+0000","last_undegraded":"2024-09-11T23:19:08.719683+0000","last_fullsized":"2024-09-11T23:19:08.719683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:03.369383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488242+0000","last_change":"2024-09-11T23:19:06.569779+0000","last_active":"2024-09-11T23:19:08.488242+0000","last_peered":"2024-09-11T23:19:08.488242+0000","last_clean":"2024-09-11T23:19:08.488242+0000","last_became_active":"2024-09-11T23:19:06.569044+0000","last_became_peered":"2024-09-11T23:19:06.569044+0000","last_unstale":"2024-09-11T23:19:08.488242+0000","last_undegraded":"2024-09-11T23:19:08.488242+0000","last_fullsized":"2024-09-11T23:19:08.488242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488112+0000","last_change":"2024-09-11T23:19:07.278428+0000","last_active":"2024-09-11T23:19:08.488112+0000","last_peered":"2024-09-11T23:19:08.488112+0000","last_clean":"2024-09-11T23:19:08.488112+0000","last_became_active":"2024-09-11T23:19:07.277629+0000","last_became_peered":"2024-09-11T23:19:07.277629+0000","last_unstale":"2024-09-11T23:19:08.488112+0000","last_undegraded":"2024-09-11T23:19:08.488112+0000","last_fullsized":"2024-09-11T23:19:08.488112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:41.868692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251292+0000","last_change":"2024-09-11T23:19:06.566301+0000","last_active":"2024-09-11T23:19:08.251292+0000","last_peered":"2024-09-11T23:19:08.251292+0000","last_clean":"2024-09-11T23:19:08.251292+0000","last_became_active":"2024-09-11T23:19:06.565597+0000","last_became_peered":"2024-09-11T23:19:06.565597+0000","last_unstale":"2024-09-11T23:19:08.251292+0000","last_undegraded":"2024-09-11T23:19:08.251292+0000","last_fullsized":"2024-09-11T23:19:08.251292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:40.864594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717388+0000","last_change":"2024-09-11T23:19:07.266323+0000","last_active":"2024-09-11T23:19:08.717388+0000","last_peered":"2024-09-11T23:19:08.717388+0000","last_clean":"2024-09-11T23:19:08.717388+0000","last_became_active":"2024-09-11T23:19:07.265654+0000","last_became_peered":"2024-09-11T23:19:07.265654+0000","last_unstale":"2024-09-11T23:19:08.717388+0000","last_undegraded":"2024-09-11T23:19:08.717388+0000","last_fullsized":"2024-09-11T23:19:08.717388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:29.762898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717820+0000","last_change":"2024-09-11T23:19:06.571225+0000","last_active":"2024-09-11T23:19:08.717820+0000","last_peered":"2024-09-11T23:19:08.717820+0000","last_clean":"2024-09-11T23:19:08.717820+0000","last_became_active":"2024-09-11T23:19:06.570625+0000","last_became_peered":"2024-09-11T23:19:06.570625+0000","last_unstale":"2024-09-11T23:19:08.717820+0000","last_undegraded":"2024-09-11T23:19:08.717820+0000","last_fullsized":"2024-09-11T23:19:08.717820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:52.266753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719074+0000","last_change":"2024-09-11T23:19:07.301782+0000","last_active":"2024-09-11T23:19:08.719074+0000","last_peered":"2024-09-11T23:19:08.719074+0000","last_clean":"2024-09-11T23:19:08.719074+0000","last_became_active":"2024-09-11T23:19:07.301074+0000","last_became_peered":"2024-09-11T23:19:07.301074+0000","last_unstale":"2024-09-11T23:19:08.719074+0000","last_undegraded":"2024-09-11T23:19:08.719074+0000","last_fullsized":"2024-09-11T23:19:08.719074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:13.541770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.252535+0000","last_change":"2024-09-11T23:19:06.554094+0000","last_active":"2024-09-11T23:19:08.252535+0000","last_peered":"2024-09-11T23:19:08.252535+0000","last_clean":"2024-09-11T23:19:08.252535+0000","last_became_active":"2024-09-11T23:19:06.553375+0000","last_became_peered":"2024-09-11T23:19:06.553375+0000","last_unstale":"2024-09-11T23:19:08.252535+0000","last_undegraded":"2024-09-11T23:19:08.252535+0000","last_fullsized":"2024-09-11T23:19:08.252535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:28.270481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.252527+0000","last_change":"2024-09-11T23:19:07.281933+0000","last_active":"2024-09-11T23:19:08.252527+0000","last_peered":"2024-09-11T23:19:08.252527+0000","last_clean":"2024-09-11T23:19:08.252527+0000","last_became_active":"2024-09-11T23:19:07.281273+0000","last_became_peered":"2024-09-11T23:19:07.281273+0000","last_unstale":"2024-09-11T23:19:08.252527+0000","last_undegraded":"2024-09-11T23:19:08.252527+0000","last_fullsized":"2024-09-11T23:19:08.252527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.719661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246260+0000","last_change":"2024-09-11T23:19:06.546448+0000","last_active":"2024-09-11T23:19:08.246260+0000","last_peered":"2024-09-11T23:19:08.246260+0000","last_clean":"2024-09-11T23:19:08.246260+0000","last_became_active":"2024-09-11T23:19:06.545743+0000","last_became_peered":"2024-09-11T23:19:06.545743+0000","last_unstale":"2024-09-11T23:19:08.246260+0000","last_undegraded":"2024-09-11T23:19:08.246260+0000","last_fullsized":"2024-09-11T23:19:08.246260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:56.814459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.252858+0000","last_change":"2024-09-11T23:19:07.273706+0000","last_active":"2024-09-11T23:19:08.252858+0000","last_peered":"2024-09-11T23:19:08.252858+0000","last_clean":"2024-09-11T23:19:08.252858+0000","last_became_active":"2024-09-11T23:19:07.272955+0000","last_became_peered":"2024-09-11T23:19:07.272955+0000","last_unstale":"2024-09-11T23:19:08.252858+0000","last_undegraded":"2024-09-11T23:19:08.252858+0000","last_fullsized":"2024-09-11T23:19:08.252858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:42.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.252729+0000","last_change":"2024-09-11T23:19:06.558413+0000","last_active":"2024-09-11T23:19:08.252729+0000","last_peered":"2024-09-11T23:19:08.252729+0000","last_clean":"2024-09-11T23:19:08.252729+0000","last_became_active":"2024-09-11T23:19:06.557721+0000","last_became_peered":"2024-09-11T23:19:06.557721+0000","last_unstale":"2024-09-11T23:19:08.252729+0000","last_undegraded":"2024-09-11T23:19:08.252729+0000","last_fullsized":"2024-09-11T23:19:08.252729+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717570+0000","last_change":"2024-09-11T23:19:07.276883+0000","last_active":"2024-09-11T23:19:08.717570+0000","last_peered":"2024-09-11T23:19:08.717570+0000","last_clean":"2024-09-11T23:19:08.717570+0000","last_became_active":"2024-09-11T23:19:07.276122+0000","last_became_peered":"2024-09-11T23:19:07.276122+0000","last_unstale":"2024-09-11T23:19:08.717570+0000","last_undegraded":"2024-09-11T23:19:08.717570+0000","last_fullsized":"2024-09-11T23:19:08.717570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:23.794337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246124+0000","last_change":"2024-09-11T23:19:06.557333+0000","last_active":"2024-09-11T23:19:08.246124+0000","last_peered":"2024-09-11T23:19:08.246124+0000","last_clean":"2024-09-11T23:19:08.246124+0000","last_became_active":"2024-09-11T23:19:06.556598+0000","last_became_peered":"2024-09-11T23:19:06.556598+0000","last_unstale":"2024-09-11T23:19:08.246124+0000","last_undegraded":"2024-09-11T23:19:08.246124+0000","last_fullsized":"2024-09-11T23:19:08.246124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:53.373475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487902+0000","last_change":"2024-09-11T23:19:07.281019+0000","last_active":"2024-09-11T23:19:08.487902+0000","last_peered":"2024-09-11T23:19:08.487902+0000","last_clean":"2024-09-11T23:19:08.487902+0000","last_became_active":"2024-09-11T23:19:07.280262+0000","last_became_peered":"2024-09-11T23:19:07.280262+0000","last_unstale":"2024-09-11T23:19:08.487902+0000","last_undegraded":"2024-09-11T23:19:08.487902+0000","last_fullsized":"2024-09-11T23:19:08.487902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.343457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251500+0000","last_change":"2024-09-11T23:19:06.565340+0000","last_active":"2024-09-11T23:19:08.251500+0000","last_peered":"2024-09-11T23:19:08.251500+0000","last_clean":"2024-09-11T23:19:08.251500+0000","last_became_active":"2024-09-11T23:19:06.564535+0000","last_became_peered":"2024-09-11T23:19:06.564535+0000","last_unstale":"2024-09-11T23:19:08.251500+0000","last_undegraded":"2024-09-11T23:19:08.251500+0000","last_fullsized":"2024-09-11T23:19:08.251500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:55.339358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.720919+0000","last_change":"2024-09-11T23:19:07.301239+0000","last_active":"2024-09-11T23:19:08.720919+0000","last_peered":"2024-09-11T23:19:08.720919+0000","last_clean":"2024-09-11T23:19:08.720919+0000","last_became_active":"2024-09-11T23:19:07.300498+0000","last_became_peered":"2024-09-11T23:19:07.300498+0000","last_unstale":"2024-09-11T23:19:08.720919+0000","last_undegraded":"2024-09-11T23:19:08.720919+0000","last_fullsized":"2024-09-11T23:19:08.720919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:39.010094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717660+0000","last_change":"2024-09-11T23:19:06.574920+0000","last_active":"2024-09-11T23:19:08.717660+0000","last_peered":"2024-09-11T23:19:08.717660+0000","last_clean":"2024-09-11T23:19:08.717660+0000","last_became_active":"2024-09-11T23:19:06.571154+0000","last_became_peered":"2024-09-11T23:19:06.571154+0000","last_unstale":"2024-09-11T23:19:08.717660+0000","last_undegraded":"2024-09-11T23:19:08.717660+0000","last_fullsized":"2024-09-11T23:19:08.717660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:42.534717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.719894+0000","last_change":"2024-09-11T23:19:07.301730+0000","last_active":"2024-09-11T23:19:08.719894+0000","last_peered":"2024-09-11T23:19:08.719894+0000","last_clean":"2024-09-11T23:19:08.719894+0000","last_became_active":"2024-09-11T23:19:07.296015+0000","last_became_peered":"2024-09-11T23:19:07.296015+0000","last_unstale":"2024-09-11T23:19:08.719894+0000","last_undegraded":"2024-09-11T23:19:08.719894+0000","last_fullsized":"2024-09-11T23:19:08.719894+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:09.839853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717944+0000","last_change":"2024-09-11T23:19:06.575470+0000","last_active":"2024-09-11T23:19:08.717944+0000","last_peered":"2024-09-11T23:19:08.717944+0000","last_clean":"2024-09-11T23:19:08.717944+0000","last_became_active":"2024-09-11T23:19:06.572387+0000","last_became_peered":"2024-09-11T23:19:06.572387+0000","last_unstale":"2024-09-11T23:19:08.717944+0000","last_undegraded":"2024-09-11T23:19:08.717944+0000","last_fullsized":"2024-09-11T23:19:08.717944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:55.383306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.253669+0000","last_change":"2024-09-11T23:19:07.264357+0000","last_active":"2024-09-11T23:19:08.253669+0000","last_peered":"2024-09-11T23:19:08.253669+0000","last_clean":"2024-09-11T23:19:08.253669+0000","last_became_active":"2024-09-11T23:19:07.263468+0000","last_became_peered":"2024-09-11T23:19:07.263468+0000","last_unstale":"2024-09-11T23:19:08.253669+0000","last_undegraded":"2024-09-11T23:19:08.253669+0000","last_fullsized":"2024-09-11T23:19:08.253669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488209+0000","last_change":"2024-09-11T23:19:06.559238+0000","last_active":"2024-09-11T23:19:08.488209+0000","last_peered":"2024-09-11T23:19:08.488209+0000","last_clean":"2024-09-11T23:19:08.488209+0000","last_became_active":"2024-09-11T23:19:06.558411+0000","last_became_peered":"2024-09-11T23:19:06.558411+0000","last_unstale":"2024-09-11T23:19:08.488209+0000","last_undegraded":"2024-09-11T23:19:08.488209+0000","last_fullsized":"2024-09-11T23:19:08.488209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:41.685199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.246297+0000","last_change":"2024-09-11T23:19:07.281067+0000","last_active":"2024-09-11T23:19:08.246297+0000","last_peered":"2024-09-11T23:19:08.246297+0000","last_clean":"2024-09-11T23:19:08.246297+0000","last_became_active":"2024-09-11T23:19:07.280376+0000","last_became_peered":"2024-09-11T23:19:07.280376+0000","last_unstale":"2024-09-11T23:19:08.246297+0000","last_undegraded":"2024-09-11T23:19:08.246297+0000","last_fullsized":"2024-09-11T23:19:08.246297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:59.009388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.718197+0000","last_change":"2024-09-11T23:19:06.577115+0000","last_active":"2024-09-11T23:19:08.718197+0000","last_peered":"2024-09-11T23:19:08.718197+0000","last_clean":"2024-09-11T23:19:08.718197+0000","last_became_active":"2024-09-11T23:19:06.576829+0000","last_became_peered":"2024-09-11T23:19:06.576829+0000","last_unstale":"2024-09-11T23:19:08.718197+0000","last_undegraded":"2024-09-11T23:19:08.718197+0000","last_fullsized":"2024-09-11T23:19:08.718197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.195424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717288+0000","last_change":"2024-09-11T23:19:07.300922+0000","last_active":"2024-09-11T23:19:08.717288+0000","last_peered":"2024-09-11T23:19:08.717288+0000","last_clean":"2024-09-11T23:19:08.717288+0000","last_became_active":"2024-09-11T23:19:07.298799+0000","last_became_peered":"2024-09-11T23:19:07.298799+0000","last_unstale":"2024-09-11T23:19:08.717288+0000","last_undegraded":"2024-09-11T23:19:08.717288+0000","last_fullsized":"2024-09-11T23:19:08.717288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:50.199522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.252799+0000","last_change":"2024-09-11T23:19:06.556306+0000","last_active":"2024-09-11T23:19:08.252799+0000","last_peered":"2024-09-11T23:19:08.252799+0000","last_clean":"2024-09-11T23:19:08.252799+0000","last_became_active":"2024-09-11T23:19:06.555615+0000","last_became_peered":"2024-09-11T23:19:06.555615+0000","last_unstale":"2024-09-11T23:19:08.252799+0000","last_undegraded":"2024-09-11T23:19:08.252799+0000","last_fullsized":"2024-09-11T23:19:08.252799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:08.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.487575+0000","last_change":"2024-09-11T23:19:07.287433+0000","last_active":"2024-09-11T23:19:08.487575+0000","last_peered":"2024-09-11T23:19:08.487575+0000","last_clean":"2024-09-11T23:19:08.487575+0000","last_became_active":"2024-09-11T23:19:07.285837+0000","last_became_peered":"2024-09-11T23:19:07.285837+0000","last_unstale":"2024-09-11T23:19:08.487575+0000","last_undegraded":"2024-09-11T23:19:08.487575+0000","last_fullsized":"2024-09-11T23:19:08.487575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:43.077313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.488122+0000","last_change":"2024-09-11T23:19:06.566084+0000","last_active":"2024-09-11T23:19:08.488122+0000","last_peered":"2024-09-11T23:19:08.488122+0000","last_clean":"2024-09-11T23:19:08.488122+0000","last_became_active":"2024-09-11T23:19:06.563321+0000","last_became_peered":"2024-09-11T23:19:06.563321+0000","last_unstale":"2024-09-11T23:19:08.488122+0000","last_undegraded":"2024-09-11T23:19:08.488122+0000","last_fullsized":"2024-09-11T23:19:08.488122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.760257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.717968+0000","last_change":"2024-09-11T23:19:07.287130+0000","last_active":"2024-09-11T23:19:08.717968+0000","last_peered":"2024-09-11T23:19:08.717968+0000","last_clean":"2024-09-11T23:19:08.717968+0000","last_became_active":"2024-09-11T23:19:07.286410+0000","last_became_peered":"2024-09-11T23:19:07.286410+0000","last_unstale":"2024-09-11T23:19:08.717968+0000","last_undegraded":"2024-09-11T23:19:08.717968+0000","last_fullsized":"2024-09-11T23:19:08.717968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:38.849234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250769+0000","last_change":"2024-09-11T23:19:06.554823+0000","last_active":"2024-09-11T23:19:08.250769+0000","last_peered":"2024-09-11T23:19:08.250769+0000","last_clean":"2024-09-11T23:19:08.250769+0000","last_became_active":"2024-09-11T23:19:06.554113+0000","last_became_peered":"2024-09-11T23:19:06.554113+0000","last_unstale":"2024-09-11T23:19:08.250769+0000","last_undegraded":"2024-09-11T23:19:08.250769+0000","last_fullsized":"2024-09-11T23:19:08.250769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:42.073215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.251719+0000","last_change":"2024-09-11T23:19:07.296848+0000","last_active":"2024-09-11T23:19:08.251719+0000","last_peered":"2024-09-11T23:19:08.251719+0000","last_clean":"2024-09-11T23:19:08.251719+0000","last_became_active":"2024-09-11T23:19:07.296316+0000","last_became_peered":"2024-09-11T23:19:07.296316+0000","last_unstale":"2024-09-11T23:19:08.251719+0000","last_undegraded":"2024-09-11T23:19:08.251719+0000","last_fullsized":"2024-09-11T23:19:08.251719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:06.515823+0000","last_clean_scrub_stamp":"2024-09-11T23:19:06.515823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:02.464388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.721192+0000","last_change":"2024-09-11T23:19:06.554819+0000","last_active":"2024-09-11T23:19:08.721192+0000","last_peered":"2024-09-11T23:19:08.721192+0000","last_clean":"2024-09-11T23:19:08.721192+0000","last_became_active":"2024-09-11T23:19:06.554385+0000","last_became_peered":"2024-09-11T23:19:06.554385+0000","last_unstale":"2024-09-11T23:19:08.721192+0000","last_undegraded":"2024-09-11T23:19:08.721192+0000","last_fullsized":"2024-09-11T23:19:08.721192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:05.511724+0000","last_clean_scrub_stamp":"2024-09-11T23:19:05.511724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:44.371543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":295,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:19:08.250983+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:19:08.250983+0000","last_peered":"2024-09-11T23:19:08.250983+0000","last_clean":"2024-09-11T23:19:08.250983+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:19:08.250983+0000","last_undegraded":"2024-09-11T23:19:08.250983+0000","last_fullsized":"2024-09-11T23:19:08.250983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1662976,"data_stored":1077122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1081344,"data_stored":488914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1060864,"data_stored":486698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":486858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1060864,"data_stored":486698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1060864,"data_stored":486698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40548,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331292,"statfs":{"total":96636764160,"available":96595243008,"internally_reserved":0,"allocated":1064960,"data_stored":486768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1679360,"data_stored":1079384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:16.379 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:19:16.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:19:16.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5063ee9640 1 Processor -- start 2024-09-11T23:19:16.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5063ee9640 1 -- start start 2024-09-11T23:19:16.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5063ee9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f505c0af100 0x7f505c071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5063ee9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0acf60 0x7f505c06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5063ee9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c15b800 con 0x7f505c0ad3a0 2024-09-11T23:19:16.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5063ee9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f505c0723a0 con 0x7f505c0af100 2024-09-11T23:19:16.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5063ee9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f505c072680 con 0x7f505c0acf60 2024-09-11T23:19:16.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5061c85640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f505c0af100 0x7f505c071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5061484640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0acf60 0x7f505c06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5062486640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f505c0ad3a0 0x7f505c073440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:43688/0 (socket says 172.21.15.94:43688) 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5062486640 1 -- 172.21.15.94:0/2665852021 learned_addr learned my addr 172.21.15.94:0/2665852021 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5061c85640 1 -- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0acf60 msgr2=0x7f505c06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5061c85640 1 --2- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0acf60 0x7f505c06ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5061c85640 1 -- 172.21.15.94:0/2665852021 >> v1:172.21.15.155:6789/0 conn(0x7f505c0ad3a0 legacy=0x7f505c073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5061c85640 1 -- 172.21.15.94:0/2665852021 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c072960 con 0x7f505c0af100 2024-09-11T23:19:16.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.545+0000 7f5061484640 1 --2- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0acf60 0x7f505c06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:16.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5061c85640 1 --2- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c071da0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f50580097c0 tx=0x7f505801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6332f967c2920cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5060c83640 1 -- 172.21.15.94:0/2665852021 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580b0070 con 0x7f505c0af100 2024-09-11T23:19:16.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5060c83640 1 -- 172.21.15.94:0/2665852021 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50580ab600 con 0x7f505c0af100 2024-09-11T23:19:16.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5060c83640 1 -- 172.21.15.94:0/2665852021 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580ab9d0 con 0x7f505c0af100 2024-09-11T23:19:16.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 -- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 msgr2=0x7f505c071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 --2- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c071da0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f50580097c0 tx=0x7f505801c410 comp rx=0 tx=0).stop 2024-09-11T23:19:16.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 -- 172.21.15.94:0/2665852021 shutdown_connections 2024-09-11T23:19:16.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 --2- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0acf60 0x7f505c06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 --2- 172.21.15.94:0/2665852021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c071da0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 -- 172.21.15.94:0/2665852021 >> 172.21.15.94:0/2665852021 conn(0x7f505c0b1c80 msgr2=0x7f505c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 -- 172.21.15.94:0/2665852021 shutdown_connections 2024-09-11T23:19:16.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.549+0000 7f5063ee9640 1 -- 172.21.15.94:0/2665852021 wait complete. 2024-09-11T23:19:16.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 Processor -- start 2024-09-11T23:19:16.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 -- start start 2024-09-11T23:19:16.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f505c0acf60 0x7f505c156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0ad3a0 0x7f505c15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f505c06f5d0 con 0x7f505c0acf60 2024-09-11T23:19:16.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f505c06f450 con 0x7f505c0af100 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f505c06f750 con 0x7f505c0ad3a0 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f505c0acf60 0x7f505c156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f505c0acf60 0x7f505c156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59460/0 (socket says 172.21.15.94:59460) 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 -- 172.21.15.94:0/3641986816 learned_addr learned my addr 172.21.15.94:0/3641986816 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061484640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0ad3a0 0x7f505c15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5062486640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 -- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0ad3a0 msgr2=0x7f505c15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0ad3a0 0x7f505c15e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 -- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 msgr2=0x7f505c1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c1504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 -- 172.21.15.94:0/3641986816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c073980 con 0x7f505c0acf60 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5062486640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:16.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5061c85640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f505c0acf60 0x7f505c156010 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f505801a040 tx=0x7f50580191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f50527fc640 1 -- 172.21.15.94:0/3641986816 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580b8070 con 0x7f505c0acf60 2024-09-11T23:19:16.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f50527fc640 1 -- 172.21.15.94:0/3641986816 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50580b4410 con 0x7f505c0acf60 2024-09-11T23:19:16.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505c1565f0 con 0x7f505c0acf60 2024-09-11T23:19:16.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f50527fc640 1 -- 172.21.15.94:0/3641986816 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580b0040 con 0x7f505c0acf60 2024-09-11T23:19:16.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505c156bb0 con 0x7f505c0acf60 2024-09-11T23:19:16.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.553+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505c09e110 con 0x7f505c0acf60 2024-09-11T23:19:16.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.557+0000 7f50527fc640 1 -- 172.21.15.94:0/3641986816 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50580bb070 con 0x7f505c0acf60 2024-09-11T23:19:16.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.557+0000 7f50527fc640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f50400678c0 0x7f5040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.557+0000 7f50527fc640 1 -- 172.21.15.94:0/3641986816 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f505811f900 con 0x7f505c0acf60 2024-09-11T23:19:16.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.557+0000 7f5061484640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f50400678c0 0x7f5040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.557+0000 7f5061484640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f50400678c0 0x7f5040069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f504c009580 tx=0x7f504c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.561+0000 7f50527fc640 1 -- 172.21.15.94:0/3641986816 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5058016090 con 0x7f505c0acf60 2024-09-11T23:19:16.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.769+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f505c15eaf0 con 0x7f505c0acf60 2024-09-11T23:19:16.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.773+0000 7f50527fc640 1 -- 172.21.15.94:0/3641986816 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f50580efc60 con 0x7f505c0acf60 2024-09-11T23:19:16.774 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:19:16.774 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:19:16.774 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2024-09-11T23:19:16.774 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2024-09-11T23:19:16.774 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:19:16.775 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f50400678c0 msgr2=0x7f5040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f50400678c0 0x7f5040069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f504c009580 tx=0x7f504c009190 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f505c0acf60 msgr2=0x7f505c156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f505c0acf60 0x7f505c156010 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f505801a040 tx=0x7f50580191b0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 shutdown_connections 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f505c0af100 0x7f505c1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f505c0ad3a0 0x7f505c15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f50400678c0 0x7f5040069d80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 --2- 172.21.15.94:0/3641986816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f505c0acf60 0x7f505c156010 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 >> 172.21.15.94:0/3641986816 conn(0x7f505c0b1c80 msgr2=0x7f505c0b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 shutdown_connections 2024-09-11T23:19:16.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.777+0000 7f5063ee9640 1 -- 172.21.15.94:0/3641986816 wait complete. 2024-09-11T23:19:16.793 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:16.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 Processor -- start 2024-09-11T23:19:16.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 -- start start 2024-09-11T23:19:16.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0f4415bec0 0x7f0f440ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415c2a0 0x7f0f440aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0f440af2a0 0x7f0f4415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0f440b3290 con 0x7f0f440af2a0 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0f440b3570 con 0x7f0f4415bec0 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f49c39640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f440b3850 con 0x7f0f4415c2a0 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f43fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0f440af2a0 0x7f0f4415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.905+0000 7f0f43fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0f440af2a0 0x7f0f4415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59472/0 (socket says 172.21.15.94:59472) 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f43fff640 1 -- 172.21.15.94:0/1360549374 learned_addr learned my addr 172.21.15.94:0/1360549374 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f437fe640 1 --2- 172.21.15.94:0/1360549374 >> v2:172.21.15.155:3300/0 conn(0x7f0f4415bec0 0x7f0f440ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f42ffd640 1 --2- 172.21.15.94:0/1360549374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415c2a0 0x7f0f440aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f43fff640 1 -- 172.21.15.94:0/1360549374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415c2a0 msgr2=0x7f0f440aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f43fff640 1 --2- 172.21.15.94:0/1360549374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415c2a0 0x7f0f440aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f43fff640 1 -- 172.21.15.94:0/1360549374 >> v2:172.21.15.155:3300/0 conn(0x7f0f4415bec0 msgr2=0x7f0f440ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f43fff640 1 --2- 172.21.15.94:0/1360549374 >> v2:172.21.15.155:3300/0 conn(0x7f0f4415bec0 0x7f0f440ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f43fff640 1 -- 172.21.15.94:0/1360549374 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f440b3b30 con 0x7f0f440af2a0 2024-09-11T23:19:16.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f43fff640 1 --2- 172.21.15.94:0/1360549374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f440af2a0 0x7f0f4415fc60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0f44071710 tx=0x7f0f3401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0ed10e9b459865 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f427fc640 1 -- 172.21.15.94:0/1360549374 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340b0070 con 0x7f0f440af2a0 2024-09-11T23:19:16.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f427fc640 1 -- 172.21.15.94:0/1360549374 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f340ab600 con 0x7f0f440af2a0 2024-09-11T23:19:16.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f427fc640 1 -- 172.21.15.94:0/1360549374 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340ab9d0 con 0x7f0f440af2a0 2024-09-11T23:19:16.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 -- 172.21.15.94:0/1360549374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f440af2a0 msgr2=0x7f0f4415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 --2- 172.21.15.94:0/1360549374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f440af2a0 0x7f0f4415fc60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0f44071710 tx=0x7f0f3401c230 comp rx=0 tx=0).stop 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 -- 172.21.15.94:0/1360549374 shutdown_connections 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 --2- 172.21.15.94:0/1360549374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f440af2a0 0x7f0f4415fc60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 --2- 172.21.15.94:0/1360549374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415c2a0 0x7f0f440aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 --2- 172.21.15.94:0/1360549374 >> v2:172.21.15.155:3300/0 conn(0x7f0f4415bec0 0x7f0f440ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 -- 172.21.15.94:0/1360549374 >> 172.21.15.94:0/1360549374 conn(0x7f0f440b1f90 msgr2=0x7f0f440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 -- 172.21.15.94:0/1360549374 shutdown_connections 2024-09-11T23:19:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.909+0000 7f0f49c39640 1 -- 172.21.15.94:0/1360549374 wait complete. 2024-09-11T23:19:16.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 Processor -- start 2024-09-11T23:19:16.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 -- start start 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f440af2a0 0x7f0f44099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415bec0 0x7f0f44152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f4415c2a0 0x7f0f441401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440ad740 con 0x7f0f4415c2a0 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440afc90 con 0x7f0f440af2a0 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4406e000 con 0x7f0f4415bec0 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f4415c2a0 0x7f0f441401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f4415c2a0 0x7f0f441401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59482/0 (socket says 172.21.15.94:59482) 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 -- 172.21.15.94:0/3944293523 learned_addr learned my addr 172.21.15.94:0/3944293523 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f437fe640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f440af2a0 0x7f0f44099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f42ffd640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415bec0 0x7f0f44152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 -- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415bec0 msgr2=0x7f0f44152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415bec0 0x7f0f44152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 -- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f440af2a0 msgr2=0x7f0f44099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f440af2a0 0x7f0f44099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 -- 172.21.15.94:0/3944293523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4409c470 con 0x7f0f4415c2a0 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f43fff640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f4415c2a0 0x7f0f441401a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0f3401a8e0 tx=0x7f0f3401aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f3bfff640 1 -- 172.21.15.94:0/3944293523 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340b0040 con 0x7f0f4415c2a0 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f3bfff640 1 -- 172.21.15.94:0/3944293523 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f340bc070 con 0x7f0f4415c2a0 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f3bfff640 1 -- 172.21.15.94:0/3944293523 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340b6660 con 0x7f0f4415c2a0 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4409c710 con 0x7f0f4415c2a0 2024-09-11T23:19:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4409ccd0 con 0x7f0f4415c2a0 2024-09-11T23:19:16.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.913+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f440ad200 con 0x7f0f4415c2a0 2024-09-11T23:19:16.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.917+0000 7f0f3bfff640 1 -- 172.21.15.94:0/3944293523 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f340b6800 con 0x7f0f4415c2a0 2024-09-11T23:19:16.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.917+0000 7f0f3bfff640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f240678c0 0x7f0f24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.917+0000 7f0f3bfff640 1 -- 172.21.15.94:0/3944293523 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f0f341201e0 con 0x7f0f4415c2a0 2024-09-11T23:19:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.917+0000 7f0f437fe640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f240678c0 0x7f0f24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.917+0000 7f0f437fe640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f240678c0 0x7f0f24069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c003fd0 tx=0x7f0f3c0039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:16.921+0000 7f0f3bfff640 1 -- 172.21.15.94:0/3944293523 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f34016110 con 0x7f0f4415c2a0 2024-09-11T23:19:17.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.101+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f4406fcd0 con 0x7f0f4415c2a0 2024-09-11T23:19:17.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.101+0000 7f0f3bfff640 1 -- 172.21.15.94:0/3944293523 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7f0f340f0b90 con 0x7f0f4415c2a0 2024-09-11T23:19:17.104 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:17.104 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:06.902722+0000","modified":"2024-09-11T23:19:09.918807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/3079112947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3079112947},{"type":"v1","addr":"172.21.15.155:6836","nonce":3079112947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":6}]} 2024-09-11T23:19:17.104 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 49 2024-09-11T23:19:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f240678c0 msgr2=0x7f0f24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f240678c0 0x7f0f24069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c003fd0 tx=0x7f0f3c0039a0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f4415c2a0 msgr2=0x7f0f441401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f4415c2a0 0x7f0f441401a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0f3401a8e0 tx=0x7f0f3401aa70 comp rx=0 tx=0).stop 2024-09-11T23:19:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 shutdown_connections 2024-09-11T23:19:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0f240678c0 0x7f0f24069d80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f4415c2a0 0x7f0f441401a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f4415bec0 0x7f0f44152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 --2- 172.21.15.94:0/3944293523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f440af2a0 0x7f0f44099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 >> 172.21.15.94:0/3944293523 conn(0x7f0f440b1f90 msgr2=0x7f0f44159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 shutdown_connections 2024-09-11T23:19:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.105+0000 7f0f49c39640 1 -- 172.21.15.94:0/3944293523 wait complete. 2024-09-11T23:19:17.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:19:06.902722+0000', 'modified': '2024-09-11T23:19:09.918807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6381': {'gid': 6381, 'name': 'd', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6836/3079112947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3079112947}, {'type': 'v1', 'addr': '172.21.15.155:6836', 'nonce': 3079112947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6381, 'qdb_cluster': [6381]} 2024-09-11T23:19:17.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:19:17.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-11T23:19:17.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9f476640 1 Processor -- start 2024-09-11T23:19:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9f476640 1 -- start start 2024-09-11T23:19:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9f476640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efd98073e60 0x7efd9806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9f476640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9806ee50 con 0x7efd980b3d50 2024-09-11T23:19:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9f476640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9806f130 con 0x7efd9806fef0 2024-09-11T23:19:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9f476640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efd9806f410 con 0x7efd98073e60 2024-09-11T23:19:17.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9da13640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7efd980b3d50 0x7efd980b4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47130/0 (socket says 172.21.15.94:47130) 2024-09-11T23:19:17.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9da13640 1 -- 172.21.15.94:0/1647212395 learned_addr learned my addr 172.21.15.94:0/1647212395 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9d212640 1 --2- 172.21.15.94:0/1647212395 >> v2:172.21.15.155:3300/0 conn(0x7efd98073e60 0x7efd9806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746188027 0 0) 0x7efd9806ee50 con 0x7efd980b3d50 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd84003450 con 0x7efd980b3d50 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4014406854 0 0) 0x7efd84003450 con 0x7efd980b3d50 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 >> v2:172.21.15.155:3300/0 conn(0x7efd98073e60 msgr2=0x7efd9806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 --2- 172.21.15.94:0/1647212395 >> v2:172.21.15.155:3300/0 conn(0x7efd98073e60 0x7efd9806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 >> v1:172.21.15.155:6789/0 conn(0x7efd9806fef0 legacy=0x7efd9815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9806f6f0 con 0x7efd980b3d50 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7efd90001a00 con 0x7efd980b3d50 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 >> v1:172.21.15.94:6789/0 conn(0x7efd980b3d50 legacy=0x7efd980b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd84003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd84008860 0x7efd8400acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd8400b570 0x7efd8400da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efd9806f410 con 0x7efd84003ab0 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd8400e310 con 0x7efd8400b570 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd8400e510 con 0x7efd84008860 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9d212640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd84003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9d212640 1 -- 172.21.15.94:0/1647212395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd84008860 msgr2=0x7efd8400acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9d212640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd84008860 0x7efd8400acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9da13640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd8400b570 0x7efd8400da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9d212640 1 -- 172.21.15.94:0/1647212395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd8400b570 msgr2=0x7efd8400da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9d212640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd8400b570 0x7efd8400da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9da13640 1 -- 172.21.15.94:0/1647212395 reap_dead start 2024-09-11T23:19:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.661+0000 7efd9d212640 1 -- 172.21.15.94:0/1647212395 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd84003450 con 0x7efd84003ab0 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9d212640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd84003ed0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efd94009ac0 tx=0x7efd9401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95a37be9e9d5378 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94009690 con 0x7efd84003ab0 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd940a6450 con 0x7efd84003ab0 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd8ffff640 1 -- 172.21.15.94:0/1647212395 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940a6820 con 0x7efd84003ab0 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- 172.21.15.94:0/1647212395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 msgr2=0x7efd84003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd84003ed0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efd94009ac0 tx=0x7efd9401ca50 comp rx=0 tx=0).stop 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- 172.21.15.94:0/1647212395 shutdown_connections 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 --2- 172.21.15.94:0/1647212395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd84003ed0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- 172.21.15.94:0/1647212395 >> 172.21.15.94:0/1647212395 conn(0x7efd980b1f90 msgr2=0x7efd980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- 172.21.15.94:0/1647212395 shutdown_connections 2024-09-11T23:19:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- 172.21.15.94:0/1647212395 wait complete. 2024-09-11T23:19:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 Processor -- start 2024-09-11T23:19:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- start start 2024-09-11T23:19:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd98099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981f4780 0x7efd981f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd981f3b00 0x7efd980731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efd9806e900 con 0x7efd84003ab0 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd9806e780 con 0x7efd981f4780 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9f476640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd9806ea80 con 0x7efd981f3b00 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9d212640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd98099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9d212640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd98099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59498/0 (socket says 172.21.15.94:59498) 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.665+0000 7efd9d212640 1 -- 172.21.15.94:0/1914640851 learned_addr learned my addr 172.21.15.94:0/1914640851 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9ca11640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981f4780 0x7efd981f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9da13640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd981f3b00 0x7efd980731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9d212640 1 -- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd981f3b00 msgr2=0x7efd980731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9d212640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd981f3b00 0x7efd980731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9d212640 1 -- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981f4780 msgr2=0x7efd981f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9d212640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981f4780 0x7efd981f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9d212640 1 -- 172.21.15.94:0/1914640851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd981f4c00 con 0x7efd84003ab0 2024-09-11T23:19:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9da13640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd981f3b00 0x7efd980731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9d212640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd98099ab0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efd94009ac0 tx=0x7efd940197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd8dffb640 1 -- 172.21.15.94:0/1914640851 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940a6d00 con 0x7efd84003ab0 2024-09-11T23:19:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd8dffb640 1 -- 172.21.15.94:0/1914640851 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd940a7430 con 0x7efd84003ab0 2024-09-11T23:19:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd981f4010 con 0x7efd84003ab0 2024-09-11T23:19:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd8dffb640 1 -- 172.21.15.94:0/1914640851 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940a77e0 con 0x7efd84003ab0 2024-09-11T23:19:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd981555d0 con 0x7efd84003ab0 2024-09-11T23:19:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd8dffb640 1 -- 172.21.15.94:0/1914640851 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd940a7980 con 0x7efd84003ab0 2024-09-11T23:19:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd8dffb640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd7c0678f0 0x7efd7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd8dffb640 1 -- 172.21.15.94:0/1914640851 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7efd9411ff10 con 0x7efd84003ab0 2024-09-11T23:19:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9ca11640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd7c0678f0 0x7efd7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efda2532000 1 Processor -- start 2024-09-11T23:19:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efda2532000 1 -- start start 2024-09-11T23:19:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.669+0000 7efd9ca11640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd7c0678f0 0x7efd7c069db0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd98072f30 tx=0x7efd88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 0x55e52dbc9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52db7f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52db7f6a0 0x55e52db7fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55e52da62b60 con 0x55e52dbc9690 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e52d9c9c70 con 0x55e52db7f6a0 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55e52d96fed0 con 0x55e52dbc8d70 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52db7f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52db7f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59514/0 (socket says 172.21.15.94:59514) 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/4187739924 learned_addr learned my addr 172.21.15.94:0/4187739924 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9da13640 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52db7f6a0 0x55e52db7fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9d212640 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 0x55e52dbc9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 msgr2=0x55e52dbc9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 0x55e52dbc9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52db7f6a0 msgr2=0x55e52db7fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52db7f6a0 0x55e52db7fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/4187739924 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52d981e50 con 0x55e52dbc9690 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52db7f160 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efd88001e60 tx=0x7efd88011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8667ef3609aaaf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd82ffd640 1 -- 172.21.15.94:0/4187739924 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88003620 con 0x55e52dbc9690 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd82ffd640 1 -- 172.21.15.94:0/4187739924 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd880037c0 con 0x55e52dbc9690 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd82ffd640 1 -- 172.21.15.94:0/4187739924 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88003b90 con 0x55e52dbc9690 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- 172.21.15.94:0/4187739924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 msgr2=0x55e52db7f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52db7f160 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efd88001e60 tx=0x7efd88011000 comp rx=0 tx=0).stop 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- 172.21.15.94:0/4187739924 shutdown_connections 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52db7f6a0 0x55e52db7fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52db7f160 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- 172.21.15.94:0/4187739924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 0x55e52dbc9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- 172.21.15.94:0/4187739924 >> 172.21.15.94:0/4187739924 conn(0x55e52db81600 msgr2=0x55e52db79630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- 172.21.15.94:0/4187739924 shutdown_connections 2024-09-11T23:19:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- 172.21.15.94:0/4187739924 wait complete. 2024-09-11T23:19:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- start start 2024-09-11T23:19:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 Processor -- start 2024-09-11T23:19:17.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbc8d70 0x55e52dbceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52dbcf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbb5490 0x55e52dbb5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55e52da2bb00 con 0x55e52dbc9690 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e52d9a4360 con 0x55e52dbc8d70 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55e52d9a12d0 con 0x55e52dbb5490 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 10 client.0 _ll_register_callbacks cb 0x55e52db66820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52dbcf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52dbcf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59528/0 (socket says 172.21.15.94:59528) 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/448704099 learned_addr learned my addr 172.21.15.94:0/448704099 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9d212640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbc8d70 0x55e52dbceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9da13640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbb5490 0x55e52dbb5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbb5490 msgr2=0x55e52dbb5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbb5490 0x55e52dbb5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbc8d70 msgr2=0x55e52dbceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbc8d70 0x55e52dbceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 -- 172.21.15.94:0/448704099 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e52d970120 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9d212640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbc8d70 0x55e52dbceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd9ca11640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52dbcf3f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x55e52da81ac0 tx=0x7efd880077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be6f63ee0c61b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd77fff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd77fff640 1 -- 172.21.15.94:0/448704099 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88021450 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efd77fff640 1 -- 172.21.15.94:0/448704099 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7efd88010070 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.673+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd880037c0 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd77fff640 1 -- 172.21.15.94:0/448704099 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7efd88032050 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 10 client.6522 fetch_fsmap learned FSMap version 49 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x55e52d969450 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd77fff640 1 -- 172.21.15.94:0/448704099 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd880037c0 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd77fff640 1 -- 172.21.15.94:0/448704099 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 49) ==== 3502+0+0 (secure 0 0 0) 0x7efd88035020 con 0x55e52dbc9690 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 10 client.6522 fetch_fsmap finished waiting for FSMap version 49 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 10 client.6522 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-11T23:19:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 20 client.6522 populate_metadata read hostname 'smithi094' 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbb6280 0x55e52dbb6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 4 client.6522 mds_command: new command op to 6381 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 --> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e52d963c00 con 0x55e52dbb6280 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd9d212640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbb6280 0x55e52dbb6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd9d212640 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbb6280 0x55e52dbb6660 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e6d4f8dbb511719 server_cookie=9d49d754408ae8cf in_seq=0 out_seq=0 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd77fff640 10 client.6522 ms_handle_connect on v2:172.21.15.155:6834/3079112947 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd77fff640 1 -- 172.21.15.94:0/448704099 <== mds.0 v2:172.21.15.155:6834/3079112947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e52d963c00 con 0x55e52dbb6280 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd77fff640 10 client.6522 handle_command_reply: tid=0 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 client.6522 shutdown 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 msgr2=0x55e52dbcf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52dbcf3f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x55e52da81ac0 tx=0x7efd880077f0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 shutdown_connections 2024-09-11T23:19:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbb6280 0x55e52dbb6660 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbb5490 0x55e52dbb5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc9690 0x55e52dbcf3f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efd77fff640 0 client.6522 ms_handle_reset on v2:172.21.15.155:6834/3079112947 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 --2- 172.21.15.94:0/448704099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbc8d70 0x55e52dbceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 >> 172.21.15.94:0/448704099 conn(0x55e52db7f6a0 msgr2=0x55e52db809b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 shutdown_connections 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 1 -- 172.21.15.94:0/448704099 wait complete. 2024-09-11T23:19:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.677+0000 7efda2532000 20 client.6522 trim_cache size 0 max 16384 2024-09-11T23:19:17.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 Processor -- start 2024-09-11T23:19:17.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- start start 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52db7f6a0 0x55e52dbdf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 0x55e52dbdf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc8d70 0x55e52dbcdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efd981ff7c0 con 0x55e52dbc8d70 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd98153e40 con 0x55e52dbb5490 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd981ff170 con 0x55e52db7f6a0 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc8d70 0x55e52dbcdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc8d70 0x55e52dbcdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59544/0 (socket says 172.21.15.94:59544) 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 -- 172.21.15.94:0/2208281316 learned_addr learned my addr 172.21.15.94:0/2208281316 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 -- 172.21.15.94:0/2208281316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52db7f6a0 msgr2=0x55e52dbdf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 --2- 172.21.15.94:0/2208281316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52db7f6a0 0x55e52dbdf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 -- 172.21.15.94:0/2208281316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 msgr2=0x55e52dbdf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 --2- 172.21.15.94:0/2208281316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 0x55e52dbdf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 -- 172.21.15.94:0/2208281316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52d950fd0 con 0x55e52dbc8d70 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd9da13640 1 --2- 172.21.15.94:0/2208281316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc8d70 0x55e52dbcdca0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efd90007c50 tx=0x7efd900021a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d5514efa48462d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd827fc640 1 -- 172.21.15.94:0/2208281316 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90018020 con 0x55e52dbc8d70 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd827fc640 1 -- 172.21.15.94:0/2208281316 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90014430 con 0x55e52dbc8d70 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efd827fc640 1 -- 172.21.15.94:0/2208281316 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90014800 con 0x55e52dbc8d70 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- 172.21.15.94:0/2208281316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc8d70 msgr2=0x55e52dbcdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 --2- 172.21.15.94:0/2208281316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc8d70 0x55e52dbcdca0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efd90007c50 tx=0x7efd900021a0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- 172.21.15.94:0/2208281316 shutdown_connections 2024-09-11T23:19:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 --2- 172.21.15.94:0/2208281316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52dbc8d70 0x55e52dbcdca0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 --2- 172.21.15.94:0/2208281316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 0x55e52dbdf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 --2- 172.21.15.94:0/2208281316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52db7f6a0 0x55e52dbdf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- 172.21.15.94:0/2208281316 >> 172.21.15.94:0/2208281316 conn(0x55e52dbb4a90 msgr2=0x55e52db79ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- 172.21.15.94:0/2208281316 shutdown_connections 2024-09-11T23:19:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- 172.21.15.94:0/2208281316 wait complete. 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 -- start start 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.697+0000 7efda2532000 1 Processor -- start 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52db7f6a0 0x55e52dc3b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 0x55e52dbd2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 0x55e52dbd3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55e52d9c8f80 con 0x55e52db7f6a0 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e52d981ca0 con 0x55e52dbb5490 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55e52d9ce2a0 con 0x55e52dbc8d70 2024-09-11T23:19:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 10 client.0 _ll_register_callbacks cb 0x7efd88001d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52db7f6a0 0x55e52dc3b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52db7f6a0 0x55e52dc3b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59548/0 (socket says 172.21.15.94:59548) 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 -- 172.21.15.94:0/1636900821 learned_addr learned my addr 172.21.15.94:0/1636900821 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 -- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 msgr2=0x55e52dbd3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 0x55e52dbd3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 -- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 msgr2=0x55e52dbd2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9ca11640 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 0x55e52dbd2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 0x55e52dbd2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 -- 172.21.15.94:0/1636900821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e52da4c750 con 0x55e52db7f6a0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9d212640 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52db7f6a0 0x55e52dc3b9f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efd940f0150 tx=0x7efd940b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54175fd044cd92d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 1 -- 172.21.15.94:0/1636900821 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940f4570 con 0x55e52db7f6a0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 1 -- 172.21.15.94:0/1636900821 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7efd940ec830 con 0x55e52db7f6a0 2024-09-11T23:19:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd90014430 con 0x55e52db7f6a0 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 1 -- 172.21.15.94:0/1636900821 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7efd940f8da0 con 0x55e52db7f6a0 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 10 client.6528 fetch_fsmap learned FSMap version 49 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x55e52d957a30 con 0x55e52db7f6a0 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 1 -- 172.21.15.94:0/1636900821 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90014430 con 0x55e52db7f6a0 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 1 -- 172.21.15.94:0/1636900821 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 49) ==== 3502+0+0 (secure 0 0 0) 0x7efd940a7c70 con 0x55e52db7f6a0 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 10 client.6528 fetch_fsmap finished waiting for FSMap version 49 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 10 client.6528 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 20 client.6528 populate_metadata read hostname 'smithi094' 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbc9690 0x55e52dbd3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 4 client.6528 mds_command: new command op to 6381 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 --> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] -- command(tid 0: {"prefix": "status"}) -- 0x55e52d9d73a0 con 0x55e52dbc9690 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9ca11640 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbc9690 0x55e52dbd3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9ca11640 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbc9690 0x55e52dbd3770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d25f46cb90c7c00 server_cookie=9707bf0e1f03ca82 in_seq=0 out_seq=0 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 10 client.6528 ms_handle_connect on v2:172.21.15.155:6834/3079112947 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 1 -- 172.21.15.94:0/1636900821 <== mds.0 v2:172.21.15.155:6834/3079112947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55e52d9d73a0 con 0x55e52dbc9690 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 10 client.6528 handle_command_reply: tid=0 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 client.6528 shutdown 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52db7f6a0 msgr2=0x55e52dc3b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52db7f6a0 0x55e52dc3b9f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efd940f0150 tx=0x7efd940b4000 comp rx=0 tx=0).stop 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 shutdown_connections 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:6834/3079112947,v1:172.21.15.155:6836/3079112947] conn(0x55e52dbc9690 0x55e52dbd3770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e52dbc8d70 0x55e52dbd3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e52dbb5490 0x55e52dbd2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd77fff640 0 client.6528 ms_handle_reset on v2:172.21.15.155:6834/3079112947 2024-09-11T23:19:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 --2- 172.21.15.94:0/1636900821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e52db7f6a0 0x55e52dc3b9f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 >> 172.21.15.94:0/1636900821 conn(0x55e52dbb4a90 msgr2=0x55e52dbde250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 shutdown_connections 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 1 -- 172.21.15.94:0/1636900821 wait complete. 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efda2532000 20 client.6528 trim_cache size 0 max 16384 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6381, 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:19:17.709 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:19:17.710 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:19:17.710 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 10.173349499, 2024-09-11T23:19:17.710 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 49, 2024-09-11T23:19:17.710 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 86, 2024-09-11T23:19:17.710 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:19:17.710 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 14.505181323 2024-09-11T23:19:17.710 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd7c0678f0 msgr2=0x7efd7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd7c0678f0 0x7efd7c069db0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd98072f30 tx=0x7efd88009040 comp rx=0 tx=0).stop 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 msgr2=0x7efd98099ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd98099ab0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efd94009ac0 tx=0x7efd940197f0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 shutdown_connections 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd981f3b00 0x7efd980731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981f4780 0x7efd981f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd7c0678f0 0x7efd7c069db0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 --2- 172.21.15.94:0/1914640851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd84003ab0 0x7efd98099ab0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 >> 172.21.15.94:0/1914640851 conn(0x7efd980b1f90 msgr2=0x7efd9815bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 shutdown_connections 2024-09-11T23:19:17.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.701+0000 7efd9f476640 1 -- 172.21.15.94:0/1914640851 wait complete. 2024-09-11T23:19:17.719 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:19:17.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f9785fd1640 1 Processor -- start 2024-09-11T23:19:18.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f9785fd1640 1 -- start start 2024-09-11T23:19:18.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f9785fd1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97800b2630 0x7f978015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f9785fd1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f97800b2a10 0x7f978015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f9785fd1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978013f7f0 con 0x7f97800cf060 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f9785fd1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9780072160 con 0x7f97800b2630 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f9785fd1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f978015d420 con 0x7f97800b2a10 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97800b2630 0x7f978015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97800b2630 0x7f978015c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59552/0 (socket says 172.21.15.94:59552) 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977f7fe640 1 -- 172.21.15.94:0/2179896461 learned_addr learned my addr 172.21.15.94:0/2179896461 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977effd640 1 --2- 172.21.15.94:0/2179896461 >> v2:172.21.15.155:3300/0 conn(0x7f97800b2a10 0x7f978015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977f7fe640 1 -- 172.21.15.94:0/2179896461 >> v2:172.21.15.155:3300/0 conn(0x7f97800b2a10 msgr2=0x7f978015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977f7fe640 1 --2- 172.21.15.94:0/2179896461 >> v2:172.21.15.155:3300/0 conn(0x7f97800b2a10 0x7f978015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977f7fe640 1 -- 172.21.15.94:0/2179896461 >> v1:172.21.15.155:6789/0 conn(0x7f97800cf060 legacy=0x7f97800cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977f7fe640 1 -- 172.21.15.94:0/2179896461 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800723b0 con 0x7f97800b2630 2024-09-11T23:19:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.829+0000 7f977effd640 1 --2- 172.21.15.94:0/2179896461 >> v2:172.21.15.155:3300/0 conn(0x7f97800b2a10 0x7f978015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977f7fe640 1 --2- 172.21.15.94:0/2179896461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f978015c9a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f978006e210 tx=0x7f977001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ecf13abdf1557d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977e7fc640 1 -- 172.21.15.94:0/2179896461 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b0070 con 0x7f97800b2630 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977e7fc640 1 -- 172.21.15.94:0/2179896461 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700ab600 con 0x7f97800b2630 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977e7fc640 1 -- 172.21.15.94:0/2179896461 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700ab9d0 con 0x7f97800b2630 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- 172.21.15.94:0/2179896461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 msgr2=0x7f978015c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2179896461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f978015c9a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f978006e210 tx=0x7f977001c300 comp rx=0 tx=0).stop 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- 172.21.15.94:0/2179896461 shutdown_connections 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2179896461 >> v2:172.21.15.155:3300/0 conn(0x7f97800b2a10 0x7f978015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2179896461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f978015c9a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- 172.21.15.94:0/2179896461 >> 172.21.15.94:0/2179896461 conn(0x7f97800d07f0 msgr2=0x7f97800d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- 172.21.15.94:0/2179896461 shutdown_connections 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- 172.21.15.94:0/2179896461 wait complete. 2024-09-11T23:19:18.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 Processor -- start 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- start start 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f97801562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97800b2a10 0x7f9780165350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800cf060 0x7f9780165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9780168f20 con 0x7f97800b2630 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9780168da0 con 0x7f97800b2a10 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f9785fd1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97801690a0 con 0x7f97800cf060 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f97801562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f97801562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59564/0 (socket says 172.21.15.94:59564) 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977f7fe640 1 -- 172.21.15.94:0/2645884008 learned_addr learned my addr 172.21.15.94:0/2645884008 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:18.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.833+0000 7f977f7fe640 1 -- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800cf060 msgr2=0x7f9780165890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977f7fe640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800cf060 0x7f9780165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977f7fe640 1 -- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97800b2a10 msgr2=0x7f9780165350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977effd640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97800b2a10 0x7f9780165350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977f7fe640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97800b2a10 0x7f9780165350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977f7fe640 1 -- 172.21.15.94:0/2645884008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800757a0 con 0x7f97800b2630 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977f7fe640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f97801562e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f97700ae040 tx=0x7f977001ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9767fff640 1 -- 172.21.15.94:0/2645884008 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b0040 con 0x7f97800b2630 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9767fff640 1 -- 172.21.15.94:0/2645884008 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700bc070 con 0x7f97800b2630 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9780161880 con 0x7f97800b2630 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9767fff640 1 -- 172.21.15.94:0/2645884008 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b6880 con 0x7f97800b2630 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9780161e00 con 0x7f97800b2630 2024-09-11T23:19:18.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97800cf4d0 con 0x7f97800b2630 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9767fff640 1 -- 172.21.15.94:0/2645884008 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97700b6a20 con 0x7f97800b2630 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9767fff640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f976c0678c0 0x7f976c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f9767fff640 1 -- 172.21.15.94:0/2645884008 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f97701202e0 con 0x7f97800b2630 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977effd640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f976c0678c0 0x7f976c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.837+0000 7f977effd640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f976c0678c0 0x7f976c069d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9774006fd0 tx=0x7f9774008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:17.841+0000 7f9767fff640 1 -- 172.21.15.94:0/2645884008 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f978013f7f0 con 0x7f97800b2630 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.033+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f978015da50 con 0x7f97800b2630 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.033+0000 7f9767fff640 1 -- 172.21.15.94:0/2645884008 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) ==== 53+0+73 (secure 0 0 0) 0x7f97700f0d20 con 0x7f97800b2630 2024-09-11T23:19:18.208 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:19:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.033+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f976c0678c0 msgr2=0x7f976c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.033+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f976c0678c0 0x7f976c069d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9774006fd0 tx=0x7f9774008040 comp rx=0 tx=0).stop 2024-09-11T23:19:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.033+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 msgr2=0x7f97801562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.033+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f97801562e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f97700ae040 tx=0x7f977001ab40 comp rx=0 tx=0).stop 2024-09-11T23:19:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 shutdown_connections 2024-09-11T23:19:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800cf060 0x7f9780165890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97800b2a10 0x7f9780165350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f976c0678c0 0x7f976c069d80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 --2- 172.21.15.94:0/2645884008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97800b2630 0x7f97801562e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 >> 172.21.15.94:0/2645884008 conn(0x7f97800d07f0 msgr2=0x7f97801414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:18.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 shutdown_connections 2024-09-11T23:19:18.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18.037+0000 7f9785fd1640 1 -- 172.21.15.94:0/2645884008 wait complete. 2024-09-11T23:19:18.211 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:19:18.211 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:19:18.211 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:19:18.211 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:19:18.211 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:18.212 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:19:18.212 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:19:18.212 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:19:18.212 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:18.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:18.212 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:19:18.219 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:19:18.219 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:19:18.219 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:19:18.219 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.219 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:19:18.219 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42230sec preferred_lft 42230sec 2024-09-11T23:19:18.220 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:19:18.222 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.222 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:18.222 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:18.222 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:19:18.222 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:18.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:18.222 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:19:18.274 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:19:18.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:18.276 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:19:18.334 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:19:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:19:18.336 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:19:18.336 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:19:18.336 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:19:18.336 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:19:18.336 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:19:18.336 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:19:18.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:19:18.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:18.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:18.461 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:19:18.467 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:19:18.467 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:19:18.467 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:18.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:18.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:19:18.520 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:19:18.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:18.520 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:18.569 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:18.569 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:18.570 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:18.616 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:19:18.674 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:19:18.723 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:19:18.724 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:19:18.725 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:19:18.725 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:19:18.725 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:19:18.725 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:18.725 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:18.725 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:18.725 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:18.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:18.726 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:19:18.773 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:19:18.773 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:19:18.818 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:19:18.833 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:19:18.885 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:19:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:18.887 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:18.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:18.888 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:19:18.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:19:18.897+0000 7fb527953580 -1 init, newargv = 0x5647fc1dcd60 newargc=15 2024-09-11T23:19:18.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[43873]: starting ceph client 2024-09-11T23:19:18.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[43873]: starting fuse 2024-09-11T23:19:20.005 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:19:20.021 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:19:20.070 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:19:20.071 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:20.072 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:20.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.073 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:19:20.125 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:19:20.125 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:19:20.126 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:19:20.127 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:19:20.249 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.43873.asok 2024-09-11T23:19:20.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:20.261 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43873.asok 2024-09-11T23:19:20.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43873.asok status 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "43873", 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6543, 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 6543 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:19:20.415 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:19:20.415 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 4273961249 2024-09-11T23:19:20.415 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:20.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 4273961249 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.6543 192.168.0.1:0/4273961249", 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/4273961249", 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 49, 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 86, 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:19:20.416 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:19:20.417 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:20.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.427 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:19:20.427 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:20.434 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:19:20.434 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:20.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.434 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:20.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.488 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch fancy_layout_file) 2024-09-11T23:19:20.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.551 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout -v 'stripe_unit=1048576 stripe_count=4 object_size=8388608' fancy_layout_file) 2024-09-11T23:19:20.608 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:19:20.608 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:20.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.657 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=fancy_layout_file bs=1M conv=fdatasync count=35 seek=0) 2024-09-11T23:19:20.980 INFO:teuthology.orchestra.run.smithi094.stderr:35+0 records in 2024-09-11T23:19:20.981 INFO:teuthology.orchestra.run.smithi094.stderr:35+0 records out 2024-09-11T23:19:20.981 INFO:teuthology.orchestra.run.smithi094.stderr:36700160 bytes (37 MB, 35 MiB) copied, 0.266955 s, 137 MB/s 2024-09-11T23:19:20.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:20.982 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f fancy_layout_file) 2024-09-11T23:19:20.995 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:21.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.165+0000 7fa3e2715640 1 Processor -- start 2024-09-11T23:19:21.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.165+0000 7fa3e2715640 1 -- start start 2024-09-11T23:19:21.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3e2715640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3dc070020 0x7fa3dc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3e2715640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3e2715640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc0aede0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3e2715640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa3dc152480 con 0x7fa3dc070020 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3e2715640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc15fa10 con 0x7fa3dc15f1d0 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3dc070020 0x7fa3dc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3dc070020 0x7fa3dc15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33164/0 (socket says 172.21.15.94:33164) 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 -- 172.21.15.94:0/3625440605 learned_addr learned my addr 172.21.15.94:0/3625440605 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3e0cb2640 1 --2- 172.21.15.94:0/3625440605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 -- 172.21.15.94:0/3625440605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 msgr2=0x7fa3dc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 --2- 172.21.15.94:0/3625440605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 -- 172.21.15.94:0/3625440605 >> v1:172.21.15.155:6789/0 conn(0x7fa3dc1520a0 legacy=0x7fa3dc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 -- 172.21.15.94:0/3625440605 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc074250 con 0x7fa3dc070020 2024-09-11T23:19:21.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3e0cb2640 1 --2- 172.21.15.94:0/3625440605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:21.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3db7fe640 1 --2- 172.21.15.94:0/3625440605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc070020 0x7fa3dc15ec90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009870 tx=0x7fa3cc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16c9374d8db4899 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3daffd640 1 -- 172.21.15.94:0/3625440605 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0a95f0 con 0x7fa3dc070020 2024-09-11T23:19:21.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3daffd640 1 -- 172.21.15.94:0/3625440605 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3cc0a9790 con 0x7fa3dc070020 2024-09-11T23:19:21.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.169+0000 7fa3daffd640 1 -- 172.21.15.94:0/3625440605 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0a9b60 con 0x7fa3dc070020 2024-09-11T23:19:21.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- 172.21.15.94:0/3625440605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc070020 msgr2=0x7fa3dc15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 --2- 172.21.15.94:0/3625440605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc070020 0x7fa3dc15ec90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009870 tx=0x7fa3cc01c530 comp rx=0 tx=0).stop 2024-09-11T23:19:21.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- 172.21.15.94:0/3625440605 shutdown_connections 2024-09-11T23:19:21.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 --2- 172.21.15.94:0/3625440605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 --2- 172.21.15.94:0/3625440605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc070020 0x7fa3dc15ec90 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- 172.21.15.94:0/3625440605 >> 172.21.15.94:0/3625440605 conn(0x7fa3dc0b1f90 msgr2=0x7fa3dc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- 172.21.15.94:0/3625440605 shutdown_connections 2024-09-11T23:19:21.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- 172.21.15.94:0/3625440605 wait complete. 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 Processor -- start 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- start start 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3dc070020 0x7fa3dc0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc1520a0 0x7fa3dc0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc1476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc15f5e0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc073d30 con 0x7fa3dc070020 2024-09-11T23:19:21.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc15f760 con 0x7fa3dc15f1d0 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc1520a0 0x7fa3dc0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc1520a0 0x7fa3dc0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33172/0 (socket says 172.21.15.94:33172) 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 -- 172.21.15.94:0/2996037366 learned_addr learned my addr 172.21.15.94:0/2996037366 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3dc070020 0x7fa3dc0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e0cb2640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc1476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 -- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 msgr2=0x7fa3dc1476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc1476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 -- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3dc070020 msgr2=0x7fa3dc0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3dc070020 0x7fa3dc0cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 -- 172.21.15.94:0/2996037366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc0d0cc0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3dc070020 0x7fa3dc0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3db7fe640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc1520a0 0x7fa3dc0ccf10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc01abe0 tx=0x7fa3cc0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3d8ff9640 1 -- 172.21.15.94:0/2996037366 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0b1800 con 0x7fa3dc1520a0 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3d8ff9640 1 -- 172.21.15.94:0/2996037366 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3cc0b19a0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3d8ff9640 1 -- 172.21.15.94:0/2996037366 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0b1d70 con 0x7fa3dc1520a0 2024-09-11T23:19:21.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc151cd0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.173+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3dc14ce50 con 0x7fa3dc1520a0 2024-09-11T23:19:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.177+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3dc151ae0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.177+0000 7fa3d8ff9640 1 -- 172.21.15.94:0/2996037366 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3cc0b83d0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.177+0000 7fa3d8ff9640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3c80678c0 0x7fa3c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.177+0000 7fa3d8ff9640 1 -- 172.21.15.94:0/2996037366 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa3cc11fff0 con 0x7fa3dc1520a0 2024-09-11T23:19:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.177+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3c80678c0 0x7fa3c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.177+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3c80678c0 0x7fa3c8069d80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00016f0 tx=0x7fa3d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.181+0000 7fa3d8ff9640 1 -- 172.21.15.94:0/2996037366 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3cc0be030 con 0x7fa3dc1520a0 2024-09-11T23:19:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.377+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3dc15ec90 con 0x7fa3dc1520a0 2024-09-11T23:19:21.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3d8ff9640 1 -- 172.21.15.94:0/2996037366 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7fa3cc0ad020 con 0x7fa3dc1520a0 2024-09-11T23:19:21.381 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:21.381 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:06.902722+0000","modified":"2024-09-11T23:19:09.918807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/3079112947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3079112947},{"type":"v1","addr":"172.21.15.155:6836","nonce":3079112947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":6}]} 2024-09-11T23:19:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 49 2024-09-11T23:19:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3c80678c0 msgr2=0x7fa3c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3c80678c0 0x7fa3c8069d80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00016f0 tx=0x7fa3d0009040 comp rx=0 tx=0).stop 2024-09-11T23:19:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc1520a0 msgr2=0x7fa3dc0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc1520a0 0x7fa3dc0ccf10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc01abe0 tx=0x7fa3cc0192d0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 shutdown_connections 2024-09-11T23:19:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3dc15f1d0 0x7fa3dc1476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa3c80678c0 0x7fa3c8069d80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3dc1520a0 0x7fa3dc0ccf10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 --2- 172.21.15.94:0/2996037366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3dc070020 0x7fa3dc0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 >> 172.21.15.94:0/2996037366 conn(0x7fa3dc0b1f90 msgr2=0x7fa3dc06ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 shutdown_connections 2024-09-11T23:19:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.381+0000 7fa3e2715640 1 -- 172.21.15.94:0/2996037366 wait complete. 2024-09-11T23:19:21.400 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-11T23:19:21.565 INFO:teuthology.orchestra.run.smithi155.stdout:{"message":"","return_code":0} 2024-09-11T23:19:21.566 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T23:19:21.566 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-11T23:19:21.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 Processor -- start 2024-09-11T23:19:21.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 -- start start 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c841520a0 0x7f8c8406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c8406fe50 0x7f8c8415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c8415f1d0 0x7f8c84071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8c84152480 con 0x7f8c841520a0 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8c84070250 con 0x7f8c8415f1d0 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.693+0000 7f8c8a857640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c840aede0 con 0x7f8c8406fe50 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c841520a0 0x7f8c8406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c841520a0 0x7f8c8406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33180/0 (socket says 172.21.15.94:33180) 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 -- 172.21.15.94:0/1834838222 learned_addr learned my addr 172.21.15.94:0/1834838222 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c88df4640 1 --2- 172.21.15.94:0/1834838222 >> v2:172.21.15.155:3300/0 conn(0x7f8c8415f1d0 0x7f8c84071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c7b7fe640 1 --2- 172.21.15.94:0/1834838222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c8406fe50 0x7f8c8415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 -- 172.21.15.94:0/1834838222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c8406fe50 msgr2=0x7f8c8415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:21.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 --2- 172.21.15.94:0/1834838222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c8406fe50 0x7f8c8415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 -- 172.21.15.94:0/1834838222 >> v2:172.21.15.155:3300/0 conn(0x7f8c8415f1d0 msgr2=0x7f8c84071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:21.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 --2- 172.21.15.94:0/1834838222 >> v2:172.21.15.155:3300/0 conn(0x7f8c8415f1d0 0x7f8c84071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 -- 172.21.15.94:0/1834838222 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8415fa10 con 0x7f8c841520a0 2024-09-11T23:19:21.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c7b7fe640 1 --2- 172.21.15.94:0/1834838222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c8406fe50 0x7f8c8415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:21.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c88df4640 1 --2- 172.21.15.94:0/1834838222 >> v2:172.21.15.155:3300/0 conn(0x7f8c8415f1d0 0x7f8c84071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:21.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c83fff640 1 --2- 172.21.15.94:0/1834838222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c841520a0 0x7f8c8406f910 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8c8406e250 tx=0x7f8c7401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beac32403b8058eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c837fe640 1 -- 172.21.15.94:0/1834838222 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c740b0070 con 0x7f8c841520a0 2024-09-11T23:19:21.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c837fe640 1 -- 172.21.15.94:0/1834838222 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c740ab600 con 0x7f8c841520a0 2024-09-11T23:19:21.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c837fe640 1 -- 172.21.15.94:0/1834838222 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c740ab9d0 con 0x7f8c841520a0 2024-09-11T23:19:21.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 -- 172.21.15.94:0/1834838222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c841520a0 msgr2=0x7f8c8406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 --2- 172.21.15.94:0/1834838222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c841520a0 0x7f8c8406f910 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8c8406e250 tx=0x7f8c7401c240 comp rx=0 tx=0).stop 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 -- 172.21.15.94:0/1834838222 shutdown_connections 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 --2- 172.21.15.94:0/1834838222 >> v2:172.21.15.155:3300/0 conn(0x7f8c8415f1d0 0x7f8c84071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 --2- 172.21.15.94:0/1834838222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c8406fe50 0x7f8c8415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 --2- 172.21.15.94:0/1834838222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c841520a0 0x7f8c8406f910 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 -- 172.21.15.94:0/1834838222 >> 172.21.15.94:0/1834838222 conn(0x7f8c840b1f90 msgr2=0x7f8c840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 -- 172.21.15.94:0/1834838222 shutdown_connections 2024-09-11T23:19:21.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.697+0000 7f8c8a857640 1 -- 172.21.15.94:0/1834838222 wait complete. 2024-09-11T23:19:21.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 Processor -- start 2024-09-11T23:19:21.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 -- start start 2024-09-11T23:19:21.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8406fe50 0x7f8c84149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c841520a0 0x7f8c841f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c8415f1d0 0x7f8c840ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84073d30 con 0x7f8c8406fe50 2024-09-11T23:19:21.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84073a50 con 0x7f8c8415f1d0 2024-09-11T23:19:21.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8415f5e0 con 0x7f8c841520a0 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8406fe50 0x7f8c84149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8406fe50 0x7f8c84149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33192/0 (socket says 172.21.15.94:33192) 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 -- 172.21.15.94:0/2907732979 learned_addr learned my addr 172.21.15.94:0/2907732979 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c88df4640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c8415f1d0 0x7f8c840ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 -- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c841520a0 msgr2=0x7f8c841f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c7b7fe640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c841520a0 0x7f8c841f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c841520a0 0x7f8c841f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 -- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c8415f1d0 msgr2=0x7f8c840ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c8415f1d0 0x7f8c840ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 -- 172.21.15.94:0/2907732979 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8414e410 con 0x7f8c8406fe50 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c88df4640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c8415f1d0 0x7f8c840ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:21.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c83fff640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8406fe50 0x7f8c84149ba0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401a8f0 tx=0x7f8c74018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c817fa640 1 -- 172.21.15.94:0/2907732979 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c740b9070 con 0x7f8c8406fe50 2024-09-11T23:19:21.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c817fa640 1 -- 172.21.15.94:0/2907732979 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c740b4600 con 0x7f8c8406fe50 2024-09-11T23:19:21.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8414de10 con 0x7f8c8406fe50 2024-09-11T23:19:21.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c817fa640 1 -- 172.21.15.94:0/2907732979 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c740b0040 con 0x7f8c8406fe50 2024-09-11T23:19:21.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8414e6d0 con 0x7f8c8406fe50 2024-09-11T23:19:21.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.701+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8406f910 con 0x7f8c8406fe50 2024-09-11T23:19:21.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.705+0000 7f8c817fa640 1 -- 172.21.15.94:0/2907732979 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c740bc070 con 0x7f8c8406fe50 2024-09-11T23:19:21.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.705+0000 7f8c817fa640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c640678f0 0x7f8c64069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.705+0000 7f8c817fa640 1 -- 172.21.15.94:0/2907732979 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f8c7411eef0 con 0x7f8c8406fe50 2024-09-11T23:19:21.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.705+0000 7f8c7b7fe640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c640678f0 0x7f8c64069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.705+0000 7f8c7b7fe640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c640678f0 0x7f8c64069db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c006fd0 tx=0x7f8c6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.709+0000 7f8c817fa640 1 -- 172.21.15.94:0/2907732979 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c740160f0 con 0x7f8c8406fe50 2024-09-11T23:19:21.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.929+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7f8c8406e540 con 0x7f8c8406fe50 2024-09-11T23:19:21.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.929+0000 7f8c817fa640 1 -- 172.21.15.94:0/2907732979 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1652 (secure 0 0 0) 0x7f8c740ef8a0 con 0x7f8c8406fe50 2024-09-11T23:19:21.931 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:21.931 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:21.931 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:19:21.931 INFO:teuthology.orchestra.run.smithi094.stdout: "total_bytes": 773094113280, 2024-09-11T23:19:21.931 INFO:teuthology.orchestra.run.smithi094.stdout: "total_avail_bytes": 772807540736, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_bytes": 286572544, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_bytes": 286572544, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_ratio": 0.00037068262463435531, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "num_osds": 8, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "num_per_pool_osds": 8, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "num_per_pool_omap_osds": 8 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "stats_by_class": { 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "ssd": { 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "total_bytes": 773094113280, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "total_avail_bytes": 772807540736, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_bytes": 286572544, 2024-09-11T23:19:21.932 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_bytes": 286572544, 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "total_used_raw_ratio": 0.00037068262463435531 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "pools": [ 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "name": ".mgr", 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 1, 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "stored": 590368, 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "objects": 2, 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "kb_used": 1160, 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "bytes_used": 1187840, 2024-09-11T23:19:21.933 INFO:teuthology.orchestra.run.smithi094.stdout: "percent_used": 1.618071678421984e-06, 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "max_avail": 367053602816 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cephfs_metadata", 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 13, 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "stored": 2410, 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "objects": 22, 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "kb_used": 64, 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "bytes_used": 65536, 2024-09-11T23:19:21.934 INFO:teuthology.orchestra.run.smithi094.stdout: "percent_used": 8.9273058279104589e-08, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "max_avail": 367053602816 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cephfs_data", 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 14, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "stats": { 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "stored": 0, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "objects": 0, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "kb_used": 0, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "bytes_used": 0, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "percent_used": 0, 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: "max_avail": 367053602816 2024-09-11T23:19:21.935 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:21.936 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:21.936 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:19:21.936 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c640678f0 msgr2=0x7f8c64069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c640678f0 0x7f8c64069db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c006fd0 tx=0x7f8c6c008040 comp rx=0 tx=0).stop 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8406fe50 msgr2=0x7f8c84149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8406fe50 0x7f8c84149ba0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401a8f0 tx=0x7f8c74018fe0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 shutdown_connections 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c8415f1d0 0x7f8c840ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c841520a0 0x7f8c841f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8c640678f0 0x7f8c64069db0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 --2- 172.21.15.94:0/2907732979 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c8406fe50 0x7f8c84149ba0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 >> 172.21.15.94:0/2907732979 conn(0x7f8c840b1f90 msgr2=0x7f8c8415da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 shutdown_connections 2024-09-11T23:19:21.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:21.933+0000 7f8c8a857640 1 -- 172.21.15.94:0/2907732979 wait complete. 2024-09-11T23:19:21.950 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-11T23:19:21.950 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:19:21.950 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:21.994 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:22.044 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:19:22.044 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:22.045 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:19:22.045 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:22.051 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:19:22.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8e56d640 1 Processor -- start 2024-09-11T23:19:22.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8e56d640 1 -- start start 2024-09-11T23:19:22.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8e56d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee8815ffe0 0x7fee8806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8e56d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8815f180 con 0x7fee8806dc40 2024-09-11T23:19:22.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8e56d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8815f460 con 0x7fee880b5cf0 2024-09-11T23:19:22.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8e56d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fee8806d440 con 0x7fee8815ffe0 2024-09-11T23:19:22.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee877fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fee8806dc40 0x7fee8815f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52026/0 (socket says 172.21.15.94:52026) 2024-09-11T23:19:22.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee877fe640 1 -- 172.21.15.94:0/3253487624 learned_addr learned my addr 172.21.15.94:0/3253487624 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:22.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/3253487624 >> v2:172.21.15.155:3300/0 conn(0x7fee8815ffe0 0x7fee8806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065482558 0 0) 0x7fee8815f180 con 0x7fee8806dc40 2024-09-11T23:19:22.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee70003530 con 0x7fee8806dc40 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4010103513 0 0) 0x7fee70003530 con 0x7fee8806dc40 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 >> v2:172.21.15.155:3300/0 conn(0x7fee8815ffe0 msgr2=0x7fee8806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 --2- 172.21.15.94:0/3253487624 >> v2:172.21.15.155:3300/0 conn(0x7fee8815ffe0 0x7fee8806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 >> v1:172.21.15.155:6789/0 conn(0x7fee880b5cf0 legacy=0x7fee8815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8815ee80 con 0x7fee8806dc40 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fee7c001680 con 0x7fee8806dc40 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 >> v1:172.21.15.94:6789/0 conn(0x7fee8806dc40 legacy=0x7fee8815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee700039c0 0x7fee70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee70004810 0x7fee70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee700051d0 0x7fee7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fee8806d440 con 0x7fee700051d0 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee7000c170 con 0x7fee70004810 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee7000c370 con 0x7fee700039c0 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee700051d0 0x7fee7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee87fff640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee700039c0 0x7fee70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee877fe640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee70004810 0x7fee70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8cb0a640 1 -- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee700039c0 msgr2=0x7fee70003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee700039c0 0x7fee70003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8cb0a640 1 -- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee70004810 msgr2=0x7fee70004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee70004810 0x7fee70004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.221+0000 7fee8cb0a640 1 -- 172.21.15.94:0/3253487624 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee70003530 con 0x7fee700051d0 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8cb0a640 1 -- 172.21.15.94:0/3253487624 reap_dead start 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee700051d0 0x7fee7000b9d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fee80009fc0 tx=0x7fee8001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1acadf9b8f4c0a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80009c10 con 0x7fee700051d0 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee800a5bc0 con 0x7fee700051d0 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee86ffd640 1 -- 172.21.15.94:0/3253487624 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee800039a0 con 0x7fee700051d0 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 -- 172.21.15.94:0/3253487624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee700051d0 msgr2=0x7fee7000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee700051d0 0x7fee7000b9d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fee80009fc0 tx=0x7fee8001ccc0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 -- 172.21.15.94:0/3253487624 shutdown_connections 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 --2- 172.21.15.94:0/3253487624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee700051d0 0x7fee7000b9d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 -- 172.21.15.94:0/3253487624 >> 172.21.15.94:0/3253487624 conn(0x7fee8806c0c0 msgr2=0x7fee8806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:22.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 -- 172.21.15.94:0/3253487624 shutdown_connections 2024-09-11T23:19:22.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 -- 172.21.15.94:0/3253487624 wait complete. 2024-09-11T23:19:22.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 Processor -- start 2024-09-11T23:19:22.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.225+0000 7fee8e56d640 1 -- start start 2024-09-11T23:19:22.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee700051d0 0x7fee88151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8814dcb0 0x7fee881575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee8815d550 0x7fee8815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fee88072870 con 0x7fee8815d550 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee880726f0 con 0x7fee700051d0 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee8806e0b0 con 0x7fee8814dcb0 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee8815d550 0x7fee8815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee8815d550 0x7fee8815d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33204/0 (socket says 172.21.15.94:33204) 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 -- 172.21.15.94:0/2840711253 learned_addr learned my addr 172.21.15.94:0/2840711253 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee87fff640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee700051d0 0x7fee88151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee877fe640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8814dcb0 0x7fee881575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 -- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8814dcb0 msgr2=0x7fee881575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8814dcb0 0x7fee881575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 -- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee700051d0 msgr2=0x7fee88151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee700051d0 0x7fee88151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 -- 172.21.15.94:0/2840711253 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee88157e10 con 0x7fee8815d550 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee877fe640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8814dcb0 0x7fee881575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8cb0a640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee8815d550 0x7fee8815d9d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fee800986e0 tx=0x7fee80009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee84ff9640 1 -- 172.21.15.94:0/2840711253 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee800aed70 con 0x7fee8815d550 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee84ff9640 1 -- 172.21.15.94:0/2840711253 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee800bd070 con 0x7fee8815d550 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8814e6e0 con 0x7fee8815d550 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee84ff9640 1 -- 172.21.15.94:0/2840711253 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80003ba0 con 0x7fee8815d550 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee88157ae0 con 0x7fee8815d550 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8806e3e0 con 0x7fee8815d550 2024-09-11T23:19:22.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee84ff9640 1 -- 172.21.15.94:0/2840711253 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee80004030 con 0x7fee8815d550 2024-09-11T23:19:22.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee84ff9640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fee740678f0 0x7fee74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee84ff9640 1 -- 172.21.15.94:0/2840711253 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fee801219a0 con 0x7fee8815d550 2024-09-11T23:19:22.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.229+0000 7fee87fff640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fee740678f0 0x7fee74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.233+0000 7fee87fff640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fee740678f0 0x7fee74069db0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fee78000c10 tx=0x7fee78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.237+0000 7fee84ff9640 1 -- 172.21.15.94:0/2840711253 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fee800169d0 con 0x7fee8815d550 2024-09-11T23:19:22.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.409+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee88069170 con 0x7fee8815d550 2024-09-11T23:19:22.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee84ff9640 1 -- 172.21.15.94:0/2840711253 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7fee800f2350 con 0x7fee8815d550 2024-09-11T23:19:22.412 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fee740678f0 msgr2=0x7fee74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fee740678f0 0x7fee74069db0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fee78000c10 tx=0x7fee78009040 comp rx=0 tx=0).stop 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee8815d550 msgr2=0x7fee8815d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee8815d550 0x7fee8815d9d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fee800986e0 tx=0x7fee80009750 comp rx=0 tx=0).stop 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 shutdown_connections 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fee740678f0 0x7fee74069db0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee8815d550 0x7fee8815d9d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8814dcb0 0x7fee881575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 --2- 172.21.15.94:0/2840711253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee700051d0 0x7fee88151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 >> 172.21.15.94:0/2840711253 conn(0x7fee8806c0c0 msgr2=0x7fee88074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 shutdown_connections 2024-09-11T23:19:22.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.413+0000 7fee8e56d640 1 -- 172.21.15.94:0/2840711253 wait complete. 2024-09-11T23:19:22.431 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:19:22.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:22.431 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:22.443 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[43873]: fuse finished with error 0 and tester_r 0 2024-09-11T23:19:22.444 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:19:22.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:22.445 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:19:22.536 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:22.537 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:19:22.537 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:22.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:22.543 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:19:22.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:22.544 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:19:22.592 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T23:19:22.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:19:22.593 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:22.593 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:19:22.593 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:22.599 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:22.599 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:19:22.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:22.599 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:19:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T23:19:22.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:19:22.645 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:22.645 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:19:22.645 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:22.651 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:22.651 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:19:22.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:22.651 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:19:22.699 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T23:19:22.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:19:22.700 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:22.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac7e33640 1 Processor -- start 2024-09-11T23:19:22.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac7e33640 1 -- start start 2024-09-11T23:19:22.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac7e33640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ac006f010 0x7f8ac0166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac7e33640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac00b3290 con 0x7f8ac015bec0 2024-09-11T23:19:22.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac7e33640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac00b3570 con 0x7f8ac015c2a0 2024-09-11T23:19:22.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac7e33640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac00b3850 con 0x7f8ac006f010 2024-09-11T23:19:22.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac5bcf640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8ac015bec0 0x7f8ac00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52042/0 (socket says 172.21.15.94:52042) 2024-09-11T23:19:22.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac5bcf640 1 -- 172.21.15.94:0/2456511574 learned_addr learned my addr 172.21.15.94:0/2456511574 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac63d0640 1 --2- 172.21.15.94:0/2456511574 >> v2:172.21.15.155:3300/0 conn(0x7f8ac006f010 0x7f8ac0166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684789511 0 0) 0x7f8ac00b3290 con 0x7f8ac015bec0 2024-09-11T23:19:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aac003530 con 0x7f8ac015bec0 2024-09-11T23:19:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3424801245 0 0) 0x7f8aac003530 con 0x7f8ac015bec0 2024-09-11T23:19:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 >> v2:172.21.15.155:3300/0 conn(0x7f8ac006f010 msgr2=0x7f8ac0166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 --2- 172.21.15.94:0/2456511574 >> v2:172.21.15.155:3300/0 conn(0x7f8ac006f010 0x7f8ac0166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 >> v1:172.21.15.155:6789/0 conn(0x7f8ac015c2a0 legacy=0x7f8ac00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00b3b30 con 0x7f8ac015bec0 2024-09-11T23:19:22.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f8abc001680 con 0x7f8ac015bec0 2024-09-11T23:19:22.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 >> v1:172.21.15.94:6789/0 conn(0x7f8ac015bec0 legacy=0x7f8ac00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aac0039c0 0x7f8aac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00b3850 con 0x7f8aac004810 2024-09-11T23:19:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac00c070 con 0x7f8aac0039c0 2024-09-11T23:19:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac00c270 con 0x7f8aac0051d0 2024-09-11T23:19:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac5bcf640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aac0039c0 0x7f8aac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac63d0640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac53ce640 1 -- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8aac0051d0 msgr2=0x7f8aac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac53ce640 1 -- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aac0039c0 msgr2=0x7f8aac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aac0039c0 0x7f8aac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac63d0640 1 -- 172.21.15.94:0/2456511574 reap_dead start 2024-09-11T23:19:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.817+0000 7f8ac53ce640 1 -- 172.21.15.94:0/2456511574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac003530 con 0x7f8aac004810 2024-09-11T23:19:22.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0001750 tx=0x7f8ab001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a35c89039636d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00013a0 con 0x7f8aac004810 2024-09-11T23:19:22.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab00052f0 con 0x7f8aac004810 2024-09-11T23:19:22.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac4bcd640 1 -- 172.21.15.94:0/2456511574 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0003840 con 0x7f8aac004810 2024-09-11T23:19:22.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 -- 172.21.15.94:0/2456511574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 msgr2=0x7f8aac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0001750 tx=0x7f8ab001c3e0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 -- 172.21.15.94:0/2456511574 shutdown_connections 2024-09-11T23:19:22.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/2456511574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 -- 172.21.15.94:0/2456511574 >> 172.21.15.94:0/2456511574 conn(0x7f8ac00b1f90 msgr2=0x7f8ac00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:22.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 -- 172.21.15.94:0/2456511574 shutdown_connections 2024-09-11T23:19:22.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 -- 172.21.15.94:0/2456511574 wait complete. 2024-09-11T23:19:22.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 Processor -- start 2024-09-11T23:19:22.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.821+0000 7f8ac7e33640 1 -- start start 2024-09-11T23:19:22.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8ac015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ac015ddf0 0x7f8ac014c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ac0154660 0x7f8ac015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00afc90 con 0x7f8aac004810 2024-09-11T23:19:22.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00b40f0 con 0x7f8ac015ddf0 2024-09-11T23:19:22.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac00ad200 con 0x7f8ac0154660 2024-09-11T23:19:22.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8ac015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8ac015c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33216/0 (socket says 172.21.15.94:33216) 2024-09-11T23:19:22.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 -- 172.21.15.94:0/1700903658 learned_addr learned my addr 172.21.15.94:0/1700903658 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:22.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ac015ddf0 0x7f8ac014c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac63d0640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ac0154660 0x7f8ac015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 -- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ac0154660 msgr2=0x7f8ac015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ac0154660 0x7f8ac015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 -- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ac015ddf0 msgr2=0x7f8ac014c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ac015ddf0 0x7f8ac014c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 -- 172.21.15.94:0/1700903658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac0154b10 con 0x7f8aac004810 2024-09-11T23:19:22.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac63d0640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ac0154660 0x7f8ac015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:22.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ac015ddf0 0x7f8ac014c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:22.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac5bcf640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8ac015c6e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8abc011840 tx=0x7f8abc011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ab67fc640 1 -- 172.21.15.94:0/1700903658 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc010040 con 0x7f8aac004810 2024-09-11T23:19:22.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ab67fc640 1 -- 172.21.15.94:0/1700903658 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc01a070 con 0x7f8aac004810 2024-09-11T23:19:22.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac015cd70 con 0x7f8aac004810 2024-09-11T23:19:22.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ab67fc640 1 -- 172.21.15.94:0/1700903658 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc00fda0 con 0x7f8aac004810 2024-09-11T23:19:22.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac015d330 con 0x7f8aac004810 2024-09-11T23:19:22.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac00ad590 con 0x7f8aac004810 2024-09-11T23:19:22.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ab67fc640 1 -- 172.21.15.94:0/1700903658 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8abc01f460 con 0x7f8aac004810 2024-09-11T23:19:22.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ab67fc640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8aa40678c0 0x7f8aa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ab67fc640 1 -- 172.21.15.94:0/1700903658 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f8abc088f70 con 0x7f8aac004810 2024-09-11T23:19:22.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.825+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8aa40678c0 0x7f8aa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.829+0000 7f8ac53ce640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8aa40678c0 0x7f8aa4069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8ac015c6b0 tx=0x7f8ab00011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:22.829+0000 7f8ab67fc640 1 -- 172.21.15.94:0/1700903658 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ac0154b10 con 0x7f8aac004810 2024-09-11T23:19:23.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.025+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ac015e1d0 con 0x7f8aac004810 2024-09-11T23:19:23.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.025+0000 7f8ab67fc640 1 -- 172.21.15.94:0/1700903658 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7f8abc059920 con 0x7f8aac004810 2024-09-11T23:19:23.028 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:23.028 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:06.902722+0000","modified":"2024-09-11T23:19:09.918807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/3079112947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3079112947},{"type":"v1","addr":"172.21.15.155:6836","nonce":3079112947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":6}]} 2024-09-11T23:19:23.028 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 49 2024-09-11T23:19:23.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8aa40678c0 msgr2=0x7f8aa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8aa40678c0 0x7f8aa4069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8ac015c6b0 tx=0x7f8ab00011a0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 msgr2=0x7f8ac015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8ac015c6e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8abc011840 tx=0x7f8abc011d00 comp rx=0 tx=0).stop 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 shutdown_connections 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ac0154660 0x7f8ac015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ac015ddf0 0x7f8ac014c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f8aa40678c0 0x7f8aa4069d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 --2- 172.21.15.94:0/1700903658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8aac004810 0x7f8ac015c6e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 >> 172.21.15.94:0/1700903658 conn(0x7f8ac00b1f90 msgr2=0x7f8ac014e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 shutdown_connections 2024-09-11T23:19:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.029+0000 7f8ac7e33640 1 -- 172.21.15.94:0/1700903658 wait complete. 2024-09-11T23:19:23.047 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:23.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81cfc4640 1 Processor -- start 2024-09-11T23:19:23.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81cfc4640 1 -- start start 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81cfc4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff818161a60 0x7ff8180d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81cfc4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8180d2e90 0x7ff8180cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81cfc4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8180d32b0 con 0x7ff8180cf450 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81cfc4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff8180d0300 con 0x7ff8180d2e90 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81cfc4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff81806e6c0 con 0x7ff818161a60 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff815d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8180d2e90 0x7ff8180cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff815d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8180d2e90 0x7ff8180cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33228/0 (socket says 172.21.15.94:33228) 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff815d9b640 1 -- 172.21.15.94:0/1291023854 learned_addr learned my addr 172.21.15.94:0/1291023854 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff81659c640 1 --2- 172.21.15.94:0/1291023854 >> v2:172.21.15.155:3300/0 conn(0x7ff818161a60 0x7ff8180d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff815d9b640 1 -- 172.21.15.94:0/1291023854 >> v2:172.21.15.155:3300/0 conn(0x7ff818161a60 msgr2=0x7ff8180d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:23.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff815d9b640 1 --2- 172.21.15.94:0/1291023854 >> v2:172.21.15.155:3300/0 conn(0x7ff818161a60 0x7ff8180d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff815d9b640 1 -- 172.21.15.94:0/1291023854 >> v1:172.21.15.155:6789/0 conn(0x7ff8180cf450 legacy=0x7ff8180d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:23.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.169+0000 7ff815d9b640 1 -- 172.21.15.94:0/1291023854 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8180b0f60 con 0x7ff8180d2e90 2024-09-11T23:19:23.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 --2- 172.21.15.94:0/1291023854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180cef10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff81808e010 tx=0x7ff80c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af245afa3b12fb1b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81559a640 1 -- 172.21.15.94:0/1291023854 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8180d1930 con 0x7ff8180d2e90 2024-09-11T23:19:23.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81559a640 1 -- 172.21.15.94:0/1291023854 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c0b0070 con 0x7ff8180d2e90 2024-09-11T23:19:23.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81559a640 1 -- 172.21.15.94:0/1291023854 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0ab840 con 0x7ff8180d2e90 2024-09-11T23:19:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1291023854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 msgr2=0x7ff8180cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1291023854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180cef10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff81808e010 tx=0x7ff80c01c420 comp rx=0 tx=0).stop 2024-09-11T23:19:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1291023854 shutdown_connections 2024-09-11T23:19:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1291023854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180cef10 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1291023854 >> v2:172.21.15.155:3300/0 conn(0x7ff818161a60 0x7ff8180d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1291023854 >> 172.21.15.94:0/1291023854 conn(0x7ff81808bf90 msgr2=0x7ff81809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1291023854 shutdown_connections 2024-09-11T23:19:23.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1291023854 wait complete. 2024-09-11T23:19:23.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 Processor -- start 2024-09-11T23:19:23.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- start start 2024-09-11T23:19:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8180cf450 0x7ff81815d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff818161a60 0x7ff8181f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180cf8c0 con 0x7ff8180d2e90 2024-09-11T23:19:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff81806d190 con 0x7ff8180cf450 2024-09-11T23:19:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81cfc4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8180cfa40 con 0x7ff818161a60 2024-09-11T23:19:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33236/0 (socket says 172.21.15.94:33236) 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 -- 172.21.15.94:0/1351865884 learned_addr learned my addr 172.21.15.94:0/1351865884 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff81659c640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8180cf450 0x7ff81815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff816d9d640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff818161a60 0x7ff8181f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 -- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff818161a60 msgr2=0x7ff8181f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff818161a60 0x7ff8181f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 -- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8180cf450 msgr2=0x7ff81815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8180cf450 0x7ff81815d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 -- 172.21.15.94:0/1351865884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81815dbc0 con 0x7ff8180d2e90 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff815d9b640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180c7e80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0ad040 tx=0x7ff80c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.173+0000 7ff806ffd640 1 -- 172.21.15.94:0/1351865884 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0abd10 con 0x7ff8180d2e90 2024-09-11T23:19:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff806ffd640 1 -- 172.21.15.94:0/1351865884 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c0be3f0 con 0x7ff8180d2e90 2024-09-11T23:19:23.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8180c83c0 con 0x7ff8180d2e90 2024-09-11T23:19:23.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff806ffd640 1 -- 172.21.15.94:0/1351865884 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0be7e0 con 0x7ff8180d2e90 2024-09-11T23:19:23.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8180c8f00 con 0x7ff8180d2e90 2024-09-11T23:19:23.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8180cef10 con 0x7ff8180d2e90 2024-09-11T23:19:23.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff806ffd640 1 -- 172.21.15.94:0/1351865884 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff80c0b43f0 con 0x7ff8180d2e90 2024-09-11T23:19:23.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff806ffd640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7f80678c0 0x7ff7f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff806ffd640 1 -- 172.21.15.94:0/1351865884 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7ff80c120240 con 0x7ff8180d2e90 2024-09-11T23:19:23.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff81659c640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7f80678c0 0x7ff7f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.177+0000 7ff81659c640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7f80678c0 0x7ff7f8069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff8180cc770 tx=0x7ff808008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.181+0000 7ff806ffd640 1 -- 172.21.15.94:0/1351865884 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff80c0c4060 con 0x7ff8180d2e90 2024-09-11T23:19:23.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.381+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff818160c20 con 0x7ff8180d2e90 2024-09-11T23:19:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff806ffd640 1 -- 172.21.15.94:0/1351865884 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7ff81815dbc0 con 0x7ff8180d2e90 2024-09-11T23:19:23.384 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:23.384 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:06.902722+0000","modified":"2024-09-11T23:19:09.918807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/3079112947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3079112947},{"type":"v1","addr":"172.21.15.155:6836","nonce":3079112947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":6}]} 2024-09-11T23:19:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 49 2024-09-11T23:19:23.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7f80678c0 msgr2=0x7ff7f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7f80678c0 0x7ff7f8069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff8180cc770 tx=0x7ff808008040 comp rx=0 tx=0).stop 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 msgr2=0x7ff8180c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180c7e80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0ad040 tx=0x7ff80c01ac60 comp rx=0 tx=0).stop 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 shutdown_connections 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff818161a60 0x7ff8181f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7f80678c0 0x7ff7f8069d80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8180d2e90 0x7ff8180c7e80 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 --2- 172.21.15.94:0/1351865884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8180cf450 0x7ff81815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 >> 172.21.15.94:0/1351865884 conn(0x7ff81808bf90 msgr2=0x7ff81806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 shutdown_connections 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.385+0000 7ff81cfc4640 1 -- 172.21.15.94:0/1351865884 wait complete. 2024-09-11T23:19:23.404 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:23.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.517+0000 7f5b8708d640 1 Processor -- start 2024-09-11T23:19:23.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.517+0000 7f5b8708d640 1 -- start start 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8708d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5b8015bec0 0x7f5b800ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8708d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b800af470 0x7f5b8006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8708d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b800b3290 con 0x7f5b8015c2a0 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8708d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5b800b3570 con 0x7f5b8015bec0 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8708d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5b800b3850 con 0x7f5b800af470 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b800af470 0x7f5b8006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b84e29640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5b8015bec0 0x7f5b800ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b800af470 0x7f5b8006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:52094/0 (socket says 172.21.15.94:52094) 2024-09-11T23:19:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 -- 172.21.15.94:0/1574045414 learned_addr learned my addr 172.21.15.94:0/1574045414 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:23.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 -- 172.21.15.94:0/1574045414 >> v2:172.21.15.155:3300/0 conn(0x7f5b8015bec0 msgr2=0x7f5b800ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:23.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 --2- 172.21.15.94:0/1574045414 >> v2:172.21.15.155:3300/0 conn(0x7f5b8015bec0 0x7f5b800ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 -- 172.21.15.94:0/1574045414 >> v1:172.21.15.155:6789/0 conn(0x7f5b8015c2a0 legacy=0x7f5b800aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 -- 172.21.15.94:0/1574045414 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b800b3b30 con 0x7f5b800af470 2024-09-11T23:19:23.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.521+0000 7f5b8562a640 1 --2- 172.21.15.94:0/1574045414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b800af470 0x7f5b8006e000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009e50 tx=0x7f5b7801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b310461296927db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7f7fe640 1 -- 172.21.15.94:0/1574045414 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780a5830 con 0x7f5b800af470 2024-09-11T23:19:23.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7f7fe640 1 -- 172.21.15.94:0/1574045414 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780a59d0 con 0x7f5b800af470 2024-09-11T23:19:23.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7f7fe640 1 -- 172.21.15.94:0/1574045414 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780a5da0 con 0x7f5b800af470 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- 172.21.15.94:0/1574045414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b800af470 msgr2=0x7f5b8006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 --2- 172.21.15.94:0/1574045414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b800af470 0x7f5b8006e000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009e50 tx=0x7f5b7801c970 comp rx=0 tx=0).stop 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- 172.21.15.94:0/1574045414 shutdown_connections 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 --2- 172.21.15.94:0/1574045414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b800af470 0x7f5b8006e000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 --2- 172.21.15.94:0/1574045414 >> v2:172.21.15.155:3300/0 conn(0x7f5b8015bec0 0x7f5b800ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- 172.21.15.94:0/1574045414 >> 172.21.15.94:0/1574045414 conn(0x7f5b800b1f90 msgr2=0x7f5b800b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- 172.21.15.94:0/1574045414 shutdown_connections 2024-09-11T23:19:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- 172.21.15.94:0/1574045414 wait complete. 2024-09-11T23:19:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 Processor -- start 2024-09-11T23:19:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- start start 2024-09-11T23:19:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b800af470 0x7f5b8014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8015bec0 0x7f5b8015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b8015c2a0 0x7f5b8015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8006ed50 con 0x7f5b8015c2a0 2024-09-11T23:19:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b800ad740 con 0x7f5b800af470 2024-09-11T23:19:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8006eed0 con 0x7f5b8015bec0 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b8015c2a0 0x7f5b8015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b8015c2a0 0x7f5b8015ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33240/0 (socket says 172.21.15.94:33240) 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 -- 172.21.15.94:0/104590043 learned_addr learned my addr 172.21.15.94:0/104590043 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b84e29640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b800af470 0x7f5b8014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7ffff640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8015bec0 0x7f5b8015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 -- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8015bec0 msgr2=0x7f5b8015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8015bec0 0x7f5b8015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 -- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b800af470 msgr2=0x7f5b8014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b800af470 0x7f5b8014a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 -- 172.21.15.94:0/104590043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8015f370 con 0x7f5b8015c2a0 2024-09-11T23:19:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7ffff640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8015bec0 0x7f5b8015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8562a640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b8015c2a0 0x7f5b8015ed30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5b7801a5a0 tx=0x7f5b78019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7d7fa640 1 -- 172.21.15.94:0/104590043 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780bc020 con 0x7f5b8015c2a0 2024-09-11T23:19:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7d7fa640 1 -- 172.21.15.94:0/104590043 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780b8670 con 0x7f5b8015c2a0 2024-09-11T23:19:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8015f650 con 0x7f5b8015c2a0 2024-09-11T23:19:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b7d7fa640 1 -- 172.21.15.94:0/104590043 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780b8a40 con 0x7f5b8015c2a0 2024-09-11T23:19:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.525+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b80097aa0 con 0x7f5b8015c2a0 2024-09-11T23:19:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.529+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8006e000 con 0x7f5b8015c2a0 2024-09-11T23:19:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.529+0000 7f5b7d7fa640 1 -- 172.21.15.94:0/104590043 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b780bf020 con 0x7f5b8015c2a0 2024-09-11T23:19:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.529+0000 7f5b7d7fa640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5b640678c0 0x7f5b64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.529+0000 7f5b7d7fa640 1 -- 172.21.15.94:0/104590043 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f5b78120be0 con 0x7f5b8015c2a0 2024-09-11T23:19:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.529+0000 7f5b84e29640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5b640678c0 0x7f5b64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.529+0000 7f5b84e29640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5b640678c0 0x7f5b64069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009af0 tx=0x7f5b74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.533+0000 7f5b7d7fa640 1 -- 172.21.15.94:0/104590043 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5b780c6070 con 0x7f5b8015c2a0 2024-09-11T23:19:23.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.693+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b8006fcd0 con 0x7f5b8015c2a0 2024-09-11T23:19:23.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b7d7fa640 1 -- 172.21.15.94:0/104590043 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16969 (secure 0 0 0) 0x7f5b78016620 con 0x7f5b8015c2a0 2024-09-11T23:19:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:23.698 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":86,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:08.242191+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:05.228050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:05.892122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5b640678c0 msgr2=0x7f5b64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5b640678c0 0x7f5b64069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009af0 tx=0x7f5b74008040 comp rx=0 tx=0).stop 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b8015c2a0 msgr2=0x7f5b8015ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b8015c2a0 0x7f5b8015ed30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5b7801a5a0 tx=0x7f5b78019710 comp rx=0 tx=0).stop 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 shutdown_connections 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5b640678c0 0x7f5b64069d80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b8015c2a0 0x7f5b8015ed30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8015bec0 0x7f5b8015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 --2- 172.21.15.94:0/104590043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b800af470 0x7f5b8014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 >> 172.21.15.94:0/104590043 conn(0x7f5b800b1f90 msgr2=0x7f5b80159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 shutdown_connections 2024-09-11T23:19:23.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.697+0000 7f5b8708d640 1 -- 172.21.15.94:0/104590043 wait complete. 2024-09-11T23:19:23.716 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:19:23.717 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:23.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30c272640 1 Processor -- start 2024-09-11T23:19:23.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30c272640 1 -- start start 2024-09-11T23:19:23.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30c272640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa304070020 0x7fa30415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30c272640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3040aede0 con 0x7fa30415f1d0 2024-09-11T23:19:23.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30c272640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa30415fa10 con 0x7fa3041520a0 2024-09-11T23:19:23.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30c272640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa304152480 con 0x7fa304070020 2024-09-11T23:19:23.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30980d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa304070020 0x7fa30415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30a80f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa30415f1d0 0x7fa3040adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52056/0 (socket says 172.21.15.94:52056) 2024-09-11T23:19:23.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30a80f640 1 -- 172.21.15.94:0/3846573132 learned_addr learned my addr 172.21.15.94:0/3846573132 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:23.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30980d640 1 -- 172.21.15.94:0/3846573132 >> v1:172.21.15.155:6789/0 conn(0x7fa3041520a0 legacy=0x7fa30406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30980d640 1 -- 172.21.15.94:0/3846573132 >> v1:172.21.15.94:6789/0 conn(0x7fa30415f1d0 legacy=0x7fa3040adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.833+0000 7fa30980d640 1 -- 172.21.15.94:0/3846573132 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa304074250 con 0x7fa304070020 2024-09-11T23:19:23.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30980d640 1 --2- 172.21.15.94:0/3846573132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa304070020 0x7fa30415ec90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40097c0 tx=0x7fa2f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26caff59175905d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30900c640 1 -- 172.21.15.94:0/3846573132 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40a7070 con 0x7fa304070020 2024-09-11T23:19:23.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30900c640 1 -- 172.21.15.94:0/3846573132 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f40b0070 con 0x7fa304070020 2024-09-11T23:19:23.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30900c640 1 -- 172.21.15.94:0/3846573132 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040aeba0 con 0x7fa304070020 2024-09-11T23:19:23.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- 172.21.15.94:0/3846573132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa304070020 msgr2=0x7fa30415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 --2- 172.21.15.94:0/3846573132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa304070020 0x7fa30415ec90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40097c0 tx=0x7fa2f401c470 comp rx=0 tx=0).stop 2024-09-11T23:19:23.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- 172.21.15.94:0/3846573132 shutdown_connections 2024-09-11T23:19:23.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 --2- 172.21.15.94:0/3846573132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa304070020 0x7fa30415ec90 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- 172.21.15.94:0/3846573132 >> 172.21.15.94:0/3846573132 conn(0x7fa3040b1f90 msgr2=0x7fa3040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- 172.21.15.94:0/3846573132 shutdown_connections 2024-09-11T23:19:23.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- 172.21.15.94:0/3846573132 wait complete. 2024-09-11T23:19:23.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 Processor -- start 2024-09-11T23:19:23.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- start start 2024-09-11T23:19:23.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa304070020 0x7fa30414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3041520a0 0x7fa30409dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa30415f1d0 0x7fa30414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa30415f600 con 0x7fa30415f1d0 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa304073d30 con 0x7fa304070020 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30c272640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa30415f780 con 0x7fa3041520a0 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa30415f1d0 0x7fa30414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa30415f1d0 0x7fa30414ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33252/0 (socket says 172.21.15.94:33252) 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 -- 172.21.15.94:0/1421490135 learned_addr learned my addr 172.21.15.94:0/1421490135 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a00e640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa304070020 0x7fa30414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 -- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3041520a0 msgr2=0x7fa30409dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3041520a0 0x7fa30409dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 -- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa304070020 msgr2=0x7fa30414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa304070020 0x7fa30414a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.837+0000 7fa30a80f640 1 -- 172.21.15.94:0/1421490135 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3040b3300 con 0x7fa30415f1d0 2024-09-11T23:19:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa30a80f640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa30415f1d0 0x7fa30414ca60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00cbc0 tx=0x7fa2fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa2faffd640 1 -- 172.21.15.94:0/1421490135 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc017070 con 0x7fa30415f1d0 2024-09-11T23:19:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa2faffd640 1 -- 172.21.15.94:0/1421490135 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2fc00ad40 con 0x7fa30415f1d0 2024-09-11T23:19:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30414af10 con 0x7fa30415f1d0 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa2faffd640 1 -- 172.21.15.94:0/1421490135 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc012600 con 0x7fa30415f1d0 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30414bde0 con 0x7fa30415f1d0 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30415ec90 con 0x7fa30415f1d0 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa2faffd640 1 -- 172.21.15.94:0/1421490135 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2fc01a070 con 0x7fa30415f1d0 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa2faffd640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2e80678f0 0x7fa2e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa2faffd640 1 -- 172.21.15.94:0/1421490135 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa2fc085a70 con 0x7fa30415f1d0 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa30a00e640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2e80678f0 0x7fa2e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.841+0000 7fa30a00e640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2e80678f0 0x7fa2e8069db0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa3041f85a0 tx=0x7fa300009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:23.845+0000 7fa2faffd640 1 -- 172.21.15.94:0/1421490135 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa2fc055dd0 con 0x7fa30415f1d0 2024-09-11T23:19:24.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.045+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa30406e540 con 0x7fa30415f1d0 2024-09-11T23:19:24.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.045+0000 7fa2faffd640 1 -- 172.21.15.94:0/1421490135 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7fa2fc05a0d0 con 0x7fa30415f1d0 2024-09-11T23:19:24.047 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:24.047 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:06.902722+0000","modified":"2024-09-11T23:19:09.918807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/3079112947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3079112947},{"type":"v1","addr":"172.21.15.155:6836","nonce":3079112947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":6}]} 2024-09-11T23:19:24.047 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 49 2024-09-11T23:19:24.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2e80678f0 msgr2=0x7fa2e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2e80678f0 0x7fa2e8069db0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa3041f85a0 tx=0x7fa300009040 comp rx=0 tx=0).stop 2024-09-11T23:19:24.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa30415f1d0 msgr2=0x7fa30414ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa30415f1d0 0x7fa30414ca60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00cbc0 tx=0x7fa2fc00a430 comp rx=0 tx=0).stop 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 shutdown_connections 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa2e80678f0 0x7fa2e8069db0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa30415f1d0 0x7fa30414ca60 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3041520a0 0x7fa30409dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 --2- 172.21.15.94:0/1421490135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa304070020 0x7fa30414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 >> 172.21.15.94:0/1421490135 conn(0x7fa3040b1f90 msgr2=0x7fa3040b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 shutdown_connections 2024-09-11T23:19:24.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.049+0000 7fa30c272640 1 -- 172.21.15.94:0/1421490135 wait complete. 2024-09-11T23:19:24.066 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:24.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b44a1640 1 Processor -- start 2024-09-11T23:19:24.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b44a1640 1 -- start start 2024-09-11T23:19:24.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b44a1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac140bd0 0x7f12ac141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b44a1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12ac0b4410 0x7f12ac0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b44a1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12ac13fb30 con 0x7f12ac156720 2024-09-11T23:19:24.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b44a1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f12ac141570 con 0x7f12ac0b4410 2024-09-11T23:19:24.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b44a1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12ac140740 con 0x7f12ac140bd0 2024-09-11T23:19:24.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12ac0b4410 0x7f12ac0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12ac0b4410 0x7f12ac0b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33260/0 (socket says 172.21.15.94:33260) 2024-09-11T23:19:24.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 -- 172.21.15.94:0/4152705336 learned_addr learned my addr 172.21.15.94:0/4152705336 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:24.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b1a3c640 1 --2- 172.21.15.94:0/4152705336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac140bd0 0x7f12ac141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 -- 172.21.15.94:0/4152705336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac140bd0 msgr2=0x7f12ac141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:24.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 --2- 172.21.15.94:0/4152705336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac140bd0 0x7f12ac141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 -- 172.21.15.94:0/4152705336 >> v1:172.21.15.155:6789/0 conn(0x7f12ac156720 legacy=0x7f12ac0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 -- 172.21.15.94:0/4152705336 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac13fe10 con 0x7f12ac0b4410 2024-09-11T23:19:24.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.189+0000 7f12b2a3e640 1 --2- 172.21.15.94:0/4152705336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0b4410 0x7f12ac0b48c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009e50 tx=0x7f12a401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a236b80ee75259 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b123b640 1 -- 172.21.15.94:0/4152705336 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40a5700 con 0x7f12ac0b4410 2024-09-11T23:19:24.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b123b640 1 -- 172.21.15.94:0/4152705336 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a40a58a0 con 0x7f12ac0b4410 2024-09-11T23:19:24.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b123b640 1 -- 172.21.15.94:0/4152705336 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40a5c70 con 0x7f12ac0b4410 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- 172.21.15.94:0/4152705336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0b4410 msgr2=0x7f12ac0b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 --2- 172.21.15.94:0/4152705336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0b4410 0x7f12ac0b48c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009e50 tx=0x7f12a401ca30 comp rx=0 tx=0).stop 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- 172.21.15.94:0/4152705336 shutdown_connections 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 --2- 172.21.15.94:0/4152705336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0b4410 0x7f12ac0b48c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 --2- 172.21.15.94:0/4152705336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac140bd0 0x7f12ac141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- 172.21.15.94:0/4152705336 >> 172.21.15.94:0/4152705336 conn(0x7f12ac06c0c0 msgr2=0x7f12ac06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- 172.21.15.94:0/4152705336 shutdown_connections 2024-09-11T23:19:24.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- 172.21.15.94:0/4152705336 wait complete. 2024-09-11T23:19:24.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 Processor -- start 2024-09-11T23:19:24.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- start start 2024-09-11T23:19:24.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ac0b4410 0x7f12ac13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac140bd0 0x7f12ac1fa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac156720 0x7f12ac1fac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac13f6e0 con 0x7f12ac140bd0 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0b5d20 con 0x7f12ac0b4410 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12ac13f860 con 0x7f12ac156720 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac140bd0 0x7f12ac1fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac140bd0 0x7f12ac1fa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33270/0 (socket says 172.21.15.94:33270) 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 -- 172.21.15.94:0/787895488 learned_addr learned my addr 172.21.15.94:0/787895488 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b223d640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ac0b4410 0x7f12ac13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 -- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac156720 msgr2=0x7f12ac1fac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac156720 0x7f12ac1fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 -- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ac0b4410 msgr2=0x7f12ac13edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ac0b4410 0x7f12ac13edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 -- 172.21.15.94:0/787895488 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac0cd570 con 0x7f12ac140bd0 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b223d640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ac0b4410 0x7f12ac13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b1a3c640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac140bd0 0x7f12ac1fa720 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f12a000d7d0 tx=0x7f12a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12aaffd640 1 -- 172.21.15.94:0/787895488 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0004020 con 0x7f12ac140bd0 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12aaffd640 1 -- 172.21.15.94:0/787895488 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a00041c0 con 0x7f12ac140bd0 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac0cd850 con 0x7f12ac140bd0 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12aaffd640 1 -- 172.21.15.94:0/787895488 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a00043b0 con 0x7f12ac140bd0 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.193+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac0cde10 con 0x7f12ac140bd0 2024-09-11T23:19:24.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.197+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac0b48c0 con 0x7f12ac140bd0 2024-09-11T23:19:24.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.197+0000 7f12aaffd640 1 -- 172.21.15.94:0/787895488 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12a001b020 con 0x7f12ac140bd0 2024-09-11T23:19:24.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.197+0000 7f12aaffd640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12980678f0 0x7f1298069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.197+0000 7f12aaffd640 1 -- 172.21.15.94:0/787895488 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f12a0085b90 con 0x7f12ac140bd0 2024-09-11T23:19:24.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.197+0000 7f12b223d640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12980678f0 0x7f1298069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.197+0000 7f12b223d640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12980678f0 0x7f1298069db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f129c0016f0 tx=0x7f129c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.201+0000 7f12aaffd640 1 -- 172.21.15.94:0/787895488 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f12a00565d0 con 0x7f12ac140bd0 2024-09-11T23:19:24.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.393+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12ac069170 con 0x7f12ac140bd0 2024-09-11T23:19:24.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.393+0000 7f12aaffd640 1 -- 172.21.15.94:0/787895488 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7f12a0055ed0 con 0x7f12ac140bd0 2024-09-11T23:19:24.394 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:24.395 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":49,"btime":"2024-09-11T23:19:10:548939+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:06.902722+0000","modified":"2024-09-11T23:19:09.918807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/3079112947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3079112947},{"type":"v1","addr":"172.21.15.155:6836","nonce":3079112947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":6}]} 2024-09-11T23:19:24.395 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 49 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12980678f0 msgr2=0x7f1298069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12980678f0 0x7f1298069db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f129c0016f0 tx=0x7f129c009040 comp rx=0 tx=0).stop 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac140bd0 msgr2=0x7f12ac1fa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac140bd0 0x7f12ac1fa720 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f12a000d7d0 tx=0x7f12a000dc90 comp rx=0 tx=0).stop 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 shutdown_connections 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12ac156720 0x7f12ac1fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12980678f0 0x7f1298069db0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac140bd0 0x7f12ac1fa720 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 --2- 172.21.15.94:0/787895488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ac0b4410 0x7f12ac13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 >> 172.21.15.94:0/787895488 conn(0x7f12ac06c0c0 msgr2=0x7f12ac0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:24.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 shutdown_connections 2024-09-11T23:19:24.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.397+0000 7f12b44a1640 1 -- 172.21.15.94:0/787895488 wait complete. 2024-09-11T23:19:24.412 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:24.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f11088ad640 1 Processor -- start 2024-09-11T23:19:24.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f11088ad640 1 -- start start 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f11088ad640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1104161a60 0x7f11040d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f11088ad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11040cf620 0x7f110406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f11088ad640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11040d32b0 con 0x7f11040d2e90 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f11088ad640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f11040d0300 con 0x7f1104161a60 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f11088ad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f11040cfa90 con 0x7f11040cf620 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f110259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1104161a60 0x7f11040d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f1101d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f11040d2e90 0x7f11040cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52060/0 (socket says 172.21.15.94:52060) 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f1101d9b640 1 -- 172.21.15.94:0/2972981893 learned_addr learned my addr 172.21.15.94:0/2972981893 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f1102d9d640 1 --2- 172.21.15.94:0/2972981893 >> v2:172.21.15.155:3300/0 conn(0x7f11040cf620 0x7f110406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f110259c640 1 -- 172.21.15.94:0/2972981893 >> v2:172.21.15.155:3300/0 conn(0x7f11040cf620 msgr2=0x7f110406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:24.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f110259c640 1 --2- 172.21.15.94:0/2972981893 >> v2:172.21.15.155:3300/0 conn(0x7f11040cf620 0x7f110406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f110259c640 1 -- 172.21.15.94:0/2972981893 >> v1:172.21.15.94:6789/0 conn(0x7f11040d2e90 legacy=0x7f11040cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f110259c640 1 -- 172.21.15.94:0/2972981893 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11040b0f60 con 0x7f1104161a60 2024-09-11T23:19:24.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.529+0000 7f110159a640 1 -- 172.21.15.94:0/2972981893 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227432800 0 0) 0x7f11040d32b0 con 0x7f11040d2e90 2024-09-11T23:19:24.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f110259c640 1 --2- 172.21.15.94:0/2972981893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1104161a60 0x7f11040d2950 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f11040ce950 tx=0x7f10f401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248614b52b5b4415 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f110159a640 1 -- 172.21.15.94:0/2972981893 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f40b1070 con 0x7f1104161a60 2024-09-11T23:19:24.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f110159a640 1 -- 172.21.15.94:0/2972981893 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f40ac620 con 0x7f1104161a60 2024-09-11T23:19:24.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f110159a640 1 -- 172.21.15.94:0/2972981893 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f40ac9f0 con 0x7f1104161a60 2024-09-11T23:19:24.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- 172.21.15.94:0/2972981893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1104161a60 msgr2=0x7f11040d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 --2- 172.21.15.94:0/2972981893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1104161a60 0x7f11040d2950 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f11040ce950 tx=0x7f10f401c3c0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- 172.21.15.94:0/2972981893 shutdown_connections 2024-09-11T23:19:24.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 --2- 172.21.15.94:0/2972981893 >> v2:172.21.15.155:3300/0 conn(0x7f11040cf620 0x7f110406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 --2- 172.21.15.94:0/2972981893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1104161a60 0x7f11040d2950 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- 172.21.15.94:0/2972981893 >> 172.21.15.94:0/2972981893 conn(0x7f110408bf90 msgr2=0x7f110409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:24.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- 172.21.15.94:0/2972981893 shutdown_connections 2024-09-11T23:19:24.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- 172.21.15.94:0/2972981893 wait complete. 2024-09-11T23:19:24.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 Processor -- start 2024-09-11T23:19:24.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- start start 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11040cf620 0x7f1104150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11040d2e90 0x7f11040cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1104161a60 0x7f11040ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f110406e400 con 0x7f11040d2e90 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f110406d190 con 0x7f1104161a60 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f110406e580 con 0x7f11040cf620 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11040d2e90 0x7f11040cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11040d2e90 0x7f11040cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33294/0 (socket says 172.21.15.94:33294) 2024-09-11T23:19:24.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 -- 172.21.15.94:0/1875717086 learned_addr learned my addr 172.21.15.94:0/1875717086 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 -- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11040cf620 msgr2=0x7f1104150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11040cf620 0x7f1104150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 -- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1104161a60 msgr2=0x7f11040ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1104161a60 0x7f11040ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 -- 172.21.15.94:0/1875717086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110415e9b0 con 0x7f11040d2e90 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f1101d9b640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11040d2e90 0x7f11040cc840 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f10f800c440 tx=0x7f10f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f10f2ffd640 1 -- 172.21.15.94:0/1875717086 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8018070 con 0x7f11040d2e90 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f10f2ffd640 1 -- 172.21.15.94:0/1875717086 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f80074e0 con 0x7f11040d2e90 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11040cd2c0 con 0x7f11040d2e90 2024-09-11T23:19:24.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f10f2ffd640 1 -- 172.21.15.94:0/1875717086 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8004a10 con 0x7f11040d2e90 2024-09-11T23:19:24.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.533+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11040b4570 con 0x7f11040d2e90 2024-09-11T23:19:24.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.537+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f110406d6b0 con 0x7f11040d2e90 2024-09-11T23:19:24.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.537+0000 7f10f2ffd640 1 -- 172.21.15.94:0/1875717086 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10f801b070 con 0x7f11040d2e90 2024-09-11T23:19:24.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.537+0000 7f10f2ffd640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10e40678c0 0x7f10e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.537+0000 7f10f2ffd640 1 -- 172.21.15.94:0/1875717086 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f10f8084fb0 con 0x7f11040d2e90 2024-09-11T23:19:24.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.537+0000 7f110259c640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10e40678c0 0x7f10e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.537+0000 7f110259c640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10e40678c0 0x7f10e4069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f10f40ae000 tx=0x7f10f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.541+0000 7f10f2ffd640 1 -- 172.21.15.94:0/1875717086 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10f80559f0 con 0x7f11040d2e90 2024-09-11T23:19:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.705+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1104074b80 con 0x7f11040d2e90 2024-09-11T23:19:24.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f10f2ffd640 1 -- 172.21.15.94:0/1875717086 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16969 (secure 0 0 0) 0x7f10f80552f0 con 0x7f11040d2e90 2024-09-11T23:19:24.709 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:24.709 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":86,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:08.242191+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:05.228050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:05.892122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10e40678c0 msgr2=0x7f10e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10e40678c0 0x7f10e4069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f10f40ae000 tx=0x7f10f4008040 comp rx=0 tx=0).stop 2024-09-11T23:19:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11040d2e90 msgr2=0x7f11040cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11040d2e90 0x7f11040cc840 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f10f800c440 tx=0x7f10f800c900 comp rx=0 tx=0).stop 2024-09-11T23:19:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 shutdown_connections 2024-09-11T23:19:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1104161a60 0x7f11040ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10e40678c0 0x7f10e4069d80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11040d2e90 0x7f11040cc840 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 --2- 172.21.15.94:0/1875717086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11040cf620 0x7f1104150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 >> 172.21.15.94:0/1875717086 conn(0x7f110408bf90 msgr2=0x7f11040cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 shutdown_connections 2024-09-11T23:19:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.709+0000 7f11088ad640 1 -- 172.21.15.94:0/1875717086 wait complete. 2024-09-11T23:19:24.728 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:19:24.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7748465640 1 Processor -- start 2024-09-11T23:19:24.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7748465640 1 -- start start 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7748465640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7748465640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f774015f1d0 0x7f77400adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7748465640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77400aede0 con 0x7f77401520a0 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7748465640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7740152480 con 0x7f774015f1d0 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7748465640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f774015fa10 con 0x7f7740070020 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7746a02640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f774015f1d0 0x7f77400adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7746201640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f77401520a0 0x7f774006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52064/0 (socket says 172.21.15.94:52064) 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7746201640 1 -- 172.21.15.94:0/1637802101 learned_addr learned my addr 172.21.15.94:0/1637802101 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7745a00640 1 --2- 172.21.15.94:0/1637802101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7746a02640 1 -- 172.21.15.94:0/1637802101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 msgr2=0x7f774015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:24.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7746a02640 1 --2- 172.21.15.94:0/1637802101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7746a02640 1 -- 172.21.15.94:0/1637802101 >> v1:172.21.15.94:6789/0 conn(0x7f77401520a0 legacy=0x7f774006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7746a02640 1 -- 172.21.15.94:0/1637802101 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7740074250 con 0x7f774015f1d0 2024-09-11T23:19:24.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.849+0000 7f7745a00640 1 --2- 172.21.15.94:0/1637802101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:24.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7746a02640 1 --2- 172.21.15.94:0/1637802101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f774015f1d0 0x7f77400adc80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f77300097f0 tx=0x7f773001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8ae85e3f0ff72f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f77451ff640 1 -- 172.21.15.94:0/1637802101 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300ae070 con 0x7f774015f1d0 2024-09-11T23:19:24.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f77451ff640 1 -- 172.21.15.94:0/1637802101 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77300a8650 con 0x7f774015f1d0 2024-09-11T23:19:24.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f77451ff640 1 -- 172.21.15.94:0/1637802101 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300a8a20 con 0x7f774015f1d0 2024-09-11T23:19:24.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- 172.21.15.94:0/1637802101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f774015f1d0 msgr2=0x7f77400adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 --2- 172.21.15.94:0/1637802101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f774015f1d0 0x7f77400adc80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f77300097f0 tx=0x7f773001e680 comp rx=0 tx=0).stop 2024-09-11T23:19:24.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- 172.21.15.94:0/1637802101 shutdown_connections 2024-09-11T23:19:24.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 --2- 172.21.15.94:0/1637802101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f774015f1d0 0x7f77400adc80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 --2- 172.21.15.94:0/1637802101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- 172.21.15.94:0/1637802101 >> 172.21.15.94:0/1637802101 conn(0x7f77400b1f90 msgr2=0x7f77400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:24.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- 172.21.15.94:0/1637802101 shutdown_connections 2024-09-11T23:19:24.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- 172.21.15.94:0/1637802101 wait complete. 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 Processor -- start 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- start start 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77401520a0 0x7f7740165860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f774015f1d0 0x7f77401502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f774015f680 con 0x7f77401520a0 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7740073d30 con 0x7f774015f1d0 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.853+0000 7f7748465640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f774006e800 con 0x7f7740070020 2024-09-11T23:19:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77401520a0 0x7f7740165860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77401520a0 0x7f7740165860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33320/0 (socket says 172.21.15.94:33320) 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 -- 172.21.15.94:0/4141572750 learned_addr learned my addr 172.21.15.94:0/4141572750 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 -- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 msgr2=0x7f774014e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7746a02640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f774015f1d0 0x7f77401502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 -- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f774015f1d0 msgr2=0x7f77401502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f774015f1d0 0x7f77401502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 -- 172.21.15.94:0/4141572750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77401fab20 con 0x7f77401520a0 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7745a00640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77401520a0 0x7f7740165860 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f773400c7f0 tx=0x7f773400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f773effd640 1 -- 172.21.15.94:0/4141572750 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734015070 con 0x7f77401520a0 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f773effd640 1 -- 172.21.15.94:0/4141572750 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7734007820 con 0x7f77401520a0 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77401fae00 con 0x7f77401520a0 2024-09-11T23:19:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f773effd640 1 -- 172.21.15.94:0/4141572750 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734007bd0 con 0x7f77401520a0 2024-09-11T23:19:24.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77401fb3c0 con 0x7f77401520a0 2024-09-11T23:19:24.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774015ec90 con 0x7f77401520a0 2024-09-11T23:19:24.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f773effd640 1 -- 172.21.15.94:0/4141572750 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7734018070 con 0x7f77401520a0 2024-09-11T23:19:24.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f773effd640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f772c0678c0 0x7f772c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:24.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f773effd640 1 -- 172.21.15.94:0/4141572750 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f7734085ed0 con 0x7f77401520a0 2024-09-11T23:19:24.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7746201640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f772c0678c0 0x7f772c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:24.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.857+0000 7f7746201640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f772c0678c0 0x7f772c069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f77380012f0 tx=0x7f7738001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:24.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:24.861+0000 7f773effd640 1 -- 172.21.15.94:0/4141572750 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7734056910 con 0x7f77401520a0 2024-09-11T23:19:25.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.057+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f774006e540 con 0x7f77401520a0 2024-09-11T23:19:25.060 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:19:25.061+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:19:25.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.061+0000 7f773effd640 1 -- 172.21.15.94:0/4141572750 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) ==== 161+0+0 (secure 0 0 0) 0x7f7734056210 con 0x7f77401520a0 2024-09-11T23:19:25.063 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:19:25.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f772c0678c0 msgr2=0x7f772c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f772c0678c0 0x7f772c069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f77380012f0 tx=0x7f7738001640 comp rx=0 tx=0).stop 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77401520a0 msgr2=0x7f7740165860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77401520a0 0x7f7740165860 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f773400c7f0 tx=0x7f773400ccb0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 shutdown_connections 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f774015f1d0 0x7f77401502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f772c0678c0 0x7f772c069d80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77401520a0 0x7f7740165860 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 --2- 172.21.15.94:0/4141572750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7740070020 0x7f774014e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 >> 172.21.15.94:0/4141572750 conn(0x7f77400b1f90 msgr2=0x7f774006f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 shutdown_connections 2024-09-11T23:19:25.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.065+0000 7f7748465640 1 -- 172.21.15.94:0/4141572750 wait complete. 2024-09-11T23:19:25.076 INFO:tasks.ceph.mds.d.smithi155.stderr: -2962> 2024-09-11T23:19:10.239+0000 7f1d4b07b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:19:25.084 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:19:25.143 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:19:25.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.201+0000 7fef81ee2640 1 Processor -- start 2024-09-11T23:19:25.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.201+0000 7fef81ee2640 1 -- start start 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef81ee2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fef7c15e260 0x7fef7c0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef81ee2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c1625b0 0x7fef7c0b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef81ee2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7c0afbb0 con 0x7fef7c067e30 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef81ee2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fef7c0af310 con 0x7fef7c15e260 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef81ee2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c0af5f0 con 0x7fef7c1625b0 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fef7c15e260 0x7fef7c0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fef7c15e260 0x7fef7c0afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33334/0 (socket says 172.21.15.94:33334) 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 -- 172.21.15.94:0/2952083108 learned_addr learned my addr 172.21.15.94:0/2952083108 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:25.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7bfff640 1 --2- 172.21.15.94:0/2952083108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c1625b0 0x7fef7c0b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 -- 172.21.15.94:0/2952083108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c1625b0 msgr2=0x7fef7c0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:25.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 --2- 172.21.15.94:0/2952083108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c1625b0 0x7fef7c0b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 -- 172.21.15.94:0/2952083108 >> v1:172.21.15.155:6789/0 conn(0x7fef7c067e30 legacy=0x7fef7c161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:25.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 -- 172.21.15.94:0/2952083108 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c0af8d0 con 0x7fef7c15e260 2024-09-11T23:19:25.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.205+0000 7fef7b7fe640 1 --2- 172.21.15.94:0/2952083108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c15e260 0x7fef7c0afff0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009870 tx=0x7fef6c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5e9d8d27fabc3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:25.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7affd640 1 -- 172.21.15.94:0/2952083108 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0aa660 con 0x7fef7c15e260 2024-09-11T23:19:25.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7affd640 1 -- 172.21.15.94:0/2952083108 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c0af070 con 0x7fef7c15e260 2024-09-11T23:19:25.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7affd640 1 -- 172.21.15.94:0/2952083108 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0aaa20 con 0x7fef7c15e260 2024-09-11T23:19:25.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- 172.21.15.94:0/2952083108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c15e260 msgr2=0x7fef7c0afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 --2- 172.21.15.94:0/2952083108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c15e260 0x7fef7c0afff0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009870 tx=0x7fef6c01c520 comp rx=0 tx=0).stop 2024-09-11T23:19:25.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- 172.21.15.94:0/2952083108 shutdown_connections 2024-09-11T23:19:25.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 --2- 172.21.15.94:0/2952083108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c1625b0 0x7fef7c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 --2- 172.21.15.94:0/2952083108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c15e260 0x7fef7c0afff0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- 172.21.15.94:0/2952083108 >> 172.21.15.94:0/2952083108 conn(0x7fef7c073580 msgr2=0x7fef7c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:25.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- 172.21.15.94:0/2952083108 shutdown_connections 2024-09-11T23:19:25.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- 172.21.15.94:0/2952083108 wait complete. 2024-09-11T23:19:25.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 Processor -- start 2024-09-11T23:19:25.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- start start 2024-09-11T23:19:25.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c067e30 0x7fef7c151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c15e260 0x7fef7c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef7c1625b0 0x7fef7c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0b52e0 con 0x7fef7c067e30 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0b5160 con 0x7fef7c1625b0 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c0b5460 con 0x7fef7c15e260 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c067e30 0x7fef7c151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c067e30 0x7fef7c151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33348/0 (socket says 172.21.15.94:33348) 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 -- 172.21.15.94:0/1503322541 learned_addr learned my addr 172.21.15.94:0/1503322541 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 -- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c15e260 msgr2=0x7fef7c153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c15e260 0x7fef7c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 -- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef7c1625b0 msgr2=0x7fef7c1544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7bfff640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef7c1625b0 0x7fef7c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef7c1625b0 0x7fef7c1544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 -- 172.21.15.94:0/1503322541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c159760 con 0x7fef7c067e30 2024-09-11T23:19:25.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef7b7fe640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c067e30 0x7fef7c151ee0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fef6c01cdc0 tx=0x7fef6c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:25.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef78ff9640 1 -- 172.21.15.94:0/1503322541 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0b3800 con 0x7fef7c067e30 2024-09-11T23:19:25.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef78ff9640 1 -- 172.21.15.94:0/1503322541 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c0b39c0 con 0x7fef7c067e30 2024-09-11T23:19:25.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c159a40 con 0x7fef7c067e30 2024-09-11T23:19:25.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef78ff9640 1 -- 172.21.15.94:0/1503322541 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0b3db0 con 0x7fef7c067e30 2024-09-11T23:19:25.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.209+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c15a000 con 0x7fef7c067e30 2024-09-11T23:19:25.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.213+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7c0afff0 con 0x7fef7c067e30 2024-09-11T23:19:25.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.213+0000 7fef78ff9640 1 -- 172.21.15.94:0/1503322541 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef6c0c6390 con 0x7fef7c067e30 2024-09-11T23:19:25.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.213+0000 7fef78ff9640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef5c0678c0 0x7fef5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.213+0000 7fef78ff9640 1 -- 172.21.15.94:0/1503322541 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fef6c120660 con 0x7fef7c067e30 2024-09-11T23:19:25.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.213+0000 7fef72ffd640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef5c0678c0 0x7fef5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.213+0000 7fef72ffd640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef5c0678c0 0x7fef5c069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fef7c1fa470 tx=0x7fef640079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:25.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.217+0000 7fef78ff9640 1 -- 172.21.15.94:0/1503322541 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef6c0c3060 con 0x7fef7c067e30 2024-09-11T23:19:25.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:25.401+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fef7c06fbd0 con 0x7fef7c067e30 2024-09-11T23:19:26.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.145+0000 7fef78ff9640 1 -- 172.21.15.94:0/1503322541 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) ==== 104+0+0 (secure 0 0 0) 0x7fef6c016110 con 0x7fef7c067e30 2024-09-11T23:19:26.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef5c0678c0 msgr2=0x7fef5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef5c0678c0 0x7fef5c069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fef7c1fa470 tx=0x7fef640079c0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c067e30 msgr2=0x7fef7c151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c067e30 0x7fef7c151ee0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fef6c01cdc0 tx=0x7fef6c01ad60 comp rx=0 tx=0).stop 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 shutdown_connections 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef7c1625b0 0x7fef7c1544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef7c15e260 0x7fef7c153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fef5c0678c0 0x7fef5c069d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 --2- 172.21.15.94:0/1503322541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef7c067e30 0x7fef7c151ee0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 >> 172.21.15.94:0/1503322541 conn(0x7fef7c073580 msgr2=0x7fef7c15b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 shutdown_connections 2024-09-11T23:19:26.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.149+0000 7fef81ee2640 1 -- 172.21.15.94:0/1503322541 wait complete. 2024-09-11T23:19:26.169 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:19:26.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d4a683640 1 Processor -- start 2024-09-11T23:19:26.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d4a683640 1 -- start start 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d4a683640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d441520a0 0x7f6d4406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d4a683640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d4406fe50 0x7f6d4415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d4a683640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d44070250 con 0x7f6d4415f1d0 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d4a683640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6d44152480 con 0x7f6d4406fe50 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d4a683640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d440aede0 con 0x7f6d441520a0 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d437fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d4406fe50 0x7f6d4415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d437fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d4406fe50 0x7f6d4415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33350/0 (socket says 172.21.15.94:33350) 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d437fe640 1 -- 172.21.15.94:0/2632519415 learned_addr learned my addr 172.21.15.94:0/2632519415 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d43fff640 1 --2- 172.21.15.94:0/2632519415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d441520a0 0x7f6d4406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d437fe640 1 -- 172.21.15.94:0/2632519415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d441520a0 msgr2=0x7f6d4406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d437fe640 1 --2- 172.21.15.94:0/2632519415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d441520a0 0x7f6d4406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d437fe640 1 -- 172.21.15.94:0/2632519415 >> v1:172.21.15.155:6789/0 conn(0x7f6d4415f1d0 legacy=0x7f6d44071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d437fe640 1 -- 172.21.15.94:0/2632519415 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4415fa10 con 0x7f6d4406fe50 2024-09-11T23:19:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.293+0000 7f6d43fff640 1 --2- 172.21.15.94:0/2632519415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d441520a0 0x7f6d4406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d437fe640 1 --2- 172.21.15.94:0/2632519415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4406fe50 0x7f6d4415ec90 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009870 tx=0x7f6d3801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee0f8d86c61162f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d42ffd640 1 -- 172.21.15.94:0/2632519415 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d380b1070 con 0x7f6d4406fe50 2024-09-11T23:19:26.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d42ffd640 1 -- 172.21.15.94:0/2632519415 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d380a8050 con 0x7f6d4406fe50 2024-09-11T23:19:26.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d42ffd640 1 -- 172.21.15.94:0/2632519415 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d380ac860 con 0x7f6d4406fe50 2024-09-11T23:19:26.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 -- 172.21.15.94:0/2632519415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4406fe50 msgr2=0x7f6d4415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 --2- 172.21.15.94:0/2632519415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4406fe50 0x7f6d4415ec90 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009870 tx=0x7f6d3801c500 comp rx=0 tx=0).stop 2024-09-11T23:19:26.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 -- 172.21.15.94:0/2632519415 shutdown_connections 2024-09-11T23:19:26.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 --2- 172.21.15.94:0/2632519415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4406fe50 0x7f6d4415ec90 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 --2- 172.21.15.94:0/2632519415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d441520a0 0x7f6d4406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 -- 172.21.15.94:0/2632519415 >> 172.21.15.94:0/2632519415 conn(0x7f6d440b1f90 msgr2=0x7f6d440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 -- 172.21.15.94:0/2632519415 shutdown_connections 2024-09-11T23:19:26.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.297+0000 7f6d4a683640 1 -- 172.21.15.94:0/2632519415 wait complete. 2024-09-11T23:19:26.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 Processor -- start 2024-09-11T23:19:26.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 -- start start 2024-09-11T23:19:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406fe50 0x7f6d4414f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d441520a0 0x7f6d440afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4415f1d0 0x7f6d440b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6d44073d30 con 0x7f6d4415f1d0 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d44073a50 con 0x7f6d441520a0 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4415f680 con 0x7f6d4406fe50 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4415f1d0 0x7f6d440b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4415f1d0 0x7f6d440b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33356/0 (socket says 172.21.15.94:33356) 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 -- 172.21.15.94:0/905541371 learned_addr learned my addr 172.21.15.94:0/905541371 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d43fff640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406fe50 0x7f6d4414f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d437fe640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d441520a0 0x7f6d440afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 -- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406fe50 msgr2=0x7f6d4414f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406fe50 0x7f6d4414f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 -- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d441520a0 msgr2=0x7f6d440afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d441520a0 0x7f6d440afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 -- 172.21.15.94:0/905541371 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d440b10f0 con 0x7f6d4415f1d0 2024-09-11T23:19:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d48c20640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4415f1d0 0x7f6d440b0340 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c3c0 tx=0x7f6d3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d40ff9640 1 -- 172.21.15.94:0/905541371 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34011790 con 0x7f6d4415f1d0 2024-09-11T23:19:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d40ff9640 1 -- 172.21.15.94:0/905541371 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d34017070 con 0x7f6d4415f1d0 2024-09-11T23:19:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d40ff9640 1 -- 172.21.15.94:0/905541371 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34011b70 con 0x7f6d4415f1d0 2024-09-11T23:19:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d440b13d0 con 0x7f6d4415f1d0 2024-09-11T23:19:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d4414f740 con 0x7f6d4415f1d0 2024-09-11T23:19:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.301+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d4415ec90 con 0x7f6d4415f1d0 2024-09-11T23:19:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.305+0000 7f6d40ff9640 1 -- 172.21.15.94:0/905541371 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6d34011d10 con 0x7f6d4415f1d0 2024-09-11T23:19:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.305+0000 7f6d40ff9640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d300678c0 0x7f6d30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.305+0000 7f6d40ff9640 1 -- 172.21.15.94:0/905541371 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f6d34085ba0 con 0x7f6d4415f1d0 2024-09-11T23:19:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.305+0000 7f6d43fff640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d300678c0 0x7f6d30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.305+0000 7f6d43fff640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d300678c0 0x7f6d30069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6d4409e490 tx=0x7f6d3c007810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.309+0000 7f6d40ff9640 1 -- 172.21.15.94:0/905541371 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6d34055ea0 con 0x7f6d4415f1d0 2024-09-11T23:19:26.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:26.469+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d4406e540 con 0x7f6d4415f1d0 2024-09-11T23:19:27.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.157+0000 7f6d40ff9640 1 -- 172.21.15.94:0/905541371 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7f6d3405a1a0 con 0x7f6d4415f1d0 2024-09-11T23:19:27.159 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:19:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d300678c0 msgr2=0x7f6d30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d300678c0 0x7f6d30069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6d4409e490 tx=0x7f6d3c007810 comp rx=0 tx=0).stop 2024-09-11T23:19:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4415f1d0 msgr2=0x7f6d440b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4415f1d0 0x7f6d440b0340 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c3c0 tx=0x7f6d3400c880 comp rx=0 tx=0).stop 2024-09-11T23:19:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 shutdown_connections 2024-09-11T23:19:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d300678c0 0x7f6d30069d80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4415f1d0 0x7f6d440b0340 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d441520a0 0x7f6d440afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 --2- 172.21.15.94:0/905541371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406fe50 0x7f6d4414f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.161+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 >> 172.21.15.94:0/905541371 conn(0x7f6d440b1f90 msgr2=0x7f6d440b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.165+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 shutdown_connections 2024-09-11T23:19:27.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.165+0000 7f6d4a683640 1 -- 172.21.15.94:0/905541371 wait complete. 2024-09-11T23:19:27.185 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:19:27.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc894a8e640 1 Processor -- start 2024-09-11T23:19:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc894a8e640 1 -- start start 2024-09-11T23:19:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc894a8e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc89015c2a0 0x7fc8900aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc894a8e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc8900af2a0 0x7fc89006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc894a8e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8900b3290 con 0x7fc89015bec0 2024-09-11T23:19:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc894a8e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc8900b3570 con 0x7fc89015c2a0 2024-09-11T23:19:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc894a8e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc8900b3850 con 0x7fc8900af2a0 2024-09-11T23:19:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88dd9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc89015c2a0 0x7fc8900aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88e59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc89015bec0 0x7fc8900ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52074/0 (socket says 172.21.15.94:52074) 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88e59c640 1 -- 172.21.15.94:0/2307670308 learned_addr learned my addr 172.21.15.94:0/2307670308 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88ed9d640 1 --2- 172.21.15.94:0/2307670308 >> v2:172.21.15.155:3300/0 conn(0x7fc8900af2a0 0x7fc89006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88dd9b640 1 -- 172.21.15.94:0/2307670308 >> v2:172.21.15.155:3300/0 conn(0x7fc8900af2a0 msgr2=0x7fc89006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88dd9b640 1 --2- 172.21.15.94:0/2307670308 >> v2:172.21.15.155:3300/0 conn(0x7fc8900af2a0 0x7fc89006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88dd9b640 1 -- 172.21.15.94:0/2307670308 >> v1:172.21.15.94:6789/0 conn(0x7fc89015bec0 legacy=0x7fc8900ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88dd9b640 1 -- 172.21.15.94:0/2307670308 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8900b3b30 con 0x7fc89015c2a0 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88d59a640 1 -- 172.21.15.94:0/2307670308 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684189768 0 0) 0x7fc8900b3290 con 0x7fc89015bec0 2024-09-11T23:19:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.305+0000 7fc88ed9d640 1 --2- 172.21.15.94:0/2307670308 >> v2:172.21.15.155:3300/0 conn(0x7fc8900af2a0 0x7fc89006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:27.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc88dd9b640 1 --2- 172.21.15.94:0/2307670308 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc89015c2a0 0x7fc8900aed60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc8900b2fb0 tx=0x7fc87801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfa8e29ed2d468d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc88d59a640 1 -- 172.21.15.94:0/2307670308 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780ab650 con 0x7fc89015c2a0 2024-09-11T23:19:27.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc88d59a640 1 -- 172.21.15.94:0/2307670308 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8780b0070 con 0x7fc89015c2a0 2024-09-11T23:19:27.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc88d59a640 1 -- 172.21.15.94:0/2307670308 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780aba10 con 0x7fc89015c2a0 2024-09-11T23:19:27.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 -- 172.21.15.94:0/2307670308 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc89015c2a0 msgr2=0x7fc8900aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2307670308 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc89015c2a0 0x7fc8900aed60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc8900b2fb0 tx=0x7fc87801c450 comp rx=0 tx=0).stop 2024-09-11T23:19:27.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 -- 172.21.15.94:0/2307670308 shutdown_connections 2024-09-11T23:19:27.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2307670308 >> v2:172.21.15.155:3300/0 conn(0x7fc8900af2a0 0x7fc89006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2307670308 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc89015c2a0 0x7fc8900aed60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 -- 172.21.15.94:0/2307670308 >> 172.21.15.94:0/2307670308 conn(0x7fc8900b1f90 msgr2=0x7fc8900b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 -- 172.21.15.94:0/2307670308 shutdown_connections 2024-09-11T23:19:27.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 -- 172.21.15.94:0/2307670308 wait complete. 2024-09-11T23:19:27.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 Processor -- start 2024-09-11T23:19:27.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.309+0000 7fc894a8e640 1 -- start start 2024-09-11T23:19:27.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8900af2a0 0x7fc89014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc89015bec0 0x7fc89014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc89015c2a0 0x7fc89014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc89006ed50 con 0x7fc8900af2a0 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8900af6b0 con 0x7fc89015bec0 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc89006eed0 con 0x7fc89015c2a0 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8900af2a0 0x7fc89014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8900af2a0 0x7fc89014c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33380/0 (socket says 172.21.15.94:33380) 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 -- 172.21.15.94:0/2185659579 learned_addr learned my addr 172.21.15.94:0/2185659579 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88dd9b640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc89015bec0 0x7fc89014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 -- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc89015c2a0 msgr2=0x7fc89014e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88ed9d640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc89015c2a0 0x7fc89014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc89015c2a0 0x7fc89014e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 -- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc89015bec0 msgr2=0x7fc89014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc89015bec0 0x7fc89014e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 -- 172.21.15.94:0/2185659579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc890150a80 con 0x7fc8900af2a0 2024-09-11T23:19:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88dd9b640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc89015bec0 0x7fc89014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88e59c640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8900af2a0 0x7fc89014c740 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc888001570 tx=0x7fc88800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc886ffd640 1 -- 172.21.15.94:0/2185659579 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc888018070 con 0x7fc8900af2a0 2024-09-11T23:19:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc886ffd640 1 -- 172.21.15.94:0/2185659579 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88800a640 con 0x7fc8900af2a0 2024-09-11T23:19:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89015cc70 con 0x7fc8900af2a0 2024-09-11T23:19:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc886ffd640 1 -- 172.21.15.94:0/2185659579 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88800aa30 con 0x7fc8900af2a0 2024-09-11T23:19:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89015d230 con 0x7fc8900af2a0 2024-09-11T23:19:27.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89006f1d0 con 0x7fc8900af2a0 2024-09-11T23:19:27.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc886ffd640 1 -- 172.21.15.94:0/2185659579 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc88801b070 con 0x7fc8900af2a0 2024-09-11T23:19:27.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc886ffd640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc8740678c0 0x7fc874069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc886ffd640 1 -- 172.21.15.94:0/2185659579 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5749+0+0 (secure 0 0 0) 0x7fc888085390 con 0x7fc8900af2a0 2024-09-11T23:19:27.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.313+0000 7fc88dd9b640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc8740678c0 0x7fc874069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.317+0000 7fc88dd9b640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc8740678c0 0x7fc874069d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8780af000 tx=0x7fc8780a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.317+0000 7fc886ffd640 1 -- 172.21.15.94:0/2185659579 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc888055ea0 con 0x7fc8900af2a0 2024-09-11T23:19:27.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:27.481+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc89006fcd0 con 0x7fc8900af2a0 2024-09-11T23:19:28.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.161+0000 7fc886ffd640 1 -- 172.21.15.94:0/2185659579 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7fc8880557a0 con 0x7fc8900af2a0 2024-09-11T23:19:28.162 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:19:28.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc8740678c0 msgr2=0x7fc874069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc8740678c0 0x7fc874069d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8780af000 tx=0x7fc8780a7000 comp rx=0 tx=0).stop 2024-09-11T23:19:28.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8900af2a0 msgr2=0x7fc89014c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8900af2a0 0x7fc89014c740 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc888001570 tx=0x7fc88800cd20 comp rx=0 tx=0).stop 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 shutdown_connections 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc89015c2a0 0x7fc89014e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc89015bec0 0x7fc89014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc8740678c0 0x7fc874069d80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 --2- 172.21.15.94:0/2185659579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8900af2a0 0x7fc89014c740 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 >> 172.21.15.94:0/2185659579 conn(0x7fc8900b1f90 msgr2=0x7fc8900b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 shutdown_connections 2024-09-11T23:19:28.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.165+0000 7fc894a8e640 1 -- 172.21.15.94:0/2185659579 wait complete. 2024-09-11T23:19:28.191 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:19:28.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae8dace640 1 Processor -- start 2024-09-11T23:19:28.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae8dace640 1 -- start start 2024-09-11T23:19:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae8dace640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fae88070020 0x7fae8815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae8dace640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fae8815f1d0 0x7fae880adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae8dace640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae880aede0 con 0x7fae881520a0 2024-09-11T23:19:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae8dace640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fae88152480 con 0x7fae8815f1d0 2024-09-11T23:19:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae8dace640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fae8815fa10 con 0x7fae88070020 2024-09-11T23:19:28.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae87fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fae8815f1d0 0x7fae880adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae877fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fae881520a0 0x7fae8806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52082/0 (socket says 172.21.15.94:52082) 2024-09-11T23:19:28.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae877fe640 1 -- 172.21.15.94:0/3367866650 learned_addr learned my addr 172.21.15.94:0/3367866650 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:28.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.313+0000 7fae86ffd640 1 --2- 172.21.15.94:0/3367866650 >> v2:172.21.15.155:3300/0 conn(0x7fae88070020 0x7fae8815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae87fff640 1 -- 172.21.15.94:0/3367866650 >> v2:172.21.15.155:3300/0 conn(0x7fae88070020 msgr2=0x7fae8815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae87fff640 1 --2- 172.21.15.94:0/3367866650 >> v2:172.21.15.155:3300/0 conn(0x7fae88070020 0x7fae8815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae87fff640 1 -- 172.21.15.94:0/3367866650 >> v1:172.21.15.94:6789/0 conn(0x7fae881520a0 legacy=0x7fae8806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae867fc640 1 -- 172.21.15.94:0/3367866650 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473816695 0 0) 0x7fae880aede0 con 0x7fae881520a0 2024-09-11T23:19:28.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae87fff640 1 -- 172.21.15.94:0/3367866650 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae88074250 con 0x7fae8815f1d0 2024-09-11T23:19:28.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae87fff640 1 --2- 172.21.15.94:0/3367866650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae880adc80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fae8806e510 tx=0x7fae7801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebb406bf41a30d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae867fc640 1 -- 172.21.15.94:0/3367866650 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780ab650 con 0x7fae8815f1d0 2024-09-11T23:19:28.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae867fc640 1 -- 172.21.15.94:0/3367866650 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780b0070 con 0x7fae8815f1d0 2024-09-11T23:19:28.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae867fc640 1 -- 172.21.15.94:0/3367866650 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780aba10 con 0x7fae8815f1d0 2024-09-11T23:19:28.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 -- 172.21.15.94:0/3367866650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 msgr2=0x7fae880adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 --2- 172.21.15.94:0/3367866650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae880adc80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fae8806e510 tx=0x7fae7801c450 comp rx=0 tx=0).stop 2024-09-11T23:19:28.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 -- 172.21.15.94:0/3367866650 shutdown_connections 2024-09-11T23:19:28.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 --2- 172.21.15.94:0/3367866650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae880adc80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 --2- 172.21.15.94:0/3367866650 >> v2:172.21.15.155:3300/0 conn(0x7fae88070020 0x7fae8815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 -- 172.21.15.94:0/3367866650 >> 172.21.15.94:0/3367866650 conn(0x7fae880b1f90 msgr2=0x7fae880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 -- 172.21.15.94:0/3367866650 shutdown_connections 2024-09-11T23:19:28.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.317+0000 7fae8dace640 1 -- 172.21.15.94:0/3367866650 wait complete. 2024-09-11T23:19:28.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 Processor -- start 2024-09-11T23:19:28.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 -- start start 2024-09-11T23:19:28.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae88070020 0x7fae8809ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae881520a0 0x7fae880ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae8809bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fae8815f680 con 0x7fae8815f1d0 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fae88073d30 con 0x7fae88070020 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fae88167f10 con 0x7fae881520a0 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae8809bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae8809bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33386/0 (socket says 172.21.15.94:33386) 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 -- 172.21.15.94:0/4067162121 learned_addr learned my addr 172.21.15.94:0/4067162121 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae86ffd640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae881520a0 0x7fae880ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae877fe640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae88070020 0x7fae8809ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 -- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae881520a0 msgr2=0x7fae880ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae881520a0 0x7fae880ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 -- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae88070020 msgr2=0x7fae8809ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae88070020 0x7fae8809ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 -- 172.21.15.94:0/4067162121 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8809b670 con 0x7fae8815f1d0 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae87fff640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae8809bd90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fae7801a080 tx=0x7fae7801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae7ffff640 1 -- 172.21.15.94:0/4067162121 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae78006e20 con 0x7fae8815f1d0 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae7ffff640 1 -- 172.21.15.94:0/4067162121 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae78004230 con 0x7fae8815f1d0 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae7ffff640 1 -- 172.21.15.94:0/4067162121 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae78003620 con 0x7fae8815f1d0 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae880cd760 con 0x7fae8815f1d0 2024-09-11T23:19:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae880cdd20 con 0x7fae8815f1d0 2024-09-11T23:19:28.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8815ec90 con 0x7fae8815f1d0 2024-09-11T23:19:28.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.321+0000 7fae7ffff640 1 -- 172.21.15.94:0/4067162121 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae780037c0 con 0x7fae8815f1d0 2024-09-11T23:19:28.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.325+0000 7fae7ffff640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fae6c0678c0 0x7fae6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.325+0000 7fae7ffff640 1 -- 172.21.15.94:0/4067162121 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7fae78120790 con 0x7fae8815f1d0 2024-09-11T23:19:28.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.325+0000 7fae877fe640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fae6c0678c0 0x7fae6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.325+0000 7fae877fe640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fae6c0678c0 0x7fae6c069d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fae80007fd0 tx=0x7fae80007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.329+0000 7fae7ffff640 1 -- 172.21.15.94:0/4067162121 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae78016070 con 0x7fae8815f1d0 2024-09-11T23:19:28.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.505+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fae8806e540 con 0x7fae8815f1d0 2024-09-11T23:19:28.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae7ffff640 1 -- 172.21.15.94:0/4067162121 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7fae780f1440 con 0x7fae8815f1d0 2024-09-11T23:19:28.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fae6c0678c0 msgr2=0x7fae6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fae6c0678c0 0x7fae6c069d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fae80007fd0 tx=0x7fae80007f00 comp rx=0 tx=0).stop 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 msgr2=0x7fae8809bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae8809bd90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fae7801a080 tx=0x7fae7801ac90 comp rx=0 tx=0).stop 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 shutdown_connections 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fae6c0678c0 0x7fae6c069d80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae8815f1d0 0x7fae8809bd90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae881520a0 0x7fae880ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 --2- 172.21.15.94:0/4067162121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae88070020 0x7fae8809ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 >> 172.21.15.94:0/4067162121 conn(0x7fae880b1f90 msgr2=0x7fae880af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 shutdown_connections 2024-09-11T23:19:28.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.513+0000 7fae8dace640 1 -- 172.21.15.94:0/4067162121 wait complete. 2024-09-11T23:19:28.533 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout' 2024-09-11T23:19:28.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f859e7640 1 Processor -- start 2024-09-11T23:19:28.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f859e7640 1 -- start start 2024-09-11T23:19:28.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f859e7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2f8015bec0 0x7f2f800ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f859e7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2f800af470 0x7f2f8006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f859e7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f800b3290 con 0x7f2f8015c2a0 2024-09-11T23:19:28.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f859e7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2f800b3570 con 0x7f2f800af470 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f859e7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2f800b3850 con 0x7f2f8015bec0 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2f800af470 0x7f2f8006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2f800af470 0x7f2f8006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33402/0 (socket says 172.21.15.94:33402) 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1106143328 learned_addr learned my addr 172.21.15.94:0/1106143328 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7effd640 1 --2- 172.21.15.94:0/1106143328 >> v2:172.21.15.155:3300/0 conn(0x7f2f8015bec0 0x7f2f800ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1106143328 >> v2:172.21.15.155:3300/0 conn(0x7f2f8015bec0 msgr2=0x7f2f800ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7f7fe640 1 --2- 172.21.15.94:0/1106143328 >> v2:172.21.15.155:3300/0 conn(0x7f2f8015bec0 0x7f2f800ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1106143328 >> v1:172.21.15.155:6789/0 conn(0x7f2f8015c2a0 legacy=0x7f2f800aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.653+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1106143328 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f800b3b30 con 0x7f2f800af470 2024-09-11T23:19:28.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f7f7fe640 1 --2- 172.21.15.94:0/1106143328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800af470 0x7f2f8006e000 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2f80071710 tx=0x7f2f7001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef113270e82218 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f7dffb640 1 -- 172.21.15.94:0/1106143328 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700a5840 con 0x7f2f800af470 2024-09-11T23:19:28.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f7dffb640 1 -- 172.21.15.94:0/1106143328 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f700a59e0 con 0x7f2f800af470 2024-09-11T23:19:28.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f7dffb640 1 -- 172.21.15.94:0/1106143328 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700a5db0 con 0x7f2f800af470 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- 172.21.15.94:0/1106143328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800af470 msgr2=0x7f2f8006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1106143328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800af470 0x7f2f8006e000 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2f80071710 tx=0x7f2f7001c980 comp rx=0 tx=0).stop 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- 172.21.15.94:0/1106143328 shutdown_connections 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1106143328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800af470 0x7f2f8006e000 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1106143328 >> v2:172.21.15.155:3300/0 conn(0x7f2f8015bec0 0x7f2f800ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- 172.21.15.94:0/1106143328 >> 172.21.15.94:0/1106143328 conn(0x7f2f800b1f90 msgr2=0x7f2f800b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- 172.21.15.94:0/1106143328 shutdown_connections 2024-09-11T23:19:28.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- 172.21.15.94:0/1106143328 wait complete. 2024-09-11T23:19:28.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 Processor -- start 2024-09-11T23:19:28.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- start start 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f800af470 0x7f2f801554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f8015bec0 0x7f2f8015c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f8015c2a0 0x7f2f8014a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8006ed50 con 0x7f2f8015c2a0 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800ad740 con 0x7f2f8015bec0 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f859e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8006eed0 con 0x7f2f800af470 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.657+0000 7f2f7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f8015c2a0 0x7f2f8014a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f8015c2a0 0x7f2f8014a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33410/0 (socket says 172.21.15.94:33410) 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1985256572 learned_addr learned my addr 172.21.15.94:0/1985256572 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7effd640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f800af470 0x7f2f801554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7e7fc640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f8015bec0 0x7f2f8015c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f800af470 msgr2=0x7f2f801554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f800af470 0x7f2f801554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f8015bec0 msgr2=0x7f2f8015c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f8015bec0 0x7f2f8015c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 -- 172.21.15.94:0/1985256572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f80155bd0 con 0x7f2f8015c2a0 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7e7fc640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f8015bec0 0x7f2f8015c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7f7fe640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f8015c2a0 0x7f2f8014a240 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2f7001a5b0 tx=0x7f2f70019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f77fff640 1 -- 172.21.15.94:0/1985256572 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700b8880 con 0x7f2f8015c2a0 2024-09-11T23:19:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f77fff640 1 -- 172.21.15.94:0/1985256572 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f700be070 con 0x7f2f8015c2a0 2024-09-11T23:19:28.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8015ef00 con 0x7f2f8015c2a0 2024-09-11T23:19:28.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f77fff640 1 -- 172.21.15.94:0/1985256572 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700b8c80 con 0x7f2f8015c2a0 2024-09-11T23:19:28.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8015f4c0 con 0x7f2f8015c2a0 2024-09-11T23:19:28.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f8015f700 con 0x7f2f8015c2a0 2024-09-11T23:19:28.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f77fff640 1 -- 172.21.15.94:0/1985256572 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f700c3460 con 0x7f2f8015c2a0 2024-09-11T23:19:28.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f77fff640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f600678c0 0x7f2f60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f77fff640 1 -- 172.21.15.94:0/1985256572 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f2f70121900 con 0x7f2f8015c2a0 2024-09-11T23:19:28.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.661+0000 7f2f7effd640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f600678c0 0x7f2f60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.665+0000 7f2f7effd640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f600678c0 0x7f2f60069d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2f8014ce70 tx=0x7f2f78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.665+0000 7f2f77fff640 1 -- 172.21.15.94:0/1985256572 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f8015f700 con 0x7f2f8015c2a0 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:28.873+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]} v 0) -- 0x7f2f8006f260 con 0x7f2f8015c2a0 2024-09-11T23:19:29.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.181+0000 7f2f77fff640 1 -- 172.21.15.94:0/1985256572 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]}]=0 v237) ==== 132+0+0 (secure 0 0 0) 0x7f2f700165a0 con 0x7f2f8015c2a0 2024-09-11T23:19:29.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f600678c0 msgr2=0x7f2f60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f600678c0 0x7f2f60069d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2f8014ce70 tx=0x7f2f78008040 comp rx=0 tx=0).stop 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f8015c2a0 msgr2=0x7f2f8014a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f8015c2a0 0x7f2f8014a240 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2f7001a5b0 tx=0x7f2f70019720 comp rx=0 tx=0).stop 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 shutdown_connections 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f600678c0 0x7f2f60069d80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f8015c2a0 0x7f2f8014a240 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f8015bec0 0x7f2f8015c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 --2- 172.21.15.94:0/1985256572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f800af470 0x7f2f801554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 >> 172.21.15.94:0/1985256572 conn(0x7f2f800b1f90 msgr2=0x7f2f80159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 shutdown_connections 2024-09-11T23:19:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.185+0000 7f2f859e7640 1 -- 172.21.15.94:0/1985256572 wait complete. 2024-09-11T23:19:29.208 INFO:tasks.cephfs_test_runner:purge stray file with fancy layout ... ok 2024-09-11T23:19:29.208 INFO:tasks.cephfs_test_runner:Starting test: test_files_throttle (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:19:29.209 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:29.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6467c1640 1 Processor -- start 2024-09-11T23:19:29.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6467c1640 1 -- start start 2024-09-11T23:19:29.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6467c1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff64015c2a0 0x7ff6400aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6467c1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6400af2a0 0x7ff64006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6467c1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6400b3290 con 0x7ff64015bec0 2024-09-11T23:19:29.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6467c1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff6400b3570 con 0x7ff64015c2a0 2024-09-11T23:19:29.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6467c1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6400b3850 con 0x7ff6400af2a0 2024-09-11T23:19:29.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6377fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff64015c2a0 0x7ff6400aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff644d5e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6400af2a0 0x7ff64006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff63ffff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff64015bec0 0x7ff6400ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:41650/0 (socket says 172.21.15.94:41650) 2024-09-11T23:19:29.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff63ffff640 1 -- 172.21.15.94:0/951230174 learned_addr learned my addr 172.21.15.94:0/951230174 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:29.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff644d5e640 1 -- 172.21.15.94:0/951230174 >> v2:172.21.15.155:3300/0 conn(0x7ff64015c2a0 msgr2=0x7ff6400aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:29.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff644d5e640 1 --2- 172.21.15.94:0/951230174 >> v2:172.21.15.155:3300/0 conn(0x7ff64015c2a0 0x7ff6400aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff644d5e640 1 -- 172.21.15.94:0/951230174 >> v1:172.21.15.155:6789/0 conn(0x7ff64015bec0 legacy=0x7ff6400ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff644d5e640 1 -- 172.21.15.94:0/951230174 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6400b3b30 con 0x7ff6400af2a0 2024-09-11T23:19:29.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.329+0000 7ff6377fe640 1 --2- 172.21.15.94:0/951230174 >> v2:172.21.15.155:3300/0 conn(0x7ff64015c2a0 0x7ff6400aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff644d5e640 1 --2- 172.21.15.94:0/951230174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6400af2a0 0x7ff64006e000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff638009d90 tx=0x7ff63801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a90f8a5dd24e9221 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff63f7fe640 1 -- 172.21.15.94:0/951230174 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6380b2070 con 0x7ff6400af2a0 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff63f7fe640 1 -- 172.21.15.94:0/951230174 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6380a5a00 con 0x7ff6400af2a0 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff63f7fe640 1 -- 172.21.15.94:0/951230174 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6380a5dd0 con 0x7ff6400af2a0 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 -- 172.21.15.94:0/951230174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6400af2a0 msgr2=0x7ff64006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 --2- 172.21.15.94:0/951230174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6400af2a0 0x7ff64006e000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff638009d90 tx=0x7ff63801c940 comp rx=0 tx=0).stop 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 -- 172.21.15.94:0/951230174 shutdown_connections 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 --2- 172.21.15.94:0/951230174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6400af2a0 0x7ff64006e000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 --2- 172.21.15.94:0/951230174 >> v2:172.21.15.155:3300/0 conn(0x7ff64015c2a0 0x7ff6400aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 -- 172.21.15.94:0/951230174 >> 172.21.15.94:0/951230174 conn(0x7ff6400b1f90 msgr2=0x7ff6400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 -- 172.21.15.94:0/951230174 shutdown_connections 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 -- 172.21.15.94:0/951230174 wait complete. 2024-09-11T23:19:29.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 Processor -- start 2024-09-11T23:19:29.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.333+0000 7ff6467c1640 1 -- start start 2024-09-11T23:19:29.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400af2a0 0x7ff64013b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64015bec0 0x7ff64014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64015c2a0 0x7ff640155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff64006ed50 con 0x7ff6400af2a0 2024-09-11T23:19:29.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff6400afc90 con 0x7ff64015bec0 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff64006eed0 con 0x7ff64015c2a0 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400af2a0 0x7ff64013b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400af2a0 0x7ff64013b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33422/0 (socket says 172.21.15.94:33422) 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 -- 172.21.15.94:0/1044398007 learned_addr learned my addr 172.21.15.94:0/1044398007 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6377fe640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64015bec0 0x7ff64014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff644d5e640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64015c2a0 0x7ff640155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 -- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64015c2a0 msgr2=0x7ff640155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64015c2a0 0x7ff640155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 -- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64015bec0 msgr2=0x7ff64014d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64015bec0 0x7ff64014d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 -- 172.21.15.94:0/1044398007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff640156920 con 0x7ff6400af2a0 2024-09-11T23:19:29.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63ffff640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400af2a0 0x7ff64013b570 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c450 tx=0x7ff63000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63d7fa640 1 -- 172.21.15.94:0/1044398007 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630017070 con 0x7ff6400af2a0 2024-09-11T23:19:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63d7fa640 1 -- 172.21.15.94:0/1044398007 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff630005cf0 con 0x7ff6400af2a0 2024-09-11T23:19:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff640156c00 con 0x7ff6400af2a0 2024-09-11T23:19:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63d7fa640 1 -- 172.21.15.94:0/1044398007 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630007290 con 0x7ff6400af2a0 2024-09-11T23:19:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff640149810 con 0x7ff6400af2a0 2024-09-11T23:19:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64006e000 con 0x7ff6400af2a0 2024-09-11T23:19:29.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63d7fa640 1 -- 172.21.15.94:0/1044398007 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff63001a070 con 0x7ff6400af2a0 2024-09-11T23:19:29.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63d7fa640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6200678c0 0x7ff620069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff63d7fa640 1 -- 172.21.15.94:0/1044398007 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7ff630084e40 con 0x7ff6400af2a0 2024-09-11T23:19:29.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.337+0000 7ff6377fe640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6200678c0 0x7ff620069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.341+0000 7ff6377fe640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6200678c0 0x7ff620069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff6400b56e0 tx=0x7ff628008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.341+0000 7ff63d7fa640 1 -- 172.21.15.94:0/1044398007 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff630055af0 con 0x7ff6400af2a0 2024-09-11T23:19:29.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.493+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff64006fcd0 con 0x7ff6400af2a0 2024-09-11T23:19:29.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.493+0000 7ff63d7fa640 1 -- 172.21.15.94:0/1044398007 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+13332 (secure 0 0 0) 0x7ff6300553f0 con 0x7ff6400af2a0 2024-09-11T23:19:29.494 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:29.494 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":89,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:28.160888+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6836/3079112947":"2024-09-12T23:19:25.062122+0000","172.21.15.155:6834/3079112947":"2024-09-12T23:19:25.062122+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6200678c0 msgr2=0x7ff620069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6200678c0 0x7ff620069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff6400b56e0 tx=0x7ff628008040 comp rx=0 tx=0).stop 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400af2a0 msgr2=0x7ff64013b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400af2a0 0x7ff64013b570 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c450 tx=0x7ff63000c910 comp rx=0 tx=0).stop 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 shutdown_connections 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64015c2a0 0x7ff640155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64015bec0 0x7ff64014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff6200678c0 0x7ff620069d80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 --2- 172.21.15.94:0/1044398007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400af2a0 0x7ff64013b570 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 >> 172.21.15.94:0/1044398007 conn(0x7ff6400b1f90 msgr2=0x7ff6400afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 shutdown_connections 2024-09-11T23:19:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.497+0000 7ff6467c1640 1 -- 172.21.15.94:0/1044398007 wait complete. 2024-09-11T23:19:29.512 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:15:02.040073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:19:29.512 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:19:29.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.633+0000 7f1320333640 1 Processor -- start 2024-09-11T23:19:29.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.633+0000 7f1320333640 1 -- start start 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f1320333640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f131815bec0 0x7f13180ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f1320333640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13180af470 0x7f131806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f1320333640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13180b3290 con 0x7f131815c2a0 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f1320333640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f13180b3570 con 0x7f131815bec0 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f1320333640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f13180b3850 con 0x7f13180af470 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e0cf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f131815bec0 0x7f13180ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e0cf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f131815bec0 0x7f13180ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33426/0 (socket says 172.21.15.94:33426) 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e0cf640 1 -- 172.21.15.94:0/3022342688 learned_addr learned my addr 172.21.15.94:0/3022342688 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:29.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e8d0640 1 --2- 172.21.15.94:0/3022342688 >> v2:172.21.15.155:3300/0 conn(0x7f13180af470 0x7f131806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e0cf640 1 -- 172.21.15.94:0/3022342688 >> v2:172.21.15.155:3300/0 conn(0x7f13180af470 msgr2=0x7f131806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:29.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e0cf640 1 --2- 172.21.15.94:0/3022342688 >> v2:172.21.15.155:3300/0 conn(0x7f13180af470 0x7f131806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e0cf640 1 -- 172.21.15.94:0/3022342688 >> v1:172.21.15.155:6789/0 conn(0x7f131815c2a0 legacy=0x7f13180aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.637+0000 7f131e0cf640 1 -- 172.21.15.94:0/3022342688 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13180b3b30 con 0x7f131815bec0 2024-09-11T23:19:29.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131e0cf640 1 --2- 172.21.15.94:0/3022342688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f13180ad200 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f13180b2fb0 tx=0x7f131401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1700752fe25505f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d0cd640 1 -- 172.21.15.94:0/3022342688 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13140ab600 con 0x7f131815bec0 2024-09-11T23:19:29.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d0cd640 1 -- 172.21.15.94:0/3022342688 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13140b0070 con 0x7f131815bec0 2024-09-11T23:19:29.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d0cd640 1 -- 172.21.15.94:0/3022342688 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13140ab9c0 con 0x7f131815bec0 2024-09-11T23:19:29.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- 172.21.15.94:0/3022342688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 msgr2=0x7f13180ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 --2- 172.21.15.94:0/3022342688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f13180ad200 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f13180b2fb0 tx=0x7f131401c4f0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- 172.21.15.94:0/3022342688 shutdown_connections 2024-09-11T23:19:29.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 --2- 172.21.15.94:0/3022342688 >> v2:172.21.15.155:3300/0 conn(0x7f13180af470 0x7f131806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 --2- 172.21.15.94:0/3022342688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f13180ad200 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- 172.21.15.94:0/3022342688 >> 172.21.15.94:0/3022342688 conn(0x7f13180b1f90 msgr2=0x7f13180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- 172.21.15.94:0/3022342688 shutdown_connections 2024-09-11T23:19:29.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- 172.21.15.94:0/3022342688 wait complete. 2024-09-11T23:19:29.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 Processor -- start 2024-09-11T23:19:29.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- start start 2024-09-11T23:19:29.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13180af470 0x7f131814df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f131814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f131815c2a0 0x7f131814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f131806ed50 con 0x7f131815bec0 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13180ad740 con 0x7f13180af470 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f1320333640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f131806eed0 con 0x7f131815c2a0 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f131814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f131814f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33434/0 (socket says 172.21.15.94:33434) 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 -- 172.21.15.94:0/2611260560 learned_addr learned my addr 172.21.15.94:0/2611260560 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131e0cf640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13180af470 0x7f131814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131e8d0640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f131815c2a0 0x7f131814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 -- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f131815c2a0 msgr2=0x7f131814cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f131815c2a0 0x7f131814cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 -- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13180af470 msgr2=0x7f131814df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13180af470 0x7f131814df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 -- 172.21.15.94:0/2611260560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13181500c0 con 0x7f131815bec0 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131e0cf640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13180af470 0x7f131814df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131e8d0640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f131815c2a0 0x7f131814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.641+0000 7f131d8ce640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f131814f750 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f130800c3c0 tx=0x7f130800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f130effd640 1 -- 172.21.15.94:0/2611260560 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308017070 con 0x7f131815bec0 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f130effd640 1 -- 172.21.15.94:0/2611260560 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13080052d0 con 0x7f131815bec0 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f130effd640 1 -- 172.21.15.94:0/2611260560 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308003820 con 0x7f131815bec0 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13181503a0 con 0x7f131815bec0 2024-09-11T23:19:29.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131814e450 con 0x7f131815bec0 2024-09-11T23:19:29.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131806f230 con 0x7f131815bec0 2024-09-11T23:19:29.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f130effd640 1 -- 172.21.15.94:0/2611260560 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f130801a070 con 0x7f131815bec0 2024-09-11T23:19:29.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f130effd640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12fc0678f0 0x7f12fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f130effd640 1 -- 172.21.15.94:0/2611260560 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f1308084e70 con 0x7f131815bec0 2024-09-11T23:19:29.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f131e0cf640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12fc0678f0 0x7f12fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.645+0000 7f131e0cf640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12fc0678f0 0x7f12fc069db0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f13140af000 tx=0x7f1314008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.649+0000 7f130effd640 1 -- 172.21.15.94:0/2611260560 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1308005480 con 0x7f131815bec0 2024-09-11T23:19:29.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.809+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f131806fcd0 con 0x7f131815bec0 2024-09-11T23:19:29.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.809+0000 7f130effd640 1 -- 172.21.15.94:0/2611260560 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f1308055b20 con 0x7f131815bec0 2024-09-11T23:19:29.810 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12fc0678f0 msgr2=0x7f12fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12fc0678f0 0x7f12fc069db0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f13140af000 tx=0x7f1314008040 comp rx=0 tx=0).stop 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 msgr2=0x7f131814f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f131814f750 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f130800c3c0 tx=0x7f130800c880 comp rx=0 tx=0).stop 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 shutdown_connections 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f131815c2a0 0x7f131814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12fc0678f0 0x7f12fc069db0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f131815bec0 0x7f131814f750 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 --2- 172.21.15.94:0/2611260560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13180af470 0x7f131814df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 >> 172.21.15.94:0/2611260560 conn(0x7f13180b1f90 msgr2=0x7f131815ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 shutdown_connections 2024-09-11T23:19:29.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.813+0000 7f1320333640 1 -- 172.21.15.94:0/2611260560 wait complete. 2024-09-11T23:19:29.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle' 2024-09-11T23:19:29.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.933+0000 7f9347d2c640 1 Processor -- start 2024-09-11T23:19:29.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.933+0000 7f9347d2c640 1 -- start start 2024-09-11T23:19:29.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9347d2c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f934006fef0 0x7f934006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9347d2c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93400b3d50 0x7f93400b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9347d2c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934006ee50 con 0x7f9340073e60 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9347d2c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f93400b46c0 con 0x7f934006fef0 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9347d2c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f934006f130 con 0x7f93400b3d50 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f93452c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f934006fef0 0x7f934006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9345ac8640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9340073e60 0x7f934015b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50606/0 (socket says 172.21.15.94:50606) 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9345ac8640 1 -- 172.21.15.94:0/1267821136 learned_addr learned my addr 172.21.15.94:0/1267821136 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f93462c9640 1 --2- 172.21.15.94:0/1267821136 >> v2:172.21.15.155:3300/0 conn(0x7f93400b3d50 0x7f93400b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f93452c7640 1 -- 172.21.15.94:0/1267821136 >> v2:172.21.15.155:3300/0 conn(0x7f93400b3d50 msgr2=0x7f93400b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f93452c7640 1 --2- 172.21.15.94:0/1267821136 >> v2:172.21.15.155:3300/0 conn(0x7f93400b3d50 0x7f93400b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f93452c7640 1 -- 172.21.15.94:0/1267821136 >> v1:172.21.15.94:6789/0 conn(0x7f9340073e60 legacy=0x7f934015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f93452c7640 1 -- 172.21.15.94:0/1267821136 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934006f410 con 0x7f934006fef0 2024-09-11T23:19:29.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9344ac6640 1 -- 172.21.15.94:0/1267821136 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111654473 0 0) 0x7f934006ee50 con 0x7f9340073e60 2024-09-11T23:19:29.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f93452c7640 1 --2- 172.21.15.94:0/1267821136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f934006fef0 0x7f934006e800 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f93400afdb0 tx=0x7f933001eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fd8e2bc50eb7ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9344ac6640 1 -- 172.21.15.94:0/1267821136 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300b4070 con 0x7f934006fef0 2024-09-11T23:19:29.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9344ac6640 1 -- 172.21.15.94:0/1267821136 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93300a79a0 con 0x7f934006fef0 2024-09-11T23:19:29.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.937+0000 7f9344ac6640 1 -- 172.21.15.94:0/1267821136 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300a7d70 con 0x7f934006fef0 2024-09-11T23:19:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/1267821136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f934006fef0 msgr2=0x7f934006e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 --2- 172.21.15.94:0/1267821136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f934006fef0 0x7f934006e800 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f93400afdb0 tx=0x7f933001eac0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/1267821136 shutdown_connections 2024-09-11T23:19:29.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 --2- 172.21.15.94:0/1267821136 >> v2:172.21.15.155:3300/0 conn(0x7f93400b3d50 0x7f93400b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 --2- 172.21.15.94:0/1267821136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f934006fef0 0x7f934006e800 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/1267821136 >> 172.21.15.94:0/1267821136 conn(0x7f93400b1f90 msgr2=0x7f93400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/1267821136 shutdown_connections 2024-09-11T23:19:29.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/1267821136 wait complete. 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 Processor -- start 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- start start 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934006fef0 0x7f9340151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9340073e60 0x7f934009a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93400b3d50 0x7f934009a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f93400729a0 con 0x7f93400b3d50 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9340072820 con 0x7f934006fef0 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9340072b20 con 0x7f9340073e60 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93400b3d50 0x7f934009a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93400b3d50 0x7f934009a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44038/0 (socket says 172.21.15.94:44038) 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 -- 172.21.15.94:0/327502300 learned_addr learned my addr 172.21.15.94:0/327502300 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93452c7640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9340073e60 0x7f934009a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9345ac8640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934006fef0 0x7f9340151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 -- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9340073e60 msgr2=0x7f934009a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9340073e60 0x7f934009a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 -- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934006fef0 msgr2=0x7f9340151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934006fef0 0x7f9340151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 -- 172.21.15.94:0/327502300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9340154a50 con 0x7f93400b3d50 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93462c9640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93400b3d50 0x7f934009a8c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9338007e70 tx=0x7f933800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93367fc640 1 -- 172.21.15.94:0/327502300 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338014620 con 0x7f93400b3d50 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93367fc640 1 -- 172.21.15.94:0/327502300 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9338019070 con 0x7f93400b3d50 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934009c400 con 0x7f93400b3d50 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f93367fc640 1 -- 172.21.15.94:0/327502300 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338014a20 con 0x7f93400b3d50 2024-09-11T23:19:29.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934009c9c0 con 0x7f93400b3d50 2024-09-11T23:19:29.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.941+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934006e800 con 0x7f93400b3d50 2024-09-11T23:19:29.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.945+0000 7f93367fc640 1 -- 172.21.15.94:0/327502300 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9338014bc0 con 0x7f93400b3d50 2024-09-11T23:19:29.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.945+0000 7f93367fc640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f93240678c0 0x7f9324069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.945+0000 7f93367fc640 1 -- 172.21.15.94:0/327502300 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f93380864e0 con 0x7f93400b3d50 2024-09-11T23:19:29.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.945+0000 7f9345ac8640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f93240678c0 0x7f9324069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.945+0000 7f9345ac8640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f93240678c0 0x7f9324069d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f933c000f70 tx=0x7f933c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:29.949+0000 7f93367fc640 1 -- 172.21.15.94:0/327502300 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93380570f0 con 0x7f93400b3d50 2024-09-11T23:19:30.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.165+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]} v 0) -- 0x7f93400723f0 con 0x7f93400b3d50 2024-09-11T23:19:30.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.189+0000 7f93367fc640 1 -- 172.21.15.94:0/327502300 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]}]=0 v238) ==== 137+0+0 (secure 0 0 0) 0x7f93380569f0 con 0x7f93400b3d50 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f93240678c0 msgr2=0x7f9324069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f93240678c0 0x7f9324069d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f933c000f70 tx=0x7f933c009040 comp rx=0 tx=0).stop 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93400b3d50 msgr2=0x7f934009a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93400b3d50 0x7f934009a8c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9338007e70 tx=0x7f933800e4b0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 shutdown_connections 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f93240678c0 0x7f9324069d80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93400b3d50 0x7f934009a8c0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9340073e60 0x7f934009a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 --2- 172.21.15.94:0/327502300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934006fef0 0x7f9340151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 >> 172.21.15.94:0/327502300 conn(0x7f93400b1f90 msgr2=0x7f93400afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 shutdown_connections 2024-09-11T23:19:30.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.193+0000 7f9347d2c640 1 -- 172.21.15.94:0/327502300 wait complete. 2024-09-11T23:19:30.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:19:30.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 Processor -- start 2024-09-11T23:19:30.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 -- start start 2024-09-11T23:19:30.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b8161a60 0x7ff7b80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff7b80d2e90 0x7ff7b80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b80cf450 0x7ff7b80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b80d32b0 con 0x7ff7b80d2e90 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b80d0300 con 0x7ff7b80cf450 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7c02d0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b80b0f60 con 0x7ff7b8161a60 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff7b80d2e90 0x7ff7b80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff7b80d2e90 0x7ff7b80cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44044/0 (socket says 172.21.15.94:44044) 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1652891354 learned_addr learned my addr 172.21.15.94:0/1652891354 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7be06c640 1 --2- 172.21.15.94:0/1652891354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b8161a60 0x7ff7b80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7be86d640 1 --2- 172.21.15.94:0/1652891354 >> v2:172.21.15.155:3300/0 conn(0x7ff7b80cf450 0x7ff7b80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1652891354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b8161a60 msgr2=0x7ff7b80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 --2- 172.21.15.94:0/1652891354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b8161a60 0x7ff7b80d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1652891354 >> v2:172.21.15.155:3300/0 conn(0x7ff7b80cf450 msgr2=0x7ff7b80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 --2- 172.21.15.94:0/1652891354 >> v2:172.21.15.155:3300/0 conn(0x7ff7b80cf450 0x7ff7b80d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1652891354 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b80cfd40 con 0x7ff7b80d2e90 2024-09-11T23:19:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7be06c640 1 --2- 172.21.15.94:0/1652891354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b8161a60 0x7ff7b80d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:30.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.333+0000 7ff7be86d640 1 --2- 172.21.15.94:0/1652891354 >> v2:172.21.15.155:3300/0 conn(0x7ff7b80cf450 0x7ff7b80d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:30.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 --2- 172.21.15.94:0/1652891354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80cef10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80d23a0 tx=0x7ff7ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c569cd5236cdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd06a640 1 -- 172.21.15.94:0/1652891354 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0ab620 con 0x7ff7b80d2e90 2024-09-11T23:19:30.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd06a640 1 -- 172.21.15.94:0/1652891354 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0b0070 con 0x7ff7b80d2e90 2024-09-11T23:19:30.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd06a640 1 -- 172.21.15.94:0/1652891354 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0ab9e0 con 0x7ff7b80d2e90 2024-09-11T23:19:30.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1652891354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 msgr2=0x7ff7b80cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1652891354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80cef10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80d23a0 tx=0x7ff7ac01c460 comp rx=0 tx=0).stop 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1652891354 shutdown_connections 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1652891354 >> v2:172.21.15.155:3300/0 conn(0x7ff7b80cf450 0x7ff7b80d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1652891354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80cef10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1652891354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b8161a60 0x7ff7b80d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1652891354 >> 172.21.15.94:0/1652891354 conn(0x7ff7b808bf90 msgr2=0x7ff7b809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1652891354 shutdown_connections 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1652891354 wait complete. 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 Processor -- start 2024-09-11T23:19:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- start start 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b80cf450 0x7ff7b80cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b8161a60 0x7ff7b80b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b806d830 con 0x7ff7b80d2e90 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b806d6b0 con 0x7ff7b8161a60 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7c02d0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b806d9b0 con 0x7ff7b80cf450 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44050/0 (socket says 172.21.15.94:44050) 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1200277557 learned_addr learned my addr 172.21.15.94:0/1200277557 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7be06c640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b80cf450 0x7ff7b80cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7be86d640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b8161a60 0x7ff7b80b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b80cf450 msgr2=0x7ff7b80cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b80cf450 0x7ff7b80cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b8161a60 msgr2=0x7ff7b80b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b8161a60 0x7ff7b80b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7bd86b640 1 -- 172.21.15.94:0/1200277557 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b80ce350 con 0x7ff7b80d2e90 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.337+0000 7ff7be06c640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b80cf450 0x7ff7b80cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7bd86b640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80b17c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0ad040 tx=0x7ff7ac01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7aaffd640 1 -- 172.21.15.94:0/1200277557 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0abd70 con 0x7ff7b80d2e90 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7aaffd640 1 -- 172.21.15.94:0/1200277557 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0be3f0 con 0x7ff7b80d2e90 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b80cd2b0 con 0x7ff7b80d2e90 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7aaffd640 1 -- 172.21.15.94:0/1200277557 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0be7e0 con 0x7ff7b80d2e90 2024-09-11T23:19:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b80cd870 con 0x7ff7b80d2e90 2024-09-11T23:19:30.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b80cef10 con 0x7ff7b80d2e90 2024-09-11T23:19:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7aaffd640 1 -- 172.21.15.94:0/1200277557 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7ac0b43f0 con 0x7ff7b80d2e90 2024-09-11T23:19:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7aaffd640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff79c0678c0 0x7ff79c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7aaffd640 1 -- 172.21.15.94:0/1200277557 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7ff7ac11ff70 con 0x7ff7b80d2e90 2024-09-11T23:19:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7be06c640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff79c0678c0 0x7ff79c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.341+0000 7ff7be06c640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff79c0678c0 0x7ff79c069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4008890 tx=0x7ff7b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.345+0000 7ff7aaffd640 1 -- 172.21.15.94:0/1200277557 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff7ac0c4060 con 0x7ff7b80d2e90 2024-09-11T23:19:30.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.497+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff7b80b3d70 con 0x7ff7b80d2e90 2024-09-11T23:19:30.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.501+0000 7ff7aaffd640 1 -- 172.21.15.94:0/1200277557 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7ff7ac016110 con 0x7ff7b80d2e90 2024-09-11T23:19:30.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff79c0678c0 msgr2=0x7ff79c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff79c0678c0 0x7ff79c069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4008890 tx=0x7ff7b4008040 comp rx=0 tx=0).stop 2024-09-11T23:19:30.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 msgr2=0x7ff7b80b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80b17c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0ad040 tx=0x7ff7ac01aca0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 shutdown_connections 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b8161a60 0x7ff7b80b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff79c0678c0 0x7ff79c069d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff7b80d2e90 0x7ff7b80b17c0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 --2- 172.21.15.94:0/1200277557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b80cf450 0x7ff7b80cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 >> 172.21.15.94:0/1200277557 conn(0x7ff7b808bf90 msgr2=0x7ff7b806dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 shutdown_connections 2024-09-11T23:19:30.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.505+0000 7ff7c02d0640 1 -- 172.21.15.94:0/1200277557 wait complete. 2024-09-11T23:19:30.519 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:19:30.520 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:30.566 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:30.608 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:19:30.608 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:19:30.608 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:30.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:30.614 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:19:30.614 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:30.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:30.656 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:19:30.656 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:30.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:30.661 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:19:30.661 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:30.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:30.703 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:19:30.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:30.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fbd1a640 1 Processor -- start 2024-09-11T23:19:30.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fbd1a640 1 -- start start 2024-09-11T23:19:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fbd1a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72f40b3330 0x7f72f40b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fbd1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72f40b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fbd1a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f40b3c50 con 0x7f72f40b51b0 2024-09-11T23:19:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fbd1a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f72f40d0b80 con 0x7f72f40b3330 2024-09-11T23:19:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fbd1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f72f40d0e60 con 0x7f72f415bc80 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f92b5640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f72f40b51b0 0x7f72f415b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50622/0 (socket says 172.21.15.94:50622) 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f92b5640 1 -- 172.21.15.94:0/976195045 learned_addr learned my addr 172.21.15.94:0/976195045 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f9ab6640 1 --2- 172.21.15.94:0/976195045 >> v2:172.21.15.155:3300/0 conn(0x7f72f40b3330 0x7f72f40b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72f40b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250293725 0 0) 0x7f72f40b3c50 con 0x7f72f40b51b0 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e0003530 con 0x7f72f40b51b0 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 303561623 0 0) 0x7f72e0003530 con 0x7f72f40b51b0 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 msgr2=0x7f72f40b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72f40b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 >> v2:172.21.15.155:3300/0 conn(0x7f72f40b3330 msgr2=0x7f72f40b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 --2- 172.21.15.94:0/976195045 >> v2:172.21.15.155:3300/0 conn(0x7f72f40b3330 0x7f72f40b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f40b46d0 con 0x7f72f40b51b0 2024-09-11T23:19:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f72e4001680 con 0x7f72f40b51b0 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72f40b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 >> v1:172.21.15.94:6789/0 conn(0x7f72f40b51b0 legacy=0x7f72f415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72e00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e0003f00 0x7f72e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72e0004d50 0x7f72e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40d0b80 con 0x7f72e0004d50 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40d0e60 con 0x7f72e0003f00 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f72e000ba80 con 0x7f72f415bc80 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72e0004d50 0x7f72e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f9ab6640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72e00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f92b5640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e0003f00 0x7f72e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 -- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 msgr2=0x7f72e00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72e00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 -- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e0003f00 msgr2=0x7f72e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:30.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e0003f00 0x7f72e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72fa2b7640 1 -- 172.21.15.94:0/976195045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e0003530 con 0x7f72e0004d50 2024-09-11T23:19:30.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f92b5640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e0003f00 0x7f72e0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:30.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.825+0000 7f72f9ab6640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f415bc80 0x7f72e00039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72e0004d50 0x7f72e00051d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f72f00073b0 tx=0x7f72f001cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49de4c109b2fc0a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0009c80 con 0x7f72e0004d50 2024-09-11T23:19:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f00a5da0 con 0x7f72e0004d50 2024-09-11T23:19:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72f8ab4640 1 -- 172.21.15.94:0/976195045 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0003ba0 con 0x7f72e0004d50 2024-09-11T23:19:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 -- 172.21.15.94:0/976195045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72e0004d50 msgr2=0x7f72e00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 --2- 172.21.15.94:0/976195045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72e0004d50 0x7f72e00051d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f72f00073b0 tx=0x7f72f001cea0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fa2b7640 1 -- 172.21.15.94:0/976195045 reap_dead start 2024-09-11T23:19:30.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 -- 172.21.15.94:0/976195045 shutdown_connections 2024-09-11T23:19:30.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 -- 172.21.15.94:0/976195045 >> 172.21.15.94:0/976195045 conn(0x7f72f40b6870 msgr2=0x7f72f40b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 -- 172.21.15.94:0/976195045 shutdown_connections 2024-09-11T23:19:30.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 -- 172.21.15.94:0/976195045 wait complete. 2024-09-11T23:19:30.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 Processor -- start 2024-09-11T23:19:30.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.829+0000 7f72fbd1a640 1 -- start start 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f4142c10 0x7f72f413c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72f413ce80 0x7f72f41f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41f56c0 0x7f72f4139260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4144d00 con 0x7f72f413ce80 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40b4c90 con 0x7f72f41f56c0 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f72f4144e80 con 0x7f72f4142c10 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72f413ce80 0x7f72f41f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72f413ce80 0x7f72f41f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44068/0 (socket says 172.21.15.94:44068) 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 -- 172.21.15.94:0/4227940108 learned_addr learned my addr 172.21.15.94:0/4227940108 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41f56c0 0x7f72f4139260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 -- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f4142c10 msgr2=0x7f72f413c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f4142c10 0x7f72f413c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 -- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41f56c0 msgr2=0x7f72f4139260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41f56c0 0x7f72f4139260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 -- 172.21.15.94:0/4227940108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f413b8a0 con 0x7f72f413ce80 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fa2b7640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41f56c0 0x7f72f4139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f92b5640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72f413ce80 0x7f72f41f5180 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f72e4010d10 tx=0x7f72e400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72ea7fc640 1 -- 172.21.15.94:0/4227940108 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e401b070 con 0x7f72f413ce80 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72ea7fc640 1 -- 172.21.15.94:0/4227940108 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4011040 con 0x7f72f413ce80 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72ea7fc640 1 -- 172.21.15.94:0/4227940108 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e40145c0 con 0x7f72f413ce80 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f413bb80 con 0x7f72f413ce80 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f413c140 con 0x7f72f413ce80 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f41f5aa0 con 0x7f72f413ce80 2024-09-11T23:19:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72ea7fc640 1 -- 172.21.15.94:0/4227940108 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72e401e070 con 0x7f72f413ce80 2024-09-11T23:19:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72ea7fc640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d80678f0 0x7f72d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72ea7fc640 1 -- 172.21.15.94:0/4227940108 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f72e40887c0 con 0x7f72f413ce80 2024-09-11T23:19:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.833+0000 7f72f9ab6640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d80678f0 0x7f72d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.837+0000 7f72f9ab6640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d80678f0 0x7f72d8069db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098b0 tx=0x7f72ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:30.837+0000 7f72ea7fc640 1 -- 172.21.15.94:0/4227940108 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f72f41f5aa0 con 0x7f72f413ce80 2024-09-11T23:19:31.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.021+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72f40b55d0 con 0x7f72f413ce80 2024-09-11T23:19:31.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72ea7fc640 1 -- 172.21.15.94:0/4227940108 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+3914 (secure 0 0 0) 0x7f72e4059470 con 0x7f72f413ce80 2024-09-11T23:19:31.025 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:31.025 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":51,"btime":"2024-09-11T23:19:26:138687+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1178065864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1178065864},{"type":"v1","addr":"172.21.15.155:6836","nonce":1178065864}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2516167567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2516167567},{"type":"v1","addr":"172.21.15.155:6837","nonce":2516167567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/220345316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":220345316},{"type":"v1","addr":"172.21.15.94:6833","nonce":220345316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1893286137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1893286137},{"type":"v1","addr":"172.21.15.94:6835","nonce":1893286137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[]} 2024-09-11T23:19:31.025 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 51 2024-09-11T23:19:31.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d80678f0 msgr2=0x7f72d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d80678f0 0x7f72d8069db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098b0 tx=0x7f72ec008040 comp rx=0 tx=0).stop 2024-09-11T23:19:31.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72f413ce80 msgr2=0x7f72f41f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72f413ce80 0x7f72f41f5180 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f72e4010d10 tx=0x7f72e400e4d0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 shutdown_connections 2024-09-11T23:19:31.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41f56c0 0x7f72f4139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f72d80678f0 0x7f72d8069db0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72f413ce80 0x7f72f41f5180 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 --2- 172.21.15.94:0/4227940108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72f4142c10 0x7f72f413c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 >> 172.21.15.94:0/4227940108 conn(0x7f72f40b6870 msgr2=0x7f72f40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:31.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 shutdown_connections 2024-09-11T23:19:31.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.025+0000 7f72fbd1a640 1 -- 172.21.15.94:0/4227940108 wait complete. 2024-09-11T23:19:31.042 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:19:31.042 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:19:31.043 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:19:31.043 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:31.043 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:19:31.043 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:19:31.043 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:19:31.043 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:31.044 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:19:31.044 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:19:31.044 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:19:31.044 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:31.044 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:19:31.044 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:19:31.044 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:19:31.045 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:31.054 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:19:31.054 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:19:31.057 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:19:31.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:19:31.059 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:19:31.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:19:31.062 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:19:31.062 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:19:31.101 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:19:31.101 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:31.102 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:19:31.102 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:31.107 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:19:31.107 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:31.108 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:19:31.108 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:31.109 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:19:31.165 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:19:31.166 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:19:31.175 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:19:31.177 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:19:31.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.221+0000 7f6a7ef5b640 1 Processor -- start 2024-09-11T23:19:31.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.221+0000 7f6a7ef5b640 1 -- start start 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.221+0000 7f6a7ef5b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.221+0000 7f6a7ef5b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a780d32b0 con 0x7f6a780cf620 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.221+0000 7f6a7ef5b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a780cfad0 con 0x7f6a780d2e90 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.221+0000 7f6a7ef5b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a780d0300 con 0x7f6a78161a60 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7d4f8640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6a780cf620 0x7f6a7806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50638/0 (socket says 172.21.15.94:50638) 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7d4f8640 1 -- 172.21.15.94:0/1013442914 learned_addr learned my addr 172.21.15.94:0/1013442914 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ccf7640 1 --2- 172.21.15.94:0/1013442914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422085633 0 0) 0x7f6a780d32b0 con 0x7f6a780cf620 2024-09-11T23:19:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a68003530 con 0x7f6a780cf620 2024-09-11T23:19:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331479810 0 0) 0x7f6a780cfad0 con 0x7f6a780d2e90 2024-09-11T23:19:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a780d32b0 con 0x7f6a780d2e90 2024-09-11T23:19:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ccf7640 1 -- 172.21.15.94:0/1013442914 >> v1:172.21.15.155:6789/0 conn(0x7f6a780d2e90 legacy=0x7f6a780cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3193922089 0 0) 0x7f6a68003530 con 0x7f6a780cf620 2024-09-11T23:19:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ccf7640 1 -- 172.21.15.94:0/1013442914 >> v1:172.21.15.94:6789/0 conn(0x7f6a780cf620 legacy=0x7f6a7806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ccf7640 1 -- 172.21.15.94:0/1013442914 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a780b0f60 con 0x7f6a78161a60 2024-09-11T23:19:31.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ccf7640 1 --2- 172.21.15.94:0/1013442914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780d2950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0097f0 tx=0x7f6a6c01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b8fd5e13207ac9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0b0070 con 0x7f6a78161a60 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0ab400 con 0x7f6a78161a60 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a777fe640 1 -- 172.21.15.94:0/1013442914 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70001a00 con 0x7f6a78161a60 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/1013442914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 msgr2=0x7f6a780d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/1013442914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780d2950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0097f0 tx=0x7f6a6c01c340 comp rx=0 tx=0).stop 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/1013442914 shutdown_connections 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/1013442914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780d2950 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/1013442914 >> 172.21.15.94:0/1013442914 conn(0x7f6a7808bf90 msgr2=0x7f6a7809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/1013442914 shutdown_connections 2024-09-11T23:19:31.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.225+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/1013442914 wait complete. 2024-09-11T23:19:31.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 Processor -- start 2024-09-11T23:19:31.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 -- start start 2024-09-11T23:19:31.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a780cf620 0x7f6a78150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a780d2e90 0x7f6a780cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7816bf30 con 0x7f6a780cf620 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7806d190 con 0x7f6a780d2e90 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7816c0b0 con 0x7f6a78161a60 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a780cf620 0x7f6a78150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a780cf620 0x7f6a78150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44110/0 (socket says 172.21.15.94:44110) 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 -- 172.21.15.94:0/2775466677 learned_addr learned my addr 172.21.15.94:0/2775466677 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a77fff640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a780d2e90 0x7f6a780cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7d4f8640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 -- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 msgr2=0x7f6a780cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 -- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a780d2e90 msgr2=0x7f6a780cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a780d2e90 0x7f6a780cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 -- 172.21.15.94:0/2775466677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a780cc030 con 0x7f6a780cf620 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7d4f8640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ccf7640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a780cf620 0x7f6a78150140 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0097f0 tx=0x7f6a6c0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a757fa640 1 -- 172.21.15.94:0/2775466677 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0bb070 con 0x7f6a780cf620 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a757fa640 1 -- 172.21.15.94:0/2775466677 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0b7460 con 0x7f6a780cf620 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a780b8290 con 0x7f6a780cf620 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a757fa640 1 -- 172.21.15.94:0/2775466677 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0b0040 con 0x7f6a780cf620 2024-09-11T23:19:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a780cc310 con 0x7f6a780cf620 2024-09-11T23:19:31.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a780b26d0 con 0x7f6a780cf620 2024-09-11T23:19:31.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.229+0000 7f6a757fa640 1 -- 172.21.15.94:0/2775466677 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a6c0be070 con 0x7f6a780cf620 2024-09-11T23:19:31.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.233+0000 7f6a757fa640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a5c0678f0 0x7f6a5c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.233+0000 7f6a757fa640 1 -- 172.21.15.94:0/2775466677 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5335+0+0 (secure 0 0 0) 0x7f6a6c11f950 con 0x7f6a780cf620 2024-09-11T23:19:31.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.233+0000 7f6a77fff640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a5c0678f0 0x7f6a5c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.233+0000 7f6a77fff640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a5c0678f0 0x7f6a5c069db0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6a7815eee0 tx=0x7f6a64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.237+0000 7f6a757fa640 1 -- 172.21.15.94:0/2775466677 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6a6c015ff0 con 0x7f6a780cf620 2024-09-11T23:19:31.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:31.409+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6a780d11a0 con 0x7f6a780cf620 2024-09-11T23:19:32.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.217+0000 7f6a757fa640 1 -- 172.21.15.94:0/2775466677 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) ==== 97+0+0 (secure 0 0 0) 0x7f6a6c0effc0 con 0x7f6a780cf620 2024-09-11T23:19:32.219 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2024-09-11T23:19:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a5c0678f0 msgr2=0x7f6a5c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a5c0678f0 0x7f6a5c069db0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6a7815eee0 tx=0x7f6a64009040 comp rx=0 tx=0).stop 2024-09-11T23:19:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a780cf620 msgr2=0x7f6a78150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a780cf620 0x7f6a78150140 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0097f0 tx=0x7f6a6c0190e0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 shutdown_connections 2024-09-11T23:19:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a78161a60 0x7f6a780cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a780d2e90 0x7f6a780cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6a5c0678f0 0x7f6a5c069db0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 --2- 172.21.15.94:0/2775466677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a780cf620 0x7f6a78150140 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 >> 172.21.15.94:0/2775466677 conn(0x7f6a7808bf90 msgr2=0x7f6a78159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 shutdown_connections 2024-09-11T23:19:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.221+0000 7f6a7ef5b640 1 -- 172.21.15.94:0/2775466677 wait complete. 2024-09-11T23:19:32.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:19:32.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.365+0000 7fd97d6f2640 1 Processor -- start 2024-09-11T23:19:32.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.365+0000 7fd97d6f2640 1 -- start start 2024-09-11T23:19:32.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd97d6f2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd97815c2a0 0x7fd9780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd97d6f2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9780af2a0 0x7fd97806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd97d6f2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9780b3290 con 0x7fd97815bec0 2024-09-11T23:19:32.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd97d6f2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780b3570 con 0x7fd97815c2a0 2024-09-11T23:19:32.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd97d6f2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780b3850 con 0x7fd9780af2a0 2024-09-11T23:19:32.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9767fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd97815c2a0 0x7fd9780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd976ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd97815bec0 0x7fd9780ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50652/0 (socket says 172.21.15.94:50652) 2024-09-11T23:19:32.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd976ffd640 1 -- 172.21.15.94:0/2058544288 learned_addr learned my addr 172.21.15.94:0/2058544288 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:32.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9777fe640 1 --2- 172.21.15.94:0/2058544288 >> v2:172.21.15.155:3300/0 conn(0x7fd9780af2a0 0x7fd97806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9767fc640 1 -- 172.21.15.94:0/2058544288 >> v2:172.21.15.155:3300/0 conn(0x7fd9780af2a0 msgr2=0x7fd97806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:32.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9767fc640 1 --2- 172.21.15.94:0/2058544288 >> v2:172.21.15.155:3300/0 conn(0x7fd9780af2a0 0x7fd97806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9767fc640 1 -- 172.21.15.94:0/2058544288 >> v1:172.21.15.94:6789/0 conn(0x7fd97815bec0 legacy=0x7fd9780ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9767fc640 1 -- 172.21.15.94:0/2058544288 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9780b3b30 con 0x7fd97815c2a0 2024-09-11T23:19:32.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd975ffb640 1 -- 172.21.15.94:0/2058544288 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491743411 0 0) 0x7fd9780b3290 con 0x7fd97815bec0 2024-09-11T23:19:32.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9777fe640 1 --2- 172.21.15.94:0/2058544288 >> v2:172.21.15.155:3300/0 conn(0x7fd9780af2a0 0x7fd97806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:32.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd9767fc640 1 --2- 172.21.15.94:0/2058544288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97815c2a0 0x7fd9780aed60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd9780b2fb0 tx=0x7fd96801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b64a2b6ea5c123e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd975ffb640 1 -- 172.21.15.94:0/2058544288 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680b2070 con 0x7fd97815c2a0 2024-09-11T23:19:32.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd975ffb640 1 -- 172.21.15.94:0/2058544288 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9680a59c0 con 0x7fd97815c2a0 2024-09-11T23:19:32.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.369+0000 7fd975ffb640 1 -- 172.21.15.94:0/2058544288 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680a5d90 con 0x7fd97815c2a0 2024-09-11T23:19:32.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- 172.21.15.94:0/2058544288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97815c2a0 msgr2=0x7fd9780aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/2058544288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97815c2a0 0x7fd9780aed60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd9780b2fb0 tx=0x7fd96801c900 comp rx=0 tx=0).stop 2024-09-11T23:19:32.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- 172.21.15.94:0/2058544288 shutdown_connections 2024-09-11T23:19:32.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/2058544288 >> v2:172.21.15.155:3300/0 conn(0x7fd9780af2a0 0x7fd97806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/2058544288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97815c2a0 0x7fd9780aed60 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- 172.21.15.94:0/2058544288 >> 172.21.15.94:0/2058544288 conn(0x7fd9780b1f90 msgr2=0x7fd9780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- 172.21.15.94:0/2058544288 shutdown_connections 2024-09-11T23:19:32.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- 172.21.15.94:0/2058544288 wait complete. 2024-09-11T23:19:32.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 Processor -- start 2024-09-11T23:19:32.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- start start 2024-09-11T23:19:32.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9780af2a0 0x7fd978155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97815bec0 0x7fd97815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97815c2a0 0x7fd97815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd97806ed50 con 0x7fd9780af2a0 2024-09-11T23:19:32.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd9780af6b0 con 0x7fd97815bec0 2024-09-11T23:19:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd97806eed0 con 0x7fd97815c2a0 2024-09-11T23:19:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9780af2a0 0x7fd978155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9780af2a0 0x7fd978155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44132/0 (socket says 172.21.15.94:44132) 2024-09-11T23:19:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 -- 172.21.15.94:0/973568891 learned_addr learned my addr 172.21.15.94:0/973568891 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:32.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd9777fe640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97815c2a0 0x7fd97815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 -- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97815c2a0 msgr2=0x7fd97815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97815c2a0 0x7fd97815f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd9767fc640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97815bec0 0x7fd97815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 -- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97815bec0 msgr2=0x7fd97815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97815bec0 0x7fd97815eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 -- 172.21.15.94:0/973568891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd978164c20 con 0x7fd9780af2a0 2024-09-11T23:19:32.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd976ffd640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9780af2a0 0x7fd978155210 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd96000c520 tx=0x7fd96000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd96f7fe640 1 -- 172.21.15.94:0/973568891 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960018070 con 0x7fd9780af2a0 2024-09-11T23:19:32.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd96f7fe640 1 -- 172.21.15.94:0/973568891 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9600074e0 con 0x7fd9780af2a0 2024-09-11T23:19:32.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd978164f00 con 0x7fd9780af2a0 2024-09-11T23:19:32.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd96f7fe640 1 -- 172.21.15.94:0/973568891 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600049f0 con 0x7fd9780af2a0 2024-09-11T23:19:32.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.373+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9781654c0 con 0x7fd9780af2a0 2024-09-11T23:19:32.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.377+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97806f1d0 con 0x7fd9780af2a0 2024-09-11T23:19:32.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.377+0000 7fd96f7fe640 1 -- 172.21.15.94:0/973568891 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd96001b070 con 0x7fd9780af2a0 2024-09-11T23:19:32.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.377+0000 7fd96f7fe640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9580678c0 0x7fd958069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.377+0000 7fd96f7fe640 1 -- 172.21.15.94:0/973568891 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7fd960084fb0 con 0x7fd9780af2a0 2024-09-11T23:19:32.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.377+0000 7fd9767fc640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9580678c0 0x7fd958069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.377+0000 7fd9767fc640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9580678c0 0x7fd958069d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd9680af000 tx=0x7fd9680a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.381+0000 7fd96f7fe640 1 -- 172.21.15.94:0/973568891 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd960055c20 con 0x7fd9780af2a0 2024-09-11T23:19:32.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd97806fcd0 con 0x7fd9780af2a0 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd96f7fe640 1 -- 172.21.15.94:0/973568891 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fd960055520 con 0x7fd9780af2a0 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg==", 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:32.594 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ==", 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ==", 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2024-09-11T23:19:32.596 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg==", 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ==", 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.597 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g==", 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.598 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow==", 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA==", 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.599 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw==", 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g==", 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA==", 2024-09-11T23:19:32.601 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA==", 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ==", 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow r", 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw==", 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.603 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ==", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:19:32.604 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw==", 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmAziHChAAz9c8+z77RX+g6eeV2hnBGA==", 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.606 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA==", 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg==", 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:19:32.607 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:19:32.608 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:19:32.608 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:19:32.608 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.608 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.608 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:19:32.608 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9580678c0 msgr2=0x7fd958069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9580678c0 0x7fd958069d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd9680af000 tx=0x7fd9680a7070 comp rx=0 tx=0).stop 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9780af2a0 msgr2=0x7fd978155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9780af2a0 0x7fd978155210 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd96000c520 tx=0x7fd96000c9e0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 shutdown_connections 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97815c2a0 0x7fd97815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97815bec0 0x7fd97815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd9580678c0 0x7fd958069d80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 --2- 172.21.15.94:0/973568891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9780af2a0 0x7fd978155210 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.593+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 >> 172.21.15.94:0/973568891 conn(0x7fd9780b1f90 msgr2=0x7fd9780b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.597+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 shutdown_connections 2024-09-11T23:19:32.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.597+0000 7fd97d6f2640 1 -- 172.21.15.94:0/973568891 wait complete. 2024-09-11T23:19:32.611 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:19:32.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.729+0000 7f5a2814d640 1 Processor -- start 2024-09-11T23:19:32.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.729+0000 7f5a2814d640 1 -- start start 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a2814d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a2015bec0 0x7f5a200ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a2814d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 0x7f5a200aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a2814d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a200b3290 con 0x7f5a200af2a0 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a2814d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a200b3570 con 0x7f5a2015bec0 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a2814d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a200b3850 con 0x7f5a2015c2a0 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a266ea640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5a200af2a0 0x7f5a2015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50666/0 (socket says 172.21.15.94:50666) 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a266ea640 1 -- 172.21.15.94:0/2398686299 learned_addr learned my addr 172.21.15.94:0/2398686299 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a256e8640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 0x7f5a200aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849645199 0 0) 0x7f5a200b3290 con 0x7f5a200af2a0 2024-09-11T23:19:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a0c003530 con 0x7f5a200af2a0 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/2398686299 >> v2:172.21.15.155:3300/0 conn(0x7f5a2015bec0 0x7f5a200ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 775806026 0 0) 0x7f5a0c003530 con 0x7f5a200af2a0 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 msgr2=0x7f5a200aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 0x7f5a200aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 >> v2:172.21.15.155:3300/0 conn(0x7f5a2015bec0 msgr2=0x7f5a200ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 --2- 172.21.15.94:0/2398686299 >> v2:172.21.15.155:3300/0 conn(0x7f5a2015bec0 0x7f5a200ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a200b3b30 con 0x7f5a200af2a0 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f5a18001a00 con 0x7f5a200af2a0 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/2398686299 >> v2:172.21.15.155:3300/0 conn(0x7f5a2015bec0 0x7f5a200ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 >> v1:172.21.15.94:6789/0 conn(0x7f5a200af2a0 legacy=0x7f5a2015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a0c0039c0 0x7f5a0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 0x7f5a0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a0c004d50 0x7f5a0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5a200b3570 con 0x7f5a0c0039c0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a200b3850 con 0x7f5a0c004d50 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0c00b9d0 con 0x7f5a2015c2a0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a0c0039c0 0x7f5a0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a266ea640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a0c004d50 0x7f5a0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a256e8640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 0x7f5a0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 -- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 msgr2=0x7f5a0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 0x7f5a0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 -- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a0c004d50 msgr2=0x7f5a0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a0c004d50 0x7f5a0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a25ee9640 1 -- 172.21.15.94:0/2398686299 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c003530 con 0x7f5a0c0039c0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.733+0000 7f5a256e8640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2015c2a0 0x7f5a0c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a0c0039c0 0x7f5a0c003de0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009900 tx=0x7f5a1c01c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea38ebc2d533013 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00f040 con 0x7f5a0c0039c0 2024-09-11T23:19:32.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c0a8650 con 0x7f5a0c0039c0 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a24ee7640 1 -- 172.21.15.94:0/2398686299 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0a8a00 con 0x7f5a0c0039c0 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- 172.21.15.94:0/2398686299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a0c0039c0 msgr2=0x7f5a0c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 --2- 172.21.15.94:0/2398686299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a0c0039c0 0x7f5a0c003de0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009900 tx=0x7f5a1c01c600 comp rx=0 tx=0).stop 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a266ea640 1 -- 172.21.15.94:0/2398686299 reap_dead start 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- 172.21.15.94:0/2398686299 shutdown_connections 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- 172.21.15.94:0/2398686299 >> 172.21.15.94:0/2398686299 conn(0x7f5a200b1f90 msgr2=0x7f5a200b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- 172.21.15.94:0/2398686299 shutdown_connections 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- 172.21.15.94:0/2398686299 wait complete. 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 Processor -- start 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- start start 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a0c0039c0 0x7f5a2009dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a2014fe50 0x7f5a201584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a20158a30 0x7f5a2015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5a200af6b0 con 0x7f5a2014fe50 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a200ad740 con 0x7f5a20158a30 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a2814d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a20166ff0 con 0x7f5a0c0039c0 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a256e8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a2014fe50 0x7f5a201584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a256e8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a2014fe50 0x7f5a201584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44154/0 (socket says 172.21.15.94:44154) 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.737+0000 7f5a256e8640 1 -- 172.21.15.94:0/3149557453 learned_addr learned my addr 172.21.15.94:0/3149557453 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a0c0039c0 0x7f5a2009dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a266ea640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a20158a30 0x7f5a2015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a256e8640 1 -- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a0c0039c0 msgr2=0x7f5a2009dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a256e8640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a0c0039c0 0x7f5a2009dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a256e8640 1 -- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a20158a30 msgr2=0x7f5a2015a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a256e8640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a20158a30 0x7f5a2015a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a256e8640 1 -- 172.21.15.94:0/3149557453 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a20160c10 con 0x7f5a2014fe50 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a256e8640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a2014fe50 0x7f5a201584f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f5a10010930 tx=0x7f5a10010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a167fc640 1 -- 172.21.15.94:0/3149557453 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000f040 con 0x7f5a2014fe50 2024-09-11T23:19:32.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a167fc640 1 -- 172.21.15.94:0/3149557453 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a10004220 con 0x7f5a2014fe50 2024-09-11T23:19:32.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a201f9000 con 0x7f5a2014fe50 2024-09-11T23:19:32.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a167fc640 1 -- 172.21.15.94:0/3149557453 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000e900 con 0x7f5a2014fe50 2024-09-11T23:19:32.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a201f95c0 con 0x7f5a2014fe50 2024-09-11T23:19:32.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a200ad200 con 0x7f5a2014fe50 2024-09-11T23:19:32.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a167fc640 1 -- 172.21.15.94:0/3149557453 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a1000eaa0 con 0x7f5a2014fe50 2024-09-11T23:19:32.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a167fc640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5a040678f0 0x7f5a04069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a167fc640 1 -- 172.21.15.94:0/3149557453 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7f5a10085d90 con 0x7f5a2014fe50 2024-09-11T23:19:32.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5a040678f0 0x7f5a04069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.741+0000 7f5a25ee9640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5a040678f0 0x7f5a04069db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0af000 tx=0x7f5a1c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.745+0000 7f5a167fc640 1 -- 172.21.15.94:0/3149557453 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a20160c10 con 0x7f5a2014fe50 2024-09-11T23:19:32.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5a20160150 con 0x7f5a2014fe50 2024-09-11T23:19:32.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a167fc640 1 -- 172.21.15.94:0/3149557453 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) ==== 84+0+65 (secure 0 0 0) 0x7f5a10018030 con 0x7f5a2014fe50 2024-09-11T23:19:32.910 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:32.910 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:19:32.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:19:32.910 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:19:32.910 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:19:32.910 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:32.910 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5a040678f0 msgr2=0x7f5a04069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5a040678f0 0x7f5a04069db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0af000 tx=0x7f5a1c0046d0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a2014fe50 msgr2=0x7f5a201584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a2014fe50 0x7f5a201584f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f5a10010930 tx=0x7f5a10010df0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 shutdown_connections 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a20158a30 0x7f5a2015a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f5a040678f0 0x7f5a04069db0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a2014fe50 0x7f5a201584f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 --2- 172.21.15.94:0/3149557453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a0c0039c0 0x7f5a2009dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 >> 172.21.15.94:0/3149557453 conn(0x7f5a200b1f90 msgr2=0x7f5a201551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 shutdown_connections 2024-09-11T23:19:32.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:32.909+0000 7f5a2814d640 1 -- 172.21.15.94:0/3149557453 wait complete. 2024-09-11T23:19:32.928 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:19:32.928 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:19:33.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b91f0640 1 Processor -- start 2024-09-11T23:19:33.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b91f0640 1 -- start start 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b91f0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09b415bec0 0x7f09b40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b91f0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f09b40af470 0x7f09b406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b91f0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b40b3290 con 0x7f09b415c2a0 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b91f0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f09b40b3570 con 0x7f09b40af470 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b91f0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f09b40b3850 con 0x7f09b415bec0 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b359e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f09b40af470 0x7f09b406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b359e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f09b40af470 0x7f09b406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44162/0 (socket says 172.21.15.94:44162) 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b359e640 1 -- 172.21.15.94:0/3597141053 learned_addr learned my addr 172.21.15.94:0/3597141053 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b359e640 1 -- 172.21.15.94:0/3597141053 >> v2:172.21.15.155:3300/0 conn(0x7f09b415bec0 msgr2=0x7f09b40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b359e640 1 --2- 172.21.15.94:0/3597141053 >> v2:172.21.15.155:3300/0 conn(0x7f09b415bec0 0x7f09b40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b359e640 1 -- 172.21.15.94:0/3597141053 >> v1:172.21.15.155:6789/0 conn(0x7f09b415c2a0 legacy=0x7f09b40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:33.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.041+0000 7f09b359e640 1 -- 172.21.15.94:0/3597141053 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b40b3b30 con 0x7f09b40af470 2024-09-11T23:19:33.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b359e640 1 --2- 172.21.15.94:0/3597141053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b40af470 0x7f09b406e000 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f09b4071710 tx=0x7f09a401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dadded8ed6007b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b1d9b640 1 -- 172.21.15.94:0/3597141053 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a40aa610 con 0x7f09b40af470 2024-09-11T23:19:33.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b1d9b640 1 -- 172.21.15.94:0/3597141053 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a40af070 con 0x7f09b40af470 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b1d9b640 1 -- 172.21.15.94:0/3597141053 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a40aa9d0 con 0x7f09b40af470 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 -- 172.21.15.94:0/3597141053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b40af470 msgr2=0x7f09b406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 --2- 172.21.15.94:0/3597141053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b40af470 0x7f09b406e000 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f09b4071710 tx=0x7f09a401c4b0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 -- 172.21.15.94:0/3597141053 shutdown_connections 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 --2- 172.21.15.94:0/3597141053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b40af470 0x7f09b406e000 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 --2- 172.21.15.94:0/3597141053 >> v2:172.21.15.155:3300/0 conn(0x7f09b415bec0 0x7f09b40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 -- 172.21.15.94:0/3597141053 >> 172.21.15.94:0/3597141053 conn(0x7f09b40b1f90 msgr2=0x7f09b40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 -- 172.21.15.94:0/3597141053 shutdown_connections 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 -- 172.21.15.94:0/3597141053 wait complete. 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 Processor -- start 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.045+0000 7f09b91f0640 1 -- start start 2024-09-11T23:19:33.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09b40af470 0x7f09b41f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09b415bec0 0x7f09b40b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b415c2a0 0x7f09b40b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f09b406ed50 con 0x7f09b415c2a0 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f09b40ad740 con 0x7f09b415bec0 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f09b406eed0 con 0x7f09b40af470 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b415c2a0 0x7f09b40b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b415c2a0 0x7f09b40b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44168/0 (socket says 172.21.15.94:44168) 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 -- 172.21.15.94:0/2241562426 learned_addr learned my addr 172.21.15.94:0/2241562426 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b259c640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09b415bec0 0x7f09b40b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 -- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09b40af470 msgr2=0x7f09b41f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b2d9d640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09b40af470 0x7f09b41f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09b40af470 0x7f09b41f7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 -- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09b415bec0 msgr2=0x7f09b40b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09b415bec0 0x7f09b40b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 -- 172.21.15.94:0/2241562426 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b41f7cb0 con 0x7f09b415c2a0 2024-09-11T23:19:33.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b259c640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09b415bec0 0x7f09b40b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:33.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b359e640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b415c2a0 0x7f09b40b1490 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f09a40ac040 tx=0x7f09a401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09ab7fe640 1 -- 172.21.15.94:0/2241562426 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a40bd5f0 con 0x7f09b415c2a0 2024-09-11T23:19:33.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09ab7fe640 1 -- 172.21.15.94:0/2241562426 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a40bd790 con 0x7f09b415c2a0 2024-09-11T23:19:33.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b41f7f90 con 0x7f09b415c2a0 2024-09-11T23:19:33.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09ab7fe640 1 -- 172.21.15.94:0/2241562426 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a40bdb80 con 0x7f09b415c2a0 2024-09-11T23:19:33.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b41f8550 con 0x7f09b415c2a0 2024-09-11T23:19:33.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b40cf660 con 0x7f09b415c2a0 2024-09-11T23:19:33.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09ab7fe640 1 -- 172.21.15.94:0/2241562426 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09a40b33f0 con 0x7f09b415c2a0 2024-09-11T23:19:33.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09ab7fe640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09940678c0 0x7f0994069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09ab7fe640 1 -- 172.21.15.94:0/2241562426 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7f09a41209e0 con 0x7f09b415c2a0 2024-09-11T23:19:33.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b2d9d640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09940678c0 0x7f0994069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.049+0000 7f09b2d9d640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09940678c0 0x7f0994069d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00a830 tx=0x7f09ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.053+0000 7f09ab7fe640 1 -- 172.21.15.94:0/2241562426 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09a40c3060 con 0x7f09b415c2a0 2024-09-11T23:19:33.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.213+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f09b40cf660 con 0x7f09b415c2a0 2024-09-11T23:19:33.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.505+0000 7f09ab7fe640 1 -- 172.21.15.94:0/2241562426 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) ==== 138+0+0 (secure 0 0 0) 0x7f09a40a7070 con 0x7f09b415c2a0 2024-09-11T23:19:33.507 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:19:33.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09940678c0 msgr2=0x7f0994069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09940678c0 0x7f0994069d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00a830 tx=0x7f09ac008040 comp rx=0 tx=0).stop 2024-09-11T23:19:33.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b415c2a0 msgr2=0x7f09b40b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b415c2a0 0x7f09b40b1490 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f09a40ac040 tx=0x7f09a401acf0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 shutdown_connections 2024-09-11T23:19:33.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f09940678c0 0x7f0994069d80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09b415c2a0 0x7f09b40b1490 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09b415bec0 0x7f09b40b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 --2- 172.21.15.94:0/2241562426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09b40af470 0x7f09b41f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 >> 172.21.15.94:0/2241562426 conn(0x7f09b40b1f90 msgr2=0x7f09b414f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.509+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 shutdown_connections 2024-09-11T23:19:33.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.513+0000 7f09b91f0640 1 -- 172.21.15.94:0/2241562426 wait complete. 2024-09-11T23:19:33.535 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:19:33.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.661+0000 7fcd134a5640 1 Processor -- start 2024-09-11T23:19:33.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.661+0000 7fcd134a5640 1 -- start start 2024-09-11T23:19:33.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.661+0000 7fcd134a5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcd0c15e570 0x7fcd0c0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.661+0000 7fcd134a5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcd0c0d4b10 0x7fcd0c0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.661+0000 7fcd134a5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd0c0b4160 con 0x7fcd0c0d4f80 2024-09-11T23:19:33.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.661+0000 7fcd134a5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c0cf1d0 con 0x7fcd0c15e570 2024-09-11T23:19:33.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.661+0000 7fcd134a5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c0cf770 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcd0c15e570 0x7fcd0c0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcd0c15e570 0x7fcd0c0b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44184/0 (socket says 172.21.15.94:44184) 2024-09-11T23:19:33.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 -- 172.21.15.94:0/2888627297 learned_addr learned my addr 172.21.15.94:0/2888627297 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:33.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd10a40640 1 --2- 172.21.15.94:0/2888627297 >> v2:172.21.15.155:3300/0 conn(0x7fcd0c0d4b10 0x7fcd0c0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 -- 172.21.15.94:0/2888627297 >> v2:172.21.15.155:3300/0 conn(0x7fcd0c0d4b10 msgr2=0x7fcd0c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:33.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 --2- 172.21.15.94:0/2888627297 >> v2:172.21.15.155:3300/0 conn(0x7fcd0c0d4b10 0x7fcd0c0d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 -- 172.21.15.94:0/2888627297 >> v1:172.21.15.155:6789/0 conn(0x7fcd0c0d4f80 legacy=0x7fcd0c0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 -- 172.21.15.94:0/2888627297 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c0d3080 con 0x7fcd0c15e570 2024-09-11T23:19:33.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd11241640 1 --2- 172.21.15.94:0/2888627297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c15e570 0x7fcd0c0b3c20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0c7f00 tx=0x7fcd0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac83f2a6e352576c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd03fff640 1 -- 172.21.15.94:0/2888627297 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd080b0070 con 0x7fcd0c15e570 2024-09-11T23:19:33.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd03fff640 1 -- 172.21.15.94:0/2888627297 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd080ab600 con 0x7fcd0c15e570 2024-09-11T23:19:33.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd03fff640 1 -- 172.21.15.94:0/2888627297 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd080ab9d0 con 0x7fcd0c15e570 2024-09-11T23:19:33.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 -- 172.21.15.94:0/2888627297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c15e570 msgr2=0x7fcd0c0b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2888627297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c15e570 0x7fcd0c0b3c20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0c7f00 tx=0x7fcd0801c460 comp rx=0 tx=0).stop 2024-09-11T23:19:33.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 -- 172.21.15.94:0/2888627297 shutdown_connections 2024-09-11T23:19:33.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2888627297 >> v2:172.21.15.155:3300/0 conn(0x7fcd0c0d4b10 0x7fcd0c0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2888627297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c15e570 0x7fcd0c0b3c20 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 -- 172.21.15.94:0/2888627297 >> 172.21.15.94:0/2888627297 conn(0x7fcd0c08bf90 msgr2=0x7fcd0c0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 -- 172.21.15.94:0/2888627297 shutdown_connections 2024-09-11T23:19:33.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.665+0000 7fcd134a5640 1 -- 172.21.15.94:0/2888627297 wait complete. 2024-09-11T23:19:33.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 Processor -- start 2024-09-11T23:19:33.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 -- start start 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c0d4b10 0x7fcd0c0b9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd0c0d4f80 0x7fcd0c0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd0c15e570 0x7fcd0c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c0d2d10 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c0d0720 con 0x7fcd0c0d4f80 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c15e950 con 0x7fcd0c15e570 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c0d4b10 0x7fcd0c0b9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c0d4b10 0x7fcd0c0b9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44194/0 (socket says 172.21.15.94:44194) 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 -- 172.21.15.94:0/2971664416 learned_addr learned my addr 172.21.15.94:0/2971664416 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:33.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11a42640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd0c15e570 0x7fcd0c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd10a40640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd0c0d4f80 0x7fcd0c0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 -- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd0c15e570 msgr2=0x7fcd0c1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd0c15e570 0x7fcd0c1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 -- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd0c0d4f80 msgr2=0x7fcd0c0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd0c0d4f80 0x7fcd0c0cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 -- 172.21.15.94:0/2971664416 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c0cc9c0 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd10a40640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd0c0d4f80 0x7fcd0c0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd11241640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c0d4b10 0x7fcd0c0b9d50 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fcd080ae040 tx=0x7fcd0801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd01ffb640 1 -- 172.21.15.94:0/2971664416 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd080ba020 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd01ffb640 1 -- 172.21.15.94:0/2971664416 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd080b6620 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd01ffb640 1 -- 172.21.15.94:0/2971664416 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd080b0040 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c0ccca0 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c0cd260 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.669+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c0d0d80 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.673+0000 7fcd01ffb640 1 -- 172.21.15.94:0/2971664416 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd080bd020 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.673+0000 7fcd01ffb640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fccf00678c0 0x7fccf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.673+0000 7fcd01ffb640 1 -- 172.21.15.94:0/2971664416 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5619+0+0 (secure 0 0 0) 0x7fcd081202d0 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.673+0000 7fcd10a40640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fccf00678c0 0x7fccf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.673+0000 7fcd10a40640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fccf00678c0 0x7fccf0069d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c157c30 tx=0x7fccfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.677+0000 7fcd01ffb640 1 -- 172.21.15.94:0/2971664416 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcd080c4030 con 0x7fcd0c0d4b10 2024-09-11T23:19:33.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:33.837+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcd0c0ba380 con 0x7fcd0c0d4b10 2024-09-11T23:19:34.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.509+0000 7fcd01ffb640 1 -- 172.21.15.94:0/2971664416 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) ==== 170+0+0 (secure 0 0 0) 0x7fcd08016110 con 0x7fcd0c0d4b10 2024-09-11T23:19:34.512 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:19:34.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.513+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fccf00678c0 msgr2=0x7fccf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.513+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fccf00678c0 0x7fccf0069d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c157c30 tx=0x7fccfc008040 comp rx=0 tx=0).stop 2024-09-11T23:19:34.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.513+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c0d4b10 msgr2=0x7fcd0c0b9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.513+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c0d4b10 0x7fcd0c0b9d50 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fcd080ae040 tx=0x7fcd0801aca0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.517+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 shutdown_connections 2024-09-11T23:19:34.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.517+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd0c15e570 0x7fcd0c1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.517+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd0c0d4f80 0x7fcd0c0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.517+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fccf00678c0 0x7fccf0069d80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.517+0000 7fcd134a5640 1 --2- 172.21.15.94:0/2971664416 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd0c0d4b10 0x7fcd0c0b9d50 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.517+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 >> 172.21.15.94:0/2971664416 conn(0x7fcd0c08bf90 msgr2=0x7fcd0c06e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:34.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.529+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 shutdown_connections 2024-09-11T23:19:34.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.529+0000 7fcd134a5640 1 -- 172.21.15.94:0/2971664416 wait complete. 2024-09-11T23:19:34.568 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:19:34.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.689+0000 7f0ba3368640 1 Processor -- start 2024-09-11T23:19:34.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba3368640 1 -- start start 2024-09-11T23:19:34.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba3368640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15bec0 0x7f0b9c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba3368640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b9c15c2a0 0x7f0b9c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba3368640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c0af2a0 0x7f0b9c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba3368640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9c0b3290 con 0x7f0b9c15bec0 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba3368640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9c0b3570 con 0x7f0b9c15c2a0 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba3368640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9c0b3850 con 0x7f0b9c0af2a0 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15bec0 0x7f0b9c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15bec0 0x7f0b9c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44196/0 (socket says 172.21.15.94:44196) 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 -- 172.21.15.94:0/468984560 learned_addr learned my addr 172.21.15.94:0/468984560 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba0903640 1 --2- 172.21.15.94:0/468984560 >> v2:172.21.15.155:3300/0 conn(0x7f0b9c15c2a0 0x7f0b9c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 -- 172.21.15.94:0/468984560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c0af2a0 msgr2=0x7f0b9c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 --2- 172.21.15.94:0/468984560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c0af2a0 0x7f0b9c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 -- 172.21.15.94:0/468984560 >> v2:172.21.15.155:3300/0 conn(0x7f0b9c15c2a0 msgr2=0x7f0b9c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 --2- 172.21.15.94:0/468984560 >> v2:172.21.15.155:3300/0 conn(0x7f0b9c15c2a0 0x7f0b9c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 -- 172.21.15.94:0/468984560 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c0b3b30 con 0x7f0b9c15bec0 2024-09-11T23:19:34.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.693+0000 7f0ba1104640 1 --2- 172.21.15.94:0/468984560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0ad200 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0ae510 tx=0x7f0b9401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b071a0ef289037 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:34.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0b93fff640 1 -- 172.21.15.94:0/468984560 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b940a5580 con 0x7f0b9c15bec0 2024-09-11T23:19:34.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0b93fff640 1 -- 172.21.15.94:0/468984560 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b940a5720 con 0x7f0b9c15bec0 2024-09-11T23:19:34.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0b93fff640 1 -- 172.21.15.94:0/468984560 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b940a5af0 con 0x7f0b9c15bec0 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- 172.21.15.94:0/468984560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 msgr2=0x7f0b9c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 --2- 172.21.15.94:0/468984560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0ad200 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0ae510 tx=0x7f0b9401c700 comp rx=0 tx=0).stop 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- 172.21.15.94:0/468984560 shutdown_connections 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 --2- 172.21.15.94:0/468984560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c0af2a0 0x7f0b9c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 --2- 172.21.15.94:0/468984560 >> v2:172.21.15.155:3300/0 conn(0x7f0b9c15c2a0 0x7f0b9c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 --2- 172.21.15.94:0/468984560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0ad200 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- 172.21.15.94:0/468984560 >> 172.21.15.94:0/468984560 conn(0x7f0b9c0b1f90 msgr2=0x7f0b9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- 172.21.15.94:0/468984560 shutdown_connections 2024-09-11T23:19:34.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- 172.21.15.94:0/468984560 wait complete. 2024-09-11T23:19:34.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 Processor -- start 2024-09-11T23:19:34.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- start start 2024-09-11T23:19:34.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b9c0af2a0 0x7f0b9c099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c15c2a0 0x7f0b9c0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c0ad740 con 0x7f0b9c15bec0 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c0af710 con 0x7f0b9c0af2a0 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba3368640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9c06e000 con 0x7f0b9c15c2a0 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44204/0 (socket says 172.21.15.94:44204) 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 -- 172.21.15.94:0/15553518 learned_addr learned my addr 172.21.15.94:0/15553518 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba1905640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c15c2a0 0x7f0b9c0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba1104640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b9c0af2a0 0x7f0b9c099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 -- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c15c2a0 msgr2=0x7f0b9c0b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c15c2a0 0x7f0b9c0b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 -- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b9c0af2a0 msgr2=0x7f0b9c099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b9c0af2a0 0x7f0b9c099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba0903640 1 -- 172.21.15.94:0/15553518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c1f5730 con 0x7f0b9c15bec0 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.697+0000 7f0ba1104640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b9c0af2a0 0x7f0b9c099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0ba0903640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0aff00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c5e0 tx=0x7f0b8c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0b91ffb640 1 -- 172.21.15.94:0/15553518 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c015070 con 0x7f0b9c15bec0 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0b91ffb640 1 -- 172.21.15.94:0/15553518 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c004220 con 0x7f0b9c15bec0 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c1f5a10 con 0x7f0b9c15bec0 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0b91ffb640 1 -- 172.21.15.94:0/15553518 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c003620 con 0x7f0b9c15bec0 2024-09-11T23:19:34.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c1f5fd0 con 0x7f0b9c15bec0 2024-09-11T23:19:34.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9c1f61d0 con 0x7f0b9c15bec0 2024-09-11T23:19:34.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0b91ffb640 1 -- 172.21.15.94:0/15553518 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b8c0037e0 con 0x7f0b9c15bec0 2024-09-11T23:19:34.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0b91ffb640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0b800678c0 0x7f0b80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0b91ffb640 1 -- 172.21.15.94:0/15553518 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6001+0+0 (secure 0 0 0) 0x7f0b8c085bd0 con 0x7f0b9c15bec0 2024-09-11T23:19:34.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0ba1104640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0b800678c0 0x7f0b80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.701+0000 7f0ba1104640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0b800678c0 0x7f0b80069d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0b940ae000 tx=0x7f0b940a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:34.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.705+0000 7f0b91ffb640 1 -- 172.21.15.94:0/15553518 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0b8c0565e0 con 0x7f0b9c15bec0 2024-09-11T23:19:34.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:34.905+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0b9c0ad200 con 0x7f0b9c15bec0 2024-09-11T23:19:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.541+0000 7f0b91ffb640 1 -- 172.21.15.94:0/15553518 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v53) ==== 174+0+0 (secure 0 0 0) 0x7f0b8c055ee0 con 0x7f0b9c15bec0 2024-09-11T23:19:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 15 and data pool 16 2024-09-11T23:19:35.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0b800678c0 msgr2=0x7f0b80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0b800678c0 0x7f0b80069d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0b940ae000 tx=0x7f0b940a7070 comp rx=0 tx=0).stop 2024-09-11T23:19:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 msgr2=0x7f0b9c0aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0aff00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c5e0 tx=0x7f0b8c00caa0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 shutdown_connections 2024-09-11T23:19:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b9c15c2a0 0x7f0b9c0b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0b800678c0 0x7f0b80069d80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15bec0 0x7f0b9c0aff00 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 --2- 172.21.15.94:0/15553518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b9c0af2a0 0x7f0b9c099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 >> 172.21.15.94:0/15553518 conn(0x7f0b9c0b1f90 msgr2=0x7f0b9c075230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 shutdown_connections 2024-09-11T23:19:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.545+0000 7f0ba3368640 1 -- 172.21.15.94:0/15553518 wait complete. 2024-09-11T23:19:35.571 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:35.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.685+0000 7f49cdfc8640 1 Processor -- start 2024-09-11T23:19:35.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.685+0000 7f49cdfc8640 1 -- start start 2024-09-11T23:19:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49cdfc8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49c80d3060 0x7f49c80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49cdfc8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f49c80cf450 0x7f49c806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49cdfc8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c80d0300 con 0x7f49c8161a60 2024-09-11T23:19:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49cdfc8640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f49c80b0f60 con 0x7f49c80cf450 2024-09-11T23:19:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49cdfc8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f49c80cfd40 con 0x7f49c80d3060 2024-09-11T23:19:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f49c80cf450 0x7f49c806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f49c80cf450 0x7f49c806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44214/0 (socket says 172.21.15.94:44214) 2024-09-11T23:19:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 -- 172.21.15.94:0/2067148866 learned_addr learned my addr 172.21.15.94:0/2067148866 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 -- 172.21.15.94:0/2067148866 >> v2:172.21.15.155:3300/0 conn(0x7f49c80d3060 msgr2=0x7f49c80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 --2- 172.21.15.94:0/2067148866 >> v2:172.21.15.155:3300/0 conn(0x7f49c80d3060 0x7f49c80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 -- 172.21.15.94:0/2067148866 >> v1:172.21.15.155:6789/0 conn(0x7f49c8161a60 legacy=0x7f49c80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 -- 172.21.15.94:0/2067148866 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c80d0020 con 0x7f49c80cf450 2024-09-11T23:19:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c7fff640 1 --2- 172.21.15.94:0/2067148866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c80cf450 0x7f49c806d6b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f49c808d850 tx=0x7f49c001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362900fda35cbca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c67fc640 1 -- 172.21.15.94:0/2067148866 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00b0070 con 0x7f49c80cf450 2024-09-11T23:19:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c67fc640 1 -- 172.21.15.94:0/2067148866 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c00ab600 con 0x7f49c80cf450 2024-09-11T23:19:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.689+0000 7f49c67fc640 1 -- 172.21.15.94:0/2067148866 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00ab9d0 con 0x7f49c80cf450 2024-09-11T23:19:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- 172.21.15.94:0/2067148866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c80cf450 msgr2=0x7f49c806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/2067148866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c80cf450 0x7f49c806d6b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f49c808d850 tx=0x7f49c001c240 comp rx=0 tx=0).stop 2024-09-11T23:19:35.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- 172.21.15.94:0/2067148866 shutdown_connections 2024-09-11T23:19:35.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/2067148866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c80cf450 0x7f49c806d6b0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/2067148866 >> v2:172.21.15.155:3300/0 conn(0x7f49c80d3060 0x7f49c80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- 172.21.15.94:0/2067148866 >> 172.21.15.94:0/2067148866 conn(0x7f49c808bf90 msgr2=0x7f49c809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:35.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- 172.21.15.94:0/2067148866 shutdown_connections 2024-09-11T23:19:35.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- 172.21.15.94:0/2067148866 wait complete. 2024-09-11T23:19:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 Processor -- start 2024-09-11T23:19:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- start start 2024-09-11T23:19:35.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49c80cf450 0x7f49c80b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49c80d3060 0x7f49c8159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c8161a60 0x7f49c81533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f49c806e400 con 0x7f49c8161a60 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80cfad0 con 0x7f49c80cf450 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49c806e580 con 0x7f49c80d3060 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c8161a60 0x7f49c81533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c8161a60 0x7f49c81533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44216/0 (socket says 172.21.15.94:44216) 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 -- 172.21.15.94:0/779481484 learned_addr learned my addr 172.21.15.94:0/779481484 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c77fe640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49c80cf450 0x7f49c80b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 -- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49c80d3060 msgr2=0x7f49c8159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c6ffd640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49c80d3060 0x7f49c8159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49c80d3060 0x7f49c8159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 -- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49c80cf450 msgr2=0x7f49c80b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49c80cf450 0x7f49c80b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 -- 172.21.15.94:0/779481484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c80b79f0 con 0x7f49c8161a60 2024-09-11T23:19:35.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49c7fff640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c8161a60 0x7f49c81533d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f49c00ae040 tx=0x7f49c001aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49bffff640 1 -- 172.21.15.94:0/779481484 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00ba020 con 0x7f49c8161a60 2024-09-11T23:19:35.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49bffff640 1 -- 172.21.15.94:0/779481484 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c00b6640 con 0x7f49c8161a60 2024-09-11T23:19:35.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c80b17c0 con 0x7f49c8161a60 2024-09-11T23:19:35.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49bffff640 1 -- 172.21.15.94:0/779481484 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00b0040 con 0x7f49c8161a60 2024-09-11T23:19:35.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.693+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c80b76e0 con 0x7f49c8161a60 2024-09-11T23:19:35.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.697+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c806d6b0 con 0x7f49c8161a60 2024-09-11T23:19:35.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.697+0000 7f49bffff640 1 -- 172.21.15.94:0/779481484 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49c00bd020 con 0x7f49c8161a60 2024-09-11T23:19:35.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.697+0000 7f49bffff640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49a80678c0 0x7f49a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.697+0000 7f49bffff640 1 -- 172.21.15.94:0/779481484 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f49c0120000 con 0x7f49c8161a60 2024-09-11T23:19:35.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.697+0000 7f49c77fe640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49a80678c0 0x7f49a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.697+0000 7f49c77fe640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49a80678c0 0x7f49a8069d80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f49b8001cf0 tx=0x7f49b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.701+0000 7f49bffff640 1 -- 172.21.15.94:0/779481484 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f49c00c4030 con 0x7f49c8161a60 2024-09-11T23:19:35.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.865+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49c80d2af0 con 0x7f49c8161a60 2024-09-11T23:19:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.865+0000 7f49bffff640 1 -- 172.21.15.94:0/779481484 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16970 (secure 0 0 0) 0x7f49c80d0300 con 0x7f49c8161a60 2024-09-11T23:19:35.866 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:35.866 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":97,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:34.907719+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:33.255692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:33.878357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:35.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49a80678c0 msgr2=0x7f49a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49a80678c0 0x7f49a8069d80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f49b8001cf0 tx=0x7f49b8009040 comp rx=0 tx=0).stop 2024-09-11T23:19:35.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c8161a60 msgr2=0x7f49c81533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c8161a60 0x7f49c81533d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f49c00ae040 tx=0x7f49c001aa80 comp rx=0 tx=0).stop 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 shutdown_connections 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49a80678c0 0x7f49a8069d80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49c8161a60 0x7f49c81533d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49c80d3060 0x7f49c8159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 --2- 172.21.15.94:0/779481484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49c80cf450 0x7f49c80b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 >> 172.21.15.94:0/779481484 conn(0x7f49c808bf90 msgr2=0x7f49c80b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 shutdown_connections 2024-09-11T23:19:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:35.869+0000 7f49cdfc8640 1 -- 172.21.15.94:0/779481484 wait complete. 2024-09-11T23:19:35.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:36.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710b803640 1 Processor -- start 2024-09-11T23:19:36.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710b803640 1 -- start start 2024-09-11T23:19:36.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710b803640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 0x7f71040d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710b803640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71040d32b0 con 0x7f71040d2e90 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710b803640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71040cfad0 con 0x7f71040cf620 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710b803640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71040d0300 con 0x7f7104161a60 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7108d9e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f71040d2e90 0x7f71040cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50678/0 (socket says 172.21.15.94:50678) 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7108d9e640 1 -- 172.21.15.94:0/1994878000 learned_addr learned my addr 172.21.15.94:0/1994878000 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710959f640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 0x7f71040d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515496864 0 0) 0x7f71040d32b0 con 0x7f71040d2e90 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70f0003530 con 0x7f71040d2e90 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3292165 0 0) 0x7f70f0003530 con 0x7f71040d2e90 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 msgr2=0x7f71040d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 0x7f71040d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 >> v1:172.21.15.155:6789/0 conn(0x7f71040cf620 legacy=0x7f710406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71040b0f60 con 0x7f71040d2e90 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f70f4001680 con 0x7f71040d2e90 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 >> v1:172.21.15.94:6789/0 conn(0x7f71040d2e90 legacy=0x7f71040cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 0x7f70f00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f0003f70 0x7f70f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70f0004d50 0x7f70f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f71040d0300 con 0x7f70f0004d50 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70f000bb60 con 0x7f70f0003f70 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70f000bd60 con 0x7f7104161a60 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7109da0640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70f0004d50 0x7f70f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710959f640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 0x7f70f00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7108d9e640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f0003f70 0x7f70f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7109da0640 1 -- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 msgr2=0x7f70f00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7109da0640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 0x7f70f00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7109da0640 1 -- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f0003f70 msgr2=0x7f70f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7109da0640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f0003f70 0x7f70f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7109da0640 1 -- 172.21.15.94:0/1994878000 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f0003530 con 0x7f70f0004d50 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f710959f640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7104161a60 0x7f70f00039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:36.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.009+0000 7f7108d9e640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f0003f70 0x7f70f0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:36.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f7109da0640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70f0004d50 0x7f70f00051d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f70fc001e70 tx=0x7f70fc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ce85b7901fe79d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc001a90 con 0x7f70f0004d50 2024-09-11T23:19:36.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc003b80 con 0x7f70f0004d50 2024-09-11T23:19:36.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f70fbfff640 1 -- 172.21.15.94:0/1994878000 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc005080 con 0x7f70f0004d50 2024-09-11T23:19:36.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 -- 172.21.15.94:0/1994878000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70f0004d50 msgr2=0x7f70f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 --2- 172.21.15.94:0/1994878000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70f0004d50 0x7f70f00051d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f70fc001e70 tx=0x7f70fc01c780 comp rx=0 tx=0).stop 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f7109da0640 1 -- 172.21.15.94:0/1994878000 reap_dead start 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 -- 172.21.15.94:0/1994878000 shutdown_connections 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 -- 172.21.15.94:0/1994878000 >> 172.21.15.94:0/1994878000 conn(0x7f710408bf90 msgr2=0x7f710409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 -- 172.21.15.94:0/1994878000 shutdown_connections 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 -- 172.21.15.94:0/1994878000 wait complete. 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 Processor -- start 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.013+0000 7f710b803640 1 -- start start 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71041f1130 0x7f71040b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710415d760 0x7f710415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71040cb440 0x7f71040cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f710406ceb0 con 0x7f71040cb440 2024-09-11T23:19:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71040d0020 con 0x7f71041f1130 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f710406d190 con 0x7f710415d760 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71040cb440 0x7f71040cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71040cb440 0x7f71040cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44244/0 (socket says 172.21.15.94:44244) 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 -- 172.21.15.94:0/2574945452 learned_addr learned my addr 172.21.15.94:0/2574945452 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7108d9e640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710415d760 0x7f710415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710959f640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71041f1130 0x7f71040b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 -- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710415d760 msgr2=0x7f710415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710415d760 0x7f710415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 -- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71041f1130 msgr2=0x7f71040b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71041f1130 0x7f71040b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 -- 172.21.15.94:0/2574945452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71040cbe00 con 0x7f71040cb440 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f7109da0640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71040cb440 0x7f71040cb8c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f70fc01cc60 tx=0x7f70f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f70f9ffb640 1 -- 172.21.15.94:0/2574945452 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0b8070 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f70f9ffb640 1 -- 172.21.15.94:0/2574945452 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc0012e0 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71040cc370 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f70f9ffb640 1 -- 172.21.15.94:0/2574945452 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc001a90 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71040ccfa0 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710406e280 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f70f9ffb640 1 -- 172.21.15.94:0/2574945452 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70fc0bb070 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f70f9ffb640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70e80678f0 0x7f70e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f70f9ffb640 1 -- 172.21.15.94:0/2574945452 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f70fc11ec50 con 0x7f71040cb440 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710959f640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70e80678f0 0x7f70e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.017+0000 7f710959f640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70e80678f0 0x7f70e8069db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f71040cce50 tx=0x7f7100008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.021+0000 7f70f9ffb640 1 -- 172.21.15.94:0/2574945452 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f70fc124020 con 0x7f71040cb440 2024-09-11T23:19:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.185+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f710406bcc0 con 0x7f71040cb440 2024-09-11T23:19:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f70f9ffb640 1 -- 172.21.15.94:0/2574945452 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16970 (secure 0 0 0) 0x7f70fc0ac020 con 0x7f71040cb440 2024-09-11T23:19:36.188 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:36.189 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":97,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:34.907719+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:33.255692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:33.878357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70e80678f0 msgr2=0x7f70e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70e80678f0 0x7f70e8069db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f71040cce50 tx=0x7f7100008040 comp rx=0 tx=0).stop 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71040cb440 msgr2=0x7f71040cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71040cb440 0x7f71040cb8c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f70fc01cc60 tx=0x7f70f0005840 comp rx=0 tx=0).stop 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 shutdown_connections 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f70e80678f0 0x7f70e8069db0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71040cb440 0x7f71040cb8c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710415d760 0x7f710415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 --2- 172.21.15.94:0/2574945452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71041f1130 0x7f71040b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 >> 172.21.15.94:0/2574945452 conn(0x7f710408bf90 msgr2=0x7f71040d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 shutdown_connections 2024-09-11T23:19:36.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.189+0000 7f710b803640 1 -- 172.21.15.94:0/2574945452 wait complete. 2024-09-11T23:19:36.208 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:19:36.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f1504bc1640 1 Processor -- start 2024-09-11T23:19:36.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f1504bc1640 1 -- start start 2024-09-11T23:19:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f1504bc1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15001587a0 0x7f15000b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f1504bc1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f150006e680 0x7f1500072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f1504bc1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f150006ec60 con 0x7f15000b37d0 2024-09-11T23:19:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f1504bc1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f15000b3c40 con 0x7f150006e680 2024-09-11T23:19:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f1504bc1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f150006f870 con 0x7f15001587a0 2024-09-11T23:19:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fed9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f150006e680 0x7f1500072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fed9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f150006e680 0x7f1500072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44254/0 (socket says 172.21.15.94:44254) 2024-09-11T23:19:36.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fed9d640 1 -- 172.21.15.94:0/334947895 learned_addr learned my addr 172.21.15.94:0/334947895 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:36.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fe59c640 1 --2- 172.21.15.94:0/334947895 >> v2:172.21.15.155:3300/0 conn(0x7f15001587a0 0x7f15000b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fed9d640 1 -- 172.21.15.94:0/334947895 >> v2:172.21.15.155:3300/0 conn(0x7f15001587a0 msgr2=0x7f15000b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fed9d640 1 --2- 172.21.15.94:0/334947895 >> v2:172.21.15.155:3300/0 conn(0x7f15001587a0 0x7f15000b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fed9d640 1 -- 172.21.15.94:0/334947895 >> v1:172.21.15.155:6789/0 conn(0x7f15000b37d0 legacy=0x7f150006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.329+0000 7f14fed9d640 1 -- 172.21.15.94:0/334947895 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150006ef40 con 0x7f150006e680 2024-09-11T23:19:36.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fed9d640 1 --2- 172.21.15.94:0/334947895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f150006e680 0x7f1500072160 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1500071710 tx=0x7f14f801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be583c302c6443a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fd59a640 1 -- 172.21.15.94:0/334947895 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f80aa610 con 0x7f150006e680 2024-09-11T23:19:36.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fd59a640 1 -- 172.21.15.94:0/334947895 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f80af070 con 0x7f150006e680 2024-09-11T23:19:36.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fd59a640 1 -- 172.21.15.94:0/334947895 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f80aa9d0 con 0x7f150006e680 2024-09-11T23:19:36.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- 172.21.15.94:0/334947895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f150006e680 msgr2=0x7f1500072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 --2- 172.21.15.94:0/334947895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f150006e680 0x7f1500072160 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1500071710 tx=0x7f14f801c4b0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- 172.21.15.94:0/334947895 shutdown_connections 2024-09-11T23:19:36.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 --2- 172.21.15.94:0/334947895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f150006e680 0x7f1500072160 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 --2- 172.21.15.94:0/334947895 >> v2:172.21.15.155:3300/0 conn(0x7f15001587a0 0x7f15000b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- 172.21.15.94:0/334947895 >> 172.21.15.94:0/334947895 conn(0x7f15000b1f90 msgr2=0x7f15000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- 172.21.15.94:0/334947895 shutdown_connections 2024-09-11T23:19:36.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- 172.21.15.94:0/334947895 wait complete. 2024-09-11T23:19:36.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 Processor -- start 2024-09-11T23:19:36.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- start start 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150006e680 0x7f15000b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15000b37d0 0x7f1500099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15001587a0 0x7f1500099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1500073030 con 0x7f15000b37d0 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1500072eb0 con 0x7f150006e680 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f1504bc1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f15000731b0 con 0x7f15001587a0 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15000b37d0 0x7f1500099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15000b37d0 0x7f1500099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44266/0 (socket says 172.21.15.94:44266) 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 -- 172.21.15.94:0/3351244849 learned_addr learned my addr 172.21.15.94:0/3351244849 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fe59c640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150006e680 0x7f15000b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 -- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15001587a0 msgr2=0x7f1500099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fed9d640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15001587a0 0x7f1500099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15001587a0 0x7f1500099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 -- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150006e680 msgr2=0x7f15000b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150006e680 0x7f15000b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fdd9b640 1 -- 172.21.15.94:0/3351244849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15001439e0 con 0x7f15000b37d0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fe59c640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150006e680 0x7f15000b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.333+0000 7f14fed9d640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15001587a0 0x7f1500099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14fdd9b640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15000b37d0 0x7f1500099520 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f14e800c480 tx=0x7f14e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14f6ffd640 1 -- 172.21.15.94:0/3351244849 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8012830 con 0x7f15000b37d0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14f6ffd640 1 -- 172.21.15.94:0/3351244849 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e8017070 con 0x7f15000b37d0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1500143c80 con 0x7f15000b37d0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14f6ffd640 1 -- 172.21.15.94:0/3351244849 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8012c30 con 0x7f15000b37d0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1500141970 con 0x7f15000b37d0 2024-09-11T23:19:36.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1500072160 con 0x7f15000b37d0 2024-09-11T23:19:36.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14f6ffd640 1 -- 172.21.15.94:0/3351244849 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14e801c460 con 0x7f15000b37d0 2024-09-11T23:19:36.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14f6ffd640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f14e40678c0 0x7f14e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14f6ffd640 1 -- 172.21.15.94:0/3351244849 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f14e8085bf0 con 0x7f15000b37d0 2024-09-11T23:19:36.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14fe59c640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f14e40678c0 0x7f14e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.337+0000 7f14fe59c640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f14e40678c0 0x7f14e4069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f14f0007eb0 tx=0x7f14f0007400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.341+0000 7f14f6ffd640 1 -- 172.21.15.94:0/3351244849 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f14e8056630 con 0x7f15000b37d0 2024-09-11T23:19:36.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.533+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1500070080 con 0x7f15000b37d0 2024-09-11T23:19:36.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f14f6ffd640 1 -- 172.21.15.94:0/3351244849 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) ==== 118+0+0 (secure 0 0 0) 0x7f14e8055f30 con 0x7f15000b37d0 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f14e40678c0 msgr2=0x7f14e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f14e40678c0 0x7f14e4069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f14f0007eb0 tx=0x7f14f0007400 comp rx=0 tx=0).stop 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15000b37d0 msgr2=0x7f1500099520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15000b37d0 0x7f1500099520 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f14e800c480 tx=0x7f14e800c940 comp rx=0 tx=0).stop 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 shutdown_connections 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15001587a0 0x7f1500099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f14e40678c0 0x7f14e4069d80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15000b37d0 0x7f1500099520 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 --2- 172.21.15.94:0/3351244849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150006e680 0x7f15000b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 >> 172.21.15.94:0/3351244849 conn(0x7f15000b1f90 msgr2=0x7f1500160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 shutdown_connections 2024-09-11T23:19:36.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.549+0000 7f1504bc1640 1 -- 172.21.15.94:0/3351244849 wait complete. 2024-09-11T23:19:36.567 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:19:36.567 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:19:36.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736f181640 1 Processor -- start 2024-09-11T23:19:36.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736f181640 1 -- start start 2024-09-11T23:19:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736f181640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f736815c2a0 0x7f73680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736f181640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736f181640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73680b3290 con 0x7f736815bec0 2024-09-11T23:19:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736f181640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f73680b3570 con 0x7f736815c2a0 2024-09-11T23:19:36.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736f181640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73680b3850 con 0x7f73680af2a0 2024-09-11T23:19:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736d71e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f7367fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f736815c2a0 0x7f73680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736d71e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:58720/0 (socket says 172.21.15.94:58720) 2024-09-11T23:19:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736d71e640 1 -- 172.21.15.94:0/1198449508 learned_addr learned my addr 172.21.15.94:0/1198449508 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736d71e640 1 -- 172.21.15.94:0/1198449508 >> v2:172.21.15.155:3300/0 conn(0x7f736815c2a0 msgr2=0x7f73680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736d71e640 1 --2- 172.21.15.94:0/1198449508 >> v2:172.21.15.155:3300/0 conn(0x7f736815c2a0 0x7f73680aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736d71e640 1 -- 172.21.15.94:0/1198449508 >> v1:172.21.15.155:6789/0 conn(0x7f736815bec0 legacy=0x7f73680ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.685+0000 7f736d71e640 1 -- 172.21.15.94:0/1198449508 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73680b3b30 con 0x7f73680af2a0 2024-09-11T23:19:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736d71e640 1 --2- 172.21.15.94:0/1198449508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736806e000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7360009e50 tx=0x7f736001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c0aebc231d70c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f73677fe640 1 -- 172.21.15.94:0/1198449508 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73600a58d0 con 0x7f73680af2a0 2024-09-11T23:19:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f73677fe640 1 -- 172.21.15.94:0/1198449508 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73600a5a70 con 0x7f73680af2a0 2024-09-11T23:19:36.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f73677fe640 1 -- 172.21.15.94:0/1198449508 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73600a5e40 con 0x7f73680af2a0 2024-09-11T23:19:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 -- 172.21.15.94:0/1198449508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 msgr2=0x7f736806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 --2- 172.21.15.94:0/1198449508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736806e000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7360009e50 tx=0x7f736001ca00 comp rx=0 tx=0).stop 2024-09-11T23:19:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 -- 172.21.15.94:0/1198449508 shutdown_connections 2024-09-11T23:19:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 --2- 172.21.15.94:0/1198449508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736806e000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 --2- 172.21.15.94:0/1198449508 >> v2:172.21.15.155:3300/0 conn(0x7f736815c2a0 0x7f73680aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 -- 172.21.15.94:0/1198449508 >> 172.21.15.94:0/1198449508 conn(0x7f73680b1f90 msgr2=0x7f73680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 -- 172.21.15.94:0/1198449508 shutdown_connections 2024-09-11T23:19:36.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 -- 172.21.15.94:0/1198449508 wait complete. 2024-09-11T23:19:36.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 Processor -- start 2024-09-11T23:19:36.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.689+0000 7f736f181640 1 -- start start 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f736815bec0 0x7f736814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f736815c2a0 0x7f7368157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f736806ed50 con 0x7f736815c2a0 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f73680afc90 con 0x7f736815bec0 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f736806eed0 con 0x7f73680af2a0 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f736815c2a0 0x7f7368157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f736815c2a0 0x7f7368157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44274/0 (socket says 172.21.15.94:44274) 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 -- 172.21.15.94:0/2776136342 learned_addr learned my addr 172.21.15.94:0/2776136342 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736cf1d640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f7367fff640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f736815bec0 0x7f736814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 -- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 msgr2=0x7f736815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736815c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 -- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f736815bec0 msgr2=0x7f736814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f736815bec0 0x7f736814a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 -- 172.21.15.94:0/2776136342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7368157040 con 0x7f736815c2a0 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f7367fff640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f736815bec0 0x7f736814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736cf1d640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736815c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736d71e640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f736815c2a0 0x7f7368157c00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f736001a630 tx=0x7f73600197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f73657fa640 1 -- 172.21.15.94:0/2776136342 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73600bc030 con 0x7f736815c2a0 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f73657fa640 1 -- 172.21.15.94:0/2776136342 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7360007c70 con 0x7f736815c2a0 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7368156a80 con 0x7f736815c2a0 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f73657fa640 1 -- 172.21.15.94:0/2776136342 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73600a58d0 con 0x7f736815c2a0 2024-09-11T23:19:36.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736814ec20 con 0x7f736815c2a0 2024-09-11T23:19:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736806e000 con 0x7f736815c2a0 2024-09-11T23:19:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f73657fa640 1 -- 172.21.15.94:0/2776136342 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73600bf070 con 0x7f736815c2a0 2024-09-11T23:19:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f73657fa640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f73480678c0 0x7f7348069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f73657fa640 1 -- 172.21.15.94:0/2776136342 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f7360120ad0 con 0x7f736815c2a0 2024-09-11T23:19:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.693+0000 7f736cf1d640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f73480678c0 0x7f7348069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.697+0000 7f736cf1d640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f73480678c0 0x7f7348069d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f736814ea90 tx=0x7f7358009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.697+0000 7f73657fa640 1 -- 172.21.15.94:0/2776136342 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f73600c7020 con 0x7f736815c2a0 2024-09-11T23:19:36.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:36.893+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f736806fcd0 con 0x7f736815c2a0 2024-09-11T23:19:37.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.549+0000 7f73657fa640 1 -- 172.21.15.94:0/2776136342 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) ==== 122+0+0 (secure 0 0 0) 0x7f7360016620 con 0x7f736815c2a0 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f73480678c0 msgr2=0x7f7348069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f73480678c0 0x7f7348069d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f736814ea90 tx=0x7f7358009040 comp rx=0 tx=0).stop 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f736815c2a0 msgr2=0x7f7368157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f736815c2a0 0x7f7368157c00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f736001a630 tx=0x7f73600197a0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 shutdown_connections 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f73480678c0 0x7f7348069d80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f736815c2a0 0x7f7368157c00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f736815bec0 0x7f736814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 --2- 172.21.15.94:0/2776136342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73680af2a0 0x7f736815c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 >> 172.21.15.94:0/2776136342 conn(0x7f73680b1f90 msgr2=0x7f736815aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:37.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 shutdown_connections 2024-09-11T23:19:37.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.557+0000 7f736f181640 1 -- 172.21.15.94:0/2776136342 wait complete. 2024-09-11T23:19:37.576 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:19:37.576 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:37.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.697+0000 7f9a68c1a640 1 Processor -- start 2024-09-11T23:19:37.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.697+0000 7f9a68c1a640 1 -- start start 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a68c1a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a64161a60 0x7f9a640d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a68c1a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a640d2e90 0x7f9a640cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a68c1a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a640d32b0 con 0x7f9a640cf450 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a68c1a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9a640d0300 con 0x7f9a64161a60 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a68c1a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6406e6c0 con 0x7f9a640d2e90 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a64161a60 0x7f9a640d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a64161a60 0x7f9a640d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44284/0 (socket says 172.21.15.94:44284) 2024-09-11T23:19:37.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 -- 172.21.15.94:0/3726573073 learned_addr learned my addr 172.21.15.94:0/3726573073 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:37.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 -- 172.21.15.94:0/3726573073 >> v2:172.21.15.155:3300/0 conn(0x7f9a640d2e90 msgr2=0x7f9a640cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:37.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 --2- 172.21.15.94:0/3726573073 >> v2:172.21.15.155:3300/0 conn(0x7f9a640d2e90 0x7f9a640cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 -- 172.21.15.94:0/3726573073 >> v1:172.21.15.155:6789/0 conn(0x7f9a640cf450 legacy=0x7f9a640d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:37.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 -- 172.21.15.94:0/3726573073 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a640b0f60 con 0x7f9a64161a60 2024-09-11T23:19:37.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6259c640 1 --2- 172.21.15.94:0/3726573073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a640d2950 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9a6408d850 tx=0x7f9a5401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5596f0867ab7b8c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:37.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6159a640 1 -- 172.21.15.94:0/3726573073 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a640d1930 con 0x7f9a64161a60 2024-09-11T23:19:37.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6159a640 1 -- 172.21.15.94:0/3726573073 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a540b0070 con 0x7f9a64161a60 2024-09-11T23:19:37.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.701+0000 7f9a6159a640 1 -- 172.21.15.94:0/3726573073 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a540ab840 con 0x7f9a64161a60 2024-09-11T23:19:37.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- 172.21.15.94:0/3726573073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 msgr2=0x7f9a640d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/3726573073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a640d2950 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9a6408d850 tx=0x7f9a5401c420 comp rx=0 tx=0).stop 2024-09-11T23:19:37.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- 172.21.15.94:0/3726573073 shutdown_connections 2024-09-11T23:19:37.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/3726573073 >> v2:172.21.15.155:3300/0 conn(0x7f9a640d2e90 0x7f9a640cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/3726573073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a640d2950 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- 172.21.15.94:0/3726573073 >> 172.21.15.94:0/3726573073 conn(0x7f9a6408bf90 msgr2=0x7f9a6409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:37.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- 172.21.15.94:0/3726573073 shutdown_connections 2024-09-11T23:19:37.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- 172.21.15.94:0/3726573073 wait complete. 2024-09-11T23:19:37.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 Processor -- start 2024-09-11T23:19:37.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- start start 2024-09-11T23:19:37.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a640cf450 0x7f9a640b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a640d2e90 0x7f9a64151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a64151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9a640cf8c0 con 0x7f9a64161a60 2024-09-11T23:19:37.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6406d190 con 0x7f9a640d2e90 2024-09-11T23:19:37.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a640cfa40 con 0x7f9a640cf450 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a64151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a64151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44290/0 (socket says 172.21.15.94:44290) 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 -- 172.21.15.94:0/1041698778 learned_addr learned my addr 172.21.15.94:0/1041698778 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a6259c640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a640cf450 0x7f9a640b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a61d9b640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a640d2e90 0x7f9a64151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 -- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a640cf450 msgr2=0x7f9a640b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a640cf450 0x7f9a640b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 -- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a640d2e90 msgr2=0x7f9a64151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a640d2e90 0x7f9a64151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 -- 172.21.15.94:0/1041698778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a640b8290 con 0x7f9a64161a60 2024-09-11T23:19:37.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a62d9d640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a64151760 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c780 tx=0x7f9a5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:37.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a52ffd640 1 -- 172.21.15.94:0/1041698778 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c017070 con 0x7f9a64161a60 2024-09-11T23:19:37.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a52ffd640 1 -- 172.21.15.94:0/1041698778 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c003db0 con 0x7f9a64161a60 2024-09-11T23:19:37.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a640b8570 con 0x7f9a64161a60 2024-09-11T23:19:37.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a52ffd640 1 -- 172.21.15.94:0/1041698778 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0052b0 con 0x7f9a64161a60 2024-09-11T23:19:37.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.705+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a640b8b30 con 0x7f9a64161a60 2024-09-11T23:19:37.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.709+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a640cef10 con 0x7f9a64161a60 2024-09-11T23:19:37.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.709+0000 7f9a52ffd640 1 -- 172.21.15.94:0/1041698778 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a5c01a070 con 0x7f9a64161a60 2024-09-11T23:19:37.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.709+0000 7f9a52ffd640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a440678f0 0x7f9a44069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.709+0000 7f9a52ffd640 1 -- 172.21.15.94:0/1041698778 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f9a5c085480 con 0x7f9a64161a60 2024-09-11T23:19:37.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.709+0000 7f9a6259c640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a440678f0 0x7f9a44069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.709+0000 7f9a6259c640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a440678f0 0x7f9a44069db0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9a540af000 tx=0x7f9a540a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:37.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.713+0000 7f9a52ffd640 1 -- 172.21.15.94:0/1041698778 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a5c055ec0 con 0x7f9a64161a60 2024-09-11T23:19:37.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.909+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a640b28d0 con 0x7f9a64161a60 2024-09-11T23:19:37.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.909+0000 7f9a52ffd640 1 -- 172.21.15.94:0/1041698778 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5231 (secure 0 0 0) 0x7f9a5c0557c0 con 0x7f9a64161a60 2024-09-11T23:19:37.911 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:37.911 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":55,"btime":"2024-09-11T23:19:37:551427+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5144,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3790711981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3790711981},{"type":"v1","addr":"172.21.15.155:6835","nonce":3790711981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5599,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1543085113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1543085113},{"type":"v1","addr":"172.21.15.155:6837","nonce":1543085113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6687,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4168281788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4168281788},{"type":"v1","addr":"172.21.15.94:6833","nonce":4168281788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:36.898739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/3585698004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3585698004},{"type":"v1","addr":"172.21.15.94:6835","nonce":3585698004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6690,"qdb_cluster":[6690]},"id":7}]} 2024-09-11T23:19:37.911 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 55 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a440678f0 msgr2=0x7f9a44069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a440678f0 0x7f9a44069db0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9a540af000 tx=0x7f9a540a7000 comp rx=0 tx=0).stop 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 msgr2=0x7f9a64151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a64151760 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c780 tx=0x7f9a5c00cc40 comp rx=0 tx=0).stop 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 shutdown_connections 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a440678f0 0x7f9a44069db0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64161a60 0x7f9a64151760 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a640d2e90 0x7f9a64151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 --2- 172.21.15.94:0/1041698778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a640cf450 0x7f9a640b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 >> 172.21.15.94:0/1041698778 conn(0x7f9a6408bf90 msgr2=0x7f9a640b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 shutdown_connections 2024-09-11T23:19:37.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:37.913+0000 7f9a68c1a640 1 -- 172.21.15.94:0/1041698778 wait complete. 2024-09-11T23:19:37.930 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:38.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.041+0000 7f103a9b8640 1 Processor -- start 2024-09-11T23:19:38.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.041+0000 7f103a9b8640 1 -- start start 2024-09-11T23:19:38.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f103a9b8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10340d2a10 0x7f10340d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f103a9b8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10340d1f70 con 0x7f10340d4130 2024-09-11T23:19:38.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f103a9b8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10340b58d0 con 0x7f103415e450 2024-09-11T23:19:38.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f103a9b8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f10340b55f0 con 0x7f10340d2a10 2024-09-11T23:19:38.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f10337fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f10340d4130 0x7f10340d45a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50680/0 (socket says 172.21.15.94:50680) 2024-09-11T23:19:38.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f10337fe640 1 -- 172.21.15.94:0/133086494 learned_addr learned my addr 172.21.15.94:0/133086494 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:38.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743897525 0 0) 0x7f10340d1f70 con 0x7f10340d4130 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1038f55640 1 --2- 172.21.15.94:0/133086494 >> v2:172.21.15.155:3300/0 conn(0x7f10340d2a10 0x7f10340d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101c003530 con 0x7f10340d4130 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2824248925 0 0) 0x7f101c003530 con 0x7f10340d4130 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 >> v2:172.21.15.155:3300/0 conn(0x7f10340d2a10 msgr2=0x7f10340d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 --2- 172.21.15.94:0/133086494 >> v2:172.21.15.155:3300/0 conn(0x7f10340d2a10 0x7f10340d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 >> v1:172.21.15.155:6789/0 conn(0x7f103415e450 legacy=0x7f10340b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10340d2210 con 0x7f10340d4130 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f10240016a0 con 0x7f10340d4130 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1038f55640 1 --2- 172.21.15.94:0/133086494 >> v2:172.21.15.155:3300/0 conn(0x7f10340d2a10 0x7f10340d2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 >> v1:172.21.15.94:6789/0 conn(0x7f10340d4130 legacy=0x7f10340d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f101c0039c0 0x7f101c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f101c004810 0x7f101c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0051d0 0x7f101c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f10340b55f0 con 0x7f101c0039c0 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f101c00c120 con 0x7f101c004810 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f101c00c320 con 0x7f101c0051d0 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1033fff640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f101c0039c0 0x7f101c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f10337fe640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f101c004810 0x7f101c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1038f55640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0051d0 0x7f101c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1033fff640 1 -- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0051d0 msgr2=0x7f101c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1033fff640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0051d0 0x7f101c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1033fff640 1 -- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f101c004810 msgr2=0x7f101c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1033fff640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f101c004810 0x7f101c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1033fff640 1 -- 172.21.15.94:0/133086494 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c003530 con 0x7f101c0039c0 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1038f55640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0051d0 0x7f101c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.045+0000 7f1038f55640 1 -- 172.21.15.94:0/133086494 reap_dead start 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1033fff640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f101c0039c0 0x7f101c003de0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1028001780 tx=0x7f102801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd27fe81a4cee6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10280013a0 con 0x7f101c0039c0 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10280a4e50 con 0x7f101c0039c0 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1032ffd640 1 -- 172.21.15.94:0/133086494 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028003600 con 0x7f101c0039c0 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- 172.21.15.94:0/133086494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f101c0039c0 msgr2=0x7f101c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f101c0039c0 0x7f101c003de0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1028001780 tx=0x7f102801c390 comp rx=0 tx=0).stop 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- 172.21.15.94:0/133086494 shutdown_connections 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 --2- 172.21.15.94:0/133086494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f101c0039c0 0x7f101c003de0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- 172.21.15.94:0/133086494 >> 172.21.15.94:0/133086494 conn(0x7f103408bf90 msgr2=0x7f103409d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- 172.21.15.94:0/133086494 shutdown_connections 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- 172.21.15.94:0/133086494 wait complete. 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 Processor -- start 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- start start 2024-09-11T23:19:38.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0039c0 0x7f1034152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1034152850 0x7f1034160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1034160e60 0x7f10340b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f103415ea40 con 0x7f1034160e60 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10340d4b30 con 0x7f1034152850 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f103a9b8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10340b7130 con 0x7f101c0039c0 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1034160e60 0x7f10340b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1034160e60 0x7f10340b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44294/0 (socket says 172.21.15.94:44294) 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 -- 172.21.15.94:0/773737176 learned_addr learned my addr 172.21.15.94:0/773737176 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1033fff640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0039c0 0x7f1034152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f10337fe640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1034152850 0x7f1034160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 -- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0039c0 msgr2=0x7f1034152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0039c0 0x7f1034152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 -- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1034152850 msgr2=0x7f1034160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1034152850 0x7f1034160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1038f55640 1 -- 172.21.15.94:0/773737176 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10341612e0 con 0x7f1034160e60 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f1033fff640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0039c0 0x7f1034152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.049+0000 7f10337fe640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1034152850 0x7f1034160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1038f55640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1034160e60 0x7f10340b14a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f103408d850 tx=0x7f102c004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1030ff9640 1 -- 172.21.15.94:0/773737176 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c007d30 con 0x7f1034160e60 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1030ff9640 1 -- 172.21.15.94:0/773737176 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c019070 con 0x7f1034160e60 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1030ff9640 1 -- 172.21.15.94:0/773737176 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c014650 con 0x7f1034160e60 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10341615c0 con 0x7f1034160e60 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10340c8080 con 0x7f1034160e60 2024-09-11T23:19:38.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10340c8280 con 0x7f1034160e60 2024-09-11T23:19:38.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1030ff9640 1 -- 172.21.15.94:0/773737176 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f102c0147f0 con 0x7f1034160e60 2024-09-11T23:19:38.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1030ff9640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10200678c0 0x7f1020069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1030ff9640 1 -- 172.21.15.94:0/773737176 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f102c0872f0 con 0x7f1034160e60 2024-09-11T23:19:38.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1033fff640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10200678c0 0x7f1020069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.053+0000 7f1033fff640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10200678c0 0x7f1020069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1028001750 tx=0x7f10280011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.057+0000 7f1030ff9640 1 -- 172.21.15.94:0/773737176 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10340c8280 con 0x7f1034160e60 2024-09-11T23:19:38.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.205+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10340b74c0 con 0x7f1034160e60 2024-09-11T23:19:38.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.209+0000 7f1030ff9640 1 -- 172.21.15.94:0/773737176 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16957 (secure 0 0 0) 0x7f102c023020 con 0x7f1034160e60 2024-09-11T23:19:38.210 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:38.210 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":98,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:36.263783+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:33.255692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:33.878357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.209+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10200678c0 msgr2=0x7f1020069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.209+0000 7f103a9b8640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10200678c0 0x7f1020069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1028001750 tx=0x7f10280011a0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1034160e60 msgr2=0x7f10340b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1034160e60 0x7f10340b14a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f103408d850 tx=0x7f102c004840 comp rx=0 tx=0).stop 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 shutdown_connections 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10200678c0 0x7f1020069d80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1034160e60 0x7f10340b14a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1034152850 0x7f1034160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 --2- 172.21.15.94:0/773737176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f101c0039c0 0x7f1034152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 >> 172.21.15.94:0/773737176 conn(0x7f103408bf90 msgr2=0x7f103406e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 shutdown_connections 2024-09-11T23:19:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.213+0000 7f103a9b8640 1 -- 172.21.15.94:0/773737176 wait complete. 2024-09-11T23:19:38.227 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:19:38.228 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12c4a22640 1 Processor -- start 2024-09-11T23:19:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12c4a22640 1 -- start start 2024-09-11T23:19:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12c4a22640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12c015c2a0 0x7f12c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12c4a22640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c00b3290 con 0x7f12c00af2a0 2024-09-11T23:19:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12c4a22640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c00b3570 con 0x7f12c015bec0 2024-09-11T23:19:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12c4a22640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f12c00b3850 con 0x7f12c015c2a0 2024-09-11T23:19:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bdd9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12c015c2a0 0x7f12c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bed9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f12c00af2a0 0x7f12c006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50682/0 (socket says 172.21.15.94:50682) 2024-09-11T23:19:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bed9d640 1 -- 172.21.15.94:0/1285341889 learned_addr learned my addr 172.21.15.94:0/1285341889 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bdd9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12c015c2a0 0x7f12c00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44298/0 (socket says 172.21.15.94:44298) 2024-09-11T23:19:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bdd9b640 1 -- 172.21.15.94:0/1285341889 >> v1:172.21.15.155:6789/0 conn(0x7f12c015bec0 legacy=0x7f12c00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bdd9b640 1 -- 172.21.15.94:0/1285341889 >> v1:172.21.15.94:6789/0 conn(0x7f12c00af2a0 legacy=0x7f12c006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bdd9b640 1 -- 172.21.15.94:0/1285341889 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c00b3b30 con 0x7f12c015c2a0 2024-09-11T23:19:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.345+0000 7f12bd59a640 1 -- 172.21.15.94:0/1285341889 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066298792 0 0) 0x7f12c00b3290 con 0x7f12c00af2a0 2024-09-11T23:19:38.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 --2- 172.21.15.94:0/1285341889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015c2a0 0x7f12c00aed60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097c0 tx=0x7f12a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480afb6371d1e5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bd59a640 1 -- 172.21.15.94:0/1285341889 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80ab430 con 0x7f12c015c2a0 2024-09-11T23:19:38.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bd59a640 1 -- 172.21.15.94:0/1285341889 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a80b0070 con 0x7f12c015c2a0 2024-09-11T23:19:38.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bd59a640 1 -- 172.21.15.94:0/1285341889 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80ab7f0 con 0x7f12c015c2a0 2024-09-11T23:19:38.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- 172.21.15.94:0/1285341889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015c2a0 msgr2=0x7f12c00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 --2- 172.21.15.94:0/1285341889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015c2a0 0x7f12c00aed60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097c0 tx=0x7f12a801c430 comp rx=0 tx=0).stop 2024-09-11T23:19:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- 172.21.15.94:0/1285341889 shutdown_connections 2024-09-11T23:19:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 --2- 172.21.15.94:0/1285341889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015c2a0 0x7f12c00aed60 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- 172.21.15.94:0/1285341889 >> 172.21.15.94:0/1285341889 conn(0x7f12c00b1f90 msgr2=0x7f12c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- 172.21.15.94:0/1285341889 shutdown_connections 2024-09-11T23:19:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- 172.21.15.94:0/1285341889 wait complete. 2024-09-11T23:19:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 Processor -- start 2024-09-11T23:19:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- start start 2024-09-11T23:19:38.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c00af2a0 0x7f12c014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015bec0 0x7f12c014c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c015c2a0 0x7f12c014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12c006ef20 con 0x7f12c015bec0 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12c00af6d0 con 0x7f12c00af2a0 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12c4a22640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12c006f0a0 con 0x7f12c015c2a0 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015bec0 0x7f12c014c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015bec0 0x7f12c014c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44306/0 (socket says 172.21.15.94:44306) 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 -- 172.21.15.94:0/2158213958 learned_addr learned my addr 172.21.15.94:0/2158213958 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bed9d640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c015c2a0 0x7f12c014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12be59c640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c00af2a0 0x7f12c014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 -- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c015c2a0 msgr2=0x7f12c014ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c015c2a0 0x7f12c014ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 -- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c00af2a0 msgr2=0x7f12c014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c00af2a0 0x7f12c014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 -- 172.21.15.94:0/2158213958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c014bd80 con 0x7f12c015bec0 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12be59c640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c00af2a0 0x7f12c014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bed9d640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c015c2a0 0x7f12c014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.349+0000 7f12bdd9b640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015bec0 0x7f12c014c920 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f12a8019040 tx=0x7f12a80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12b6ffd640 1 -- 172.21.15.94:0/2158213958 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80bf450 con 0x7f12c015bec0 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12b6ffd640 1 -- 172.21.15.94:0/2158213958 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a80bf5f0 con 0x7f12c015bec0 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c0157e20 con 0x7f12c015bec0 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12b6ffd640 1 -- 172.21.15.94:0/2158213958 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80bf9e0 con 0x7f12c015bec0 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c0157060 con 0x7f12c015bec0 2024-09-11T23:19:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c00aed60 con 0x7f12c015bec0 2024-09-11T23:19:38.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12b6ffd640 1 -- 172.21.15.94:0/2158213958 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12a80bfb80 con 0x7f12c015bec0 2024-09-11T23:19:38.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12b6ffd640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12a00678f0 0x7f12a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12b6ffd640 1 -- 172.21.15.94:0/2158213958 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f12a80a8030 con 0x7f12c015bec0 2024-09-11T23:19:38.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12be59c640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12a00678f0 0x7f12a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.353+0000 7f12be59c640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12a00678f0 0x7f12a0069db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f12b0007fd0 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.357+0000 7f12b6ffd640 1 -- 172.21.15.94:0/2158213958 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f12c014bd80 con 0x7f12c015bec0 2024-09-11T23:19:38.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.513+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12c0167de0 con 0x7f12a00678f0 2024-09-11T23:19:38.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.529+0000 7f12b6ffd640 1 -- 172.21.15.94:0/2158213958 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252045 (secure 0 0 0) 0x7f12c0167de0 con 0x7f12a00678f0 2024-09-11T23:19:38.534 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12a00678f0 msgr2=0x7f12a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12a00678f0 0x7f12a0069db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f12b0007fd0 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015bec0 msgr2=0x7f12c014c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015bec0 0x7f12c014c920 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f12a8019040 tx=0x7f12a80191d0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 shutdown_connections 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c015c2a0 0x7f12c014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12a00678f0 0x7f12a0069db0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c015bec0 0x7f12c014c920 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 --2- 172.21.15.94:0/2158213958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c00af2a0 0x7f12c014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 >> 172.21.15.94:0/2158213958 conn(0x7f12c00b1f90 msgr2=0x7f12c0159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 shutdown_connections 2024-09-11T23:19:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.533+0000 7f12c4a22640 1 -- 172.21.15.94:0/2158213958 wait complete. 2024-09-11T23:19:38.552 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-09-11T23:19:38.057539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289320,"kb_used_data":10656,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754685400,"statfs":{"total":773094113280,"available":772797849600,"internally_reserved":0,"allocated":10911744,"data_stored":5624740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.546172"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314171+0000","last_change":"2024-09-11T23:19:35.298140+0000","last_active":"2024-09-11T23:19:35.314171+0000","last_peered":"2024-09-11T23:19:35.314171+0000","last_clean":"2024-09-11T23:19:35.314171+0000","last_became_active":"2024-09-11T23:19:35.297287+0000","last_became_peered":"2024-09-11T23:19:35.297287+0000","last_unstale":"2024-09-11T23:19:35.314171+0000","last_undegraded":"2024-09-11T23:19:35.314171+0000","last_fullsized":"2024-09-11T23:19:35.314171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:53.462808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.309134+0000","last_change":"2024-09-11T23:19:35.304386+0000","last_active":"2024-09-11T23:19:35.309134+0000","last_peered":"2024-09-11T23:19:35.309134+0000","last_clean":"2024-09-11T23:19:35.309134+0000","last_became_active":"2024-09-11T23:19:35.303689+0000","last_became_peered":"2024-09-11T23:19:35.303689+0000","last_unstale":"2024-09-11T23:19:35.309134+0000","last_undegraded":"2024-09-11T23:19:35.309134+0000","last_fullsized":"2024-09-11T23:19:35.309134+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:41.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312048+0000","last_change":"2024-09-11T23:19:35.289327+0000","last_active":"2024-09-11T23:19:35.312048+0000","last_peered":"2024-09-11T23:19:35.312048+0000","last_clean":"2024-09-11T23:19:35.312048+0000","last_became_active":"2024-09-11T23:19:35.288618+0000","last_became_peered":"2024-09-11T23:19:35.288618+0000","last_unstale":"2024-09-11T23:19:35.312048+0000","last_undegraded":"2024-09-11T23:19:35.312048+0000","last_fullsized":"2024-09-11T23:19:35.312048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:07.587229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274282+0000","last_change":"2024-09-11T23:19:35.321555+0000","last_active":"2024-09-11T23:19:36.274282+0000","last_peered":"2024-09-11T23:19:36.274282+0000","last_clean":"2024-09-11T23:19:36.274282+0000","last_became_active":"2024-09-11T23:19:35.320935+0000","last_became_peered":"2024-09-11T23:19:35.320935+0000","last_unstale":"2024-09-11T23:19:36.274282+0000","last_undegraded":"2024-09-11T23:19:36.274282+0000","last_fullsized":"2024-09-11T23:19:36.274282+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:31.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.316449+0000","last_change":"2024-09-11T23:19:35.315005+0000","last_active":"2024-09-11T23:19:35.316449+0000","last_peered":"2024-09-11T23:19:35.316449+0000","last_clean":"2024-09-11T23:19:35.316449+0000","last_became_active":"2024-09-11T23:19:35.314480+0000","last_became_peered":"2024-09-11T23:19:35.314480+0000","last_unstale":"2024-09-11T23:19:35.316449+0000","last_undegraded":"2024-09-11T23:19:35.316449+0000","last_fullsized":"2024-09-11T23:19:35.316449+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:02.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.319195+0000","last_change":"2024-09-11T23:19:35.314280+0000","last_active":"2024-09-11T23:19:35.319195+0000","last_peered":"2024-09-11T23:19:35.319195+0000","last_clean":"2024-09-11T23:19:35.319195+0000","last_became_active":"2024-09-11T23:19:35.313340+0000","last_became_peered":"2024-09-11T23:19:35.313340+0000","last_unstale":"2024-09-11T23:19:35.319195+0000","last_undegraded":"2024-09-11T23:19:35.319195+0000","last_fullsized":"2024-09-11T23:19:35.319195+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.319138+0000","last_change":"2024-09-11T23:19:35.313834+0000","last_active":"2024-09-11T23:19:35.319138+0000","last_peered":"2024-09-11T23:19:35.319138+0000","last_clean":"2024-09-11T23:19:35.319138+0000","last_became_active":"2024-09-11T23:19:35.313089+0000","last_became_peered":"2024-09-11T23:19:35.313089+0000","last_unstale":"2024-09-11T23:19:35.319138+0000","last_undegraded":"2024-09-11T23:19:35.319138+0000","last_fullsized":"2024-09-11T23:19:35.319138+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884924+0000","last_change":"2024-09-11T23:19:35.310069+0000","last_active":"2024-09-11T23:19:36.884924+0000","last_peered":"2024-09-11T23:19:36.884924+0000","last_clean":"2024-09-11T23:19:36.884924+0000","last_became_active":"2024-09-11T23:19:35.309308+0000","last_became_peered":"2024-09-11T23:19:35.309308+0000","last_unstale":"2024-09-11T23:19:36.884924+0000","last_undegraded":"2024-09-11T23:19:36.884924+0000","last_fullsized":"2024-09-11T23:19:36.884924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:08.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312481+0000","last_change":"2024-09-11T23:19:35.306842+0000","last_active":"2024-09-11T23:19:35.312481+0000","last_peered":"2024-09-11T23:19:35.312481+0000","last_clean":"2024-09-11T23:19:35.312481+0000","last_became_active":"2024-09-11T23:19:35.306087+0000","last_became_peered":"2024-09-11T23:19:35.306087+0000","last_unstale":"2024-09-11T23:19:35.312481+0000","last_undegraded":"2024-09-11T23:19:35.312481+0000","last_fullsized":"2024-09-11T23:19:35.312481+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:51.787447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310804+0000","last_change":"2024-09-11T23:19:35.307069+0000","last_active":"2024-09-11T23:19:35.310804+0000","last_peered":"2024-09-11T23:19:35.310804+0000","last_clean":"2024-09-11T23:19:35.310804+0000","last_became_active":"2024-09-11T23:19:35.306249+0000","last_became_peered":"2024-09-11T23:19:35.306249+0000","last_unstale":"2024-09-11T23:19:35.310804+0000","last_undegraded":"2024-09-11T23:19:35.310804+0000","last_fullsized":"2024-09-11T23:19:35.310804+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:02.480094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280356+0000","last_change":"2024-09-11T23:19:35.304513+0000","last_active":"2024-09-11T23:19:36.280356+0000","last_peered":"2024-09-11T23:19:36.280356+0000","last_clean":"2024-09-11T23:19:36.280356+0000","last_became_active":"2024-09-11T23:19:35.303730+0000","last_became_peered":"2024-09-11T23:19:35.303730+0000","last_unstale":"2024-09-11T23:19:36.280356+0000","last_undegraded":"2024-09-11T23:19:36.280356+0000","last_fullsized":"2024-09-11T23:19:36.280356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:02.480094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278090+0000","last_change":"2024-09-11T23:19:35.322564+0000","last_active":"2024-09-11T23:19:36.278090+0000","last_peered":"2024-09-11T23:19:36.278090+0000","last_clean":"2024-09-11T23:19:36.278090+0000","last_became_active":"2024-09-11T23:19:35.316709+0000","last_became_peered":"2024-09-11T23:19:35.316709+0000","last_unstale":"2024-09-11T23:19:36.278090+0000","last_undegraded":"2024-09-11T23:19:36.278090+0000","last_fullsized":"2024-09-11T23:19:36.278090+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:51.787447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274085+0000","last_change":"2024-09-11T23:19:35.297244+0000","last_active":"2024-09-11T23:19:36.274085+0000","last_peered":"2024-09-11T23:19:36.274085+0000","last_clean":"2024-09-11T23:19:36.274085+0000","last_became_active":"2024-09-11T23:19:35.296415+0000","last_became_peered":"2024-09-11T23:19:35.296415+0000","last_unstale":"2024-09-11T23:19:36.274085+0000","last_undegraded":"2024-09-11T23:19:36.274085+0000","last_fullsized":"2024-09-11T23:19:36.274085+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.320210+0000","last_change":"2024-09-11T23:19:35.310956+0000","last_active":"2024-09-11T23:19:35.320210+0000","last_peered":"2024-09-11T23:19:35.320210+0000","last_clean":"2024-09-11T23:19:35.320210+0000","last_became_active":"2024-09-11T23:19:35.310228+0000","last_became_peered":"2024-09-11T23:19:35.310228+0000","last_unstale":"2024-09-11T23:19:35.320210+0000","last_undegraded":"2024-09-11T23:19:35.320210+0000","last_fullsized":"2024-09-11T23:19:35.320210+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.318745+0000","last_change":"2024-09-11T23:19:35.310639+0000","last_active":"2024-09-11T23:19:35.318745+0000","last_peered":"2024-09-11T23:19:35.318745+0000","last_clean":"2024-09-11T23:19:35.318745+0000","last_became_active":"2024-09-11T23:19:35.310044+0000","last_became_peered":"2024-09-11T23:19:35.310044+0000","last_unstale":"2024-09-11T23:19:35.318745+0000","last_undegraded":"2024-09-11T23:19:35.318745+0000","last_fullsized":"2024-09-11T23:19:35.318745+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.320160+0000","last_change":"2024-09-11T23:19:35.310884+0000","last_active":"2024-09-11T23:19:35.320160+0000","last_peered":"2024-09-11T23:19:35.320160+0000","last_clean":"2024-09-11T23:19:35.320160+0000","last_became_active":"2024-09-11T23:19:35.310117+0000","last_became_peered":"2024-09-11T23:19:35.310117+0000","last_unstale":"2024-09-11T23:19:35.320160+0000","last_undegraded":"2024-09-11T23:19:35.320160+0000","last_fullsized":"2024-09-11T23:19:35.320160+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314258+0000","last_change":"2024-09-11T23:19:35.301351+0000","last_active":"2024-09-11T23:19:35.314258+0000","last_peered":"2024-09-11T23:19:35.314258+0000","last_clean":"2024-09-11T23:19:35.314258+0000","last_became_active":"2024-09-11T23:19:35.300665+0000","last_became_peered":"2024-09-11T23:19:35.300665+0000","last_unstale":"2024-09-11T23:19:35.314258+0000","last_undegraded":"2024-09-11T23:19:35.314258+0000","last_fullsized":"2024-09-11T23:19:35.314258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:39.421676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.319058+0000","last_change":"2024-09-11T23:19:35.314097+0000","last_active":"2024-09-11T23:19:35.319058+0000","last_peered":"2024-09-11T23:19:35.319058+0000","last_clean":"2024-09-11T23:19:35.319058+0000","last_became_active":"2024-09-11T23:19:35.313432+0000","last_became_peered":"2024-09-11T23:19:35.313432+0000","last_unstale":"2024-09-11T23:19:35.319058+0000","last_undegraded":"2024-09-11T23:19:35.319058+0000","last_fullsized":"2024-09-11T23:19:35.319058+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314288+0000","last_change":"2024-09-11T23:19:35.303762+0000","last_active":"2024-09-11T23:19:35.314288+0000","last_peered":"2024-09-11T23:19:35.314288+0000","last_clean":"2024-09-11T23:19:35.314288+0000","last_became_active":"2024-09-11T23:19:35.302590+0000","last_became_peered":"2024-09-11T23:19:35.302590+0000","last_unstale":"2024-09-11T23:19:35.314288+0000","last_undegraded":"2024-09-11T23:19:35.314288+0000","last_fullsized":"2024-09-11T23:19:35.314288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:25.796220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278377+0000","last_change":"2024-09-11T23:19:35.320977+0000","last_active":"2024-09-11T23:19:36.278377+0000","last_peered":"2024-09-11T23:19:36.278377+0000","last_clean":"2024-09-11T23:19:36.278377+0000","last_became_active":"2024-09-11T23:19:35.315938+0000","last_became_peered":"2024-09-11T23:19:35.315938+0000","last_unstale":"2024-09-11T23:19:36.278377+0000","last_undegraded":"2024-09-11T23:19:36.278377+0000","last_fullsized":"2024-09-11T23:19:36.278377+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885380+0000","last_change":"2024-09-11T23:19:35.302765+0000","last_active":"2024-09-11T23:19:36.885380+0000","last_peered":"2024-09-11T23:19:36.885380+0000","last_clean":"2024-09-11T23:19:36.885380+0000","last_became_active":"2024-09-11T23:19:35.301938+0000","last_became_peered":"2024-09-11T23:19:35.301938+0000","last_unstale":"2024-09-11T23:19:36.885380+0000","last_undegraded":"2024-09-11T23:19:36.885380+0000","last_fullsized":"2024-09-11T23:19:36.885380+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:31.966526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310588+0000","last_change":"2024-09-11T23:19:35.297663+0000","last_active":"2024-09-11T23:19:35.310588+0000","last_peered":"2024-09-11T23:19:35.310588+0000","last_clean":"2024-09-11T23:19:35.310588+0000","last_became_active":"2024-09-11T23:19:35.295654+0000","last_became_peered":"2024-09-11T23:19:35.295654+0000","last_unstale":"2024-09-11T23:19:35.310588+0000","last_undegraded":"2024-09-11T23:19:35.310588+0000","last_fullsized":"2024-09-11T23:19:35.310588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.293948+0000","last_change":"2024-09-11T23:19:35.285254+0000","last_active":"2024-09-11T23:19:35.293948+0000","last_peered":"2024-09-11T23:19:35.293948+0000","last_clean":"2024-09-11T23:19:35.293948+0000","last_became_active":"2024-09-11T23:19:35.283137+0000","last_became_peered":"2024-09-11T23:19:35.283137+0000","last_unstale":"2024-09-11T23:19:35.293948+0000","last_undegraded":"2024-09-11T23:19:35.293948+0000","last_fullsized":"2024-09-11T23:19:35.293948+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:42.697598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.307857+0000","last_change":"2024-09-11T23:19:35.291951+0000","last_active":"2024-09-11T23:19:35.307857+0000","last_peered":"2024-09-11T23:19:35.307857+0000","last_clean":"2024-09-11T23:19:35.307857+0000","last_became_active":"2024-09-11T23:19:35.291291+0000","last_became_peered":"2024-09-11T23:19:35.291291+0000","last_unstale":"2024-09-11T23:19:35.307857+0000","last_undegraded":"2024-09-11T23:19:35.307857+0000","last_fullsized":"2024-09-11T23:19:35.307857+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:06.842344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278215+0000","last_change":"2024-09-11T23:19:35.314954+0000","last_active":"2024-09-11T23:19:36.278215+0000","last_peered":"2024-09-11T23:19:36.278215+0000","last_clean":"2024-09-11T23:19:36.278215+0000","last_became_active":"2024-09-11T23:19:35.314432+0000","last_became_peered":"2024-09-11T23:19:35.314432+0000","last_unstale":"2024-09-11T23:19:36.278215+0000","last_undegraded":"2024-09-11T23:19:36.278215+0000","last_fullsized":"2024-09-11T23:19:36.278215+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278186+0000","last_change":"2024-09-11T23:19:35.316843+0000","last_active":"2024-09-11T23:19:36.278186+0000","last_peered":"2024-09-11T23:19:36.278186+0000","last_clean":"2024-09-11T23:19:36.278186+0000","last_became_active":"2024-09-11T23:19:35.316215+0000","last_became_peered":"2024-09-11T23:19:35.316215+0000","last_unstale":"2024-09-11T23:19:36.278186+0000","last_undegraded":"2024-09-11T23:19:36.278186+0000","last_fullsized":"2024-09-11T23:19:36.278186+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:06.842344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280577+0000","last_change":"2024-09-11T23:19:35.298453+0000","last_active":"2024-09-11T23:19:36.280577+0000","last_peered":"2024-09-11T23:19:36.280577+0000","last_clean":"2024-09-11T23:19:36.280577+0000","last_became_active":"2024-09-11T23:19:35.297148+0000","last_became_peered":"2024-09-11T23:19:35.297148+0000","last_unstale":"2024-09-11T23:19:36.280577+0000","last_undegraded":"2024-09-11T23:19:36.280577+0000","last_fullsized":"2024-09-11T23:19:36.280577+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:31.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.308507+0000","last_change":"2024-09-11T23:19:35.301959+0000","last_active":"2024-09-11T23:19:35.308507+0000","last_peered":"2024-09-11T23:19:35.308507+0000","last_clean":"2024-09-11T23:19:35.308507+0000","last_became_active":"2024-09-11T23:19:35.301100+0000","last_became_peered":"2024-09-11T23:19:35.301100+0000","last_unstale":"2024-09-11T23:19:35.308507+0000","last_undegraded":"2024-09-11T23:19:35.308507+0000","last_fullsized":"2024-09-11T23:19:35.308507+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:42.062507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885537+0000","last_change":"2024-09-11T23:19:35.301270+0000","last_active":"2024-09-11T23:19:36.885537+0000","last_peered":"2024-09-11T23:19:36.885537+0000","last_clean":"2024-09-11T23:19:36.885537+0000","last_became_active":"2024-09-11T23:19:35.300577+0000","last_became_peered":"2024-09-11T23:19:35.300577+0000","last_unstale":"2024-09-11T23:19:36.885537+0000","last_undegraded":"2024-09-11T23:19:36.885537+0000","last_fullsized":"2024-09-11T23:19:36.885537+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:44.757465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277255+0000","last_change":"2024-09-11T23:19:35.313533+0000","last_active":"2024-09-11T23:19:36.277255+0000","last_peered":"2024-09-11T23:19:36.277255+0000","last_clean":"2024-09-11T23:19:36.277255+0000","last_became_active":"2024-09-11T23:19:35.298336+0000","last_became_peered":"2024-09-11T23:19:35.298336+0000","last_unstale":"2024-09-11T23:19:36.277255+0000","last_undegraded":"2024-09-11T23:19:36.277255+0000","last_fullsized":"2024-09-11T23:19:36.277255+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:42.062507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.308450+0000","last_change":"2024-09-11T23:19:35.301410+0000","last_active":"2024-09-11T23:19:35.308450+0000","last_peered":"2024-09-11T23:19:35.308450+0000","last_clean":"2024-09-11T23:19:35.308450+0000","last_became_active":"2024-09-11T23:19:35.300680+0000","last_became_peered":"2024-09-11T23:19:35.300680+0000","last_unstale":"2024-09-11T23:19:35.308450+0000","last_undegraded":"2024-09-11T23:19:35.308450+0000","last_fullsized":"2024-09-11T23:19:35.308450+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:18.967577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885057+0000","last_change":"2024-09-11T23:19:35.299138+0000","last_active":"2024-09-11T23:19:36.885057+0000","last_peered":"2024-09-11T23:19:36.885057+0000","last_clean":"2024-09-11T23:19:36.885057+0000","last_became_active":"2024-09-11T23:19:35.298498+0000","last_became_peered":"2024-09-11T23:19:35.298498+0000","last_unstale":"2024-09-11T23:19:36.885057+0000","last_undegraded":"2024-09-11T23:19:36.885057+0000","last_fullsized":"2024-09-11T23:19:36.885057+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:40.554847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.316331+0000","last_change":"2024-09-11T23:19:35.310914+0000","last_active":"2024-09-11T23:19:35.316331+0000","last_peered":"2024-09-11T23:19:35.316331+0000","last_clean":"2024-09-11T23:19:35.316331+0000","last_became_active":"2024-09-11T23:19:35.309469+0000","last_became_peered":"2024-09-11T23:19:35.309469+0000","last_unstale":"2024-09-11T23:19:35.316331+0000","last_undegraded":"2024-09-11T23:19:35.316331+0000","last_fullsized":"2024-09-11T23:19:35.316331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:18.794977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274605+0000","last_change":"2024-09-11T23:19:34.561184+0000","last_active":"2024-09-11T23:19:36.274605+0000","last_peered":"2024-09-11T23:19:36.274605+0000","last_clean":"2024-09-11T23:19:36.274605+0000","last_became_active":"2024-09-11T23:19:34.560715+0000","last_became_peered":"2024-09-11T23:19:34.560715+0000","last_unstale":"2024-09-11T23:19:36.274605+0000","last_undegraded":"2024-09-11T23:19:36.274605+0000","last_fullsized":"2024-09-11T23:19:36.274605+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:41.058934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884892+0000","last_change":"2024-09-11T23:19:35.314736+0000","last_active":"2024-09-11T23:19:36.884892+0000","last_peered":"2024-09-11T23:19:36.884892+0000","last_clean":"2024-09-11T23:19:36.884892+0000","last_became_active":"2024-09-11T23:19:35.314375+0000","last_became_peered":"2024-09-11T23:19:35.314375+0000","last_unstale":"2024-09-11T23:19:36.884892+0000","last_undegraded":"2024-09-11T23:19:36.884892+0000","last_fullsized":"2024-09-11T23:19:36.884892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:37.834668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885693+0000","last_change":"2024-09-11T23:19:34.537714+0000","last_active":"2024-09-11T23:19:36.885693+0000","last_peered":"2024-09-11T23:19:36.885693+0000","last_clean":"2024-09-11T23:19:36.885693+0000","last_became_active":"2024-09-11T23:19:34.537178+0000","last_became_peered":"2024-09-11T23:19:34.537178+0000","last_unstale":"2024-09-11T23:19:36.885693+0000","last_undegraded":"2024-09-11T23:19:36.885693+0000","last_fullsized":"2024-09-11T23:19:36.885693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:46.819795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277325+0000","last_change":"2024-09-11T23:19:35.296986+0000","last_active":"2024-09-11T23:19:36.277325+0000","last_peered":"2024-09-11T23:19:36.277325+0000","last_clean":"2024-09-11T23:19:36.277325+0000","last_became_active":"2024-09-11T23:19:35.296260+0000","last_became_peered":"2024-09-11T23:19:35.296260+0000","last_unstale":"2024-09-11T23:19:36.277325+0000","last_undegraded":"2024-09-11T23:19:36.277325+0000","last_fullsized":"2024-09-11T23:19:36.277325+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:41.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278733+0000","last_change":"2024-09-11T23:19:34.546119+0000","last_active":"2024-09-11T23:19:36.278733+0000","last_peered":"2024-09-11T23:19:36.278733+0000","last_clean":"2024-09-11T23:19:36.278733+0000","last_became_active":"2024-09-11T23:19:34.545308+0000","last_became_peered":"2024-09-11T23:19:34.545308+0000","last_unstale":"2024-09-11T23:19:36.278733+0000","last_undegraded":"2024-09-11T23:19:36.278733+0000","last_fullsized":"2024-09-11T23:19:36.278733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.951850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.279933+0000","last_change":"2024-09-11T23:19:35.299520+0000","last_active":"2024-09-11T23:19:36.279933+0000","last_peered":"2024-09-11T23:19:36.279933+0000","last_clean":"2024-09-11T23:19:36.279933+0000","last_became_active":"2024-09-11T23:19:35.298787+0000","last_became_peered":"2024-09-11T23:19:35.298787+0000","last_unstale":"2024-09-11T23:19:36.279933+0000","last_undegraded":"2024-09-11T23:19:36.279933+0000","last_fullsized":"2024-09-11T23:19:36.279933+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.558895+0000","last_change":"2024-09-11T23:19:34.563485+0000","last_active":"2024-09-11T23:19:35.558895+0000","last_peered":"2024-09-11T23:19:35.558895+0000","last_clean":"2024-09-11T23:19:35.558895+0000","last_became_active":"2024-09-11T23:19:34.563203+0000","last_became_peered":"2024-09-11T23:19:34.563203+0000","last_unstale":"2024-09-11T23:19:35.558895+0000","last_undegraded":"2024-09-11T23:19:35.558895+0000","last_fullsized":"2024-09-11T23:19:35.558895+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:48.061293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274217+0000","last_change":"2024-09-11T23:19:35.305703+0000","last_active":"2024-09-11T23:19:36.274217+0000","last_peered":"2024-09-11T23:19:36.274217+0000","last_clean":"2024-09-11T23:19:36.274217+0000","last_became_active":"2024-09-11T23:19:35.304973+0000","last_became_peered":"2024-09-11T23:19:35.304973+0000","last_unstale":"2024-09-11T23:19:36.274217+0000","last_undegraded":"2024-09-11T23:19:36.274217+0000","last_fullsized":"2024-09-11T23:19:36.274217+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:02.480094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.560879+0000","last_change":"2024-09-11T23:19:34.556243+0000","last_active":"2024-09-11T23:19:35.560879+0000","last_peered":"2024-09-11T23:19:35.560879+0000","last_clean":"2024-09-11T23:19:35.560879+0000","last_became_active":"2024-09-11T23:19:34.554415+0000","last_became_peered":"2024-09-11T23:19:34.554415+0000","last_unstale":"2024-09-11T23:19:35.560879+0000","last_undegraded":"2024-09-11T23:19:35.560879+0000","last_fullsized":"2024-09-11T23:19:35.560879+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:40.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314248+0000","last_change":"2024-09-11T23:19:35.308728+0000","last_active":"2024-09-11T23:19:35.314248+0000","last_peered":"2024-09-11T23:19:35.314248+0000","last_clean":"2024-09-11T23:19:35.314248+0000","last_became_active":"2024-09-11T23:19:35.303575+0000","last_became_peered":"2024-09-11T23:19:35.303575+0000","last_unstale":"2024-09-11T23:19:35.314248+0000","last_undegraded":"2024-09-11T23:19:35.314248+0000","last_fullsized":"2024-09-11T23:19:35.314248+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:04.838099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.279230+0000","last_change":"2024-09-11T23:19:34.559793+0000","last_active":"2024-09-11T23:19:36.279230+0000","last_peered":"2024-09-11T23:19:36.279230+0000","last_clean":"2024-09-11T23:19:36.279230+0000","last_became_active":"2024-09-11T23:19:34.559076+0000","last_became_peered":"2024-09-11T23:19:34.559076+0000","last_unstale":"2024-09-11T23:19:36.279230+0000","last_undegraded":"2024-09-11T23:19:36.279230+0000","last_fullsized":"2024-09-11T23:19:36.279230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.104186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.309073+0000","last_change":"2024-09-11T23:19:35.301636+0000","last_active":"2024-09-11T23:19:35.309073+0000","last_peered":"2024-09-11T23:19:35.309073+0000","last_clean":"2024-09-11T23:19:35.309073+0000","last_became_active":"2024-09-11T23:19:35.300876+0000","last_became_peered":"2024-09-11T23:19:35.300876+0000","last_unstale":"2024-09-11T23:19:35.309073+0000","last_undegraded":"2024-09-11T23:19:35.309073+0000","last_fullsized":"2024-09-11T23:19:35.309073+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:49.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.276880+0000","last_change":"2024-09-11T23:19:34.544929+0000","last_active":"2024-09-11T23:19:36.276880+0000","last_peered":"2024-09-11T23:19:36.276880+0000","last_clean":"2024-09-11T23:19:36.276880+0000","last_became_active":"2024-09-11T23:19:34.543677+0000","last_became_peered":"2024-09-11T23:19:34.543677+0000","last_unstale":"2024-09-11T23:19:36.276880+0000","last_undegraded":"2024-09-11T23:19:36.276880+0000","last_fullsized":"2024-09-11T23:19:36.276880+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274563+0000","last_change":"2024-09-11T23:19:35.301300+0000","last_active":"2024-09-11T23:19:36.274563+0000","last_peered":"2024-09-11T23:19:36.274563+0000","last_clean":"2024-09-11T23:19:36.274563+0000","last_became_active":"2024-09-11T23:19:35.300342+0000","last_became_peered":"2024-09-11T23:19:35.300342+0000","last_unstale":"2024-09-11T23:19:36.274563+0000","last_undegraded":"2024-09-11T23:19:36.274563+0000","last_fullsized":"2024-09-11T23:19:36.274563+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:38.687745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.273800+0000","last_change":"2024-09-11T23:19:34.530234+0000","last_active":"2024-09-11T23:19:36.273800+0000","last_peered":"2024-09-11T23:19:36.273800+0000","last_clean":"2024-09-11T23:19:36.273800+0000","last_became_active":"2024-09-11T23:19:34.529514+0000","last_became_peered":"2024-09-11T23:19:34.529514+0000","last_unstale":"2024-09-11T23:19:36.273800+0000","last_undegraded":"2024-09-11T23:19:36.273800+0000","last_fullsized":"2024-09-11T23:19:36.273800+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.964004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.316370+0000","last_change":"2024-09-11T23:19:35.311298+0000","last_active":"2024-09-11T23:19:35.316370+0000","last_peered":"2024-09-11T23:19:35.316370+0000","last_clean":"2024-09-11T23:19:35.316370+0000","last_became_active":"2024-09-11T23:19:35.310208+0000","last_became_peered":"2024-09-11T23:19:35.310208+0000","last_unstale":"2024-09-11T23:19:35.316370+0000","last_undegraded":"2024-09-11T23:19:35.316370+0000","last_fullsized":"2024-09-11T23:19:35.316370+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:07.438916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278649+0000","last_change":"2024-09-11T23:19:34.555585+0000","last_active":"2024-09-11T23:19:36.278649+0000","last_peered":"2024-09-11T23:19:36.278649+0000","last_clean":"2024-09-11T23:19:36.278649+0000","last_became_active":"2024-09-11T23:19:34.554867+0000","last_became_peered":"2024-09-11T23:19:34.554867+0000","last_unstale":"2024-09-11T23:19:36.278649+0000","last_undegraded":"2024-09-11T23:19:36.278649+0000","last_fullsized":"2024-09-11T23:19:36.278649+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.964004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310479+0000","last_change":"2024-09-11T23:19:35.300156+0000","last_active":"2024-09-11T23:19:35.310479+0000","last_peered":"2024-09-11T23:19:35.310479+0000","last_clean":"2024-09-11T23:19:35.310479+0000","last_became_active":"2024-09-11T23:19:35.299412+0000","last_became_peered":"2024-09-11T23:19:35.299412+0000","last_unstale":"2024-09-11T23:19:35.310479+0000","last_undegraded":"2024-09-11T23:19:35.310479+0000","last_fullsized":"2024-09-11T23:19:35.310479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.267214+0000","last_change":"2024-09-11T23:19:34.555617+0000","last_active":"2024-09-11T23:19:35.267214+0000","last_peered":"2024-09-11T23:19:35.267214+0000","last_clean":"2024-09-11T23:19:35.267214+0000","last_became_active":"2024-09-11T23:19:34.555289+0000","last_became_peered":"2024-09-11T23:19:34.555289+0000","last_unstale":"2024-09-11T23:19:35.267214+0000","last_undegraded":"2024-09-11T23:19:35.267214+0000","last_fullsized":"2024-09-11T23:19:35.267214+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:03.137186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885404+0000","last_change":"2024-09-11T23:19:35.314006+0000","last_active":"2024-09-11T23:19:36.885404+0000","last_peered":"2024-09-11T23:19:36.885404+0000","last_clean":"2024-09-11T23:19:36.885404+0000","last_became_active":"2024-09-11T23:19:35.313714+0000","last_became_peered":"2024-09-11T23:19:35.313714+0000","last_unstale":"2024-09-11T23:19:36.885404+0000","last_undegraded":"2024-09-11T23:19:36.885404+0000","last_fullsized":"2024-09-11T23:19:36.885404+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.833267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.562499+0000","last_change":"2024-09-11T23:19:34.546071+0000","last_active":"2024-09-11T23:19:35.562499+0000","last_peered":"2024-09-11T23:19:35.562499+0000","last_clean":"2024-09-11T23:19:35.562499+0000","last_became_active":"2024-09-11T23:19:34.545237+0000","last_became_peered":"2024-09-11T23:19:34.545237+0000","last_unstale":"2024-09-11T23:19:35.562499+0000","last_undegraded":"2024-09-11T23:19:35.562499+0000","last_fullsized":"2024-09-11T23:19:35.562499+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:50.783874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310695+0000","last_change":"2024-09-11T23:19:35.304619+0000","last_active":"2024-09-11T23:19:35.310695+0000","last_peered":"2024-09-11T23:19:35.310695+0000","last_clean":"2024-09-11T23:19:35.310695+0000","last_became_active":"2024-09-11T23:19:35.304137+0000","last_became_peered":"2024-09-11T23:19:35.304137+0000","last_unstale":"2024-09-11T23:19:35.310695+0000","last_undegraded":"2024-09-11T23:19:35.310695+0000","last_fullsized":"2024-09-11T23:19:35.310695+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.567963+0000","last_change":"2024-09-11T23:19:34.558914+0000","last_active":"2024-09-11T23:19:35.567963+0000","last_peered":"2024-09-11T23:19:35.567963+0000","last_clean":"2024-09-11T23:19:35.567963+0000","last_became_active":"2024-09-11T23:19:34.552803+0000","last_became_peered":"2024-09-11T23:19:34.552803+0000","last_unstale":"2024-09-11T23:19:35.567963+0000","last_undegraded":"2024-09-11T23:19:35.567963+0000","last_fullsized":"2024-09-11T23:19:35.567963+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.703298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280033+0000","last_change":"2024-09-11T23:19:35.289110+0000","last_active":"2024-09-11T23:19:36.280033+0000","last_peered":"2024-09-11T23:19:36.280033+0000","last_clean":"2024-09-11T23:19:36.280033+0000","last_became_active":"2024-09-11T23:19:35.288388+0000","last_became_peered":"2024-09-11T23:19:35.288388+0000","last_unstale":"2024-09-11T23:19:36.280033+0000","last_undegraded":"2024-09-11T23:19:36.280033+0000","last_fullsized":"2024-09-11T23:19:36.280033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.556331+0000","last_change":"2024-09-11T23:19:34.534111+0000","last_active":"2024-09-11T23:19:35.556331+0000","last_peered":"2024-09-11T23:19:35.556331+0000","last_clean":"2024-09-11T23:19:35.556331+0000","last_became_active":"2024-09-11T23:19:34.533737+0000","last_became_peered":"2024-09-11T23:19:34.533737+0000","last_unstale":"2024-09-11T23:19:35.556331+0000","last_undegraded":"2024-09-11T23:19:35.556331+0000","last_fullsized":"2024-09-11T23:19:35.556331+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:40.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312924+0000","last_change":"2024-09-11T23:19:35.307206+0000","last_active":"2024-09-11T23:19:35.312924+0000","last_peered":"2024-09-11T23:19:35.312924+0000","last_clean":"2024-09-11T23:19:35.312924+0000","last_became_active":"2024-09-11T23:19:35.306399+0000","last_became_peered":"2024-09-11T23:19:35.306399+0000","last_unstale":"2024-09-11T23:19:35.312924+0000","last_undegraded":"2024-09-11T23:19:35.312924+0000","last_fullsized":"2024-09-11T23:19:35.312924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:06.842344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274139+0000","last_change":"2024-09-11T23:19:34.538538+0000","last_active":"2024-09-11T23:19:36.274139+0000","last_peered":"2024-09-11T23:19:36.274139+0000","last_clean":"2024-09-11T23:19:36.274139+0000","last_became_active":"2024-09-11T23:19:34.538132+0000","last_became_peered":"2024-09-11T23:19:34.538132+0000","last_unstale":"2024-09-11T23:19:36.274139+0000","last_undegraded":"2024-09-11T23:19:36.274139+0000","last_fullsized":"2024-09-11T23:19:36.274139+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:48.061293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885979+0000","last_change":"2024-09-11T23:19:35.322149+0000","last_active":"2024-09-11T23:19:36.885979+0000","last_peered":"2024-09-11T23:19:36.885979+0000","last_clean":"2024-09-11T23:19:36.885979+0000","last_became_active":"2024-09-11T23:19:35.321528+0000","last_became_peered":"2024-09-11T23:19:35.321528+0000","last_unstale":"2024-09-11T23:19:36.885979+0000","last_undegraded":"2024-09-11T23:19:36.885979+0000","last_fullsized":"2024-09-11T23:19:36.885979+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.682407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884821+0000","last_change":"2024-09-11T23:19:34.555607+0000","last_active":"2024-09-11T23:19:36.884821+0000","last_peered":"2024-09-11T23:19:36.884821+0000","last_clean":"2024-09-11T23:19:36.884821+0000","last_became_active":"2024-09-11T23:19:34.555289+0000","last_became_peered":"2024-09-11T23:19:34.555289+0000","last_unstale":"2024-09-11T23:19:36.884821+0000","last_undegraded":"2024-09-11T23:19:36.884821+0000","last_fullsized":"2024-09-11T23:19:36.884821+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:17.404298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314214+0000","last_change":"2024-09-11T23:19:35.301044+0000","last_active":"2024-09-11T23:19:35.314214+0000","last_peered":"2024-09-11T23:19:35.314214+0000","last_clean":"2024-09-11T23:19:35.314214+0000","last_became_active":"2024-09-11T23:19:35.299709+0000","last_became_peered":"2024-09-11T23:19:35.299709+0000","last_unstale":"2024-09-11T23:19:35.314214+0000","last_undegraded":"2024-09-11T23:19:35.314214+0000","last_fullsized":"2024-09-11T23:19:35.314214+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:34.373642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.276816+0000","last_change":"2024-09-11T23:19:34.545492+0000","last_active":"2024-09-11T23:19:36.276816+0000","last_peered":"2024-09-11T23:19:36.276816+0000","last_clean":"2024-09-11T23:19:36.276816+0000","last_became_active":"2024-09-11T23:19:34.543670+0000","last_became_peered":"2024-09-11T23:19:34.543670+0000","last_unstale":"2024-09-11T23:19:36.276816+0000","last_undegraded":"2024-09-11T23:19:36.276816+0000","last_fullsized":"2024-09-11T23:19:36.276816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:15.733958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885318+0000","last_change":"2024-09-11T23:19:35.298943+0000","last_active":"2024-09-11T23:19:36.885318+0000","last_peered":"2024-09-11T23:19:36.885318+0000","last_clean":"2024-09-11T23:19:36.885318+0000","last_became_active":"2024-09-11T23:19:35.298231+0000","last_became_peered":"2024-09-11T23:19:35.298231+0000","last_unstale":"2024-09-11T23:19:36.885318+0000","last_undegraded":"2024-09-11T23:19:36.885318+0000","last_fullsized":"2024-09-11T23:19:36.885318+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:31.758325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.566186+0000","last_change":"2024-09-11T23:19:34.565693+0000","last_active":"2024-09-11T23:19:35.566186+0000","last_peered":"2024-09-11T23:19:35.566186+0000","last_clean":"2024-09-11T23:19:35.566186+0000","last_became_active":"2024-09-11T23:19:34.564730+0000","last_became_peered":"2024-09-11T23:19:34.564730+0000","last_unstale":"2024-09-11T23:19:35.566186+0000","last_undegraded":"2024-09-11T23:19:35.566186+0000","last_fullsized":"2024-09-11T23:19:35.566186+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.104186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.308432+0000","last_change":"2024-09-11T23:19:35.301222+0000","last_active":"2024-09-11T23:19:35.308432+0000","last_peered":"2024-09-11T23:19:35.308432+0000","last_clean":"2024-09-11T23:19:35.308432+0000","last_became_active":"2024-09-11T23:19:35.300450+0000","last_became_peered":"2024-09-11T23:19:35.300450+0000","last_unstale":"2024-09-11T23:19:35.308432+0000","last_undegraded":"2024-09-11T23:19:35.308432+0000","last_fullsized":"2024-09-11T23:19:35.308432+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:05.889053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.565029+0000","last_change":"2024-09-11T23:19:34.564907+0000","last_active":"2024-09-11T23:19:35.565029+0000","last_peered":"2024-09-11T23:19:35.565029+0000","last_clean":"2024-09-11T23:19:35.565029+0000","last_became_active":"2024-09-11T23:19:34.564174+0000","last_became_peered":"2024-09-11T23:19:34.564174+0000","last_unstale":"2024-09-11T23:19:35.565029+0000","last_undegraded":"2024-09-11T23:19:35.565029+0000","last_fullsized":"2024-09-11T23:19:35.565029+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:05.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310636+0000","last_change":"2024-09-11T23:19:35.295792+0000","last_active":"2024-09-11T23:19:35.310636+0000","last_peered":"2024-09-11T23:19:35.310636+0000","last_clean":"2024-09-11T23:19:35.310636+0000","last_became_active":"2024-09-11T23:19:35.295060+0000","last_became_peered":"2024-09-11T23:19:35.295060+0000","last_unstale":"2024-09-11T23:19:35.310636+0000","last_undegraded":"2024-09-11T23:19:35.310636+0000","last_fullsized":"2024-09-11T23:19:35.310636+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280014+0000","last_change":"2024-09-11T23:19:34.556722+0000","last_active":"2024-09-11T23:19:36.280014+0000","last_peered":"2024-09-11T23:19:36.280014+0000","last_clean":"2024-09-11T23:19:36.280014+0000","last_became_active":"2024-09-11T23:19:34.556021+0000","last_became_peered":"2024-09-11T23:19:34.556021+0000","last_unstale":"2024-09-11T23:19:36.280014+0000","last_undegraded":"2024-09-11T23:19:36.280014+0000","last_fullsized":"2024-09-11T23:19:36.280014+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.951850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314101+0000","last_change":"2024-09-11T23:19:35.294031+0000","last_active":"2024-09-11T23:19:35.314101+0000","last_peered":"2024-09-11T23:19:35.314101+0000","last_clean":"2024-09-11T23:19:35.314101+0000","last_became_active":"2024-09-11T23:19:35.293350+0000","last_became_peered":"2024-09-11T23:19:35.293350+0000","last_unstale":"2024-09-11T23:19:35.314101+0000","last_undegraded":"2024-09-11T23:19:35.314101+0000","last_fullsized":"2024-09-11T23:19:35.314101+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:22.143162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885683+0000","last_change":"2024-09-11T23:19:34.531270+0000","last_active":"2024-09-11T23:19:36.885683+0000","last_peered":"2024-09-11T23:19:36.885683+0000","last_clean":"2024-09-11T23:19:36.885683+0000","last_became_active":"2024-09-11T23:19:34.530804+0000","last_became_peered":"2024-09-11T23:19:34.530804+0000","last_unstale":"2024-09-11T23:19:36.885683+0000","last_undegraded":"2024-09-11T23:19:36.885683+0000","last_fullsized":"2024-09-11T23:19:36.885683+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:18.034787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312088+0000","last_change":"2024-09-11T23:19:35.290948+0000","last_active":"2024-09-11T23:19:35.312088+0000","last_peered":"2024-09-11T23:19:35.312088+0000","last_clean":"2024-09-11T23:19:35.312088+0000","last_became_active":"2024-09-11T23:19:35.290138+0000","last_became_peered":"2024-09-11T23:19:35.290138+0000","last_unstale":"2024-09-11T23:19:35.312088+0000","last_undegraded":"2024-09-11T23:19:35.312088+0000","last_fullsized":"2024-09-11T23:19:35.312088+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:27.156242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884916+0000","last_change":"2024-09-11T23:19:34.529378+0000","last_active":"2024-09-11T23:19:36.884916+0000","last_peered":"2024-09-11T23:19:36.884916+0000","last_clean":"2024-09-11T23:19:36.884916+0000","last_became_active":"2024-09-11T23:19:34.528961+0000","last_became_peered":"2024-09-11T23:19:34.528961+0000","last_unstale":"2024-09-11T23:19:36.884916+0000","last_undegraded":"2024-09-11T23:19:36.884916+0000","last_fullsized":"2024-09-11T23:19:36.884916+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:25.118498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274281+0000","last_change":"2024-09-11T23:19:35.306126+0000","last_active":"2024-09-11T23:19:36.274281+0000","last_peered":"2024-09-11T23:19:36.274281+0000","last_clean":"2024-09-11T23:19:36.274281+0000","last_became_active":"2024-09-11T23:19:35.305556+0000","last_became_peered":"2024-09-11T23:19:35.305556+0000","last_unstale":"2024-09-11T23:19:36.274281+0000","last_undegraded":"2024-09-11T23:19:36.274281+0000","last_fullsized":"2024-09-11T23:19:36.274281+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:37.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.293026+0000","last_change":"2024-09-11T23:19:34.552900+0000","last_active":"2024-09-11T23:19:35.293026+0000","last_peered":"2024-09-11T23:19:35.293026+0000","last_clean":"2024-09-11T23:19:35.293026+0000","last_became_active":"2024-09-11T23:19:34.551942+0000","last_became_peered":"2024-09-11T23:19:34.551942+0000","last_unstale":"2024-09-11T23:19:35.293026+0000","last_undegraded":"2024-09-11T23:19:35.293026+0000","last_fullsized":"2024-09-11T23:19:35.293026+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885898+0000","last_change":"2024-09-11T23:19:35.314621+0000","last_active":"2024-09-11T23:19:36.885898+0000","last_peered":"2024-09-11T23:19:36.885898+0000","last_clean":"2024-09-11T23:19:36.885898+0000","last_became_active":"2024-09-11T23:19:35.313859+0000","last_became_peered":"2024-09-11T23:19:35.313859+0000","last_unstale":"2024-09-11T23:19:36.885898+0000","last_undegraded":"2024-09-11T23:19:36.885898+0000","last_fullsized":"2024-09-11T23:19:36.885898+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:45.618395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885307+0000","last_change":"2024-09-11T23:19:34.529471+0000","last_active":"2024-09-11T23:19:36.885307+0000","last_peered":"2024-09-11T23:19:36.885307+0000","last_clean":"2024-09-11T23:19:36.885307+0000","last_became_active":"2024-09-11T23:19:34.529079+0000","last_became_peered":"2024-09-11T23:19:34.529079+0000","last_unstale":"2024-09-11T23:19:36.885307+0000","last_undegraded":"2024-09-11T23:19:36.885307+0000","last_fullsized":"2024-09-11T23:19:36.885307+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:22.111723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312157+0000","last_change":"2024-09-11T23:19:35.290469+0000","last_active":"2024-09-11T23:19:35.312157+0000","last_peered":"2024-09-11T23:19:35.312157+0000","last_clean":"2024-09-11T23:19:35.312157+0000","last_became_active":"2024-09-11T23:19:35.289692+0000","last_became_peered":"2024-09-11T23:19:35.289692+0000","last_unstale":"2024-09-11T23:19:35.312157+0000","last_undegraded":"2024-09-11T23:19:35.312157+0000","last_fullsized":"2024-09-11T23:19:35.312157+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:45.909214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.559113+0000","last_change":"2024-09-11T23:19:34.533551+0000","last_active":"2024-09-11T23:19:35.559113+0000","last_peered":"2024-09-11T23:19:35.559113+0000","last_clean":"2024-09-11T23:19:35.559113+0000","last_became_active":"2024-09-11T23:19:34.532956+0000","last_became_peered":"2024-09-11T23:19:34.532956+0000","last_unstale":"2024-09-11T23:19:35.559113+0000","last_undegraded":"2024-09-11T23:19:35.559113+0000","last_fullsized":"2024-09-11T23:19:35.559113+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:50.783874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277031+0000","last_change":"2024-09-11T23:19:35.314734+0000","last_active":"2024-09-11T23:19:36.277031+0000","last_peered":"2024-09-11T23:19:36.277031+0000","last_clean":"2024-09-11T23:19:36.277031+0000","last_became_active":"2024-09-11T23:19:35.313003+0000","last_became_peered":"2024-09-11T23:19:35.313003+0000","last_unstale":"2024-09-11T23:19:36.277031+0000","last_undegraded":"2024-09-11T23:19:36.277031+0000","last_fullsized":"2024-09-11T23:19:36.277031+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:49.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.269366+0000","last_change":"2024-09-11T23:19:34.531211+0000","last_active":"2024-09-11T23:19:35.269366+0000","last_peered":"2024-09-11T23:19:35.269366+0000","last_clean":"2024-09-11T23:19:35.269366+0000","last_became_active":"2024-09-11T23:19:34.530846+0000","last_became_peered":"2024-09-11T23:19:34.530846+0000","last_unstale":"2024-09-11T23:19:35.269366+0000","last_undegraded":"2024-09-11T23:19:35.269366+0000","last_fullsized":"2024-09-11T23:19:35.269366+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:13.525542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274218+0000","last_change":"2024-09-11T23:19:35.306158+0000","last_active":"2024-09-11T23:19:36.274218+0000","last_peered":"2024-09-11T23:19:36.274218+0000","last_clean":"2024-09-11T23:19:36.274218+0000","last_became_active":"2024-09-11T23:19:35.305491+0000","last_became_peered":"2024-09-11T23:19:35.305491+0000","last_unstale":"2024-09-11T23:19:36.274218+0000","last_undegraded":"2024-09-11T23:19:36.274218+0000","last_fullsized":"2024-09-11T23:19:36.274218+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:02.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.295670+0000","last_change":"2024-09-11T23:19:34.551567+0000","last_active":"2024-09-11T23:19:35.295670+0000","last_peered":"2024-09-11T23:19:35.295670+0000","last_clean":"2024-09-11T23:19:35.295670+0000","last_became_active":"2024-09-11T23:19:34.547274+0000","last_became_peered":"2024-09-11T23:19:34.547274+0000","last_unstale":"2024-09-11T23:19:35.295670+0000","last_undegraded":"2024-09-11T23:19:35.295670+0000","last_fullsized":"2024-09-11T23:19:35.295670+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.951850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280000+0000","last_change":"2024-09-11T23:19:35.284348+0000","last_active":"2024-09-11T23:19:36.280000+0000","last_peered":"2024-09-11T23:19:36.280000+0000","last_clean":"2024-09-11T23:19:36.280000+0000","last_became_active":"2024-09-11T23:19:35.283546+0000","last_became_peered":"2024-09-11T23:19:35.283546+0000","last_unstale":"2024-09-11T23:19:36.280000+0000","last_undegraded":"2024-09-11T23:19:36.280000+0000","last_fullsized":"2024-09-11T23:19:36.280000+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.288695+0000","last_change":"2024-09-11T23:19:34.560243+0000","last_active":"2024-09-11T23:19:35.288695+0000","last_peered":"2024-09-11T23:19:35.288695+0000","last_clean":"2024-09-11T23:19:35.288695+0000","last_became_active":"2024-09-11T23:19:34.559810+0000","last_became_peered":"2024-09-11T23:19:34.559810+0000","last_unstale":"2024-09-11T23:19:35.288695+0000","last_undegraded":"2024-09-11T23:19:35.288695+0000","last_fullsized":"2024-09-11T23:19:35.288695+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:41.058934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885713+0000","last_change":"2024-09-11T23:19:35.309391+0000","last_active":"2024-09-11T23:19:36.885713+0000","last_peered":"2024-09-11T23:19:36.885713+0000","last_clean":"2024-09-11T23:19:36.885713+0000","last_became_active":"2024-09-11T23:19:35.308651+0000","last_became_peered":"2024-09-11T23:19:35.308651+0000","last_unstale":"2024-09-11T23:19:36.885713+0000","last_undegraded":"2024-09-11T23:19:36.885713+0000","last_fullsized":"2024-09-11T23:19:36.885713+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:13.368751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277706+0000","last_change":"2024-09-11T23:19:34.555478+0000","last_active":"2024-09-11T23:19:36.277706+0000","last_peered":"2024-09-11T23:19:36.277706+0000","last_clean":"2024-09-11T23:19:36.277706+0000","last_became_active":"2024-09-11T23:19:34.554438+0000","last_became_peered":"2024-09-11T23:19:34.554438+0000","last_unstale":"2024-09-11T23:19:36.277706+0000","last_undegraded":"2024-09-11T23:19:36.277706+0000","last_fullsized":"2024-09-11T23:19:36.277706+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.104186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885611+0000","last_change":"2024-09-11T23:19:35.314951+0000","last_active":"2024-09-11T23:19:36.885611+0000","last_peered":"2024-09-11T23:19:36.885611+0000","last_clean":"2024-09-11T23:19:36.885611+0000","last_became_active":"2024-09-11T23:19:35.314173+0000","last_became_peered":"2024-09-11T23:19:35.314173+0000","last_unstale":"2024-09-11T23:19:36.885611+0000","last_undegraded":"2024-09-11T23:19:36.885611+0000","last_fullsized":"2024-09-11T23:19:36.885611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:25.673089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885296+0000","last_change":"2024-09-11T23:19:34.555996+0000","last_active":"2024-09-11T23:19:36.885296+0000","last_peered":"2024-09-11T23:19:36.885296+0000","last_clean":"2024-09-11T23:19:36.885296+0000","last_became_active":"2024-09-11T23:19:34.555622+0000","last_became_peered":"2024-09-11T23:19:34.555622+0000","last_unstale":"2024-09-11T23:19:36.885296+0000","last_undegraded":"2024-09-11T23:19:36.885296+0000","last_fullsized":"2024-09-11T23:19:36.885296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:52.877546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.323013+0000","last_change":"2024-09-11T23:19:35.319433+0000","last_active":"2024-09-11T23:19:35.323013+0000","last_peered":"2024-09-11T23:19:35.323013+0000","last_clean":"2024-09-11T23:19:35.323013+0000","last_became_active":"2024-09-11T23:19:35.318755+0000","last_became_peered":"2024-09-11T23:19:35.318755+0000","last_unstale":"2024-09-11T23:19:35.323013+0000","last_undegraded":"2024-09-11T23:19:35.323013+0000","last_fullsized":"2024-09-11T23:19:35.323013+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.293432+0000","last_change":"2024-09-11T23:19:34.552782+0000","last_active":"2024-09-11T23:19:35.293432+0000","last_peered":"2024-09-11T23:19:35.293432+0000","last_clean":"2024-09-11T23:19:35.293432+0000","last_became_active":"2024-09-11T23:19:34.547409+0000","last_became_peered":"2024-09-11T23:19:34.547409+0000","last_unstale":"2024-09-11T23:19:35.293432+0000","last_undegraded":"2024-09-11T23:19:35.293432+0000","last_fullsized":"2024-09-11T23:19:35.293432+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:13.721323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280464+0000","last_change":"2024-09-11T23:19:35.297925+0000","last_active":"2024-09-11T23:19:36.280464+0000","last_peered":"2024-09-11T23:19:36.280464+0000","last_clean":"2024-09-11T23:19:36.280464+0000","last_became_active":"2024-09-11T23:19:35.297205+0000","last_became_peered":"2024-09-11T23:19:35.297205+0000","last_unstale":"2024-09-11T23:19:36.280464+0000","last_undegraded":"2024-09-11T23:19:36.280464+0000","last_fullsized":"2024-09-11T23:19:36.280464+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:02.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885576+0000","last_change":"2024-09-11T23:19:34.554636+0000","last_active":"2024-09-11T23:19:36.885576+0000","last_peered":"2024-09-11T23:19:36.885576+0000","last_clean":"2024-09-11T23:19:36.885576+0000","last_became_active":"2024-09-11T23:19:34.554275+0000","last_became_peered":"2024-09-11T23:19:34.554275+0000","last_unstale":"2024-09-11T23:19:36.885576+0000","last_undegraded":"2024-09-11T23:19:36.885576+0000","last_fullsized":"2024-09-11T23:19:36.885576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.993679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.279384+0000","last_change":"2024-09-11T23:19:35.291868+0000","last_active":"2024-09-11T23:19:36.279384+0000","last_peered":"2024-09-11T23:19:36.279384+0000","last_clean":"2024-09-11T23:19:36.279384+0000","last_became_active":"2024-09-11T23:19:35.291162+0000","last_became_peered":"2024-09-11T23:19:35.291162+0000","last_unstale":"2024-09-11T23:19:36.279384+0000","last_undegraded":"2024-09-11T23:19:36.279384+0000","last_fullsized":"2024-09-11T23:19:36.279384+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885943+0000","last_change":"2024-09-11T23:19:34.529973+0000","last_active":"2024-09-11T23:19:36.885943+0000","last_peered":"2024-09-11T23:19:36.885943+0000","last_clean":"2024-09-11T23:19:36.885943+0000","last_became_active":"2024-09-11T23:19:34.529491+0000","last_became_peered":"2024-09-11T23:19:34.529491+0000","last_unstale":"2024-09-11T23:19:36.885943+0000","last_undegraded":"2024-09-11T23:19:36.885943+0000","last_fullsized":"2024-09-11T23:19:36.885943+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:00.008433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":315,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.288994+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:19:35.288994+0000","last_peered":"2024-09-11T23:19:35.288994+0000","last_clean":"2024-09-11T23:19:35.288994+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:19:35.288994+0000","last_undegraded":"2024-09-11T23:19:35.288994+0000","last_fullsized":"2024-09-11T23:19:35.288994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1806336,"data_stored":1143753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1224704,"data_stored":555441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1216512,"data_stored":559917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36544,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335296,"statfs":{"total":96636764160,"available":96599343104,"internally_reserved":0,"allocated":1224704,"data_stored":560009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36532,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335308,"statfs":{"total":96636764160,"available":96599355392,"internally_reserved":0,"allocated":1208320,"data_stored":553807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1208320,"data_stored":553259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40684,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331156,"statfs":{"total":96636764160,"available":96595103744,"internally_reserved":0,"allocated":1208320,"data_stored":553259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41288,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330552,"statfs":{"total":96636764160,"available":96594485248,"internally_reserved":0,"allocated":1814528,"data_stored":1145295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:38.556 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b95826640 1 Processor -- start 2024-09-11T23:19:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b95826640 1 -- start start 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b95826640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b9015bec0 0x7f1b900ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b95826640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1b900af470 0x7f1b9006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b95826640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b900b3290 con 0x7f1b9015c2a0 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b95826640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1b900b3570 con 0x7f1b9015bec0 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b95826640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1b900b3850 con 0x7f1b900af470 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8effd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b9015bec0 0x7f1b900ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8e7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1b9015c2a0 0x7f1b900aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50688/0 (socket says 172.21.15.94:50688) 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8e7fc640 1 -- 172.21.15.94:0/2469376317 learned_addr learned my addr 172.21.15.94:0/2469376317 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8f7fe640 1 --2- 172.21.15.94:0/2469376317 >> v2:172.21.15.155:3300/0 conn(0x7f1b900af470 0x7f1b9006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8effd640 1 -- 172.21.15.94:0/2469376317 >> v2:172.21.15.155:3300/0 conn(0x7f1b900af470 msgr2=0x7f1b9006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8effd640 1 --2- 172.21.15.94:0/2469376317 >> v2:172.21.15.155:3300/0 conn(0x7f1b900af470 0x7f1b9006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8effd640 1 -- 172.21.15.94:0/2469376317 >> v1:172.21.15.94:6789/0 conn(0x7f1b9015c2a0 legacy=0x7f1b900aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8effd640 1 -- 172.21.15.94:0/2469376317 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900b3b30 con 0x7f1b9015bec0 2024-09-11T23:19:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8dffb640 1 -- 172.21.15.94:0/2469376317 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448888231 0 0) 0x7f1b900b3290 con 0x7f1b9015c2a0 2024-09-11T23:19:38.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.717+0000 7f1b8effd640 1 --2- 172.21.15.94:0/2469376317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b900ad200 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1b900b2fb0 tx=0x7f1b8401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4d321f84fa5f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8dffb640 1 -- 172.21.15.94:0/2469376317 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b840b2070 con 0x7f1b9015bec0 2024-09-11T23:19:38.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8dffb640 1 -- 172.21.15.94:0/2469376317 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b840a58d0 con 0x7f1b9015bec0 2024-09-11T23:19:38.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8dffb640 1 -- 172.21.15.94:0/2469376317 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b840a5ca0 con 0x7f1b9015bec0 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- 172.21.15.94:0/2469376317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 msgr2=0x7f1b900ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 --2- 172.21.15.94:0/2469376317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b900ad200 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1b900b2fb0 tx=0x7f1b8401c900 comp rx=0 tx=0).stop 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- 172.21.15.94:0/2469376317 shutdown_connections 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 --2- 172.21.15.94:0/2469376317 >> v2:172.21.15.155:3300/0 conn(0x7f1b900af470 0x7f1b9006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 --2- 172.21.15.94:0/2469376317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b900ad200 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- 172.21.15.94:0/2469376317 >> 172.21.15.94:0/2469376317 conn(0x7f1b900b1f90 msgr2=0x7f1b900b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- 172.21.15.94:0/2469376317 shutdown_connections 2024-09-11T23:19:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- 172.21.15.94:0/2469376317 wait complete. 2024-09-11T23:19:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 Processor -- start 2024-09-11T23:19:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- start start 2024-09-11T23:19:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b900af470 0x7f1b90150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b901509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b9015c2a0 0x7f1b9014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9006ed50 con 0x7f1b9015bec0 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900ad740 con 0x7f1b9015c2a0 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9006eed0 con 0x7f1b900af470 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b901509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b901509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44322/0 (socket says 172.21.15.94:44322) 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 -- 172.21.15.94:0/2922195982 learned_addr learned my addr 172.21.15.94:0/2922195982 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 -- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b900af470 msgr2=0x7f1b90150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8effd640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b900af470 0x7f1b90150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8f7fe640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b9015c2a0 0x7f1b9014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b900af470 0x7f1b90150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 -- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b9015c2a0 msgr2=0x7f1b9014afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b9015c2a0 0x7f1b9014afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 -- 172.21.15.94:0/2922195982 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900722b0 con 0x7f1b9015bec0 2024-09-11T23:19:38.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b8e7fc640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b901509b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000c440 tx=0x7f1b8000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b77fff640 1 -- 172.21.15.94:0/2922195982 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80018070 con 0x7f1b9015bec0 2024-09-11T23:19:38.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b77fff640 1 -- 172.21.15.94:0/2922195982 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b800074e0 con 0x7f1b9015bec0 2024-09-11T23:19:38.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b90072590 con 0x7f1b9015bec0 2024-09-11T23:19:38.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b77fff640 1 -- 172.21.15.94:0/2922195982 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80004a30 con 0x7f1b9015bec0 2024-09-11T23:19:38.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.721+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b90072b50 con 0x7f1b9015bec0 2024-09-11T23:19:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.725+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9006e000 con 0x7f1b9015bec0 2024-09-11T23:19:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.725+0000 7f1b77fff640 1 -- 172.21.15.94:0/2922195982 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b8001b070 con 0x7f1b9015bec0 2024-09-11T23:19:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.725+0000 7f1b77fff640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b7c0678c0 0x7f1b7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.725+0000 7f1b77fff640 1 -- 172.21.15.94:0/2922195982 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f1b80084ff0 con 0x7f1b9015bec0 2024-09-11T23:19:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.725+0000 7f1b8effd640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b7c0678c0 0x7f1b7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.725+0000 7f1b8effd640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b7c0678c0 0x7f1b7c069d80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1b840af000 tx=0x7f1b840a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.729+0000 7f1b77fff640 1 -- 172.21.15.94:0/2922195982 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b80055a30 con 0x7f1b9015bec0 2024-09-11T23:19:38.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.885+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b9006fcd0 con 0x7f1b7c0678c0 2024-09-11T23:19:38.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.905+0000 7f1b77fff640 1 -- 172.21.15.94:0/2922195982 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252045 (secure 0 0 0) 0x7f1b9006fcd0 con 0x7f1b7c0678c0 2024-09-11T23:19:38.907 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:38.909 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b7c0678c0 msgr2=0x7f1b7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b7c0678c0 0x7f1b7c069d80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1b840af000 tx=0x7f1b840a7070 comp rx=0 tx=0).stop 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 msgr2=0x7f1b901509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b901509b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000c440 tx=0x7f1b8000c900 comp rx=0 tx=0).stop 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 shutdown_connections 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b9015c2a0 0x7f1b9014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1b7c0678c0 0x7f1b7c069d80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b9015bec0 0x7f1b901509b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 --2- 172.21.15.94:0/2922195982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b900af470 0x7f1b90150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:38.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 >> 172.21.15.94:0/2922195982 conn(0x7f1b900b1f90 msgr2=0x7f1b900cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:38.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 shutdown_connections 2024-09-11T23:19:38.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:38.909+0000 7f1b95826640 1 -- 172.21.15.94:0/2922195982 wait complete. 2024-09-11T23:19:38.926 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-09-11T23:19:38.057539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289320,"kb_used_data":10656,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754685400,"statfs":{"total":773094113280,"available":772797849600,"internally_reserved":0,"allocated":10911744,"data_stored":5624740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.546172"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314171+0000","last_change":"2024-09-11T23:19:35.298140+0000","last_active":"2024-09-11T23:19:35.314171+0000","last_peered":"2024-09-11T23:19:35.314171+0000","last_clean":"2024-09-11T23:19:35.314171+0000","last_became_active":"2024-09-11T23:19:35.297287+0000","last_became_peered":"2024-09-11T23:19:35.297287+0000","last_unstale":"2024-09-11T23:19:35.314171+0000","last_undegraded":"2024-09-11T23:19:35.314171+0000","last_fullsized":"2024-09-11T23:19:35.314171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:53.462808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.309134+0000","last_change":"2024-09-11T23:19:35.304386+0000","last_active":"2024-09-11T23:19:35.309134+0000","last_peered":"2024-09-11T23:19:35.309134+0000","last_clean":"2024-09-11T23:19:35.309134+0000","last_became_active":"2024-09-11T23:19:35.303689+0000","last_became_peered":"2024-09-11T23:19:35.303689+0000","last_unstale":"2024-09-11T23:19:35.309134+0000","last_undegraded":"2024-09-11T23:19:35.309134+0000","last_fullsized":"2024-09-11T23:19:35.309134+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:41.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312048+0000","last_change":"2024-09-11T23:19:35.289327+0000","last_active":"2024-09-11T23:19:35.312048+0000","last_peered":"2024-09-11T23:19:35.312048+0000","last_clean":"2024-09-11T23:19:35.312048+0000","last_became_active":"2024-09-11T23:19:35.288618+0000","last_became_peered":"2024-09-11T23:19:35.288618+0000","last_unstale":"2024-09-11T23:19:35.312048+0000","last_undegraded":"2024-09-11T23:19:35.312048+0000","last_fullsized":"2024-09-11T23:19:35.312048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:07.587229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274282+0000","last_change":"2024-09-11T23:19:35.321555+0000","last_active":"2024-09-11T23:19:36.274282+0000","last_peered":"2024-09-11T23:19:36.274282+0000","last_clean":"2024-09-11T23:19:36.274282+0000","last_became_active":"2024-09-11T23:19:35.320935+0000","last_became_peered":"2024-09-11T23:19:35.320935+0000","last_unstale":"2024-09-11T23:19:36.274282+0000","last_undegraded":"2024-09-11T23:19:36.274282+0000","last_fullsized":"2024-09-11T23:19:36.274282+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:31.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.316449+0000","last_change":"2024-09-11T23:19:35.315005+0000","last_active":"2024-09-11T23:19:35.316449+0000","last_peered":"2024-09-11T23:19:35.316449+0000","last_clean":"2024-09-11T23:19:35.316449+0000","last_became_active":"2024-09-11T23:19:35.314480+0000","last_became_peered":"2024-09-11T23:19:35.314480+0000","last_unstale":"2024-09-11T23:19:35.316449+0000","last_undegraded":"2024-09-11T23:19:35.316449+0000","last_fullsized":"2024-09-11T23:19:35.316449+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:02.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.319195+0000","last_change":"2024-09-11T23:19:35.314280+0000","last_active":"2024-09-11T23:19:35.319195+0000","last_peered":"2024-09-11T23:19:35.319195+0000","last_clean":"2024-09-11T23:19:35.319195+0000","last_became_active":"2024-09-11T23:19:35.313340+0000","last_became_peered":"2024-09-11T23:19:35.313340+0000","last_unstale":"2024-09-11T23:19:35.319195+0000","last_undegraded":"2024-09-11T23:19:35.319195+0000","last_fullsized":"2024-09-11T23:19:35.319195+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.319138+0000","last_change":"2024-09-11T23:19:35.313834+0000","last_active":"2024-09-11T23:19:35.319138+0000","last_peered":"2024-09-11T23:19:35.319138+0000","last_clean":"2024-09-11T23:19:35.319138+0000","last_became_active":"2024-09-11T23:19:35.313089+0000","last_became_peered":"2024-09-11T23:19:35.313089+0000","last_unstale":"2024-09-11T23:19:35.319138+0000","last_undegraded":"2024-09-11T23:19:35.319138+0000","last_fullsized":"2024-09-11T23:19:35.319138+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884924+0000","last_change":"2024-09-11T23:19:35.310069+0000","last_active":"2024-09-11T23:19:36.884924+0000","last_peered":"2024-09-11T23:19:36.884924+0000","last_clean":"2024-09-11T23:19:36.884924+0000","last_became_active":"2024-09-11T23:19:35.309308+0000","last_became_peered":"2024-09-11T23:19:35.309308+0000","last_unstale":"2024-09-11T23:19:36.884924+0000","last_undegraded":"2024-09-11T23:19:36.884924+0000","last_fullsized":"2024-09-11T23:19:36.884924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:08.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312481+0000","last_change":"2024-09-11T23:19:35.306842+0000","last_active":"2024-09-11T23:19:35.312481+0000","last_peered":"2024-09-11T23:19:35.312481+0000","last_clean":"2024-09-11T23:19:35.312481+0000","last_became_active":"2024-09-11T23:19:35.306087+0000","last_became_peered":"2024-09-11T23:19:35.306087+0000","last_unstale":"2024-09-11T23:19:35.312481+0000","last_undegraded":"2024-09-11T23:19:35.312481+0000","last_fullsized":"2024-09-11T23:19:35.312481+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:51.787447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310804+0000","last_change":"2024-09-11T23:19:35.307069+0000","last_active":"2024-09-11T23:19:35.310804+0000","last_peered":"2024-09-11T23:19:35.310804+0000","last_clean":"2024-09-11T23:19:35.310804+0000","last_became_active":"2024-09-11T23:19:35.306249+0000","last_became_peered":"2024-09-11T23:19:35.306249+0000","last_unstale":"2024-09-11T23:19:35.310804+0000","last_undegraded":"2024-09-11T23:19:35.310804+0000","last_fullsized":"2024-09-11T23:19:35.310804+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:02.480094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280356+0000","last_change":"2024-09-11T23:19:35.304513+0000","last_active":"2024-09-11T23:19:36.280356+0000","last_peered":"2024-09-11T23:19:36.280356+0000","last_clean":"2024-09-11T23:19:36.280356+0000","last_became_active":"2024-09-11T23:19:35.303730+0000","last_became_peered":"2024-09-11T23:19:35.303730+0000","last_unstale":"2024-09-11T23:19:36.280356+0000","last_undegraded":"2024-09-11T23:19:36.280356+0000","last_fullsized":"2024-09-11T23:19:36.280356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:02.480094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278090+0000","last_change":"2024-09-11T23:19:35.322564+0000","last_active":"2024-09-11T23:19:36.278090+0000","last_peered":"2024-09-11T23:19:36.278090+0000","last_clean":"2024-09-11T23:19:36.278090+0000","last_became_active":"2024-09-11T23:19:35.316709+0000","last_became_peered":"2024-09-11T23:19:35.316709+0000","last_unstale":"2024-09-11T23:19:36.278090+0000","last_undegraded":"2024-09-11T23:19:36.278090+0000","last_fullsized":"2024-09-11T23:19:36.278090+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:51.787447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274085+0000","last_change":"2024-09-11T23:19:35.297244+0000","last_active":"2024-09-11T23:19:36.274085+0000","last_peered":"2024-09-11T23:19:36.274085+0000","last_clean":"2024-09-11T23:19:36.274085+0000","last_became_active":"2024-09-11T23:19:35.296415+0000","last_became_peered":"2024-09-11T23:19:35.296415+0000","last_unstale":"2024-09-11T23:19:36.274085+0000","last_undegraded":"2024-09-11T23:19:36.274085+0000","last_fullsized":"2024-09-11T23:19:36.274085+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.320210+0000","last_change":"2024-09-11T23:19:35.310956+0000","last_active":"2024-09-11T23:19:35.320210+0000","last_peered":"2024-09-11T23:19:35.320210+0000","last_clean":"2024-09-11T23:19:35.320210+0000","last_became_active":"2024-09-11T23:19:35.310228+0000","last_became_peered":"2024-09-11T23:19:35.310228+0000","last_unstale":"2024-09-11T23:19:35.320210+0000","last_undegraded":"2024-09-11T23:19:35.320210+0000","last_fullsized":"2024-09-11T23:19:35.320210+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.318745+0000","last_change":"2024-09-11T23:19:35.310639+0000","last_active":"2024-09-11T23:19:35.318745+0000","last_peered":"2024-09-11T23:19:35.318745+0000","last_clean":"2024-09-11T23:19:35.318745+0000","last_became_active":"2024-09-11T23:19:35.310044+0000","last_became_peered":"2024-09-11T23:19:35.310044+0000","last_unstale":"2024-09-11T23:19:35.318745+0000","last_undegraded":"2024-09-11T23:19:35.318745+0000","last_fullsized":"2024-09-11T23:19:35.318745+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.320160+0000","last_change":"2024-09-11T23:19:35.310884+0000","last_active":"2024-09-11T23:19:35.320160+0000","last_peered":"2024-09-11T23:19:35.320160+0000","last_clean":"2024-09-11T23:19:35.320160+0000","last_became_active":"2024-09-11T23:19:35.310117+0000","last_became_peered":"2024-09-11T23:19:35.310117+0000","last_unstale":"2024-09-11T23:19:35.320160+0000","last_undegraded":"2024-09-11T23:19:35.320160+0000","last_fullsized":"2024-09-11T23:19:35.320160+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314258+0000","last_change":"2024-09-11T23:19:35.301351+0000","last_active":"2024-09-11T23:19:35.314258+0000","last_peered":"2024-09-11T23:19:35.314258+0000","last_clean":"2024-09-11T23:19:35.314258+0000","last_became_active":"2024-09-11T23:19:35.300665+0000","last_became_peered":"2024-09-11T23:19:35.300665+0000","last_unstale":"2024-09-11T23:19:35.314258+0000","last_undegraded":"2024-09-11T23:19:35.314258+0000","last_fullsized":"2024-09-11T23:19:35.314258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:39.421676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.319058+0000","last_change":"2024-09-11T23:19:35.314097+0000","last_active":"2024-09-11T23:19:35.319058+0000","last_peered":"2024-09-11T23:19:35.319058+0000","last_clean":"2024-09-11T23:19:35.319058+0000","last_became_active":"2024-09-11T23:19:35.313432+0000","last_became_peered":"2024-09-11T23:19:35.313432+0000","last_unstale":"2024-09-11T23:19:35.319058+0000","last_undegraded":"2024-09-11T23:19:35.319058+0000","last_fullsized":"2024-09-11T23:19:35.319058+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314288+0000","last_change":"2024-09-11T23:19:35.303762+0000","last_active":"2024-09-11T23:19:35.314288+0000","last_peered":"2024-09-11T23:19:35.314288+0000","last_clean":"2024-09-11T23:19:35.314288+0000","last_became_active":"2024-09-11T23:19:35.302590+0000","last_became_peered":"2024-09-11T23:19:35.302590+0000","last_unstale":"2024-09-11T23:19:35.314288+0000","last_undegraded":"2024-09-11T23:19:35.314288+0000","last_fullsized":"2024-09-11T23:19:35.314288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:25.796220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278377+0000","last_change":"2024-09-11T23:19:35.320977+0000","last_active":"2024-09-11T23:19:36.278377+0000","last_peered":"2024-09-11T23:19:36.278377+0000","last_clean":"2024-09-11T23:19:36.278377+0000","last_became_active":"2024-09-11T23:19:35.315938+0000","last_became_peered":"2024-09-11T23:19:35.315938+0000","last_unstale":"2024-09-11T23:19:36.278377+0000","last_undegraded":"2024-09-11T23:19:36.278377+0000","last_fullsized":"2024-09-11T23:19:36.278377+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885380+0000","last_change":"2024-09-11T23:19:35.302765+0000","last_active":"2024-09-11T23:19:36.885380+0000","last_peered":"2024-09-11T23:19:36.885380+0000","last_clean":"2024-09-11T23:19:36.885380+0000","last_became_active":"2024-09-11T23:19:35.301938+0000","last_became_peered":"2024-09-11T23:19:35.301938+0000","last_unstale":"2024-09-11T23:19:36.885380+0000","last_undegraded":"2024-09-11T23:19:36.885380+0000","last_fullsized":"2024-09-11T23:19:36.885380+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:31.966526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310588+0000","last_change":"2024-09-11T23:19:35.297663+0000","last_active":"2024-09-11T23:19:35.310588+0000","last_peered":"2024-09-11T23:19:35.310588+0000","last_clean":"2024-09-11T23:19:35.310588+0000","last_became_active":"2024-09-11T23:19:35.295654+0000","last_became_peered":"2024-09-11T23:19:35.295654+0000","last_unstale":"2024-09-11T23:19:35.310588+0000","last_undegraded":"2024-09-11T23:19:35.310588+0000","last_fullsized":"2024-09-11T23:19:35.310588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.293948+0000","last_change":"2024-09-11T23:19:35.285254+0000","last_active":"2024-09-11T23:19:35.293948+0000","last_peered":"2024-09-11T23:19:35.293948+0000","last_clean":"2024-09-11T23:19:35.293948+0000","last_became_active":"2024-09-11T23:19:35.283137+0000","last_became_peered":"2024-09-11T23:19:35.283137+0000","last_unstale":"2024-09-11T23:19:35.293948+0000","last_undegraded":"2024-09-11T23:19:35.293948+0000","last_fullsized":"2024-09-11T23:19:35.293948+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:42.697598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.307857+0000","last_change":"2024-09-11T23:19:35.291951+0000","last_active":"2024-09-11T23:19:35.307857+0000","last_peered":"2024-09-11T23:19:35.307857+0000","last_clean":"2024-09-11T23:19:35.307857+0000","last_became_active":"2024-09-11T23:19:35.291291+0000","last_became_peered":"2024-09-11T23:19:35.291291+0000","last_unstale":"2024-09-11T23:19:35.307857+0000","last_undegraded":"2024-09-11T23:19:35.307857+0000","last_fullsized":"2024-09-11T23:19:35.307857+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:06.842344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278215+0000","last_change":"2024-09-11T23:19:35.314954+0000","last_active":"2024-09-11T23:19:36.278215+0000","last_peered":"2024-09-11T23:19:36.278215+0000","last_clean":"2024-09-11T23:19:36.278215+0000","last_became_active":"2024-09-11T23:19:35.314432+0000","last_became_peered":"2024-09-11T23:19:35.314432+0000","last_unstale":"2024-09-11T23:19:36.278215+0000","last_undegraded":"2024-09-11T23:19:36.278215+0000","last_fullsized":"2024-09-11T23:19:36.278215+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278186+0000","last_change":"2024-09-11T23:19:35.316843+0000","last_active":"2024-09-11T23:19:36.278186+0000","last_peered":"2024-09-11T23:19:36.278186+0000","last_clean":"2024-09-11T23:19:36.278186+0000","last_became_active":"2024-09-11T23:19:35.316215+0000","last_became_peered":"2024-09-11T23:19:35.316215+0000","last_unstale":"2024-09-11T23:19:36.278186+0000","last_undegraded":"2024-09-11T23:19:36.278186+0000","last_fullsized":"2024-09-11T23:19:36.278186+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:06.842344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280577+0000","last_change":"2024-09-11T23:19:35.298453+0000","last_active":"2024-09-11T23:19:36.280577+0000","last_peered":"2024-09-11T23:19:36.280577+0000","last_clean":"2024-09-11T23:19:36.280577+0000","last_became_active":"2024-09-11T23:19:35.297148+0000","last_became_peered":"2024-09-11T23:19:35.297148+0000","last_unstale":"2024-09-11T23:19:36.280577+0000","last_undegraded":"2024-09-11T23:19:36.280577+0000","last_fullsized":"2024-09-11T23:19:36.280577+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:31.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.308507+0000","last_change":"2024-09-11T23:19:35.301959+0000","last_active":"2024-09-11T23:19:35.308507+0000","last_peered":"2024-09-11T23:19:35.308507+0000","last_clean":"2024-09-11T23:19:35.308507+0000","last_became_active":"2024-09-11T23:19:35.301100+0000","last_became_peered":"2024-09-11T23:19:35.301100+0000","last_unstale":"2024-09-11T23:19:35.308507+0000","last_undegraded":"2024-09-11T23:19:35.308507+0000","last_fullsized":"2024-09-11T23:19:35.308507+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:42.062507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885537+0000","last_change":"2024-09-11T23:19:35.301270+0000","last_active":"2024-09-11T23:19:36.885537+0000","last_peered":"2024-09-11T23:19:36.885537+0000","last_clean":"2024-09-11T23:19:36.885537+0000","last_became_active":"2024-09-11T23:19:35.300577+0000","last_became_peered":"2024-09-11T23:19:35.300577+0000","last_unstale":"2024-09-11T23:19:36.885537+0000","last_undegraded":"2024-09-11T23:19:36.885537+0000","last_fullsized":"2024-09-11T23:19:36.885537+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:44.757465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277255+0000","last_change":"2024-09-11T23:19:35.313533+0000","last_active":"2024-09-11T23:19:36.277255+0000","last_peered":"2024-09-11T23:19:36.277255+0000","last_clean":"2024-09-11T23:19:36.277255+0000","last_became_active":"2024-09-11T23:19:35.298336+0000","last_became_peered":"2024-09-11T23:19:35.298336+0000","last_unstale":"2024-09-11T23:19:36.277255+0000","last_undegraded":"2024-09-11T23:19:36.277255+0000","last_fullsized":"2024-09-11T23:19:36.277255+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:42.062507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.308450+0000","last_change":"2024-09-11T23:19:35.301410+0000","last_active":"2024-09-11T23:19:35.308450+0000","last_peered":"2024-09-11T23:19:35.308450+0000","last_clean":"2024-09-11T23:19:35.308450+0000","last_became_active":"2024-09-11T23:19:35.300680+0000","last_became_peered":"2024-09-11T23:19:35.300680+0000","last_unstale":"2024-09-11T23:19:35.308450+0000","last_undegraded":"2024-09-11T23:19:35.308450+0000","last_fullsized":"2024-09-11T23:19:35.308450+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:18.967577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885057+0000","last_change":"2024-09-11T23:19:35.299138+0000","last_active":"2024-09-11T23:19:36.885057+0000","last_peered":"2024-09-11T23:19:36.885057+0000","last_clean":"2024-09-11T23:19:36.885057+0000","last_became_active":"2024-09-11T23:19:35.298498+0000","last_became_peered":"2024-09-11T23:19:35.298498+0000","last_unstale":"2024-09-11T23:19:36.885057+0000","last_undegraded":"2024-09-11T23:19:36.885057+0000","last_fullsized":"2024-09-11T23:19:36.885057+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:40.554847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.316331+0000","last_change":"2024-09-11T23:19:35.310914+0000","last_active":"2024-09-11T23:19:35.316331+0000","last_peered":"2024-09-11T23:19:35.316331+0000","last_clean":"2024-09-11T23:19:35.316331+0000","last_became_active":"2024-09-11T23:19:35.309469+0000","last_became_peered":"2024-09-11T23:19:35.309469+0000","last_unstale":"2024-09-11T23:19:35.316331+0000","last_undegraded":"2024-09-11T23:19:35.316331+0000","last_fullsized":"2024-09-11T23:19:35.316331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:18.794977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274605+0000","last_change":"2024-09-11T23:19:34.561184+0000","last_active":"2024-09-11T23:19:36.274605+0000","last_peered":"2024-09-11T23:19:36.274605+0000","last_clean":"2024-09-11T23:19:36.274605+0000","last_became_active":"2024-09-11T23:19:34.560715+0000","last_became_peered":"2024-09-11T23:19:34.560715+0000","last_unstale":"2024-09-11T23:19:36.274605+0000","last_undegraded":"2024-09-11T23:19:36.274605+0000","last_fullsized":"2024-09-11T23:19:36.274605+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:41.058934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884892+0000","last_change":"2024-09-11T23:19:35.314736+0000","last_active":"2024-09-11T23:19:36.884892+0000","last_peered":"2024-09-11T23:19:36.884892+0000","last_clean":"2024-09-11T23:19:36.884892+0000","last_became_active":"2024-09-11T23:19:35.314375+0000","last_became_peered":"2024-09-11T23:19:35.314375+0000","last_unstale":"2024-09-11T23:19:36.884892+0000","last_undegraded":"2024-09-11T23:19:36.884892+0000","last_fullsized":"2024-09-11T23:19:36.884892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:37.834668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885693+0000","last_change":"2024-09-11T23:19:34.537714+0000","last_active":"2024-09-11T23:19:36.885693+0000","last_peered":"2024-09-11T23:19:36.885693+0000","last_clean":"2024-09-11T23:19:36.885693+0000","last_became_active":"2024-09-11T23:19:34.537178+0000","last_became_peered":"2024-09-11T23:19:34.537178+0000","last_unstale":"2024-09-11T23:19:36.885693+0000","last_undegraded":"2024-09-11T23:19:36.885693+0000","last_fullsized":"2024-09-11T23:19:36.885693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:46.819795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277325+0000","last_change":"2024-09-11T23:19:35.296986+0000","last_active":"2024-09-11T23:19:36.277325+0000","last_peered":"2024-09-11T23:19:36.277325+0000","last_clean":"2024-09-11T23:19:36.277325+0000","last_became_active":"2024-09-11T23:19:35.296260+0000","last_became_peered":"2024-09-11T23:19:35.296260+0000","last_unstale":"2024-09-11T23:19:36.277325+0000","last_undegraded":"2024-09-11T23:19:36.277325+0000","last_fullsized":"2024-09-11T23:19:36.277325+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:41.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278733+0000","last_change":"2024-09-11T23:19:34.546119+0000","last_active":"2024-09-11T23:19:36.278733+0000","last_peered":"2024-09-11T23:19:36.278733+0000","last_clean":"2024-09-11T23:19:36.278733+0000","last_became_active":"2024-09-11T23:19:34.545308+0000","last_became_peered":"2024-09-11T23:19:34.545308+0000","last_unstale":"2024-09-11T23:19:36.278733+0000","last_undegraded":"2024-09-11T23:19:36.278733+0000","last_fullsized":"2024-09-11T23:19:36.278733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.951850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.279933+0000","last_change":"2024-09-11T23:19:35.299520+0000","last_active":"2024-09-11T23:19:36.279933+0000","last_peered":"2024-09-11T23:19:36.279933+0000","last_clean":"2024-09-11T23:19:36.279933+0000","last_became_active":"2024-09-11T23:19:35.298787+0000","last_became_peered":"2024-09-11T23:19:35.298787+0000","last_unstale":"2024-09-11T23:19:36.279933+0000","last_undegraded":"2024-09-11T23:19:36.279933+0000","last_fullsized":"2024-09-11T23:19:36.279933+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:13.882234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.558895+0000","last_change":"2024-09-11T23:19:34.563485+0000","last_active":"2024-09-11T23:19:35.558895+0000","last_peered":"2024-09-11T23:19:35.558895+0000","last_clean":"2024-09-11T23:19:35.558895+0000","last_became_active":"2024-09-11T23:19:34.563203+0000","last_became_peered":"2024-09-11T23:19:34.563203+0000","last_unstale":"2024-09-11T23:19:35.558895+0000","last_undegraded":"2024-09-11T23:19:35.558895+0000","last_fullsized":"2024-09-11T23:19:35.558895+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:48.061293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274217+0000","last_change":"2024-09-11T23:19:35.305703+0000","last_active":"2024-09-11T23:19:36.274217+0000","last_peered":"2024-09-11T23:19:36.274217+0000","last_clean":"2024-09-11T23:19:36.274217+0000","last_became_active":"2024-09-11T23:19:35.304973+0000","last_became_peered":"2024-09-11T23:19:35.304973+0000","last_unstale":"2024-09-11T23:19:36.274217+0000","last_undegraded":"2024-09-11T23:19:36.274217+0000","last_fullsized":"2024-09-11T23:19:36.274217+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:02.480094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.560879+0000","last_change":"2024-09-11T23:19:34.556243+0000","last_active":"2024-09-11T23:19:35.560879+0000","last_peered":"2024-09-11T23:19:35.560879+0000","last_clean":"2024-09-11T23:19:35.560879+0000","last_became_active":"2024-09-11T23:19:34.554415+0000","last_became_peered":"2024-09-11T23:19:34.554415+0000","last_unstale":"2024-09-11T23:19:35.560879+0000","last_undegraded":"2024-09-11T23:19:35.560879+0000","last_fullsized":"2024-09-11T23:19:35.560879+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:40.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314248+0000","last_change":"2024-09-11T23:19:35.308728+0000","last_active":"2024-09-11T23:19:35.314248+0000","last_peered":"2024-09-11T23:19:35.314248+0000","last_clean":"2024-09-11T23:19:35.314248+0000","last_became_active":"2024-09-11T23:19:35.303575+0000","last_became_peered":"2024-09-11T23:19:35.303575+0000","last_unstale":"2024-09-11T23:19:35.314248+0000","last_undegraded":"2024-09-11T23:19:35.314248+0000","last_fullsized":"2024-09-11T23:19:35.314248+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:04.838099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.279230+0000","last_change":"2024-09-11T23:19:34.559793+0000","last_active":"2024-09-11T23:19:36.279230+0000","last_peered":"2024-09-11T23:19:36.279230+0000","last_clean":"2024-09-11T23:19:36.279230+0000","last_became_active":"2024-09-11T23:19:34.559076+0000","last_became_peered":"2024-09-11T23:19:34.559076+0000","last_unstale":"2024-09-11T23:19:36.279230+0000","last_undegraded":"2024-09-11T23:19:36.279230+0000","last_fullsized":"2024-09-11T23:19:36.279230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.104186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.309073+0000","last_change":"2024-09-11T23:19:35.301636+0000","last_active":"2024-09-11T23:19:35.309073+0000","last_peered":"2024-09-11T23:19:35.309073+0000","last_clean":"2024-09-11T23:19:35.309073+0000","last_became_active":"2024-09-11T23:19:35.300876+0000","last_became_peered":"2024-09-11T23:19:35.300876+0000","last_unstale":"2024-09-11T23:19:35.309073+0000","last_undegraded":"2024-09-11T23:19:35.309073+0000","last_fullsized":"2024-09-11T23:19:35.309073+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:49.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.276880+0000","last_change":"2024-09-11T23:19:34.544929+0000","last_active":"2024-09-11T23:19:36.276880+0000","last_peered":"2024-09-11T23:19:36.276880+0000","last_clean":"2024-09-11T23:19:36.276880+0000","last_became_active":"2024-09-11T23:19:34.543677+0000","last_became_peered":"2024-09-11T23:19:34.543677+0000","last_unstale":"2024-09-11T23:19:36.276880+0000","last_undegraded":"2024-09-11T23:19:36.276880+0000","last_fullsized":"2024-09-11T23:19:36.276880+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274563+0000","last_change":"2024-09-11T23:19:35.301300+0000","last_active":"2024-09-11T23:19:36.274563+0000","last_peered":"2024-09-11T23:19:36.274563+0000","last_clean":"2024-09-11T23:19:36.274563+0000","last_became_active":"2024-09-11T23:19:35.300342+0000","last_became_peered":"2024-09-11T23:19:35.300342+0000","last_unstale":"2024-09-11T23:19:36.274563+0000","last_undegraded":"2024-09-11T23:19:36.274563+0000","last_fullsized":"2024-09-11T23:19:36.274563+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:38.687745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.273800+0000","last_change":"2024-09-11T23:19:34.530234+0000","last_active":"2024-09-11T23:19:36.273800+0000","last_peered":"2024-09-11T23:19:36.273800+0000","last_clean":"2024-09-11T23:19:36.273800+0000","last_became_active":"2024-09-11T23:19:34.529514+0000","last_became_peered":"2024-09-11T23:19:34.529514+0000","last_unstale":"2024-09-11T23:19:36.273800+0000","last_undegraded":"2024-09-11T23:19:36.273800+0000","last_fullsized":"2024-09-11T23:19:36.273800+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.964004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.316370+0000","last_change":"2024-09-11T23:19:35.311298+0000","last_active":"2024-09-11T23:19:35.316370+0000","last_peered":"2024-09-11T23:19:35.316370+0000","last_clean":"2024-09-11T23:19:35.316370+0000","last_became_active":"2024-09-11T23:19:35.310208+0000","last_became_peered":"2024-09-11T23:19:35.310208+0000","last_unstale":"2024-09-11T23:19:35.316370+0000","last_undegraded":"2024-09-11T23:19:35.316370+0000","last_fullsized":"2024-09-11T23:19:35.316370+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:07.438916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.278649+0000","last_change":"2024-09-11T23:19:34.555585+0000","last_active":"2024-09-11T23:19:36.278649+0000","last_peered":"2024-09-11T23:19:36.278649+0000","last_clean":"2024-09-11T23:19:36.278649+0000","last_became_active":"2024-09-11T23:19:34.554867+0000","last_became_peered":"2024-09-11T23:19:34.554867+0000","last_unstale":"2024-09-11T23:19:36.278649+0000","last_undegraded":"2024-09-11T23:19:36.278649+0000","last_fullsized":"2024-09-11T23:19:36.278649+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.964004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310479+0000","last_change":"2024-09-11T23:19:35.300156+0000","last_active":"2024-09-11T23:19:35.310479+0000","last_peered":"2024-09-11T23:19:35.310479+0000","last_clean":"2024-09-11T23:19:35.310479+0000","last_became_active":"2024-09-11T23:19:35.299412+0000","last_became_peered":"2024-09-11T23:19:35.299412+0000","last_unstale":"2024-09-11T23:19:35.310479+0000","last_undegraded":"2024-09-11T23:19:35.310479+0000","last_fullsized":"2024-09-11T23:19:35.310479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.267214+0000","last_change":"2024-09-11T23:19:34.555617+0000","last_active":"2024-09-11T23:19:35.267214+0000","last_peered":"2024-09-11T23:19:35.267214+0000","last_clean":"2024-09-11T23:19:35.267214+0000","last_became_active":"2024-09-11T23:19:34.555289+0000","last_became_peered":"2024-09-11T23:19:34.555289+0000","last_unstale":"2024-09-11T23:19:35.267214+0000","last_undegraded":"2024-09-11T23:19:35.267214+0000","last_fullsized":"2024-09-11T23:19:35.267214+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:03.137186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885404+0000","last_change":"2024-09-11T23:19:35.314006+0000","last_active":"2024-09-11T23:19:36.885404+0000","last_peered":"2024-09-11T23:19:36.885404+0000","last_clean":"2024-09-11T23:19:36.885404+0000","last_became_active":"2024-09-11T23:19:35.313714+0000","last_became_peered":"2024-09-11T23:19:35.313714+0000","last_unstale":"2024-09-11T23:19:36.885404+0000","last_undegraded":"2024-09-11T23:19:36.885404+0000","last_fullsized":"2024-09-11T23:19:36.885404+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.833267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.562499+0000","last_change":"2024-09-11T23:19:34.546071+0000","last_active":"2024-09-11T23:19:35.562499+0000","last_peered":"2024-09-11T23:19:35.562499+0000","last_clean":"2024-09-11T23:19:35.562499+0000","last_became_active":"2024-09-11T23:19:34.545237+0000","last_became_peered":"2024-09-11T23:19:34.545237+0000","last_unstale":"2024-09-11T23:19:35.562499+0000","last_undegraded":"2024-09-11T23:19:35.562499+0000","last_fullsized":"2024-09-11T23:19:35.562499+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:50.783874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310695+0000","last_change":"2024-09-11T23:19:35.304619+0000","last_active":"2024-09-11T23:19:35.310695+0000","last_peered":"2024-09-11T23:19:35.310695+0000","last_clean":"2024-09-11T23:19:35.310695+0000","last_became_active":"2024-09-11T23:19:35.304137+0000","last_became_peered":"2024-09-11T23:19:35.304137+0000","last_unstale":"2024-09-11T23:19:35.310695+0000","last_undegraded":"2024-09-11T23:19:35.310695+0000","last_fullsized":"2024-09-11T23:19:35.310695+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.567963+0000","last_change":"2024-09-11T23:19:34.558914+0000","last_active":"2024-09-11T23:19:35.567963+0000","last_peered":"2024-09-11T23:19:35.567963+0000","last_clean":"2024-09-11T23:19:35.567963+0000","last_became_active":"2024-09-11T23:19:34.552803+0000","last_became_peered":"2024-09-11T23:19:34.552803+0000","last_unstale":"2024-09-11T23:19:35.567963+0000","last_undegraded":"2024-09-11T23:19:35.567963+0000","last_fullsized":"2024-09-11T23:19:35.567963+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.703298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280033+0000","last_change":"2024-09-11T23:19:35.289110+0000","last_active":"2024-09-11T23:19:36.280033+0000","last_peered":"2024-09-11T23:19:36.280033+0000","last_clean":"2024-09-11T23:19:36.280033+0000","last_became_active":"2024-09-11T23:19:35.288388+0000","last_became_peered":"2024-09-11T23:19:35.288388+0000","last_unstale":"2024-09-11T23:19:36.280033+0000","last_undegraded":"2024-09-11T23:19:36.280033+0000","last_fullsized":"2024-09-11T23:19:36.280033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.556331+0000","last_change":"2024-09-11T23:19:34.534111+0000","last_active":"2024-09-11T23:19:35.556331+0000","last_peered":"2024-09-11T23:19:35.556331+0000","last_clean":"2024-09-11T23:19:35.556331+0000","last_became_active":"2024-09-11T23:19:34.533737+0000","last_became_peered":"2024-09-11T23:19:34.533737+0000","last_unstale":"2024-09-11T23:19:35.556331+0000","last_undegraded":"2024-09-11T23:19:35.556331+0000","last_fullsized":"2024-09-11T23:19:35.556331+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:40.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312924+0000","last_change":"2024-09-11T23:19:35.307206+0000","last_active":"2024-09-11T23:19:35.312924+0000","last_peered":"2024-09-11T23:19:35.312924+0000","last_clean":"2024-09-11T23:19:35.312924+0000","last_became_active":"2024-09-11T23:19:35.306399+0000","last_became_peered":"2024-09-11T23:19:35.306399+0000","last_unstale":"2024-09-11T23:19:35.312924+0000","last_undegraded":"2024-09-11T23:19:35.312924+0000","last_fullsized":"2024-09-11T23:19:35.312924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:06.842344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274139+0000","last_change":"2024-09-11T23:19:34.538538+0000","last_active":"2024-09-11T23:19:36.274139+0000","last_peered":"2024-09-11T23:19:36.274139+0000","last_clean":"2024-09-11T23:19:36.274139+0000","last_became_active":"2024-09-11T23:19:34.538132+0000","last_became_peered":"2024-09-11T23:19:34.538132+0000","last_unstale":"2024-09-11T23:19:36.274139+0000","last_undegraded":"2024-09-11T23:19:36.274139+0000","last_fullsized":"2024-09-11T23:19:36.274139+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:48.061293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885979+0000","last_change":"2024-09-11T23:19:35.322149+0000","last_active":"2024-09-11T23:19:36.885979+0000","last_peered":"2024-09-11T23:19:36.885979+0000","last_clean":"2024-09-11T23:19:36.885979+0000","last_became_active":"2024-09-11T23:19:35.321528+0000","last_became_peered":"2024-09-11T23:19:35.321528+0000","last_unstale":"2024-09-11T23:19:36.885979+0000","last_undegraded":"2024-09-11T23:19:36.885979+0000","last_fullsized":"2024-09-11T23:19:36.885979+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.682407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884821+0000","last_change":"2024-09-11T23:19:34.555607+0000","last_active":"2024-09-11T23:19:36.884821+0000","last_peered":"2024-09-11T23:19:36.884821+0000","last_clean":"2024-09-11T23:19:36.884821+0000","last_became_active":"2024-09-11T23:19:34.555289+0000","last_became_peered":"2024-09-11T23:19:34.555289+0000","last_unstale":"2024-09-11T23:19:36.884821+0000","last_undegraded":"2024-09-11T23:19:36.884821+0000","last_fullsized":"2024-09-11T23:19:36.884821+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:17.404298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314214+0000","last_change":"2024-09-11T23:19:35.301044+0000","last_active":"2024-09-11T23:19:35.314214+0000","last_peered":"2024-09-11T23:19:35.314214+0000","last_clean":"2024-09-11T23:19:35.314214+0000","last_became_active":"2024-09-11T23:19:35.299709+0000","last_became_peered":"2024-09-11T23:19:35.299709+0000","last_unstale":"2024-09-11T23:19:35.314214+0000","last_undegraded":"2024-09-11T23:19:35.314214+0000","last_fullsized":"2024-09-11T23:19:35.314214+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:34.373642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.276816+0000","last_change":"2024-09-11T23:19:34.545492+0000","last_active":"2024-09-11T23:19:36.276816+0000","last_peered":"2024-09-11T23:19:36.276816+0000","last_clean":"2024-09-11T23:19:36.276816+0000","last_became_active":"2024-09-11T23:19:34.543670+0000","last_became_peered":"2024-09-11T23:19:34.543670+0000","last_unstale":"2024-09-11T23:19:36.276816+0000","last_undegraded":"2024-09-11T23:19:36.276816+0000","last_fullsized":"2024-09-11T23:19:36.276816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:15.733958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885318+0000","last_change":"2024-09-11T23:19:35.298943+0000","last_active":"2024-09-11T23:19:36.885318+0000","last_peered":"2024-09-11T23:19:36.885318+0000","last_clean":"2024-09-11T23:19:36.885318+0000","last_became_active":"2024-09-11T23:19:35.298231+0000","last_became_peered":"2024-09-11T23:19:35.298231+0000","last_unstale":"2024-09-11T23:19:36.885318+0000","last_undegraded":"2024-09-11T23:19:36.885318+0000","last_fullsized":"2024-09-11T23:19:36.885318+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:31.758325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.566186+0000","last_change":"2024-09-11T23:19:34.565693+0000","last_active":"2024-09-11T23:19:35.566186+0000","last_peered":"2024-09-11T23:19:35.566186+0000","last_clean":"2024-09-11T23:19:35.566186+0000","last_became_active":"2024-09-11T23:19:34.564730+0000","last_became_peered":"2024-09-11T23:19:34.564730+0000","last_unstale":"2024-09-11T23:19:35.566186+0000","last_undegraded":"2024-09-11T23:19:35.566186+0000","last_fullsized":"2024-09-11T23:19:35.566186+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.104186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.308432+0000","last_change":"2024-09-11T23:19:35.301222+0000","last_active":"2024-09-11T23:19:35.308432+0000","last_peered":"2024-09-11T23:19:35.308432+0000","last_clean":"2024-09-11T23:19:35.308432+0000","last_became_active":"2024-09-11T23:19:35.300450+0000","last_became_peered":"2024-09-11T23:19:35.300450+0000","last_unstale":"2024-09-11T23:19:35.308432+0000","last_undegraded":"2024-09-11T23:19:35.308432+0000","last_fullsized":"2024-09-11T23:19:35.308432+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:05.889053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.565029+0000","last_change":"2024-09-11T23:19:34.564907+0000","last_active":"2024-09-11T23:19:35.565029+0000","last_peered":"2024-09-11T23:19:35.565029+0000","last_clean":"2024-09-11T23:19:35.565029+0000","last_became_active":"2024-09-11T23:19:34.564174+0000","last_became_peered":"2024-09-11T23:19:34.564174+0000","last_unstale":"2024-09-11T23:19:35.565029+0000","last_undegraded":"2024-09-11T23:19:35.565029+0000","last_fullsized":"2024-09-11T23:19:35.565029+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:05.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.310636+0000","last_change":"2024-09-11T23:19:35.295792+0000","last_active":"2024-09-11T23:19:35.310636+0000","last_peered":"2024-09-11T23:19:35.310636+0000","last_clean":"2024-09-11T23:19:35.310636+0000","last_became_active":"2024-09-11T23:19:35.295060+0000","last_became_peered":"2024-09-11T23:19:35.295060+0000","last_unstale":"2024-09-11T23:19:35.310636+0000","last_undegraded":"2024-09-11T23:19:35.310636+0000","last_fullsized":"2024-09-11T23:19:35.310636+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280014+0000","last_change":"2024-09-11T23:19:34.556722+0000","last_active":"2024-09-11T23:19:36.280014+0000","last_peered":"2024-09-11T23:19:36.280014+0000","last_clean":"2024-09-11T23:19:36.280014+0000","last_became_active":"2024-09-11T23:19:34.556021+0000","last_became_peered":"2024-09-11T23:19:34.556021+0000","last_unstale":"2024-09-11T23:19:36.280014+0000","last_undegraded":"2024-09-11T23:19:36.280014+0000","last_fullsized":"2024-09-11T23:19:36.280014+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.951850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.314101+0000","last_change":"2024-09-11T23:19:35.294031+0000","last_active":"2024-09-11T23:19:35.314101+0000","last_peered":"2024-09-11T23:19:35.314101+0000","last_clean":"2024-09-11T23:19:35.314101+0000","last_became_active":"2024-09-11T23:19:35.293350+0000","last_became_peered":"2024-09-11T23:19:35.293350+0000","last_unstale":"2024-09-11T23:19:35.314101+0000","last_undegraded":"2024-09-11T23:19:35.314101+0000","last_fullsized":"2024-09-11T23:19:35.314101+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:22.143162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885683+0000","last_change":"2024-09-11T23:19:34.531270+0000","last_active":"2024-09-11T23:19:36.885683+0000","last_peered":"2024-09-11T23:19:36.885683+0000","last_clean":"2024-09-11T23:19:36.885683+0000","last_became_active":"2024-09-11T23:19:34.530804+0000","last_became_peered":"2024-09-11T23:19:34.530804+0000","last_unstale":"2024-09-11T23:19:36.885683+0000","last_undegraded":"2024-09-11T23:19:36.885683+0000","last_fullsized":"2024-09-11T23:19:36.885683+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:18.034787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312088+0000","last_change":"2024-09-11T23:19:35.290948+0000","last_active":"2024-09-11T23:19:35.312088+0000","last_peered":"2024-09-11T23:19:35.312088+0000","last_clean":"2024-09-11T23:19:35.312088+0000","last_became_active":"2024-09-11T23:19:35.290138+0000","last_became_peered":"2024-09-11T23:19:35.290138+0000","last_unstale":"2024-09-11T23:19:35.312088+0000","last_undegraded":"2024-09-11T23:19:35.312088+0000","last_fullsized":"2024-09-11T23:19:35.312088+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:27.156242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.884916+0000","last_change":"2024-09-11T23:19:34.529378+0000","last_active":"2024-09-11T23:19:36.884916+0000","last_peered":"2024-09-11T23:19:36.884916+0000","last_clean":"2024-09-11T23:19:36.884916+0000","last_became_active":"2024-09-11T23:19:34.528961+0000","last_became_peered":"2024-09-11T23:19:34.528961+0000","last_unstale":"2024-09-11T23:19:36.884916+0000","last_undegraded":"2024-09-11T23:19:36.884916+0000","last_fullsized":"2024-09-11T23:19:36.884916+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:25.118498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274281+0000","last_change":"2024-09-11T23:19:35.306126+0000","last_active":"2024-09-11T23:19:36.274281+0000","last_peered":"2024-09-11T23:19:36.274281+0000","last_clean":"2024-09-11T23:19:36.274281+0000","last_became_active":"2024-09-11T23:19:35.305556+0000","last_became_peered":"2024-09-11T23:19:35.305556+0000","last_unstale":"2024-09-11T23:19:36.274281+0000","last_undegraded":"2024-09-11T23:19:36.274281+0000","last_fullsized":"2024-09-11T23:19:36.274281+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:37.832963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.293026+0000","last_change":"2024-09-11T23:19:34.552900+0000","last_active":"2024-09-11T23:19:35.293026+0000","last_peered":"2024-09-11T23:19:35.293026+0000","last_clean":"2024-09-11T23:19:35.293026+0000","last_became_active":"2024-09-11T23:19:34.551942+0000","last_became_peered":"2024-09-11T23:19:34.551942+0000","last_unstale":"2024-09-11T23:19:35.293026+0000","last_undegraded":"2024-09-11T23:19:35.293026+0000","last_fullsized":"2024-09-11T23:19:35.293026+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885898+0000","last_change":"2024-09-11T23:19:35.314621+0000","last_active":"2024-09-11T23:19:36.885898+0000","last_peered":"2024-09-11T23:19:36.885898+0000","last_clean":"2024-09-11T23:19:36.885898+0000","last_became_active":"2024-09-11T23:19:35.313859+0000","last_became_peered":"2024-09-11T23:19:35.313859+0000","last_unstale":"2024-09-11T23:19:36.885898+0000","last_undegraded":"2024-09-11T23:19:36.885898+0000","last_fullsized":"2024-09-11T23:19:36.885898+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:45.618395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885307+0000","last_change":"2024-09-11T23:19:34.529471+0000","last_active":"2024-09-11T23:19:36.885307+0000","last_peered":"2024-09-11T23:19:36.885307+0000","last_clean":"2024-09-11T23:19:36.885307+0000","last_became_active":"2024-09-11T23:19:34.529079+0000","last_became_peered":"2024-09-11T23:19:34.529079+0000","last_unstale":"2024-09-11T23:19:36.885307+0000","last_undegraded":"2024-09-11T23:19:36.885307+0000","last_fullsized":"2024-09-11T23:19:36.885307+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:22.111723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.312157+0000","last_change":"2024-09-11T23:19:35.290469+0000","last_active":"2024-09-11T23:19:35.312157+0000","last_peered":"2024-09-11T23:19:35.312157+0000","last_clean":"2024-09-11T23:19:35.312157+0000","last_became_active":"2024-09-11T23:19:35.289692+0000","last_became_peered":"2024-09-11T23:19:35.289692+0000","last_unstale":"2024-09-11T23:19:35.312157+0000","last_undegraded":"2024-09-11T23:19:35.312157+0000","last_fullsized":"2024-09-11T23:19:35.312157+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:45.909214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.559113+0000","last_change":"2024-09-11T23:19:34.533551+0000","last_active":"2024-09-11T23:19:35.559113+0000","last_peered":"2024-09-11T23:19:35.559113+0000","last_clean":"2024-09-11T23:19:35.559113+0000","last_became_active":"2024-09-11T23:19:34.532956+0000","last_became_peered":"2024-09-11T23:19:34.532956+0000","last_unstale":"2024-09-11T23:19:35.559113+0000","last_undegraded":"2024-09-11T23:19:35.559113+0000","last_fullsized":"2024-09-11T23:19:35.559113+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:50.783874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277031+0000","last_change":"2024-09-11T23:19:35.314734+0000","last_active":"2024-09-11T23:19:36.277031+0000","last_peered":"2024-09-11T23:19:36.277031+0000","last_clean":"2024-09-11T23:19:36.277031+0000","last_became_active":"2024-09-11T23:19:35.313003+0000","last_became_peered":"2024-09-11T23:19:35.313003+0000","last_unstale":"2024-09-11T23:19:36.277031+0000","last_undegraded":"2024-09-11T23:19:36.277031+0000","last_fullsized":"2024-09-11T23:19:36.277031+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:49.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.269366+0000","last_change":"2024-09-11T23:19:34.531211+0000","last_active":"2024-09-11T23:19:35.269366+0000","last_peered":"2024-09-11T23:19:35.269366+0000","last_clean":"2024-09-11T23:19:35.269366+0000","last_became_active":"2024-09-11T23:19:34.530846+0000","last_became_peered":"2024-09-11T23:19:34.530846+0000","last_unstale":"2024-09-11T23:19:35.269366+0000","last_undegraded":"2024-09-11T23:19:35.269366+0000","last_fullsized":"2024-09-11T23:19:35.269366+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:13.525542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.274218+0000","last_change":"2024-09-11T23:19:35.306158+0000","last_active":"2024-09-11T23:19:36.274218+0000","last_peered":"2024-09-11T23:19:36.274218+0000","last_clean":"2024-09-11T23:19:36.274218+0000","last_became_active":"2024-09-11T23:19:35.305491+0000","last_became_peered":"2024-09-11T23:19:35.305491+0000","last_unstale":"2024-09-11T23:19:36.274218+0000","last_undegraded":"2024-09-11T23:19:36.274218+0000","last_fullsized":"2024-09-11T23:19:36.274218+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:02.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.295670+0000","last_change":"2024-09-11T23:19:34.551567+0000","last_active":"2024-09-11T23:19:35.295670+0000","last_peered":"2024-09-11T23:19:35.295670+0000","last_clean":"2024-09-11T23:19:35.295670+0000","last_became_active":"2024-09-11T23:19:34.547274+0000","last_became_peered":"2024-09-11T23:19:34.547274+0000","last_unstale":"2024-09-11T23:19:35.295670+0000","last_undegraded":"2024-09-11T23:19:35.295670+0000","last_fullsized":"2024-09-11T23:19:35.295670+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.951850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280000+0000","last_change":"2024-09-11T23:19:35.284348+0000","last_active":"2024-09-11T23:19:36.280000+0000","last_peered":"2024-09-11T23:19:36.280000+0000","last_clean":"2024-09-11T23:19:36.280000+0000","last_became_active":"2024-09-11T23:19:35.283546+0000","last_became_peered":"2024-09-11T23:19:35.283546+0000","last_unstale":"2024-09-11T23:19:36.280000+0000","last_undegraded":"2024-09-11T23:19:36.280000+0000","last_fullsized":"2024-09-11T23:19:36.280000+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:16.151629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.288695+0000","last_change":"2024-09-11T23:19:34.560243+0000","last_active":"2024-09-11T23:19:35.288695+0000","last_peered":"2024-09-11T23:19:35.288695+0000","last_clean":"2024-09-11T23:19:35.288695+0000","last_became_active":"2024-09-11T23:19:34.559810+0000","last_became_peered":"2024-09-11T23:19:34.559810+0000","last_unstale":"2024-09-11T23:19:35.288695+0000","last_undegraded":"2024-09-11T23:19:35.288695+0000","last_fullsized":"2024-09-11T23:19:35.288695+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:41.058934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885713+0000","last_change":"2024-09-11T23:19:35.309391+0000","last_active":"2024-09-11T23:19:36.885713+0000","last_peered":"2024-09-11T23:19:36.885713+0000","last_clean":"2024-09-11T23:19:36.885713+0000","last_became_active":"2024-09-11T23:19:35.308651+0000","last_became_peered":"2024-09-11T23:19:35.308651+0000","last_unstale":"2024-09-11T23:19:36.885713+0000","last_undegraded":"2024-09-11T23:19:36.885713+0000","last_fullsized":"2024-09-11T23:19:36.885713+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:13.368751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.277706+0000","last_change":"2024-09-11T23:19:34.555478+0000","last_active":"2024-09-11T23:19:36.277706+0000","last_peered":"2024-09-11T23:19:36.277706+0000","last_clean":"2024-09-11T23:19:36.277706+0000","last_became_active":"2024-09-11T23:19:34.554438+0000","last_became_peered":"2024-09-11T23:19:34.554438+0000","last_unstale":"2024-09-11T23:19:36.277706+0000","last_undegraded":"2024-09-11T23:19:36.277706+0000","last_fullsized":"2024-09-11T23:19:36.277706+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:39.104186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885611+0000","last_change":"2024-09-11T23:19:35.314951+0000","last_active":"2024-09-11T23:19:36.885611+0000","last_peered":"2024-09-11T23:19:36.885611+0000","last_clean":"2024-09-11T23:19:36.885611+0000","last_became_active":"2024-09-11T23:19:35.314173+0000","last_became_peered":"2024-09-11T23:19:35.314173+0000","last_unstale":"2024-09-11T23:19:36.885611+0000","last_undegraded":"2024-09-11T23:19:36.885611+0000","last_fullsized":"2024-09-11T23:19:36.885611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:25.673089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885296+0000","last_change":"2024-09-11T23:19:34.555996+0000","last_active":"2024-09-11T23:19:36.885296+0000","last_peered":"2024-09-11T23:19:36.885296+0000","last_clean":"2024-09-11T23:19:36.885296+0000","last_became_active":"2024-09-11T23:19:34.555622+0000","last_became_peered":"2024-09-11T23:19:34.555622+0000","last_unstale":"2024-09-11T23:19:36.885296+0000","last_undegraded":"2024-09-11T23:19:36.885296+0000","last_fullsized":"2024-09-11T23:19:36.885296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:52.877546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.323013+0000","last_change":"2024-09-11T23:19:35.319433+0000","last_active":"2024-09-11T23:19:35.323013+0000","last_peered":"2024-09-11T23:19:35.323013+0000","last_clean":"2024-09-11T23:19:35.323013+0000","last_became_active":"2024-09-11T23:19:35.318755+0000","last_became_peered":"2024-09-11T23:19:35.318755+0000","last_unstale":"2024-09-11T23:19:35.323013+0000","last_undegraded":"2024-09-11T23:19:35.323013+0000","last_fullsized":"2024-09-11T23:19:35.323013+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:41.534880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.293432+0000","last_change":"2024-09-11T23:19:34.552782+0000","last_active":"2024-09-11T23:19:35.293432+0000","last_peered":"2024-09-11T23:19:35.293432+0000","last_clean":"2024-09-11T23:19:35.293432+0000","last_became_active":"2024-09-11T23:19:34.547409+0000","last_became_peered":"2024-09-11T23:19:34.547409+0000","last_unstale":"2024-09-11T23:19:35.293432+0000","last_undegraded":"2024-09-11T23:19:35.293432+0000","last_fullsized":"2024-09-11T23:19:35.293432+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:13.721323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.280464+0000","last_change":"2024-09-11T23:19:35.297925+0000","last_active":"2024-09-11T23:19:36.280464+0000","last_peered":"2024-09-11T23:19:36.280464+0000","last_clean":"2024-09-11T23:19:36.280464+0000","last_became_active":"2024-09-11T23:19:35.297205+0000","last_became_peered":"2024-09-11T23:19:35.297205+0000","last_unstale":"2024-09-11T23:19:36.280464+0000","last_undegraded":"2024-09-11T23:19:36.280464+0000","last_fullsized":"2024-09-11T23:19:36.280464+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:02.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885576+0000","last_change":"2024-09-11T23:19:34.554636+0000","last_active":"2024-09-11T23:19:36.885576+0000","last_peered":"2024-09-11T23:19:36.885576+0000","last_clean":"2024-09-11T23:19:36.885576+0000","last_became_active":"2024-09-11T23:19:34.554275+0000","last_became_peered":"2024-09-11T23:19:34.554275+0000","last_unstale":"2024-09-11T23:19:36.885576+0000","last_undegraded":"2024-09-11T23:19:36.885576+0000","last_fullsized":"2024-09-11T23:19:36.885576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:33.993679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.279384+0000","last_change":"2024-09-11T23:19:35.291868+0000","last_active":"2024-09-11T23:19:36.279384+0000","last_peered":"2024-09-11T23:19:36.279384+0000","last_clean":"2024-09-11T23:19:36.279384+0000","last_became_active":"2024-09-11T23:19:35.291162+0000","last_became_peered":"2024-09-11T23:19:35.291162+0000","last_unstale":"2024-09-11T23:19:36.279384+0000","last_undegraded":"2024-09-11T23:19:36.279384+0000","last_fullsized":"2024-09-11T23:19:36.279384+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:34.508933+0000","last_clean_scrub_stamp":"2024-09-11T23:19:34.508933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:04.973409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-11T23:19:36.885943+0000","last_change":"2024-09-11T23:19:34.529973+0000","last_active":"2024-09-11T23:19:36.885943+0000","last_peered":"2024-09-11T23:19:36.885943+0000","last_clean":"2024-09-11T23:19:36.885943+0000","last_became_active":"2024-09-11T23:19:34.529491+0000","last_became_peered":"2024-09-11T23:19:34.529491+0000","last_unstale":"2024-09-11T23:19:36.885943+0000","last_undegraded":"2024-09-11T23:19:36.885943+0000","last_fullsized":"2024-09-11T23:19:36.885943+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:33.505360+0000","last_clean_scrub_stamp":"2024-09-11T23:19:33.505360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:00.008433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":315,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T23:19:35.288994+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:19:35.288994+0000","last_peered":"2024-09-11T23:19:35.288994+0000","last_clean":"2024-09-11T23:19:35.288994+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:19:35.288994+0000","last_undegraded":"2024-09-11T23:19:35.288994+0000","last_fullsized":"2024-09-11T23:19:35.288994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1806336,"data_stored":1143753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1224704,"data_stored":555441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1216512,"data_stored":559917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36544,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335296,"statfs":{"total":96636764160,"available":96599343104,"internally_reserved":0,"allocated":1224704,"data_stored":560009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36532,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335308,"statfs":{"total":96636764160,"available":96599355392,"internally_reserved":0,"allocated":1208320,"data_stored":553807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1208320,"data_stored":553259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40684,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331156,"statfs":{"total":96636764160,"available":96595103744,"internally_reserved":0,"allocated":1208320,"data_stored":553259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41288,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330552,"statfs":{"total":96636764160,"available":96594485248,"internally_reserved":0,"allocated":1814528,"data_stored":1145295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:38.929 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:19:38.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:19:39.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b3d99640 1 Processor -- start 2024-09-11T23:19:39.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b3d99640 1 -- start start 2024-09-11T23:19:39.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b3d99640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65ac0b43a0 0x7f65ac0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b3d99640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65ac072230 0x7f65ac072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b3d99640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac0cf0f0 con 0x7f65ac15e640 2024-09-11T23:19:39.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b3d99640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f65ac15ea20 con 0x7f65ac0b43a0 2024-09-11T23:19:39.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b3d99640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f65ac0cf3c0 con 0x7f65ac072230 2024-09-11T23:19:39.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b1334640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65ac0b43a0 0x7f65ac0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b1334640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65ac0b43a0 0x7f65ac0b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44326/0 (socket says 172.21.15.94:44326) 2024-09-11T23:19:39.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b1334640 1 -- 172.21.15.94:0/2948769199 learned_addr learned my addr 172.21.15.94:0/2948769199 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:39.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b2336640 1 --2- 172.21.15.94:0/2948769199 >> v2:172.21.15.155:3300/0 conn(0x7f65ac072230 0x7f65ac072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b1334640 1 -- 172.21.15.94:0/2948769199 >> v2:172.21.15.155:3300/0 conn(0x7f65ac072230 msgr2=0x7f65ac072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:39.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b1334640 1 --2- 172.21.15.94:0/2948769199 >> v2:172.21.15.155:3300/0 conn(0x7f65ac072230 0x7f65ac072640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b1334640 1 -- 172.21.15.94:0/2948769199 >> v1:172.21.15.155:6789/0 conn(0x7f65ac15e640 legacy=0x7f65ac0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:39.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.101+0000 7f65b1334640 1 -- 172.21.15.94:0/2948769199 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac0cf6a0 con 0x7f65ac0b43a0 2024-09-11T23:19:39.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b1334640 1 --2- 172.21.15.94:0/2948769199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac0b43a0 0x7f65ac0b47e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f65ac09e080 tx=0x7f65a801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45eff0f1ffe23b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b0b33640 1 -- 172.21.15.94:0/2948769199 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a80ab5f0 con 0x7f65ac0b43a0 2024-09-11T23:19:39.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b0b33640 1 -- 172.21.15.94:0/2948769199 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a80b0070 con 0x7f65ac0b43a0 2024-09-11T23:19:39.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b0b33640 1 -- 172.21.15.94:0/2948769199 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a80ab9b0 con 0x7f65ac0b43a0 2024-09-11T23:19:39.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 -- 172.21.15.94:0/2948769199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac0b43a0 msgr2=0x7f65ac0b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2948769199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac0b43a0 0x7f65ac0b47e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f65ac09e080 tx=0x7f65a801c4e0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 -- 172.21.15.94:0/2948769199 shutdown_connections 2024-09-11T23:19:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2948769199 >> v2:172.21.15.155:3300/0 conn(0x7f65ac072230 0x7f65ac072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2948769199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac0b43a0 0x7f65ac0b47e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 -- 172.21.15.94:0/2948769199 >> 172.21.15.94:0/2948769199 conn(0x7f65ac0b1c80 msgr2=0x7f65ac0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 -- 172.21.15.94:0/2948769199 shutdown_connections 2024-09-11T23:19:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 -- 172.21.15.94:0/2948769199 wait complete. 2024-09-11T23:19:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 Processor -- start 2024-09-11T23:19:39.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.105+0000 7f65b3d99640 1 -- start start 2024-09-11T23:19:39.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65ac072230 0x7f65ac152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65ac0b43a0 0x7f65ac160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac15e640 0x7f65ac15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac06f0e0 con 0x7f65ac15e640 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac06ef60 con 0x7f65ac072230 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65ac16b0f0 con 0x7f65ac0b43a0 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac15e640 0x7f65ac15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac15e640 0x7f65ac15caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44332/0 (socket says 172.21.15.94:44332) 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 -- 172.21.15.94:0/2551112669 learned_addr learned my addr 172.21.15.94:0/2551112669 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b1334640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65ac0b43a0 0x7f65ac160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b1b35640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65ac072230 0x7f65ac152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 -- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65ac0b43a0 msgr2=0x7f65ac160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65ac0b43a0 0x7f65ac160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 -- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65ac072230 msgr2=0x7f65ac152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65ac072230 0x7f65ac152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 -- 172.21.15.94:0/2551112669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac15fb30 con 0x7f65ac15e640 2024-09-11T23:19:39.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b2336640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac15e640 0x7f65ac15caa0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f65a4007e70 tx=0x7f65a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65a27fc640 1 -- 172.21.15.94:0/2551112669 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4014420 con 0x7f65ac15e640 2024-09-11T23:19:39.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65a27fc640 1 -- 172.21.15.94:0/2551112669 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4019070 con 0x7f65ac15e640 2024-09-11T23:19:39.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ac15fe10 con 0x7f65ac15e640 2024-09-11T23:19:39.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65a27fc640 1 -- 172.21.15.94:0/2551112669 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4014820 con 0x7f65ac15e640 2024-09-11T23:19:39.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ac1603d0 con 0x7f65ac15e640 2024-09-11T23:19:39.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ac072640 con 0x7f65ac15e640 2024-09-11T23:19:39.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65a27fc640 1 -- 172.21.15.94:0/2551112669 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65a40149c0 con 0x7f65ac15e640 2024-09-11T23:19:39.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65a27fc640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65900678c0 0x7f6590069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65a27fc640 1 -- 172.21.15.94:0/2551112669 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f65a4086670 con 0x7f65ac15e640 2024-09-11T23:19:39.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.109+0000 7f65b1b35640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65900678c0 0x7f6590069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.113+0000 7f65b1b35640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65900678c0 0x7f6590069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f65ac06e790 tx=0x7f659c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.113+0000 7f65a27fc640 1 -- 172.21.15.94:0/2551112669 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f65a4011260 con 0x7f65ac15e640 2024-09-11T23:19:39.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.325+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f65ac0af340 con 0x7f65ac15e640 2024-09-11T23:19:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.329+0000 7f65a27fc640 1 -- 172.21.15.94:0/2551112669 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f65a4057020 con 0x7f65ac15e640 2024-09-11T23:19:39.331 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:19:39.331 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:19:39.331 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2024-09-11T23:19:39.331 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2024-09-11T23:19:39.331 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:19:39.332 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2024-09-11T23:19:39.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65900678c0 msgr2=0x7f6590069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65900678c0 0x7f6590069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f65ac06e790 tx=0x7f659c008040 comp rx=0 tx=0).stop 2024-09-11T23:19:39.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac15e640 msgr2=0x7f65ac15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac15e640 0x7f65ac15caa0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f65a4007e70 tx=0x7f65a400e4b0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 shutdown_connections 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f65900678c0 0x7f6590069d80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65ac15e640 0x7f65ac15caa0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65ac0b43a0 0x7f65ac160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 --2- 172.21.15.94:0/2551112669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65ac072230 0x7f65ac152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 >> 172.21.15.94:0/2551112669 conn(0x7f65ac0b1c80 msgr2=0x7f65ac0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 shutdown_connections 2024-09-11T23:19:39.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.333+0000 7f65b3d99640 1 -- 172.21.15.94:0/2551112669 wait complete. 2024-09-11T23:19:39.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:39.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.457+0000 7fe7f19f4640 1 Processor -- start 2024-09-11T23:19:39.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.457+0000 7fe7f19f4640 1 -- start start 2024-09-11T23:19:39.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7f19f4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe7ec1520a0 0x7fe7ec06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7f19f4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7ec06fe50 0x7fe7ec15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7f19f4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ec070250 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7f19f4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec152480 con 0x7fe7ec1520a0 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7f19f4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec0aede0 con 0x7fe7ec06fe50 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7eaffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe7ec1520a0 0x7fe7ec06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7eb7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe7ec15f1d0 0x7fe7ec071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50690/0 (socket says 172.21.15.94:50690) 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7eb7fe640 1 -- 172.21.15.94:0/3353167444 learned_addr learned my addr 172.21.15.94:0/3353167444 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7ea7fc640 1 --2- 172.21.15.94:0/3353167444 >> v2:172.21.15.155:3300/0 conn(0x7fe7ec06fe50 0x7fe7ec15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7e9ffb640 1 -- 172.21.15.94:0/3353167444 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808317239 0 0) 0x7fe7ec070250 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7e9ffb640 1 -- 172.21.15.94:0/3353167444 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7d4003530 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7eaffd640 1 -- 172.21.15.94:0/3353167444 >> v2:172.21.15.155:3300/0 conn(0x7fe7ec06fe50 msgr2=0x7fe7ec15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7eaffd640 1 --2- 172.21.15.94:0/3353167444 >> v2:172.21.15.155:3300/0 conn(0x7fe7ec06fe50 0x7fe7ec15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7eaffd640 1 -- 172.21.15.94:0/3353167444 >> v1:172.21.15.94:6789/0 conn(0x7fe7ec15f1d0 legacy=0x7fe7ec071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.461+0000 7fe7eaffd640 1 -- 172.21.15.94:0/3353167444 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec15fa10 con 0x7fe7ec1520a0 2024-09-11T23:19:39.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eaffd640 1 --2- 172.21.15.94:0/3353167444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec1520a0 0x7fe7ec06f910 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec06e510 tx=0x7fe7dc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989d0d2ffb27c7f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7e9ffb640 1 -- 172.21.15.94:0/3353167444 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0b2070 con 0x7fe7ec1520a0 2024-09-11T23:19:39.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7e9ffb640 1 -- 172.21.15.94:0/3353167444 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc0ad680 con 0x7fe7ec1520a0 2024-09-11T23:19:39.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7e9ffb640 1 -- 172.21.15.94:0/3353167444 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0ada50 con 0x7fe7ec1520a0 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3353167444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec1520a0 msgr2=0x7fe7ec06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3353167444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec1520a0 0x7fe7ec06f910 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec06e510 tx=0x7fe7dc01c460 comp rx=0 tx=0).stop 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3353167444 shutdown_connections 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3353167444 >> v2:172.21.15.155:3300/0 conn(0x7fe7ec06fe50 0x7fe7ec15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3353167444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec1520a0 0x7fe7ec06f910 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3353167444 >> 172.21.15.94:0/3353167444 conn(0x7fe7ec0b1f90 msgr2=0x7fe7ec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3353167444 shutdown_connections 2024-09-11T23:19:39.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3353167444 wait complete. 2024-09-11T23:19:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 Processor -- start 2024-09-11T23:19:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- start start 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7ec06fe50 0x7fe7ec1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7ec1520a0 0x7fe7ec15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec15f1d0 0x7fe7ec15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec073d30 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec073a50 con 0x7fe7ec06fe50 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec15f5e0 con 0x7fe7ec1520a0 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec15f1d0 0x7fe7ec15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec15f1d0 0x7fe7ec15cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44346/0 (socket says 172.21.15.94:44346) 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 -- 172.21.15.94:0/3712561323 learned_addr learned my addr 172.21.15.94:0/3712561323 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:39.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7ea7fc640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7ec1520a0 0x7fe7ec15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 -- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7ec1520a0 msgr2=0x7fe7ec15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eaffd640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7ec06fe50 0x7fe7ec1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7ec1520a0 0x7fe7ec15c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 -- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7ec06fe50 msgr2=0x7fe7ec1461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7ec06fe50 0x7fe7ec1461b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 -- 172.21.15.94:0/3712561323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec15e600 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7eb7fe640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec15f1d0 0x7fe7ec15cbf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400cb70 tx=0x7fe7e400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7d3fff640 1 -- 172.21.15.94:0/3712561323 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4017070 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7d3fff640 1 -- 172.21.15.94:0/3712561323 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e400ad40 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7d3fff640 1 -- 172.21.15.94:0/3712561323 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4012620 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec14e500 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.465+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec0ccde0 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.469+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec15ec90 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.469+0000 7fe7d3fff640 1 -- 172.21.15.94:0/3712561323 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7e401a070 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.469+0000 7fe7d3fff640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe7d80678c0 0x7fe7d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.469+0000 7fe7d3fff640 1 -- 172.21.15.94:0/3712561323 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fe7e4085c90 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.469+0000 7fe7eaffd640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe7d80678c0 0x7fe7d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.469+0000 7fe7eaffd640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe7d80678c0 0x7fe7d8069d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0af000 tx=0x7fe7dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.473+0000 7fe7d3fff640 1 -- 172.21.15.94:0/3712561323 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe7e4056630 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7ec06e540 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7d3fff640 1 -- 172.21.15.94:0/3712561323 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5231 (secure 0 0 0) 0x7fe7e4055f30 con 0x7fe7ec15f1d0 2024-09-11T23:19:39.657 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:39.657 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":55,"btime":"2024-09-11T23:19:37:551427+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5144,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3790711981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3790711981},{"type":"v1","addr":"172.21.15.155:6835","nonce":3790711981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5599,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1543085113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1543085113},{"type":"v1","addr":"172.21.15.155:6837","nonce":1543085113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6687,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4168281788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4168281788},{"type":"v1","addr":"172.21.15.94:6833","nonce":4168281788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:36.898739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/3585698004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3585698004},{"type":"v1","addr":"172.21.15.94:6835","nonce":3585698004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6690,"qdb_cluster":[6690]},"id":7}]} 2024-09-11T23:19:39.657 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 55 2024-09-11T23:19:39.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe7d80678c0 msgr2=0x7fe7d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe7d80678c0 0x7fe7d8069d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0af000 tx=0x7fe7dc008040 comp rx=0 tx=0).stop 2024-09-11T23:19:39.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec15f1d0 msgr2=0x7fe7ec15cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec15f1d0 0x7fe7ec15cbf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400cb70 tx=0x7fe7e400a430 comp rx=0 tx=0).stop 2024-09-11T23:19:39.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 shutdown_connections 2024-09-11T23:19:39.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe7d80678c0 0x7fe7d8069d80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7ec15f1d0 0x7fe7ec15cbf0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7ec1520a0 0x7fe7ec15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 --2- 172.21.15.94:0/3712561323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7ec06fe50 0x7fe7ec1461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 >> 172.21.15.94:0/3712561323 conn(0x7fe7ec0b1f90 msgr2=0x7fe7ec0adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:39.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 shutdown_connections 2024-09-11T23:19:39.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:39.657+0000 7fe7f19f4640 1 -- 172.21.15.94:0/3712561323 wait complete. 2024-09-11T23:19:40.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:19:34.908440+0000', 'modified': '2024-09-11T23:19:36.898739+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6690}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6690': {'gid': 6690, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6835/3585698004', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 3585698004}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 3585698004}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6690, 'qdb_cluster': [6690]} 2024-09-11T23:19:40.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:19:40.077 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:19:40.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.201+0000 7f2270397640 1 Processor -- start 2024-09-11T23:19:40.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.201+0000 7f2270397640 1 -- start start 2024-09-11T23:19:40.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f2270397640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 0x7f22680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f2270397640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f22680af2a0 0x7f226806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f2270397640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22680b3290 con 0x7f226815bec0 2024-09-11T23:19:40.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f2270397640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f22680b3570 con 0x7f22680af2a0 2024-09-11T23:19:40.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f2270397640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f22680b3850 con 0x7f226815c2a0 2024-09-11T23:19:40.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e133640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f226815bec0 0x7f22680ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56732/0 (socket says 172.21.15.94:56732) 2024-09-11T23:19:40.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e133640 1 -- 172.21.15.94:0/2793644040 learned_addr learned my addr 172.21.15.94:0/2793644040 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:40.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 --2- 172.21.15.94:0/2793644040 >> v2:172.21.15.155:3300/0 conn(0x7f22680af2a0 0x7f226806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d932640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 0x7f22680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369034508 0 0) 0x7f22680b3290 con 0x7f226815bec0 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2254003530 con 0x7f226815bec0 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2209133271 0 0) 0x7f2254003530 con 0x7f226815bec0 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 msgr2=0x7f22680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 0x7f22680aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 >> v2:172.21.15.155:3300/0 conn(0x7f22680af2a0 msgr2=0x7f226806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 --2- 172.21.15.94:0/2793644040 >> v2:172.21.15.155:3300/0 conn(0x7f22680af2a0 0x7f226806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22680b3b30 con 0x7f226815bec0 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f2264001680 con 0x7f226815bec0 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 >> v1:172.21.15.94:6789/0 conn(0x7f226815bec0 legacy=0x7f22680ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22540039c0 0x7f2254003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 0x7f2254004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f22540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f22680b3570 con 0x7f2254004d50 2024-09-11T23:19:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22680b3850 con 0x7f22540039c0 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f225400b9d0 con 0x7f226815c2a0 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f22540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 -- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 msgr2=0x7f2254004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e133640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22540039c0 0x7f2254003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226d932640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 0x7f2254004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226815c2a0 0x7f2254004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 -- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22540039c0 msgr2=0x7f2254003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22540039c0 0x7f2254003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 -- 172.21.15.94:0/2793644040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2254003530 con 0x7f2254004d50 2024-09-11T23:19:40.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.205+0000 7f226e934640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f22540051d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2260009fc0 tx=0x7f226001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250024b944d5f1ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600b2070 con 0x7f2254004d50 2024-09-11T23:19:40.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22600a5cd0 con 0x7f2254004d50 2024-09-11T23:19:40.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226d131640 1 -- 172.21.15.94:0/2793644040 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260009c10 con 0x7f2254004d50 2024-09-11T23:19:40.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- 172.21.15.94:0/2793644040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 msgr2=0x7f22540051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 --2- 172.21.15.94:0/2793644040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f22540051d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2260009fc0 tx=0x7f226001ccc0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e934640 1 -- 172.21.15.94:0/2793644040 reap_dead start 2024-09-11T23:19:40.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- 172.21.15.94:0/2793644040 shutdown_connections 2024-09-11T23:19:40.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- 172.21.15.94:0/2793644040 >> 172.21.15.94:0/2793644040 conn(0x7f22680b1f90 msgr2=0x7f22680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- 172.21.15.94:0/2793644040 shutdown_connections 2024-09-11T23:19:40.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- 172.21.15.94:0/2793644040 wait complete. 2024-09-11T23:19:40.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 Processor -- start 2024-09-11T23:19:40.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- start start 2024-09-11T23:19:40.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f2268156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2268099bf0 0x7f22681e5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22681e57a0 0x7f2268156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f22680af730 con 0x7f2254004d50 2024-09-11T23:19:40.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22680b40f0 con 0x7f22681e57a0 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f22680afc90 con 0x7f2268099bf0 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f2268156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f2268156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42728/0 (socket says 172.21.15.94:42728) 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 -- 172.21.15.94:0/2525653794 learned_addr learned my addr 172.21.15.94:0/2525653794 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 -- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2268099bf0 msgr2=0x7f22681e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226d932640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2268099bf0 0x7f22681e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e934640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22681e57a0 0x7f2268156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2268099bf0 0x7f22681e5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 -- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22681e57a0 msgr2=0x7f2268156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22681e57a0 0x7f2268156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 -- 172.21.15.94:0/2525653794 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226815b620 con 0x7f2254004d50 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f226e133640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f2268156060 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2264000f70 tx=0x7f226400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f225affd640 1 -- 172.21.15.94:0/2525653794 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264019070 con 0x7f2254004d50 2024-09-11T23:19:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f225affd640 1 -- 172.21.15.94:0/2525653794 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22640074e0 con 0x7f2254004d50 2024-09-11T23:19:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f225affd640 1 -- 172.21.15.94:0/2525653794 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640049f0 con 0x7f2254004d50 2024-09-11T23:19:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2268154fc0 con 0x7f2254004d50 2024-09-11T23:19:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.209+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2268155580 con 0x7f2254004d50 2024-09-11T23:19:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f225affd640 1 -- 172.21.15.94:0/2525653794 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f226401c070 con 0x7f2254004d50 2024-09-11T23:19:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f225affd640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f224c0678f0 0x7f224c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f225affd640 1 -- 172.21.15.94:0/2525653794 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f22640858f0 con 0x7f2254004d50 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226d932640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f224c0678f0 0x7f224c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 Processor -- start 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 -- start start 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226d932640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f224c0678f0 0x7f224c069db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f22681544a0 tx=0x7f225c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 0x56092a7ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ec440 0x56092a7a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7a2290 0x56092a7a2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56092a689b60 con 0x56092a7a2290 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56092a5f0c70 con 0x56092a7ec440 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56092a596ed0 con 0x56092a7ebb20 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7a2290 0x56092a7a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7a2290 0x56092a7a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42732/0 (socket says 172.21.15.94:42732) 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 -- 172.21.15.94:0/101115116 learned_addr learned my addr 172.21.15.94:0/101115116 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226d932640 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ec440 0x56092a7a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 -- 172.21.15.94:0/101115116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 msgr2=0x56092a7ebf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 0x56092a7ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 -- 172.21.15.94:0/101115116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ec440 msgr2=0x56092a7a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ec440 0x56092a7a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 -- 172.21.15.94:0/101115116 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56092a5a8e50 con 0x56092a7a2290 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f226e934640 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7a2290 0x56092a7a2670 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f226001d560 tx=0x7f226001b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ef485933332d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.213+0000 7f224bfff640 1 -- 172.21.15.94:0/101115116 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600b2040 con 0x56092a7a2290 2024-09-11T23:19:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f224bfff640 1 -- 172.21.15.94:0/101115116 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2260009cd0 con 0x56092a7a2290 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f224bfff640 1 -- 172.21.15.94:0/101115116 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600a5cd0 con 0x56092a7a2290 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/101115116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7a2290 msgr2=0x56092a7a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7a2290 0x56092a7a2670 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f226001d560 tx=0x7f226001b500 comp rx=0 tx=0).stop 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/101115116 shutdown_connections 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7a2290 0x56092a7a2670 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ec440 0x56092a7a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- 172.21.15.94:0/101115116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 0x56092a7ebf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/101115116 >> 172.21.15.94:0/101115116 conn(0x56092a7a8600 msgr2=0x56092a7a0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/101115116 shutdown_connections 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/101115116 wait complete. 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- start start 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 Processor -- start 2024-09-11T23:19:40.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 0x56092a7ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56092a652b00 con 0x56092a7ec440 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56092a5cb360 con 0x56092a7ebb20 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56092a5c82d0 con 0x56092a7a7390 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 10 client.0 _ll_register_callbacks cb 0x56092a78d820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42742/0 (socket says 172.21.15.94:42742) 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 -- 172.21.15.94:0/2203192708 learned_addr learned my addr 172.21.15.94:0/2203192708 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226e934640 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 0x56092a7ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226e133640 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 -- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 msgr2=0x56092a7ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 0x56092a7ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 -- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 msgr2=0x56092a7a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7a6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 -- 172.21.15.94:0/2203192708 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56092a597120 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226d932640 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7accf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f225c015490 tx=0x7f225c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da52bd6172d7131e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f22497fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f22497fa640 1 -- 172.21.15.94:0/2203192708 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c025070 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56092a58ac00 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f22497fa640 1 -- 172.21.15.94:0/2203192708 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f225c021620 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f22497fa640 1 -- 172.21.15.94:0/2203192708 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f225c030050 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 10 client.6822 fetch_fsmap learned FSMap version 55 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x56092a590450 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f22497fa640 1 -- 172.21.15.94:0/2203192708 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56092a58ac00 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f22497fa640 1 -- 172.21.15.94:0/2203192708 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f225c033020 con 0x56092a7ec440 2024-09-11T23:19:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 10 client.6822 fetch_fsmap finished waiting for FSMap version 55 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 10 client.6822 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 20 client.6822 populate_metadata read hostname 'smithi094' 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a7fa280 0x56092a7fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 4 client.6822 mds_command: new command op to 6690 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 --> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56092a5fe3a0 con 0x56092a7fa280 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226e133640 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a7fa280 0x56092a7fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f22497fa640 10 client.6822 ms_handle_connect on v2:172.21.15.94:6834/3585698004 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.217+0000 7f226e133640 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a7fa280 0x56092a7fc670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de07d38e2f8ad5d server_cookie=f5a1cde8cd278e72 in_seq=0 out_seq=0 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f22497fa640 1 -- 172.21.15.94:0/2203192708 <== mds.0 v2:172.21.15.94:6834/3585698004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56092a5fe3a0 con 0x56092a7fa280 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f22497fa640 10 client.6822 handle_command_reply: tid=0 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 client.6822 shutdown 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 msgr2=0x56092a7accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7accf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f225c015490 tx=0x7f225c004740 comp rx=0 tx=0).stop 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 shutdown_connections 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a7fa280 0x56092a7fc670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 0x56092a7ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7accf0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f22497fa640 0 client.6822 ms_handle_reset on v2:172.21.15.94:6834/3585698004 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 --2- 172.21.15.94:0/2203192708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 >> 172.21.15.94:0/2203192708 conn(0x56092a7a2290 msgr2=0x56092a7a0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 shutdown_connections 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 1 -- 172.21.15.94:0/2203192708 wait complete. 2024-09-11T23:19:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.221+0000 7f2273453000 20 client.6822 trim_cache size 0 max 16384 2024-09-11T23:19:40.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.237+0000 7f2273453000 1 Processor -- start 2024-09-11T23:19:40.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.237+0000 7f2273453000 1 -- start start 2024-09-11T23:19:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 0x56092a7eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7eb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f22681fe250 con 0x56092a7ec440 2024-09-11T23:19:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22681fd5b0 con 0x56092a7ebb20 2024-09-11T23:19:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f22681fdc00 con 0x56092a7a7390 2024-09-11T23:19:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7fc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42752/0 (socket says 172.21.15.94:42752) 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/923492140 learned_addr learned my addr 172.21.15.94:0/923492140 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/923492140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 msgr2=0x56092a7eacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 0x56092a7eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/923492140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 msgr2=0x56092a7eb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226d932640 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7eb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7eb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/923492140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56092a7f78e0 con 0x56092a7ec440 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7fc670 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f226001c730 tx=0x7f2260004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ceeff8fca02f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f224b7fe640 1 -- 172.21.15.94:0/923492140 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600ba040 con 0x56092a7ec440 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f224b7fe640 1 -- 172.21.15.94:0/923492140 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22600039a0 con 0x56092a7ec440 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f224b7fe640 1 -- 172.21.15.94:0/923492140 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600b2040 con 0x56092a7ec440 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- 172.21.15.94:0/923492140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 msgr2=0x56092a7fc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7fc670 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f226001c730 tx=0x7f2260004a50 comp rx=0 tx=0).stop 2024-09-11T23:19:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- 172.21.15.94:0/923492140 shutdown_connections 2024-09-11T23:19:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a7fc670 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7ebb20 0x56092a7eb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- 172.21.15.94:0/923492140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7a7390 0x56092a7eacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- 172.21.15.94:0/923492140 >> 172.21.15.94:0/923492140 conn(0x56092a7a2290 msgr2=0x56092a7a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- 172.21.15.94:0/923492140 shutdown_connections 2024-09-11T23:19:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- 172.21.15.94:0/923492140 wait complete. 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- start start 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 Processor -- start 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7a7390 0x56092a7ff590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 0x56092a81a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a81aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x56092a5eff80 con 0x56092a7ec440 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56092a5a8ca0 con 0x56092a7a7390 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56092a5f52a0 con 0x56092a7ebb20 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 10 client.0 _ll_register_callbacks cb 0x7f225c011d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a81aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a81aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42766/0 (socket says 172.21.15.94:42766) 2024-09-11T23:19:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/2435499309 learned_addr learned my addr 172.21.15.94:0/2435499309 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e133640 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7a7390 0x56092a7ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226d932640 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 0x56092a81a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 msgr2=0x56092a81a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 0x56092a81a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7a7390 msgr2=0x56092a7ff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7a7390 0x56092a7ff590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 -- 172.21.15.94:0/2435499309 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56092a7ec270 con 0x56092a7ec440 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f226e934640 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a81aea0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f226001caf0 tx=0x7f2254005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f8da37af9b2e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f22497fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f22497fa640 1 -- 172.21.15.94:0/2435499309 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600ba070 con 0x56092a7ec440 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f22497fa640 1 -- 172.21.15.94:0/2435499309 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f22600c8c50 con 0x56092a7ec440 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.241+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22600039a0 con 0x56092a7ec440 2024-09-11T23:19:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f22497fa640 1 -- 172.21.15.94:0/2435499309 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f22600c8e50 con 0x56092a7ec440 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 10 client.6828 fetch_fsmap learned FSMap version 55 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x56092a577fd0 con 0x56092a7ec440 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f22497fa640 1 -- 172.21.15.94:0/2435499309 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22600039a0 con 0x56092a7ec440 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f22497fa640 1 -- 172.21.15.94:0/2435499309 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f22600a5ce0 con 0x56092a7ec440 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 10 client.6828 fetch_fsmap finished waiting for FSMap version 55 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 10 client.6828 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 20 client.6828 populate_metadata read hostname 'smithi094' 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a81b3e0 0x56092a85ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 4 client.6828 mds_command: new command op to 6690 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 --> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] -- command(tid 0: {"prefix": "status"}) -- 0x56092a5f86f0 con 0x56092a81b3e0 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f226e133640 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a81b3e0 0x56092a85ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f22497fa640 10 client.6828 ms_handle_connect on v2:172.21.15.94:6834/3585698004 2024-09-11T23:19:40.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f226e133640 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a81b3e0 0x56092a85ee10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ae9d80a5127eaec server_cookie=4b9b20a2bc8bea9f in_seq=0 out_seq=0 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f22497fa640 1 -- 172.21.15.94:0/2435499309 <== mds.0 v2:172.21.15.94:6834/3585698004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56092a5f86f0 con 0x56092a81b3e0 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f22497fa640 10 client.6828 handle_command_reply: tid=0 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 client.6828 shutdown 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 msgr2=0x56092a81aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a81aea0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f226001caf0 tx=0x7f2254005840 comp rx=0 tx=0).stop 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 shutdown_connections 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56092a7ec440 0x56092a81aea0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.94:6834/3585698004,v1:172.21.15.94:6835/3585698004] conn(0x56092a81b3e0 0x56092a85ee10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56092a7ebb20 0x56092a81a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 --2- 172.21.15.94:0/2435499309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56092a7a7390 0x56092a7ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 >> 172.21.15.94:0/2435499309 conn(0x56092a7a2290 msgr2=0x56092a7e9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f22497fa640 0 client.6828 ms_handle_reset on v2:172.21.15.94:6834/3585698004 2024-09-11T23:19:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 shutdown_connections 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 1 -- 172.21.15.94:0/2435499309 wait complete. 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2273453000 20 client.6828 trim_cache size 0 max 16384 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6690, 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:19:40.251 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 4.7025724049999997, 2024-09-11T23:19:40.252 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 55, 2024-09-11T23:19:40.252 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 98, 2024-09-11T23:19:40.252 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 98, 2024-09-11T23:19:40.252 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 9.0773634370000007 2024-09-11T23:19:40.252 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f224c0678f0 msgr2=0x7f224c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f224c0678f0 0x7f224c069db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f22681544a0 tx=0x7f225c008040 comp rx=0 tx=0).stop 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 msgr2=0x7f2268156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f2268156060 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2264000f70 tx=0x7f226400dd40 comp rx=0 tx=0).stop 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 shutdown_connections 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22681e57a0 0x7f2268156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2268099bf0 0x7f22681e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f224c0678f0 0x7f224c069db0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 --2- 172.21.15.94:0/2525653794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2254004d50 0x7f2268156060 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 >> 172.21.15.94:0/2525653794 conn(0x7f22680b1f90 msgr2=0x7f226815a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 shutdown_connections 2024-09-11T23:19:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.245+0000 7f2270397640 1 -- 172.21.15.94:0/2525653794 wait complete. 2024-09-11T23:19:40.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:19:40.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.373+0000 7f39c10c3640 1 Processor -- start 2024-09-11T23:19:40.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.373+0000 7f39c10c3640 1 -- start start 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39c10c3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 0x7f39bc166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39c10c3640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39bc0b3290 con 0x7f39bc15bec0 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39c10c3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39bc0b3570 con 0x7f39bc15c2a0 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39c10c3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc0b3850 con 0x7f39bc06f010 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bad9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f39bc15bec0 0x7f39bc0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56734/0 (socket says 172.21.15.94:56734) 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bad9d640 1 -- 172.21.15.94:0/1823507765 learned_addr learned my addr 172.21.15.94:0/1823507765 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bb59e640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 0x7f39bc166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682572356 0 0) 0x7f39bc0b3290 con 0x7f39bc15bec0 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39a4003530 con 0x7f39bc15bec0 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 346183759 0 0) 0x7f39a4003530 con 0x7f39bc15bec0 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 msgr2=0x7f39bc166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 0x7f39bc166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 >> v1:172.21.15.155:6789/0 conn(0x7f39bc15c2a0 legacy=0x7f39bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc0b3b30 con 0x7f39bc15bec0 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f39ac001680 con 0x7f39bc15bec0 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 >> v1:172.21.15.94:6789/0 conn(0x7f39bc15bec0 legacy=0x7f39bc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 0x7f39a40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39a4003f70 0x7f39a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39a4004d50 0x7f39a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0b3850 con 0x7f39a4004d50 2024-09-11T23:19:40.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f39a400bab0 con 0x7f39a4003f70 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39a400bcb0 con 0x7f39bc06f010 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bb59e640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39a4004d50 0x7f39a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bad9d640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 0x7f39a40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39ba59c640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39a4003f70 0x7f39a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bb59e640 1 -- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 msgr2=0x7f39a40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bb59e640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 0x7f39a40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bb59e640 1 -- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39a4003f70 msgr2=0x7f39a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bb59e640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39a4003f70 0x7f39a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bb59e640 1 -- 172.21.15.94:0/1823507765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4003530 con 0x7f39a4004d50 2024-09-11T23:19:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.377+0000 7f39bad9d640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc06f010 0x7f39a40039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:40.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bb59e640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39a4004d50 0x7f39a40051d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009f90 tx=0x7f39b401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4204ed281ac94fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b40b2070 con 0x7f39a4004d50 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b40a5c50 con 0x7f39a4004d50 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39b9d9b640 1 -- 172.21.15.94:0/1823507765 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4009c10 con 0x7f39a4004d50 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- 172.21.15.94:0/1823507765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39a4004d50 msgr2=0x7f39a40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 --2- 172.21.15.94:0/1823507765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39a4004d50 0x7f39a40051d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009f90 tx=0x7f39b401cc40 comp rx=0 tx=0).stop 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bb59e640 1 -- 172.21.15.94:0/1823507765 reap_dead start 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- 172.21.15.94:0/1823507765 shutdown_connections 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- 172.21.15.94:0/1823507765 >> 172.21.15.94:0/1823507765 conn(0x7f39bc0b1f90 msgr2=0x7f39bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- 172.21.15.94:0/1823507765 shutdown_connections 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- 172.21.15.94:0/1823507765 wait complete. 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 Processor -- start 2024-09-11T23:19:40.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- start start 2024-09-11T23:19:40.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39bc1f50f0 0x7f39bc15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc150610 0x7f39bc15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c6e0 0x7f39bc153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0afc90 con 0x7f39bc1f50f0 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0b40f0 con 0x7f39bc150610 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc0af470 con 0x7f39bc15c6e0 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39bc1f50f0 0x7f39bc15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39bc1f50f0 0x7f39bc15e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42790/0 (socket says 172.21.15.94:42790) 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 -- 172.21.15.94:0/3740737666 learned_addr learned my addr 172.21.15.94:0/3740737666 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39ba59c640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc150610 0x7f39bc15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bb59e640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c6e0 0x7f39bc153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 -- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c6e0 msgr2=0x7f39bc153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c6e0 0x7f39bc153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 -- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc150610 msgr2=0x7f39bc15ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc150610 0x7f39bc15ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 -- 172.21.15.94:0/3740737666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc15cbe0 con 0x7f39bc1f50f0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39bad9d640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39bc1f50f0 0x7f39bc15e900 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00db10 tx=0x7f39ac007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39a37fe640 1 -- 172.21.15.94:0/3740737666 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac019070 con 0x7f39bc1f50f0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39a37fe640 1 -- 172.21.15.94:0/3740737666 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac004cc0 con 0x7f39bc1f50f0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39bc15cec0 con 0x7f39bc1f50f0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39a37fe640 1 -- 172.21.15.94:0/3740737666 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00b9a0 con 0x7f39bc1f50f0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.381+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39bc15d480 con 0x7f39bc1f50f0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.385+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39bc0aed60 con 0x7f39bc1f50f0 2024-09-11T23:19:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.385+0000 7f39a37fe640 1 -- 172.21.15.94:0/3740737666 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f39ac01c070 con 0x7f39bc1f50f0 2024-09-11T23:19:40.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.385+0000 7f39a37fe640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f39a80678c0 0x7f39a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:40.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.385+0000 7f39a37fe640 1 -- 172.21.15.94:0/3740737666 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f39ac085af0 con 0x7f39bc1f50f0 2024-09-11T23:19:40.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.385+0000 7f39ba59c640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f39a80678c0 0x7f39a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:40.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.385+0000 7f39ba59c640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f39a80678c0 0x7f39a8069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f39bc1557a0 tx=0x7f39b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:40.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.389+0000 7f39a37fe640 1 -- 172.21.15.94:0/3740737666 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f39ac056560 con 0x7f39bc1f50f0 2024-09-11T23:19:40.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.569+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39bc06fcd0 con 0x7f39bc1f50f0 2024-09-11T23:19:40.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39a37fe640 1 -- 172.21.15.94:0/3740737666 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) ==== 53+0+73 (secure 0 0 0) 0x7f39ac055e60 con 0x7f39bc1f50f0 2024-09-11T23:19:40.573 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:19:40.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f39a80678c0 msgr2=0x7f39a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f39a80678c0 0x7f39a8069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f39bc1557a0 tx=0x7f39b0009040 comp rx=0 tx=0).stop 2024-09-11T23:19:40.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39bc1f50f0 msgr2=0x7f39bc15e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39bc1f50f0 0x7f39bc15e900 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00db10 tx=0x7f39ac007ea0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 shutdown_connections 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c6e0 0x7f39bc153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc150610 0x7f39bc15ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f39a80678c0 0x7f39a8069d80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 --2- 172.21.15.94:0/3740737666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39bc1f50f0 0x7f39bc15e900 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 >> 172.21.15.94:0/3740737666 conn(0x7f39bc0b1f90 msgr2=0x7f39bc15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 shutdown_connections 2024-09-11T23:19:40.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40.573+0000 7f39c10c3640 1 -- 172.21.15.94:0/3740737666 wait complete. 2024-09-11T23:19:40.590 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:19:40.590 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:19:40.590 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:19:40.591 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:19:40.591 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:40.591 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:19:40.591 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:19:40.591 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:19:40.591 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:40.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:40.591 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:19:40.597 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:19:40.597 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:19:40.597 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:19:40.598 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42208sec preferred_lft 42208sec 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.599 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:40.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:40.601 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:19:40.650 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:19:40.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:40.652 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:19:40.705 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:19:40.705 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:19:40.705 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:19:40.705 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:19:40.705 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:19:40.705 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:19:40.706 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:19:40.706 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:19:40.706 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:19:40.706 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:19:40.706 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:19:40.707 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:19:40.707 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:19:40.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:19:40.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:19:40.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:19:40.708 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:19:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:19:40.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:40.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:40.829 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:19:40.877 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:19:40.877 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:19:40.877 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:40.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:40.877 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:19:40.932 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:19:40.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:40.933 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:40.980 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:40.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:40.981 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:41.028 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:19:41.090 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:19:41.137 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:19:41.137 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:19:41.137 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:19:41.138 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:19:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:41.140 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:41.140 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:41.140 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:41.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:41.141 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:19:41.193 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:19:41.193 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:19:41.238 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:19:41.252 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:19:41.301 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:19:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:19:41.303 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:41.304 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:41.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:41.305 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:19:41.308 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:19:41.309+0000 7f8dd48f2580 -1 init, newargv = 0x55d03e5f3530 newargc=15 2024-09-11T23:19:41.308 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[45061]: starting ceph client 2024-09-11T23:19:41.313 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[45061]: starting fuse 2024-09-11T23:19:41.512 INFO:tasks.ceph.mds.a.smithi094.stderr:2024-09-11T23:19:41.513+0000 7fd7bb47c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:19:42.413 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:19:42.429 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:19:42.478 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:19:42.479 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:42.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:42.481 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:19:42.529 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:19:42.529 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:42.530 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:19:42.531 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:19:42.651 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.45061.asok 2024-09-11T23:19:42.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:42.662 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45061.asok 2024-09-11T23:19:42.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:42.663 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45061.asok status 2024-09-11T23:19:42.823 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:42.823 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:19:42.823 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:19:42.823 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:19:42.823 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:19:42.823 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:19:42.823 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "45061", 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6840, 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 6840 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:42.824 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2109962511 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2109962511 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.6840 192.168.0.1:0/2109962511", 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/2109962511", 2024-09-11T23:19:42.825 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:19:42.826 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 55, 2024-09-11T23:19:42.826 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 98, 2024-09-11T23:19:42.826 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:19:42.826 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:19:42.826 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:19:42.826 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:42.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:42.836 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:19:42.837 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:42.842 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:19:42.842 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:42.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:42.843 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:42.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:19:42.941 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-11T23:19:42.967 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-11T23:19:42.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.969 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-11T23:19:42.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-11T23:19:42.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.972 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-11T23:19:42.973 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:19:42.974 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-11T23:19:42.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.976 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:19:42.977 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:19:42.978 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:19:42.979 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_files = 6 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.980 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.981 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-11T23:19:42.982 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-11T23:19:42.983 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-11T23:19:42.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:19:42.985 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:19:42.986 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-11T23:19:42.987 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.988 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-11T23:19:42.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:19:42.990 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-11T23:19:42.991 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-11T23:19:42.992 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:19:42.992 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:19:42.992 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:19:42.992 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2024-09-11T23:19:42.995 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:19:43.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.065 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:19:43.066 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.067 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.068 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-11T23:19:43.069 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.070 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-11T23:19:43.071 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.072 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.073 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-11T23:19:43.074 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:19:43.075 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-11T23:19:43.076 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2024-09-11T23:19:43.077 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 100000000 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-11T23:19:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-11T23:19:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-11T23:19:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:19:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-11T23:19:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-11T23:19:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-11T23:19:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:19:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:19:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:19:43.089 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_files = 6 2024-09-11T23:19:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_ops = 100000000 2024-09-11T23:19:43.091 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T23:19:43.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7edd863640 1 Processor -- start 2024-09-11T23:19:43.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7edd863640 1 -- start start 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7edd863640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ed80d0a50 0x7f7ed806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7edd863640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed80af650 con 0x7f7ed815bfe0 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7edd863640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed80af930 con 0x7f7ed806f5a0 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7edd863640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed806ece0 con 0x7f7ed80d0a50 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7ed815bfe0 0x7f7ed80aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56740/0 (socket says 172.21.15.94:56740) 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 -- 172.21.15.94:0/3960665814 learned_addr learned my addr 172.21.15.94:0/3960665814 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed77fe640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ed80d0a50 0x7f7ed806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148904688 0 0) 0x7f7ed80af650 con 0x7f7ed815bfe0 2024-09-11T23:19:43.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ec4003530 con 0x7f7ed815bfe0 2024-09-11T23:19:43.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2723230569 0 0) 0x7f7ec4003530 con 0x7f7ed815bfe0 2024-09-11T23:19:43.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ed80d0a50 msgr2=0x7f7ed806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ed80d0a50 0x7f7ed806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 >> v1:172.21.15.155:6789/0 conn(0x7f7ed806f5a0 legacy=0x7f7ed80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed806dfa0 con 0x7f7ed815bfe0 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7ec0001680 con 0x7f7ed815bfe0 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 >> v1:172.21.15.94:6789/0 conn(0x7f7ed815bfe0 legacy=0x7f7ed80aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec40039f0 0x7f7ec4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ed80d0a50 0x7f7ec4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ec4004d50 0x7f7ec40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed806ece0 con 0x7f7ec40039f0 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec400bb30 con 0x7f7ec4004d50 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec400bd30 con 0x7f7ed80d0a50 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec40039f0 0x7f7ec4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed77fe640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ec4004d50 0x7f7ec40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 -- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ed80d0a50 msgr2=0x7f7ec4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ed80d0a50 0x7f7ec4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 -- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ec4004d50 msgr2=0x7f7ec40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ec4004d50 0x7f7ec40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.248+0000 7f7ed6ffd640 1 -- 172.21.15.94:0/3960665814 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec4003530 con 0x7f7ec40039f0 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7ed6ffd640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec40039f0 0x7f7ec4003e10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c1c0 tx=0x7f7ec001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f650677e583774dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0007d00 con 0x7f7ec40039f0 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec00a9020 con 0x7f7ec40039f0 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7ed67fc640 1 -- 172.21.15.94:0/3960665814 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0005ae0 con 0x7f7ec40039f0 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- 172.21.15.94:0/3960665814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec40039f0 msgr2=0x7f7ec4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 --2- 172.21.15.94:0/3960665814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec40039f0 0x7f7ec4003e10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c1c0 tx=0x7f7ec001cba0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7ed77fe640 1 -- 172.21.15.94:0/3960665814 reap_dead start 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- 172.21.15.94:0/3960665814 shutdown_connections 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- 172.21.15.94:0/3960665814 >> 172.21.15.94:0/3960665814 conn(0x7f7ed80b2140 msgr2=0x7f7ed80b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- 172.21.15.94:0/3960665814 shutdown_connections 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- 172.21.15.94:0/3960665814 wait complete. 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 Processor -- start 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- start start 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ec40039f0 0x7f7ed8155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ed815d0e0 0x7f7ed814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ed8159f60 0x7f7ed815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8072990 con 0x7f7ed8159f60 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8072810 con 0x7f7ed815d0e0 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7edd863640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed806dd50 con 0x7f7ec40039f0 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.252+0000 7f7ed77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ed8159f60 0x7f7ed815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ed8159f60 0x7f7ed815a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42802/0 (socket says 172.21.15.94:42802) 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 -- 172.21.15.94:0/2636052458 learned_addr learned my addr 172.21.15.94:0/2636052458 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed6ffd640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ec40039f0 0x7f7ed8155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ecffff640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ed815d0e0 0x7f7ed814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 -- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ec40039f0 msgr2=0x7f7ed8155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ec40039f0 0x7f7ed8155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 -- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ed815d0e0 msgr2=0x7f7ed814fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ed815d0e0 0x7f7ed814fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 -- 172.21.15.94:0/2636052458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed8157370 con 0x7f7ed8159f60 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed77fe640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ed8159f60 0x7f7ed815a3c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009ed0 tx=0x7f7ed00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed4ff9640 1 -- 172.21.15.94:0/2636052458 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011e40 con 0x7f7ed8159f60 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed4ff9640 1 -- 172.21.15.94:0/2636052458 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed001b070 con 0x7f7ed8159f60 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed8157650 con 0x7f7ed8159f60 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed4ff9640 1 -- 172.21.15.94:0/2636052458 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00039a0 con 0x7f7ed8159f60 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed8152640 con 0x7f7ed8159f60 2024-09-11T23:19:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed80d0340 con 0x7f7ed8159f60 2024-09-11T23:19:43.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed4ff9640 1 -- 172.21.15.94:0/2636052458 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ed0003b40 con 0x7f7ed8159f60 2024-09-11T23:19:43.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed4ff9640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7eb80678f0 0x7f7eb8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed4ff9640 1 -- 172.21.15.94:0/2636052458 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f7ed0087160 con 0x7f7ed8159f60 2024-09-11T23:19:43.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.256+0000 7f7ed6ffd640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7eb80678f0 0x7f7eb8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.260+0000 7f7ed6ffd640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7eb80678f0 0x7f7eb8069db0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00aa000 tx=0x7f7ec00b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.260+0000 7f7ed4ff9640 1 -- 172.21.15.94:0/2636052458 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ed0025020 con 0x7f7ed8159f60 2024-09-11T23:19:43.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7ed815b8b0 con 0x7f7ed8159f60 2024-09-11T23:19:43.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7ed4ff9640 1 -- 172.21.15.94:0/2636052458 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) ==== 100+0+11 (secure 0 0 0) 0x7f7ed0057630 con 0x7f7ed8159f60 2024-09-11T23:19:43.429 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-09-11T23:19:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7eb80678f0 msgr2=0x7f7eb8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7eb80678f0 0x7f7eb8069db0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00aa000 tx=0x7f7ec00b1040 comp rx=0 tx=0).stop 2024-09-11T23:19:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ed8159f60 msgr2=0x7f7ed815a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ed8159f60 0x7f7ed815a3c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009ed0 tx=0x7f7ed00115a0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 shutdown_connections 2024-09-11T23:19:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7eb80678f0 0x7f7eb8069db0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ed8159f60 0x7f7ed815a3c0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ed815d0e0 0x7f7ed814fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 --2- 172.21.15.94:0/2636052458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ec40039f0 0x7f7ed8155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 >> 172.21.15.94:0/2636052458 conn(0x7f7ed80b2140 msgr2=0x7f7ed80ad020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 shutdown_connections 2024-09-11T23:19:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.428+0000 7f7edd863640 1 -- 172.21.15.94:0/2636052458 wait complete. 2024-09-11T23:19:43.449 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:19:43.451 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-11T23:19:43.474 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.475 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-11T23:19:43.476 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:19:43.477 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.478 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.479 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:19:43.480 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.482 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:19:43.483 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:19:43.484 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_files = 6 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_ops = 100000000 2024-09-11T23:19:43.485 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.486 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:19:43.487 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-11T23:19:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.489 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-11T23:19:43.490 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-11T23:19:43.491 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-11T23:19:43.492 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.493 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.494 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-11T23:19:43.495 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.496 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-11T23:19:43.497 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-11T23:19:43.498 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:19:43.498 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:19:43.498 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:19:43.498 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2024-09-11T23:19:43.498 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 100000000 2024-09-11T23:19:43.498 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-11T23:19:43.500 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:19:43.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:43.500 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:19:43.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:43.500 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:19:43.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:43.501 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:19:43.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:43.553 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:19:43.554 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-11T23:19:43.555 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:19:43.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-11T23:19:43.559 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:19:43.559 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-11T23:19:43.560 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:19:43.561 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-11T23:19:43.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864fdb9640 1 Processor -- start 2024-09-11T23:19:43.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864fdb9640 1 -- start start 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864fdb9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 0x7f86480d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864fdb9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864815ec10 con 0x7f86480d0ac0 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864fdb9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864815e980 con 0x7f8648161c70 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864fdb9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f864815ee80 con 0x7f8648075740 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864e356640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f86480d0ac0 0x7f864815fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56756/0 (socket says 172.21.15.94:56756) 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864e356640 1 -- 172.21.15.94:0/1101781254 learned_addr learned my addr 172.21.15.94:0/1101781254 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.672+0000 7f864d354640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 0x7f86480d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296510749 0 0) 0x7f864815ec10 con 0x7f86480d0ac0 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8634003530 con 0x7f86480d0ac0 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2807499088 0 0) 0x7f8634003530 con 0x7f86480d0ac0 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 msgr2=0x7f86480d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 0x7f86480d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 >> v1:172.21.15.155:6789/0 conn(0x7f8648161c70 legacy=0x7f8648075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864815f160 con 0x7f86480d0ac0 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f8640001a00 con 0x7f86480d0ac0 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 >> v1:172.21.15.94:6789/0 conn(0x7f86480d0ac0 legacy=0x7f864815fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86340039f0 0x7f8634003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 0x7f8634004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f86340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f864815ee80 con 0x7f8634004d50 2024-09-11T23:19:43.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f863400ba80 con 0x7f86340039f0 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f863400bc80 con 0x7f8648075740 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864e356640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f86340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864d354640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 0x7f8634004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864db55640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86340039f0 0x7f8634003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864e356640 1 -- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 msgr2=0x7f8634004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864e356640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648075740 0x7f8634004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864e356640 1 -- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86340039f0 msgr2=0x7f8634003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864e356640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86340039f0 0x7f8634003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864e356640 1 -- 172.21.15.94:0/1101781254 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8634003530 con 0x7f8634004d50 2024-09-11T23:19:43.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864db55640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86340039f0 0x7f8634003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:43.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864e356640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f86340051d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8640002240 tx=0x7f864001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45454848fa058dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864000a4a0 con 0x7f8634004d50 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86400ad650 con 0x7f8634004d50 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.676+0000 7f864cb53640 1 -- 172.21.15.94:0/1101781254 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400ada40 con 0x7f8634004d50 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 -- 172.21.15.94:0/1101781254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 msgr2=0x7f86340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 --2- 172.21.15.94:0/1101781254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f86340051d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8640002240 tx=0x7f864001d360 comp rx=0 tx=0).stop 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864e356640 1 -- 172.21.15.94:0/1101781254 reap_dead start 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 -- 172.21.15.94:0/1101781254 shutdown_connections 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 -- 172.21.15.94:0/1101781254 >> 172.21.15.94:0/1101781254 conn(0x7f8648067a00 msgr2=0x7f8648067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 -- 172.21.15.94:0/1101781254 shutdown_connections 2024-09-11T23:19:43.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 -- 172.21.15.94:0/1101781254 wait complete. 2024-09-11T23:19:43.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 Processor -- start 2024-09-11T23:19:43.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 -- start start 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.680+0000 7f864fdb9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f8648155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86481f3d60 0x7f86480b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86481f41e0 0x7f86480b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f86480d0f40 con 0x7f8634004d50 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f864815f720 con 0x7f86481f41e0 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f86480d10c0 con 0x7f86481f3d60 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f8648155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f8648155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42814/0 (socket says 172.21.15.94:42814) 2024-09-11T23:19:43.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 -- 172.21.15.94:0/3996605637 learned_addr learned my addr 172.21.15.94:0/3996605637 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864d354640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86481f3d60 0x7f86480b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864e356640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86481f41e0 0x7f86480b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 -- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86481f3d60 msgr2=0x7f86480b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86481f3d60 0x7f86480b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 -- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86481f41e0 msgr2=0x7f86480b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86481f41e0 0x7f86480b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 -- 172.21.15.94:0/3996605637 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8648157750 con 0x7f8634004d50 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864db55640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f8648155e80 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f864400d770 tx=0x7f864400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f863e7fc640 1 -- 172.21.15.94:0/3996605637 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644005270 con 0x7f8634004d50 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f863e7fc640 1 -- 172.21.15.94:0/3996605637 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8644017070 con 0x7f8634004d50 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f863e7fc640 1 -- 172.21.15.94:0/3996605637 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864400b6b0 con 0x7f8634004d50 2024-09-11T23:19:43.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8648157a30 con 0x7f8634004d50 2024-09-11T23:19:43.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8648157ff0 con 0x7f8634004d50 2024-09-11T23:19:43.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4ea1ad640 1 Processor -- start 2024-09-11T23:19:43.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4ea1ad640 1 -- start start 2024-09-11T23:19:43.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864815eb50 con 0x7f8634004d50 2024-09-11T23:19:43.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4ea1ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e40cf7e0 0x7fb4e415c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4e2ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb4e406fa20 0x7fb4e406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56762/0 (socket says 172.21.15.94:56762) 2024-09-11T23:19:43.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4e2ffd640 1 -- 172.21.15.94:0/574606396 learned_addr learned my addr 172.21.15.94:0/574606396 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:43.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e40cea20 con 0x7fb4e406fa20 2024-09-11T23:19:43.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e40ced00 con 0x7fb4e4158e50 2024-09-11T23:19:43.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4e3fff640 1 --2- 172.21.15.94:0/574606396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e40cf7e0 0x7fb4e415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.684+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e40cf350 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7f863e7fc640 1 -- 172.21.15.94:0/3996605637 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f864400b850 con 0x7f8634004d50 2024-09-11T23:19:43.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e27fc640 1 -- 172.21.15.94:0/574606396 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690641161 0 0) 0x7fb4e40ced00 con 0x7fb4e4158e50 2024-09-11T23:19:43.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e27fc640 1 -- 172.21.15.94:0/574606396 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4cc005740 con 0x7fb4e4158e50 2024-09-11T23:19:43.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e3fff640 1 -- 172.21.15.94:0/574606396 >> v1:172.21.15.155:6789/0 conn(0x7fb4e4158e50 legacy=0x7fb4e406f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e3fff640 1 -- 172.21.15.94:0/574606396 >> v1:172.21.15.94:6789/0 conn(0x7fb4e406fa20 legacy=0x7fb4e406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e3fff640 1 -- 172.21.15.94:0/574606396 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e40cefe0 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7f863e7fc640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7f863e7fc640 1 -- 172.21.15.94:0/3996605637 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f8644086780 con 0x7f8634004d50 2024-09-11T23:19:43.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7f864d354640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7f864d354640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f86481f72e0 tx=0x7f8638008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e3fff640 1 --2- 172.21.15.94:0/574606396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e40cf7e0 0x7fb4e415c220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009dc0 tx=0x7fb4dc01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e814995ba08d15e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e27fc640 1 -- 172.21.15.94:0/574606396 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0b2070 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e27fc640 1 -- 172.21.15.94:0/574606396 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0a5860 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7fb4e27fc640 1 -- 172.21.15.94:0/574606396 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0a5c30 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.688+0000 7f863e7fc640 1 -- 172.21.15.94:0/3996605637 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8644057210 con 0x7f8634004d50 2024-09-11T23:19:43.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.692+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e40cf7e0 msgr2=0x7fb4e415c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.692+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/574606396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e40cf7e0 0x7fb4e415c220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009dc0 tx=0x7fb4dc01c920 comp rx=0 tx=0).stop 2024-09-11T23:19:43.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 shutdown_connections 2024-09-11T23:19:43.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/574606396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e40cf7e0 0x7fb4e415c220 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 >> 172.21.15.94:0/574606396 conn(0x7fb4e40b2820 msgr2=0x7fb4e40b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 shutdown_connections 2024-09-11T23:19:43.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/574606396 wait complete. 2024-09-11T23:19:43.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 Processor -- start 2024-09-11T23:19:43.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- start start 2024-09-11T23:19:43.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e406fa20 0x7fb4e4151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e40cf7e0 0x7fb4e4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e4158e50 0x7fb4e414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e4072b90 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e4072a10 con 0x7fb4e406fa20 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e4072d10 con 0x7fb4e4158e50 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e40cf7e0 0x7fb4e4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e40cf7e0 0x7fb4e4151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42818/0 (socket says 172.21.15.94:42818) 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 -- 172.21.15.94:0/1542088444 learned_addr learned my addr 172.21.15.94:0/1542088444 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e37fe640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e406fa20 0x7fb4e4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e3fff640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e4158e50 0x7fb4e414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 -- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e4158e50 msgr2=0x7fb4e414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e4158e50 0x7fb4e414bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 -- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e406fa20 msgr2=0x7fb4e4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e406fa20 0x7fb4e4151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 -- 172.21.15.94:0/1542088444 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e415f2d0 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e37fe640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e406fa20 0x7fb4e4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:43.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4e2ffd640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e40cf7e0 0x7fb4e4151b50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8005890 tx=0x7fb4d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4cbfff640 1 -- 172.21.15.94:0/1542088444 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8017070 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4cbfff640 1 -- 172.21.15.94:0/1542088444 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d8005cf0 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e415d2d0 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4cbfff640 1 -- 172.21.15.94:0/1542088444 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80072b0 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.696+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e415d890 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.700+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e415c220 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.700+0000 7fb4cbfff640 1 -- 172.21.15.94:0/1542088444 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb4d801a070 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.700+0000 7fb4cbfff640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4d00678c0 0x7fb4d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.700+0000 7fb4cbfff640 1 -- 172.21.15.94:0/1542088444 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fb4d80850c0 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.700+0000 7fb4e37fe640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4d00678c0 0x7fb4d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.700+0000 7fb4e37fe640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4d00678c0 0x7fb4d0069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40011f0 tx=0x7fb4d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.708+0000 7fb4cbfff640 1 -- 172.21.15.94:0/1542088444 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb4d8055420 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.720+0000 7f9a404f1640 1 Processor -- start 2024-09-11T23:19:43.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.720+0000 7f9a404f1640 1 -- start start 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.720+0000 7f9a404f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3806d9c0 0x7f9a3815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.720+0000 7f9a404f1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a3815de50 0x7f9a380cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a404f1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a380ce9e0 con 0x7f9a380cff80 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a404f1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9a380cec80 con 0x7f9a3815de50 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a404f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a380cef60 con 0x7f9a3806d9c0 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3da8c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a3815de50 0x7f9a380cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3da8c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a3815de50 0x7f9a380cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42830/0 (socket says 172.21.15.94:42830) 2024-09-11T23:19:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3da8c640 1 -- 172.21.15.94:0/2813217417 learned_addr learned my addr 172.21.15.94:0/2813217417 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3e28d640 1 --2- 172.21.15.94:0/2813217417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3806d9c0 0x7f9a3815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3da8c640 1 -- 172.21.15.94:0/2813217417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3806d9c0 msgr2=0x7f9a3815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3da8c640 1 --2- 172.21.15.94:0/2813217417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3806d9c0 0x7f9a3815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3da8c640 1 -- 172.21.15.94:0/2813217417 >> v1:172.21.15.155:6789/0 conn(0x7f9a380cff80 legacy=0x7f9a3806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7f9a3da8c640 1 -- 172.21.15.94:0/2813217417 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a380cf240 con 0x7f9a3815de50 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfcaf2c640 1 Processor -- start 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfcaf2c640 1 -- start start 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfcaf2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40cfed0 0x7fdfc40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfcaf2c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc415b5a0 con 0x7fdfc40728d0 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfcaf2c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc40cf4d0 con 0x7fdfc415b1c0 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfcaf2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc406f230 con 0x7fdfc40cfed0 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc94c9640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdfc40728d0 0x7fdfc40b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56768/0 (socket says 172.21.15.94:56768) 2024-09-11T23:19:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc94c9640 1 -- 172.21.15.94:0/3809648123 learned_addr learned my addr 172.21.15.94:0/3809648123 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc3fff640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40cfed0 0x7fdfc40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199374012 0 0) 0x7fdfc415b5a0 con 0x7fdfc40728d0 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb4003530 con 0x7fdfc40728d0 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 604002740 0 0) 0x7fdfb4003530 con 0x7fdfc40728d0 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40cfed0 msgr2=0x7fdfc40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40cfed0 0x7fdfc40cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 >> v1:172.21.15.155:6789/0 conn(0x7fdfc415b1c0 legacy=0x7fdfc4072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc4071520 con 0x7fdfc40728d0 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fdfbc001a00 con 0x7fdfc40728d0 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 >> v1:172.21.15.94:6789/0 conn(0x7fdfc40728d0 legacy=0x7fdfc40b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfb40039f0 0x7fdfb4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb4004810 0x7fdfb4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40cfed0 0x7fdfb40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb400ba80 con 0x7fdfb40039f0 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb400bc00 con 0x7fdfb4004810 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb400be00 con 0x7fdfc40cfed0 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc8cc8640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfb40039f0 0x7fdfb4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc3fff640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb4004810 0x7fdfb4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc8cc8640 1 -- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40cfed0 msgr2=0x7fdfb40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc8cc8640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40cfed0 0x7fdfb40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc8cc8640 1 -- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb4004810 msgr2=0x7fdfb4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc8cc8640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb4004810 0x7fdfb4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.724+0000 7fdfc8cc8640 1 -- 172.21.15.94:0/3809648123 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb4003530 con 0x7fdfb40039f0 2024-09-11T23:19:43.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a3da8c640 1 --2- 172.21.15.94:0/2813217417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3815de50 0x7f9a380cfa40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009870 tx=0x7f9a2801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce012c7426245e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a3d28b640 1 -- 172.21.15.94:0/2813217417 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a280ab640 con 0x7f9a3815de50 2024-09-11T23:19:43.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a3d28b640 1 -- 172.21.15.94:0/2813217417 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a280b0070 con 0x7f9a3815de50 2024-09-11T23:19:43.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a3d28b640 1 -- 172.21.15.94:0/2813217417 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a280aba00 con 0x7f9a3815de50 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 -- 172.21.15.94:0/2813217417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3815de50 msgr2=0x7f9a380cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 --2- 172.21.15.94:0/2813217417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3815de50 0x7f9a380cfa40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009870 tx=0x7f9a2801c530 comp rx=0 tx=0).stop 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 -- 172.21.15.94:0/2813217417 shutdown_connections 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 --2- 172.21.15.94:0/2813217417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3815de50 0x7f9a380cfa40 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 --2- 172.21.15.94:0/2813217417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3806d9c0 0x7f9a3815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 -- 172.21.15.94:0/2813217417 >> 172.21.15.94:0/2813217417 conn(0x7f9a380b2890 msgr2=0x7f9a380b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 -- 172.21.15.94:0/2813217417 shutdown_connections 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 -- 172.21.15.94:0/2813217417 wait complete. 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 Processor -- start 2024-09-11T23:19:43.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7f9a404f1640 1 -- start start 2024-09-11T23:19:43.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfc8cc8640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfb40039f0 0x7fdfb4003e10 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8001750 tx=0x7fdfb801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fef506cd156c192 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80013a0 con 0x7fdfb40039f0 2024-09-11T23:19:43.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb80052d0 con 0x7fdfb40039f0 2024-09-11T23:19:43.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfc37fe640 1 -- 172.21.15.94:0/3809648123 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80013a0 con 0x7fdfb40039f0 2024-09-11T23:19:43.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3809648123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfb40039f0 msgr2=0x7fdfb4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfcaf2c640 1 --2- 172.21.15.94:0/3809648123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfb40039f0 0x7fdfb4003e10 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8001750 tx=0x7fdfb801c3c0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfc94c9640 1 -- 172.21.15.94:0/3809648123 reap_dead start 2024-09-11T23:19:43.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3809648123 shutdown_connections 2024-09-11T23:19:43.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3809648123 >> 172.21.15.94:0/3809648123 conn(0x7fdfc4075030 msgr2=0x7fdfc4075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3809648123 shutdown_connections 2024-09-11T23:19:43.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.728+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3809648123 wait complete. 2024-09-11T23:19:43.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a3806d9c0 0x7f9a381413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a380cff80 0x7f9a38142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3815de50 0x7f9a38158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38168f10 con 0x7f9a380cff80 2024-09-11T23:19:43.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3815d5e0 con 0x7f9a3806d9c0 2024-09-11T23:19:43.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a38169090 con 0x7f9a3815de50 2024-09-11T23:19:43.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a380cff80 0x7f9a38142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a380cff80 0x7f9a38142040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42844/0 (socket says 172.21.15.94:42844) 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 -- 172.21.15.94:0/3146719824 learned_addr learned my addr 172.21.15.94:0/3146719824 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3e28d640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a3806d9c0 0x7f9a381413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3ea8e640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3815de50 0x7f9a38158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 -- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3815de50 msgr2=0x7f9a38158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3815de50 0x7f9a38158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 -- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a3806d9c0 msgr2=0x7f9a381413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a3806d9c0 0x7f9a381413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 -- 172.21.15.94:0/3146719824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a38142ac0 con 0x7f9a380cff80 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a3da8c640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a380cff80 0x7f9a38142040 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ad040 tx=0x7f9a280192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a2effd640 1 -- 172.21.15.94:0/3146719824 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a280bf410 con 0x7f9a380cff80 2024-09-11T23:19:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a2effd640 1 -- 172.21.15.94:0/3146719824 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a280bf5d0 con 0x7f9a380cff80 2024-09-11T23:19:43.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a2effd640 1 -- 172.21.15.94:0/3146719824 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a280bf9c0 con 0x7f9a380cff80 2024-09-11T23:19:43.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a38142da0 con 0x7f9a380cff80 2024-09-11T23:19:43.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a38143360 con 0x7f9a380cff80 2024-09-11T23:19:43.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 Processor -- start 2024-09-11T23:19:43.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 -- start start 2024-09-11T23:19:43.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3815d910 con 0x7f9a380cff80 2024-09-11T23:19:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40039f0 0x7fdfc4159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc40b2b30 0x7fdfc4160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfc40b2fb0 0x7fdfc4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4073090 con 0x7fdfc40b2fb0 2024-09-11T23:19:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4072f10 con 0x7fdfc40b2b30 2024-09-11T23:19:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfcaf2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc4073210 con 0x7fdfb40039f0 2024-09-11T23:19:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40039f0 0x7fdfc4159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc94c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfc40b2fb0 0x7fdfc4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc40b2b30 0x7fdfc4160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc94c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfc40b2fb0 0x7fdfc4160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42860/0 (socket says 172.21.15.94:42860) 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40039f0 0x7fdfc4159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:32878/0 (socket says 172.21.15.94:32878) 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc94c9640 1 -- 172.21.15.94:0/3738829054 learned_addr learned my addr 172.21.15.94:0/3738829054 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 -- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc40b2b30 msgr2=0x7fdfc4160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc40b2b30 0x7fdfc4160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 -- 172.21.15.94:0/3738829054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfc40b2fb0 msgr2=0x7fdfc4160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfc40b2fb0 0x7fdfc4160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 -- 172.21.15.94:0/3738829054 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc40b1150 con 0x7fdfb40039f0 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc94c9640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfc40b2fb0 0x7fdfc4160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc8cc8640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40039f0 0x7fdfc4159fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4004770 tx=0x7fdfb4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7f9a2effd640 1 -- 172.21.15.94:0/3146719824 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a280bd020 con 0x7f9a380cff80 2024-09-11T23:19:43.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc17fa640 1 -- 172.21.15.94:0/3738829054 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80ba020 con 0x7fdfb40039f0 2024-09-11T23:19:43.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.732+0000 7fdfc17fa640 1 -- 172.21.15.94:0/3738829054 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb8000ee0 con 0x7fdfb40039f0 2024-09-11T23:19:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7f9a2effd640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a1c0678c0 0x7f9a1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7f9a2effd640 1 -- 172.21.15.94:0/3146719824 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f9a281205a0 con 0x7f9a380cff80 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfc17fa640 1 -- 172.21.15.94:0/3738829054 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8007a40 con 0x7fdfb40039f0 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc40b1430 con 0x7fdfb40039f0 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc40b19f0 con 0x7fdfb40039f0 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc40b36f0 con 0x7fdfb40039f0 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfc17fa640 1 -- 172.21.15.94:0/3738829054 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdfb80bd070 con 0x7fdfb40039f0 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfc17fa640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa8067910 0x7fdfa8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfc17fa640 1 -- 172.21.15.94:0/3738829054 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fdfb811f480 con 0x7fdfb40039f0 2024-09-11T23:19:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.736+0000 7fdfc3fff640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa8067910 0x7fdfa8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.740+0000 7f9a3e28d640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a1c0678c0 0x7f9a1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.740+0000 7fdfc3fff640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa8067910 0x7fdfa8069dd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b5990 tx=0x7fdfb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.740+0000 7f9a3e28d640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a1c0678c0 0x7f9a1c069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9a3815a290 tx=0x7f9a34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.744+0000 7f9a2effd640 1 -- 172.21.15.94:0/3146719824 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a280c6030 con 0x7f9a380cff80 2024-09-11T23:19:43.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.752+0000 7fdfc17fa640 1 -- 172.21.15.94:0/3738829054 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdfb80c3020 con 0x7fdfb40039f0 2024-09-11T23:19:43.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.932+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f86480ce9b0 con 0x7f8634004d50 2024-09-11T23:19:43.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.940+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fb4e406ed60 con 0x7fb4e40cf7e0 2024-09-11T23:19:43.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.964+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f9a380b4bd0 con 0x7f9a380cff80 2024-09-11T23:19:43.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:43.976+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fdfc415a4f0 con 0x7fdfb40039f0 2024-09-11T23:19:44.345 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:44.348 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:44.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.592+0000 7f863e7fc640 1 -- 172.21.15.94:0/3996605637 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5599 v56) ==== 95+0+0 (secure 0 0 0) 0x7f8644056b10 con 0x7f8634004d50 2024-09-11T23:19:44.594 INFO:teuthology.orchestra.run.smithi094.stderr:failed mds gid 5599 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 msgr2=0x7f862c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f86481f72e0 tx=0x7f8638008040 comp rx=0 tx=0).stop 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 msgr2=0x7f8648155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f8648155e80 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f864400d770 tx=0x7f864400dc30 comp rx=0 tx=0).stop 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 shutdown_connections 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86481f41e0 0x7f86480b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86481f3d60 0x7f86480b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f862c0678c0 0x7f862c069d80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 --2- 172.21.15.94:0/3996605637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8634004d50 0x7f8648155e80 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 >> 172.21.15.94:0/3996605637 conn(0x7f8648067a00 msgr2=0x7f8648160360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 shutdown_connections 2024-09-11T23:19:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.596+0000 7f864fdb9640 1 -- 172.21.15.94:0/3996605637 wait complete. 2024-09-11T23:19:44.614 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:19:44.612+0000 7f5d1601d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:19:44.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4cbfff640 1 -- 172.21.15.94:0/1542088444 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5144 v57) ==== 95+0+0 (secure 0 0 0) 0x7fb4d8059720 con 0x7fb4e40cf7e0 2024-09-11T23:19:44.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a2effd640 1 -- 172.21.15.94:0/3146719824 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6687 v57) ==== 95+0+0 (secure 0 0 0) 0x7f9a28016150 con 0x7f9a380cff80 2024-09-11T23:19:44.616 INFO:teuthology.orchestra.run.smithi094.stderr:failed mds gid 5144 2024-09-11T23:19:44.617 INFO:teuthology.orchestra.run.smithi094.stderr:failed mds gid 6687 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4d00678c0 msgr2=0x7fb4d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4d00678c0 0x7fb4d0069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40011f0 tx=0x7fb4d4009040 comp rx=0 tx=0).stop 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e40cf7e0 msgr2=0x7fb4e4151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e40cf7e0 0x7fb4e4151b50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8005890 tx=0x7fb4d800c960 comp rx=0 tx=0).stop 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 shutdown_connections 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4e4158e50 0x7fb4e414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb4d00678c0 0x7fb4d0069d80 secure :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40011f0 tx=0x7fb4d4009040 comp rx=0 tx=0).stop 2024-09-11T23:19:44.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a1c0678c0 msgr2=0x7f9a1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a1c0678c0 0x7f9a1c069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9a3815a290 tx=0x7f9a34008040 comp rx=0 tx=0).stop 2024-09-11T23:19:44.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e40cf7e0 0x7fb4e4151b50 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 --2- 172.21.15.94:0/1542088444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e406fa20 0x7fb4e4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a380cff80 msgr2=0x7f9a38142040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a380cff80 0x7f9a38142040 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ad040 tx=0x7f9a280192d0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 >> 172.21.15.94:0/1542088444 conn(0x7fb4e40b2820 msgr2=0x7fb4e40746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:44.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 shutdown_connections 2024-09-11T23:19:44.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3815de50 0x7f9a38158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9a1c0678c0 0x7f9a1c069d80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a380cff80 0x7f9a38142040 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 --2- 172.21.15.94:0/3146719824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a3806d9c0 0x7f9a381413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 >> 172.21.15.94:0/3146719824 conn(0x7f9a380b2890 msgr2=0x7f9a38072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:44.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 shutdown_connections 2024-09-11T23:19:44.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 shutdown_connections 2024-09-11T23:19:44.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7f9a404f1640 1 -- 172.21.15.94:0/3146719824 wait complete. 2024-09-11T23:19:44.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.616+0000 7fb4ea1ad640 1 -- 172.21.15.94:0/1542088444 wait complete. 2024-09-11T23:19:44.623 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:19:44.623 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:19:44.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfc17fa640 1 -- 172.21.15.94:0/3738829054 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6690 v57) ==== 95+0+0 (secure 0 0 0) 0x7fdfb80160d0 con 0x7fdfb40039f0 2024-09-11T23:19:44.625 INFO:teuthology.orchestra.run.smithi094.stderr:failed mds gid 6690 2024-09-11T23:19:44.626 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:19:44.626 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:44.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa8067910 msgr2=0x7fdfa8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa8067910 0x7fdfa8069dd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b5990 tx=0x7fdfb0008040 comp rx=0 tx=0).stop 2024-09-11T23:19:44.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40039f0 msgr2=0x7fdfc4159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40039f0 0x7fdfc4159fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4004770 tx=0x7fdfb4005840 comp rx=0 tx=0).stop 2024-09-11T23:19:44.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 shutdown_connections 2024-09-11T23:19:44.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdfa8067910 0x7fdfa8069dd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfc40b2fb0 0x7fdfc4160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc40b2b30 0x7fdfc4160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 --2- 172.21.15.94:0/3738829054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40039f0 0x7fdfc4159fb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 >> 172.21.15.94:0/3738829054 conn(0x7fdfc4075030 msgr2=0x7fdfc40b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:44.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 shutdown_connections 2024-09-11T23:19:44.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.624+0000 7fdfcaf2c640 1 -- 172.21.15.94:0/3738829054 wait complete. 2024-09-11T23:19:44.643 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:19:44.643 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:19:44.645 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:19:44.645 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:19:44.648 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:19:44.648 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:19:44.648 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:19:44.649 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:44.649 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:19:44.649 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:44.693 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:19:44.693 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:44.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:44.702 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:19:44.707 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:19:44.715 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:19:44.752 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:19:44.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd13028f640 1 Processor -- start 2024-09-11T23:19:44.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd13028f640 1 -- start start 2024-09-11T23:19:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd13028f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1280d0a90 0x7fd128075030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd13028f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd128075570 0x7fd1280cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd13028f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12806ff70 con 0x7fd12815c2c0 2024-09-11T23:19:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd13028f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd1280759c0 con 0x7fd128075570 2024-09-11T23:19:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd13028f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd1280cfff0 con 0x7fd1280d0a90 2024-09-11T23:19:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12e82c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd128075570 0x7fd1280cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12e82c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd128075570 0x7fd1280cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42892/0 (socket says 172.21.15.94:42892) 2024-09-11T23:19:44.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12e82c640 1 -- 172.21.15.94:0/3922179929 learned_addr learned my addr 172.21.15.94:0/3922179929 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:44.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12d82a640 1 --2- 172.21.15.94:0/3922179929 >> v2:172.21.15.155:3300/0 conn(0x7fd1280d0a90 0x7fd128075030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:44.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12e82c640 1 -- 172.21.15.94:0/3922179929 >> v2:172.21.15.155:3300/0 conn(0x7fd1280d0a90 msgr2=0x7fd128075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:44.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12e82c640 1 --2- 172.21.15.94:0/3922179929 >> v2:172.21.15.155:3300/0 conn(0x7fd1280d0a90 0x7fd128075030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12e82c640 1 -- 172.21.15.94:0/3922179929 >> v1:172.21.15.155:6789/0 conn(0x7fd12815c2c0 legacy=0x7fd12806f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:44.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12e82c640 1 -- 172.21.15.94:0/3922179929 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12806fc90 con 0x7fd128075570 2024-09-11T23:19:44.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.796+0000 7fd12d82a640 1 --2- 172.21.15.94:0/3922179929 >> v2:172.21.15.155:3300/0 conn(0x7fd1280d0a90 0x7fd128075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:44.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12e82c640 1 --2- 172.21.15.94:0/3922179929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd128075570 0x7fd1280cd510 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd12806ef00 tx=0x7fd12001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3b2d053d25e52f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:44.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12d029640 1 -- 172.21.15.94:0/3922179929 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1200a56d0 con 0x7fd128075570 2024-09-11T23:19:44.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12d029640 1 -- 172.21.15.94:0/3922179929 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1200a5870 con 0x7fd128075570 2024-09-11T23:19:44.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12d029640 1 -- 172.21.15.94:0/3922179929 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1200a5c40 con 0x7fd128075570 2024-09-11T23:19:44.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- 172.21.15.94:0/3922179929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd128075570 msgr2=0x7fd1280cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 --2- 172.21.15.94:0/3922179929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd128075570 0x7fd1280cd510 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd12806ef00 tx=0x7fd12001c920 comp rx=0 tx=0).stop 2024-09-11T23:19:44.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- 172.21.15.94:0/3922179929 shutdown_connections 2024-09-11T23:19:44.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 --2- 172.21.15.94:0/3922179929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd128075570 0x7fd1280cd510 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 --2- 172.21.15.94:0/3922179929 >> v2:172.21.15.155:3300/0 conn(0x7fd1280d0a90 0x7fd128075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- 172.21.15.94:0/3922179929 >> 172.21.15.94:0/3922179929 conn(0x7fd128067a00 msgr2=0x7fd128067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:44.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- 172.21.15.94:0/3922179929 shutdown_connections 2024-09-11T23:19:44.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- 172.21.15.94:0/3922179929 wait complete. 2024-09-11T23:19:44.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 Processor -- start 2024-09-11T23:19:44.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- start start 2024-09-11T23:19:44.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd128075570 0x7fd128153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:44.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1280d0a90 0x7fd128149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:44.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd12815c2c0 0x7fd12814f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:44.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd12815c820 con 0x7fd12815c2c0 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd12815c6a0 con 0x7fd1280d0a90 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd13028f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd12806f820 con 0x7fd128075570 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12e82c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd12815c2c0 0x7fd12814f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12e82c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd12815c2c0 0x7fd12814f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42900/0 (socket says 172.21.15.94:42900) 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12e82c640 1 -- 172.21.15.94:0/1486319785 learned_addr learned my addr 172.21.15.94:0/1486319785 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.800+0000 7fd12d82a640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1280d0a90 0x7fd128149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e02b640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd128075570 0x7fd128153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e82c640 1 -- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd128075570 msgr2=0x7fd128153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e82c640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd128075570 0x7fd128153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e82c640 1 -- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1280d0a90 msgr2=0x7fd128149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e82c640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1280d0a90 0x7fd128149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e82c640 1 -- 172.21.15.94:0/1486319785 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd128154b50 con 0x7fd12815c2c0 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e82c640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd12815c2c0 0x7fd12814f0c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd1200af040 tx=0x7fd1200196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd11effd640 1 -- 172.21.15.94:0/1486319785 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1200bc020 con 0x7fd12815c2c0 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd11effd640 1 -- 172.21.15.94:0/1486319785 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1200b8670 con 0x7fd12815c2c0 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1281542b0 con 0x7fd12815c2c0 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd11effd640 1 -- 172.21.15.94:0/1486319785 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1200b8a60 con 0x7fd12815c2c0 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd128154870 con 0x7fd12815c2c0 2024-09-11T23:19:44.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1280cd510 con 0x7fd12815c2c0 2024-09-11T23:19:44.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd11effd640 1 -- 172.21.15.94:0/1486319785 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1200bf020 con 0x7fd12815c2c0 2024-09-11T23:19:44.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd11effd640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd10c0678c0 0x7fd10c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:44.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd11effd640 1 -- 172.21.15.94:0/1486319785 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7fd120120df0 con 0x7fd12815c2c0 2024-09-11T23:19:44.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e02b640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd10c0678c0 0x7fd10c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:44.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.804+0000 7fd12e02b640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd10c0678c0 0x7fd10c069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd118003d60 tx=0x7fd118009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:44.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.808+0000 7fd11effd640 1 -- 172.21.15.94:0/1486319785 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1200c6030 con 0x7fd12815c2c0 2024-09-11T23:19:44.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.988+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1280b1500 con 0x7fd12815c2c0 2024-09-11T23:19:44.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd11effd640 1 -- 172.21.15.94:0/1486319785 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+1912 (secure 0 0 0) 0x7fd1200165a0 con 0x7fd12815c2c0 2024-09-11T23:19:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:44.992 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":57,"btime":"2024-09-11T23:19:44:616052+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:44.616045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-11T23:19:44.992 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 57 2024-09-11T23:19:44.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd10c0678c0 msgr2=0x7fd10c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd10c0678c0 0x7fd10c069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd118003d60 tx=0x7fd118009040 comp rx=0 tx=0).stop 2024-09-11T23:19:44.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd12815c2c0 msgr2=0x7fd12814f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:44.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd12815c2c0 0x7fd12814f0c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd1200af040 tx=0x7fd1200196c0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 shutdown_connections 2024-09-11T23:19:44.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd10c0678c0 0x7fd10c069d80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd12815c2c0 0x7fd12814f0c0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1280d0a90 0x7fd128149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 --2- 172.21.15.94:0/1486319785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd128075570 0x7fd128153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:44.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 >> 172.21.15.94:0/1486319785 conn(0x7fd128067a00 msgr2=0x7fd1280b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:44.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 shutdown_connections 2024-09-11T23:19:44.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:44.992+0000 7fd13028f640 1 -- 172.21.15.94:0/1486319785 wait complete. 2024-09-11T23:19:45.412 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:19:34.908440+0000', 'modified': '2024-09-11T23:19:44.616045+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T23:19:45.412 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-11T23:19:46.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:46.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.544+0000 7fb05e9ce640 1 Processor -- start 2024-09-11T23:19:46.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.544+0000 7fb05e9ce640 1 -- start start 2024-09-11T23:19:46.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05e9ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 0x7fb05806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05e9ce640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb05806c9b0 0x7fb0580cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05e9ce640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0580b6890 con 0x7fb05815e660 2024-09-11T23:19:46.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05e9ce640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb05806ce00 con 0x7fb05806c9b0 2024-09-11T23:19:46.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05e9ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb0580b6b70 con 0x7fb05815ea40 2024-09-11T23:19:46.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb05815e660 0x7fb0580b33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56784/0 (socket says 172.21.15.94:56784) 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 -- 172.21.15.94:0/1783714513 learned_addr learned my addr 172.21.15.94:0/1783714513 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05cf6b640 1 --2- 172.21.15.94:0/1783714513 >> v2:172.21.15.155:3300/0 conn(0x7fb05806c9b0 0x7fb0580cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705059129 0 0) 0x7fb0580b6890 con 0x7fb05815e660 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb0577fe640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 0x7fb05806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb044003530 con 0x7fb05815e660 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1000626400 0 0) 0x7fb044003530 con 0x7fb05815e660 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 msgr2=0x7fb05806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 0x7fb05806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 >> v2:172.21.15.155:3300/0 conn(0x7fb05806c9b0 msgr2=0x7fb0580cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 --2- 172.21.15.94:0/1783714513 >> v2:172.21.15.155:3300/0 conn(0x7fb05806c9b0 0x7fb0580cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0580b6e50 con 0x7fb05815e660 2024-09-11T23:19:46.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fb040001a00 con 0x7fb05815e660 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 >> v1:172.21.15.94:6789/0 conn(0x7fb05815e660 legacy=0x7fb0580b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb044003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb044004810 0x7fb044004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 0x7fb0440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb05806ce00 con 0x7fb0440039c0 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0580b6b70 con 0x7fb044004810 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb04400b9d0 con 0x7fb05815ea40 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb044003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb0577fe640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb044004810 0x7fb044004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05cf6b640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 0x7fb0440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 -- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 msgr2=0x7fb0440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:46.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 0x7fb0440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 -- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb044004810 msgr2=0x7fb044004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:46.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb044004810 0x7fb044004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 -- 172.21.15.94:0/1783714513 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb044003530 con 0x7fb0440039c0 2024-09-11T23:19:46.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb05cf6b640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb05815ea40 0x7fb0440051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb057fff640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb044003de0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb04000a7b0 tx=0x7fb04001d250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1236de1f5786a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.548+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04000a3d0 con 0x7fb0440039c0 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0400ad650 con 0x7fb0440039c0 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb056ffd640 1 -- 172.21.15.94:0/1783714513 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0400ada40 con 0x7fb0440039c0 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- 172.21.15.94:0/1783714513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 msgr2=0x7fb044003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 --2- 172.21.15.94:0/1783714513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb044003de0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb04000a7b0 tx=0x7fb04001d250 comp rx=0 tx=0).stop 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05cf6b640 1 -- 172.21.15.94:0/1783714513 reap_dead start 2024-09-11T23:19:46.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- 172.21.15.94:0/1783714513 shutdown_connections 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- 172.21.15.94:0/1783714513 >> 172.21.15.94:0/1783714513 conn(0x7fb0580b7860 msgr2=0x7fb0580b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- 172.21.15.94:0/1783714513 shutdown_connections 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- 172.21.15.94:0/1783714513 wait complete. 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 Processor -- start 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- start start 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb0581ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0581ec5c0 0x7fb05809e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb05809e7e0 0x7fb058155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb05806d130 con 0x7fb0440039c0 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0580b3d10 con 0x7fb05809e7e0 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb05806d2b0 con 0x7fb0581ec5c0 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb0581ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb0581ee9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42920/0 (socket says 172.21.15.94:42920) 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 -- 172.21.15.94:0/486188973 learned_addr learned my addr 172.21.15.94:0/486188973 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb0577fe640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0581ec5c0 0x7fb05809e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 -- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0581ec5c0 msgr2=0x7fb05809e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0581ec5c0 0x7fb05809e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05cf6b640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb05809e7e0 0x7fb058155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 -- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb05809e7e0 msgr2=0x7fb058155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb05809e7e0 0x7fb058155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 -- 172.21.15.94:0/486188973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05809ed10 con 0x7fb0440039c0 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb0577fe640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0581ec5c0 0x7fb05809e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb057fff640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb0581ee9b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb04001d080 tx=0x7fb044005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb054ff9640 1 -- 172.21.15.94:0/486188973 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040004b70 con 0x7fb0440039c0 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb054ff9640 1 -- 172.21.15.94:0/486188973 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb040004d10 con 0x7fb0440039c0 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05809eff0 con 0x7fb0440039c0 2024-09-11T23:19:46.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb054ff9640 1 -- 172.21.15.94:0/486188973 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040001a00 con 0x7fb0440039c0 2024-09-11T23:19:46.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.552+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb05809f5b0 con 0x7fb0440039c0 2024-09-11T23:19:46.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.556+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05815b880 con 0x7fb0440039c0 2024-09-11T23:19:46.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.556+0000 7fb054ff9640 1 -- 172.21.15.94:0/486188973 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0400b5070 con 0x7fb0440039c0 2024-09-11T23:19:46.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.556+0000 7fb054ff9640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0380678c0 0x7fb038069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:46.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.556+0000 7fb054ff9640 1 -- 172.21.15.94:0/486188973 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7fb0401200c0 con 0x7fb0440039c0 2024-09-11T23:19:46.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.556+0000 7fb0577fe640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0380678c0 0x7fb038069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:46.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.556+0000 7fb0577fe640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0380678c0 0x7fb038069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb058154730 tx=0x7fb048008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:46.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.560+0000 7fb054ff9640 1 -- 172.21.15.94:0/486188973 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb0400bd060 con 0x7fb0440039c0 2024-09-11T23:19:46.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.752+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0580704b0 con 0x7fb0440039c0 2024-09-11T23:19:46.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.752+0000 7fb054ff9640 1 -- 172.21.15.94:0/486188973 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5220 (secure 0 0 0) 0x7fb040016ff0 con 0x7fb0440039c0 2024-09-11T23:19:46.754 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:46.754 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":60,"btime":"2024-09-11T23:19:46:627087+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:45.641417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-11T23:19:46.754 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 60 2024-09-11T23:19:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.752+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0380678c0 msgr2=0x7fb038069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.752+0000 7fb05e9ce640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0380678c0 0x7fb038069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb058154730 tx=0x7fb048008040 comp rx=0 tx=0).stop 2024-09-11T23:19:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.752+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 msgr2=0x7fb0581ee9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.752+0000 7fb05e9ce640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb0581ee9b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb04001d080 tx=0x7fb044005840 comp rx=0 tx=0).stop 2024-09-11T23:19:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 shutdown_connections 2024-09-11T23:19:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb05809e7e0 0x7fb058155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0581ec5c0 0x7fb05809e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0380678c0 0x7fb038069d80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 --2- 172.21.15.94:0/486188973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0440039c0 0x7fb0581ee9b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 >> 172.21.15.94:0/486188973 conn(0x7fb0580b7860 msgr2=0x7fb0580709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 shutdown_connections 2024-09-11T23:19:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:46.756+0000 7fb05e9ce640 1 -- 172.21.15.94:0/486188973 wait complete. 2024-09-11T23:19:47.173 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:19:34.908440+0000', 'modified': '2024-09-11T23:19:45.641417+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6894}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6894': {'gid': 6894, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.94:6835/1696446491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 1696446491}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 1696446491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T23:19:47.173 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6894:up:reconnect 2024-09-11T23:19:48.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:48.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f8d22640 1 Processor -- start 2024-09-11T23:19:48.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f8d22640 1 -- start start 2024-09-11T23:19:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f8d22640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 0x7fc6f41692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f8d22640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f40b7740 con 0x7fc6f40d3350 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f8d22640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f40cfdd0 con 0x7fc6f415e6f0 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f8d22640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f40d3850 con 0x7fc6f40d15d0 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f1d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc6f40d3350 0x7fc6f40d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56796/0 (socket says 172.21.15.94:56796) 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f1d9b640 1 -- 172.21.15.94:0/4045749442 learned_addr learned my addr 172.21.15.94:0/4045749442 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857486393 0 0) 0x7fc6f40b7740 con 0x7fc6f40d3350 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f2d9d640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 0x7fc6f41692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6dc003530 con 0x7fc6f40d3350 2024-09-11T23:19:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1637628361 0 0) 0x7fc6dc003530 con 0x7fc6f40d3350 2024-09-11T23:19:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 msgr2=0x7fc6f41692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 0x7fc6f41692b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 >> v1:172.21.15.155:6789/0 conn(0x7fc6f415e6f0 legacy=0x7fc6f40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f40d3b30 con 0x7fc6f40d3350 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fc6e8001680 con 0x7fc6f40d3350 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 >> v1:172.21.15.94:6789/0 conn(0x7fc6f40d3350 legacy=0x7fc6f40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6dc0039f0 0x7fc6dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 0x7fc6dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f40d3850 con 0x7fc6dc004d50 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc00bb00 con 0x7fc6dc0039f0 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc6dc00bd00 con 0x7fc6f40d15d0 2024-09-11T23:19:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f2d9d640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f259c640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6dc0039f0 0x7fc6dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f1d9b640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 0x7fc6dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f2d9d640 1 -- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 msgr2=0x7fc6dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:48.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f2d9d640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f40d15d0 0x7fc6dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f2d9d640 1 -- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6dc0039f0 msgr2=0x7fc6dc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:48.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f2d9d640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6dc0039f0 0x7fc6dc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.304+0000 7fc6f2d9d640 1 -- 172.21.15.94:0/4045749442 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc003530 con 0x7fc6dc004d50 2024-09-11T23:19:48.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f2d9d640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6dc0051d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009f90 tx=0x7fc6ec01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6327ba27ff4fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:48.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec0b2070 con 0x7fc6dc004d50 2024-09-11T23:19:48.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ec0a5b40 con 0x7fc6dc004d50 2024-09-11T23:19:48.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f159a640 1 -- 172.21.15.94:0/4045749442 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec009c10 con 0x7fc6dc004d50 2024-09-11T23:19:48.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 -- 172.21.15.94:0/4045749442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 msgr2=0x7fc6dc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:48.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 --2- 172.21.15.94:0/4045749442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6dc0051d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009f90 tx=0x7fc6ec01cc40 comp rx=0 tx=0).stop 2024-09-11T23:19:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f2d9d640 1 -- 172.21.15.94:0/4045749442 reap_dead start 2024-09-11T23:19:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 -- 172.21.15.94:0/4045749442 shutdown_connections 2024-09-11T23:19:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 -- 172.21.15.94:0/4045749442 >> 172.21.15.94:0/4045749442 conn(0x7fc6f40722a0 msgr2=0x7fc6f40726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 -- 172.21.15.94:0/4045749442 shutdown_connections 2024-09-11T23:19:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 -- 172.21.15.94:0/4045749442 wait complete. 2024-09-11T23:19:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 Processor -- start 2024-09-11T23:19:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.308+0000 7fc6f8d22640 1 -- start start 2024-09-11T23:19:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6f40cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f414c590 0x7fc6f414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f414db60 0x7fc6f414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f415ead0 con 0x7fc6dc004d50 2024-09-11T23:19:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f40d40f0 con 0x7fc6f414db60 2024-09-11T23:19:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f40b8c30 con 0x7fc6f414c590 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6f40cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6f40cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42940/0 (socket says 172.21.15.94:42940) 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 -- 172.21.15.94:0/1284073497 learned_addr learned my addr 172.21.15.94:0/1284073497 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f2d9d640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f414db60 0x7fc6f414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f1d9b640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f414c590 0x7fc6f414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 -- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f414c590 msgr2=0x7fc6f414efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f414c590 0x7fc6f414efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 -- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f414db60 msgr2=0x7fc6f414dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f414db60 0x7fc6f414dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 -- 172.21.15.94:0/1284073497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f414f520 con 0x7fc6dc004d50 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f259c640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6f40cb070 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400f820 tx=0x7fc6e400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6e2ffd640 1 -- 172.21.15.94:0/1284073497 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e40050d0 con 0x7fc6dc004d50 2024-09-11T23:19:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6e2ffd640 1 -- 172.21.15.94:0/1284073497 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e4018070 con 0x7fc6dc004d50 2024-09-11T23:19:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f414cac0 con 0x7fc6dc004d50 2024-09-11T23:19:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6e2ffd640 1 -- 172.21.15.94:0/1284073497 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400d730 con 0x7fc6dc004d50 2024-09-11T23:19:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f414d080 con 0x7fc6dc004d50 2024-09-11T23:19:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f4161eb0 con 0x7fc6dc004d50 2024-09-11T23:19:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6e2ffd640 1 -- 172.21.15.94:0/1284073497 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6e400d8d0 con 0x7fc6dc004d50 2024-09-11T23:19:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6e2ffd640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6d40678c0 0x7fc6d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6e2ffd640 1 -- 172.21.15.94:0/1284073497 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7fc6e4085c50 con 0x7fc6dc004d50 2024-09-11T23:19:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.312+0000 7fc6f1d9b640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6d40678c0 0x7fc6d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.316+0000 7fc6f1d9b640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6d40678c0 0x7fc6d4069d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000fc0 tx=0x7fc6e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:48.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.316+0000 7fc6e2ffd640 1 -- 172.21.15.94:0/1284073497 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6e408b020 con 0x7fc6dc004d50 2024-09-11T23:19:48.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.508+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6f40b90d0 con 0x7fc6dc004d50 2024-09-11T23:19:48.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.508+0000 7fc6e2ffd640 1 -- 172.21.15.94:0/1284073497 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5217 (secure 0 0 0) 0x7fc6e4056640 con 0x7fc6dc004d50 2024-09-11T23:19:48.510 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:48.511 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":61,"btime":"2024-09-11T23:19:47:630203+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:46.635294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-11T23:19:48.511 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 61 2024-09-11T23:19:48.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6d40678c0 msgr2=0x7fc6d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:48.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6d40678c0 0x7fc6d4069d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000fc0 tx=0x7fc6e8009040 comp rx=0 tx=0).stop 2024-09-11T23:19:48.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 msgr2=0x7fc6f40cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6f40cb070 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400f820 tx=0x7fc6e400fce0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 shutdown_connections 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f414db60 0x7fc6f414dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6f414c590 0x7fc6f414efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc6d40678c0 0x7fc6d4069d80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 --2- 172.21.15.94:0/1284073497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6dc004d50 0x7fc6f40cb070 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 >> 172.21.15.94:0/1284073497 conn(0x7fc6f40722a0 msgr2=0x7fc6f40b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 shutdown_connections 2024-09-11T23:19:48.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:48.512+0000 7fc6f8d22640 1 -- 172.21.15.94:0/1284073497 wait complete. 2024-09-11T23:19:48.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:19:34.908440+0000', 'modified': '2024-09-11T23:19:46.635294+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6894}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6894': {'gid': 6894, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.94:6835/1696446491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 1696446491}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 1696446491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T23:19:48.930 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6894:up:rejoin 2024-09-11T23:19:49.931 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:50.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f164aef3640 1 Processor -- start 2024-09-11T23:19:50.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f164aef3640 1 -- start start 2024-09-11T23:19:50.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f164aef3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f164415c5e0 0x7f164415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f164aef3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16440af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f164aef3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164415dfd0 con 0x7f164415da10 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f164aef3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f164415e2b0 con 0x7f164415c5e0 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f164aef3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f164415e590 con 0x7f16440b2a70 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f164415c5e0 0x7f164415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f164415c5e0 0x7f164415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38626/0 (socket says 172.21.15.94:38626) 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 -- 172.21.15.94:0/1360233768 learned_addr learned my addr 172.21.15.94:0/1360233768 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1643fff640 1 --2- 172.21.15.94:0/1360233768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16440af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 -- 172.21.15.94:0/1360233768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 msgr2=0x7f16440af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 --2- 172.21.15.94:0/1360233768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16440af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 -- 172.21.15.94:0/1360233768 >> v1:172.21.15.155:6789/0 conn(0x7f164415da10 legacy=0x7f1644075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 -- 172.21.15.94:0/1360233768 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164415e870 con 0x7f164415c5e0 2024-09-11T23:19:50.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1643fff640 1 --2- 172.21.15.94:0/1360233768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16440af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:50.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f1648c8f640 1 --2- 172.21.15.94:0/1360233768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415c5e0 0x7f164415c9c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f1638009870 tx=0x7f163801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736e920cf2b49d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f16437fe640 1 -- 172.21.15.94:0/1360233768 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380b5070 con 0x7f164415c5e0 2024-09-11T23:19:50.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f16437fe640 1 -- 172.21.15.94:0/1360233768 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16380a89d0 con 0x7f164415c5e0 2024-09-11T23:19:50.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.064+0000 7f16437fe640 1 -- 172.21.15.94:0/1360233768 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380a8da0 con 0x7f164415c5e0 2024-09-11T23:19:50.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- 172.21.15.94:0/1360233768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415c5e0 msgr2=0x7f164415c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 --2- 172.21.15.94:0/1360233768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415c5e0 0x7f164415c9c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f1638009870 tx=0x7f163801ed10 comp rx=0 tx=0).stop 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- 172.21.15.94:0/1360233768 shutdown_connections 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 --2- 172.21.15.94:0/1360233768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16440af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 --2- 172.21.15.94:0/1360233768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415c5e0 0x7f164415c9c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- 172.21.15.94:0/1360233768 >> 172.21.15.94:0/1360233768 conn(0x7f16440b2e70 msgr2=0x7f16440b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- 172.21.15.94:0/1360233768 shutdown_connections 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- 172.21.15.94:0/1360233768 wait complete. 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 Processor -- start 2024-09-11T23:19:50.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- start start 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16441511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164415c5e0 0x7f16441490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415da10 0x7f164414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f16440758c0 con 0x7f164415da10 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1644075740 con 0x7f164415c5e0 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f164aef3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f164415f070 con 0x7f16440b2a70 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415da10 0x7f164414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415da10 0x7f164414f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38642/0 (socket says 172.21.15.94:38642) 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 -- 172.21.15.94:0/2882612996 learned_addr learned my addr 172.21.15.94:0/2882612996 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1643fff640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164415c5e0 0x7f16441490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1648c8f640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16441511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 -- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 msgr2=0x7f16441511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16441511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 -- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164415c5e0 msgr2=0x7f16441490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164415c5e0 0x7f16441490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 -- 172.21.15.94:0/2882612996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164414e510 con 0x7f164415da10 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1643fff640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164415c5e0 0x7f16441490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1648c8f640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16441511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f1649490640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415da10 0x7f164414f770 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f163c00b970 tx=0x7f163c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f16417fa640 1 -- 172.21.15.94:0/2882612996 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c019070 con 0x7f164415da10 2024-09-11T23:19:50.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f16417fa640 1 -- 172.21.15.94:0/2882612996 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c00cb40 con 0x7f164415da10 2024-09-11T23:19:50.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.068+0000 7f16417fa640 1 -- 172.21.15.94:0/2882612996 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c014440 con 0x7f164415da10 2024-09-11T23:19:50.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164414e7f0 con 0x7f164415da10 2024-09-11T23:19:50.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1644149630 con 0x7f164415da10 2024-09-11T23:19:50.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164415c9c0 con 0x7f164415da10 2024-09-11T23:19:50.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f16417fa640 1 -- 172.21.15.94:0/2882612996 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f163c01c070 con 0x7f164415da10 2024-09-11T23:19:50.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f16417fa640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16280678c0 0x7f1628069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f16417fa640 1 -- 172.21.15.94:0/2882612996 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7f163c085af0 con 0x7f164415da10 2024-09-11T23:19:50.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f1648c8f640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16280678c0 0x7f1628069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.072+0000 7f1648c8f640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16280678c0 0x7f1628069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f16380b2000 tx=0x7f1638008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.076+0000 7f16417fa640 1 -- 172.21.15.94:0/2882612996 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f163c0563c0 con 0x7f164415da10 2024-09-11T23:19:50.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.260+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1644159350 con 0x7f164415da10 2024-09-11T23:19:50.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.260+0000 7f16417fa640 1 -- 172.21.15.94:0/2882612996 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f163c055cc0 con 0x7f164415da10 2024-09-11T23:19:50.264 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:50.264 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:19:50.264 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:19:50.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16280678c0 msgr2=0x7f1628069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16280678c0 0x7f1628069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f16380b2000 tx=0x7f1638008040 comp rx=0 tx=0).stop 2024-09-11T23:19:50.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415da10 msgr2=0x7f164414f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415da10 0x7f164414f770 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f163c00b970 tx=0x7f163c00be30 comp rx=0 tx=0).stop 2024-09-11T23:19:50.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 shutdown_connections 2024-09-11T23:19:50.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f16280678c0 0x7f1628069d80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f164415da10 0x7f164414f770 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164415c5e0 0x7f16441490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 --2- 172.21.15.94:0/2882612996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16440b2a70 0x7f16441511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 >> 172.21.15.94:0/2882612996 conn(0x7f16440b2e70 msgr2=0x7f164415b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 shutdown_connections 2024-09-11T23:19:50.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.264+0000 7f164aef3640 1 -- 172.21.15.94:0/2882612996 wait complete. 2024-09-11T23:19:50.684 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:19:34.908440+0000', 'modified': '2024-09-11T23:19:49.645832+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6894}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6894': {'gid': 6894, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.94:6835/1696446491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 1696446491}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 1696446491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6894, 'qdb_cluster': [6894]} 2024-09-11T23:19:50.684 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:19:50.684 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:19:50.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f187959e640 1 Processor -- start 2024-09-11T23:19:50.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f187959e640 1 -- start start 2024-09-11T23:19:50.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f187959e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18740d0420 0x7f18740b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f187959e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18740ad390 con 0x7f18740b3160 2024-09-11T23:19:50.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f187959e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18740ad670 con 0x7f18740cd370 2024-09-11T23:19:50.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f187959e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f18740ad140 con 0x7f18740d0420 2024-09-11T23:19:50.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f18727fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f18740b3160 0x7f18740d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:54230/0 (socket says 172.21.15.94:54230) 2024-09-11T23:19:50.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f18727fc640 1 -- 172.21.15.94:0/3013099630 learned_addr learned my addr 172.21.15.94:0/3013099630 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:50.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3013099630 >> v2:172.21.15.155:3300/0 conn(0x7f18740d0420 0x7f18740b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321090018 0 0) 0x7f18740ad390 con 0x7f18740b3160 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f185c003530 con 0x7f18740b3160 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4138163439 0 0) 0x7f185c003530 con 0x7f18740b3160 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 >> v2:172.21.15.155:3300/0 conn(0x7f18740d0420 msgr2=0x7f18740b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 --2- 172.21.15.94:0/3013099630 >> v2:172.21.15.155:3300/0 conn(0x7f18740d0420 0x7f18740b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 >> v1:172.21.15.155:6789/0 conn(0x7f18740cd370 legacy=0x7f18740ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18740ad950 con 0x7f18740b3160 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f1868001680 con 0x7f18740b3160 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.812+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 >> v1:172.21.15.94:6789/0 conn(0x7f18740b3160 legacy=0x7f18740d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f185c0039c0 0x7f185c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c004810 0x7f185c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f185c0051d0 0x7f185c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f18740ad140 con 0x7f185c0039c0 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f185c00c170 con 0x7f185c004810 2024-09-11T23:19:50.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f185c00c370 con 0x7f185c0051d0 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f185c0039c0 0x7f185c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f18727fc640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c004810 0x7f185c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f18737fe640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f185c0051d0 0x7f185c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1872ffd640 1 -- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f185c0051d0 msgr2=0x7f185c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f185c0051d0 0x7f185c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1872ffd640 1 -- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c004810 msgr2=0x7f185c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c004810 0x7f185c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1872ffd640 1 -- 172.21.15.94:0/3013099630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185c003530 con 0x7f185c0039c0 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f18737fe640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f185c0051d0 0x7f185c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:50.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f18737fe640 1 -- 172.21.15.94:0/3013099630 reap_dead start 2024-09-11T23:19:50.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f185c0039c0 0x7f185c003de0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1864009ae0 tx=0x7f186401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c53f7d108300be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640096b0 con 0x7f185c0039c0 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18640a6450 con 0x7f185c0039c0 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f1871ffb640 1 -- 172.21.15.94:0/3013099630 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640a6840 con 0x7f185c0039c0 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f187959e640 1 -- 172.21.15.94:0/3013099630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f185c0039c0 msgr2=0x7f185c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f187959e640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f185c0039c0 0x7f185c003de0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1864009ae0 tx=0x7f186401ca70 comp rx=0 tx=0).stop 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f187959e640 1 -- 172.21.15.94:0/3013099630 shutdown_connections 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f187959e640 1 --2- 172.21.15.94:0/3013099630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f185c0039c0 0x7f185c003de0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f187959e640 1 -- 172.21.15.94:0/3013099630 >> 172.21.15.94:0/3013099630 conn(0x7f1874075200 msgr2=0x7f1874075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f187959e640 1 -- 172.21.15.94:0/3013099630 shutdown_connections 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.816+0000 7f187959e640 1 -- 172.21.15.94:0/3013099630 wait complete. 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 Processor -- start 2024-09-11T23:19:50.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 -- start start 2024-09-11T23:19:50.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c0039c0 0x7f18740993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1874152700 0x7f187414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1874152b80 0x7f18741504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f18740aeae0 con 0x7f1874152b80 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18740ae960 con 0x7f185c0039c0 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f18740aec60 con 0x7f1874152700 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1874152b80 0x7f18741504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1874152b80 0x7f18741504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38658/0 (socket says 172.21.15.94:38658) 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 -- 172.21.15.94:0/950579676 learned_addr learned my addr 172.21.15.94:0/950579676 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f1872ffd640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c0039c0 0x7f18740993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18727fc640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1874152700 0x7f187414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 -- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1874152700 msgr2=0x7f187414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1874152700 0x7f187414e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 -- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c0039c0 msgr2=0x7f18740993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c0039c0 0x7f18740993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 -- 172.21.15.94:0/950579676 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187414f400 con 0x7f1874152b80 2024-09-11T23:19:50.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f1872ffd640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c0039c0 0x7f18740993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:50.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f18737fe640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1874152b80 0x7f18741504a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f18740cc590 tx=0x7f186c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f185b7fe640 1 -- 172.21.15.94:0/950579676 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c018070 con 0x7f1874152b80 2024-09-11T23:19:50.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f185b7fe640 1 -- 172.21.15.94:0/950579676 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186c003ba0 con 0x7f1874152b80 2024-09-11T23:19:50.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187414f6e0 con 0x7f1874152b80 2024-09-11T23:19:50.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f185b7fe640 1 -- 172.21.15.94:0/950579676 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c005070 con 0x7f1874152b80 2024-09-11T23:19:50.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187414fca0 con 0x7f1874152b80 2024-09-11T23:19:50.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.820+0000 7f185b7fe640 1 -- 172.21.15.94:0/950579676 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f186c01b070 con 0x7f1874152b80 2024-09-11T23:19:50.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f185b7fe640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18600678c0 0x7f1860069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f185b7fe640 1 -- 172.21.15.94:0/950579676 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7f186c0854e0 con 0x7f1874152b80 2024-09-11T23:19:50.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f1872ffd640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18600678c0 0x7f1860069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 Processor -- start 2024-09-11T23:19:50.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- start start 2024-09-11T23:19:50.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f1872ffd640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18600678c0 0x7f1860069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f18640ad000 tx=0x7f18640b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8842cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e883e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e3290 0x557e883e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e882cab60 con 0x557e8842d440 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557e88231c70 con 0x557e8842cb20 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557e881d7ed0 con 0x557e883e3290 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e883e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e883e2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38660/0 (socket says 172.21.15.94:38660) 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 -- 172.21.15.94:0/703031883 learned_addr learned my addr 172.21.15.94:0/703031883 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f1872ffd640 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8842cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18737fe640 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e3290 0x557e883e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 -- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e3290 msgr2=0x557e883e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e3290 0x557e883e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 -- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 msgr2=0x557e8842cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8842cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 -- 172.21.15.94:0/703031883 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e881e9e50 con 0x557e8842d440 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f18727fc640 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e883e2d50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1868005960 tx=0x7f1868005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86590248621c682 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f1858ff9640 1 -- 172.21.15.94:0/703031883 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868010a80 con 0x557e8842d440 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f1858ff9640 1 -- 172.21.15.94:0/703031883 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868019070 con 0x557e8842d440 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f1858ff9640 1 -- 172.21.15.94:0/703031883 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868010e20 con 0x557e8842d440 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- 172.21.15.94:0/703031883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 msgr2=0x557e883e2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e883e2d50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1868005960 tx=0x7f1868005e20 comp rx=0 tx=0).stop 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- 172.21.15.94:0/703031883 shutdown_connections 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e3290 0x557e883e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e883e2d50 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 --2- 172.21.15.94:0/703031883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8842cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- 172.21.15.94:0/703031883 >> 172.21.15.94:0/703031883 conn(0x557e883e9600 msgr2=0x557e883e1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- 172.21.15.94:0/703031883 shutdown_connections 2024-09-11T23:19:50.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.824+0000 7f187c65a000 1 -- 172.21.15.94:0/703031883 wait complete. 2024-09-11T23:19:50.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- start start 2024-09-11T23:19:50.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 Processor -- start 2024-09-11T23:19:50.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842cb20 0x557e883e7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842d440 0x557e883edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e883ee230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e88293b00 con 0x557e8842cb20 2024-09-11T23:19:50.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557e8820c360 con 0x557e883e8390 2024-09-11T23:19:50.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557e882092d0 con 0x557e8842d440 2024-09-11T23:19:50.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 10 client.0 _ll_register_callbacks cb 0x557e883ce820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842cb20 0x557e883e7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842cb20 0x557e883e7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38674/0 (socket says 172.21.15.94:38674) 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 -- 172.21.15.94:0/3564487971 learned_addr learned my addr 172.21.15.94:0/3564487971 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f18737fe640 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e883ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f18727fc640 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842d440 0x557e883edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 -- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842d440 msgr2=0x557e883edcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842d440 0x557e883edcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 -- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 msgr2=0x557e883ee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e883ee230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 -- 172.21.15.94:0/3564487971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e881d8120 con 0x557e8842cb20 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842cb20 0x557e883e7e50 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f186401cf50 tx=0x7f1864019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f739b9f500dbef8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 1 -- 172.21.15.94:0/3564487971 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640cb060 con 0x557e8842cb20 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 1 -- 172.21.15.94:0/3564487971 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7f18640bbae0 con 0x557e8842cb20 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1868019070 con 0x557e8842cb20 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 1 -- 172.21.15.94:0/3564487971 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f18640d1050 con 0x557e8842cb20 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 10 client.6930 fetch_fsmap learned FSMap version 63 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x557e881d1450 con 0x557e8842cb20 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 1 -- 172.21.15.94:0/3564487971 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868019070 con 0x557e8842cb20 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 1 -- 172.21.15.94:0/3564487971 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f18640d4020 con 0x557e8842cb20 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 10 client.6930 fetch_fsmap finished waiting for FSMap version 63 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 10 client.6930 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 20 client.6930 populate_metadata read hostname 'smithi094' 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8843b280 0x557e8843d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 4 client.6930 mds_command: new command op to 6894 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 --> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e881cbc00 con 0x557e8843b280 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f18727fc640 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8843b280 0x557e8843d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f18727fc640 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8843b280 0x557e8843d670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec2046b2458549cb server_cookie=4f1855eb5101b04e in_seq=0 out_seq=0 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 10 client.6930 ms_handle_connect on v2:172.21.15.94:6834/1696446491 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 1 -- 172.21.15.94:0/3564487971 <== mds.0 v2:172.21.15.94:6834/1696446491 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e881cbc00 con 0x557e8843b280 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 10 client.6930 handle_command_reply: tid=0 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 client.6930 shutdown 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842cb20 msgr2=0x557e883e7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842cb20 0x557e883e7e50 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f186401cf50 tx=0x7f1864019810 comp rx=0 tx=0).stop 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 shutdown_connections 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8843b280 0x557e8843d670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e883ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842d440 0x557e883edcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f1851ffb640 0 client.6930 ms_handle_reset on v2:172.21.15.94:6834/1696446491 2024-09-11T23:19:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 --2- 172.21.15.94:0/3564487971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842cb20 0x557e883e7e50 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 >> 172.21.15.94:0/3564487971 conn(0x557e883e3290 msgr2=0x557e883e1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 shutdown_connections 2024-09-11T23:19:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.828+0000 7f187c65a000 1 -- 172.21.15.94:0/3564487971 wait complete. 2024-09-11T23:19:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.832+0000 7f187c65a000 20 client.6930 trim_cache size 0 max 16384 2024-09-11T23:19:50.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 Processor -- start 2024-09-11T23:19:50.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 -- start start 2024-09-11T23:19:50.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e8842bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842cb20 0x557e8842c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8843d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1874203fa0 con 0x557e8842d440 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18740725b0 con 0x557e883e8390 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1874203950 con 0x557e8842cb20 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8843d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8843d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38682/0 (socket says 172.21.15.94:38682) 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 -- 172.21.15.94:0/3646620723 learned_addr learned my addr 172.21.15.94:0/3646620723 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e8842bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18727fc640 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842cb20 0x557e8842c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 -- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842cb20 msgr2=0x557e8842c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842cb20 0x557e8842c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 -- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 msgr2=0x557e8842bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e8842bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 -- 172.21.15.94:0/3646620723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e881b8fd0 con 0x557e8842d440 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f1872ffd640 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e8842bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f18737fe640 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8843d670 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f186c005040 tx=0x7f186c05c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6049f209ac3c7e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f1853fff640 1 -- 172.21.15.94:0/3646620723 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c05e470 con 0x557e8842d440 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f1853fff640 1 -- 172.21.15.94:0/3646620723 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186c053b90 con 0x557e8842d440 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.848+0000 7f1853fff640 1 -- 172.21.15.94:0/3646620723 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c051f00 con 0x557e8842d440 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/3646620723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 msgr2=0x557e8843d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8843d670 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f186c005040 tx=0x7f186c05c040 comp rx=0 tx=0).stop 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/3646620723 shutdown_connections 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8843d670 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e8842cb20 0x557e8842c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/3646620723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e883e8390 0x557e8842bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/3646620723 >> 172.21.15.94:0/3646620723 conn(0x557e883e3290 msgr2=0x557e883e7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/3646620723 shutdown_connections 2024-09-11T23:19:50.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/3646620723 wait complete. 2024-09-11T23:19:50.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- start start 2024-09-11T23:19:50.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 Processor -- start 2024-09-11T23:19:50.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e8390 0x557e88440590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8849f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8849f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e88230f80 con 0x557e8842d440 2024-09-11T23:19:50.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557e881e9ca0 con 0x557e8842cb20 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x557e882362a0 con 0x557e883e8390 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 10 client.0 _ll_register_callbacks cb 0x7f185c003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8849f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8849f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38684/0 (socket says 172.21.15.94:38684) 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 -- 172.21.15.94:0/755072911 learned_addr learned my addr 172.21.15.94:0/755072911 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18727fc640 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8849f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1872ffd640 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e8390 0x557e88440590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 -- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e8390 msgr2=0x557e88440590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e8390 0x557e88440590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 -- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 msgr2=0x557e8849f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8849f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 -- 172.21.15.94:0/755072911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e882b4750 con 0x557e8842d440 2024-09-11T23:19:50.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f18737fe640 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8849f5b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f186c003fd0 tx=0x7f186c058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fa8e565f441e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 1 -- 172.21.15.94:0/755072911 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c05e1e0 con 0x557e8842d440 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 1 -- 172.21.15.94:0/755072911 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7f186c054ce0 con 0x557e8842d440 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f186c053b90 con 0x557e8842d440 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 1 -- 172.21.15.94:0/755072911 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f186c054f20 con 0x557e8842d440 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 10 client.6936 fetch_fsmap learned FSMap version 63 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x557e881bfa30 con 0x557e8842d440 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 1 -- 172.21.15.94:0/755072911 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186c053b90 con 0x557e8842d440 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 1 -- 172.21.15.94:0/755072911 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f186c056bc0 con 0x557e8842d440 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 10 client.6936 fetch_fsmap finished waiting for FSMap version 63 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 10 client.6936 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 20 client.6936 populate_metadata read hostname 'smithi094' 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8845b960 0x557e8845bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 4 client.6936 mds_command: new command op to 6894 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 --> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] -- command(tid 0: {"prefix": "status"}) -- 0x557e8823f3a0 con 0x557e8845b960 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1872ffd640 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8845b960 0x557e8845bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1872ffd640 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8845b960 0x557e8845bd40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c2813112572c33 server_cookie=dde6a856acd4a241 in_seq=0 out_seq=0 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 10 client.6936 ms_handle_connect on v2:172.21.15.94:6834/1696446491 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 1 -- 172.21.15.94:0/755072911 <== mds.0 v2:172.21.15.94:6834/1696446491 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x557e8823f3a0 con 0x557e8845b960 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 10 client.6936 handle_command_reply: tid=0 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 client.6936 shutdown 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 msgr2=0x557e8849f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8849f5b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f186c003fd0 tx=0x7f186c058040 comp rx=0 tx=0).stop 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 shutdown_connections 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:6834/1696446491,v1:172.21.15.94:6835/1696446491] conn(0x557e8845b960 0x557e8845bd40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e8842d440 0x557e8849f5b0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557e8842cb20 0x557e8849f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f1851ffb640 0 client.6936 ms_handle_reset on v2:172.21.15.94:6834/1696446491 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 --2- 172.21.15.94:0/755072911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x557e883e8390 0x557e88440590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.852+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 >> 172.21.15.94:0/755072911 conn(0x557e883e3290 msgr2=0x557e8842acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 shutdown_connections 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187c65a000 1 -- 172.21.15.94:0/755072911 wait complete. 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187c65a000 20 client.6936 trim_cache size 0 max 16384 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 6894, 2024-09-11T23:19:50.862 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 5.2240523840000002, 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 63, 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 102, 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 102, 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 6.1017391449999998 2024-09-11T23:19:50.863 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18600678c0 msgr2=0x7f1860069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18600678c0 0x7f1860069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f18640ad000 tx=0x7f18640b2040 comp rx=0 tx=0).stop 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1874152b80 msgr2=0x7f18741504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1874152b80 0x7f18741504a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f18740cc590 tx=0x7f186c00dc00 comp rx=0 tx=0).stop 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 shutdown_connections 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f18600678c0 0x7f1860069d80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1874152b80 0x7f18741504a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1874152700 0x7f187414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 --2- 172.21.15.94:0/950579676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f185c0039c0 0x7f18740993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:50.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 >> 172.21.15.94:0/950579676 conn(0x7f1874075200 msgr2=0x7f1874159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:50.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 shutdown_connections 2024-09-11T23:19:50.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:50.856+0000 7f187959e640 1 -- 172.21.15.94:0/950579676 wait complete. 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> subdir = "delete_me" 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> size_unit = 1024 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> file_multiplier = 200 2024-09-11T23:19:50.872 DEBUG:teuthology.orchestra.run.smithi094:> os.mkdir(os.path.join(mountpoint, subdir)) 2024-09-11T23:19:50.873 DEBUG:teuthology.orchestra.run.smithi094:> for i in range(0, file_multiplier): 2024-09-11T23:19:50.873 DEBUG:teuthology.orchestra.run.smithi094:> for size in range(0, 16*size_unit, size_unit): 2024-09-11T23:19:50.873 DEBUG:teuthology.orchestra.run.smithi094:> filename = "{0}_{1}.bin".format(i, size // size_unit) 2024-09-11T23:19:50.873 DEBUG:teuthology.orchestra.run.smithi094:> with open(os.path.join(mountpoint, subdir, filename), '"'"'w'"'"') as f: 2024-09-11T23:19:50.873 DEBUG:teuthology.orchestra.run.smithi094:> f.write(size * '"'"'x'"'"') 2024-09-11T23:19:50.873 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:19:51.630 INFO:tasks.ceph.mds.a.smithi094.stderr:2024-09-11T23:19:51.628+0000 7f8c35a93640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:19:57.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:57.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config get mds_max_purge_ops 2024-09-11T23:19:57.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:57.897 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf delete_me) 2024-09-11T23:19:58.075 INFO:teuthology.orchestra.run.smithi094.stdout:{"mds_max_purge_ops":"100000000"} 2024-09-11T23:19:58.076 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_purge_ops": "100000000" } 2024-09-11T23:19:58.076 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config get mds_max_purge_files 2024-09-11T23:19:58.213 INFO:teuthology.orchestra.run.smithi094.stdout:{"mds_max_purge_files":"6"} 2024-09-11T23:19:58.214 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_purge_files": "6" } 2024-09-11T23:19:58.214 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:58.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc860788640 1 Processor -- start 2024-09-11T23:19:58.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc860788640 1 -- start start 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc860788640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 0x7fc8580b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc860788640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc85806cb80 0x7fc8580b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc860788640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8580b6890 con 0x7fc85815ea40 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc860788640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc8580b6b70 con 0x7fc85806cb80 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc860788640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580b6e50 con 0x7fc85815e660 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc85dd23640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc85815ea40 0x7fc85806c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:54232/0 (socket says 172.21.15.94:54232) 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc85dd23640 1 -- 172.21.15.94:0/190502004 learned_addr learned my addr 172.21.15.94:0/190502004 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc85ed25640 1 --2- 172.21.15.94:0/190502004 >> v2:172.21.15.155:3300/0 conn(0x7fc85806cb80 0x7fc8580b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc85e524640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 0x7fc8580b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604765593 0 0) 0x7fc8580b6890 con 0x7fc85815ea40 2024-09-11T23:19:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc844003530 con 0x7fc85815ea40 2024-09-11T23:19:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.328+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2569675248 0 0) 0x7fc844003530 con 0x7fc85815ea40 2024-09-11T23:19:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 msgr2=0x7fc8580b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 0x7fc8580b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 >> v2:172.21.15.155:3300/0 conn(0x7fc85806cb80 msgr2=0x7fc8580b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 --2- 172.21.15.94:0/190502004 >> v2:172.21.15.155:3300/0 conn(0x7fc85806cb80 0x7fc8580b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580b7130 con 0x7fc85815ea40 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fc848001680 con 0x7fc85815ea40 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 >> v1:172.21.15.94:6789/0 conn(0x7fc85815ea40 legacy=0x7fc85806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8440039c0 0x7fc844003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc844004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 0x7fc8440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580b6b70 con 0x7fc844004810 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580b6e50 con 0x7fc8440039c0 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc84400b9d0 con 0x7fc85815e660 2024-09-11T23:19:58.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85dd23640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc844004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85ed25640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 0x7fc8440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85e524640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8440039c0 0x7fc844003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85dd23640 1 -- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 msgr2=0x7fc8440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85dd23640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 0x7fc8440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85dd23640 1 -- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8440039c0 msgr2=0x7fc844003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85dd23640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8440039c0 0x7fc844003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85dd23640 1 -- 172.21.15.94:0/190502004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc844003530 con 0x7fc844004810 2024-09-11T23:19:58.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85ed25640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc85815e660 0x7fc8440051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:58.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85dd23640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc844004c90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fc848014970 tx=0x7fc8480279b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd2275268e05ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:58.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480b8070 con 0x7fc844004810 2024-09-11T23:19:58.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc848005b00 con 0x7fc844004810 2024-09-11T23:19:58.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.332+0000 7fc85d522640 1 -- 172.21.15.94:0/190502004 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848007c70 con 0x7fc844004810 2024-09-11T23:19:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- 172.21.15.94:0/190502004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 msgr2=0x7fc844004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 --2- 172.21.15.94:0/190502004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc844004c90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fc848014970 tx=0x7fc8480279b0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85ed25640 1 -- 172.21.15.94:0/190502004 reap_dead start 2024-09-11T23:19:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- 172.21.15.94:0/190502004 shutdown_connections 2024-09-11T23:19:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- 172.21.15.94:0/190502004 >> 172.21.15.94:0/190502004 conn(0x7fc8580b7860 msgr2=0x7fc8580b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- 172.21.15.94:0/190502004 shutdown_connections 2024-09-11T23:19:58.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- 172.21.15.94:0/190502004 wait complete. 2024-09-11T23:19:58.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 Processor -- start 2024-09-11T23:19:58.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- start start 2024-09-11T23:19:58.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc858160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc858153350 0x7fc858160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8581537d0 0x7fc858153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc85806d2b0 con 0x7fc844004810 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc85806d130 con 0x7fc858153350 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc860788640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580b33f0 con 0x7fc8581537d0 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc858160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc858160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38704/0 (socket says 172.21.15.94:38704) 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 -- 172.21.15.94:0/3435992883 learned_addr learned my addr 172.21.15.94:0/3435992883 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85dd23640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc858153350 0x7fc858160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85ed25640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8581537d0 0x7fc858153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 -- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8581537d0 msgr2=0x7fc858153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8581537d0 0x7fc858153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 -- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc858153350 msgr2=0x7fc858160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc858153350 0x7fc858160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 -- 172.21.15.94:0/3435992883 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc858152600 con 0x7fc844004810 2024-09-11T23:19:58.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc85e524640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc858160360 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc8540108c0 tx=0x7fc854010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:58.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.336+0000 7fc84effd640 1 -- 172.21.15.94:0/3435992883 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85400f040 con 0x7fc844004810 2024-09-11T23:19:58.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc84effd640 1 -- 172.21.15.94:0/3435992883 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85400ea80 con 0x7fc844004810 2024-09-11T23:19:58.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc84effd640 1 -- 172.21.15.94:0/3435992883 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85400ee70 con 0x7fc844004810 2024-09-11T23:19:58.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc858152870 con 0x7fc844004810 2024-09-11T23:19:58.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc858159f30 con 0x7fc844004810 2024-09-11T23:19:58.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8580b37d0 con 0x7fc844004810 2024-09-11T23:19:58.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc84effd640 1 -- 172.21.15.94:0/3435992883 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc85401c400 con 0x7fc844004810 2024-09-11T23:19:58.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc84effd640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc83c0678f0 0x7fc83c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc84effd640 1 -- 172.21.15.94:0/3435992883 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fc854086460 con 0x7fc844004810 2024-09-11T23:19:58.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc85dd23640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc83c0678f0 0x7fc83c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.340+0000 7fc85dd23640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc83c0678f0 0x7fc83c069db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc8480b5000 tx=0x7fc8580b6a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:58.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.348+0000 7fc84effd640 1 -- 172.21.15.94:0/3435992883 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc854018030 con 0x7fc844004810 2024-09-11T23:19:58.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.564+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc858069d80 con 0x7fc844004810 2024-09-11T23:19:58.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.564+0000 7fc84effd640 1 -- 172.21.15.94:0/3435992883 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7fc854056d00 con 0x7fc844004810 2024-09-11T23:19:58.567 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:19:58.567 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:19:58.567 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc83c0678f0 msgr2=0x7fc83c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc83c0678f0 0x7fc83c069db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc8480b5000 tx=0x7fc8580b6a60 comp rx=0 tx=0).stop 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 msgr2=0x7fc858160360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc858160360 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc8540108c0 tx=0x7fc854010d80 comp rx=0 tx=0).stop 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 shutdown_connections 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8581537d0 0x7fc858153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc858153350 0x7fc858160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc83c0678f0 0x7fc83c069db0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 --2- 172.21.15.94:0/3435992883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc844004810 0x7fc858160360 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 >> 172.21.15.94:0/3435992883 conn(0x7fc8580b7860 msgr2=0x7fc858070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:58.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 shutdown_connections 2024-09-11T23:19:58.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:58.568+0000 7fc860788640 1 -- 172.21.15.94:0/3435992883 wait complete. 2024-09-11T23:19:58.587 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:19:58.720 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":41,"msgr_send_messages":37,"msgr_recv_bytes":111817,"msgr_send_bytes":481978,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.014755038,"msgr_running_send_time":0.004984968,"msgr_running_recv_time":0.009884870,"msgr_running_fast_dispatch_time":0.001809563,"msgr_send_messages_queue_lat":{"avgcount":37,"sum":0.008914169,"avgtime":0.000240923},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":108480,"msgr_send_encrypted_bytes":101136},"AsyncMessenger::Worker-1":{"msgr_recv_messages":4578,"msgr_send_messages":10704,"msgr_recv_bytes":1613992,"msgr_send_bytes":8331477,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":0.467536423,"msgr_running_send_time":0.252860165,"msgr_running_recv_time":0.252603008,"msgr_running_fast_dispatch_time":0.002697586,"msgr_send_messages_queue_lat":{"avgcount":10702,"sum":0.248053919,"avgtime":0.000023178},"msgr_handle_ack_lat":{"avgcount":15047,"sum":0.003531833,"avgtime":0.000000234},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":37,"msgr_send_messages":39,"msgr_recv_bytes":17067,"msgr_send_bytes":3331303,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011415466,"msgr_running_send_time":0.005961629,"msgr_running_recv_time":0.002760606,"msgr_running_fast_dispatch_time":0.002405410,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.006382936,"avgtime":0.000167972},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":314,"complete_latency":{"avgcount":74,"sum":1.117140293,"avgtime":0.015096490}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000096589,"avgtime":0.000024147}},"mds":{"request":3257,"reply":3255,"reply_latency":{"avgcount":3255,"sum":3.974942797,"avgtime":0.001221180},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":3256,"inodes_top":0,"inodes_bottom":3256,"inodes_pin_tail":0,"inodes_pinned":3256,"inodes_expired":0,"inodes_with_caps":3202,"caps":3202,"subtrees":2,"traverse":3263,"traverse_hit":3262,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":3199,"root_rbytes":5655552,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":40,"ceph_cap_op_grant":3280,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1257,"handle_client_caps_dirty":1173,"handle_client_cap_release":0,"process_request_cap_release":3291},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":45,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":45,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":4507,"evex":0,"evtrm":0,"ev":4510,"evexg":0,"evexd":0,"segadd":6,"segex":0,"segtrm":0,"seg":8,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":13058310,"rdpos":4195244,"jlat":{"avgcount":11,"sum":0.087695436,"avgtime":0.007972312},"replayed":3},"mds_mem":{"ino":3214,"ino+":3214,"ino-":0,"dir":13,"dir+":13,"dir-":0,"dn":3256,"dn+":3256,"dn-":0,"cap":3202,"cap+":3202,"cap-":0,"rss":81560,"heap":248116},"mds_server":{"dispatch_client_request":3260,"dispatch_server_request":0,"handle_client_request":3257,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":45,"sum":0.060195897,"avgtime":0.001337686},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":3101,"average_load":3101,"avg_session_uptime":1025,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":5676453,"buffer_anon_items":1859,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":6975256,"mds_co_items":32709,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":65,"op_send_bytes":8740171,"op_resend":0,"op_reply":65,"op_latency":{"avgcount":65,"sum":0.231997218,"avgtime":0.003569187},"op_inflight":0,"oplen_avg":{"avgcount":65,"sum":122},"op":65,"op_r":36,"op_w":29,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":11,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":7,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":17,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":9146,"max":104857600,"get_started":0,"get":4651,"get_sum":1321428,"get_or_fail_fail":0,"get_or_fail_success":4651,"take":0,"take_sum":0,"put":4616,"put_sum":1312282,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":65,"take_sum":8741290,"put":65,"put_sum":8741290,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":65,"take_sum":65,"put":65,"put_sum":65,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":475398,"max":3758096384,"get_started":0,"get":4507,"get_sum":8862623,"get_or_fail_fail":0,"get_or_fail_success":4507,"take":0,"take_sum":0,"put":11,"put_sum":8387225,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:19:58.721 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 111817, "msgr_recv_encrypted_bytes": 108480, "msgr_recv_messages": 41, "msgr_running_fast_dispatch_time": 0.001809563, "msgr_running_recv_time": 0.00988487, "msgr_running_send_time": 0.004984968, "msgr_running_total_time": 0.014755038, "msgr_send_bytes": 481978, "msgr_send_encrypted_bytes": 101136, "msgr_send_messages": 37, "msgr_send_messages_queue_lat": { "avgcount": 37, "avgtime": 0.000240923, "sum": 0.008914169 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 15047, "avgtime": 2.34e-07, "sum": 0.003531833 }, "msgr_recv_bytes": 1613992, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 4578, "msgr_running_fast_dispatch_time": 0.002697586, "msgr_running_recv_time": 0.252603008, "msgr_running_send_time": 0.252860165, "msgr_running_total_time": 0.467536423, "msgr_send_bytes": 8331477, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 10704, "msgr_send_messages_queue_lat": { "avgcount": 10702, "avgtime": 2.3178e-05, "sum": 0.248053919 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 17067, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 37, "msgr_running_fast_dispatch_time": 0.00240541, "msgr_running_recv_time": 0.002760606, "msgr_running_send_time": 0.005961629, "msgr_running_total_time": 0.011415466, "msgr_send_bytes": 3331303, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 39, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000167972, "sum": 0.006382936 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 74, "avgtime": 0.01509649, "sum": 1.117140293 }, "queue_len": 314 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.4147e-05, "sum": 9.6589e-05 }, "queue_len": 0 }, "mds": { "caps": 3202, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 3280, "ceph_cap_op_revoke": 40, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1257, "handle_client_caps_dirty": 1173, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 3256, "inodes_bottom": 3256, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 3256, "inodes_top": 0, "inodes_with_caps": 3202, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 3291, "q": 0, "reply": 3255, "reply_latency": { "avgcount": 3255, "avgtime": 0.00122118, "sum": 3.974942797 }, "request": 3257, "root_rbytes": 5655552, "root_rfiles": 3199, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 3263, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 3262, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 45, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 45, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 4510, "evadd": 4507, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 11, "avgtime": 0.007972312, "sum": 0.087695436 }, "rdpos": 4195244, "replayed": 3, "seg": 8, "segadd": 6, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 13058310 }, "mds_mem": { "cap": 3202, "cap+": 3202, "cap-": 0, "dir": 13, "dir+": 13, "dir-": 0, "dn": 3256, "dn+": 3256, "dn-": 0, "heap": 248116, "ino": 3214, "ino+": 3214, "ino-": 0, "rss": 81560 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3260, "dispatch_server_request": 0, "handle_client_request": 3257, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 45, "avgtime": 0.001337686, "sum": 0.060195897 } }, "mds_sessions": { "average_load": 3101, "avg_session_uptime": 1025, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 3101 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 5676453, "buffer_anon_items": 1859, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 6975256, "mds_co_items": 32709, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 3, "omap_rd": 48, "omap_wr": 17, "op": 65, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 65, "avgtime": 0.003569187, "sum": 0.231997218 }, "op_pg": 0, "op_r": 36, "op_reply": 65, "op_resend": 0, "op_rmw": 0, "op_send": 65, "op_send_bytes": 8740171, "op_w": 29, "oplen_avg": { "avgcount": 65, "sum": 122 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 7, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 11, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 4651, "get_or_fail_fail": 0, "get_or_fail_success": 4651, "get_started": 0, "get_sum": 1321428, "max": 104857600, "put": 4616, "put_sum": 1312282, "take": 0, "take_sum": 0, "val": 9146, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 65, "put_sum": 8741290, "take": 65, "take_sum": 8741290, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 65, "put_sum": 65, "take": 65, "take_sum": 65, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 4507, "get_or_fail_fail": 0, "get_or_fail_success": 4507, "get_started": 0, "get_sum": 8862623, "max": 3758096384, "put": 11, "put_sum": 8387225, "take": 0, "take_sum": 0, "val": 475398, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:19:58.722 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/45, 0/45 2024-09-11T23:19:59.722 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:59.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2f2f9640 1 Processor -- start 2024-09-11T23:19:59.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2f2f9640 1 -- start start 2024-09-11T23:19:59.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2f2f9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c2815b2b0 0x7f9c280b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2f2f9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c28072090 0x7f9c280b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2f2f9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c280b4e20 con 0x7f9c280b6400 2024-09-11T23:19:59.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2f2f9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9c280b5100 con 0x7f9c28072090 2024-09-11T23:19:59.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2f2f9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9c280b53e0 con 0x7f9c2815b2b0 2024-09-11T23:19:59.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2c894640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c28072090 0x7f9c280b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2c894640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c28072090 0x7f9c280b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39804/0 (socket says 172.21.15.94:39804) 2024-09-11T23:19:59.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.848+0000 7f9c2c894640 1 -- 172.21.15.94:0/2004129581 learned_addr learned my addr 172.21.15.94:0/2004129581 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:59.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2d095640 1 --2- 172.21.15.94:0/2004129581 >> v2:172.21.15.155:3300/0 conn(0x7f9c2815b2b0 0x7f9c280b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2c894640 1 -- 172.21.15.94:0/2004129581 >> v2:172.21.15.155:3300/0 conn(0x7f9c2815b2b0 msgr2=0x7f9c280b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:59.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2c894640 1 --2- 172.21.15.94:0/2004129581 >> v2:172.21.15.155:3300/0 conn(0x7f9c2815b2b0 0x7f9c280b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2c894640 1 -- 172.21.15.94:0/2004129581 >> v1:172.21.15.155:6789/0 conn(0x7f9c280b6400 legacy=0x7f9c2806e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:59.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2c894640 1 -- 172.21.15.94:0/2004129581 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c280b56c0 con 0x7f9c28072090 2024-09-11T23:19:59.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2c894640 1 --2- 172.21.15.94:0/2004129581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c28072090 0x7f9c280b5ec0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9c28071c70 tx=0x7f9c1801eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957b9c1ff6a1e620 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:59.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c1ffff640 1 -- 172.21.15.94:0/2004129581 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180b4070 con 0x7f9c28072090 2024-09-11T23:19:59.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c1ffff640 1 -- 172.21.15.94:0/2004129581 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c180a7be0 con 0x7f9c28072090 2024-09-11T23:19:59.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c1ffff640 1 -- 172.21.15.94:0/2004129581 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180af440 con 0x7f9c28072090 2024-09-11T23:19:59.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2004129581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c28072090 msgr2=0x7f9c280b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2004129581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c28072090 0x7f9c280b5ec0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9c28071c70 tx=0x7f9c1801eaf0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2004129581 shutdown_connections 2024-09-11T23:19:59.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2004129581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c28072090 0x7f9c280b5ec0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2004129581 >> v2:172.21.15.155:3300/0 conn(0x7f9c2815b2b0 0x7f9c280b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2004129581 >> 172.21.15.94:0/2004129581 conn(0x7f9c280b3110 msgr2=0x7f9c280b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:59.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2004129581 shutdown_connections 2024-09-11T23:19:59.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.852+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2004129581 wait complete. 2024-09-11T23:19:59.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 Processor -- start 2024-09-11T23:19:59.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 -- start start 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c28072090 0x7f9c2815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c280b6400 0x7f9c2814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2815b2b0 0x7f9c2814fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2815bea0 con 0x7f9c280b6400 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2806eb90 con 0x7f9c2815b2b0 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2815c020 con 0x7f9c28072090 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c280b6400 0x7f9c2814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c280b6400 0x7f9c2814c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39810/0 (socket says 172.21.15.94:39810) 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 -- 172.21.15.94:0/2611444742 learned_addr learned my addr 172.21.15.94:0/2611444742 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2d095640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c28072090 0x7f9c2815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2d896640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2815b2b0 0x7f9c2814fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 -- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c28072090 msgr2=0x7f9c2815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c28072090 0x7f9c2815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 -- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2815b2b0 msgr2=0x7f9c2814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2815b2b0 0x7f9c2814fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 -- 172.21.15.94:0/2611444742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2815cab0 con 0x7f9c280b6400 2024-09-11T23:19:59.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2d896640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2815b2b0 0x7f9c2814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:59.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2c894640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c280b6400 0x7f9c2814c410 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9c1801c720 tx=0x7f9c1801b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:59.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c1dffb640 1 -- 172.21.15.94:0/2611444742 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180b4030 con 0x7f9c280b6400 2024-09-11T23:19:59.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c1dffb640 1 -- 172.21.15.94:0/2611444742 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c180b6070 con 0x7f9c280b6400 2024-09-11T23:19:59.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c1dffb640 1 -- 172.21.15.94:0/2611444742 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180ad7b0 con 0x7f9c280b6400 2024-09-11T23:19:59.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2815cd90 con 0x7f9c280b6400 2024-09-11T23:19:59.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c28157540 con 0x7f9c280b6400 2024-09-11T23:19:59.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.856+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c280b5ec0 con 0x7f9c280b6400 2024-09-11T23:19:59.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.860+0000 7f9c1dffb640 1 -- 172.21.15.94:0/2611444742 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c180c1060 con 0x7f9c280b6400 2024-09-11T23:19:59.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.860+0000 7f9c1dffb640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c0c067910 0x7f9c0c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.860+0000 7f9c1dffb640 1 -- 172.21.15.94:0/2611444742 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f9c181203c0 con 0x7f9c280b6400 2024-09-11T23:19:59.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.860+0000 7f9c2d095640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c0c067910 0x7f9c0c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.860+0000 7f9c2d095640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c0c067910 0x7f9c0c069dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400a970 tx=0x7f9c24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:59.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:19:59.868+0000 7f9c1dffb640 1 -- 172.21.15.94:0/2611444742 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9c180187a0 con 0x7f9c280b6400 2024-09-11T23:20:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.104+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c2806e530 con 0x7f9c280b6400 2024-09-11T23:20:00.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c1dffb640 1 -- 172.21.15.94:0/2611444742 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f9c180f0d30 con 0x7f9c280b6400 2024-09-11T23:20:00.108 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:00.108 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:00.109 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c0c067910 msgr2=0x7f9c0c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c0c067910 0x7f9c0c069dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400a970 tx=0x7f9c24008040 comp rx=0 tx=0).stop 2024-09-11T23:20:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c280b6400 msgr2=0x7f9c2814c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c280b6400 0x7f9c2814c410 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9c1801c720 tx=0x7f9c1801b890 comp rx=0 tx=0).stop 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 shutdown_connections 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2815b2b0 0x7f9c2814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c0c067910 0x7f9c0c069dd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c280b6400 0x7f9c2814c410 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 --2- 172.21.15.94:0/2611444742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c28072090 0x7f9c2815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 >> 172.21.15.94:0/2611444742 conn(0x7f9c280b3110 msgr2=0x7f9c28075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 shutdown_connections 2024-09-11T23:20:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:00.108+0000 7f9c2f2f9640 1 -- 172.21.15.94:0/2611444742 wait complete. 2024-09-11T23:20:00.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:00.279 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":42,"msgr_send_messages":38,"msgr_recv_bytes":112109,"msgr_send_bytes":492899,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.014896330,"msgr_running_send_time":0.005029252,"msgr_running_recv_time":0.009926873,"msgr_running_fast_dispatch_time":0.001855963,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.008941912,"avgtime":0.000235313},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":108480,"msgr_send_encrypted_bytes":101136},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6056,"msgr_send_messages":12454,"msgr_recv_bytes":2161601,"msgr_send_bytes":9063499,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":0.564002086,"msgr_running_send_time":0.301154181,"msgr_running_recv_time":0.319034043,"msgr_running_fast_dispatch_time":0.002777175,"msgr_send_messages_queue_lat":{"avgcount":12452,"sum":0.275824369,"avgtime":0.000022151},"msgr_handle_ack_lat":{"avgcount":18130,"sum":0.004056592,"avgtime":0.000000223},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":40,"msgr_send_messages":42,"msgr_recv_bytes":17805,"msgr_send_bytes":7526561,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.022724152,"msgr_running_send_time":0.015126216,"msgr_running_recv_time":0.002811462,"msgr_running_fast_dispatch_time":0.004485488,"msgr_send_messages_queue_lat":{"avgcount":41,"sum":0.008251263,"avgtime":0.000201250},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":1434,"complete_latency":{"avgcount":78,"sum":1.401692233,"avgtime":0.017970413}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000096589,"avgtime":0.000024147}},"mds":{"request":3932,"reply":3930,"reply_latency":{"avgcount":3930,"sum":5.367392562,"avgtime":0.001365748},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":3931,"inodes_top":0,"inodes_bottom":3931,"inodes_pin_tail":0,"inodes_pinned":3931,"inodes_expired":0,"inodes_with_caps":3202,"caps":3202,"subtrees":2,"traverse":3938,"traverse_hit":3937,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":3199,"root_rbytes":5655552,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":405,"ceph_cap_op_grant":3467,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":2093,"handle_client_caps_dirty":1963,"handle_client_cap_release":0,"process_request_cap_release":4641},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":720,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":720,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":6020,"evex":0,"evtrm":0,"ev":6023,"evexg":0,"evexd":0,"segadd":8,"segex":0,"segtrm":0,"seg":10,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":16844864,"rdpos":4195244,"jlat":{"avgcount":12,"sum":0.107154086,"avgtime":0.008929507},"replayed":3},"mds_mem":{"ino":3214,"ino+":3214,"ino-":0,"dir":13,"dir+":13,"dir-":0,"dn":3931,"dn+":3931,"dn-":0,"cap":3202,"cap+":3202,"cap-":0,"rss":94820,"heap":248116},"mds_server":{"dispatch_client_request":3935,"dispatch_server_request":0,"handle_client_request":3932,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":720,"sum":1.452645662,"avgtime":0.002017563},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":3702,"average_load":3702,"avg_session_uptime":1030,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":21119511,"buffer_anon_items":5705,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":14380233,"mds_co_items":99050,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":69,"op_send_bytes":12945036,"op_resend":0,"op_reply":69,"op_latency":{"avgcount":69,"sum":0.263996837,"avgtime":0.003826041},"op_inflight":0,"oplen_avg":{"avgcount":69,"sum":127},"op":69,"op_r":36,"op_w":33,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":13,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":8,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":18,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":306,"max":104857600,"get_started":0,"get":6133,"get_sum":1736687,"get_or_fail_fail":0,"get_or_fail_success":6133,"take":0,"take_sum":0,"put":6132,"put_sum":1736381,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":69,"take_sum":12946155,"put":69,"put_sum":12946155,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":69,"take_sum":69,"put":69,"put_sum":69,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":67648,"max":3758096384,"get_started":0,"get":6020,"get_sum":12649177,"get_or_fail_fail":0,"get_or_fail_success":6020,"take":0,"take_sum":0,"put":13,"put_sum":12581529,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:00.280 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 112109, "msgr_recv_encrypted_bytes": 108480, "msgr_recv_messages": 42, "msgr_running_fast_dispatch_time": 0.001855963, "msgr_running_recv_time": 0.009926873, "msgr_running_send_time": 0.005029252, "msgr_running_total_time": 0.01489633, "msgr_send_bytes": 492899, "msgr_send_encrypted_bytes": 101136, "msgr_send_messages": 38, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000235313, "sum": 0.008941912 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 18130, "avgtime": 2.23e-07, "sum": 0.004056592 }, "msgr_recv_bytes": 2161601, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6056, "msgr_running_fast_dispatch_time": 0.002777175, "msgr_running_recv_time": 0.319034043, "msgr_running_send_time": 0.301154181, "msgr_running_total_time": 0.564002086, "msgr_send_bytes": 9063499, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 12454, "msgr_send_messages_queue_lat": { "avgcount": 12452, "avgtime": 2.2151e-05, "sum": 0.275824369 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 17805, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.004485488, "msgr_running_recv_time": 0.002811462, "msgr_running_send_time": 0.015126216, "msgr_running_total_time": 0.022724152, "msgr_send_bytes": 7526561, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 41, "avgtime": 0.00020125, "sum": 0.008251263 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 78, "avgtime": 0.017970413, "sum": 1.401692233 }, "queue_len": 1434 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.4147e-05, "sum": 9.6589e-05 }, "queue_len": 0 }, "mds": { "caps": 3202, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 3467, "ceph_cap_op_revoke": 405, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 2093, "handle_client_caps_dirty": 1963, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 3931, "inodes_bottom": 3931, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 3931, "inodes_top": 0, "inodes_with_caps": 3202, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 4641, "q": 0, "reply": 3930, "reply_latency": { "avgcount": 3930, "avgtime": 0.001365748, "sum": 5.367392562 }, "request": 3932, "root_rbytes": 5655552, "root_rfiles": 3199, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 3938, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 3937, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 720, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 720, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6023, "evadd": 6020, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 12, "avgtime": 0.008929507, "sum": 0.107154086 }, "rdpos": 4195244, "replayed": 3, "seg": 10, "segadd": 8, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 16844864 }, "mds_mem": { "cap": 3202, "cap+": 3202, "cap-": 0, "dir": 13, "dir+": 13, "dir-": 0, "dn": 3931, "dn+": 3931, "dn-": 0, "heap": 248116, "ino": 3214, "ino+": 3214, "ino-": 0, "rss": 94820 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3935, "dispatch_server_request": 0, "handle_client_request": 3932, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 720, "avgtime": 0.002017563, "sum": 1.452645662 } }, "mds_sessions": { "average_load": 3702, "avg_session_uptime": 1030, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 3702 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 21119511, "buffer_anon_items": 5705, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 14380233, "mds_co_items": 99050, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 4, "omap_rd": 48, "omap_wr": 18, "op": 69, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 69, "avgtime": 0.003826041, "sum": 0.263996837 }, "op_pg": 0, "op_r": 36, "op_reply": 69, "op_resend": 0, "op_rmw": 0, "op_send": 69, "op_send_bytes": 12945036, "op_w": 33, "oplen_avg": { "avgcount": 69, "sum": 127 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 8, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 13, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 6133, "get_or_fail_fail": 0, "get_or_fail_success": 6133, "get_started": 0, "get_sum": 1736687, "max": 104857600, "put": 6132, "put_sum": 1736381, "take": 0, "take_sum": 0, "val": 306, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 69, "put_sum": 12946155, "take": 69, "take_sum": 12946155, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 69, "put_sum": 69, "take": 69, "take_sum": 69, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 6020, "get_or_fail_fail": 0, "get_or_fail_success": 6020, "get_started": 0, "get_sum": 12649177, "max": 3758096384, "put": 13, "put_sum": 12581529, "take": 0, "take_sum": 0, "val": 67648, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:00.280 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/720, 0/720 2024-09-11T23:20:01.282 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:01.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11cbe30640 1 Processor -- start 2024-09-11T23:20:01.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11cbe30640 1 -- start start 2024-09-11T23:20:01.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11cbe30640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11c415ea40 0x7f11c406c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11cbe30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c406c9b0 0x7f11c40cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11cbe30640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c40b6890 con 0x7f11c415e660 2024-09-11T23:20:01.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11cbe30640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f11c406ce20 con 0x7f11c415ea40 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11cbe30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f11c40b6b70 con 0x7f11c406c9b0 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c9bcc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f11c415e660 0x7f11c40b33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46806/0 (socket says 172.21.15.94:46806) 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c9bcc640 1 -- 172.21.15.94:0/3047997343 learned_addr learned my addr 172.21.15.94:0/3047997343 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c93cb640 1 --2- 172.21.15.94:0/3047997343 >> v2:172.21.15.155:3300/0 conn(0x7f11c415ea40 0x7f11c406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11ca3cd640 1 --2- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c406c9b0 0x7f11c40cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c8bca640 1 -- 172.21.15.94:0/3047997343 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872565978 0 0) 0x7f11c40b6890 con 0x7f11c415e660 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c8bca640 1 -- 172.21.15.94:0/3047997343 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11b0003530 con 0x7f11c415e660 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c93cb640 1 -- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c406c9b0 msgr2=0x7f11c40cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c93cb640 1 --2- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c406c9b0 0x7f11c40cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c93cb640 1 -- 172.21.15.94:0/3047997343 >> v1:172.21.15.94:6789/0 conn(0x7f11c415e660 legacy=0x7f11c40b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.396+0000 7f11c93cb640 1 -- 172.21.15.94:0/3047997343 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c40b6e50 con 0x7f11c415ea40 2024-09-11T23:20:01.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11c93cb640 1 --2- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c406c470 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097c0 tx=0x7f11b401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f661bf233d241fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:01.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11c8bca640 1 -- 172.21.15.94:0/3047997343 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b40a7070 con 0x7f11c415ea40 2024-09-11T23:20:01.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11c8bca640 1 -- 172.21.15.94:0/3047997343 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b40b0070 con 0x7f11c415ea40 2024-09-11T23:20:01.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11c8bca640 1 -- 172.21.15.94:0/3047997343 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b40ab870 con 0x7f11c415ea40 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 -- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 msgr2=0x7f11c406c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 --2- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c406c470 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097c0 tx=0x7f11b401c470 comp rx=0 tx=0).stop 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 -- 172.21.15.94:0/3047997343 shutdown_connections 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 --2- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c406c9b0 0x7f11c40cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 --2- 172.21.15.94:0/3047997343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c406c470 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 -- 172.21.15.94:0/3047997343 >> 172.21.15.94:0/3047997343 conn(0x7f11c40b7860 msgr2=0x7f11c40b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 -- 172.21.15.94:0/3047997343 shutdown_connections 2024-09-11T23:20:01.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.400+0000 7f11cbe30640 1 -- 172.21.15.94:0/3047997343 wait complete. 2024-09-11T23:20:01.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 Processor -- start 2024-09-11T23:20:01.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 -- start start 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11c406c9b0 0x7f11c4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c415e660 0x7f11c4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c414f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f11c406d2b0 con 0x7f11c406c9b0 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f11c406d130 con 0x7f11c415ea40 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f11c40cc510 con 0x7f11c415e660 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11c406c9b0 0x7f11c4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11c406c9b0 0x7f11c4148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39822/0 (socket says 172.21.15.94:39822) 2024-09-11T23:20:01.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 -- 172.21.15.94:0/2304336661 learned_addr learned my addr 172.21.15.94:0/2304336661 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11ca3cd640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c414f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c93cb640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c415e660 0x7f11c4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 -- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c415e660 msgr2=0x7f11c4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c415e660 0x7f11c4152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 -- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 msgr2=0x7f11c414f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c414f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 -- 172.21.15.94:0/2304336661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c4151820 con 0x7f11c406c9b0 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11ca3cd640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c414f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11c9bcc640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11c406c9b0 0x7f11c4148c70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f11c000c480 tx=0x7f11c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11ba7fc640 1 -- 172.21.15.94:0/2304336661 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0017070 con 0x7f11c406c9b0 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c4151b00 con 0x7f11c406c9b0 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11ba7fc640 1 -- 172.21.15.94:0/2304336661 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c0005cf0 con 0x7f11c406c9b0 2024-09-11T23:20:01.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11ba7fc640 1 -- 172.21.15.94:0/2304336661 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0007290 con 0x7f11c406c9b0 2024-09-11T23:20:01.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c41520c0 con 0x7f11c406c9b0 2024-09-11T23:20:01.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c40cc920 con 0x7f11c406c9b0 2024-09-11T23:20:01.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.404+0000 7f11ba7fc640 1 -- 172.21.15.94:0/2304336661 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f11c001a070 con 0x7f11c406c9b0 2024-09-11T23:20:01.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.408+0000 7f11ba7fc640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11a80678c0 0x7f11a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.408+0000 7f11ba7fc640 1 -- 172.21.15.94:0/2304336661 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f11c00852f0 con 0x7f11c406c9b0 2024-09-11T23:20:01.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.408+0000 7f11c93cb640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11a80678c0 0x7f11a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.408+0000 7f11c93cb640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11a80678c0 0x7f11a8069d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f11b40af000 tx=0x7f11b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:01.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.412+0000 7f11ba7fc640 1 -- 172.21.15.94:0/2304336661 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f11c0055c20 con 0x7f11c406c9b0 2024-09-11T23:20:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.664+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c40704e0 con 0x7f11c406c9b0 2024-09-11T23:20:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11ba7fc640 1 -- 172.21.15.94:0/2304336661 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f11c0055520 con 0x7f11c406c9b0 2024-09-11T23:20:01.668 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:01.669 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:01.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11a80678c0 msgr2=0x7f11a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11a80678c0 0x7f11a8069d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f11b40af000 tx=0x7f11b4008040 comp rx=0 tx=0).stop 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11c406c9b0 msgr2=0x7f11c4148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11c406c9b0 0x7f11c4148c70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f11c000c480 tx=0x7f11c000c940 comp rx=0 tx=0).stop 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 shutdown_connections 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c415ea40 0x7f11c414f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c415e660 0x7f11c4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f11a80678c0 0x7f11a8069d80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 --2- 172.21.15.94:0/2304336661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11c406c9b0 0x7f11c4148c70 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 >> 172.21.15.94:0/2304336661 conn(0x7f11c40b7860 msgr2=0x7f11c4070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 shutdown_connections 2024-09-11T23:20:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:01.668+0000 7f11cbe30640 1 -- 172.21.15.94:0/2304336661 wait complete. 2024-09-11T23:20:01.687 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:01.829 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":55,"msgr_send_messages":52,"msgr_recv_bytes":115581,"msgr_send_bytes":512090,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.015867373,"msgr_running_send_time":0.005438884,"msgr_running_recv_time":0.010168477,"msgr_running_fast_dispatch_time":0.002118064,"msgr_send_messages_queue_lat":{"avgcount":52,"sum":0.009214445,"avgtime":0.000177200},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":108752,"msgr_send_encrypted_bytes":103584},"AsyncMessenger::Worker-1":{"msgr_recv_messages":7372,"msgr_send_messages":15422,"msgr_recv_bytes":2646878,"msgr_send_bytes":11937023,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":0.674180532,"msgr_running_send_time":0.367159539,"msgr_running_recv_time":0.367306708,"msgr_running_fast_dispatch_time":0.004028369,"msgr_send_messages_queue_lat":{"avgcount":15420,"sum":0.321465360,"avgtime":0.000020847},"msgr_handle_ack_lat":{"avgcount":21673,"sum":0.004656889,"avgtime":0.000000214},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":80,"msgr_send_messages":82,"msgr_recv_bytes":58666,"msgr_send_bytes":7570302,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.025222970,"msgr_running_send_time":0.016070701,"msgr_running_recv_time":0.003434910,"msgr_running_fast_dispatch_time":0.005267199,"msgr_send_messages_queue_lat":{"avgcount":81,"sum":0.009282454,"avgtime":0.000114598},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":1136,"complete_latency":{"avgcount":81,"sum":2.793449769,"avgtime":0.034487034}},"finisher-PurgeQueue":{"queue_len":157,"complete_latency":{"avgcount":101,"sum":0.181832421,"avgtime":0.001800321}},"mds":{"request":4356,"reply":4354,"reply_latency":{"avgcount":4354,"sum":6.410389925,"avgtime":0.001472299},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":4355,"inodes_top":0,"inodes_bottom":4355,"inodes_pin_tail":0,"inodes_pinned":4355,"inodes_expired":0,"inodes_with_caps":2897,"caps":2897,"subtrees":2,"traverse":4362,"traverse_hit":4361,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":2822,"root_rbytes":8591360,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":531,"ceph_cap_op_grant":4472,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":2848,"handle_client_caps_dirty":2663,"handle_client_cap_release":2,"process_request_cap_release":5489},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":972,"num_strays_delayed":0,"num_strays_enqueuing":133,"strays_created":1144,"strays_enqueued":172,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":7373,"evex":0,"evtrm":0,"ev":7376,"evexg":0,"evexd":0,"segadd":9,"segex":0,"segtrm":0,"seg":11,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":19765795,"rdpos":4195244,"jlat":{"avgcount":14,"sum":1.066781766,"avgtime":0.076198697},"replayed":3},"mds_mem":{"ino":3214,"ino+":3214,"ino-":0,"dir":13,"dir+":13,"dir-":0,"dn":4355,"dn+":4355,"dn-":0,"cap":2897,"cap+":3202,"cap-":305,"rss":98512,"heap":248116},"mds_server":{"dispatch_client_request":4359,"dispatch_server_request":0,"handle_client_request":4356,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":1144,"sum":2.495643025,"avgtime":0.002181506},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":4068,"average_load":4068,"avg_session_uptime":1030,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":21119511,"buffer_anon_items":5705,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":14380233,"mds_co_items":99050,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":134,"op_send_bytes":14887356,"op_resend":0,"op_reply":134,"op_latency":{"avgcount":134,"sum":0.455994545,"avgtime":0.003402944},"op_inflight":0,"oplen_avg":{"avgcount":134,"sum":196},"op":134,"op_r":40,"op_w":94,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":12,"osdop_write":18,"osdop_writefull":3,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":60,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":22,"omap_rd":48,"omap_del":6},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":1,"pq_executing_ops_high_water":6,"pq_executing":1,"pq_executing_high_water":6,"pq_executed_ops":45,"pq_executed":45,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":31505,"max":104857600,"get_started":0,"get":7502,"get_sum":2143035,"get_or_fail_fail":0,"get_or_fail_success":7502,"take":0,"take_sum":0,"put":7381,"put_sum":2111530,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":134,"take_sum":14919280,"put":134,"put_sum":14919280,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":134,"take_sum":134,"put":134,"put_sum":134,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":305,"get_sum":30805,"get_or_fail_fail":0,"get_or_fail_success":305,"take":0,"take_sum":0,"put":4,"put_sum":30805,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":1089939,"max":3758096384,"get_started":0,"get":7373,"get_sum":15570108,"get_or_fail_fail":0,"get_or_fail_success":7373,"take":0,"take_sum":0,"put":14,"put_sum":14480169,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:01.830 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 115581, "msgr_recv_encrypted_bytes": 108752, "msgr_recv_messages": 55, "msgr_running_fast_dispatch_time": 0.002118064, "msgr_running_recv_time": 0.010168477, "msgr_running_send_time": 0.005438884, "msgr_running_total_time": 0.015867373, "msgr_send_bytes": 512090, "msgr_send_encrypted_bytes": 103584, "msgr_send_messages": 52, "msgr_send_messages_queue_lat": { "avgcount": 52, "avgtime": 0.0001772, "sum": 0.009214445 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 21673, "avgtime": 2.14e-07, "sum": 0.004656889 }, "msgr_recv_bytes": 2646878, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 7372, "msgr_running_fast_dispatch_time": 0.004028369, "msgr_running_recv_time": 0.367306708, "msgr_running_send_time": 0.367159539, "msgr_running_total_time": 0.674180532, "msgr_send_bytes": 11937023, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 15422, "msgr_send_messages_queue_lat": { "avgcount": 15420, "avgtime": 2.0847e-05, "sum": 0.32146536 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 58666, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 80, "msgr_running_fast_dispatch_time": 0.005267199, "msgr_running_recv_time": 0.00343491, "msgr_running_send_time": 0.016070701, "msgr_running_total_time": 0.02522297, "msgr_send_bytes": 7570302, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 82, "msgr_send_messages_queue_lat": { "avgcount": 81, "avgtime": 0.000114598, "sum": 0.009282454 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 81, "avgtime": 0.034487034, "sum": 2.793449769 }, "queue_len": 1136 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 101, "avgtime": 0.001800321, "sum": 0.181832421 }, "queue_len": 157 }, "mds": { "caps": 2897, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 4472, "ceph_cap_op_revoke": 531, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 2, "handle_client_caps": 2848, "handle_client_caps_dirty": 2663, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4355, "inodes_bottom": 4355, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4355, "inodes_top": 0, "inodes_with_caps": 2897, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 5489, "q": 0, "reply": 4354, "reply_latency": { "avgcount": 4354, "avgtime": 0.001472299, "sum": 6.410389925 }, "request": 4356, "root_rbytes": 8591360, "root_rfiles": 2822, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4362, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4361, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 972, "num_strays_delayed": 0, "num_strays_enqueuing": 133, "recovery_completed": 0, "recovery_started": 0, "strays_created": 1144, "strays_enqueued": 172, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7376, "evadd": 7373, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 14, "avgtime": 0.076198697, "sum": 1.066781766 }, "rdpos": 4195244, "replayed": 3, "seg": 11, "segadd": 9, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 19765795 }, "mds_mem": { "cap": 2897, "cap+": 3202, "cap-": 305, "dir": 13, "dir+": 13, "dir-": 0, "dn": 4355, "dn+": 4355, "dn-": 0, "heap": 248116, "ino": 3214, "ino+": 3214, "ino-": 0, "rss": 98512 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4359, "dispatch_server_request": 0, "handle_client_request": 4356, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 1144, "avgtime": 0.002181506, "sum": 2.495643025 } }, "mds_sessions": { "average_load": 4068, "avg_session_uptime": 1030, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 4068 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 21119511, "buffer_anon_items": 5705, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 14380233, "mds_co_items": 99050, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 6, "omap_rd": 48, "omap_wr": 22, "op": 134, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 134, "avgtime": 0.003402944, "sum": 0.455994545 }, "op_pg": 0, "op_r": 40, "op_reply": 134, "op_resend": 0, "op_rmw": 0, "op_send": 134, "op_send_bytes": 14887356, "op_w": 94, "oplen_avg": { "avgcount": 134, "sum": 196 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 60, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 12, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 18, "osdop_writefull": 3, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 45, "pq_executed_ops": 45, "pq_executing": 1, "pq_executing_high_water": 6, "pq_executing_ops": 1, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 7502, "get_or_fail_fail": 0, "get_or_fail_success": 7502, "get_started": 0, "get_sum": 2143035, "max": 104857600, "put": 7381, "put_sum": 2111530, "take": 0, "take_sum": 0, "val": 31505, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 134, "put_sum": 14919280, "take": 134, "take_sum": 14919280, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 134, "put_sum": 134, "take": 134, "take_sum": 134, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 305, "get_or_fail_fail": 0, "get_or_fail_success": 305, "get_started": 0, "get_sum": 30805, "max": 3758096384, "put": 4, "put_sum": 30805, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 7373, "get_or_fail_fail": 0, "get_or_fail_success": 7373, "get_started": 0, "get_sum": 15570108, "max": 3758096384, "put": 14, "put_sum": 14480169, "take": 0, "take_sum": 0, "val": 1089939, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:01.831 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 1/972, 45/1144 2024-09-11T23:20:02.832 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:02.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294e4bc640 1 Processor -- start 2024-09-11T23:20:02.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294e4bc640 1 -- start start 2024-09-11T23:20:02.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294e4bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294815c6b0 0x7f29480b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294e4bc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f29480b1720 0x7f29480b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294e4bc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29480b6aa0 con 0x7f294815c2d0 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294e4bc640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f29480b67c0 con 0x7f29480b1720 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294e4bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29480b1d60 con 0x7f294815c6b0 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294ca59640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f29480b1720 0x7f29480b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294ca59640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f29480b1720 0x7f29480b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39838/0 (socket says 172.21.15.94:39838) 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294ca59640 1 -- 172.21.15.94:0/3161114003 learned_addr learned my addr 172.21.15.94:0/3161114003 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f29477fe640 1 --2- 172.21.15.94:0/3161114003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294815c6b0 0x7f29480b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294ca59640 1 -- 172.21.15.94:0/3161114003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294815c6b0 msgr2=0x7f29480b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294ca59640 1 --2- 172.21.15.94:0/3161114003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294815c6b0 0x7f29480b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294ca59640 1 -- 172.21.15.94:0/3161114003 >> v1:172.21.15.155:6789/0 conn(0x7f294815c2d0 legacy=0x7f29480afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:02.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.972+0000 7f294ca59640 1 -- 172.21.15.94:0/3161114003 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29480b2040 con 0x7f29480b1720 2024-09-11T23:20:02.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294ca59640 1 --2- 172.21.15.94:0/3161114003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29480b1720 0x7f29480b2840 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f29480ce560 tx=0x7f294001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fb0b0c6538f15d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:02.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f2946ffd640 1 -- 172.21.15.94:0/3161114003 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29400a5820 con 0x7f29480b1720 2024-09-11T23:20:02.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f2946ffd640 1 -- 172.21.15.94:0/3161114003 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29400a59c0 con 0x7f29480b1720 2024-09-11T23:20:02.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f2946ffd640 1 -- 172.21.15.94:0/3161114003 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29400a5d90 con 0x7f29480b1720 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 -- 172.21.15.94:0/3161114003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29480b1720 msgr2=0x7f29480b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 --2- 172.21.15.94:0/3161114003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29480b1720 0x7f29480b2840 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f29480ce560 tx=0x7f294001c980 comp rx=0 tx=0).stop 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 -- 172.21.15.94:0/3161114003 shutdown_connections 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 --2- 172.21.15.94:0/3161114003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29480b1720 0x7f29480b2840 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 --2- 172.21.15.94:0/3161114003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294815c6b0 0x7f29480b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 -- 172.21.15.94:0/3161114003 >> 172.21.15.94:0/3161114003 conn(0x7f29480b7860 msgr2=0x7f29480b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 -- 172.21.15.94:0/3161114003 shutdown_connections 2024-09-11T23:20:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 -- 172.21.15.94:0/3161114003 wait complete. 2024-09-11T23:20:02.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 Processor -- start 2024-09-11T23:20:02.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.976+0000 7f294e4bc640 1 -- start start 2024-09-11T23:20:02.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29480b1720 0x7f2948152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f294815c2d0 0x7f294814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294814ce90 0x7f294806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f29480b3960 con 0x7f294815c2d0 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29480b37e0 con 0x7f294814ce90 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29480b3ae0 con 0x7f29480b1720 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f294815c2d0 0x7f294814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f294815c2d0 0x7f294814c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39842/0 (socket says 172.21.15.94:39842) 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 -- 172.21.15.94:0/3050259342 learned_addr learned my addr 172.21.15.94:0/3050259342 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f2947fff640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29480b1720 0x7f2948152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294ca59640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294814ce90 0x7f294806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 -- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29480b1720 msgr2=0x7f2948152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29480b1720 0x7f2948152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 -- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294814ce90 msgr2=0x7f294806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294814ce90 0x7f294806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 -- 172.21.15.94:0/3050259342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294814b610 con 0x7f294815c2d0 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f2947fff640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29480b1720 0x7f2948152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f29477fe640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f294815c2d0 0x7f294814c950 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f293c00d830 tx=0x7f293c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f2944ff9640 1 -- 172.21.15.94:0/3050259342 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c00b6c0 con 0x7f294815c2d0 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f2944ff9640 1 -- 172.21.15.94:0/3050259342 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293c019070 con 0x7f294815c2d0 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 -- 172.21.15.94:0/3050259342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294814b8b0 con 0x7f294815c2d0 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f2944ff9640 1 -- 172.21.15.94:0/3050259342 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c00ba60 con 0x7f294815c2d0 2024-09-11T23:20:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f294e4bc640 1 -- 172.21.15.94:0/3050259342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294814be70 con 0x7f294815c2d0 2024-09-11T23:20:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29200052a0 con 0x7f294815c2d0 2024-09-11T23:20:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f2944ff9640 1 -- 172.21.15.94:0/3050259342 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f293c01e460 con 0x7f294815c2d0 2024-09-11T23:20:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.980+0000 7f2944ff9640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29340678c0 0x7f2934069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.984+0000 7f2944ff9640 1 -- 172.21.15.94:0/3050259342 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f293c0865b0 con 0x7f294815c2d0 2024-09-11T23:20:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.984+0000 7f2947fff640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29340678c0 0x7f2934069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.984+0000 7f2947fff640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29340678c0 0x7f2934069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2938003ec0 tx=0x7f2938009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:02.992+0000 7f2944ff9640 1 -- 172.21.15.94:0/3050259342 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f293c056ed0 con 0x7f294815c2d0 2024-09-11T23:20:03.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.280+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2920005860 con 0x7f294815c2d0 2024-09-11T23:20:03.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.280+0000 7f2944ff9640 1 -- 172.21.15.94:0/3050259342 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f293c0567d0 con 0x7f294815c2d0 2024-09-11T23:20:03.281 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:03.281 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29340678c0 msgr2=0x7f2934069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29340678c0 0x7f2934069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2938003ec0 tx=0x7f2938009040 comp rx=0 tx=0).stop 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f294815c2d0 msgr2=0x7f294814c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f294815c2d0 0x7f294814c950 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f293c00d830 tx=0x7f293c00dcf0 comp rx=0 tx=0).stop 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 shutdown_connections 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294814ce90 0x7f294806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f29340678c0 0x7f2934069d80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f294815c2d0 0x7f294814c950 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 --2- 172.21.15.94:0/3050259342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29480b1720 0x7f2948152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 >> 172.21.15.94:0/3050259342 conn(0x7f29480b7860 msgr2=0x7f2948159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 shutdown_connections 2024-09-11T23:20:03.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:03.284+0000 7f292e7fc640 1 -- 172.21.15.94:0/3050259342 wait complete. 2024-09-11T23:20:03.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:03.456 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":178,"msgr_send_messages":175,"msgr_recv_bytes":146861,"msgr_send_bytes":557135,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.024826298,"msgr_running_send_time":0.008429396,"msgr_running_recv_time":0.012327670,"msgr_running_fast_dispatch_time":0.004961880,"msgr_send_messages_queue_lat":{"avgcount":175,"sum":0.014199622,"avgtime":0.000081140},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":108752,"msgr_send_encrypted_bytes":103584},"AsyncMessenger::Worker-1":{"msgr_recv_messages":8249,"msgr_send_messages":17888,"msgr_recv_bytes":2967770,"msgr_send_bytes":15102984,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":0.814385579,"msgr_running_send_time":0.453908065,"msgr_running_recv_time":0.416415559,"msgr_running_fast_dispatch_time":0.010387226,"msgr_send_messages_queue_lat":{"avgcount":17886,"sum":0.411819209,"avgtime":0.000023024},"msgr_handle_ack_lat":{"avgcount":24172,"sum":0.005537243,"avgtime":0.000000229},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":417,"msgr_send_messages":419,"msgr_recv_bytes":181586,"msgr_send_bytes":7717486,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.051013489,"msgr_running_send_time":0.025806492,"msgr_running_recv_time":0.008822685,"msgr_running_fast_dispatch_time":0.013749687,"msgr_send_messages_queue_lat":{"avgcount":418,"sum":0.024538933,"avgtime":0.000058705},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":1060,"complete_latency":{"avgcount":84,"sum":4.094999828,"avgtime":0.048749997}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":1127,"sum":0.801834272,"avgtime":0.000711476}},"mds":{"request":4867,"reply":4864,"reply_latency":{"avgcount":4864,"sum":7.907452413,"avgtime":0.001625709},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":4560,"inodes_top":0,"inodes_bottom":4560,"inodes_pin_tail":0,"inodes_pinned":4560,"inodes_expired":0,"inodes_with_caps":2527,"caps":2527,"subtrees":2,"traverse":4873,"traverse_hit":4871,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":2217,"root_rbytes":12428288,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":562,"ceph_cap_op_grant":4998,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3151,"handle_client_caps_dirty":2949,"handle_client_cap_release":3,"process_request_cap_release":6511},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":979,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":1654,"strays_enqueued":675,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":8691,"evex":0,"evtrm":0,"ev":8694,"evexg":0,"evexd":0,"segadd":10,"segex":0,"segtrm":0,"seg":12,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":22280698,"rdpos":4195244,"jlat":{"avgcount":15,"sum":1.085661595,"avgtime":0.072377439},"replayed":3},"mds_mem":{"ino":2909,"ino+":3214,"ino-":305,"dir":13,"dir+":13,"dir-":0,"dn":4560,"dn+":4865,"dn-":305,"cap":2527,"cap+":3202,"cap-":675,"rss":98512,"heap":248116},"mds_server":{"dispatch_client_request":4870,"dispatch_server_request":0,"handle_client_request":4867,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":1654,"sum":3.992705513,"avgtime":0.002413969},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":4486,"average_load":4486,"avg_session_uptime":1030,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":21119511,"buffer_anon_items":5705,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":14380233,"mds_co_items":99050,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":775,"op_send_bytes":17225483,"op_resend":0,"op_reply":775,"op_latency":{"avgcount":775,"sum":2.007976111,"avgtime":0.002590936},"op_inflight":0,"oplen_avg":{"avgcount":775,"sum":838},"op":775,"op_r":43,"op_w":732,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":15,"osdop_write":23,"osdop_writefull":5,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":690,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":23,"omap_rd":48,"omap_del":7},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":675,"pq_executed":675,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":305,"max":104857600,"get_started":0,"get":8839,"get_sum":2497797,"get_or_fail_fail":0,"get_or_fail_success":8839,"take":0,"take_sum":0,"put":8838,"put_sum":2497492,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":775,"take_sum":17294777,"put":775,"put_sum":17294777,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":775,"take_sum":775,"put":775,"put_sum":775,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":675,"get_sum":68175,"get_or_fail_fail":0,"get_or_fail_success":675,"take":0,"take_sum":0,"put":7,"put_sum":68175,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":1309178,"max":3758096384,"get_started":0,"get":8691,"get_sum":18085011,"get_or_fail_fail":0,"get_or_fail_success":8691,"take":0,"take_sum":0,"put":16,"put_sum":16775833,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:03.458 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 146861, "msgr_recv_encrypted_bytes": 108752, "msgr_recv_messages": 178, "msgr_running_fast_dispatch_time": 0.00496188, "msgr_running_recv_time": 0.01232767, "msgr_running_send_time": 0.008429396, "msgr_running_total_time": 0.024826298, "msgr_send_bytes": 557135, "msgr_send_encrypted_bytes": 103584, "msgr_send_messages": 175, "msgr_send_messages_queue_lat": { "avgcount": 175, "avgtime": 8.114e-05, "sum": 0.014199622 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 24172, "avgtime": 2.29e-07, "sum": 0.005537243 }, "msgr_recv_bytes": 2967770, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 8249, "msgr_running_fast_dispatch_time": 0.010387226, "msgr_running_recv_time": 0.416415559, "msgr_running_send_time": 0.453908065, "msgr_running_total_time": 0.814385579, "msgr_send_bytes": 15102984, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 17888, "msgr_send_messages_queue_lat": { "avgcount": 17886, "avgtime": 2.3024e-05, "sum": 0.411819209 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 181586, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 417, "msgr_running_fast_dispatch_time": 0.013749687, "msgr_running_recv_time": 0.008822685, "msgr_running_send_time": 0.025806492, "msgr_running_total_time": 0.051013489, "msgr_send_bytes": 7717486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 419, "msgr_send_messages_queue_lat": { "avgcount": 418, "avgtime": 5.8705e-05, "sum": 0.024538933 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 84, "avgtime": 0.048749997, "sum": 4.094999828 }, "queue_len": 1060 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 1127, "avgtime": 0.000711476, "sum": 0.801834272 }, "queue_len": 0 }, "mds": { "caps": 2527, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 4998, "ceph_cap_op_revoke": 562, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 3, "handle_client_caps": 3151, "handle_client_caps_dirty": 2949, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4560, "inodes_bottom": 4560, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4560, "inodes_top": 0, "inodes_with_caps": 2527, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 6511, "q": 0, "reply": 4864, "reply_latency": { "avgcount": 4864, "avgtime": 0.001625709, "sum": 7.907452413 }, "request": 4867, "root_rbytes": 12428288, "root_rfiles": 2217, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4873, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4871, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 979, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 1654, "strays_enqueued": 675, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8694, "evadd": 8691, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 15, "avgtime": 0.072377439, "sum": 1.085661595 }, "rdpos": 4195244, "replayed": 3, "seg": 12, "segadd": 10, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 22280698 }, "mds_mem": { "cap": 2527, "cap+": 3202, "cap-": 675, "dir": 13, "dir+": 13, "dir-": 0, "dn": 4560, "dn+": 4865, "dn-": 305, "heap": 248116, "ino": 2909, "ino+": 3214, "ino-": 305, "rss": 98512 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4870, "dispatch_server_request": 0, "handle_client_request": 4867, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 1654, "avgtime": 0.002413969, "sum": 3.992705513 } }, "mds_sessions": { "average_load": 4486, "avg_session_uptime": 1030, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 4486 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 21119511, "buffer_anon_items": 5705, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 14380233, "mds_co_items": 99050, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 7, "omap_rd": 48, "omap_wr": 23, "op": 775, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 775, "avgtime": 0.002590936, "sum": 2.007976111 }, "op_pg": 0, "op_r": 43, "op_reply": 775, "op_resend": 0, "op_rmw": 0, "op_send": 775, "op_send_bytes": 17225483, "op_w": 732, "oplen_avg": { "avgcount": 775, "sum": 838 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 690, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 15, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 23, "osdop_writefull": 5, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 675, "pq_executed_ops": 675, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 8839, "get_or_fail_fail": 0, "get_or_fail_success": 8839, "get_started": 0, "get_sum": 2497797, "max": 104857600, "put": 8838, "put_sum": 2497492, "take": 0, "take_sum": 0, "val": 305, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 775, "put_sum": 17294777, "take": 775, "take_sum": 17294777, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 775, "put_sum": 775, "take": 775, "take_sum": 775, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 675, "get_or_fail_fail": 0, "get_or_fail_success": 675, "get_started": 0, "get_sum": 68175, "max": 3758096384, "put": 7, "put_sum": 68175, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 8691, "get_or_fail_fail": 0, "get_or_fail_success": 8691, "get_started": 0, "get_sum": 18085011, "max": 3758096384, "put": 16, "put_sum": 16775833, "take": 0, "take_sum": 0, "val": 1309178, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:03.458 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/979, 675/1654 2024-09-11T23:20:04.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:04.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f34527af640 1 Processor -- start 2024-09-11T23:20:04.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f34527af640 1 -- start start 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f34527af640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f344c0d1960 0x7f344c0b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f34527af640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f344c0b6400 0x7f344c166020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f34527af640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344c0b6810 con 0x7f344c15c380 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f34527af640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f344c0cf8b0 con 0x7f344c0d1960 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f34527af640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f344c0cfb90 con 0x7f344c0b6400 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f344b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f344c0d1960 0x7f344c0b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f344b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f344c0d1960 0x7f344c0b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39858/0 (socket says 172.21.15.94:39858) 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f344b7fe640 1 -- 172.21.15.94:0/3371519772 learned_addr learned my addr 172.21.15.94:0/3371519772 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f344b7fe640 1 -- 172.21.15.94:0/3371519772 >> v2:172.21.15.155:3300/0 conn(0x7f344c0b6400 msgr2=0x7f344c166020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f344b7fe640 1 --2- 172.21.15.94:0/3371519772 >> v2:172.21.15.155:3300/0 conn(0x7f344c0b6400 0x7f344c166020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f344b7fe640 1 -- 172.21.15.94:0/3371519772 >> v1:172.21.15.155:6789/0 conn(0x7f344c15c380 legacy=0x7f344c0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.612+0000 7f344b7fe640 1 -- 172.21.15.94:0/3371519772 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c0cfe70 con 0x7f344c0d1960 2024-09-11T23:20:04.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f344b7fe640 1 --2- 172.21.15.94:0/3371519772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0d1960 0x7f344c0b5ec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f344c0724e0 tx=0x7f344001c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7521a34312463ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:04.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f344affd640 1 -- 172.21.15.94:0/3371519772 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400b0070 con 0x7f344c0d1960 2024-09-11T23:20:04.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f344affd640 1 -- 172.21.15.94:0/3371519772 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34400ab600 con 0x7f344c0d1960 2024-09-11T23:20:04.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f344affd640 1 -- 172.21.15.94:0/3371519772 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400ab9d0 con 0x7f344c0d1960 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 -- 172.21.15.94:0/3371519772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0d1960 msgr2=0x7f344c0b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 --2- 172.21.15.94:0/3371519772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0d1960 0x7f344c0b5ec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f344c0724e0 tx=0x7f344001c2d0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 -- 172.21.15.94:0/3371519772 shutdown_connections 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 --2- 172.21.15.94:0/3371519772 >> v2:172.21.15.155:3300/0 conn(0x7f344c0b6400 0x7f344c166020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 --2- 172.21.15.94:0/3371519772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0d1960 0x7f344c0b5ec0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 -- 172.21.15.94:0/3371519772 >> 172.21.15.94:0/3371519772 conn(0x7f344c073620 msgr2=0x7f344c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 -- 172.21.15.94:0/3371519772 shutdown_connections 2024-09-11T23:20:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.616+0000 7f34527af640 1 -- 172.21.15.94:0/3371519772 wait complete. 2024-09-11T23:20:04.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 Processor -- start 2024-09-11T23:20:04.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 -- start start 2024-09-11T23:20:04.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0b6400 0x7f344c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f344c0d1960 0x7f344c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f344c15c380 0x7f344c06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f344c15c760 con 0x7f344c0b6400 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f344c0cf500 con 0x7f344c0d1960 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f344c155a10 con 0x7f344c15c380 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0b6400 0x7f344c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0b6400 0x7f344c0c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39866/0 (socket says 172.21.15.94:39866) 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 -- 172.21.15.94:0/3462480693 learned_addr learned my addr 172.21.15.94:0/3462480693 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f3450d4c640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f344c15c380 0x7f344c06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344b7fe640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f344c0d1960 0x7f344c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 -- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f344c15c380 msgr2=0x7f344c06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f344c15c380 0x7f344c06c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 -- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f344c0d1960 msgr2=0x7f344c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f344c0d1960 0x7f344c1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 -- 172.21.15.94:0/3462480693 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c155f10 con 0x7f344c0b6400 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f344bfff640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0b6400 0x7f344c0c7c30 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f343c00b3e0 tx=0x7f343c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f3448ff9640 1 -- 172.21.15.94:0/3462480693 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c015020 con 0x7f344c0b6400 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f3448ff9640 1 -- 172.21.15.94:0/3462480693 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343c011850 con 0x7f344c0b6400 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f3448ff9640 1 -- 172.21.15.94:0/3462480693 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c011c40 con 0x7f344c0b6400 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344c0b1bb0 con 0x7f344c0b6400 2024-09-11T23:20:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.620+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344c0b2170 con 0x7f344c0b6400 2024-09-11T23:20:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.624+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344c0b5ec0 con 0x7f344c0b6400 2024-09-11T23:20:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.624+0000 7f3448ff9640 1 -- 172.21.15.94:0/3462480693 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f343c018020 con 0x7f344c0b6400 2024-09-11T23:20:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.624+0000 7f3448ff9640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34380678c0 0x7f3438069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.624+0000 7f3448ff9640 1 -- 172.21.15.94:0/3462480693 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f343c085d70 con 0x7f344c0b6400 2024-09-11T23:20:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.624+0000 7f344b7fe640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34380678c0 0x7f3438069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.624+0000 7f344b7fe640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34380678c0 0x7f3438069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f3440008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:04.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.632+0000 7f3448ff9640 1 -- 172.21.15.94:0/3462480693 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f343c01f020 con 0x7f344c0b6400 2024-09-11T23:20:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.908+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f344c0cf270 con 0x7f344c0b6400 2024-09-11T23:20:04.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.908+0000 7f3448ff9640 1 -- 172.21.15.94:0/3462480693 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f343c0172c0 con 0x7f344c0b6400 2024-09-11T23:20:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:04.912 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:04.912 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34380678c0 msgr2=0x7f3438069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34380678c0 0x7f3438069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f3440008040 comp rx=0 tx=0).stop 2024-09-11T23:20:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0b6400 msgr2=0x7f344c0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0b6400 0x7f344c0c7c30 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f343c00b3e0 tx=0x7f343c00b8a0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 shutdown_connections 2024-09-11T23:20:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f344c15c380 0x7f344c06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f344c0d1960 0x7f344c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f34380678c0 0x7f3438069d80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 --2- 172.21.15.94:0/3462480693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f344c0b6400 0x7f344c0c7c30 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 >> 172.21.15.94:0/3462480693 conn(0x7f344c073620 msgr2=0x7f344c070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 shutdown_connections 2024-09-11T23:20:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:04.912+0000 7f34527af640 1 -- 172.21.15.94:0/3462480693 wait complete. 2024-09-11T23:20:04.931 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:05.075 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":304,"msgr_send_messages":301,"msgr_recv_bytes":179001,"msgr_send_bytes":601227,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.033228688,"msgr_running_send_time":0.011556913,"msgr_running_recv_time":0.014467447,"msgr_running_fast_dispatch_time":0.007521369,"msgr_send_messages_queue_lat":{"avgcount":301,"sum":0.017932302,"avgtime":0.000059575},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":109024,"msgr_send_encrypted_bytes":104224},"AsyncMessenger::Worker-1":{"msgr_recv_messages":9256,"msgr_send_messages":19404,"msgr_recv_bytes":3355704,"msgr_send_bytes":15754877,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":0.910585231,"msgr_running_send_time":0.504509154,"msgr_running_recv_time":0.468408868,"msgr_running_fast_dispatch_time":0.014011695,"msgr_send_messages_queue_lat":{"avgcount":19402,"sum":0.457235975,"avgtime":0.000023566},"msgr_handle_ack_lat":{"avgcount":26137,"sum":0.005881982,"avgtime":0.000000225},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":832,"msgr_send_messages":834,"msgr_recv_bytes":355843,"msgr_send_bytes":8338042,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.097992353,"msgr_running_send_time":0.051491089,"msgr_running_recv_time":0.016844315,"msgr_running_fast_dispatch_time":0.025268879,"msgr_send_messages_queue_lat":{"avgcount":833,"sum":0.080755135,"avgtime":0.000096944},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":2169,"complete_latency":{"avgcount":92,"sum":5.301348122,"avgtime":0.057623349}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2268,"sum":0.959071062,"avgtime":0.000422870}},"mds":{"request":5653,"reply":5650,"reply_latency":{"avgcount":5650,"sum":9.043596841,"avgtime":0.001600636},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":5153,"inodes_top":0,"inodes_bottom":5153,"inodes_pin_tail":0,"inodes_pinned":5153,"inodes_expired":0,"inodes_with_caps":1844,"caps":1844,"subtrees":2,"traverse":5659,"traverse_hit":5658,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1822,"root_rbytes":12383232,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":562,"ceph_cap_op_grant":5210,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3204,"handle_client_caps_dirty":3000,"handle_client_cap_release":5,"process_request_cap_release":8083},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1083,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":2441,"strays_enqueued":1358,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":10217,"evex":0,"evtrm":0,"ev":10220,"evexg":0,"evexd":0,"segadd":13,"segex":0,"segtrm":0,"seg":15,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":25302687,"rdpos":4195244,"jlat":{"avgcount":18,"sum":2.243762176,"avgtime":0.124653454},"replayed":3},"mds_mem":{"ino":2719,"ino+":3214,"ino-":495,"dir":13,"dir+":13,"dir-":0,"dn":5156,"dn+":5651,"dn-":495,"cap":1844,"cap+":3202,"cap-":1358,"rss":105356,"heap":248116},"mds_server":{"dispatch_client_request":5656,"dispatch_server_request":0,"handle_client_request":5653,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":2440,"sum":5.128849941,"avgtime":0.002101987},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5182,"average_load":5182,"avg_session_uptime":1035,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":29569994,"buffer_anon_items":8218,"buffer_meta_bytes":176,"buffer_meta_items":2,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":14633029,"mds_co_items":151842,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":1479,"op_send_bytes":21491636,"op_resend":0,"op_reply":1479,"op_latency":{"avgcount":1479,"sum":3.855954183,"avgtime":0.002607136},"op_inflight":0,"oplen_avg":{"avgcount":1479,"sum":1545},"op":1479,"op_r":49,"op_w":1430,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":21,"osdop_write":32,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":1374,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":26,"omap_rd":48,"omap_del":9},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":1358,"pq_executed":1358,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":304,"max":104857600,"get_started":0,"get":10387,"get_sum":2952756,"get_or_fail_fail":0,"get_or_fail_success":10387,"take":0,"take_sum":0,"put":10386,"put_sum":2952452,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":1479,"take_sum":21629913,"put":1479,"put_sum":21629913,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":1479,"take_sum":1479,"put":1479,"put_sum":1479,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":1358,"get_sum":137158,"get_or_fail_fail":0,"get_or_fail_success":1358,"take":0,"take_sum":0,"put":13,"put_sum":137158,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":136863,"max":3758096384,"get_started":0,"get":10217,"get_sum":21107000,"get_or_fail_fail":0,"get_or_fail_success":10217,"take":0,"take_sum":0,"put":19,"put_sum":20970137,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:05.077 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 179001, "msgr_recv_encrypted_bytes": 109024, "msgr_recv_messages": 304, "msgr_running_fast_dispatch_time": 0.007521369, "msgr_running_recv_time": 0.014467447, "msgr_running_send_time": 0.011556913, "msgr_running_total_time": 0.033228688, "msgr_send_bytes": 601227, "msgr_send_encrypted_bytes": 104224, "msgr_send_messages": 301, "msgr_send_messages_queue_lat": { "avgcount": 301, "avgtime": 5.9575e-05, "sum": 0.017932302 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 26137, "avgtime": 2.25e-07, "sum": 0.005881982 }, "msgr_recv_bytes": 3355704, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 9256, "msgr_running_fast_dispatch_time": 0.014011695, "msgr_running_recv_time": 0.468408868, "msgr_running_send_time": 0.504509154, "msgr_running_total_time": 0.910585231, "msgr_send_bytes": 15754877, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 19404, "msgr_send_messages_queue_lat": { "avgcount": 19402, "avgtime": 2.3566e-05, "sum": 0.457235975 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 355843, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 832, "msgr_running_fast_dispatch_time": 0.025268879, "msgr_running_recv_time": 0.016844315, "msgr_running_send_time": 0.051491089, "msgr_running_total_time": 0.097992353, "msgr_send_bytes": 8338042, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 834, "msgr_send_messages_queue_lat": { "avgcount": 833, "avgtime": 9.6944e-05, "sum": 0.080755135 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 92, "avgtime": 0.057623349, "sum": 5.301348122 }, "queue_len": 2169 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2268, "avgtime": 0.00042287, "sum": 0.959071062 }, "queue_len": 0 }, "mds": { "caps": 1844, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 5210, "ceph_cap_op_revoke": 562, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 5, "handle_client_caps": 3204, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 5153, "inodes_bottom": 5153, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 5153, "inodes_top": 0, "inodes_with_caps": 1844, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 8083, "q": 0, "reply": 5650, "reply_latency": { "avgcount": 5650, "avgtime": 0.001600636, "sum": 9.043596841 }, "request": 5653, "root_rbytes": 12383232, "root_rfiles": 1822, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 5659, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 5658, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1083, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 2441, "strays_enqueued": 1358, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 10220, "evadd": 10217, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 18, "avgtime": 0.124653454, "sum": 2.243762176 }, "rdpos": 4195244, "replayed": 3, "seg": 15, "segadd": 13, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 25302687 }, "mds_mem": { "cap": 1844, "cap+": 3202, "cap-": 1358, "dir": 13, "dir+": 13, "dir-": 0, "dn": 5156, "dn+": 5651, "dn-": 495, "heap": 248116, "ino": 2719, "ino+": 3214, "ino-": 495, "rss": 105356 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 5656, "dispatch_server_request": 0, "handle_client_request": 5653, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 2440, "avgtime": 0.002101987, "sum": 5.128849941 } }, "mds_sessions": { "average_load": 5182, "avg_session_uptime": 1035, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5182 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 29569994, "buffer_anon_items": 8218, "buffer_meta_bytes": 176, "buffer_meta_items": 2, "mds_co_bytes": 14633029, "mds_co_items": 151842, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 9, "omap_rd": 48, "omap_wr": 26, "op": 1479, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 1479, "avgtime": 0.002607136, "sum": 3.855954183 }, "op_pg": 0, "op_r": 49, "op_reply": 1479, "op_resend": 0, "op_rmw": 0, "op_send": 1479, "op_send_bytes": 21491636, "op_w": 1430, "oplen_avg": { "avgcount": 1479, "sum": 1545 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 1374, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 21, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 32, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 1358, "pq_executed_ops": 1358, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 10387, "get_or_fail_fail": 0, "get_or_fail_success": 10387, "get_started": 0, "get_sum": 2952756, "max": 104857600, "put": 10386, "put_sum": 2952452, "take": 0, "take_sum": 0, "val": 304, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 1479, "put_sum": 21629913, "take": 1479, "take_sum": 21629913, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 1479, "put_sum": 1479, "take": 1479, "take_sum": 1479, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 1358, "get_or_fail_fail": 0, "get_or_fail_success": 1358, "get_started": 0, "get_sum": 137158, "max": 3758096384, "put": 13, "put_sum": 137158, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 10217, "get_or_fail_fail": 0, "get_or_fail_success": 10217, "get_started": 0, "get_sum": 21107000, "max": 3758096384, "put": 19, "put_sum": 20970137, "take": 0, "take_sum": 0, "val": 136863, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:05.077 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1083, 1358/2441 2024-09-11T23:20:06.078 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:06.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e07dbb640 1 Processor -- start 2024-09-11T23:20:06.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e07dbb640 1 -- start start 2024-09-11T23:20:06.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e07dbb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1e0006cb80 0x7f1e001693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:06.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e07dbb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e000b6890 con 0x7f1e0015e660 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e07dbb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e000b6b70 con 0x7f1e0015ea40 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e07dbb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1e000b6e50 con 0x7f1e0006cb80 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e05b57640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1e0015e660 0x7f1e000b33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46814/0 (socket says 172.21.15.94:46814) 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e05b57640 1 -- 172.21.15.94:0/3787237900 learned_addr learned my addr 172.21.15.94:0/3787237900 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e06358640 1 --2- 172.21.15.94:0/3787237900 >> v2:172.21.15.94:3300/0 conn(0x7f1e0006cb80 0x7f1e001693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e04b55640 1 -- 172.21.15.94:0/3787237900 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994060934 0 0) 0x7f1e000b6890 con 0x7f1e0015e660 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e04b55640 1 -- 172.21.15.94:0/3787237900 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dec003530 con 0x7f1e0015e660 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e06358640 1 -- 172.21.15.94:0/3787237900 >> v1:172.21.15.155:6789/0 conn(0x7f1e0015ea40 legacy=0x7f1e0006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e06358640 1 -- 172.21.15.94:0/3787237900 >> v1:172.21.15.94:6789/0 conn(0x7f1e0015e660 legacy=0x7f1e000b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:06.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.212+0000 7f1e06358640 1 -- 172.21.15.94:0/3787237900 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e000b7130 con 0x7f1e0006cb80 2024-09-11T23:20:06.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e06358640 1 --2- 172.21.15.94:0/3787237900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e001693b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009d90 tx=0x7f1df801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823423b5d15a8410 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:06.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e04b55640 1 -- 172.21.15.94:0/3787237900 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80b2070 con 0x7f1e0006cb80 2024-09-11T23:20:06.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e04b55640 1 -- 172.21.15.94:0/3787237900 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df80a5990 con 0x7f1e0006cb80 2024-09-11T23:20:06.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e04b55640 1 -- 172.21.15.94:0/3787237900 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80a5d60 con 0x7f1e0006cb80 2024-09-11T23:20:06.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e07dbb640 1 -- 172.21.15.94:0/3787237900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 msgr2=0x7f1e001693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:06.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/3787237900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e001693b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009d90 tx=0x7f1df801c8b0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e07dbb640 1 -- 172.21.15.94:0/3787237900 shutdown_connections 2024-09-11T23:20:06.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/3787237900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e001693b0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.216+0000 7f1e07dbb640 1 -- 172.21.15.94:0/3787237900 >> 172.21.15.94:0/3787237900 conn(0x7f1e000b7860 msgr2=0x7f1e000b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:06.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- 172.21.15.94:0/3787237900 shutdown_connections 2024-09-11T23:20:06.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- 172.21.15.94:0/3787237900 wait complete. 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 Processor -- start 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- start start 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e0013b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e0015e660 0x7f1e0014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0015ea40 0x7f1e0015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0016c6a0 con 0x7f1e0006cb80 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0016c520 con 0x7f1e0015ea40 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0016c820 con 0x7f1e0015e660 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e0013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e0013b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39874/0 (socket says 172.21.15.94:39874) 2024-09-11T23:20:06.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 -- 172.21.15.94:0/2989136321 learned_addr learned my addr 172.21.15.94:0/2989136321 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e06358640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0015ea40 0x7f1e0015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05356640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e0015e660 0x7f1e0014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 -- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e0015e660 msgr2=0x7f1e0014c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e0015e660 0x7f1e0014c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 -- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0015ea40 msgr2=0x7f1e0015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0015ea40 0x7f1e0015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 -- 172.21.15.94:0/2989136321 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0015b0c0 con 0x7f1e0006cb80 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e05b57640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e0013b410 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c500 tx=0x7f1dfc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1df67fc640 1 -- 172.21.15.94:0/2989136321 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc017070 con 0x7f1e0006cb80 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1df67fc640 1 -- 172.21.15.94:0/2989136321 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dfc005cf0 con 0x7f1e0006cb80 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1df67fc640 1 -- 172.21.15.94:0/2989136321 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0072f0 con 0x7f1e0006cb80 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0013b950 con 0x7f1e0006cb80 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.220+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e00156a40 con 0x7f1e0006cb80 2024-09-11T23:20:06.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.224+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e000b33f0 con 0x7f1e0006cb80 2024-09-11T23:20:06.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.224+0000 7f1df67fc640 1 -- 172.21.15.94:0/2989136321 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1dfc01a070 con 0x7f1e0006cb80 2024-09-11T23:20:06.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.224+0000 7f1df67fc640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1de40678f0 0x7f1de4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:06.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.224+0000 7f1df67fc640 1 -- 172.21.15.94:0/2989136321 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f1dfc085160 con 0x7f1e0006cb80 2024-09-11T23:20:06.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.224+0000 7f1e05356640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1de40678f0 0x7f1de4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:06.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.224+0000 7f1e05356640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1de40678f0 0x7f1de4069db0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1e000d28a0 tx=0x7f1df0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:06.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.232+0000 7f1df67fc640 1 -- 172.21.15.94:0/2989136321 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e0015b0c0 con 0x7f1e0006cb80 2024-09-11T23:20:06.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.480+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e00070d80 con 0x7f1e0006cb80 2024-09-11T23:20:06.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.480+0000 7f1df67fc640 1 -- 172.21.15.94:0/2989136321 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f1dfc0554c0 con 0x7f1e0006cb80 2024-09-11T23:20:06.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:06.482 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:06.483 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:06.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1de40678f0 msgr2=0x7f1de4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1de40678f0 0x7f1de4069db0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1e000d28a0 tx=0x7f1df0009040 comp rx=0 tx=0).stop 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 msgr2=0x7f1e0013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e0013b410 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c500 tx=0x7f1dfc00c9c0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 shutdown_connections 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0015ea40 0x7f1e0015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e0015e660 0x7f1e0014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1de40678f0 0x7f1de4069db0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 --2- 172.21.15.94:0/2989136321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e0006cb80 0x7f1e0013b410 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 >> 172.21.15.94:0/2989136321 conn(0x7f1e000b7860 msgr2=0x7f1e000b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 shutdown_connections 2024-09-11T23:20:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:06.484+0000 7f1e07dbb640 1 -- 172.21.15.94:0/2989136321 wait complete. 2024-09-11T23:20:06.502 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:06.647 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":312,"msgr_send_messages":310,"msgr_recv_bytes":181071,"msgr_send_bytes":605835,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.033726566,"msgr_running_send_time":0.011761811,"msgr_running_recv_time":0.014586949,"msgr_running_fast_dispatch_time":0.007659906,"msgr_send_messages_queue_lat":{"avgcount":310,"sum":0.018064154,"avgtime":0.000058271},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":109024,"msgr_send_encrypted_bytes":106032},"AsyncMessenger::Worker-1":{"msgr_recv_messages":10034,"msgr_send_messages":21915,"msgr_recv_bytes":3661552,"msgr_send_bytes":16603950,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":0.990166436,"msgr_running_send_time":0.549226408,"msgr_running_recv_time":0.509809164,"msgr_running_fast_dispatch_time":0.014346812,"msgr_send_messages_queue_lat":{"avgcount":21913,"sum":0.489482640,"avgtime":0.000022337},"msgr_handle_ack_lat":{"avgcount":28504,"sum":0.006277348,"avgtime":0.000000220},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":867,"msgr_send_messages":869,"msgr_recv_bytes":369727,"msgr_send_bytes":10942936,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.108236118,"msgr_running_send_time":0.058970915,"msgr_running_recv_time":0.017351797,"msgr_running_fast_dispatch_time":0.027397192,"msgr_send_messages_queue_lat":{"avgcount":868,"sum":0.081691840,"avgtime":0.000094115},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":2171,"complete_latency":{"avgcount":92,"sum":5.301348122,"avgtime":0.057623349}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2366,"sum":1.012269268,"avgtime":0.000427839}},"mds":{"request":6413,"reply":6410,"reply_latency":{"avgcount":6410,"sum":10.160522868,"avgtime":0.001585104},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":5165,"inodes_top":0,"inodes_bottom":5165,"inodes_pin_tail":0,"inodes_pinned":5165,"inodes_expired":0,"inodes_with_caps":1794,"caps":1794,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":946,"root_rbytes":7432192,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":562,"ceph_cap_op_grant":6052,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3204,"handle_client_caps_dirty":3000,"handle_client_cap_release":6,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1792,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":3200,"strays_enqueued":1408,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":11027,"evex":0,"evtrm":0,"ev":11030,"evexg":0,"evexd":0,"segadd":13,"segex":0,"segtrm":0,"seg":15,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":27754314,"rdpos":4195244,"jlat":{"avgcount":18,"sum":2.243762176,"avgtime":0.124653454},"replayed":3},"mds_mem":{"ino":2206,"ino+":3214,"ino-":1008,"dir":13,"dir+":13,"dir-":0,"dn":5404,"dn+":6412,"dn-":1008,"cap":1794,"cap+":3202,"cap-":1408,"rss":110632,"heap":248116},"mds_server":{"dispatch_client_request":6416,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.245775968,"avgtime":0.001951804},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5844,"average_load":5844,"avg_session_uptime":1035,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":29569994,"buffer_anon_items":8218,"buffer_meta_bytes":176,"buffer_meta_items":2,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":14633029,"mds_co_items":151842,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":1538,"op_send_bytes":24085424,"op_resend":0,"op_reply":1538,"op_latency":{"avgcount":1538,"sum":4.035952051,"avgtime":0.002624156},"op_inflight":0,"oplen_avg":{"avgcount":1538,"sum":1605},"op":1538,"op_r":52,"op_w":1486,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":24,"osdop_write":36,"osdop_writefull":9,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":1424,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":28,"omap_rd":48,"omap_del":9},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":1408,"pq_executed":1408,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":11208,"get_sum":3200668,"get_or_fail_fail":0,"get_or_fail_success":11208,"take":0,"take_sum":0,"put":11208,"put_sum":3200668,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":1538,"take_sum":24228751,"put":1538,"put_sum":24228751,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":1538,"take_sum":1538,"put":1538,"put_sum":1538,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":1408,"get_sum":142208,"get_or_fail_fail":0,"get_or_fail_success":1408,"take":0,"take_sum":0,"put":16,"put_sum":142208,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":0,"max":3758096384,"get_started":0,"get":11027,"get_sum":23558627,"get_or_fail_fail":0,"get_or_fail_success":11027,"take":0,"take_sum":0,"put":20,"put_sum":23558627,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:06.649 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 181071, "msgr_recv_encrypted_bytes": 109024, "msgr_recv_messages": 312, "msgr_running_fast_dispatch_time": 0.007659906, "msgr_running_recv_time": 0.014586949, "msgr_running_send_time": 0.011761811, "msgr_running_total_time": 0.033726566, "msgr_send_bytes": 605835, "msgr_send_encrypted_bytes": 106032, "msgr_send_messages": 310, "msgr_send_messages_queue_lat": { "avgcount": 310, "avgtime": 5.8271e-05, "sum": 0.018064154 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 28504, "avgtime": 2.2e-07, "sum": 0.006277348 }, "msgr_recv_bytes": 3661552, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 10034, "msgr_running_fast_dispatch_time": 0.014346812, "msgr_running_recv_time": 0.509809164, "msgr_running_send_time": 0.549226408, "msgr_running_total_time": 0.990166436, "msgr_send_bytes": 16603950, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 21915, "msgr_send_messages_queue_lat": { "avgcount": 21913, "avgtime": 2.2337e-05, "sum": 0.48948264 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 369727, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 867, "msgr_running_fast_dispatch_time": 0.027397192, "msgr_running_recv_time": 0.017351797, "msgr_running_send_time": 0.058970915, "msgr_running_total_time": 0.108236118, "msgr_send_bytes": 10942936, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 869, "msgr_send_messages_queue_lat": { "avgcount": 868, "avgtime": 9.4115e-05, "sum": 0.08169184 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 92, "avgtime": 0.057623349, "sum": 5.301348122 }, "queue_len": 2171 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2366, "avgtime": 0.000427839, "sum": 1.012269268 }, "queue_len": 0 }, "mds": { "caps": 1794, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6052, "ceph_cap_op_revoke": 562, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 6, "handle_client_caps": 3204, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 5165, "inodes_bottom": 5165, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 5165, "inodes_top": 0, "inodes_with_caps": 1794, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6410, "reply_latency": { "avgcount": 6410, "avgtime": 0.001585104, "sum": 10.160522868 }, "request": 6413, "root_rbytes": 7432192, "root_rfiles": 946, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1792, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3200, "strays_enqueued": 1408, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 11030, "evadd": 11027, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 18, "avgtime": 0.124653454, "sum": 2.243762176 }, "rdpos": 4195244, "replayed": 3, "seg": 15, "segadd": 13, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 27754314 }, "mds_mem": { "cap": 1794, "cap+": 3202, "cap-": 1408, "dir": 13, "dir+": 13, "dir-": 0, "dn": 5404, "dn+": 6412, "dn-": 1008, "heap": 248116, "ino": 2206, "ino+": 3214, "ino-": 1008, "rss": 110632 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6416, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.001951804, "sum": 6.245775968 } }, "mds_sessions": { "average_load": 5844, "avg_session_uptime": 1035, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5844 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 29569994, "buffer_anon_items": 8218, "buffer_meta_bytes": 176, "buffer_meta_items": 2, "mds_co_bytes": 14633029, "mds_co_items": 151842, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 9, "omap_rd": 48, "omap_wr": 28, "op": 1538, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 1538, "avgtime": 0.002624156, "sum": 4.035952051 }, "op_pg": 0, "op_r": 52, "op_reply": 1538, "op_resend": 0, "op_rmw": 0, "op_send": 1538, "op_send_bytes": 24085424, "op_w": 1486, "oplen_avg": { "avgcount": 1538, "sum": 1605 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 1424, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 24, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 36, "osdop_writefull": 9, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 1408, "pq_executed_ops": 1408, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 11208, "get_or_fail_fail": 0, "get_or_fail_success": 11208, "get_started": 0, "get_sum": 3200668, "max": 104857600, "put": 11208, "put_sum": 3200668, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 1538, "put_sum": 24228751, "take": 1538, "take_sum": 24228751, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 1538, "put_sum": 1538, "take": 1538, "take_sum": 1538, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 1408, "get_or_fail_fail": 0, "get_or_fail_success": 1408, "get_started": 0, "get_sum": 142208, "max": 3758096384, "put": 16, "put_sum": 142208, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 11027, "get_or_fail_fail": 0, "get_or_fail_success": 11027, "get_started": 0, "get_sum": 23558627, "max": 3758096384, "put": 20, "put_sum": 23558627, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:06.649 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1792, 1408/3200 2024-09-11T23:20:07.140 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74bb0f9640 1 Processor -- start 2024-09-11T23:20:07.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74bb0f9640 1 -- start start 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74bb0f9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74b40d0420 0x7f74b40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74bb0f9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40ce810 0x7f74b40cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74bb0f9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b415c6b0 con 0x7f74b40b4a60 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74bb0f9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f74b40b5240 con 0x7f74b40d0420 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74bb0f9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74b40b4f60 con 0x7f74b40ce810 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b9696640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40ce810 0x7f74b40cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b8e95640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74b40d0420 0x7f74b40d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b9696640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40ce810 0x7f74b40cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:56090/0 (socket says 172.21.15.94:56090) 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b9696640 1 -- 172.21.15.94:0/3775822798 learned_addr learned my addr 172.21.15.94:0/3775822798 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:07.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74abfff640 1 --1- 172.21.15.94:0/3775822798 >> v1:172.21.15.155:6789/0 conn(0x7f74b40b4a60 0x7f74b40cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:57920/0 (socket says 172.21.15.94:57920) 2024-09-11T23:20:07.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b8e95640 1 -- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40ce810 msgr2=0x7f74b40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:07.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b8e95640 1 --2- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40ce810 0x7f74b40cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b8e95640 1 -- 172.21.15.94:0/3775822798 >> v1:172.21.15.155:6789/0 conn(0x7f74b40b4a60 legacy=0x7f74b40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b8e95640 1 -- 172.21.15.94:0/3775822798 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b406dab0 con 0x7f74b40d0420 2024-09-11T23:20:07.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.244+0000 7f74b9696640 1 --2- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40ce810 0x7f74b40cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:07.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74b8e95640 1 --2- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40d0420 0x7f74b40d0800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f74b00097c0 tx=0x7f74b001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb6cfeb193f64bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:07.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74ab7fe640 1 -- 172.21.15.94:0/3775822798 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b00b0070 con 0x7f74b40d0420 2024-09-11T23:20:07.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74ab7fe640 1 -- 172.21.15.94:0/3775822798 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b00ab600 con 0x7f74b40d0420 2024-09-11T23:20:07.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74ab7fe640 1 -- 172.21.15.94:0/3775822798 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b00ab9d0 con 0x7f74b40d0420 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 -- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40d0420 msgr2=0x7f74b40d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40d0420 0x7f74b40d0800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f74b00097c0 tx=0x7f74b001c4a0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 -- 172.21.15.94:0/3775822798 shutdown_connections 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40ce810 0x7f74b40cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/3775822798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40d0420 0x7f74b40d0800 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 -- 172.21.15.94:0/3775822798 >> 172.21.15.94:0/3775822798 conn(0x7f74b4075200 msgr2=0x7f74b4075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 -- 172.21.15.94:0/3775822798 shutdown_connections 2024-09-11T23:20:07.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 -- 172.21.15.94:0/3775822798 wait complete. 2024-09-11T23:20:07.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 Processor -- start 2024-09-11T23:20:07.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 -- start start 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b40b4a60 0x7f74b4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.248+0000 7f74bb0f9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40ce810 0x7f74b41478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74bb0f9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40d0420 0x7f74b414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74bb0f9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4169040 con 0x7f74b40b4a60 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74bb0f9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4168ec0 con 0x7f74b40ce810 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74bb0f9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74b41691c0 con 0x7f74b40d0420 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b40b4a60 0x7f74b4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b40b4a60 0x7f74b4153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39878/0 (socket says 172.21.15.94:39878) 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 -- 172.21.15.94:0/1406902913 learned_addr learned my addr 172.21.15.94:0/1406902913 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b9696640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40d0420 0x7f74b414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74abfff640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40ce810 0x7f74b41478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 -- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40d0420 msgr2=0x7f74b414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40d0420 0x7f74b414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 -- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40ce810 msgr2=0x7f74b41478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40ce810 0x7f74b41478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 -- 172.21.15.94:0/1406902913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b414f830 con 0x7f74b40b4a60 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74b8e95640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b40b4a60 0x7f74b4153be0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f74b001a0d0 tx=0x7f74b001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74a97fa640 1 -- 172.21.15.94:0/1406902913 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b00b0050 con 0x7f74b40b4a60 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74a97fa640 1 -- 172.21.15.94:0/1406902913 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b00bc070 con 0x7f74b40b4a60 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74a97fa640 1 -- 172.21.15.94:0/1406902913 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b00b5830 con 0x7f74b40b4a60 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b414fb10 con 0x7f74b40b4a60 2024-09-11T23:20:07.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b41500d0 con 0x7f74b40b4a60 2024-09-11T23:20:07.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b40cecc0 con 0x7f74b40b4a60 2024-09-11T23:20:07.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74a97fa640 1 -- 172.21.15.94:0/1406902913 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74b00b59d0 con 0x7f74b40b4a60 2024-09-11T23:20:07.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74a97fa640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74a00678c0 0x7f74a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74a97fa640 1 -- 172.21.15.94:0/1406902913 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f74b0120680 con 0x7f74b40b4a60 2024-09-11T23:20:07.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74abfff640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74a00678c0 0x7f74a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.252+0000 7f74abfff640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74a00678c0 0x7f74a0069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74b414b6d0 tx=0x7f74a4007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:07.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.256+0000 7f74a97fa640 1 -- 172.21.15.94:0/1406902913 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74b0016090 con 0x7f74b40b4a60 2024-09-11T23:20:07.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.444+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74b40cff90 con 0x7f74b40b4a60 2024-09-11T23:20:07.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.444+0000 7f74a97fa640 1 -- 172.21.15.94:0/1406902913 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f74b00f1040 con 0x7f74b40b4a60 2024-09-11T23:20:07.446 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:07.447 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:07.447 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:07.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74a00678c0 msgr2=0x7f74a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74a00678c0 0x7f74a0069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74b414b6d0 tx=0x7f74a4007c90 comp rx=0 tx=0).stop 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b40b4a60 msgr2=0x7f74b4153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b40b4a60 0x7f74b4153be0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f74b001a0d0 tx=0x7f74b001ace0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 shutdown_connections 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74b40d0420 0x7f74b414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b40ce810 0x7f74b41478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74a00678c0 0x7f74a0069d80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 --2- 172.21.15.94:0/1406902913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b40b4a60 0x7f74b4153be0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 >> 172.21.15.94:0/1406902913 conn(0x7f74b4075200 msgr2=0x7f74b415ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 shutdown_connections 2024-09-11T23:20:07.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.448+0000 7f74bb0f9640 1 -- 172.21.15.94:0/1406902913 wait complete. 2024-09-11T23:20:07.464 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-11T23:20:07.650 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:07.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043f560640 1 Processor -- start 2024-09-11T23:20:07.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043f560640 1 -- start start 2024-09-11T23:20:07.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043f560640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f043004eb70 0x7f0430047580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043f560640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0430009b00 0x7f0430009f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043f560640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043001dea0 con 0x7f04300338c0 2024-09-11T23:20:07.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043f560640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f043000bac0 con 0x7f043004eb70 2024-09-11T23:20:07.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043f560640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f043001d0e0 con 0x7f0430009b00 2024-09-11T23:20:07.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043d2fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f043004eb70 0x7f0430047580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043dafd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0430009b00 0x7f0430009f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043dafd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0430009b00 0x7f0430009f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:35478/0 (socket says 172.21.15.94:35478) 2024-09-11T23:20:07.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043dafd640 1 -- 172.21.15.94:0/1858323624 learned_addr learned my addr 172.21.15.94:0/1858323624 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:07.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f042ffff640 1 -- 172.21.15.94:0/1858323624 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160925419 0 0) 0x7f043001dea0 con 0x7f04300338c0 2024-09-11T23:20:07.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f042ffff640 1 -- 172.21.15.94:0/1858323624 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0424003530 con 0x7f04300338c0 2024-09-11T23:20:07.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f043dafd640 1 -- 172.21.15.94:0/1858323624 >> v2:172.21.15.94:3300/0 conn(0x7f043004eb70 msgr2=0x7f0430047580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:07.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.832+0000 7f042ffff640 1 -- 172.21.15.94:0/1858323624 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 995545479 0 0) 0x7f0424003530 con 0x7f04300338c0 2024-09-11T23:20:07.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.836+0000 7f043dafd640 1 --2- 172.21.15.94:0/1858323624 >> v2:172.21.15.94:3300/0 conn(0x7f043004eb70 0x7f0430047580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.836+0000 7f043dafd640 1 -- 172.21.15.94:0/1858323624 >> v1:172.21.15.94:6789/0 conn(0x7f04300338c0 legacy=0x7f043004ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.836+0000 7f043dafd640 1 -- 172.21.15.94:0/1858323624 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043001d3c0 con 0x7f0430009b00 2024-09-11T23:20:07.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.836+0000 7f043d2fc640 1 --2- 172.21.15.94:0/1858323624 >> v2:172.21.15.94:3300/0 conn(0x7f043004eb70 0x7f0430047580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:07.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.836+0000 7f043dafd640 1 --2- 172.21.15.94:0/1858323624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 0x7f0430009f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f043807bd30 tx=0x7f0438098660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f7f67e02cfcfee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:07.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f042ffff640 1 -- 172.21.15.94:0/1858323624 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043812c070 con 0x7f0430009b00 2024-09-11T23:20:07.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f042ffff640 1 -- 172.21.15.94:0/1858323624 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0438127400 con 0x7f0430009b00 2024-09-11T23:20:07.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f042ffff640 1 -- 172.21.15.94:0/1858323624 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434001680 con 0x7f0430009b00 2024-09-11T23:20:07.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 -- 172.21.15.94:0/1858323624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 msgr2=0x7f0430009f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 --2- 172.21.15.94:0/1858323624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 0x7f0430009f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f043807bd30 tx=0x7f0438098660 comp rx=0 tx=0).stop 2024-09-11T23:20:07.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 -- 172.21.15.94:0/1858323624 shutdown_connections 2024-09-11T23:20:07.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 --2- 172.21.15.94:0/1858323624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 0x7f0430009f90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 --2- 172.21.15.94:0/1858323624 >> v2:172.21.15.94:3300/0 conn(0x7f043004eb70 0x7f0430047580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 -- 172.21.15.94:0/1858323624 >> 172.21.15.94:0/1858323624 conn(0x7f04300360a0 msgr2=0x7f04300364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:07.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 -- 172.21.15.94:0/1858323624 shutdown_connections 2024-09-11T23:20:07.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.840+0000 7f043f560640 1 -- 172.21.15.94:0/1858323624 wait complete. 2024-09-11T23:20:07.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 Processor -- start 2024-09-11T23:20:07.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 -- start start 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 0x7f0430039ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04300338c0 0x7f043004b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f043004eb70 0x7f04300d9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f04300f3b30 con 0x7f043004eb70 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f04300f39b0 con 0x7f0430009b00 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043f560640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f04300f3cb0 con 0x7f04300338c0 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f043004eb70 0x7f04300d9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043cafb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04300338c0 0x7f043004b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f043004eb70 0x7f04300d9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39896/0 (socket says 172.21.15.94:39896) 2024-09-11T23:20:07.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 -- 172.21.15.94:0/1286995090 learned_addr learned my addr 172.21.15.94:0/1286995090 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:07.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043d2fc640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 0x7f0430039ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 -- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04300338c0 msgr2=0x7f043004b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04300338c0 0x7f043004b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 -- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 msgr2=0x7f0430039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 0x7f0430039ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 -- 172.21.15.94:0/1286995090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043003a400 con 0x7f043004eb70 2024-09-11T23:20:07.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.844+0000 7f043dafd640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f043004eb70 0x7f04300d9ae0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0438051960 tx=0x7f04380954a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:07.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.848+0000 7f042dffb640 1 -- 172.21.15.94:0/1286995090 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043812c040 con 0x7f043004eb70 2024-09-11T23:20:07.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.848+0000 7f042dffb640 1 -- 172.21.15.94:0/1286995090 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0438127da0 con 0x7f043004eb70 2024-09-11T23:20:07.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.848+0000 7f042dffb640 1 -- 172.21.15.94:0/1286995090 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438131680 con 0x7f043004eb70 2024-09-11T23:20:07.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.848+0000 7f043f560640 1 -- 172.21.15.94:0/1286995090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0430038ae0 con 0x7f043004eb70 2024-09-11T23:20:07.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.848+0000 7f043f560640 1 -- 172.21.15.94:0/1286995090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04300390a0 con 0x7f043004eb70 2024-09-11T23:20:07.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.848+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04140052a0 con 0x7f043004eb70 2024-09-11T23:20:07.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.852+0000 7f042dffb640 1 -- 172.21.15.94:0/1286995090 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0438139020 con 0x7f043004eb70 2024-09-11T23:20:07.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.852+0000 7f042dffb640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f041c067910 0x7f041c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:07.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.856+0000 7f043d2fc640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f041c067910 0x7f041c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.856+0000 7f042dffb640 1 -- 172.21.15.94:0/1286995090 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f0438168dd0 con 0x7f043004eb70 2024-09-11T23:20:07.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.856+0000 7f043d2fc640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f041c067910 0x7f041c069dd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04300355c0 tx=0x7f0428008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:07.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:07.856+0000 7f042dffb640 1 -- 172.21.15.94:0/1286995090 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f04381a3020 con 0x7f043004eb70 2024-09-11T23:20:07.910 INFO:teuthology.orchestra.run.smithi094.stdout:{"message":"","return_code":0} 2024-09-11T23:20:07.910 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T23:20:08.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.044+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0414005590 con 0x7f043004eb70 2024-09-11T23:20:08.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.044+0000 7f042dffb640 1 -- 172.21.15.94:0/1286995090 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f0438092420 con 0x7f043004eb70 2024-09-11T23:20:08.048 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:08.048 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:08.048 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f041c067910 msgr2=0x7f041c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f041c067910 0x7f041c069dd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04300355c0 tx=0x7f0428008040 comp rx=0 tx=0).stop 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f043004eb70 msgr2=0x7f04300d9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f043004eb70 0x7f04300d9ae0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0438051960 tx=0x7f04380954a0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 shutdown_connections 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f041c067910 0x7f041c069dd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f043004eb70 0x7f04300d9ae0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04300338c0 0x7f043004b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 --2- 172.21.15.94:0/1286995090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0430009b00 0x7f0430039ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 >> 172.21.15.94:0/1286995090 conn(0x7f04300360a0 msgr2=0x7f04300e4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:08.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 shutdown_connections 2024-09-11T23:20:08.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:08.048+0000 7f041b7fe640 1 -- 172.21.15.94:0/1286995090 wait complete. 2024-09-11T23:20:08.065 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:08.201 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":634,"msgr_send_messages":632,"msgr_recv_bytes":284397,"msgr_send_bytes":766540,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.050534302,"msgr_running_send_time":0.015860169,"msgr_running_recv_time":0.018286117,"msgr_running_fast_dispatch_time":0.016161471,"msgr_send_messages_queue_lat":{"avgcount":632,"sum":0.408846403,"avgtime":0.000646908},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":109024,"msgr_send_encrypted_bytes":106032},"AsyncMessenger::Worker-1":{"msgr_recv_messages":10542,"msgr_send_messages":24233,"msgr_recv_bytes":3848197,"msgr_send_bytes":17287455,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":1.068459120,"msgr_running_send_time":0.587416225,"msgr_running_recv_time":0.525088761,"msgr_running_fast_dispatch_time":0.033404205,"msgr_send_messages_queue_lat":{"avgcount":24231,"sum":1.279545826,"avgtime":0.000052806},"msgr_handle_ack_lat":{"avgcount":29430,"sum":0.006522024,"avgtime":0.000000221},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":1882,"msgr_send_messages":1884,"msgr_recv_bytes":729496,"msgr_send_bytes":12352373,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.208101310,"msgr_running_send_time":0.120732687,"msgr_running_recv_time":0.024560792,"msgr_running_fast_dispatch_time":0.057046043,"msgr_send_messages_queue_lat":{"avgcount":1883,"sum":19.282416458,"avgtime":0.010240263},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":124,"sum":7.786620489,"avgtime":0.062795326}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2970,"sum":1.221083750,"avgtime":0.000411139}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.709675937,"avgtime":0.001670515},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":4658,"inodes_top":0,"inodes_bottom":4658,"inodes_pin_tail":0,"inodes_pinned":4658,"inodes_expired":0,"inodes_with_caps":1448,"caps":1448,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":564,"ceph_cap_op_grant":6959,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":8,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1447,"num_strays_delayed":1447,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":1754,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":11378,"evex":11378,"evtrm":11378,"ev":11380,"evexg":0,"evexd":11377,"segadd":15,"segex":16,"segtrm":16,"seg":1,"segmjr":1,"segexg":0,"segexd":15,"expos":27965114,"wrpos":27968795,"rdpos":4195244,"jlat":{"avgcount":23,"sum":4.004652057,"avgtime":0.174115306},"replayed":3},"mds_mem":{"ino":1460,"ino+":3214,"ino-":1754,"dir":13,"dir+":13,"dir-":0,"dn":1458,"dn+":6412,"dn-":4954,"cap":834,"cap+":3202,"cap-":2368,"rss":113460,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.549153069,"avgtime":0.549153069},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.245775968,"avgtime":0.001951804},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5808,"average_load":5808,"avg_session_uptime":1035,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":29569994,"buffer_anon_items":8218,"buffer_meta_bytes":176,"buffer_meta_items":2,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":14633029,"mds_co_items":151842,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":3377,"op_send_bytes":25353735,"op_resend":0,"op_reply":3377,"op_latency":{"avgcount":3377,"sum":219.841400483,"avgtime":0.065099615},"op_inflight":0,"oplen_avg":{"avgcount":3377,"sum":6379},"op":3377,"op_r":55,"op_w":3322,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1458,"osdop_read":27,"osdop_write":42,"osdop_writefull":15,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":1775,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2916,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":50,"omap_rd":48,"omap_del":11},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":1754,"pq_executed":1754,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":13053,"get_sum":3684358,"get_or_fail_fail":0,"get_or_fail_success":13053,"take":0,"take_sum":0,"put":13053,"put_sum":3684358,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":3377,"take_sum":25532008,"put":3377,"put_sum":25532008,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":3377,"take_sum":3377,"put":3377,"put_sum":3377,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":1754,"get_sum":177154,"get_or_fail_fail":0,"get_or_fail_success":1754,"take":0,"take_sum":0,"put":19,"put_sum":177154,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":0,"max":3758096384,"get_started":0,"get":11378,"get_sum":23773108,"get_or_fail_fail":0,"get_or_fail_success":11378,"take":0,"take_sum":0,"put":23,"put_sum":23773108,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:08.203 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 284397, "msgr_recv_encrypted_bytes": 109024, "msgr_recv_messages": 634, "msgr_running_fast_dispatch_time": 0.016161471, "msgr_running_recv_time": 0.018286117, "msgr_running_send_time": 0.015860169, "msgr_running_total_time": 0.050534302, "msgr_send_bytes": 766540, "msgr_send_encrypted_bytes": 106032, "msgr_send_messages": 632, "msgr_send_messages_queue_lat": { "avgcount": 632, "avgtime": 0.000646908, "sum": 0.408846403 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 29430, "avgtime": 2.21e-07, "sum": 0.006522024 }, "msgr_recv_bytes": 3848197, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 10542, "msgr_running_fast_dispatch_time": 0.033404205, "msgr_running_recv_time": 0.525088761, "msgr_running_send_time": 0.587416225, "msgr_running_total_time": 1.06845912, "msgr_send_bytes": 17287455, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 24233, "msgr_send_messages_queue_lat": { "avgcount": 24231, "avgtime": 5.2806e-05, "sum": 1.279545826 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 729496, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 1882, "msgr_running_fast_dispatch_time": 0.057046043, "msgr_running_recv_time": 0.024560792, "msgr_running_send_time": 0.120732687, "msgr_running_total_time": 0.20810131, "msgr_send_bytes": 12352373, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 1884, "msgr_send_messages_queue_lat": { "avgcount": 1883, "avgtime": 0.010240263, "sum": 19.282416458 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 124, "avgtime": 0.062795326, "sum": 7.786620489 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2970, "avgtime": 0.000411139, "sum": 1.22108375 }, "queue_len": 0 }, "mds": { "caps": 1448, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6959, "ceph_cap_op_revoke": 564, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 8, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4658, "inodes_bottom": 4658, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4658, "inodes_top": 0, "inodes_with_caps": 1448, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001670515, "sum": 10.709675937 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1447, "num_strays_delayed": 1447, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 1754, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 11380, "evadd": 11378, "evex": 11378, "evexd": 11377, "evexg": 0, "evlrg": 0, "evtrm": 11378, "expos": 27965114, "jlat": { "avgcount": 23, "avgtime": 0.174115306, "sum": 4.004652057 }, "rdpos": 4195244, "replayed": 3, "seg": 1, "segadd": 15, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 27968795 }, "mds_mem": { "cap": 834, "cap+": 3202, "cap-": 2368, "dir": 13, "dir+": 13, "dir-": 0, "dn": 1458, "dn+": 6412, "dn-": 4954, "heap": 248116, "ino": 1460, "ino+": 3214, "ino-": 1754, "rss": 113460 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.549153069, "sum": 0.549153069 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.001951804, "sum": 6.245775968 } }, "mds_sessions": { "average_load": 5808, "avg_session_uptime": 1035, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5808 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 29569994, "buffer_anon_items": 8218, "buffer_meta_bytes": 176, "buffer_meta_items": 2, "mds_co_bytes": 14633029, "mds_co_items": 151842, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 11, "omap_rd": 48, "omap_wr": 50, "op": 3377, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 3377, "avgtime": 0.065099615, "sum": 219.841400483 }, "op_pg": 0, "op_r": 55, "op_reply": 3377, "op_resend": 0, "op_rmw": 0, "op_send": 3377, "op_send_bytes": 25353735, "op_w": 3322, "oplen_avg": { "avgcount": 3377, "sum": 6379 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1458, "osdop_delete": 1775, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 27, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2916, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 42, "osdop_writefull": 15, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 1754, "pq_executed_ops": 1754, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 13053, "get_or_fail_fail": 0, "get_or_fail_success": 13053, "get_started": 0, "get_sum": 3684358, "max": 104857600, "put": 13053, "put_sum": 3684358, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 3377, "put_sum": 25532008, "take": 3377, "take_sum": 25532008, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 3377, "put_sum": 3377, "take": 3377, "take_sum": 3377, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 1754, "get_or_fail_fail": 0, "get_or_fail_success": 1754, "get_started": 0, "get_sum": 177154, "max": 3758096384, "put": 19, "put_sum": 177154, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 11378, "get_or_fail_fail": 0, "get_or_fail_success": 11378, "get_started": 0, "get_sum": 23773108, "max": 3758096384, "put": 23, "put_sum": 23773108, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:08.203 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1447, 1754/3201 2024-09-11T23:20:09.204 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e23d7640 1 Processor -- start 2024-09-11T23:20:09.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e23d7640 1 -- start start 2024-09-11T23:20:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e23d7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7dc15c3c0 0x7fc7dc0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e23d7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7dc075740 0x7fc7dc15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e23d7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc0d0a40 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e23d7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc0d0d20 con 0x7fc7dc075740 2024-09-11T23:20:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e23d7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc06f4d0 con 0x7fc7dc15c3c0 2024-09-11T23:20:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7db7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc7dc06fcd0 0x7fc7dc075030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46830/0 (socket says 172.21.15.94:46830) 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7db7fe640 1 -- 172.21.15.94:0/733777852 learned_addr learned my addr 172.21.15.94:0/733777852 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e0974640 1 --2- 172.21.15.94:0/733777852 >> v2:172.21.15.94:3300/0 conn(0x7fc7dc075740 0x7fc7dc15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7dbfff640 1 --2- 172.21.15.94:0/733777852 >> v2:172.21.15.155:3300/0 conn(0x7fc7dc15c3c0 0x7fc7dc0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7daffd640 1 -- 172.21.15.94:0/733777852 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384296405 0 0) 0x7fc7dc0d0a40 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7daffd640 1 -- 172.21.15.94:0/733777852 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7c8003530 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e0974640 1 -- 172.21.15.94:0/733777852 >> v2:172.21.15.155:3300/0 conn(0x7fc7dc15c3c0 msgr2=0x7fc7dc0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e0974640 1 --2- 172.21.15.94:0/733777852 >> v2:172.21.15.155:3300/0 conn(0x7fc7dc15c3c0 0x7fc7dc0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e0974640 1 -- 172.21.15.94:0/733777852 >> v1:172.21.15.94:6789/0 conn(0x7fc7dc06fcd0 legacy=0x7fc7dc075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.332+0000 7fc7e0974640 1 -- 172.21.15.94:0/733777852 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc06f7b0 con 0x7fc7dc075740 2024-09-11T23:20:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e0974640 1 --2- 172.21.15.94:0/733777852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc075740 0x7fc7dc15c7a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0097c0 tx=0x7fc7cc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579ade34127a377d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7daffd640 1 -- 172.21.15.94:0/733777852 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0b0070 con 0x7fc7dc075740 2024-09-11T23:20:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7daffd640 1 -- 172.21.15.94:0/733777852 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc0ab600 con 0x7fc7dc075740 2024-09-11T23:20:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7daffd640 1 -- 172.21.15.94:0/733777852 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0ab9d0 con 0x7fc7dc075740 2024-09-11T23:20:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 -- 172.21.15.94:0/733777852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc075740 msgr2=0x7fc7dc15c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/733777852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc075740 0x7fc7dc15c7a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0097c0 tx=0x7fc7cc01c370 comp rx=0 tx=0).stop 2024-09-11T23:20:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 -- 172.21.15.94:0/733777852 shutdown_connections 2024-09-11T23:20:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/733777852 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc075740 0x7fc7dc15c7a0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/733777852 >> v2:172.21.15.155:3300/0 conn(0x7fc7dc15c3c0 0x7fc7dc0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 -- 172.21.15.94:0/733777852 >> 172.21.15.94:0/733777852 conn(0x7fc7dc067a00 msgr2=0x7fc7dc067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 -- 172.21.15.94:0/733777852 shutdown_connections 2024-09-11T23:20:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 -- 172.21.15.94:0/733777852 wait complete. 2024-09-11T23:20:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 Processor -- start 2024-09-11T23:20:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.336+0000 7fc7e23d7640 1 -- start start 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc06fcd0 0x7fc7dc152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7dc075740 0x7fc7dc165700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7dc15c3c0 0x7fc7dc1407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc15d880 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc15d700 con 0x7fc7dc075740 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc1690d0 con 0x7fc7dc15c3c0 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc06fcd0 0x7fc7dc152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc06fcd0 0x7fc7dc152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39912/0 (socket says 172.21.15.94:39912) 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 -- 172.21.15.94:0/1602897854 learned_addr learned my addr 172.21.15.94:0/1602897854 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e0974640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7dc15c3c0 0x7fc7dc1407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 -- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7dc15c3c0 msgr2=0x7fc7dc1407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7dc15c3c0 0x7fc7dc1407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 -- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7dc075740 msgr2=0x7fc7dc165700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7db7fe640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7dc075740 0x7fc7dc165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7dc075740 0x7fc7dc165700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 -- 172.21.15.94:0/1602897854 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc0b5420 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7dbfff640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc06fcd0 0x7fc7dc152590 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4007e90 tx=0x7fc7d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7d8ff9640 1 -- 172.21.15.94:0/1602897854 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4014620 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7d8ff9640 1 -- 172.21.15.94:0/1602897854 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d4019070 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7dc0b5700 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7d8ff9640 1 -- 172.21.15.94:0/1602897854 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4014a20 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7dc0b5cc0 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7dc15c7a0 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7d8ff9640 1 -- 172.21.15.94:0/1602897854 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7d4014bc0 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7d8ff9640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7bc0678c0 0x7fc7bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7d8ff9640 1 -- 172.21.15.94:0/1602897854 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fc7d4086790 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.340+0000 7fc7db7fe640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7bc0678c0 0x7fc7bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:09.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.344+0000 7fc7db7fe640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7bc0678c0 0x7fc7bc069d80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4007fd0 tx=0x7fc7c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.348+0000 7fc7d8ff9640 1 -- 172.21.15.94:0/1602897854 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc7d4011260 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.544+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7dc15a8c0 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.544+0000 7fc7d8ff9640 1 -- 172.21.15.94:0/1602897854 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7fc7d40570b0 con 0x7fc7dc06fcd0 2024-09-11T23:20:09.547 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:09.547 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:09.547 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7bc0678c0 msgr2=0x7fc7bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7bc0678c0 0x7fc7bc069d80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4007fd0 tx=0x7fc7c4009040 comp rx=0 tx=0).stop 2024-09-11T23:20:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc06fcd0 msgr2=0x7fc7dc152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc06fcd0 0x7fc7dc152590 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4007e90 tx=0x7fc7d400e4b0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 shutdown_connections 2024-09-11T23:20:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7dc15c3c0 0x7fc7dc1407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7dc075740 0x7fc7dc165700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7bc0678c0 0x7fc7bc069d80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 --2- 172.21.15.94:0/1602897854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7dc06fcd0 0x7fc7dc152590 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 >> 172.21.15.94:0/1602897854 conn(0x7fc7dc067a00 msgr2=0x7fc7dc166300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 shutdown_connections 2024-09-11T23:20:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:09.548+0000 7fc7e23d7640 1 -- 172.21.15.94:0/1602897854 wait complete. 2024-09-11T23:20:09.569 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:09.706 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":747,"msgr_send_messages":745,"msgr_recv_bytes":313193,"msgr_send_bytes":803895,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.060851261,"msgr_running_send_time":0.019639944,"msgr_running_recv_time":0.020847775,"msgr_running_fast_dispatch_time":0.019451593,"msgr_send_messages_queue_lat":{"avgcount":745,"sum":0.412885500,"avgtime":0.000554208},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":109296,"msgr_send_encrypted_bytes":106672},"AsyncMessenger::Worker-1":{"msgr_recv_messages":10716,"msgr_send_messages":24405,"msgr_recv_bytes":3912385,"msgr_send_bytes":17343609,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":1.085818159,"msgr_running_send_time":0.593125757,"msgr_running_recv_time":0.530791655,"msgr_running_fast_dispatch_time":0.038164226,"msgr_send_messages_queue_lat":{"avgcount":24403,"sum":1.286627585,"avgtime":0.000052724},"msgr_handle_ack_lat":{"avgcount":29432,"sum":0.006522618,"avgtime":0.000000221},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":2221,"msgr_send_messages":2223,"msgr_recv_bytes":877568,"msgr_send_bytes":12524853,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.238386387,"msgr_running_send_time":0.132008904,"msgr_running_recv_time":0.032047774,"msgr_running_fast_dispatch_time":0.066762410,"msgr_send_messages_queue_lat":{"avgcount":2222,"sum":19.296105390,"avgtime":0.008684115},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":126,"sum":7.786671285,"avgtime":0.061798978}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4069,"sum":1.353367778,"avgtime":0.000332604}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.709675937,"avgtime":0.001670515},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":4658,"inodes_top":0,"inodes_bottom":4658,"inodes_pin_tail":0,"inodes_pinned":4658,"inodes_expired":0,"inodes_with_caps":1448,"caps":1448,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":564,"ceph_cap_op_grant":6959,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":9,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":833,"num_strays_delayed":833,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":2368,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":11992,"evex":11378,"evtrm":11378,"ev":617,"evexg":0,"evexd":11377,"segadd":15,"segex":16,"segtrm":16,"seg":1,"segmjr":1,"segexg":0,"segexd":15,"expos":27965114,"wrpos":28337430,"rdpos":4195244,"jlat":{"avgcount":23,"sum":4.004652057,"avgtime":0.174115306},"replayed":3},"mds_mem":{"ino":1460,"ino+":3214,"ino-":1754,"dir":13,"dir+":13,"dir-":0,"dn":1458,"dn+":6412,"dn-":4954,"cap":1,"cap+":3202,"cap-":3201,"rss":113460,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.549153069,"avgtime":0.549153069},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.245775968,"avgtime":0.001951804},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5808,"average_load":5808,"avg_session_uptime":1035,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":29569994,"buffer_anon_items":8218,"buffer_meta_bytes":176,"buffer_meta_items":2,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":14633029,"mds_co_items":151842,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":4000,"op_send_bytes":25415974,"op_resend":0,"op_reply":4000,"op_latency":{"avgcount":4000,"sum":221.141385126,"avgtime":0.055285346},"op_inflight":0,"oplen_avg":{"avgcount":4000,"sum":7004},"op":4000,"op_r":58,"op_w":3942,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1458,"osdop_read":30,"osdop_write":45,"osdop_writefull":16,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":2389,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2916,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":52,"omap_rd":48,"omap_del":13},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":2368,"pq_executed":2368,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":13679,"get_sum":3869022,"get_or_fail_fail":0,"get_or_fail_success":13679,"take":0,"take_sum":0,"put":13679,"put_sum":3869022,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4000,"take_sum":25656261,"put":4000,"put_sum":25656261,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4000,"take_sum":4000,"put":4000,"put_sum":4000,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":2368,"get_sum":239168,"get_or_fail_fail":0,"get_or_fail_success":2368,"take":0,"take_sum":0,"put":22,"put_sum":239168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":368635,"max":3758096384,"get_started":0,"get":11992,"get_sum":24141743,"get_or_fail_fail":0,"get_or_fail_success":11992,"take":0,"take_sum":0,"put":23,"put_sum":23773108,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:09.707 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 313193, "msgr_recv_encrypted_bytes": 109296, "msgr_recv_messages": 747, "msgr_running_fast_dispatch_time": 0.019451593, "msgr_running_recv_time": 0.020847775, "msgr_running_send_time": 0.019639944, "msgr_running_total_time": 0.060851261, "msgr_send_bytes": 803895, "msgr_send_encrypted_bytes": 106672, "msgr_send_messages": 745, "msgr_send_messages_queue_lat": { "avgcount": 745, "avgtime": 0.000554208, "sum": 0.4128855 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 29432, "avgtime": 2.21e-07, "sum": 0.006522618 }, "msgr_recv_bytes": 3912385, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 10716, "msgr_running_fast_dispatch_time": 0.038164226, "msgr_running_recv_time": 0.530791655, "msgr_running_send_time": 0.593125757, "msgr_running_total_time": 1.085818159, "msgr_send_bytes": 17343609, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 24405, "msgr_send_messages_queue_lat": { "avgcount": 24403, "avgtime": 5.2724e-05, "sum": 1.286627585 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 877568, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 2221, "msgr_running_fast_dispatch_time": 0.06676241, "msgr_running_recv_time": 0.032047774, "msgr_running_send_time": 0.132008904, "msgr_running_total_time": 0.238386387, "msgr_send_bytes": 12524853, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 2223, "msgr_send_messages_queue_lat": { "avgcount": 2222, "avgtime": 0.008684115, "sum": 19.29610539 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 126, "avgtime": 0.061798978, "sum": 7.786671285 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4069, "avgtime": 0.000332604, "sum": 1.353367778 }, "queue_len": 0 }, "mds": { "caps": 1448, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6959, "ceph_cap_op_revoke": 564, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 9, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4658, "inodes_bottom": 4658, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4658, "inodes_top": 0, "inodes_with_caps": 1448, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001670515, "sum": 10.709675937 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 833, "num_strays_delayed": 833, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 2368, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 617, "evadd": 11992, "evex": 11378, "evexd": 11377, "evexg": 0, "evlrg": 0, "evtrm": 11378, "expos": 27965114, "jlat": { "avgcount": 23, "avgtime": 0.174115306, "sum": 4.004652057 }, "rdpos": 4195244, "replayed": 3, "seg": 1, "segadd": 15, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 28337430 }, "mds_mem": { "cap": 1, "cap+": 3202, "cap-": 3201, "dir": 13, "dir+": 13, "dir-": 0, "dn": 1458, "dn+": 6412, "dn-": 4954, "heap": 248116, "ino": 1460, "ino+": 3214, "ino-": 1754, "rss": 113460 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.549153069, "sum": 0.549153069 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.001951804, "sum": 6.245775968 } }, "mds_sessions": { "average_load": 5808, "avg_session_uptime": 1035, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5808 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 29569994, "buffer_anon_items": 8218, "buffer_meta_bytes": 176, "buffer_meta_items": 2, "mds_co_bytes": 14633029, "mds_co_items": 151842, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 13, "omap_rd": 48, "omap_wr": 52, "op": 4000, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 4000, "avgtime": 0.055285346, "sum": 221.141385126 }, "op_pg": 0, "op_r": 58, "op_reply": 4000, "op_resend": 0, "op_rmw": 0, "op_send": 4000, "op_send_bytes": 25415974, "op_w": 3942, "oplen_avg": { "avgcount": 4000, "sum": 7004 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1458, "osdop_delete": 2389, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 30, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2916, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 45, "osdop_writefull": 16, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 2368, "pq_executed_ops": 2368, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 13679, "get_or_fail_fail": 0, "get_or_fail_success": 13679, "get_started": 0, "get_sum": 3869022, "max": 104857600, "put": 13679, "put_sum": 3869022, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 4000, "put_sum": 25656261, "take": 4000, "take_sum": 25656261, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 4000, "put_sum": 4000, "take": 4000, "take_sum": 4000, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 2368, "get_or_fail_fail": 0, "get_or_fail_success": 2368, "get_started": 0, "get_sum": 239168, "max": 3758096384, "put": 22, "put_sum": 239168, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 11992, "get_or_fail_fail": 0, "get_or_fail_success": 11992, "get_started": 0, "get_sum": 24141743, "max": 3758096384, "put": 23, "put_sum": 23773108, "take": 0, "take_sum": 0, "val": 368635, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:09.707 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/833, 2368/3201 2024-09-11T23:20:10.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:10.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd0652fe640 1 Processor -- start 2024-09-11T23:20:10.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd0652fe640 1 -- start start 2024-09-11T23:20:10.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd0652fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd0600cfa40 0x7fd0600cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd0652fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06006f330 0x7fd06006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd0652fe640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0600ce9e0 con 0x7fd06006d9c0 2024-09-11T23:20:10.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd0652fe640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd0600cec80 con 0x7fd0600cfa40 2024-09-11T23:20:10.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd0652fe640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0600cef60 con 0x7fd06006f330 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06006f330 0x7fd06006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05e7fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd0600cfa40 0x7fd0600cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06006f330 0x7fd06006f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49608/0 (socket says 172.21.15.94:49608) 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05effd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd06006d9c0 0x7fd06015d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:40738/0 (socket says 172.21.15.94:40738) 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05f7fe640 1 -- 172.21.15.94:0/4170312067 learned_addr learned my addr 172.21.15.94:0/4170312067 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05f7fe640 1 -- 172.21.15.94:0/4170312067 >> v2:172.21.15.155:3300/0 conn(0x7fd0600cfa40 msgr2=0x7fd0600cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05f7fe640 1 --2- 172.21.15.94:0/4170312067 >> v2:172.21.15.155:3300/0 conn(0x7fd0600cfa40 0x7fd0600cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05f7fe640 1 -- 172.21.15.94:0/4170312067 >> v1:172.21.15.155:6789/0 conn(0x7fd06006d9c0 legacy=0x7fd06015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.840+0000 7fd05f7fe640 1 -- 172.21.15.94:0/4170312067 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0600cf240 con 0x7fd06006f330 2024-09-11T23:20:10.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd05f7fe640 1 --2- 172.21.15.94:0/4170312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06006f330 0x7fd06006f7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd058009870 tx=0x7fd05801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2a1084229c98135 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd05dffb640 1 -- 172.21.15.94:0/4170312067 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580a95f0 con 0x7fd06006f330 2024-09-11T23:20:10.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd05dffb640 1 -- 172.21.15.94:0/4170312067 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0580a9790 con 0x7fd06006f330 2024-09-11T23:20:10.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd05dffb640 1 -- 172.21.15.94:0/4170312067 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580a9b60 con 0x7fd06006f330 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- 172.21.15.94:0/4170312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06006f330 msgr2=0x7fd06006f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 --2- 172.21.15.94:0/4170312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06006f330 0x7fd06006f7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd058009870 tx=0x7fd05801c530 comp rx=0 tx=0).stop 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- 172.21.15.94:0/4170312067 shutdown_connections 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 --2- 172.21.15.94:0/4170312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06006f330 0x7fd06006f7c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 --2- 172.21.15.94:0/4170312067 >> v2:172.21.15.155:3300/0 conn(0x7fd0600cfa40 0x7fd0600cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- 172.21.15.94:0/4170312067 >> 172.21.15.94:0/4170312067 conn(0x7fd0600b2890 msgr2=0x7fd0600b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- 172.21.15.94:0/4170312067 shutdown_connections 2024-09-11T23:20:10.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- 172.21.15.94:0/4170312067 wait complete. 2024-09-11T23:20:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 Processor -- start 2024-09-11T23:20:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- start start 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd06006d9c0 0x7fd0601645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd06006f330 0x7fd060165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0600cfa40 0x7fd06015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd06015e1a0 con 0x7fd06006d9c0 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd06015e020 con 0x7fd06006f330 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd0652fe640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd06015d3d0 con 0x7fd0600cfa40 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd05effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd06006d9c0 0x7fd0601645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd05effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd06006d9c0 0x7fd0601645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43172/0 (socket says 172.21.15.94:43172) 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.844+0000 7fd05effd640 1 -- 172.21.15.94:0/3710232089 learned_addr learned my addr 172.21.15.94:0/3710232089 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05f7fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0600cfa40 0x7fd06015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05e7fc640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd06006f330 0x7fd060165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05effd640 1 -- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0600cfa40 msgr2=0x7fd06015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05effd640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0600cfa40 0x7fd06015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05effd640 1 -- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd06006f330 msgr2=0x7fd060165ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05effd640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd06006f330 0x7fd060165ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05effd640 1 -- 172.21.15.94:0/3710232089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd060156120 con 0x7fd06006d9c0 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05effd640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd06006d9c0 0x7fd0601645f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c420 tx=0x7fd05000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0477fe640 1 -- 172.21.15.94:0/3710232089 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0500074e0 con 0x7fd06006d9c0 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0477fe640 1 -- 172.21.15.94:0/3710232089 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd050007680 con 0x7fd06006d9c0 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd060166780 con 0x7fd06006d9c0 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0477fe640 1 -- 172.21.15.94:0/3710232089 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050004a30 con 0x7fd06006d9c0 2024-09-11T23:20:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd060071950 con 0x7fd06006d9c0 2024-09-11T23:20:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06006f7c0 con 0x7fd06006d9c0 2024-09-11T23:20:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0477fe640 1 -- 172.21.15.94:0/3710232089 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd05001a020 con 0x7fd06006d9c0 2024-09-11T23:20:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0477fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd04c0678c0 0x7fd04c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd0477fe640 1 -- 172.21.15.94:0/3710232089 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fd050085660 con 0x7fd06006d9c0 2024-09-11T23:20:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.848+0000 7fd05e7fc640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd04c0678c0 0x7fd04c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.852+0000 7fd05e7fc640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd04c0678c0 0x7fd04c069d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd06015efb0 tx=0x7fd05400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:10.852+0000 7fd0477fe640 1 -- 172.21.15.94:0/3710232089 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd060156120 con 0x7fd06006d9c0 2024-09-11T23:20:11.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.052+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0600b6030 con 0x7fd06006d9c0 2024-09-11T23:20:11.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.052+0000 7fd0477fe640 1 -- 172.21.15.94:0/3710232089 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7fd050056010 con 0x7fd06006d9c0 2024-09-11T23:20:11.054 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:11.054 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:11.054 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:11.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd04c0678c0 msgr2=0x7fd04c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd04c0678c0 0x7fd04c069d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd06015efb0 tx=0x7fd05400b040 comp rx=0 tx=0).stop 2024-09-11T23:20:11.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd06006d9c0 msgr2=0x7fd0601645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd06006d9c0 0x7fd0601645f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c420 tx=0x7fd05000c8e0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 shutdown_connections 2024-09-11T23:20:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0600cfa40 0x7fd06015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd06006f330 0x7fd060165ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd04c0678c0 0x7fd04c069d80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 --2- 172.21.15.94:0/3710232089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd06006d9c0 0x7fd0601645f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 >> 172.21.15.94:0/3710232089 conn(0x7fd0600b2890 msgr2=0x7fd0600b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 shutdown_connections 2024-09-11T23:20:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.056+0000 7fd0652fe640 1 -- 172.21.15.94:0/3710232089 wait complete. 2024-09-11T23:20:11.074 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:11.210 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":893,"msgr_send_messages":891,"msgr_recv_bytes":350273,"msgr_send_bytes":851529,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.072348595,"msgr_running_send_time":0.023885389,"msgr_running_recv_time":0.023750659,"msgr_running_fast_dispatch_time":0.023028404,"msgr_send_messages_queue_lat":{"avgcount":891,"sum":0.419504760,"avgtime":0.000470824},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":109296,"msgr_send_encrypted_bytes":106672},"AsyncMessenger::Worker-1":{"msgr_recv_messages":10951,"msgr_send_messages":24638,"msgr_recv_bytes":3972395,"msgr_send_bytes":17419649,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":1.104368390,"msgr_running_send_time":0.599840283,"msgr_running_recv_time":0.535309086,"msgr_running_fast_dispatch_time":0.043931565,"msgr_send_messages_queue_lat":{"avgcount":24636,"sum":1.293621950,"avgtime":0.000052509},"msgr_handle_ack_lat":{"avgcount":29434,"sum":0.006522942,"avgtime":0.000000221},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":2684,"msgr_send_messages":2686,"msgr_recv_bytes":1079247,"msgr_send_bytes":13128503,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.276159216,"msgr_running_send_time":0.146847751,"msgr_running_recv_time":0.041228315,"msgr_running_fast_dispatch_time":0.078133593,"msgr_send_messages_queue_lat":{"avgcount":2685,"sum":19.315568134,"avgtime":0.007193880},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":129,"sum":7.937366485,"avgtime":0.061529972}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":5517,"sum":1.561175180,"avgtime":0.000282975}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.709675937,"avgtime":0.001670515},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":1458,"inodes_top":0,"inodes_bottom":1458,"inodes_pin_tail":0,"inodes_pinned":625,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":564,"ceph_cap_op_grant":6959,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":9,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":3201,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":12826,"evex":11378,"evtrm":11378,"ev":1451,"evexg":0,"evexd":11377,"segadd":16,"segex":16,"segtrm":16,"seg":2,"segmjr":1,"segexg":0,"segexd":15,"expos":27965114,"wrpos":28837294,"rdpos":4195244,"jlat":{"avgcount":24,"sum":4.012229415,"avgtime":0.167176225},"replayed":3},"mds_mem":{"ino":846,"ino+":3214,"ino-":2368,"dir":12,"dir+":13,"dir-":1,"dn":1458,"dn+":6412,"dn-":4954,"cap":1,"cap+":3202,"cap-":3201,"rss":113460,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.549153069,"avgtime":0.549153069},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.245775968,"avgtime":0.001951804},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5808,"average_load":5808,"avg_session_uptime":1040,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":5185242,"buffer_anon_items":1323,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":4450778,"mds_co_items":74453,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":4842,"op_send_bytes":25868874,"op_resend":0,"op_reply":4842,"op_latency":{"avgcount":4842,"sum":222.753366110,"avgtime":0.046004412},"op_inflight":0,"oplen_avg":{"avgcount":4842,"sum":7846},"op":4842,"op_r":61,"op_w":4781,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1458,"osdop_read":33,"osdop_write":49,"osdop_writefull":17,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":3222,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2916,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":53,"omap_rd":48,"omap_del":13},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":3201,"pq_executed":3201,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":14523,"get_sum":4091831,"get_or_fail_fail":0,"get_or_fail_success":14523,"take":0,"take_sum":0,"put":14523,"put_sum":4091831,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4842,"take_sum":26193294,"put":4842,"put_sum":26193294,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4842,"take_sum":4842,"put":4842,"put_sum":4842,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":3201,"get_sum":323301,"get_or_fail_fail":0,"get_or_fail_success":3201,"take":0,"take_sum":0,"put":25,"put_sum":323301,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":499864,"max":3758096384,"get_started":0,"get":12826,"get_sum":24641607,"get_or_fail_fail":0,"get_or_fail_success":12826,"take":0,"take_sum":0,"put":24,"put_sum":24141743,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:11.212 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 350273, "msgr_recv_encrypted_bytes": 109296, "msgr_recv_messages": 893, "msgr_running_fast_dispatch_time": 0.023028404, "msgr_running_recv_time": 0.023750659, "msgr_running_send_time": 0.023885389, "msgr_running_total_time": 0.072348595, "msgr_send_bytes": 851529, "msgr_send_encrypted_bytes": 106672, "msgr_send_messages": 891, "msgr_send_messages_queue_lat": { "avgcount": 891, "avgtime": 0.000470824, "sum": 0.41950476 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 29434, "avgtime": 2.21e-07, "sum": 0.006522942 }, "msgr_recv_bytes": 3972395, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 10951, "msgr_running_fast_dispatch_time": 0.043931565, "msgr_running_recv_time": 0.535309086, "msgr_running_send_time": 0.599840283, "msgr_running_total_time": 1.10436839, "msgr_send_bytes": 17419649, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 24638, "msgr_send_messages_queue_lat": { "avgcount": 24636, "avgtime": 5.2509e-05, "sum": 1.29362195 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1079247, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 2684, "msgr_running_fast_dispatch_time": 0.078133593, "msgr_running_recv_time": 0.041228315, "msgr_running_send_time": 0.146847751, "msgr_running_total_time": 0.276159216, "msgr_send_bytes": 13128503, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 2686, "msgr_send_messages_queue_lat": { "avgcount": 2685, "avgtime": 0.00719388, "sum": 19.315568134 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 129, "avgtime": 0.061529972, "sum": 7.937366485 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 5517, "avgtime": 0.000282975, "sum": 1.56117518 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6959, "ceph_cap_op_revoke": 564, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 9, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 1458, "inodes_bottom": 1458, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 625, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001670515, "sum": 10.709675937 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 3201, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 1451, "evadd": 12826, "evex": 11378, "evexd": 11377, "evexg": 0, "evlrg": 0, "evtrm": 11378, "expos": 27965114, "jlat": { "avgcount": 24, "avgtime": 0.167176225, "sum": 4.012229415 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 16, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 28837294 }, "mds_mem": { "cap": 1, "cap+": 3202, "cap-": 3201, "dir": 12, "dir+": 13, "dir-": 1, "dn": 1458, "dn+": 6412, "dn-": 4954, "heap": 248116, "ino": 846, "ino+": 3214, "ino-": 2368, "rss": 113460 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.549153069, "sum": 0.549153069 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.001951804, "sum": 6.245775968 } }, "mds_sessions": { "average_load": 5808, "avg_session_uptime": 1040, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5808 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 5185242, "buffer_anon_items": 1323, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 4450778, "mds_co_items": 74453, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 13, "omap_rd": 48, "omap_wr": 53, "op": 4842, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 4842, "avgtime": 0.046004412, "sum": 222.75336611 }, "op_pg": 0, "op_r": 61, "op_reply": 4842, "op_resend": 0, "op_rmw": 0, "op_send": 4842, "op_send_bytes": 25868874, "op_w": 4781, "oplen_avg": { "avgcount": 4842, "sum": 7846 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1458, "osdop_delete": 3222, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 33, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2916, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 49, "osdop_writefull": 17, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 3201, "pq_executed_ops": 3201, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 14523, "get_or_fail_fail": 0, "get_or_fail_success": 14523, "get_started": 0, "get_sum": 4091831, "max": 104857600, "put": 14523, "put_sum": 4091831, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 4842, "put_sum": 26193294, "take": 4842, "take_sum": 26193294, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 4842, "put_sum": 4842, "take": 4842, "take_sum": 4842, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 3201, "get_or_fail_fail": 0, "get_or_fail_success": 3201, "get_started": 0, "get_sum": 323301, "max": 3758096384, "put": 25, "put_sum": 323301, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 12826, "get_or_fail_fail": 0, "get_or_fail_success": 12826, "get_started": 0, "get_sum": 24641607, "max": 3758096384, "put": 24, "put_sum": 24141743, "take": 0, "take_sum": 0, "val": 499864, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:11.212 INFO:tasks.cephfs.test_strays:Complete purge in 8 seconds 2024-09-11T23:20:11.212 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.332+0000 7efe9ad0c640 1 Processor -- start 2024-09-11T23:20:11.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.332+0000 7efe9ad0c640 1 -- start start 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe9ad0c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9415e6f0 0x7efe940cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe9ad0c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efe940cfc00 0x7efe940d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe9ad0c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe940b7740 con 0x7efe940d3350 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe9ad0c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7efe940d3850 con 0x7efe940cfc00 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe9ad0c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe940d3b30 con 0x7efe9415e6f0 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efe940cfc00 0x7efe940d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efe940cfc00 0x7efe940d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43184/0 (socket says 172.21.15.94:43184) 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 -- 172.21.15.94:0/3393375414 learned_addr learned my addr 172.21.15.94:0/3393375414 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe98aa8640 1 --2- 172.21.15.94:0/3393375414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9415e6f0 0x7efe940cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 -- 172.21.15.94:0/3393375414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9415e6f0 msgr2=0x7efe940cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:11.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 --2- 172.21.15.94:0/3393375414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9415e6f0 0x7efe940cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 -- 172.21.15.94:0/3393375414 >> v1:172.21.15.155:6789/0 conn(0x7efe940d3350 legacy=0x7efe940b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 -- 172.21.15.94:0/3393375414 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe940d3e10 con 0x7efe940cfc00 2024-09-11T23:20:11.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe93fff640 1 --2- 172.21.15.94:0/3393375414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940cfc00 0x7efe940d0ec0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7efe88009870 tx=0x7efe8801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218b222a64b403d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:11.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe937fe640 1 -- 172.21.15.94:0/3393375414 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe880ab430 con 0x7efe940cfc00 2024-09-11T23:20:11.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe937fe640 1 -- 172.21.15.94:0/3393375414 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe880b0070 con 0x7efe940cfc00 2024-09-11T23:20:11.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.336+0000 7efe937fe640 1 -- 172.21.15.94:0/3393375414 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe880ab7f0 con 0x7efe940cfc00 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3393375414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940cfc00 msgr2=0x7efe940d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3393375414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940cfc00 0x7efe940d0ec0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7efe88009870 tx=0x7efe8801c4a0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3393375414 shutdown_connections 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3393375414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940cfc00 0x7efe940d0ec0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3393375414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9415e6f0 0x7efe940cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3393375414 >> 172.21.15.94:0/3393375414 conn(0x7efe940722a0 msgr2=0x7efe940726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3393375414 shutdown_connections 2024-09-11T23:20:11.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3393375414 wait complete. 2024-09-11T23:20:11.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 Processor -- start 2024-09-11T23:20:11.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- start start 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940d3350 0x7efe940c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415e6f0 0x7efe9414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940b40d0 0x7efe940b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efe9416b4d0 con 0x7efe940d3350 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe940d1810 con 0x7efe9415e6f0 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe9416b650 con 0x7efe940b40d0 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940d3350 0x7efe940c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940d3350 0x7efe940c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43190/0 (socket says 172.21.15.94:43190) 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 -- 172.21.15.94:0/3629450160 learned_addr learned my addr 172.21.15.94:0/3629450160 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:11.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe992a9640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940b40d0 0x7efe940b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe93fff640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415e6f0 0x7efe9414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 -- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940b40d0 msgr2=0x7efe940b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940b40d0 0x7efe940b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 -- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415e6f0 msgr2=0x7efe9414f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415e6f0 0x7efe9414f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 -- 172.21.15.94:0/3629450160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe940c86d0 con 0x7efe940d3350 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe98aa8640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940d3350 0x7efe940c8190 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efe8400d5f0 tx=0x7efe8400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe917fa640 1 -- 172.21.15.94:0/3629450160 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840125f0 con 0x7efe940d3350 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe917fa640 1 -- 172.21.15.94:0/3629450160 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe84019070 con 0x7efe940d3350 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe940cab20 con 0x7efe940d3350 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe917fa640 1 -- 172.21.15.94:0/3629450160 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840129d0 con 0x7efe940d3350 2024-09-11T23:20:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9414ef70 con 0x7efe940d3350 2024-09-11T23:20:11.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.340+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe940d0ec0 con 0x7efe940d3350 2024-09-11T23:20:11.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.344+0000 7efe917fa640 1 -- 172.21.15.94:0/3629450160 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe84012b70 con 0x7efe940d3350 2024-09-11T23:20:11.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.344+0000 7efe917fa640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efe800678c0 0x7efe80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:11.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.344+0000 7efe917fa640 1 -- 172.21.15.94:0/3629450160 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7efe84086ce0 con 0x7efe940d3350 2024-09-11T23:20:11.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.344+0000 7efe93fff640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efe800678c0 0x7efe80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:11.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.344+0000 7efe93fff640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efe800678c0 0x7efe80069d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efe880af000 tx=0x7efe880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:11.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.348+0000 7efe917fa640 1 -- 172.21.15.94:0/3629450160 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe940c86d0 con 0x7efe940d3350 2024-09-11T23:20:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.544+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe94157f40 con 0x7efe940d3350 2024-09-11T23:20:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe917fa640 1 -- 172.21.15.94:0/3629450160 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7efe84057770 con 0x7efe940d3350 2024-09-11T23:20:11.549 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:11.549 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:11.549 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efe800678c0 msgr2=0x7efe80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efe800678c0 0x7efe80069d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efe880af000 tx=0x7efe880a7000 comp rx=0 tx=0).stop 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940d3350 msgr2=0x7efe940c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940d3350 0x7efe940c8190 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efe8400d5f0 tx=0x7efe8400dab0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 shutdown_connections 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940b40d0 0x7efe940b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415e6f0 0x7efe9414f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efe800678c0 0x7efe80069d80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 --2- 172.21.15.94:0/3629450160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efe940d3350 0x7efe940c8190 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 >> 172.21.15.94:0/3629450160 conn(0x7efe940722a0 msgr2=0x7efe94158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 shutdown_connections 2024-09-11T23:20:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:11.548+0000 7efe9ad0c640 1 -- 172.21.15.94:0/3629450160 wait complete. 2024-09-11T23:20:11.568 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-11T23:20:11.696 INFO:teuthology.orchestra.run.smithi094.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":893,"msgr_send_messages":892,"msgr_recv_bytes":350273,"msgr_send_bytes":853337,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.072415162,"msgr_running_send_time":0.023945064,"msgr_running_recv_time":0.023750659,"msgr_running_fast_dispatch_time":0.023028404,"msgr_send_messages_queue_lat":{"avgcount":892,"sum":0.419558569,"avgtime":0.000470357},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000193,"avgtime":0.000000096},"msgr_recv_encrypted_bytes":109296,"msgr_send_encrypted_bytes":108480},"AsyncMessenger::Worker-1":{"msgr_recv_messages":10951,"msgr_send_messages":24638,"msgr_recv_bytes":3972395,"msgr_send_bytes":17419649,"msgr_created_connections":7,"msgr_active_connections":5,"msgr_running_total_time":1.104368390,"msgr_running_send_time":0.599840283,"msgr_running_recv_time":0.535309086,"msgr_running_fast_dispatch_time":0.043931565,"msgr_send_messages_queue_lat":{"avgcount":24636,"sum":1.293621950,"avgtime":0.000052509},"msgr_handle_ack_lat":{"avgcount":29434,"sum":0.006522942,"avgtime":0.000000221},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":78848},"AsyncMessenger::Worker-2":{"msgr_recv_messages":2684,"msgr_send_messages":2686,"msgr_recv_bytes":1079247,"msgr_send_bytes":13128503,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.276159216,"msgr_running_send_time":0.146847751,"msgr_running_recv_time":0.041228315,"msgr_running_fast_dispatch_time":0.078133593,"msgr_send_messages_queue_lat":{"avgcount":2685,"sum":19.315568134,"avgtime":0.007193880},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":129,"sum":7.937366485,"avgtime":0.061529972}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":5517,"sum":1.561175180,"avgtime":0.000282975}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.709675937,"avgtime":0.001670515},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":1458,"inodes_top":0,"inodes_bottom":1458,"inodes_pin_tail":0,"inodes_pinned":625,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":564,"ceph_cap_op_grant":6959,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":9,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":3201,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":12826,"evex":11378,"evtrm":11378,"ev":1451,"evexg":0,"evexd":11377,"segadd":16,"segex":16,"segtrm":16,"seg":2,"segmjr":1,"segexg":0,"segexd":15,"expos":27965114,"wrpos":28837294,"rdpos":4195244,"jlat":{"avgcount":24,"sum":4.012229415,"avgtime":0.167176225},"replayed":3},"mds_mem":{"ino":846,"ino+":3214,"ino-":2368,"dir":12,"dir+":13,"dir-":1,"dn":1458,"dn+":6412,"dn-":4954,"cap":1,"cap+":3202,"cap-":3201,"rss":113460,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.704614023,"avgtime":0.001157691},"req_getattr_latency":{"avgcount":6,"sum":0.002737501,"avgtime":0.000456250},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004219209,"avgtime":0.004219209},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.203176167,"avgtime":0.067725389},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.549153069,"avgtime":0.549153069},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.245775968,"avgtime":0.001951804},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5808,"average_load":5808,"avg_session_uptime":1040,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":5185242,"buffer_anon_items":1323,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":4450778,"mds_co_items":74453,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":4842,"op_send_bytes":25868874,"op_resend":0,"op_reply":4842,"op_latency":{"avgcount":4842,"sum":222.753366110,"avgtime":0.046004412},"op_inflight":0,"oplen_avg":{"avgcount":4842,"sum":7846},"op":4842,"op_r":61,"op_w":4781,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1458,"osdop_read":33,"osdop_write":49,"osdop_writefull":17,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":3222,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2916,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":104,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":53,"omap_rd":48,"omap_del":13},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":3201,"pq_executed":3201,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":14523,"get_sum":4091831,"get_or_fail_fail":0,"get_or_fail_success":14523,"take":0,"take_sum":0,"put":14523,"put_sum":4091831,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4842,"take_sum":26193294,"put":4842,"put_sum":26193294,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4842,"take_sum":4842,"put":4842,"put_sum":4842,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":3201,"get_sum":323301,"get_or_fail_fail":0,"get_or_fail_success":3201,"take":0,"take_sum":0,"put":25,"put_sum":323301,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x555b7b00ea00":{"val":499864,"max":3758096384,"get_started":0,"get":12826,"get_sum":24641607,"get_or_fail_fail":0,"get_or_fail_success":12826,"take":0,"take_sum":0,"put":24,"put_sum":24141743,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-11T23:20:11.697 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 9.6e-08, "sum": 1.93e-07 }, "msgr_recv_bytes": 350273, "msgr_recv_encrypted_bytes": 109296, "msgr_recv_messages": 893, "msgr_running_fast_dispatch_time": 0.023028404, "msgr_running_recv_time": 0.023750659, "msgr_running_send_time": 0.023945064, "msgr_running_total_time": 0.072415162, "msgr_send_bytes": 853337, "msgr_send_encrypted_bytes": 108480, "msgr_send_messages": 892, "msgr_send_messages_queue_lat": { "avgcount": 892, "avgtime": 0.000470357, "sum": 0.419558569 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 29434, "avgtime": 2.21e-07, "sum": 0.006522942 }, "msgr_recv_bytes": 3972395, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 10951, "msgr_running_fast_dispatch_time": 0.043931565, "msgr_running_recv_time": 0.535309086, "msgr_running_send_time": 0.599840283, "msgr_running_total_time": 1.10436839, "msgr_send_bytes": 17419649, "msgr_send_encrypted_bytes": 78848, "msgr_send_messages": 24638, "msgr_send_messages_queue_lat": { "avgcount": 24636, "avgtime": 5.2509e-05, "sum": 1.29362195 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1079247, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 2684, "msgr_running_fast_dispatch_time": 0.078133593, "msgr_running_recv_time": 0.041228315, "msgr_running_send_time": 0.146847751, "msgr_running_total_time": 0.276159216, "msgr_send_bytes": 13128503, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 2686, "msgr_send_messages_queue_lat": { "avgcount": 2685, "avgtime": 0.00719388, "sum": 19.315568134 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 129, "avgtime": 0.061529972, "sum": 7.937366485 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 5517, "avgtime": 0.000282975, "sum": 1.56117518 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6959, "ceph_cap_op_revoke": 564, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 9, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 1458, "inodes_bottom": 1458, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 625, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001670515, "sum": 10.709675937 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 3201, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 1451, "evadd": 12826, "evex": 11378, "evexd": 11377, "evexg": 0, "evlrg": 0, "evtrm": 11378, "expos": 27965114, "jlat": { "avgcount": 24, "avgtime": 0.167176225, "sum": 4.012229415 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 16, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 28837294 }, "mds_mem": { "cap": 1, "cap+": 3202, "cap-": 3201, "dir": 12, "dir+": 13, "dir-": 1, "dn": 1458, "dn+": 6412, "dn-": 4954, "heap": 248116, "ino": 846, "ino+": 3214, "ino-": 2368, "rss": 113460 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001157691, "sum": 3.704614023 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.00045625, "sum": 0.002737501 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004219209, "sum": 0.004219209 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.067725389, "sum": 0.203176167 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.549153069, "sum": 0.549153069 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.001951804, "sum": 6.245775968 } }, "mds_sessions": { "average_load": 5808, "avg_session_uptime": 1040, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5808 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 5185242, "buffer_anon_items": 1323, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 4450778, "mds_co_items": 74453, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 104, "map_full": 0, "map_inc": 2, "omap_del": 13, "omap_rd": 48, "omap_wr": 53, "op": 4842, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 4842, "avgtime": 0.046004412, "sum": 222.75336611 }, "op_pg": 0, "op_r": 61, "op_reply": 4842, "op_resend": 0, "op_rmw": 0, "op_send": 4842, "op_send_bytes": 25868874, "op_w": 4781, "oplen_avg": { "avgcount": 4842, "sum": 7846 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1458, "osdop_delete": 3222, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 33, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2916, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 49, "osdop_writefull": 17, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 3201, "pq_executed_ops": 3201, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 14523, "get_or_fail_fail": 0, "get_or_fail_success": 14523, "get_started": 0, "get_sum": 4091831, "max": 104857600, "put": 14523, "put_sum": 4091831, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 4842, "put_sum": 26193294, "take": 4842, "take_sum": 26193294, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 4842, "put_sum": 4842, "take": 4842, "take_sum": 4842, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 3201, "get_or_fail_fail": 0, "get_or_fail_success": 3201, "get_started": 0, "get_sum": 323301, "max": 3758096384, "put": 25, "put_sum": 323301, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x555b7b00ea00": { "get": 12826, "get_or_fail_fail": 0, "get_or_fail_success": 12826, "get_started": 0, "get_sum": 24641607, "max": 3758096384, "put": 24, "put_sum": 24141743, "take": 0, "take_sum": 0, "val": 499864, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-11T23:20:11.698 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:20:11.698 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:11.781 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:11.824 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:20:11.824 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:11.824 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:11.824 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:11.830 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:20:12.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bfaa0640 1 Processor -- start 2024-09-11T23:20:12.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bfaa0640 1 -- start start 2024-09-11T23:20:12.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bfaa0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f64b80d0420 0x7f64b80d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bfaa0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f64b80b4a60 0x7f64b80cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bfaa0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b815c6b0 con 0x7f64b80b3160 2024-09-11T23:20:12.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bfaa0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f64b80b5240 con 0x7f64b80b4a60 2024-09-11T23:20:12.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bfaa0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f64b80b4f60 con 0x7f64b80d0420 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd03b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f64b80b4a60 0x7f64b80cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd03b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f64b80b4a60 0x7f64b80cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43198/0 (socket says 172.21.15.94:43198) 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd03b640 1 -- 172.21.15.94:0/4214461278 learned_addr learned my addr 172.21.15.94:0/4214461278 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64be03d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f64b80b3160 0x7f64b80b3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56166/0 (socket says 172.21.15.94:56166) 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd83c640 1 --2- 172.21.15.94:0/4214461278 >> v2:172.21.15.155:3300/0 conn(0x7f64b80d0420 0x7f64b80d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd03b640 1 -- 172.21.15.94:0/4214461278 >> v2:172.21.15.155:3300/0 conn(0x7f64b80d0420 msgr2=0x7f64b80d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd03b640 1 --2- 172.21.15.94:0/4214461278 >> v2:172.21.15.155:3300/0 conn(0x7f64b80d0420 0x7f64b80d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd03b640 1 -- 172.21.15.94:0/4214461278 >> v1:172.21.15.94:6789/0 conn(0x7f64b80b3160 legacy=0x7f64b80b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd03b640 1 -- 172.21.15.94:0/4214461278 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b806dab0 con 0x7f64b80b4a60 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bc83a640 1 -- 172.21.15.94:0/4214461278 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108544531 0 0) 0x7f64b815c6b0 con 0x7f64b80b3160 2024-09-11T23:20:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.000+0000 7f64bd83c640 1 --2- 172.21.15.94:0/4214461278 >> v2:172.21.15.155:3300/0 conn(0x7f64b80d0420 0x7f64b80d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bd03b640 1 --2- 172.21.15.94:0/4214461278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80b4a60 0x7f64b80cc930 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f64b806f3b0 tx=0x7f64ac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2036b81c5008306f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bc83a640 1 -- 172.21.15.94:0/4214461278 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0a57a0 con 0x7f64b80b4a60 2024-09-11T23:20:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bc83a640 1 -- 172.21.15.94:0/4214461278 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac0a5940 con 0x7f64b80b4a60 2024-09-11T23:20:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bc83a640 1 -- 172.21.15.94:0/4214461278 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0a5d10 con 0x7f64b80b4a60 2024-09-11T23:20:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- 172.21.15.94:0/4214461278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80b4a60 msgr2=0x7f64b80cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/4214461278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80b4a60 0x7f64b80cc930 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f64b806f3b0 tx=0x7f64ac01c9f0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- 172.21.15.94:0/4214461278 shutdown_connections 2024-09-11T23:20:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/4214461278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80b4a60 0x7f64b80cc930 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/4214461278 >> v2:172.21.15.155:3300/0 conn(0x7f64b80d0420 0x7f64b80d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- 172.21.15.94:0/4214461278 >> 172.21.15.94:0/4214461278 conn(0x7f64b8075200 msgr2=0x7f64b8075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- 172.21.15.94:0/4214461278 shutdown_connections 2024-09-11T23:20:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- 172.21.15.94:0/4214461278 wait complete. 2024-09-11T23:20:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 Processor -- start 2024-09-11T23:20:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- start start 2024-09-11T23:20:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b80b3160 0x7f64b8158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64b80b4a60 0x7f64b815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80d0420 0x7f64b815d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f64b80ccff0 con 0x7f64b80d0420 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64b80cce70 con 0x7f64b80b3160 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bfaa0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64b81696d0 con 0x7f64b80b4a60 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64be03d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80d0420 0x7f64b815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64be03d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80d0420 0x7f64b815d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43206/0 (socket says 172.21.15.94:43206) 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64be03d640 1 -- 172.21.15.94:0/1711198561 learned_addr learned my addr 172.21.15.94:0/1711198561 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bd83c640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b80b3160 0x7f64b8158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.004+0000 7f64bd03b640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64b80b4a60 0x7f64b815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64be03d640 1 -- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64b80b4a60 msgr2=0x7f64b815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64be03d640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64b80b4a60 0x7f64b815a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64be03d640 1 -- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b80b3160 msgr2=0x7f64b8158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64be03d640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b80b3160 0x7f64b8158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64be03d640 1 -- 172.21.15.94:0/1711198561 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b815a8d0 con 0x7f64b80d0420 2024-09-11T23:20:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64be03d640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80d0420 0x7f64b815d960 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f64b000c3e0 tx=0x7f64b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64b67fc640 1 -- 172.21.15.94:0/1711198561 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00074e0 con 0x7f64b80d0420 2024-09-11T23:20:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64b67fc640 1 -- 172.21.15.94:0/1711198561 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b00047f0 con 0x7f64b80d0420 2024-09-11T23:20:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b815abf0 con 0x7f64b80d0420 2024-09-11T23:20:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64b67fc640 1 -- 172.21.15.94:0/1711198561 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b0004be0 con 0x7f64b80d0420 2024-09-11T23:20:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b80728f0 con 0x7f64b80d0420 2024-09-11T23:20:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b815bcc0 con 0x7f64b80d0420 2024-09-11T23:20:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64b67fc640 1 -- 172.21.15.94:0/1711198561 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f64b0011070 con 0x7f64b80d0420 2024-09-11T23:20:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64b67fc640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f64a40678c0 0x7f64a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64b67fc640 1 -- 172.21.15.94:0/1711198561 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f64b00859b0 con 0x7f64b80d0420 2024-09-11T23:20:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64bd83c640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f64a40678c0 0x7f64a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.008+0000 7f64bd83c640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f64a40678c0 0x7f64a4069d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f64b8072280 tx=0x7f64a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.012+0000 7f64b67fc640 1 -- 172.21.15.94:0/1711198561 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f64b815abf0 con 0x7f64b80d0420 2024-09-11T23:20:12.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.172+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f64b80d0800 con 0x7f64b80d0420 2024-09-11T23:20:12.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64b67fc640 1 -- 172.21.15.94:0/1711198561 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v104) ==== 80+0+122 (secure 0 0 0) 0x7f64b0056360 con 0x7f64b80d0420 2024-09-11T23:20:12.176 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94:6835/3585698004 2024-09-12T23:19:44.615685+0000 2024-09-11T23:20:12.176 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94:6834/3585698004 2024-09-12T23:19:44.615685+0000 2024-09-11T23:20:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:listed 2 entries 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f64a40678c0 msgr2=0x7f64a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f64a40678c0 0x7f64a4069d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f64b8072280 tx=0x7f64a8008040 comp rx=0 tx=0).stop 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80d0420 msgr2=0x7f64b815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80d0420 0x7f64b815d960 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f64b000c3e0 tx=0x7f64b000c8a0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 shutdown_connections 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f64a40678c0 0x7f64a4069d80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64b80d0420 0x7f64b815d960 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64b80b4a60 0x7f64b815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 --2- 172.21.15.94:0/1711198561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b80b3160 0x7f64b8158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 >> 172.21.15.94:0/1711198561 conn(0x7f64b8075200 msgr2=0x7f64b80b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 shutdown_connections 2024-09-11T23:20:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.176+0000 7f64bfaa0640 1 -- 172.21.15.94:0/1711198561 wait complete. 2024-09-11T23:20:12.193 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:20:12.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:12.193 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:12.202 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[45061]: fuse finished with error 0 and tester_r 0 2024-09-11T23:20:12.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:20:12.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:12.204 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:20:12.335 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:12.335 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:12.336 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:12.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:12.344 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:20:12.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:12.344 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:20:12.390 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T23:20:12.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:20:12.391 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:12.391 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:12.392 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:12.397 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:12.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:20:12.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:12.397 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:20:12.444 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T23:20:12.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:20:12.445 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:12.445 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:12.445 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:12.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:12.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:20:12.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:12.451 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:20:12.498 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T23:20:12.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:20:12.499 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:12.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa82e065640 1 Processor -- start 2024-09-11T23:20:12.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa82e065640 1 -- start start 2024-09-11T23:20:12.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa82e065640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa8280d3350 0x7fa8280d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa82e065640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa8280d1400 0x7fa8280b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa82e065640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8280b7740 con 0x7fa82815e6f0 2024-09-11T23:20:12.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa82e065640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa8280d1810 con 0x7fa8280d3350 2024-09-11T23:20:12.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa82e065640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa8280cfdd0 con 0x7fa8280d1400 2024-09-11T23:20:12.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa81ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa8280d3350 0x7fa8280d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa81ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa8280d3350 0x7fa8280d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43220/0 (socket says 172.21.15.94:43220) 2024-09-11T23:20:12.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa81ffff640 1 -- 172.21.15.94:0/3378451048 learned_addr learned my addr 172.21.15.94:0/3378451048 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:12.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa827fff640 1 --2- 172.21.15.94:0/3378451048 >> v2:172.21.15.155:3300/0 conn(0x7fa8280d1400 0x7fa8280b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa81ffff640 1 -- 172.21.15.94:0/3378451048 >> v2:172.21.15.155:3300/0 conn(0x7fa8280d1400 msgr2=0x7fa8280b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:12.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa81ffff640 1 --2- 172.21.15.94:0/3378451048 >> v2:172.21.15.155:3300/0 conn(0x7fa8280d1400 0x7fa8280b7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa81ffff640 1 -- 172.21.15.94:0/3378451048 >> v1:172.21.15.155:6789/0 conn(0x7fa82815e6f0 legacy=0x7fa8280cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:12.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.620+0000 7fa81ffff640 1 -- 172.21.15.94:0/3378451048 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8280d3850 con 0x7fa8280d3350 2024-09-11T23:20:12.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa81ffff640 1 --2- 172.21.15.94:0/3378451048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa8280d0ec0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa8280ce830 tx=0x7fa81001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c999c77277869de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa826ffd640 1 -- 172.21.15.94:0/3378451048 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ab600 con 0x7fa8280d3350 2024-09-11T23:20:12.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa826ffd640 1 -- 172.21.15.94:0/3378451048 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8100b0070 con 0x7fa8280d3350 2024-09-11T23:20:12.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa826ffd640 1 -- 172.21.15.94:0/3378451048 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ab9c0 con 0x7fa8280d3350 2024-09-11T23:20:12.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 -- 172.21.15.94:0/3378451048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 msgr2=0x7fa8280d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 --2- 172.21.15.94:0/3378451048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa8280d0ec0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa8280ce830 tx=0x7fa81001c400 comp rx=0 tx=0).stop 2024-09-11T23:20:12.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 -- 172.21.15.94:0/3378451048 shutdown_connections 2024-09-11T23:20:12.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 --2- 172.21.15.94:0/3378451048 >> v2:172.21.15.155:3300/0 conn(0x7fa8280d1400 0x7fa8280b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 --2- 172.21.15.94:0/3378451048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa8280d0ec0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 -- 172.21.15.94:0/3378451048 >> 172.21.15.94:0/3378451048 conn(0x7fa8280722a0 msgr2=0x7fa8280726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:12.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 -- 172.21.15.94:0/3378451048 shutdown_connections 2024-09-11T23:20:12.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 -- 172.21.15.94:0/3378451048 wait complete. 2024-09-11T23:20:12.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 Processor -- start 2024-09-11T23:20:12.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.624+0000 7fa82e065640 1 -- start start 2024-09-11T23:20:12.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8280d1400 0x7fa82814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa82815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82815e6f0 0x7fa8280b9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa8280b8970 con 0x7fa8280d3350 2024-09-11T23:20:12.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa82815ead0 con 0x7fa8280d1400 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa8280b8af0 con 0x7fa82815e6f0 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa82815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa82815f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43234/0 (socket says 172.21.15.94:43234) 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 -- 172.21.15.94:0/2538327962 learned_addr learned my addr 172.21.15.94:0/2538327962 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa8277fe640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8280d1400 0x7fa82814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa827fff640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82815e6f0 0x7fa8280b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 -- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82815e6f0 msgr2=0x7fa8280b9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82815e6f0 0x7fa8280b9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 -- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8280d1400 msgr2=0x7fa82814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8280d1400 0x7fa82814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 -- 172.21.15.94:0/2538327962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82814e000 con 0x7fa8280d3350 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa81ffff640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa82815f660 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa81001a030 tx=0x7fa81001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa824ff9640 1 -- 172.21.15.94:0/2538327962 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b4800 con 0x7fa8280d3350 2024-09-11T23:20:12.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa824ff9640 1 -- 172.21.15.94:0/2538327962 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8100b49c0 con 0x7fa8280d3350 2024-09-11T23:20:12.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82815ff20 con 0x7fa8280d3350 2024-09-11T23:20:12.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa824ff9640 1 -- 172.21.15.94:0/2538327962 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b4db0 con 0x7fa8280d3350 2024-09-11T23:20:12.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8281604e0 con 0x7fa8280d3350 2024-09-11T23:20:12.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8280b8e80 con 0x7fa8280d3350 2024-09-11T23:20:12.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa824ff9640 1 -- 172.21.15.94:0/2538327962 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8100aa070 con 0x7fa8280d3350 2024-09-11T23:20:12.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa824ff9640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa8080678c0 0x7fa808069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa824ff9640 1 -- 172.21.15.94:0/2538327962 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fa81011ff30 con 0x7fa8280d3350 2024-09-11T23:20:12.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.628+0000 7fa8277fe640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa8080678c0 0x7fa808069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.632+0000 7fa8277fe640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa8080678c0 0x7fa808069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa81800b810 tx=0x7fa818008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.632+0000 7fa824ff9640 1 -- 172.21.15.94:0/2538327962 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa8100c4060 con 0x7fa8280d3350 2024-09-11T23:20:12.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8280b8e80 con 0x7fa8280d3350 2024-09-11T23:20:12.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa824ff9640 1 -- 172.21.15.94:0/2538327962 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7fa8100160b0 con 0x7fa8280d3350 2024-09-11T23:20:12.833 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:12.833 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:12.834 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:12.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa8080678c0 msgr2=0x7fa808069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa8080678c0 0x7fa808069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa81800b810 tx=0x7fa818008040 comp rx=0 tx=0).stop 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 msgr2=0x7fa82815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa82815f660 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa81001a030 tx=0x7fa81001ac40 comp rx=0 tx=0).stop 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 shutdown_connections 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa82815e6f0 0x7fa8280b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa8080678c0 0x7fa808069d80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8280d3350 0x7fa82815f660 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 --2- 172.21.15.94:0/2538327962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8280d1400 0x7fa82814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.832+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 >> 172.21.15.94:0/2538327962 conn(0x7fa8280722a0 msgr2=0x7fa82814e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.836+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 shutdown_connections 2024-09-11T23:20:12.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.836+0000 7fa82e065640 1 -- 172.21.15.94:0/2538327962 wait complete. 2024-09-11T23:20:12.852 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:12.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.968+0000 7f9070e4a640 1 Processor -- start 2024-09-11T23:20:12.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.968+0000 7f9070e4a640 1 -- start start 2024-09-11T23:20:12.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f906c0ad260 0x7f906c0b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 0x7f906c0adf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f906c0b3dd0 con 0x7f906c15aa40 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f906c0b3b80 con 0x7f906c0ad260 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f906c0b40b0 con 0x7f906c0adae0 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f906c0ad260 0x7f906c0b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f906c0ad260 0x7f906c0b4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43240/0 (socket says 172.21.15.94:43240) 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 -- 172.21.15.94:0/625966709 learned_addr learned my addr 172.21.15.94:0/625966709 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f906a59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f906c15aa40 0x7f906c15b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56176/0 (socket says 172.21.15.94:56176) 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f906ad9d640 1 --2- 172.21.15.94:0/625966709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 0x7f906c0adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 -- 172.21.15.94:0/625966709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 msgr2=0x7f906c0adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 --2- 172.21.15.94:0/625966709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 0x7f906c0adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 -- 172.21.15.94:0/625966709 >> v1:172.21.15.94:6789/0 conn(0x7f906c15aa40 legacy=0x7f906c15b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f906959a640 1 -- 172.21.15.94:0/625966709 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523328077 0 0) 0x7f906c0b3dd0 con 0x7f906c15aa40 2024-09-11T23:20:12.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 -- 172.21.15.94:0/625966709 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c0b4390 con 0x7f906c0ad260 2024-09-11T23:20:12.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9069d9b640 1 --2- 172.21.15.94:0/625966709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c0ad260 0x7f906c0b4e70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9054009870 tx=0x7f905401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd8e0fedbd5500b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f906959a640 1 -- 172.21.15.94:0/625966709 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90540b0070 con 0x7f906c0ad260 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f906959a640 1 -- 172.21.15.94:0/625966709 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90540ab600 con 0x7f906c0ad260 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f906959a640 1 -- 172.21.15.94:0/625966709 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90540ab9d0 con 0x7f906c0ad260 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 -- 172.21.15.94:0/625966709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c0ad260 msgr2=0x7f906c0b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 --2- 172.21.15.94:0/625966709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c0ad260 0x7f906c0b4e70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9054009870 tx=0x7f905401c560 comp rx=0 tx=0).stop 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 -- 172.21.15.94:0/625966709 shutdown_connections 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 --2- 172.21.15.94:0/625966709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 0x7f906c0adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.972+0000 7f9070e4a640 1 --2- 172.21.15.94:0/625966709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c0ad260 0x7f906c0b4e70 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- 172.21.15.94:0/625966709 >> 172.21.15.94:0/625966709 conn(0x7f906c075200 msgr2=0x7f906c075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- 172.21.15.94:0/625966709 shutdown_connections 2024-09-11T23:20:12.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- 172.21.15.94:0/625966709 wait complete. 2024-09-11T23:20:12.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 Processor -- start 2024-09-11T23:20:12.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- start start 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 0x7f906c163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c15aa40 0x7f906c165820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c14fb40 0x7f906c146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f906c06d310 con 0x7f906c14fb40 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f906c06d190 con 0x7f906c15aa40 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f906c06d490 con 0x7f906c0adae0 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c14fb40 0x7f906c146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c14fb40 0x7f906c146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43250/0 (socket says 172.21.15.94:43250) 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 -- 172.21.15.94:0/2751477133 learned_addr learned my addr 172.21.15.94:0/2751477133 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 -- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 msgr2=0x7f906c163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 0x7f906c163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 -- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c15aa40 msgr2=0x7f906c165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9069d9b640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c15aa40 0x7f906c165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c15aa40 0x7f906c165820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 -- 172.21.15.94:0/2751477133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c150fd0 con 0x7f906c14fb40 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f906ad9d640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c14fb40 0x7f906c146510 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f906400efc0 tx=0x7f906400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9062ffd640 1 -- 172.21.15.94:0/2751477133 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064018020 con 0x7f906c14fb40 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9062ffd640 1 -- 172.21.15.94:0/2751477133 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9064014480 con 0x7f906c14fb40 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906c163240 con 0x7f906c14fb40 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9062ffd640 1 -- 172.21.15.94:0/2751477133 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064014870 con 0x7f906c14fb40 2024-09-11T23:20:12.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906c150cf0 con 0x7f906c14fb40 2024-09-11T23:20:12.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.976+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906c0b4e70 con 0x7f906c14fb40 2024-09-11T23:20:12.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.980+0000 7f9062ffd640 1 -- 172.21.15.94:0/2751477133 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f906401b020 con 0x7f906c14fb40 2024-09-11T23:20:12.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.980+0000 7f9062ffd640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f904c0678c0 0x7f904c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:12.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.980+0000 7f9062ffd640 1 -- 172.21.15.94:0/2751477133 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f9064087030 con 0x7f906c14fb40 2024-09-11T23:20:12.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.980+0000 7f906a59c640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f904c0678c0 0x7f904c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:12.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.980+0000 7f906a59c640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f904c0678c0 0x7f904c069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f906c0b2b10 tx=0x7f905c007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:12.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:12.984+0000 7f9062ffd640 1 -- 172.21.15.94:0/2751477133 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9064022070 con 0x7f906c14fb40 2024-09-11T23:20:13.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.180+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f906c151930 con 0x7f906c14fb40 2024-09-11T23:20:13.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.180+0000 7f9062ffd640 1 -- 172.21.15.94:0/2751477133 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7f9064010040 con 0x7f906c14fb40 2024-09-11T23:20:13.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:13.182 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:13.182 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:13.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f904c0678c0 msgr2=0x7f904c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f904c0678c0 0x7f904c069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f906c0b2b10 tx=0x7f905c007970 comp rx=0 tx=0).stop 2024-09-11T23:20:13.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c14fb40 msgr2=0x7f906c146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c14fb40 0x7f906c146510 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f906400efc0 tx=0x7f906400c490 comp rx=0 tx=0).stop 2024-09-11T23:20:13.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 shutdown_connections 2024-09-11T23:20:13.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f904c0678c0 0x7f904c069d80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906c14fb40 0x7f906c146510 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c15aa40 0x7f906c165820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 --2- 172.21.15.94:0/2751477133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c0adae0 0x7f906c163720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 >> 172.21.15.94:0/2751477133 conn(0x7f906c075200 msgr2=0x7f906c15c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:13.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 shutdown_connections 2024-09-11T23:20:13.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.184+0000 7f9070e4a640 1 -- 172.21.15.94:0/2751477133 wait complete. 2024-09-11T23:20:13.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:13.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef20648640 1 Processor -- start 2024-09-11T23:20:13.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef20648640 1 -- start start 2024-09-11T23:20:13.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef20648640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef180d0420 0x7fef180b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef20648640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef180ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef20648640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef180ad390 con 0x7fef180b3160 2024-09-11T23:20:13.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef20648640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fef180ad140 con 0x7fef180d0420 2024-09-11T23:20:13.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef20648640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef180ad670 con 0x7fef180cd370 2024-09-11T23:20:13.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1ebe5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef180ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1e3e4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef180d0420 0x7fef180b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1ebe5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef180ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49678/0 (socket says 172.21.15.94:49678) 2024-09-11T23:20:13.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1ebe5640 1 -- 172.21.15.94:0/2984750126 learned_addr learned my addr 172.21.15.94:0/2984750126 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:13.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1ebe5640 1 -- 172.21.15.94:0/2984750126 >> v2:172.21.15.155:3300/0 conn(0x7fef180d0420 msgr2=0x7fef180b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:13.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1ebe5640 1 --2- 172.21.15.94:0/2984750126 >> v2:172.21.15.155:3300/0 conn(0x7fef180d0420 0x7fef180b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1ebe5640 1 -- 172.21.15.94:0/2984750126 >> v1:172.21.15.155:6789/0 conn(0x7fef180b3160 legacy=0x7fef180d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.316+0000 7fef1ebe5640 1 -- 172.21.15.94:0/2984750126 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef180ad950 con 0x7fef180cd370 2024-09-11T23:20:13.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef1ebe5640 1 --2- 172.21.15.94:0/2984750126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef180ae150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef10009870 tx=0x7fef1001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3be4f98d7d347e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef1d3e2640 1 -- 172.21.15.94:0/2984750126 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef100b1070 con 0x7fef180cd370 2024-09-11T23:20:13.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef1d3e2640 1 -- 172.21.15.94:0/2984750126 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef100a8050 con 0x7fef180cd370 2024-09-11T23:20:13.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef1d3e2640 1 -- 172.21.15.94:0/2984750126 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef100ac860 con 0x7fef180cd370 2024-09-11T23:20:13.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 -- 172.21.15.94:0/2984750126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 msgr2=0x7fef180ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 --2- 172.21.15.94:0/2984750126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef180ae150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef10009870 tx=0x7fef1001c4d0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 -- 172.21.15.94:0/2984750126 shutdown_connections 2024-09-11T23:20:13.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 --2- 172.21.15.94:0/2984750126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef180ae150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 --2- 172.21.15.94:0/2984750126 >> v2:172.21.15.155:3300/0 conn(0x7fef180d0420 0x7fef180b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 -- 172.21.15.94:0/2984750126 >> 172.21.15.94:0/2984750126 conn(0x7fef18075200 msgr2=0x7fef18075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:13.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 -- 172.21.15.94:0/2984750126 shutdown_connections 2024-09-11T23:20:13.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 -- 172.21.15.94:0/2984750126 wait complete. 2024-09-11T23:20:13.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 Processor -- start 2024-09-11T23:20:13.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.320+0000 7fef20648640 1 -- start start 2024-09-11T23:20:13.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef180b3160 0x7fef18146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef1814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef180d0420 0x7fef1814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef18168660 con 0x7fef180d0420 2024-09-11T23:20:13.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef181687e0 con 0x7fef180b3160 2024-09-11T23:20:13.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef18168960 con 0x7fef180cd370 2024-09-11T23:20:13.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef180d0420 0x7fef1814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef180d0420 0x7fef1814e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43256/0 (socket says 172.21.15.94:43256) 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 -- 172.21.15.94:0/106131899 learned_addr learned my addr 172.21.15.94:0/106131899 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1dbe3640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef1814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1e3e4640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef180b3160 0x7fef18146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 -- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 msgr2=0x7fef1814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef1814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 -- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef180b3160 msgr2=0x7fef18146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef180b3160 0x7fef18146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 -- 172.21.15.94:0/106131899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef18146b90 con 0x7fef180d0420 2024-09-11T23:20:13.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1dbe3640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef1814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:13.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef1ebe5640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef180d0420 0x7fef1814e230 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fef1001a100 tx=0x7fef10019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef0effd640 1 -- 172.21.15.94:0/106131899 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef100b9070 con 0x7fef180d0420 2024-09-11T23:20:13.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef0effd640 1 -- 172.21.15.94:0/106131899 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef100acdd0 con 0x7fef180d0420 2024-09-11T23:20:13.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef0effd640 1 -- 172.21.15.94:0/106131899 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef100b1040 con 0x7fef180d0420 2024-09-11T23:20:13.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1814d190 con 0x7fef180d0420 2024-09-11T23:20:13.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1814d750 con 0x7fef180d0420 2024-09-11T23:20:13.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.324+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef180aecb0 con 0x7fef180d0420 2024-09-11T23:20:13.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.328+0000 7fef0effd640 1 -- 172.21.15.94:0/106131899 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef100bc070 con 0x7fef180d0420 2024-09-11T23:20:13.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.328+0000 7fef0effd640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feefc0678c0 0x7feefc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.328+0000 7fef0effd640 1 -- 172.21.15.94:0/106131899 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fef1011fa60 con 0x7fef180d0420 2024-09-11T23:20:13.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.328+0000 7fef1e3e4640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feefc0678c0 0x7feefc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.328+0000 7fef1e3e4640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feefc0678c0 0x7feefc069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fef140073f0 tx=0x7fef1400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.332+0000 7fef0effd640 1 -- 172.21.15.94:0/106131899 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef10016150 con 0x7fef180d0420 2024-09-11T23:20:13.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.484+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef180ae150 con 0x7fef180d0420 2024-09-11T23:20:13.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.484+0000 7fef0effd640 1 -- 172.21.15.94:0/106131899 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+17186 (secure 0 0 0) 0x7fef100f0410 con 0x7fef180d0420 2024-09-11T23:20:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:13.487 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":104,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:56.128869+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:33.255692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:33.878357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1","mappings":[{"from":1,"to":7}]},{"pgid":"16.1f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.94:6835/3585698004":"2024-09-12T23:19:44.615685+0000","172.21.15.94:6834/3585698004":"2024-09-12T23:19:44.615685+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feefc0678c0 msgr2=0x7feefc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feefc0678c0 0x7feefc069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fef140073f0 tx=0x7fef1400b040 comp rx=0 tx=0).stop 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef180d0420 msgr2=0x7fef1814e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef180d0420 0x7fef1814e230 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fef1001a100 tx=0x7fef10019270 comp rx=0 tx=0).stop 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 shutdown_connections 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7feefc0678c0 0x7feefc069d80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef180d0420 0x7fef1814e230 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180cd370 0x7fef1814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 --2- 172.21.15.94:0/106131899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef180b3160 0x7fef18146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 >> 172.21.15.94:0/106131899 conn(0x7fef18075200 msgr2=0x7fef180b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:13.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 shutdown_connections 2024-09-11T23:20:13.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.488+0000 7fef20648640 1 -- 172.21.15.94:0/106131899 wait complete. 2024-09-11T23:20:13.505 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:20:13.505 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:13.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd635f55640 1 Processor -- start 2024-09-11T23:20:13.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd635f55640 1 -- start start 2024-09-11T23:20:13.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd635f55640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 0x7fd6300cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd635f55640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6300b7740 con 0x7fd6300d15d0 2024-09-11T23:20:13.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd635f55640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6300d3850 con 0x7fd6300cfc00 2024-09-11T23:20:13.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd635f55640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd6300d3b30 con 0x7fd63015e6f0 2024-09-11T23:20:13.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd6300d15d0 0x7fd6300b7c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56190/0 (socket says 172.21.15.94:56190) 2024-09-11T23:20:13.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62ffff640 1 -- 172.21.15.94:0/2907401829 learned_addr learned my addr 172.21.15.94:0/2907401829 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62f7fe640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 0x7fd6300cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109937773 0 0) 0x7fd6300b7740 con 0x7fd6300d15d0 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd618003530 con 0x7fd6300d15d0 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1785275016 0 0) 0x7fd618003530 con 0x7fd6300d15d0 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 msgr2=0x7fd6300cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 0x7fd6300cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 >> v1:172.21.15.155:6789/0 conn(0x7fd6300cfc00 legacy=0x7fd6300d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6300d3e10 con 0x7fd6300d15d0 2024-09-11T23:20:13.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fd628001a00 con 0x7fd6300d15d0 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 >> v1:172.21.15.94:6789/0 conn(0x7fd6300d15d0 legacy=0x7fd6300b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 0x7fd6180039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd618003f70 0x7fd618004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd618004d50 0x7fd6180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300d3b30 con 0x7fd618004d50 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd61800bb60 con 0x7fd618003f70 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.624+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd61800bd60 con 0x7fd63015e6f0 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd618004d50 0x7fd6180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62effd640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd618003f70 0x7fd618004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62f7fe640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 0x7fd6180039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 -- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 msgr2=0x7fd6180039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 0x7fd6180039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 -- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd618003f70 msgr2=0x7fd618004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:13.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd618003f70 0x7fd618004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 -- 172.21.15.94:0/2907401829 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd618003530 con 0x7fd618004d50 2024-09-11T23:20:13.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62f7fe640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63015e6f0 0x7fd6180039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd618004d50 0x7fd6180051d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd6300d19e0 tx=0x7fd62801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9656eb2ff11ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62800a4a0 con 0x7fd618004d50 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6280aa710 con 0x7fd618004d50 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62e7fc640 1 -- 172.21.15.94:0/2907401829 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280aab00 con 0x7fd618004d50 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd635f55640 1 -- 172.21.15.94:0/2907401829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd618004d50 msgr2=0x7fd6180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd635f55640 1 --2- 172.21.15.94:0/2907401829 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd618004d50 0x7fd6180051d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd6300d19e0 tx=0x7fd62801fac0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd62ffff640 1 -- 172.21.15.94:0/2907401829 reap_dead start 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd635f55640 1 -- 172.21.15.94:0/2907401829 shutdown_connections 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd635f55640 1 -- 172.21.15.94:0/2907401829 >> 172.21.15.94:0/2907401829 conn(0x7fd6300722a0 msgr2=0x7fd6300726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:13.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd635f55640 1 -- 172.21.15.94:0/2907401829 shutdown_connections 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.628+0000 7fd635f55640 1 -- 172.21.15.94:0/2907401829 wait complete. 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 Processor -- start 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 -- start start 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6300b2c30 0x7fd6300b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6300b6350 0x7fd6300ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6300ad560 0x7fd6301f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300d3350 con 0x7fd6300b2c30 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd63015ead0 con 0x7fd6300b6350 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd6300d34d0 con 0x7fd6300ad560 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6300b2c30 0x7fd6300b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6300b2c30 0x7fd6300b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43274/0 (socket says 172.21.15.94:43274) 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 -- 172.21.15.94:0/897420677 learned_addr learned my addr 172.21.15.94:0/897420677 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62effd640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6300b6350 0x7fd6300ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 -- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6300ad560 msgr2=0x7fd6301f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6300ad560 0x7fd6301f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 -- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6300b6350 msgr2=0x7fd6300ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6300b6350 0x7fd6300ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 -- 172.21.15.94:0/897420677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6301f4400 con 0x7fd6300b2c30 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62effd640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6300b6350 0x7fd6300ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd62f7fe640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6300b2c30 0x7fd6300b5e10 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd620010850 tx=0x7fd620010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd617fff640 1 -- 172.21.15.94:0/897420677 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62000f040 con 0x7fd6300b2c30 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd617fff640 1 -- 172.21.15.94:0/897420677 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd620004220 con 0x7fd6300b2c30 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6301f4680 con 0x7fd6300b2c30 2024-09-11T23:20:13.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd617fff640 1 -- 172.21.15.94:0/897420677 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62000e960 con 0x7fd6300b2c30 2024-09-11T23:20:13.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301f4c40 con 0x7fd6300b2c30 2024-09-11T23:20:13.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.632+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6300cf6c0 con 0x7fd6300b2c30 2024-09-11T23:20:13.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.636+0000 7fd617fff640 1 -- 172.21.15.94:0/897420677 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd62000eb00 con 0x7fd6300b2c30 2024-09-11T23:20:13.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.636+0000 7fd617fff640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd61c0678c0 0x7fd61c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.636+0000 7fd617fff640 1 -- 172.21.15.94:0/897420677 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fd620086780 con 0x7fd6300b2c30 2024-09-11T23:20:13.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.636+0000 7fd62effd640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd61c0678c0 0x7fd61c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.636+0000 7fd62effd640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd61c0678c0 0x7fd61c069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd6300acac0 tx=0x7fd624009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.640+0000 7fd617fff640 1 -- 172.21.15.94:0/897420677 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd6301f4400 con 0x7fd6300b2c30 2024-09-11T23:20:13.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.832+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6300b6730 con 0x7fd6300b2c30 2024-09-11T23:20:13.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.832+0000 7fd617fff640 1 -- 172.21.15.94:0/897420677 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7fd620018030 con 0x7fd6300b2c30 2024-09-11T23:20:13.835 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:13.835 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:13.836 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd61c0678c0 msgr2=0x7fd61c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd61c0678c0 0x7fd61c069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd6300acac0 tx=0x7fd624009040 comp rx=0 tx=0).stop 2024-09-11T23:20:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6300b2c30 msgr2=0x7fd6300b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6300b2c30 0x7fd6300b5e10 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd620010850 tx=0x7fd620010d10 comp rx=0 tx=0).stop 2024-09-11T23:20:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 shutdown_connections 2024-09-11T23:20:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6300ad560 0x7fd6301f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6300b6350 0x7fd6300ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd61c0678c0 0x7fd61c069d80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 --2- 172.21.15.94:0/897420677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6300b2c30 0x7fd6300b5e10 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 >> 172.21.15.94:0/897420677 conn(0x7fd6300722a0 msgr2=0x7fd6300cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 shutdown_connections 2024-09-11T23:20:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.836+0000 7fd635f55640 1 -- 172.21.15.94:0/897420677 wait complete. 2024-09-11T23:20:13.854 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:13.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.968+0000 7fc75648d640 1 Processor -- start 2024-09-11T23:20:13.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.968+0000 7fc75648d640 1 -- start start 2024-09-11T23:20:13.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc75648d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7500d15d0 0x7fc7501692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc75648d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7500b7740 con 0x7fc7500d3350 2024-09-11T23:20:13.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc75648d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7500cfdd0 con 0x7fc75015e6f0 2024-09-11T23:20:13.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc75648d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc7500d3850 con 0x7fc7500d15d0 2024-09-11T23:20:13.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc754a2a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7500d15d0 0x7fc7501692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc74f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc7500d3350 0x7fc7500d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56198/0 (socket says 172.21.15.94:56198) 2024-09-11T23:20:13.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc74f7fe640 1 -- 172.21.15.94:0/1782330163 learned_addr learned my addr 172.21.15.94:0/1782330163 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:13.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc754a2a640 1 -- 172.21.15.94:0/1782330163 >> v1:172.21.15.155:6789/0 conn(0x7fc75015e6f0 legacy=0x7fc7500cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc754a2a640 1 -- 172.21.15.94:0/1782330163 >> v1:172.21.15.94:6789/0 conn(0x7fc7500d3350 legacy=0x7fc7500d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc74effd640 1 -- 172.21.15.94:0/1782330163 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059713853 0 0) 0x7fc7500b7740 con 0x7fc7500d3350 2024-09-11T23:20:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc754a2a640 1 -- 172.21.15.94:0/1782330163 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7500d3b30 con 0x7fc7500d15d0 2024-09-11T23:20:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc754a2a640 1 --2- 172.21.15.94:0/1782330163 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7500d15d0 0x7fc7501692b0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc7400097c0 tx=0x7fc74001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514007a9406f4d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc74effd640 1 -- 172.21.15.94:0/1782330163 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7400b1070 con 0x7fc7500d15d0 2024-09-11T23:20:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc74effd640 1 -- 172.21.15.94:0/1782330163 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7400a8050 con 0x7fc7500d15d0 2024-09-11T23:20:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.972+0000 7fc74effd640 1 -- 172.21.15.94:0/1782330163 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7400ac860 con 0x7fc7500d15d0 2024-09-11T23:20:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/1782330163 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7500d15d0 msgr2=0x7fc7501692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 --2- 172.21.15.94:0/1782330163 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7500d15d0 0x7fc7501692b0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc7400097c0 tx=0x7fc74001c3e0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/1782330163 shutdown_connections 2024-09-11T23:20:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 --2- 172.21.15.94:0/1782330163 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7500d15d0 0x7fc7501692b0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/1782330163 >> 172.21.15.94:0/1782330163 conn(0x7fc7500722a0 msgr2=0x7fc7500726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/1782330163 shutdown_connections 2024-09-11T23:20:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/1782330163 wait complete. 2024-09-11T23:20:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 Processor -- start 2024-09-11T23:20:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- start start 2024-09-11T23:20:13.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7500d15d0 0x7fc750150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7500d3350 0x7fc7500d45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc75015e6f0 0x7fc7500d4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc75016c5a0 con 0x7fc75015e6f0 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc75016c420 con 0x7fc7500d3350 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc75016c720 con 0x7fc7500d15d0 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc75015e6f0 0x7fc7500d4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc75015e6f0 0x7fc7500d4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43296/0 (socket says 172.21.15.94:43296) 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 -- 172.21.15.94:0/3220344045 learned_addr learned my addr 172.21.15.94:0/3220344045 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc74ffff640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7500d15d0 0x7fc750150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc74f7fe640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7500d3350 0x7fc7500d45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 -- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7500d15d0 msgr2=0x7fc750150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7500d15d0 0x7fc750150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 -- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7500d3350 msgr2=0x7fc7500d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:13.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7500d3350 0x7fc7500d45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 -- 172.21.15.94:0/3220344045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75015c760 con 0x7fc75015e6f0 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc74ffff640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7500d15d0 0x7fc750150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc74f7fe640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7500d3350 0x7fc7500d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc754a2a640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc75015e6f0 0x7fc7500d4ae0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc7400af040 tx=0x7fc74001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc74cff9640 1 -- 172.21.15.94:0/3220344045 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7400bd070 con 0x7fc75015e6f0 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc74cff9640 1 -- 172.21.15.94:0/3220344045 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7400b2040 con 0x7fc75015e6f0 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75015ca40 con 0x7fc75015e6f0 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc74cff9640 1 -- 172.21.15.94:0/3220344045 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7400b1050 con 0x7fc75015e6f0 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc750155260 con 0x7fc75015e6f0 2024-09-11T23:20:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.976+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7500d0ec0 con 0x7fc75015e6f0 2024-09-11T23:20:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.980+0000 7fc74cff9640 1 -- 172.21.15.94:0/3220344045 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7400c0070 con 0x7fc75015e6f0 2024-09-11T23:20:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.980+0000 7fc74cff9640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7300678f0 0x7fc730069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.980+0000 7fc74cff9640 1 -- 172.21.15.94:0/3220344045 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fc74011fb80 con 0x7fc75015e6f0 2024-09-11T23:20:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.980+0000 7fc74ffff640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7300678f0 0x7fc730069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.980+0000 7fc74ffff640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7300678f0 0x7fc730069db0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc748007fd0 tx=0x7fc748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:13.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:13.984+0000 7fc74cff9640 1 -- 172.21.15.94:0/3220344045 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc740016090 con 0x7fc75015e6f0 2024-09-11T23:20:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.172+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc75015a2f0 con 0x7fc75015e6f0 2024-09-11T23:20:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.172+0000 7fc74cff9640 1 -- 172.21.15.94:0/3220344045 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5224 (secure 0 0 0) 0x7fc7400f0610 con 0x7fc75015e6f0 2024-09-11T23:20:14.174 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:14.174 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":63,"btime":"2024-09-11T23:19:49:645843+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:34.908440+0000","modified":"2024-09-11T23:19:49.645832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6894":{"gid":6894,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":5,"addr":"172.21.15.94:6835/1696446491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1696446491},{"type":"v1","addr":"172.21.15.94:6835","nonce":1696446491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6894,"qdb_cluster":[6894]},"id":7}]} 2024-09-11T23:20:14.175 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 63 2024-09-11T23:20:14.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7300678f0 msgr2=0x7fc730069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7300678f0 0x7fc730069db0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc748007fd0 tx=0x7fc748009040 comp rx=0 tx=0).stop 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc75015e6f0 msgr2=0x7fc7500d4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc75015e6f0 0x7fc7500d4ae0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc7400af040 tx=0x7fc74001ac20 comp rx=0 tx=0).stop 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 shutdown_connections 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc7300678f0 0x7fc730069db0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc75015e6f0 0x7fc7500d4ae0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7500d3350 0x7fc7500d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 --2- 172.21.15.94:0/3220344045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7500d15d0 0x7fc750150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 >> 172.21.15.94:0/3220344045 conn(0x7fc7500722a0 msgr2=0x7fc7500b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 shutdown_connections 2024-09-11T23:20:14.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.176+0000 7fc75648d640 1 -- 172.21.15.94:0/3220344045 wait complete. 2024-09-11T23:20:14.192 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:14.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.308+0000 7faff91b1640 1 Processor -- start 2024-09-11T23:20:14.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.308+0000 7faff91b1640 1 -- start start 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff91b1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faff40b0310 0x7faff4072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff91b1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff40b0730 con 0x7faff4075030 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff91b1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff415e8a0 con 0x7faff415e4c0 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff91b1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7faff4072040 con 0x7faff40b0310 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff359e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7faff4075030 0x7faff40aeb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56206/0 (socket says 172.21.15.94:56206) 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff359e640 1 -- 172.21.15.94:0/311506583 learned_addr learned my addr 172.21.15.94:0/311506583 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867708361 0 0) 0x7faff40b0730 con 0x7faff4075030 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe0003530 con 0x7faff4075030 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff259c640 1 --2- 172.21.15.94:0/311506583 >> v2:172.21.15.155:3300/0 conn(0x7faff40b0310 0x7faff4072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2468429682 0 0) 0x7fafe0003530 con 0x7faff4075030 2024-09-11T23:20:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 >> v2:172.21.15.155:3300/0 conn(0x7faff40b0310 msgr2=0x7faff4072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 --2- 172.21.15.94:0/311506583 >> v2:172.21.15.155:3300/0 conn(0x7faff40b0310 0x7faff4072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 >> v1:172.21.15.155:6789/0 conn(0x7faff415e4c0 legacy=0x7faff406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff40b09a0 con 0x7faff4075030 2024-09-11T23:20:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fafec001680 con 0x7faff4075030 2024-09-11T23:20:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 >> v1:172.21.15.94:6789/0 conn(0x7faff4075030 legacy=0x7faff40aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe0004810 0x7fafe0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafe00052f0 0x7fafe000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faff4072040 con 0x7fafe00039c0 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fafe000c1c0 con 0x7fafe00052f0 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fafe000c3c0 con 0x7fafe0004810 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff2d9d640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff359e640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafe00052f0 0x7fafe000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff259c640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe0004810 0x7fafe0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff2d9d640 1 -- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe0004810 msgr2=0x7fafe0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff2d9d640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe0004810 0x7fafe0004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff2d9d640 1 -- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafe00052f0 msgr2=0x7fafe000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:14.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff2d9d640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafe00052f0 0x7fafe000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff2d9d640 1 -- 172.21.15.94:0/311506583 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe0003530 con 0x7fafe00039c0 2024-09-11T23:20:14.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff359e640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafe00052f0 0x7fafe000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:14.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.312+0000 7faff359e640 1 -- 172.21.15.94:0/311506583 reap_dead start 2024-09-11T23:20:14.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff2d9d640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fafe4001e40 tx=0x7fafe401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea08b01218e3d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:14.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4001a90 con 0x7fafe00039c0 2024-09-11T23:20:14.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe4003b80 con 0x7fafe00039c0 2024-09-11T23:20:14.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff1d9b640 1 -- 172.21.15.94:0/311506583 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe40050d0 con 0x7fafe00039c0 2024-09-11T23:20:14.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- 172.21.15.94:0/311506583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe00039c0 msgr2=0x7fafe0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fafe4001e40 tx=0x7fafe401c740 comp rx=0 tx=0).stop 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- 172.21.15.94:0/311506583 shutdown_connections 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 --2- 172.21.15.94:0/311506583 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- 172.21.15.94:0/311506583 >> 172.21.15.94:0/311506583 conn(0x7faff406bc80 msgr2=0x7faff406c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- 172.21.15.94:0/311506583 shutdown_connections 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- 172.21.15.94:0/311506583 wait complete. 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 Processor -- start 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- start start 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe00039c0 0x7faff4161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff414d320 0x7faff41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff4155ae0 0x7faff4155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faff406f970 con 0x7faff414d320 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faff4072290 con 0x7faff4155ae0 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faff406faf0 con 0x7fafe00039c0 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff414d320 0x7faff41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff414d320 0x7faff41534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43302/0 (socket says 172.21.15.94:43302) 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 -- 172.21.15.94:0/982550316 learned_addr learned my addr 172.21.15.94:0/982550316 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff359e640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff4155ae0 0x7faff4155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 -- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe00039c0 msgr2=0x7faff4161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe00039c0 0x7faff4161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 -- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff4155ae0 msgr2=0x7faff4155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff4155ae0 0x7faff4155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 -- 172.21.15.94:0/982550316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff41607c0 con 0x7faff414d320 2024-09-11T23:20:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff359e640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff4155ae0 0x7faff4155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff259c640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff414d320 0x7faff41534d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e870 tx=0x7fafdc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7fafeb7fe640 1 -- 172.21.15.94:0/982550316 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc017070 con 0x7faff414d320 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7fafeb7fe640 1 -- 172.21.15.94:0/982550316 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc00c870 con 0x7faff414d320 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff4154230 con 0x7faff414d320 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7fafeb7fe640 1 -- 172.21.15.94:0/982550316 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00f040 con 0x7faff414d320 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.316+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff41564a0 con 0x7faff414d320 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.320+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff40697d0 con 0x7faff414d320 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.320+0000 7fafeb7fe640 1 -- 172.21.15.94:0/982550316 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fafdc01a070 con 0x7faff414d320 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.320+0000 7fafeb7fe640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fafd40678c0 0x7fafd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.320+0000 7fafeb7fe640 1 -- 172.21.15.94:0/982550316 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7fafdc085d80 con 0x7faff414d320 2024-09-11T23:20:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.320+0000 7faff2d9d640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fafd40678c0 0x7fafd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.320+0000 7faff2d9d640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fafd40678c0 0x7fafd4069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fafe40ad000 tx=0x7fafe40014b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.324+0000 7fafeb7fe640 1 -- 172.21.15.94:0/982550316 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fafdc00ee60 con 0x7faff414d320 2024-09-11T23:20:14.395 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:14.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:14.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.488+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faff406fe80 con 0x7faff414d320 2024-09-11T23:20:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.488+0000 7fafeb7fe640 1 -- 172.21.15.94:0/982550316 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+17186 (secure 0 0 0) 0x7fafdc056710 con 0x7faff414d320 2024-09-11T23:20:14.492 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:14.492 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":104,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:19:56.128869+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:33.255692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:33.878357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1","mappings":[{"from":1,"to":7}]},{"pgid":"16.1f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.94:6835/3585698004":"2024-09-12T23:19:44.615685+0000","172.21.15.94:6834/3585698004":"2024-09-12T23:19:44.615685+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fafd40678c0 msgr2=0x7fafd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fafd40678c0 0x7fafd4069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fafe40ad000 tx=0x7fafe40014b0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff414d320 msgr2=0x7faff41534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff414d320 0x7faff41534d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e870 tx=0x7fafdc00ed30 comp rx=0 tx=0).stop 2024-09-11T23:20:14.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 shutdown_connections 2024-09-11T23:20:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff4155ae0 0x7faff4155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fafd40678c0 0x7fafd4069d80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff414d320 0x7faff41534d0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 --2- 172.21.15.94:0/982550316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafe00039c0 0x7faff4161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 >> 172.21.15.94:0/982550316 conn(0x7faff406bc80 msgr2=0x7faff415d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 shutdown_connections 2024-09-11T23:20:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.492+0000 7faff91b1640 1 -- 172.21.15.94:0/982550316 wait complete. 2024-09-11T23:20:14.511 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:20:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c6e17640 1 Processor -- start 2024-09-11T23:20:14.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c6e17640 1 -- start start 2024-09-11T23:20:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c6e17640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f87c00b3e30 0x7f87c00b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c6e17640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0143c10 0x7f87c0144060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c6e17640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c0144940 con 0x7f87c006fc80 2024-09-11T23:20:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c6e17640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f87c00ae8c0 con 0x7f87c00b3e30 2024-09-11T23:20:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c6e17640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f87c00aeb10 con 0x7f87c0143c10 2024-09-11T23:20:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f87c006fc80 0x7f87c0071770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56216/0 (socket says 172.21.15.94:56216) 2024-09-11T23:20:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 -- 172.21.15.94:0/2463150673 learned_addr learned my addr 172.21.15.94:0/2463150673 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c53b4640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0143c10 0x7f87c0144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bffff640 1 --2- 172.21.15.94:0/2463150673 >> v2:172.21.15.155:3300/0 conn(0x7f87c00b3e30 0x7f87c00b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779858761 0 0) 0x7f87c0144940 con 0x7f87c006fc80 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87a8003530 con 0x7f87c006fc80 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3346927454 0 0) 0x7f87a8003530 con 0x7f87c006fc80 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0143c10 msgr2=0x7f87c0144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0143c10 0x7f87c0144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 >> v2:172.21.15.155:3300/0 conn(0x7f87c00b3e30 msgr2=0x7f87c00b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 --2- 172.21.15.94:0/2463150673 >> v2:172.21.15.155:3300/0 conn(0x7f87c00b3e30 0x7f87c00b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c00aedf0 con 0x7f87c006fc80 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f87b0001680 con 0x7f87c006fc80 2024-09-11T23:20:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 >> v1:172.21.15.94:6789/0 conn(0x7f87c006fc80 legacy=0x7f87c0071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87a80039c0 0x7f87a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87a8004810 0x7f87a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0143c10 0x7f87a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f87c00ae8c0 con 0x7f87a80039c0 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f87c00aeb10 con 0x7f87a8004810 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f87a800b9d0 con 0x7f87c0143c10 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87a80039c0 0x7f87a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 -- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0143c10 msgr2=0x7f87a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0143c10 0x7f87a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 -- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87a8004810 msgr2=0x7f87a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87a8004810 0x7f87a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.672+0000 7f87c4bb3640 1 -- 172.21.15.94:0/2463150673 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a8003530 con 0x7f87a80039c0 2024-09-11T23:20:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c4bb3640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87a80039c0 0x7f87a8003de0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c270 tx=0x7f87b001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac96cd560ead1b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0007d40 con 0x7f87a80039c0 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b00a9020 con 0x7f87a80039c0 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87bf7fe640 1 -- 172.21.15.94:0/2463150673 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0005b00 con 0x7f87a80039c0 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 -- 172.21.15.94:0/2463150673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87a80039c0 msgr2=0x7f87a8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 --2- 172.21.15.94:0/2463150673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87a80039c0 0x7f87a8003de0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c270 tx=0x7f87b001cca0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c53b4640 1 -- 172.21.15.94:0/2463150673 reap_dead start 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 -- 172.21.15.94:0/2463150673 shutdown_connections 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 -- 172.21.15.94:0/2463150673 >> 172.21.15.94:0/2463150673 conn(0x7f87c00d0a70 msgr2=0x7f87c00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 -- 172.21.15.94:0/2463150673 shutdown_connections 2024-09-11T23:20:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 -- 172.21.15.94:0/2463150673 wait complete. 2024-09-11T23:20:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 Processor -- start 2024-09-11T23:20:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.676+0000 7f87c6e17640 1 -- start start 2024-09-11T23:20:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87a80039c0 0x7f87c006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c006d7d0 0x7f87c006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0141e60 0x7f87c01422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f87c015f1f0 con 0x7f87c006d7d0 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f87c015f070 con 0x7f87a80039c0 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f87c015f370 con 0x7f87c0141e60 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c006d7d0 0x7f87c006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c006d7d0 0x7f87c006dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43320/0 (socket says 172.21.15.94:43320) 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 -- 172.21.15.94:0/4004319661 learned_addr learned my addr 172.21.15.94:0/4004319661 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 -- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0141e60 msgr2=0x7f87c01422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0141e60 0x7f87c01422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 -- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87a80039c0 msgr2=0x7f87c006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87a80039c0 0x7f87c006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 -- 172.21.15.94:0/4004319661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c0142820 con 0x7f87c006d7d0 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bffff640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c006d7d0 0x7f87c006dc50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e7f0 tx=0x7f87b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bd7fa640 1 -- 172.21.15.94:0/4004319661 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4017070 con 0x7f87c006d7d0 2024-09-11T23:20:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bd7fa640 1 -- 172.21.15.94:0/4004319661 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b400c8c0 con 0x7f87c006d7d0 2024-09-11T23:20:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bd7fa640 1 -- 172.21.15.94:0/4004319661 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b400ccb0 con 0x7f87c006d7d0 2024-09-11T23:20:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c00b06b0 con 0x7f87c006d7d0 2024-09-11T23:20:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c00b0c70 con 0x7f87c006d7d0 2024-09-11T23:20:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c015f700 con 0x7f87c006d7d0 2024-09-11T23:20:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bd7fa640 1 -- 172.21.15.94:0/4004319661 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87b401a070 con 0x7f87c006d7d0 2024-09-11T23:20:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bd7fa640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87ac0678f0 0x7f87ac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87bd7fa640 1 -- 172.21.15.94:0/4004319661 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6245+0+0 (secure 0 0 0) 0x7f87b4085c40 con 0x7f87c006d7d0 2024-09-11T23:20:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.680+0000 7f87c4bb3640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87ac0678f0 0x7f87ac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.684+0000 7f87c4bb3640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87ac0678f0 0x7f87ac069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f87b00aa000 tx=0x7f87b001b4e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:14.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.684+0000 7f87bd7fa640 1 -- 172.21.15.94:0/4004319661 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f87c0142820 con 0x7f87c006d7d0 2024-09-11T23:20:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.880+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f87c00d07e0 con 0x7f87c006d7d0 2024-09-11T23:20:14.884 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:20:14.884+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:20:14.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.884+0000 7f87bd7fa640 1 -- 172.21.15.94:0/4004319661 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7f87b40564c0 con 0x7f87c006d7d0 2024-09-11T23:20:14.887 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:20:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87ac0678f0 msgr2=0x7f87ac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87ac0678f0 0x7f87ac069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f87b00aa000 tx=0x7f87b001b4e0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c006d7d0 msgr2=0x7f87c006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c006d7d0 0x7f87c006dc50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e7f0 tx=0x7f87b400ecb0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 shutdown_connections 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87c0141e60 0x7f87c01422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87ac0678f0 0x7f87ac069db0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c006d7d0 0x7f87c006dc50 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 --2- 172.21.15.94:0/4004319661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87a80039c0 0x7f87c006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 >> 172.21.15.94:0/4004319661 conn(0x7f87c00d0a70 msgr2=0x7f87c015ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 shutdown_connections 2024-09-11T23:20:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:14.888+0000 7f87c6e17640 1 -- 172.21.15.94:0/4004319661 wait complete. 2024-09-11T23:20:14.909 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:20:14.937 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:20:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96d6817640 1 Processor -- start 2024-09-11T23:20:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96d6817640 1 -- start start 2024-09-11T23:20:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96d6817640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 0x7f96d015b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96d6817640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d00b4bb0 con 0x7f96d00b47d0 2024-09-11T23:20:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96d6817640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d006dd20 con 0x7f96d00ad9a0 2024-09-11T23:20:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96d6817640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96d006d5b0 con 0x7f96d00ad140 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96cffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f96d00b47d0 0x7f96d006eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56224/0 (socket says 172.21.15.94:56224) 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.024+0000 7f96cffff640 1 -- 172.21.15.94:0/264553256 learned_addr learned my addr 172.21.15.94:0/264553256 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 0x7f96d015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287973023 0 0) 0x7f96d00b4bb0 con 0x7f96d00b47d0 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b8003530 con 0x7f96d00b47d0 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4046971719 0 0) 0x7f96b8003530 con 0x7f96d00b47d0 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 msgr2=0x7f96d015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 0x7f96d015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 >> v1:172.21.15.155:6789/0 conn(0x7f96d00ad9a0 legacy=0x7f96d00b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d006e000 con 0x7f96d00b47d0 2024-09-11T23:20:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f96c0001680 con 0x7f96d00b47d0 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 >> v1:172.21.15.94:6789/0 conn(0x7f96d00b47d0 legacy=0x7f96d006eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b80039f0 0x7f96b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 0x7f96b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f96d006d5b0 con 0x7f96b8004810 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96b800bb00 con 0x7f96b80039f0 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96b800bd00 con 0x7f96d00ad140 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cffff640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b80039f0 0x7f96b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 -- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 msgr2=0x7f96b8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d4db4640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 0x7f96b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 0x7f96b8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 -- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b80039f0 msgr2=0x7f96b8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b80039f0 0x7f96b8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 -- 172.21.15.94:0/264553256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b8003530 con 0x7f96b8004810 2024-09-11T23:20:15.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d4db4640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00ad140 0x7f96b8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96b8004c90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f96c400aae0 tx=0x7f96c401df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96450886c38f2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c40b2070 con 0x7f96b8004810 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c40ad600 con 0x7f96b8004810 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96ceffd640 1 -- 172.21.15.94:0/264553256 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c400b040 con 0x7f96b8004810 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d6817640 1 -- 172.21.15.94:0/264553256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 msgr2=0x7f96b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d6817640 1 --2- 172.21.15.94:0/264553256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96b8004c90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f96c400aae0 tx=0x7f96c401df90 comp rx=0 tx=0).stop 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d4db4640 1 -- 172.21.15.94:0/264553256 reap_dead start 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d6817640 1 -- 172.21.15.94:0/264553256 shutdown_connections 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d6817640 1 -- 172.21.15.94:0/264553256 >> 172.21.15.94:0/264553256 conn(0x7f96d0075200 msgr2=0x7f96d0075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.028+0000 7f96d6817640 1 -- 172.21.15.94:0/264553256 shutdown_connections 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- 172.21.15.94:0/264553256 wait complete. 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 Processor -- start 2024-09-11T23:20:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- start start 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96d014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00b21b0 0x7f96d0073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d00736d0 0x7f96d01f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f96d00b3c80 con 0x7f96b8004810 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96d015bc20 con 0x7f96d00736d0 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96d00addb0 con 0x7f96d00b21b0 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96d014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96d014d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43352/0 (socket says 172.21.15.94:43352) 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 -- 172.21.15.94:0/3038165203 learned_addr learned my addr 172.21.15.94:0/3038165203 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00b21b0 0x7f96d0073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d4db4640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d00736d0 0x7f96d01f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 -- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00b21b0 msgr2=0x7f96d0073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00b21b0 0x7f96d0073190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 -- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d00736d0 msgr2=0x7f96d01f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d00736d0 0x7f96d01f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 -- 172.21.15.94:0/3038165203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d01f6190 con 0x7f96b8004810 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00b21b0 0x7f96d0073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96cffff640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96d014d560 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f96c000e850 tx=0x7f96c000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96ccff9640 1 -- 172.21.15.94:0/3038165203 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c000c8d0 con 0x7f96b8004810 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96ccff9640 1 -- 172.21.15.94:0/3038165203 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c0018070 con 0x7f96b8004810 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d00b16d0 con 0x7f96b8004810 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96ccff9640 1 -- 172.21.15.94:0/3038165203 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c000ccd0 con 0x7f96b8004810 2024-09-11T23:20:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d00b1c90 con 0x7f96b8004810 2024-09-11T23:20:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.032+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d00ae1c0 con 0x7f96b8004810 2024-09-11T23:20:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.036+0000 7f96ccff9640 1 -- 172.21.15.94:0/3038165203 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96c0013420 con 0x7f96b8004810 2024-09-11T23:20:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.036+0000 7f96ccff9640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f96bc0678f0 0x7f96bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.036+0000 7f96ccff9640 1 -- 172.21.15.94:0/3038165203 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6331+0+0 (secure 0 0 0) 0x7f96c0085b30 con 0x7f96b8004810 2024-09-11T23:20:15.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.036+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f96bc0678f0 0x7f96bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.036+0000 7f96cf7fe640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f96bc0678f0 0x7f96bc069db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f96c40af000 tx=0x7f96c40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.040+0000 7f96ccff9640 1 -- 172.21.15.94:0/3038165203 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96c0056400 con 0x7f96b8004810 2024-09-11T23:20:15.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.224+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f96d0073ab0 con 0x7f96b8004810 2024-09-11T23:20:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.888+0000 7f96ccff9640 1 -- 172.21.15.94:0/3038165203 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7f96c0055d00 con 0x7f96b8004810 2024-09-11T23:20:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f96bc0678f0 msgr2=0x7f96bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f96bc0678f0 0x7f96bc069db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f96c40af000 tx=0x7f96c40046d0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 msgr2=0x7f96d014d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96d014d560 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f96c000e850 tx=0x7f96c000ed10 comp rx=0 tx=0).stop 2024-09-11T23:20:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 shutdown_connections 2024-09-11T23:20:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d00736d0 0x7f96d01f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d00b21b0 0x7f96d0073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f96bc0678f0 0x7f96bc069db0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 --2- 172.21.15.94:0/3038165203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96b8004810 0x7f96d014d560 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 >> 172.21.15.94:0/3038165203 conn(0x7f96d0075200 msgr2=0x7f96d00b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:15.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 shutdown_connections 2024-09-11T23:20:15.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:15.892+0000 7f96d6817640 1 -- 172.21.15.94:0/3038165203 wait complete. 2024-09-11T23:20:15.914 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:20:16.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48fbecb640 1 Processor -- start 2024-09-11T23:20:16.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48fbecb640 1 -- start start 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48fbecb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f48f40b3880 0x7f48f40d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48fbecb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48f415f590 0x7f48f415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48fbecb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f4143dc0 con 0x7f48f40d0970 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48fbecb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f48f40d0de0 con 0x7f48f40b3880 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48fbecb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f48f41440a0 con 0x7f48f415f590 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48f9c67640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f48f40b3880 0x7f48f40d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48f9c67640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f48f40b3880 0x7f48f40d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43358/0 (socket says 172.21.15.94:43358) 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48f9c67640 1 -- 172.21.15.94:0/757617568 learned_addr learned my addr 172.21.15.94:0/757617568 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48f9c67640 1 -- 172.21.15.94:0/757617568 >> v2:172.21.15.155:3300/0 conn(0x7f48f415f590 msgr2=0x7f48f415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48f9c67640 1 --2- 172.21.15.94:0/757617568 >> v2:172.21.15.155:3300/0 conn(0x7f48f415f590 0x7f48f415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48f9c67640 1 -- 172.21.15.94:0/757617568 >> v1:172.21.15.155:6789/0 conn(0x7f48f40d0970 legacy=0x7f48f415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:16.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.084+0000 7f48f9c67640 1 -- 172.21.15.94:0/757617568 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f4144380 con 0x7f48f40b3880 2024-09-11T23:20:16.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 --2- 172.21.15.94:0/757617568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f40d0430 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f48f40b53c0 tx=0x7f48f001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cb553511631100 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:16.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f8c65640 1 -- 172.21.15.94:0/757617568 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b1070 con 0x7f48f40b3880 2024-09-11T23:20:16.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f8c65640 1 -- 172.21.15.94:0/757617568 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f00ac630 con 0x7f48f40b3880 2024-09-11T23:20:16.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f8c65640 1 -- 172.21.15.94:0/757617568 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a8050 con 0x7f48f40b3880 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- 172.21.15.94:0/757617568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 msgr2=0x7f48f40d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 --2- 172.21.15.94:0/757617568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f40d0430 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f48f40b53c0 tx=0x7f48f001c4e0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- 172.21.15.94:0/757617568 shutdown_connections 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 --2- 172.21.15.94:0/757617568 >> v2:172.21.15.155:3300/0 conn(0x7f48f415f590 0x7f48f415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 --2- 172.21.15.94:0/757617568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f40d0430 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- 172.21.15.94:0/757617568 >> 172.21.15.94:0/757617568 conn(0x7f48f4075200 msgr2=0x7f48f4075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- 172.21.15.94:0/757617568 shutdown_connections 2024-09-11T23:20:16.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- 172.21.15.94:0/757617568 wait complete. 2024-09-11T23:20:16.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 Processor -- start 2024-09-11T23:20:16.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- start start 2024-09-11T23:20:16.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f40d0970 0x7f48f415a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f415f590 0x7f48f4161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f48f406d0b0 con 0x7f48f40b3880 2024-09-11T23:20:16.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f48f406cf30 con 0x7f48f40d0970 2024-09-11T23:20:16.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48fbecb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f48f406d230 con 0x7f48f415f590 2024-09-11T23:20:16.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f41575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43362/0 (socket says 172.21.15.94:43362) 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 -- 172.21.15.94:0/3848961092 learned_addr learned my addr 172.21.15.94:0/3848961092 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 -- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f415f590 msgr2=0x7f48f4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f415f590 0x7f48f4161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 -- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f40d0970 msgr2=0x7f48f415a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9466640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f40d0970 0x7f48f415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f40d0970 0x7f48f415a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 -- 172.21.15.94:0/3848961092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f40cf6e0 con 0x7f48f40b3880 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.088+0000 7f48f9c67640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f41575d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f48f001ab90 tx=0x7f48f0019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48ea7fc640 1 -- 172.21.15.94:0/3848961092 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b1040 con 0x7f48f40b3880 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48ea7fc640 1 -- 172.21.15.94:0/3848961092 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f00ba070 con 0x7f48f40b3880 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f40cf9c0 con 0x7f48f40b3880 2024-09-11T23:20:16.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48ea7fc640 1 -- 172.21.15.94:0/3848961092 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a8040 con 0x7f48f40b3880 2024-09-11T23:20:16.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f40cddb0 con 0x7f48f40b3880 2024-09-11T23:20:16.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f40d0430 con 0x7f48f40b3880 2024-09-11T23:20:16.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48ea7fc640 1 -- 172.21.15.94:0/3848961092 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f48f00b58a0 con 0x7f48f40b3880 2024-09-11T23:20:16.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48ea7fc640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48d80678c0 0x7f48d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48ea7fc640 1 -- 172.21.15.94:0/3848961092 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6331+0+0 (secure 0 0 0) 0x7f48f011fd70 con 0x7f48f40b3880 2024-09-11T23:20:16.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48f9466640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48d80678c0 0x7f48d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:16.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.092+0000 7f48f9466640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48d80678c0 0x7f48d8069d80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f48f4159ba0 tx=0x7f48e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:16.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.096+0000 7f48ea7fc640 1 -- 172.21.15.94:0/3848961092 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f48f00160d0 con 0x7f48f40b3880 2024-09-11T23:20:16.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:16.260+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f48f4156bd0 con 0x7f48f40b3880 2024-09-11T23:20:17.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.216+0000 7f48ea7fc640 1 -- 172.21.15.94:0/3848961092 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) ==== 181+0+0 (secure 0 0 0) 0x7f48f00f0630 con 0x7f48f40b3880 2024-09-11T23:20:17.219 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48d80678c0 msgr2=0x7f48d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48d80678c0 0x7f48d8069d80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f48f4159ba0 tx=0x7f48e4009040 comp rx=0 tx=0).stop 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 msgr2=0x7f48f41575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f41575d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f48f001ab90 tx=0x7f48f0019280 comp rx=0 tx=0).stop 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 shutdown_connections 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f415f590 0x7f48f4161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f40d0970 0x7f48f415a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48d80678c0 0x7f48d8069d80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 --2- 172.21.15.94:0/3848961092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48f40b3880 0x7f48f41575d0 secure :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f48f001ab90 tx=0x7f48f0019280 comp rx=0 tx=0).stop 2024-09-11T23:20:17.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 >> 172.21.15.94:0/3848961092 conn(0x7f48f4075200 msgr2=0x7f48f415d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:17.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 shutdown_connections 2024-09-11T23:20:17.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.224+0000 7f48fbecb640 1 -- 172.21.15.94:0/3848961092 wait complete. 2024-09-11T23:20:17.246 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:20:17.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.368+0000 7f797150a640 1 Processor -- start 2024-09-11T23:20:17.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.368+0000 7f797150a640 1 -- start start 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f796c0ce7b0 0x7f796c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f796c15ed80 0x7f796c0d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 0x7f796c0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f796c06cf30 con 0x7f796c0ce7b0 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f796c06d210 con 0x7f796c15ed80 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f796c06d4f0 con 0x7f796c0b3280 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f796c0ce7b0 0x7f796c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f796c0ce7b0 0x7f796c0b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43366/0 (socket says 172.21.15.94:43366) 2024-09-11T23:20:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 -- 172.21.15.94:0/1329233358 learned_addr learned my addr 172.21.15.94:0/1329233358 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:17.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 -- 172.21.15.94:0/1329233358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 msgr2=0x7f796c0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:17.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 --2- 172.21.15.94:0/1329233358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 0x7f796c0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 -- 172.21.15.94:0/1329233358 >> v2:172.21.15.155:3300/0 conn(0x7f796c15ed80 msgr2=0x7f796c0d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:17.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 --2- 172.21.15.94:0/1329233358 >> v2:172.21.15.155:3300/0 conn(0x7f796c15ed80 0x7f796c0d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 -- 172.21.15.94:0/1329233358 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c06d7d0 con 0x7f796c0ce7b0 2024-09-11T23:20:17.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f796affd640 1 --2- 172.21.15.94:0/1329233358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c0b4a00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f796c06d420 tx=0x7f795c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1e6b636fc04d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:17.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f7969ffb640 1 -- 172.21.15.94:0/1329233358 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0b0070 con 0x7f796c0ce7b0 2024-09-11T23:20:17.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f7969ffb640 1 -- 172.21.15.94:0/1329233358 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795c0ab600 con 0x7f796c0ce7b0 2024-09-11T23:20:17.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f7969ffb640 1 -- 172.21.15.94:0/1329233358 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0ab9d0 con 0x7f796c0ce7b0 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 -- 172.21.15.94:0/1329233358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 msgr2=0x7f796c0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.372+0000 7f797150a640 1 --2- 172.21.15.94:0/1329233358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c0b4a00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f796c06d420 tx=0x7f795c01c520 comp rx=0 tx=0).stop 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- 172.21.15.94:0/1329233358 shutdown_connections 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 --2- 172.21.15.94:0/1329233358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 0x7f796c0d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 --2- 172.21.15.94:0/1329233358 >> v2:172.21.15.155:3300/0 conn(0x7f796c15ed80 0x7f796c0d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 --2- 172.21.15.94:0/1329233358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c0b4a00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- 172.21.15.94:0/1329233358 >> 172.21.15.94:0/1329233358 conn(0x7f796c075200 msgr2=0x7f796c075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- 172.21.15.94:0/1329233358 shutdown_connections 2024-09-11T23:20:17.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- 172.21.15.94:0/1329233358 wait complete. 2024-09-11T23:20:17.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 Processor -- start 2024-09-11T23:20:17.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- start start 2024-09-11T23:20:17.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 0x7f796c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c1673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c15ed80 0x7f796c1642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f796c0b4380 con 0x7f796c0ce7b0 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f796c0b4200 con 0x7f796c15ed80 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f796c0b4500 con 0x7f796c0b3280 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c1673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c1673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43374/0 (socket says 172.21.15.94:43374) 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 -- 172.21.15.94:0/2599193985 learned_addr learned my addr 172.21.15.94:0/2599193985 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796affd640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 0x7f796c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796b7fe640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c15ed80 0x7f796c1642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 -- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 msgr2=0x7f796c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 0x7f796c155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 -- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c15ed80 msgr2=0x7f796c1642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c15ed80 0x7f796c1642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 -- 172.21.15.94:0/2599193985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c155fa0 con 0x7f796c0ce7b0 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f796a7fc640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c1673b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f796000b480 tx=0x7f796000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f79537fe640 1 -- 172.21.15.94:0/2599193985 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960014070 con 0x7f796c0ce7b0 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f79537fe640 1 -- 172.21.15.94:0/2599193985 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7960010890 con 0x7f796c0ce7b0 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796c167cb0 con 0x7f796c0ce7b0 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f79537fe640 1 -- 172.21.15.94:0/2599193985 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960010c80 con 0x7f796c0ce7b0 2024-09-11T23:20:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f796c1582a0 con 0x7f796c0ce7b0 2024-09-11T23:20:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.376+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796c0b4a00 con 0x7f796c0ce7b0 2024-09-11T23:20:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.380+0000 7f79537fe640 1 -- 172.21.15.94:0/2599193985 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7960017070 con 0x7f796c0ce7b0 2024-09-11T23:20:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.380+0000 7f79537fe640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f79580678c0 0x7f7958069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.380+0000 7f79537fe640 1 -- 172.21.15.94:0/2599193985 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5893+0+0 (secure 0 0 0) 0x7f7960085af0 con 0x7f796c0ce7b0 2024-09-11T23:20:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.380+0000 7f796affd640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f79580678c0 0x7f7958069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.380+0000 7f796affd640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f79580678c0 0x7f7958069d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f795c0ad000 tx=0x7f795c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:17.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.384+0000 7f79537fe640 1 -- 172.21.15.94:0/2599193985 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7960056600 con 0x7f796c0ce7b0 2024-09-11T23:20:17.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:17.544+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f796c15fa70 con 0x7f796c0ce7b0 2024-09-11T23:20:18.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.224+0000 7f79537fe640 1 -- 172.21.15.94:0/2599193985 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) ==== 169+0+0 (secure 0 0 0) 0x7f7960010e20 con 0x7f796c0ce7b0 2024-09-11T23:20:18.227 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:20:18.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f79580678c0 msgr2=0x7f7958069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f79580678c0 0x7f7958069d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f795c0ad000 tx=0x7f795c0a6000 comp rx=0 tx=0).stop 2024-09-11T23:20:18.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 msgr2=0x7f796c1673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c1673b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f796000b480 tx=0x7f796000b940 comp rx=0 tx=0).stop 2024-09-11T23:20:18.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 shutdown_connections 2024-09-11T23:20:18.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c15ed80 0x7f796c1642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f79580678c0 0x7f7958069d80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f796c0ce7b0 0x7f796c1673b0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 --2- 172.21.15.94:0/2599193985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f796c0b3280 0x7f796c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 >> 172.21.15.94:0/2599193985 conn(0x7f796c075200 msgr2=0x7f796c0755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:18.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 shutdown_connections 2024-09-11T23:20:18.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.232+0000 7f797150a640 1 -- 172.21.15.94:0/2599193985 wait complete. 2024-09-11T23:20:18.259 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:20:18.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:20:18.283 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-11T23:20:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-11T23:20:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:20:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-11T23:20:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-11T23:20:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-11T23:20:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:20:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-11T23:20:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:20:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:20:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_files = 6 2024-09-11T23:20:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_ops = 100000000 2024-09-11T23:20:18.296 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-11T23:20:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-11T23:20:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:20:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-11T23:20:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-11T23:20:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:20:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-11T23:20:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.299 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-11T23:20:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:20:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:20:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.303 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:20:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.305 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-11T23:20:18.306 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:20:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2024-09-11T23:20:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 100000000 2024-09-11T23:20:18.310 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:20:18.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:20:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-11T23:20:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:20:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-11T23:20:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-11T23:20:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:20:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.388 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-09-11T23:20:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-09-11T23:20:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-11T23:20:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-11T23:20:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-11T23:20:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-11T23:20:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:20:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: mds_max_purge_files = 6 2024-09-11T23:20:18.395 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-11T23:20:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:20:18.397 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:20:18.398 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:20:18.399 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-11T23:20:18.400 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.401 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.402 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:20:18.403 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-11T23:20:18.404 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-11T23:20:18.405 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:20:18.406 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-11T23:20:18.408 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-11T23:20:18.408 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-11T23:20:18.408 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-11T23:20:18.408 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:20:18.408 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.408 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.408 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2024-09-11T23:20:18.409 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:20:18.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:20:18.461 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-11T23:20:18.461 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-11T23:20:18.461 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:20:18.462 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:20:18.463 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-11T23:20:18.464 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-11T23:20:18.465 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-11T23:20:18.466 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-11T23:20:18.467 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:20:18.468 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-11T23:20:18.469 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.470 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-09-11T23:20:18.471 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-11T23:20:18.472 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-11T23:20:18.473 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-11T23:20:18.473 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-11T23:20:18.473 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-11T23:20:18.473 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.473 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.474 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-11T23:20:18.474 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-11T23:20:18.474 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:20:18.474 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:20:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:20:18.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.94,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6 2024-09-11T23:20:18.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-11T23:20:18.478 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-11T23:20:18.479 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:20:18.480 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-11T23:20:18.481 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.482 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-11T23:20:18.483 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-11T23:20:18.484 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-11T23:20:18.485 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-11T23:20:18.486 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:20:18.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.644+0000 7f85490c4640 1 Processor -- start 2024-09-11T23:20:18.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.644+0000 7f85490c4640 1 -- start start 2024-09-11T23:20:18.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.644+0000 7f85490c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f854406fef0 0x7f854406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.644+0000 7f85490c4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85440b3d50 0x7f85440b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.644+0000 7f85490c4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854406ee50 con 0x7f8544073e60 2024-09-11T23:20:18.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.644+0000 7f85490c4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f85440b46c0 con 0x7f85440b3d50 2024-09-11T23:20:18.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.644+0000 7f85490c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f854406f130 con 0x7f854406fef0 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f854406fef0 0x7f854406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f854359e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85440b3d50 0x7f85440b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f854406fef0 0x7f854406e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49878/0 (socket says 172.21.15.94:49878) 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f854359e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85440b3d50 0x7f85440b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:39042/0 (socket says 172.21.15.94:39042) 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 -- 172.21.15.94:0/779954594 learned_addr learned my addr 172.21.15.94:0/779954594 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 -- 172.21.15.94:0/779954594 >> v2:172.21.15.155:3300/0 conn(0x7f85440b3d50 msgr2=0x7f85440b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 --2- 172.21.15.94:0/779954594 >> v2:172.21.15.155:3300/0 conn(0x7f85440b3d50 0x7f85440b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 -- 172.21.15.94:0/779954594 >> v1:172.21.15.155:6789/0 conn(0x7f8544073e60 legacy=0x7f854415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 -- 172.21.15.94:0/779954594 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854406f410 con 0x7f854406fef0 2024-09-11T23:20:18.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f853a59c640 1 --2- 172.21.15.94:0/779954594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f854406fef0 0x7f854406e800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f852c009870 tx=0x7f852c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7017f3eaab8593 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f854259c640 1 -- 172.21.15.94:0/779954594 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c0b0070 con 0x7f854406fef0 2024-09-11T23:20:18.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f854259c640 1 -- 172.21.15.94:0/779954594 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c0ab600 con 0x7f854406fef0 2024-09-11T23:20:18.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.648+0000 7f854259c640 1 -- 172.21.15.94:0/779954594 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c0ab9d0 con 0x7f854406fef0 2024-09-11T23:20:18.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- 172.21.15.94:0/779954594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f854406fef0 msgr2=0x7f854406e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 --2- 172.21.15.94:0/779954594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f854406fef0 0x7f854406e800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f852c009870 tx=0x7f852c01c4d0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- 172.21.15.94:0/779954594 shutdown_connections 2024-09-11T23:20:18.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 --2- 172.21.15.94:0/779954594 >> v2:172.21.15.155:3300/0 conn(0x7f85440b3d50 0x7f85440b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 --2- 172.21.15.94:0/779954594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f854406fef0 0x7f854406e800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- 172.21.15.94:0/779954594 >> 172.21.15.94:0/779954594 conn(0x7f85440b1f90 msgr2=0x7f85440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:18.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- 172.21.15.94:0/779954594 shutdown_connections 2024-09-11T23:20:18.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- 172.21.15.94:0/779954594 wait complete. 2024-09-11T23:20:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 Processor -- start 2024-09-11T23:20:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- start start 2024-09-11T23:20:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8544073e60 0x7f85440b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85440b3d50 0x7f85440b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85440afdb0 0x7f85440b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f85440729a0 con 0x7f85440b3d50 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8544072820 con 0x7f8544073e60 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8544072b20 con 0x7f85440afdb0 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85440b3d50 0x7f85440b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85440b3d50 0x7f85440b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43376/0 (socket says 172.21.15.94:43376) 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 -- 172.21.15.94:0/1639033392 learned_addr learned my addr 172.21.15.94:0/1639033392 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f854359e640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85440afdb0 0x7f85440b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f8542d9d640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8544073e60 0x7f85440b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 -- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85440afdb0 msgr2=0x7f85440b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85440afdb0 0x7f85440b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 -- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8544073e60 msgr2=0x7f85440b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8544073e60 0x7f85440b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 -- 172.21.15.94:0/1639033392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8544153670 con 0x7f85440b3d50 2024-09-11T23:20:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853a59c640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85440b3d50 0x7f85440b1250 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ae040 tx=0x7f852c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853bfff640 1 -- 172.21.15.94:0/1639033392 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c0bb070 con 0x7f85440b3d50 2024-09-11T23:20:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853bfff640 1 -- 172.21.15.94:0/1639033392 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c0abdd0 con 0x7f85440b3d50 2024-09-11T23:20:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854409a4b0 con 0x7f85440b3d50 2024-09-11T23:20:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f853bfff640 1 -- 172.21.15.94:0/1639033392 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c0b0040 con 0x7f85440b3d50 2024-09-11T23:20:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.652+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85440b1790 con 0x7f85440b3d50 2024-09-11T23:20:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.656+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854406e800 con 0x7f85440b3d50 2024-09-11T23:20:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.656+0000 7f853bfff640 1 -- 172.21.15.94:0/1639033392 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f852c004230 con 0x7f85440b3d50 2024-09-11T23:20:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.656+0000 7f853bfff640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85240678f0 0x7f8524069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.656+0000 7f853bfff640 1 -- 172.21.15.94:0/1639033392 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7f852c11efb0 con 0x7f85440b3d50 2024-09-11T23:20:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.656+0000 7f8542d9d640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85240678f0 0x7f8524069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.656+0000 7f8542d9d640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85240678f0 0x7f8524069db0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8534001650 tx=0x7f8534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.660+0000 7f853bfff640 1 -- 172.21.15.94:0/1639033392 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f852c016150 con 0x7f85440b3d50 2024-09-11T23:20:18.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.820+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f85440723f0 con 0x7f85440b3d50 2024-09-11T23:20:18.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f853bfff640 1 -- 172.21.15.94:0/1639033392 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f852c0ef5d0 con 0x7f85440b3d50 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85240678f0 msgr2=0x7f8524069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85240678f0 0x7f8524069db0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8534001650 tx=0x7f8534009040 comp rx=0 tx=0).stop 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85440b3d50 msgr2=0x7f85440b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85440b3d50 0x7f85440b1250 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ae040 tx=0x7f852c019270 comp rx=0 tx=0).stop 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 shutdown_connections 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85440afdb0 0x7f85440b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f85240678f0 0x7f8524069db0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85440b3d50 0x7f85440b1250 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 --2- 172.21.15.94:0/1639033392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8544073e60 0x7f85440b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 >> 172.21.15.94:0/1639033392 conn(0x7f85440b1f90 msgr2=0x7f8544074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:18.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 shutdown_connections 2024-09-11T23:20:18.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.828+0000 7f85490c4640 1 -- 172.21.15.94:0/1639033392 wait complete. 2024-09-11T23:20:18.849 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle' 2024-09-11T23:20:18.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6cc55b640 1 Processor -- start 2024-09-11T23:20:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6cc55b640 1 -- start start 2024-09-11T23:20:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6cc55b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c415c2a0 0x7fa6c40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6cc55b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c40b3290 con 0x7fa6c415bec0 2024-09-11T23:20:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6cc55b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c40b3570 con 0x7fa6c40af2a0 2024-09-11T23:20:18.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6cc55b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c40b3850 con 0x7fa6c415c2a0 2024-09-11T23:20:18.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6ca2f7640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa6c415bec0 0x7fa6c40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56236/0 (socket says 172.21.15.94:56236) 2024-09-11T23:20:18.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6ca2f7640 1 -- 172.21.15.94:0/1517136963 learned_addr learned my addr 172.21.15.94:0/1517136963 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:18.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c9af6640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c415c2a0 0x7fa6c40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215183821 0 0) 0x7fa6c40b3290 con 0x7fa6c415bec0 2024-09-11T23:20:18.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b0003530 con 0x7fa6c415bec0 2024-09-11T23:20:18.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2922673551 0 0) 0x7fa6b0003530 con 0x7fa6c415bec0 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c415c2a0 msgr2=0x7fa6c40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c415c2a0 0x7fa6c40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 >> v1:172.21.15.155:6789/0 conn(0x7fa6c40af2a0 legacy=0x7fa6c406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c40b3b30 con 0x7fa6c415bec0 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fa6c0001680 con 0x7fa6c415bec0 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 >> v1:172.21.15.94:6789/0 conn(0x7fa6c415bec0 legacy=0x7fa6c40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c415c2a0 0x7fa6b00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003f70 0x7fa6b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6b0004d50 0x7fa6b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c40b3850 con 0x7fa6b0004d50 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b000bab0 con 0x7fa6b0003f70 2024-09-11T23:20:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b000bcb0 con 0x7fa6c415c2a0 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6caaf8640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6b0004d50 0x7fa6b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c9af6640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003f70 0x7fa6b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6caaf8640 1 -- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c415c2a0 msgr2=0x7fa6b00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6caaf8640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c415c2a0 0x7fa6b00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6caaf8640 1 -- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003f70 msgr2=0x7fa6b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6caaf8640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003f70 0x7fa6b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6caaf8640 1 -- 172.21.15.94:0/1517136963 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b0003530 con 0x7fa6b0004d50 2024-09-11T23:20:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.964+0000 7fa6c9af6640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003f70 0x7fa6b0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:18.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6caaf8640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6b0004d50 0x7fa6b00051d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001e70 tx=0x7fa6bc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1e935ac6419b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc001a90 con 0x7fa6b0004d50 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6bc003b80 con 0x7fa6b0004d50 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6c92f5640 1 -- 172.21.15.94:0/1517136963 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc005080 con 0x7fa6b0004d50 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 -- 172.21.15.94:0/1517136963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6b0004d50 msgr2=0x7fa6b00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 --2- 172.21.15.94:0/1517136963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6b0004d50 0x7fa6b00051d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001e70 tx=0x7fa6bc01c780 comp rx=0 tx=0).stop 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6caaf8640 1 -- 172.21.15.94:0/1517136963 reap_dead start 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 -- 172.21.15.94:0/1517136963 shutdown_connections 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 -- 172.21.15.94:0/1517136963 >> 172.21.15.94:0/1517136963 conn(0x7fa6c40b1f90 msgr2=0x7fa6c40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 -- 172.21.15.94:0/1517136963 shutdown_connections 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 -- 172.21.15.94:0/1517136963 wait complete. 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 Processor -- start 2024-09-11T23:20:18.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.968+0000 7fa6cc55b640 1 -- start start 2024-09-11T23:20:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0004d50 0x7fa6c41420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c41e7170 0x7fa6c41e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6c415d370 0x7fa6c415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c40af730 con 0x7fa6c415d370 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c40b40f0 con 0x7fa6b0004d50 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c40afc90 con 0x7fa6c41e7170 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6c415d370 0x7fa6c415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6c415d370 0x7fa6c415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43402/0 (socket says 172.21.15.94:43402) 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 -- 172.21.15.94:0/494777153 learned_addr learned my addr 172.21.15.94:0/494777153 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6ca2f7640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0004d50 0x7fa6c41420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 -- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c41e7170 msgr2=0x7fa6c41e75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c41e7170 0x7fa6c41e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 -- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0004d50 msgr2=0x7fa6c41420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0004d50 0x7fa6c41420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 -- 172.21.15.94:0/494777153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c415df80 con 0x7fa6c415d370 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6caaf8640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6c415d370 0x7fa6c415d7f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01cc60 tx=0x7fa6b0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6b6ffd640 1 -- 172.21.15.94:0/494777153 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0ba070 con 0x7fa6c415d370 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6b6ffd640 1 -- 172.21.15.94:0/494777153 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6bc005820 con 0x7fa6c415d370 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6b6ffd640 1 -- 172.21.15.94:0/494777153 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc001a90 con 0x7fa6c415d370 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c415e260 con 0x7fa6c415d370 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c41e4bc0 con 0x7fa6c415d370 2024-09-11T23:20:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c40aed60 con 0x7fa6c415d370 2024-09-11T23:20:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6b6ffd640 1 -- 172.21.15.94:0/494777153 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6bc0bd070 con 0x7fa6c415d370 2024-09-11T23:20:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6b6ffd640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa6a80678f0 0x7fa6a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6b6ffd640 1 -- 172.21.15.94:0/494777153 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7fa6bc11f400 con 0x7fa6c415d370 2024-09-11T23:20:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6ca2f7640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa6a80678f0 0x7fa6a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.972+0000 7fa6ca2f7640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa6a80678f0 0x7fa6a8069db0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0001870 tx=0x7fa6c00016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:18.976+0000 7fa6b6ffd640 1 -- 172.21.15.94:0/494777153 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6bc0ac020 con 0x7fa6c415d370 2024-09-11T23:20:19.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.200+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]} v 0) -- 0x7fa6c406fcd0 con 0x7fa6c415d370 2024-09-11T23:20:19.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6b6ffd640 1 -- 172.21.15.94:0/494777153 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]}]=0 v282) ==== 134+0+0 (secure 0 0 0) 0x7fa6bc016490 con 0x7fa6c415d370 2024-09-11T23:20:19.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa6a80678f0 msgr2=0x7fa6a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa6a80678f0 0x7fa6a8069db0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0001870 tx=0x7fa6c00016c0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6c415d370 msgr2=0x7fa6c415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6c415d370 0x7fa6c415d7f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01cc60 tx=0x7fa6b0005840 comp rx=0 tx=0).stop 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 shutdown_connections 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa6a80678f0 0x7fa6a8069db0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6c415d370 0x7fa6c415d7f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c41e7170 0x7fa6c41e75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 --2- 172.21.15.94:0/494777153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0004d50 0x7fa6c41420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 >> 172.21.15.94:0/494777153 conn(0x7fa6c40b1f90 msgr2=0x7fa6c40b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 shutdown_connections 2024-09-11T23:20:19.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.228+0000 7fa6cc55b640 1 -- 172.21.15.94:0/494777153 wait complete. 2024-09-11T23:20:19.247 INFO:tasks.cephfs_test_runner:test_files_throttle (tasks.cephfs.test_strays.TestStrays) ... ok 2024-09-11T23:20:19.248 INFO:tasks.cephfs_test_runner:Starting test: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) That removal of primary dentry of hardlinked inode results 2024-09-11T23:20:19.248 INFO:tasks.cephfs_test_runner:test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:20:19.248 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:19.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.352+0000 7f12c6528640 1 Processor -- start 2024-09-11T23:20:19.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.352+0000 7f12c6528640 1 -- start start 2024-09-11T23:20:19.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12c00d3060 0x7f12c00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c00d0300 con 0x7f12c0161a60 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c00b0f60 con 0x7f12c00cf450 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f12c00cfd40 con 0x7f12c00d3060 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12bf7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12c00d3060 0x7f12c00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12bffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f12c0161a60 0x7f12c00d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56238/0 (socket says 172.21.15.94:56238) 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12bffff640 1 -- 172.21.15.94:0/45901990 learned_addr learned my addr 172.21.15.94:0/45901990 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12bf7fe640 1 -- 172.21.15.94:0/45901990 >> v1:172.21.15.155:6789/0 conn(0x7f12c00cf450 legacy=0x7f12c006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12bf7fe640 1 -- 172.21.15.94:0/45901990 >> v1:172.21.15.94:6789/0 conn(0x7f12c0161a60 legacy=0x7f12c00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12bf7fe640 1 -- 172.21.15.94:0/45901990 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c00d0020 con 0x7f12c00d3060 2024-09-11T23:20:19.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12beffd640 1 -- 172.21.15.94:0/45901990 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470558021 0 0) 0x7f12b0001120 con 0x7f12c0161a60 2024-09-11T23:20:19.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12bf7fe640 1 --2- 172.21.15.94:0/45901990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00cef10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f12b40097c0 tx=0x7f12b401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8ab8ca06ab3588 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12beffd640 1 -- 172.21.15.94:0/45901990 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b40b1070 con 0x7f12c00d3060 2024-09-11T23:20:19.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12beffd640 1 -- 172.21.15.94:0/45901990 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b40ac600 con 0x7f12c00d3060 2024-09-11T23:20:19.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12beffd640 1 -- 172.21.15.94:0/45901990 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b40ac9d0 con 0x7f12c00d3060 2024-09-11T23:20:19.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- 172.21.15.94:0/45901990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 msgr2=0x7f12c00cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 --2- 172.21.15.94:0/45901990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00cef10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f12b40097c0 tx=0x7f12b401c3a0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- 172.21.15.94:0/45901990 shutdown_connections 2024-09-11T23:20:19.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 --2- 172.21.15.94:0/45901990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00cef10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- 172.21.15.94:0/45901990 >> 172.21.15.94:0/45901990 conn(0x7f12c008bf90 msgr2=0x7f12c009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:19.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- 172.21.15.94:0/45901990 shutdown_connections 2024-09-11T23:20:19.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.356+0000 7f12c6528640 1 -- 172.21.15.94:0/45901990 wait complete. 2024-09-11T23:20:19.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 Processor -- start 2024-09-11T23:20:19.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 -- start start 2024-09-11T23:20:19.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c00cf450 0x7f12c00cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c0161a60 0x7f12c0158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12c016bf30 con 0x7f12c00d3060 2024-09-11T23:20:19.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12c016c0b0 con 0x7f12c0161a60 2024-09-11T23:20:19.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12c016c230 con 0x7f12c00cf450 2024-09-11T23:20:19.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43418/0 (socket says 172.21.15.94:43418) 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 -- 172.21.15.94:0/2550647665 learned_addr learned my addr 172.21.15.94:0/2550647665 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bffff640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c00cf450 0x7f12c00cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 -- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c00cf450 msgr2=0x7f12c00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c00cf450 0x7f12c00cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 -- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c0161a60 msgr2=0x7f12c0158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c4ac5640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c0161a60 0x7f12c0158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c0161a60 0x7f12c0158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 -- 172.21.15.94:0/2550647665 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c00cc630 con 0x7f12c00d3060 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bffff640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c00cf450 0x7f12c00cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bf7fe640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00b3200 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f12b4018fb0 tx=0x7f12b401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bcff9640 1 -- 172.21.15.94:0/2550647665 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b40bb020 con 0x7f12c00d3060 2024-09-11T23:20:19.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bcff9640 1 -- 172.21.15.94:0/2550647665 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b40b7620 con 0x7f12c00d3060 2024-09-11T23:20:19.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c00cc8d0 con 0x7f12c00d3060 2024-09-11T23:20:19.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bcff9640 1 -- 172.21.15.94:0/2550647665 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b40b1040 con 0x7f12c00d3060 2024-09-11T23:20:19.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c00cce90 con 0x7f12c00d3060 2024-09-11T23:20:19.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c00cb170 con 0x7f12c00d3060 2024-09-11T23:20:19.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.360+0000 7f12bcff9640 1 -- 172.21.15.94:0/2550647665 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12b40be020 con 0x7f12c00d3060 2024-09-11T23:20:19.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.364+0000 7f12bcff9640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12ac0678c0 0x7f12ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.364+0000 7f12bcff9640 1 -- 172.21.15.94:0/2550647665 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7f12b411fc90 con 0x7f12c00d3060 2024-09-11T23:20:19.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.364+0000 7f12bffff640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12ac0678c0 0x7f12ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.364+0000 7f12bffff640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12ac0678c0 0x7f12ac069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f12b0000f70 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.368+0000 7f12bcff9640 1 -- 172.21.15.94:0/2550647665 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f12b4016050 con 0x7f12c00d3060 2024-09-11T23:20:19.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.532+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12c00d29f0 con 0x7f12c00d3060 2024-09-11T23:20:19.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.532+0000 7f12bcff9640 1 -- 172.21.15.94:0/2550647665 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+13463 (secure 0 0 0) 0x7f12b40f0a10 con 0x7f12c00d3060 2024-09-11T23:20:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:19.536 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":107,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:20:18.221809+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.94:6835/1696446491":"2024-09-12T23:20:14.886060+0000","172.21.15.94:6834/1696446491":"2024-09-12T23:20:14.886060+0000","172.21.15.94:6835/3585698004":"2024-09-12T23:19:44.615685+0000","172.21.15.94:6834/3585698004":"2024-09-12T23:19:44.615685+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12ac0678c0 msgr2=0x7f12ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12ac0678c0 0x7f12ac069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f12b0000f70 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 msgr2=0x7f12c00b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00b3200 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f12b4018fb0 tx=0x7f12b401abe0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 shutdown_connections 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12c0161a60 0x7f12c0158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f12ac0678c0 0x7f12ac069d80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c00d3060 0x7f12c00b3200 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 --2- 172.21.15.94:0/2550647665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12c00cf450 0x7f12c00cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 >> 172.21.15.94:0/2550647665 conn(0x7f12c008bf90 msgr2=0x7f12c00b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:19.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 shutdown_connections 2024-09-11T23:20:19.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.536+0000 7f12c6528640 1 -- 172.21.15.94:0/2550647665 wait complete. 2024-09-11T23:20:19.554 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:15:02.040073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:20:19.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:20:19.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec2a439640 1 Processor -- start 2024-09-11T23:20:19.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec2a439640 1 -- start start 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec2a439640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec2415bec0 0x7fec240ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec2a439640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec240aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec2a439640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec240b3290 con 0x7fec240af2a0 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec2a439640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fec240b3570 con 0x7fec2415bec0 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec2a439640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fec240b3850 con 0x7fec2415c2a0 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec23fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec2415bec0 0x7fec240ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec23fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec2415bec0 0x7fec240ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43428/0 (socket says 172.21.15.94:43428) 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.672+0000 7fec23fff640 1 -- 172.21.15.94:0/4256691065 learned_addr learned my addr 172.21.15.94:0/4256691065 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:19.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec237fe640 1 --2- 172.21.15.94:0/4256691065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec240aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec23fff640 1 -- 172.21.15.94:0/4256691065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 msgr2=0x7fec240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:19.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec23fff640 1 --2- 172.21.15.94:0/4256691065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec240aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec23fff640 1 -- 172.21.15.94:0/4256691065 >> v1:172.21.15.155:6789/0 conn(0x7fec240af2a0 legacy=0x7fec2415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:19.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec23fff640 1 -- 172.21.15.94:0/4256691065 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec240b3b30 con 0x7fec2415bec0 2024-09-11T23:20:19.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec237fe640 1 --2- 172.21.15.94:0/4256691065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec240aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:19.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec23fff640 1 --2- 172.21.15.94:0/4256691065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec2415bec0 0x7fec240ad200 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009e50 tx=0x7fec1c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c096e2a4e23a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec22ffd640 1 -- 172.21.15.94:0/4256691065 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0a5840 con 0x7fec2415bec0 2024-09-11T23:20:19.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec22ffd640 1 -- 172.21.15.94:0/4256691065 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1c0a59e0 con 0x7fec2415bec0 2024-09-11T23:20:19.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec22ffd640 1 -- 172.21.15.94:0/4256691065 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0a5db0 con 0x7fec2415bec0 2024-09-11T23:20:19.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 -- 172.21.15.94:0/4256691065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec2415bec0 msgr2=0x7fec240ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 --2- 172.21.15.94:0/4256691065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec2415bec0 0x7fec240ad200 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009e50 tx=0x7fec1c01c9c0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 -- 172.21.15.94:0/4256691065 shutdown_connections 2024-09-11T23:20:19.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 --2- 172.21.15.94:0/4256691065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec240aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 --2- 172.21.15.94:0/4256691065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec2415bec0 0x7fec240ad200 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 -- 172.21.15.94:0/4256691065 >> 172.21.15.94:0/4256691065 conn(0x7fec240b1f90 msgr2=0x7fec240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:19.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 -- 172.21.15.94:0/4256691065 shutdown_connections 2024-09-11T23:20:19.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.676+0000 7fec2a439640 1 -- 172.21.15.94:0/4256691065 wait complete. 2024-09-11T23:20:19.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 Processor -- start 2024-09-11T23:20:19.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 -- start start 2024-09-11T23:20:19.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec240af2a0 0x7fec2415f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec2415bec0 0x7fec240998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec24159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fec240ad740 con 0x7fec240af2a0 2024-09-11T23:20:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec240afc90 con 0x7fec2415bec0 2024-09-11T23:20:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fec24169000 con 0x7fec2415c2a0 2024-09-11T23:20:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec240af2a0 0x7fec2415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec240af2a0 0x7fec2415f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43430/0 (socket says 172.21.15.94:43430) 2024-09-11T23:20:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 -- 172.21.15.94:0/3359435318 learned_addr learned my addr 172.21.15.94:0/3359435318 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec289d6640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec24159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec237fe640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec2415bec0 0x7fec240998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 -- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 msgr2=0x7fec24159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec24159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 -- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec2415bec0 msgr2=0x7fec240998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec2415bec0 0x7fec240998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 -- 172.21.15.94:0/3359435318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2415f6c0 con 0x7fec240af2a0 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec289d6640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec24159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec23fff640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec240af2a0 0x7fec2415f180 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0af040 tx=0x7fec1c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec20ff9640 1 -- 172.21.15.94:0/3359435318 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0b8880 con 0x7fec240af2a0 2024-09-11T23:20:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec20ff9640 1 -- 172.21.15.94:0/3359435318 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1c0be070 con 0x7fec240af2a0 2024-09-11T23:20:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2415e910 con 0x7fec240af2a0 2024-09-11T23:20:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec20ff9640 1 -- 172.21.15.94:0/3359435318 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0b8ca0 con 0x7fec240af2a0 2024-09-11T23:20:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec24071f10 con 0x7fec240af2a0 2024-09-11T23:20:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec240ad200 con 0x7fec240af2a0 2024-09-11T23:20:19.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec20ff9640 1 -- 172.21.15.94:0/3359435318 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec1c0c3460 con 0x7fec240af2a0 2024-09-11T23:20:19.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec20ff9640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec040678c0 0x7fec04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.680+0000 7fec20ff9640 1 -- 172.21.15.94:0/3359435318 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7fec1c120f00 con 0x7fec240af2a0 2024-09-11T23:20:19.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.684+0000 7fec237fe640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec040678c0 0x7fec04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.684+0000 7fec237fe640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec040678c0 0x7fec04069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fec0c006fd0 tx=0x7fec0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.688+0000 7fec20ff9640 1 -- 172.21.15.94:0/3359435318 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec1c0165e0 con 0x7fec240af2a0 2024-09-11T23:20:19.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec2406fcd0 con 0x7fec240af2a0 2024-09-11T23:20:19.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec20ff9640 1 -- 172.21.15.94:0/3359435318 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) ==== 93+0+10 (secure 0 0 0) 0x7fec1c0a59b0 con 0x7fec240af2a0 2024-09-11T23:20:19.849 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-09-11T23:20:19.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec040678c0 msgr2=0x7fec04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec040678c0 0x7fec04069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fec0c006fd0 tx=0x7fec0c008040 comp rx=0 tx=0).stop 2024-09-11T23:20:19.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec240af2a0 msgr2=0x7fec2415f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec240af2a0 0x7fec2415f180 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0af040 tx=0x7fec1c019760 comp rx=0 tx=0).stop 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 shutdown_connections 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec2415c2a0 0x7fec24159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec2415bec0 0x7fec240998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fec040678c0 0x7fec04069d80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 --2- 172.21.15.94:0/3359435318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec240af2a0 0x7fec2415f180 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 >> 172.21.15.94:0/3359435318 conn(0x7fec240b1f90 msgr2=0x7fec24075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 shutdown_connections 2024-09-11T23:20:19.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.848+0000 7fec2a439640 1 -- 172.21.15.94:0/3359435318 wait complete. 2024-09-11T23:20:19.868 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration' 2024-09-11T23:20:19.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 Processor -- start 2024-09-11T23:20:19.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 -- start start 2024-09-11T23:20:19.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0e301587a0 0x7f0e300b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e300b37d0 0x7f0e3006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0e300b3c40 con 0x7f0e300b37d0 2024-09-11T23:20:19.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3006f870 con 0x7f0e301587a0 2024-09-11T23:20:19.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e387b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3006ec60 con 0x7f0e3006e4b0 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e300b37d0 0x7f0e3006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e300b37d0 0x7f0e3006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37484/0 (socket says 172.21.15.94:37484) 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 -- 172.21.15.94:0/3713849395 learned_addr learned my addr 172.21.15.94:0/3713849395 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e36555640 1 --2- 172.21.15.94:0/3713849395 >> v2:172.21.15.155:3300/0 conn(0x7f0e301587a0 0x7f0e300b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e36d56640 1 --2- 172.21.15.94:0/3713849395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 -- 172.21.15.94:0/3713849395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 msgr2=0x7f0e30161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 --2- 172.21.15.94:0/3713849395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30161e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 -- 172.21.15.94:0/3713849395 >> v2:172.21.15.155:3300/0 conn(0x7f0e301587a0 msgr2=0x7f0e300b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 --2- 172.21.15.94:0/3713849395 >> v2:172.21.15.155:3300/0 conn(0x7f0e301587a0 0x7f0e300b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e35d54640 1 -- 172.21.15.94:0/3713849395 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3006ef40 con 0x7f0e300b37d0 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e36d56640 1 --2- 172.21.15.94:0/3713849395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:19.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.984+0000 7f0e36555640 1 --2- 172.21.15.94:0/3713849395 >> v2:172.21.15.155:3300/0 conn(0x7f0e301587a0 0x7f0e300b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 --2- 172.21.15.94:0/3713849395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e3006df70 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0e30071710 tx=0x7f0e2001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3fd313df77f503 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35553640 1 -- 172.21.15.94:0/3713849395 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200b0070 con 0x7f0e300b37d0 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35553640 1 -- 172.21.15.94:0/3713849395 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e200ab600 con 0x7f0e300b37d0 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35553640 1 -- 172.21.15.94:0/3713849395 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200ab9d0 con 0x7f0e300b37d0 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- 172.21.15.94:0/3713849395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 msgr2=0x7f0e3006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 --2- 172.21.15.94:0/3713849395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e3006df70 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0e30071710 tx=0x7f0e2001c230 comp rx=0 tx=0).stop 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- 172.21.15.94:0/3713849395 shutdown_connections 2024-09-11T23:20:19.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 --2- 172.21.15.94:0/3713849395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 --2- 172.21.15.94:0/3713849395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e3006df70 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 --2- 172.21.15.94:0/3713849395 >> v2:172.21.15.155:3300/0 conn(0x7f0e301587a0 0x7f0e300b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- 172.21.15.94:0/3713849395 >> 172.21.15.94:0/3713849395 conn(0x7f0e300b1f90 msgr2=0x7f0e300b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:19.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- 172.21.15.94:0/3713849395 shutdown_connections 2024-09-11T23:20:19.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- 172.21.15.94:0/3713849395 wait complete. 2024-09-11T23:20:19.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 Processor -- start 2024-09-11T23:20:19.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- start start 2024-09-11T23:20:19.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e30154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e301587a0 0x7f0e300ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30158b80 con 0x7f0e300b37d0 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30072160 con 0x7f0e301587a0 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e30150320 con 0x7f0e3006e4b0 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e30154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e30154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37498/0 (socket says 172.21.15.94:37498) 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 -- 172.21.15.94:0/770354762 learned_addr learned my addr 172.21.15.94:0/770354762 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e36555640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e36d56640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e301587a0 0x7f0e300ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 -- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 msgr2=0x7f0e30146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 -- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e301587a0 msgr2=0x7f0e300ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e301587a0 0x7f0e300ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 -- 172.21.15.94:0/770354762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e30155240 con 0x7f0e300b37d0 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e36d56640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e301587a0 0x7f0e300ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e35d54640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e30154940 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f0e2001a8e0 tx=0x7f0e20018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e26ffd640 1 -- 172.21.15.94:0/770354762 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200b9070 con 0x7f0e300b37d0 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e26ffd640 1 -- 172.21.15.94:0/770354762 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e200b4600 con 0x7f0e300b37d0 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3014fcd0 con 0x7f0e300b37d0 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e26ffd640 1 -- 172.21.15.94:0/770354762 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200b0040 con 0x7f0e300b37d0 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.988+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e30147440 con 0x7f0e300b37d0 2024-09-11T23:20:19.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.992+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e30070080 con 0x7f0e300b37d0 2024-09-11T23:20:19.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.992+0000 7f0e26ffd640 1 -- 172.21.15.94:0/770354762 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e200bc070 con 0x7f0e300b37d0 2024-09-11T23:20:19.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.992+0000 7f0e26ffd640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e140678c0 0x7f0e14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:19.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.992+0000 7f0e26ffd640 1 -- 172.21.15.94:0/770354762 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7f0e2011ed30 con 0x7f0e300b37d0 2024-09-11T23:20:19.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.992+0000 7f0e36555640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e140678c0 0x7f0e14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:19.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.992+0000 7f0e36555640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e140678c0 0x7f0e14069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c006fd0 tx=0x7f0e2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:19.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:19.996+0000 7f0e26ffd640 1 -- 172.21.15.94:0/770354762 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e20016110 con 0x7f0e300b37d0 2024-09-11T23:20:20.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.200+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]} v 0) -- 0x7f0e301504a0 con 0x7f0e300b37d0 2024-09-11T23:20:20.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.228+0000 7f0e26ffd640 1 -- 172.21.15.94:0/770354762 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]}]=0 v283) ==== 145+0+0 (secure 0 0 0) 0x7f0e200ef990 con 0x7f0e300b37d0 2024-09-11T23:20:20.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e140678c0 msgr2=0x7f0e14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e140678c0 0x7f0e14069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c006fd0 tx=0x7f0e2c008040 comp rx=0 tx=0).stop 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 msgr2=0x7f0e30154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e30154940 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f0e2001a8e0 tx=0x7f0e20018fd0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 shutdown_connections 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e301587a0 0x7f0e300ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0e140678c0 0x7f0e14069d80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e300b37d0 0x7f0e30154940 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 --2- 172.21.15.94:0/770354762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e3006e4b0 0x7f0e30146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 >> 172.21.15.94:0/770354762 conn(0x7f0e300b1f90 msgr2=0x7f0e300b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 shutdown_connections 2024-09-11T23:20:20.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.232+0000 7f0e387b9640 1 -- 172.21.15.94:0/770354762 wait complete. 2024-09-11T23:20:20.250 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:20:20.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.364+0000 7fcbc03c5640 1 Processor -- start 2024-09-11T23:20:20.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.364+0000 7fcbc03c5640 1 -- start start 2024-09-11T23:20:20.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbc03c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcbb80b4460 0x7fcbb806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbc03c5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb806ee50 con 0x7fcbb8073e60 2024-09-11T23:20:20.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbc03c5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb806f130 con 0x7fcbb806fef0 2024-09-11T23:20:20.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbc03c5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb806f410 con 0x7fcbb80b4460 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbe161640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcbb8073e60 0x7fcbb815b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42210/0 (socket says 172.21.15.94:42210) 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbe161640 1 -- 172.21.15.94:0/3006174066 learned_addr learned my addr 172.21.15.94:0/3006174066 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841950339 0 0) 0x7fcbb806ee50 con 0x7fcbb8073e60 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcba0005740 con 0x7fcbb8073e60 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbe962640 1 --2- 172.21.15.94:0/3006174066 >> v2:172.21.15.155:3300/0 conn(0x7fcbb80b4460 0x7fcbb806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2530746050 0 0) 0x7fcba0005740 con 0x7fcbb8073e60 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 >> v2:172.21.15.155:3300/0 conn(0x7fcbb80b4460 msgr2=0x7fcbb806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 --2- 172.21.15.94:0/3006174066 >> v2:172.21.15.155:3300/0 conn(0x7fcbb80b4460 0x7fcbb806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 >> v1:172.21.15.155:6789/0 conn(0x7fcbb806fef0 legacy=0x7fcbb80b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb806f6f0 con 0x7fcbb8073e60 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fcbb0001a00 con 0x7fcbb8073e60 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 >> v1:172.21.15.94:6789/0 conn(0x7fcbb8073e60 legacy=0x7fcbb815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba0005bd0 0x7fcba0005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcba0006a20 0x7fcba0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0007500 0x7fcba000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb806f410 con 0x7fcba0006a20 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcba000e3d0 con 0x7fcba0005bd0 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcba000e5d0 con 0x7fcba0007500 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd960640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcba0006a20 0x7fcba0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbe161640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba0005bd0 0x7fcba0005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbe962640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0007500 0x7fcba000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd960640 1 -- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0007500 msgr2=0x7fcba000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd960640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0007500 0x7fcba000dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd960640 1 -- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba0005bd0 msgr2=0x7fcba0005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd960640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba0005bd0 0x7fcba0005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbd960640 1 -- 172.21.15.94:0/3006174066 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba0005740 con 0x7fcba0006a20 2024-09-11T23:20:20.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.368+0000 7fcbbe962640 1 -- 172.21.15.94:0/3006174066 reap_dead start 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcba0006a20 0x7fcba0006ea0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001750 tx=0x7fcbac01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94985020e50a7081 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0013a0 con 0x7fcba0006a20 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac0052f0 con 0x7fcba0006a20 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd15f640 1 -- 172.21.15.94:0/3006174066 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac003840 con 0x7fcba0006a20 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- 172.21.15.94:0/3006174066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcba0006a20 msgr2=0x7fcba0006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcba0006a20 0x7fcba0006ea0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001750 tx=0x7fcbac01c3a0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- 172.21.15.94:0/3006174066 shutdown_connections 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/3006174066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcba0006a20 0x7fcba0006ea0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- 172.21.15.94:0/3006174066 >> 172.21.15.94:0/3006174066 conn(0x7fcbb80b1f90 msgr2=0x7fcbb80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:20.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- 172.21.15.94:0/3006174066 shutdown_connections 2024-09-11T23:20:20.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- 172.21.15.94:0/3006174066 wait complete. 2024-09-11T23:20:20.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 Processor -- start 2024-09-11T23:20:20.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- start start 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0006a20 0x7fcbb81f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb81598a0 0x7fcbb81578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbb8157df0 0x7fcbb8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb806e900 con 0x7fcbb81598a0 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb806e780 con 0x7fcbb8157df0 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb806ea80 con 0x7fcba0006a20 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb81598a0 0x7fcbb81578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb81598a0 0x7fcbb81578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37520/0 (socket says 172.21.15.94:37520) 2024-09-11T23:20:20.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 -- 172.21.15.94:0/2583578395 learned_addr learned my addr 172.21.15.94:0/2583578395 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbe962640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbb8157df0 0x7fcbb8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbe161640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0006a20 0x7fcbb81f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 -- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0006a20 msgr2=0x7fcbb81f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0006a20 0x7fcbb81f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 -- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbb8157df0 msgr2=0x7fcbb8155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbb8157df0 0x7fcbb8155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 -- 172.21.15.94:0/2583578395 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb81f4530 con 0x7fcbb81598a0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbe962640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbb8157df0 0x7fcbb8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbbd960640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb81598a0 0x7fcbb81578b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fcbac01c1d0 tx=0x7fcba0007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbb6ffd640 1 -- 172.21.15.94:0/2583578395 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac007a40 con 0x7fcbb81598a0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbb6ffd640 1 -- 172.21.15.94:0/2583578395 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac0ba070 con 0x7fcbb81598a0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb8159d40 con 0x7fcbb81598a0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbb6ffd640 1 -- 172.21.15.94:0/2583578395 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0054a0 con 0x7fcbb81598a0 2024-09-11T23:20:20.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.372+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb815a300 con 0x7fcbb81598a0 2024-09-11T23:20:20.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.376+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb8158200 con 0x7fcbb81598a0 2024-09-11T23:20:20.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.376+0000 7fcbb6ffd640 1 -- 172.21.15.94:0/2583578395 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcbac007030 con 0x7fcbb81598a0 2024-09-11T23:20:20.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.376+0000 7fcbb6ffd640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcba40678c0 0x7fcba4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.376+0000 7fcbb6ffd640 1 -- 172.21.15.94:0/2583578395 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7fcbac11fad0 con 0x7fcbb81598a0 2024-09-11T23:20:20.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.376+0000 7fcbbe161640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcba40678c0 0x7fcba4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.376+0000 7fcbbe161640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcba40678c0 0x7fcba4069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00013e0 tx=0x7fcbb0001500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.380+0000 7fcbb6ffd640 1 -- 172.21.15.94:0/2583578395 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcbb8158200 con 0x7fcbb81598a0 2024-09-11T23:20:20.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.540+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcbb815e400 con 0x7fcbb81598a0 2024-09-11T23:20:20.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.544+0000 7fcbb6ffd640 1 -- 172.21.15.94:0/2583578395 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fcbb81f4530 con 0x7fcbb81598a0 2024-09-11T23:20:20.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcba40678c0 msgr2=0x7fcba4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcba40678c0 0x7fcba4069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00013e0 tx=0x7fcbb0001500 comp rx=0 tx=0).stop 2024-09-11T23:20:20.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb81598a0 msgr2=0x7fcbb81578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb81598a0 0x7fcbb81578b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fcbac01c1d0 tx=0x7fcba0007a50 comp rx=0 tx=0).stop 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 shutdown_connections 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbb8157df0 0x7fcbb8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fcba40678c0 0x7fcba4069d80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb81598a0 0x7fcbb81578b0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 --2- 172.21.15.94:0/2583578395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba0006a20 0x7fcbb81f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 >> 172.21.15.94:0/2583578395 conn(0x7fcbb80b1f90 msgr2=0x7fcbb80734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 shutdown_connections 2024-09-11T23:20:20.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.548+0000 7fcbc03c5640 1 -- 172.21.15.94:0/2583578395 wait complete. 2024-09-11T23:20:20.566 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:20:20.567 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:20.617 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:20.675 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:20:20.675 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:20.676 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:20.681 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:20.681 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:20.682 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:20.688 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:20.688 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:20.688 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:20.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:20.729 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:20.729 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:20.734 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:20.735 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:20:20.735 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:20.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.892+0000 7f30060db640 1 Processor -- start 2024-09-11T23:20:20.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.892+0000 7f30060db640 1 -- start start 2024-09-11T23:20:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f30060db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f30060db640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f30000af2a0 0x7f300006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f30060db640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30000b3290 con 0x7f300015bec0 2024-09-11T23:20:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f30060db640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f30000b3570 con 0x7f30000af2a0 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f30060db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30000b3850 con 0x7f300015c2a0 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2fff7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f300015bec0 0x7f30000ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42226/0 (socket says 172.21.15.94:42226) 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2fff7fe640 1 -- 172.21.15.94:0/3854865699 learned_addr learned my addr 172.21.15.94:0/3854865699 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffffff640 1 --2- 172.21.15.94:0/3854865699 >> v2:172.21.15.94:3300/0 conn(0x7f30000af2a0 0x7f300006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ff6ffd640 1 --2- 172.21.15.94:0/3854865699 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffeffd640 1 -- 172.21.15.94:0/3854865699 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762563193 0 0) 0x7f30000b3290 con 0x7f300015bec0 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffeffd640 1 -- 172.21.15.94:0/3854865699 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fec003530 con 0x7f300015bec0 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffffff640 1 -- 172.21.15.94:0/3854865699 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 msgr2=0x7f30000aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffffff640 1 --2- 172.21.15.94:0/3854865699 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffffff640 1 -- 172.21.15.94:0/3854865699 >> v1:172.21.15.94:6789/0 conn(0x7f300015bec0 legacy=0x7f30000ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffffff640 1 -- 172.21.15.94:0/3854865699 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30000b3b30 con 0x7f30000af2a0 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffffff640 1 --2- 172.21.15.94:0/3854865699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30000af2a0 0x7f300006e000 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009d90 tx=0x7f2ff801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810fe0326e52b461 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffeffd640 1 -- 172.21.15.94:0/3854865699 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80b2070 con 0x7f30000af2a0 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffeffd640 1 -- 172.21.15.94:0/3854865699 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff80a5a00 con 0x7f30000af2a0 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.896+0000 7f2ffeffd640 1 -- 172.21.15.94:0/3854865699 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80a5dd0 con 0x7f30000af2a0 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- 172.21.15.94:0/3854865699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30000af2a0 msgr2=0x7f300006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 --2- 172.21.15.94:0/3854865699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30000af2a0 0x7f300006e000 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009d90 tx=0x7f2ff801c940 comp rx=0 tx=0).stop 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- 172.21.15.94:0/3854865699 shutdown_connections 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 --2- 172.21.15.94:0/3854865699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30000af2a0 0x7f300006e000 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 --2- 172.21.15.94:0/3854865699 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- 172.21.15.94:0/3854865699 >> 172.21.15.94:0/3854865699 conn(0x7f30000b1f90 msgr2=0x7f30000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- 172.21.15.94:0/3854865699 shutdown_connections 2024-09-11T23:20:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- 172.21.15.94:0/3854865699 wait complete. 2024-09-11T23:20:20.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 Processor -- start 2024-09-11T23:20:20.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- start start 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30000af2a0 0x7f3000099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f300015bec0 0x7f3000155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f300006ed50 con 0x7f300015bec0 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30000afc90 con 0x7f30000af2a0 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f300006eed0 con 0x7f300015c2a0 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f300015bec0 0x7f3000155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f300015bec0 0x7f3000155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37532/0 (socket says 172.21.15.94:37532) 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 -- 172.21.15.94:0/1002089752 learned_addr learned my addr 172.21.15.94:0/1002089752 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 -- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 msgr2=0x7f30000732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ffffff640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2fff7fe640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30000af2a0 0x7f3000099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 -- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30000af2a0 msgr2=0x7f3000099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30000af2a0 0x7f3000099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 -- 172.21.15.94:0/1002089752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30000cf4b0 con 0x7f300015bec0 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ff6ffd640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f300015bec0 0x7f3000155570 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800d5f0 tx=0x7f2fe800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ffcff9640 1 -- 172.21.15.94:0/1002089752 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80125f0 con 0x7f300015bec0 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ffcff9640 1 -- 172.21.15.94:0/1002089752 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8019070 con 0x7f300015bec0 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f2ffcff9640 1 -- 172.21.15.94:0/1002089752 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80129b0 con 0x7f300015bec0 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3000153bc0 con 0x7f300015bec0 2024-09-11T23:20:20.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.900+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3000154180 con 0x7f300015bec0 2024-09-11T23:20:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.904+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300006f280 con 0x7f300015bec0 2024-09-11T23:20:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.904+0000 7f2ffcff9640 1 -- 172.21.15.94:0/1002089752 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fe8012b50 con 0x7f300015bec0 2024-09-11T23:20:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.904+0000 7f2ffcff9640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2fe00678c0 0x7f2fe0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.904+0000 7f2ffcff9640 1 -- 172.21.15.94:0/1002089752 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7f2fe8085eb0 con 0x7f300015bec0 2024-09-11T23:20:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.904+0000 7f2fff7fe640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2fe00678c0 0x7f2fe0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.904+0000 7f2fff7fe640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2fe00678c0 0x7f2fe0069d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0007fd0 tx=0x7f2ff0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:20.908+0000 7f2ffcff9640 1 -- 172.21.15.94:0/1002089752 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fe8056ba0 con 0x7f300015bec0 2024-09-11T23:20:21.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30000aeed0 con 0x7f300015bec0 2024-09-11T23:20:21.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f2ffcff9640 1 -- 172.21.15.94:0/1002089752 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3908 (secure 0 0 0) 0x7f2fe80564a0 con 0x7f300015bec0 2024-09-11T23:20:21.101 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:21.102 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":65,"btime":"2024-09-11T23:20:15:888763+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2161929785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2161929785},{"type":"v1","addr":"172.21.15.155:6837","nonce":2161929785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/99897452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":99897452},{"type":"v1","addr":"172.21.15.155:6835","nonce":99897452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/162171373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":162171373},{"type":"v1","addr":"172.21.15.94:6833","nonce":162171373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":7062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2517106315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2517106315},{"type":"v1","addr":"172.21.15.94:6835","nonce":2517106315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[]} 2024-09-11T23:20:21.102 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 65 2024-09-11T23:20:21.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2fe00678c0 msgr2=0x7f2fe0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2fe00678c0 0x7f2fe0069d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0007fd0 tx=0x7f2ff0009040 comp rx=0 tx=0).stop 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f300015bec0 msgr2=0x7f3000155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f300015bec0 0x7f3000155570 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800d5f0 tx=0x7f2fe800dab0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 shutdown_connections 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f300015c2a0 0x7f30000732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2fe00678c0 0x7f2fe0069d80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f300015bec0 0x7f3000155570 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 --2- 172.21.15.94:0/1002089752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30000af2a0 0x7f3000099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 >> 172.21.15.94:0/1002089752 conn(0x7f30000b1f90 msgr2=0x7f30000cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 shutdown_connections 2024-09-11T23:20:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.100+0000 7f30060db640 1 -- 172.21.15.94:0/1002089752 wait complete. 2024-09-11T23:20:21.119 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:20:21.120 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:20:21.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:20:21.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:21.120 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:20:21.120 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:20:21.120 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:20:21.121 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:21.121 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:20:21.121 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:20:21.121 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:20:21.121 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:21.121 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:20:21.121 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:20:21.122 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:20:21.122 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:21.130 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:20:21.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:20:21.131 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:20:21.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:20:21.133 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:20:21.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:20:21.135 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:20:21.135 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:20:21.173 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:20:21.173 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:21.174 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:20:21.174 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:21.178 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:20:21.179 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:21.180 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:20:21.180 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:21.180 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:20:21.231 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-09-11T23:20:21.238 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:20:21.248 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-11T23:20:21.255 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f0184a30640 1 Processor -- start 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f0184a30640 1 -- start start 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f0184a30640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f018009ac60 0x7f018009ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f0184a30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01800af730 0x7f018015d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f0184a30640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01800afd80 con 0x7f018009b040 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f0184a30640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f01800afb60 con 0x7f018009ac60 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f0184a30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01800b0060 con 0x7f01800af730 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017dd9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f018009b040 0x7f01800b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42234/0 (socket says 172.21.15.94:42234) 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017dd9b640 1 -- 172.21.15.94:0/3801779347 learned_addr learned my addr 172.21.15.94:0/3801779347 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017e59c640 1 --2- 172.21.15.94:0/3801779347 >> v2:172.21.15.94:3300/0 conn(0x7f018009ac60 0x7f018009ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017ed9d640 1 --2- 172.21.15.94:0/3801779347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01800af730 0x7f018015d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017e59c640 1 -- 172.21.15.94:0/3801779347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01800af730 msgr2=0x7f018015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017e59c640 1 --2- 172.21.15.94:0/3801779347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01800af730 0x7f018015d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017e59c640 1 -- 172.21.15.94:0/3801779347 >> v1:172.21.15.94:6789/0 conn(0x7f018009b040 legacy=0x7f01800b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017e59c640 1 -- 172.21.15.94:0/3801779347 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800b0340 con 0x7f018009ac60 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017d59a640 1 -- 172.21.15.94:0/3801779347 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30612594 0 0) 0x7f01800afd80 con 0x7f018009b040 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017ed9d640 1 --2- 172.21.15.94:0/3801779347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01800af730 0x7f018015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:21.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017e59c640 1 --2- 172.21.15.94:0/3801779347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f018009ac60 0x7f018009ba00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0170009d90 tx=0x7f017001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0b2ccb9f4291 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:21.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017d59a640 1 -- 172.21.15.94:0/3801779347 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01700b2070 con 0x7f018009ac60 2024-09-11T23:20:21.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017d59a640 1 -- 172.21.15.94:0/3801779347 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01700a5890 con 0x7f018009ac60 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.292+0000 7f017d59a640 1 -- 172.21.15.94:0/3801779347 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01700a5c60 con 0x7f018009ac60 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- 172.21.15.94:0/3801779347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f018009ac60 msgr2=0x7f018009ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 --2- 172.21.15.94:0/3801779347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f018009ac60 0x7f018009ba00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0170009d90 tx=0x7f017001c8e0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- 172.21.15.94:0/3801779347 shutdown_connections 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 --2- 172.21.15.94:0/3801779347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01800af730 0x7f018015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 --2- 172.21.15.94:0/3801779347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f018009ac60 0x7f018009ba00 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- 172.21.15.94:0/3801779347 >> 172.21.15.94:0/3801779347 conn(0x7f01800b78d0 msgr2=0x7f01800b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- 172.21.15.94:0/3801779347 shutdown_connections 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- 172.21.15.94:0/3801779347 wait complete. 2024-09-11T23:20:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 Processor -- start 2024-09-11T23:20:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- start start 2024-09-11T23:20:21.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f018009ac60 0x7f01801363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018009b040 0x7f0180136920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01800af730 0x7f0180136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f01800b23c0 con 0x7f01800af730 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f018015d550 con 0x7f018009b040 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01800b2540 con 0x7f018009ac60 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01800af730 0x7f0180136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01800af730 0x7f0180136e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37592/0 (socket says 172.21.15.94:37592) 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 -- 172.21.15.94:0/2394703632 learned_addr learned my addr 172.21.15.94:0/2394703632 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017e59c640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f018009ac60 0x7f01801363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017dd9b640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018009b040 0x7f0180136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 -- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f018009ac60 msgr2=0x7f01801363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f018009ac60 0x7f01801363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 -- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018009b040 msgr2=0x7f0180136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018009b040 0x7f0180136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 -- 172.21.15.94:0/2394703632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018014dc10 con 0x7f01800af730 2024-09-11T23:20:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f017ed9d640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01800af730 0x7f0180136e60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f017800c820 tx=0x7f017800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f016effd640 1 -- 172.21.15.94:0/2394703632 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178015020 con 0x7f01800af730 2024-09-11T23:20:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f016effd640 1 -- 172.21.15.94:0/2394703632 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0178004240 con 0x7f01800af730 2024-09-11T23:20:21.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f016effd640 1 -- 172.21.15.94:0/2394703632 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178003620 con 0x7f01800af730 2024-09-11T23:20:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018014d930 con 0x7f01800af730 2024-09-11T23:20:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.296+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0180150030 con 0x7f01800af730 2024-09-11T23:20:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.300+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018014fb80 con 0x7f01800af730 2024-09-11T23:20:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.300+0000 7f016effd640 1 -- 172.21.15.94:0/2394703632 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0178018020 con 0x7f01800af730 2024-09-11T23:20:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.300+0000 7f016effd640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f01600678c0 0x7f0160069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.300+0000 7f016effd640 1 -- 172.21.15.94:0/2394703632 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5421+0+0 (secure 0 0 0) 0x7f0178085c00 con 0x7f01800af730 2024-09-11T23:20:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.300+0000 7f017e59c640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f01600678c0 0x7f0160069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.300+0000 7f017e59c640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f01600678c0 0x7f0160069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f01700af000 tx=0x7f01700a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:21.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.304+0000 7f016effd640 1 -- 172.21.15.94:0/2394703632 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f017808c080 con 0x7f01800af730 2024-09-11T23:20:21.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:21.476+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f018015e590 con 0x7f01800af730 2024-09-11T23:20:22.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.248+0000 7f016effd640 1 -- 172.21.15.94:0/2394703632 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) ==== 97+0+0 (secure 0 0 0) 0x7f017801f020 con 0x7f01800af730 2024-09-11T23:20:22.249 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f01600678c0 msgr2=0x7f0160069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f01600678c0 0x7f0160069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f01700af000 tx=0x7f01700a7070 comp rx=0 tx=0).stop 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01800af730 msgr2=0x7f0180136e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01800af730 0x7f0180136e60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f017800c820 tx=0x7f017800cce0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 shutdown_connections 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f01600678c0 0x7f0160069d80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01800af730 0x7f0180136e60 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018009b040 0x7f0180136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 --2- 172.21.15.94:0/2394703632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f018009ac60 0x7f01801363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 >> 172.21.15.94:0/2394703632 conn(0x7f01800b78d0 msgr2=0x7f01800718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 shutdown_connections 2024-09-11T23:20:22.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.252+0000 7f0184a30640 1 -- 172.21.15.94:0/2394703632 wait complete. 2024-09-11T23:20:22.275 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:20:22.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c3e13640 1 Processor -- start 2024-09-11T23:20:22.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c3e13640 1 -- start start 2024-09-11T23:20:22.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c3e13640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0d3060 0x7ff1bc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c3e13640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1bc0cf450 0x7ff1bc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c3e13640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1bc0d0300 con 0x7ff1bc161a60 2024-09-11T23:20:22.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c3e13640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff1bc0b0f60 con 0x7ff1bc0cf450 2024-09-11T23:20:22.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c3e13640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1bc0cfd40 con 0x7ff1bc0d3060 2024-09-11T23:20:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c13ae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0d3060 0x7ff1bc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c23b0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1bc0cf450 0x7ff1bc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c13ae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0d3060 0x7ff1bc0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49416/0 (socket says 172.21.15.94:49416) 2024-09-11T23:20:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c1baf640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff1bc161a60 0x7ff1bc0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:51450/0 (socket says 172.21.15.94:51450) 2024-09-11T23:20:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c23b0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1bc0cf450 0x7ff1bc06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:54286/0 (socket says 172.21.15.94:54286) 2024-09-11T23:20:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c13ae640 1 -- 172.21.15.94:0/3245763213 learned_addr learned my addr 172.21.15.94:0/3245763213 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c13ae640 1 -- 172.21.15.94:0/3245763213 >> v2:172.21.15.155:3300/0 conn(0x7ff1bc0cf450 msgr2=0x7ff1bc06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c13ae640 1 --2- 172.21.15.94:0/3245763213 >> v2:172.21.15.155:3300/0 conn(0x7ff1bc0cf450 0x7ff1bc06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c13ae640 1 -- 172.21.15.94:0/3245763213 >> v1:172.21.15.155:6789/0 conn(0x7ff1bc161a60 legacy=0x7ff1bc0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c13ae640 1 -- 172.21.15.94:0/3245763213 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc0d0020 con 0x7ff1bc0d3060 2024-09-11T23:20:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.392+0000 7ff1c23b0640 1 --2- 172.21.15.94:0/3245763213 >> v2:172.21.15.155:3300/0 conn(0x7ff1bc0cf450 0x7ff1bc06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c13ae640 1 --2- 172.21.15.94:0/3245763213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0d3060 0x7ff1bc0cef10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009870 tx=0x7ff1ac01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f0aafcfd129805 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c0bad640 1 -- 172.21.15.94:0/3245763213 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0aa600 con 0x7ff1bc0d3060 2024-09-11T23:20:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c0bad640 1 -- 172.21.15.94:0/3245763213 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ac0af070 con 0x7ff1bc0d3060 2024-09-11T23:20:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c0bad640 1 -- 172.21.15.94:0/3245763213 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0aa9c0 con 0x7ff1bc0d3060 2024-09-11T23:20:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3245763213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0d3060 msgr2=0x7ff1bc0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3245763213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0d3060 0x7ff1bc0cef10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009870 tx=0x7ff1ac01c4a0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3245763213 shutdown_connections 2024-09-11T23:20:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3245763213 >> v2:172.21.15.155:3300/0 conn(0x7ff1bc0cf450 0x7ff1bc06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3245763213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0d3060 0x7ff1bc0cef10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3245763213 >> 172.21.15.94:0/3245763213 conn(0x7ff1bc08bf90 msgr2=0x7ff1bc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3245763213 shutdown_connections 2024-09-11T23:20:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3245763213 wait complete. 2024-09-11T23:20:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 Processor -- start 2024-09-11T23:20:22.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- start start 2024-09-11T23:20:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0cf450 0x7ff1bc0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1bc0d3060 0x7ff1bc0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1bc161a60 0x7ff1bc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc16af20 con 0x7ff1bc161a60 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc06e610 con 0x7ff1bc0d3060 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.396+0000 7ff1c3e13640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1bc16b0a0 con 0x7ff1bc0cf450 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1bc161a60 0x7ff1bc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1bc161a60 0x7ff1bc0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37604/0 (socket says 172.21.15.94:37604) 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 -- 172.21.15.94:0/3900776532 learned_addr learned my addr 172.21.15.94:0/3900776532 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c1baf640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0cf450 0x7ff1bc0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c13ae640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1bc0d3060 0x7ff1bc0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 -- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0cf450 msgr2=0x7ff1bc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0cf450 0x7ff1bc0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 -- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1bc0d3060 msgr2=0x7ff1bc0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1bc0d3060 0x7ff1bc0cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 -- 172.21.15.94:0/3900776532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc0c8930 con 0x7ff1bc161a60 2024-09-11T23:20:22.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c23b0640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1bc161a60 0x7ff1bc0c99d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400efc0 tx=0x7ff1b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:22.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1b27fc640 1 -- 172.21.15.94:0/3900776532 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4018030 con 0x7ff1bc161a60 2024-09-11T23:20:22.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1b27fc640 1 -- 172.21.15.94:0/3900776532 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b400cdf0 con 0x7ff1bc161a60 2024-09-11T23:20:22.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1b27fc640 1 -- 172.21.15.94:0/3900776532 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4003bc0 con 0x7ff1bc161a60 2024-09-11T23:20:22.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1bc0c8c10 con 0x7ff1bc161a60 2024-09-11T23:20:22.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1bc0c91d0 con 0x7ff1bc161a60 2024-09-11T23:20:22.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1bc06d6b0 con 0x7ff1bc161a60 2024-09-11T23:20:22.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.400+0000 7ff1b27fc640 1 -- 172.21.15.94:0/3900776532 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1b401b070 con 0x7ff1bc161a60 2024-09-11T23:20:22.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.404+0000 7ff1b27fc640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1a00678c0 0x7ff1a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.404+0000 7ff1b27fc640 1 -- 172.21.15.94:0/3900776532 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5249+0+0 (secure 0 0 0) 0x7ff1b4086a80 con 0x7ff1bc161a60 2024-09-11T23:20:22.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.404+0000 7ff1c1baf640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1a00678c0 0x7ff1a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.404+0000 7ff1c1baf640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1a00678c0 0x7ff1a0069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc15f950 tx=0x7ff1b8007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:22.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.404+0000 7ff1b27fc640 1 -- 172.21.15.94:0/3900776532 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff1b4010040 con 0x7ff1bc161a60 2024-09-11T23:20:22.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.620+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff1bc160c20 con 0x7ff1bc161a60 2024-09-11T23:20:22.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.620+0000 7ff1b27fc640 1 -- 172.21.15.94:0/3900776532 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7ff1b401b360 con 0x7ff1bc161a60 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmXOlXIRAAO3a5YdIU/HWHOj+GS/WRsg==", 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:20:22.623 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmIsnrLxAAKL78sMMtjw94wSWoc+a3aQ==", 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmYHzGKRAA7CHI/zCmZuFBlayMxZOwTQ==", 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmpKpkOBAAjsc6gxl+EwgbXR68gLRzpg==", 2024-09-11T23:20:22.625 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBJJOJmkC9IExAAEE+UQGmWdDSY3kDSFk/FeQ==", 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.626 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBMJOJmF7cSIRAAxgfo0jwuwnZ81yTJxzhx3g==", 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.627 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBPJOJmhEV0MRAAP9pRZo5/fjFK94XFaghcow==", 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBTJOJmBDEmBRAA+y/oCIs4oBGt5Vd9DgAXZA==", 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.628 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBZJOJmuu1xDBAAWHAqWrVvrbB9DxHZGeelgw==", 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBcJOJmE+mqGRAA2LpquQ+eQdVKPoYAzGTj2g==", 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBfJOJmy7DxKRAASWVYWW/oPBa0pPxD0DwWZA==", 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.630 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBiJOJmVAJEORAAZcy/KqDpQbU10QyU5R6UuA==", 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.631 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ==", 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow r", 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm1uQgChAAqVNgXG9BKAXY3dzOKfv1Iw==", 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.632 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJmU8BMBxAAk3QvV9ZkAFpBT0I4pX0otQ==", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBIJOJm8g90DxAAxFxOfLFghH16bsbyg+mkcw==", 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.634 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmAziHChAAz9c8+z77RX+g6eeV2hnBGA==", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmjxsuHhAAYc/a1ohhc0MD6fGVWnOowA==", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:20:22.635 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBHJOJmy+FKGxAAy2oj8oXJ9v4/b8YpiDyZqg==", 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.636 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-11T23:20:22.637 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:22.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1a00678c0 msgr2=0x7ff1a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1a00678c0 0x7ff1a0069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc15f950 tx=0x7ff1b8007cf0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1bc161a60 msgr2=0x7ff1bc0c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1bc161a60 0x7ff1bc0c99d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400efc0 tx=0x7ff1b400c490 comp rx=0 tx=0).stop 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 shutdown_connections 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff1a00678c0 0x7ff1a0069d80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1bc161a60 0x7ff1bc0c99d0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1bc0d3060 0x7ff1bc0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 --2- 172.21.15.94:0/3900776532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1bc0cf450 0x7ff1bc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 >> 172.21.15.94:0/3900776532 conn(0x7ff1bc08bf90 msgr2=0x7ff1bc0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 shutdown_connections 2024-09-11T23:20:22.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.624+0000 7ff1c3e13640 1 -- 172.21.15.94:0/3900776532 wait complete. 2024-09-11T23:20:22.642 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:20:22.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.752+0000 7ff984f18640 1 Processor -- start 2024-09-11T23:20:22.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.752+0000 7ff984f18640 1 -- start start 2024-09-11T23:20:22.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff984f18640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff98015c2a0 0x7ff9800aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff984f18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff984f18640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9800b3290 con 0x7ff98015bec0 2024-09-11T23:20:22.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff984f18640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff9800b3570 con 0x7ff98015c2a0 2024-09-11T23:20:22.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff984f18640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9800b3850 con 0x7ff9800af2a0 2024-09-11T23:20:22.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97dd9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff98015c2a0 0x7ff9800aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49432/0 (socket says 172.21.15.94:49432) 2024-09-11T23:20:22.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 -- 172.21.15.94:0/2050560678 learned_addr learned my addr 172.21.15.94:0/2050560678 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:22.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 -- 172.21.15.94:0/2050560678 >> v2:172.21.15.155:3300/0 conn(0x7ff98015c2a0 msgr2=0x7ff9800aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:22.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 --2- 172.21.15.94:0/2050560678 >> v2:172.21.15.155:3300/0 conn(0x7ff98015c2a0 0x7ff9800aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 -- 172.21.15.94:0/2050560678 >> v1:172.21.15.155:6789/0 conn(0x7ff98015bec0 legacy=0x7ff9800ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 -- 172.21.15.94:0/2050560678 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9800b3b30 con 0x7ff9800af2a0 2024-09-11T23:20:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.756+0000 7ff97ed9d640 1 --2- 172.21.15.94:0/2050560678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98006e000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff970009870 tx=0x7ff97001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa492156c536fb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97d59a640 1 -- 172.21.15.94:0/2050560678 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9700a95f0 con 0x7ff9800af2a0 2024-09-11T23:20:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97d59a640 1 -- 172.21.15.94:0/2050560678 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9700a9790 con 0x7ff9800af2a0 2024-09-11T23:20:22.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97d59a640 1 -- 172.21.15.94:0/2050560678 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9700a9b60 con 0x7ff9800af2a0 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- 172.21.15.94:0/2050560678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 msgr2=0x7ff98006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 --2- 172.21.15.94:0/2050560678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98006e000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff970009870 tx=0x7ff97001c530 comp rx=0 tx=0).stop 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- 172.21.15.94:0/2050560678 shutdown_connections 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 --2- 172.21.15.94:0/2050560678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98006e000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 --2- 172.21.15.94:0/2050560678 >> v2:172.21.15.155:3300/0 conn(0x7ff98015c2a0 0x7ff9800aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- 172.21.15.94:0/2050560678 >> 172.21.15.94:0/2050560678 conn(0x7ff9800b1f90 msgr2=0x7ff9800b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- 172.21.15.94:0/2050560678 shutdown_connections 2024-09-11T23:20:22.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- 172.21.15.94:0/2050560678 wait complete. 2024-09-11T23:20:22.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 Processor -- start 2024-09-11T23:20:22.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- start start 2024-09-11T23:20:22.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98014a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff98015bec0 0x7ff98015e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff98015c2a0 0x7ff9800b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff98006ed50 con 0x7ff98015c2a0 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9800afc90 con 0x7ff98015bec0 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff98006eed0 con 0x7ff9800af2a0 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff98015c2a0 0x7ff9800b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff98015c2a0 0x7ff9800b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37612/0 (socket says 172.21.15.94:37612) 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 -- 172.21.15.94:0/789159994 learned_addr learned my addr 172.21.15.94:0/789159994 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97dd9b640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff98015bec0 0x7ff98015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97e59c640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98014a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 -- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 msgr2=0x7ff98014a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98014a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 -- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff98015bec0 msgr2=0x7ff98015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff98015bec0 0x7ff98015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 -- 172.21.15.94:0/789159994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98014a9d0 con 0x7ff98015c2a0 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff97ed9d640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff98015c2a0 0x7ff9800b0c70 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff97001a160 tx=0x7ff97001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff976ffd640 1 -- 172.21.15.94:0/789159994 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9700b1600 con 0x7ff98015c2a0 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff976ffd640 1 -- 172.21.15.94:0/789159994 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9700b17a0 con 0x7ff98015c2a0 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff980155f40 con 0x7ff98015c2a0 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff976ffd640 1 -- 172.21.15.94:0/789159994 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9700b1b50 con 0x7ff98015c2a0 2024-09-11T23:20:22.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.760+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98015f230 con 0x7ff98015c2a0 2024-09-11T23:20:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.764+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98006e000 con 0x7ff98015c2a0 2024-09-11T23:20:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.764+0000 7ff976ffd640 1 -- 172.21.15.94:0/789159994 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9700b1cf0 con 0x7ff98015c2a0 2024-09-11T23:20:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.764+0000 7ff976ffd640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff9600678c0 0x7ff960069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.764+0000 7ff976ffd640 1 -- 172.21.15.94:0/789159994 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5249+0+0 (secure 0 0 0) 0x7ff970120580 con 0x7ff98015c2a0 2024-09-11T23:20:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.764+0000 7ff97e59c640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff9600678c0 0x7ff960069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:22.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.764+0000 7ff97e59c640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff9600678c0 0x7ff960069d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff9800b1890 tx=0x7ff978009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:22.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.768+0000 7ff976ffd640 1 -- 172.21.15.94:0/789159994 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff9700ad020 con 0x7ff98015c2a0 2024-09-11T23:20:22.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.924+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff98006fcd0 con 0x7ff98015c2a0 2024-09-11T23:20:22.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.924+0000 7ff976ffd640 1 -- 172.21.15.94:0/789159994 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) ==== 84+0+65 (secure 0 0 0) 0x7ff970016150 con 0x7ff98015c2a0 2024-09-11T23:20:22.926 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:22.926 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-09-11T23:20:22.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-11T23:20:22.926 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-09-11T23:20:22.926 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-09-11T23:20:22.926 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:22.926 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-09-11T23:20:22.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.924+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff9600678c0 msgr2=0x7ff960069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.924+0000 7ff984f18640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff9600678c0 0x7ff960069d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff9800b1890 tx=0x7ff978009040 comp rx=0 tx=0).stop 2024-09-11T23:20:22.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff98015c2a0 msgr2=0x7ff9800b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:22.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff98015c2a0 0x7ff9800b0c70 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff97001a160 tx=0x7ff97001ad70 comp rx=0 tx=0).stop 2024-09-11T23:20:22.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 shutdown_connections 2024-09-11T23:20:22.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff9600678c0 0x7ff960069d80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff98015c2a0 0x7ff9800b0c70 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff98015bec0 0x7ff98015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 --2- 172.21.15.94:0/789159994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800af2a0 0x7ff98014a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 >> 172.21.15.94:0/789159994 conn(0x7ff9800b1f90 msgr2=0x7ff9800b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 shutdown_connections 2024-09-11T23:20:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:22.928+0000 7ff984f18640 1 -- 172.21.15.94:0/789159994 wait complete. 2024-09-11T23:20:22.943 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:20:22.944 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:20:23.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd592b8640 1 Processor -- start 2024-09-11T23:20:23.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd592b8640 1 -- start start 2024-09-11T23:20:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd592b8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 0x7efd540ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd592b8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efd5415c2a0 0x7efd540aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd592b8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd540b3290 con 0x7efd540af2a0 2024-09-11T23:20:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd592b8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efd540b3570 con 0x7efd5415c2a0 2024-09-11T23:20:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd592b8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd540b3850 con 0x7efd5415bec0 2024-09-11T23:20:23.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd537fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7efd540af2a0 0x7efd5415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42240/0 (socket says 172.21.15.94:42240) 2024-09-11T23:20:23.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd537fe640 1 -- 172.21.15.94:0/1818376045 learned_addr learned my addr 172.21.15.94:0/1818376045 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:23.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd527fc640 1 --2- 172.21.15.94:0/1818376045 >> v2:172.21.15.155:3300/0 conn(0x7efd5415c2a0 0x7efd540aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd52ffd640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 0x7efd540ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254104626 0 0) 0x7efd540b3290 con 0x7efd540af2a0 2024-09-11T23:20:23.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd3c003530 con 0x7efd540af2a0 2024-09-11T23:20:23.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3005429378 0 0) 0x7efd3c003530 con 0x7efd540af2a0 2024-09-11T23:20:23.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 msgr2=0x7efd540ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:23.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 0x7efd540ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 >> v2:172.21.15.155:3300/0 conn(0x7efd5415c2a0 msgr2=0x7efd540aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:23.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 --2- 172.21.15.94:0/1818376045 >> v2:172.21.15.155:3300/0 conn(0x7efd5415c2a0 0x7efd540aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd540b3b30 con 0x7efd540af2a0 2024-09-11T23:20:23.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7efd4c001a00 con 0x7efd540af2a0 2024-09-11T23:20:23.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 >> v1:172.21.15.94:6789/0 conn(0x7efd540af2a0 legacy=0x7efd5415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 0x7efd3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd3c004d50 0x7efd3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efd540b3570 con 0x7efd3c0039c0 2024-09-11T23:20:23.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd540b3850 con 0x7efd3c004d50 2024-09-11T23:20:23.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd3c00b9d0 con 0x7efd5415bec0 2024-09-11T23:20:23.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd52ffd640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd527fc640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 0x7efd3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd52ffd640 1 -- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 msgr2=0x7efd3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:23.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd52ffd640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 0x7efd3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd52ffd640 1 -- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd3c004d50 msgr2=0x7efd3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:23.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd52ffd640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd3c004d50 0x7efd3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd52ffd640 1 -- 172.21.15.94:0/1818376045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c003530 con 0x7efd3c0039c0 2024-09-11T23:20:23.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.056+0000 7efd527fc640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5415bec0 0x7efd3c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:23.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd52ffd640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd3c003de0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7efd44009ac0 tx=0x7efd4401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae0180ed119c047 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd440b2070 con 0x7efd3c0039c0 2024-09-11T23:20:23.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd440a55f0 con 0x7efd3c0039c0 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd51ffb640 1 -- 172.21.15.94:0/1818376045 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44009690 con 0x7efd3c0039c0 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 -- 172.21.15.94:0/1818376045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 msgr2=0x7efd3c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 --2- 172.21.15.94:0/1818376045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd3c003de0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7efd44009ac0 tx=0x7efd4401ca20 comp rx=0 tx=0).stop 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd537fe640 1 -- 172.21.15.94:0/1818376045 reap_dead start 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 -- 172.21.15.94:0/1818376045 shutdown_connections 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 -- 172.21.15.94:0/1818376045 >> 172.21.15.94:0/1818376045 conn(0x7efd540b1f90 msgr2=0x7efd540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 -- 172.21.15.94:0/1818376045 shutdown_connections 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 -- 172.21.15.94:0/1818376045 wait complete. 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 Processor -- start 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.060+0000 7efd592b8640 1 -- start start 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd5415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd54158960 0x7efd5415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5414f390 0x7efd5415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efd540ad610 con 0x7efd3c0039c0 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd540af6d0 con 0x7efd54158960 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd540ad790 con 0x7efd5414f390 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd5415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd5415e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37636/0 (socket says 172.21.15.94:37636) 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 -- 172.21.15.94:0/138980820 learned_addr learned my addr 172.21.15.94:0/138980820 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd537fe640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5414f390 0x7efd5415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 -- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5414f390 msgr2=0x7efd5415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd527fc640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd54158960 0x7efd5415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5414f390 0x7efd5415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 -- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd54158960 msgr2=0x7efd5415e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd54158960 0x7efd5415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 -- 172.21.15.94:0/138980820 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5415d2e0 con 0x7efd3c0039c0 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd52ffd640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd5415e460 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7efd4401c850 tx=0x7efd3c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd3b7fe640 1 -- 172.21.15.94:0/138980820 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd440bc070 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd3b7fe640 1 -- 172.21.15.94:0/138980820 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd440b7460 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5415d5c0 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd3b7fe640 1 -- 172.21.15.94:0/138980820 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd440b2040 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5414fb00 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd54071f10 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd3b7fe640 1 -- 172.21.15.94:0/138980820 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd440b5070 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd3b7fe640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd400678c0 0x7efd40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd3b7fe640 1 -- 172.21.15.94:0/138980820 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5249+0+0 (secure 0 0 0) 0x7efd44120740 con 0x7efd3c0039c0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.064+0000 7efd527fc640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd400678c0 0x7efd40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.068+0000 7efd527fc640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd400678c0 0x7efd40069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efd54151480 tx=0x7efd48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.068+0000 7efd3b7fe640 1 -- 172.21.15.94:0/138980820 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efd440c6020 con 0x7efd3c0039c0 2024-09-11T23:20:23.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.220+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efd5406fcd0 con 0x7efd3c0039c0 2024-09-11T23:20:23.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd3b7fe640 1 -- 172.21.15.94:0/138980820 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) ==== 138+0+0 (secure 0 0 0) 0x7efd44016760 con 0x7efd3c0039c0 2024-09-11T23:20:23.277 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd400678c0 msgr2=0x7efd40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd400678c0 0x7efd40069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efd54151480 tx=0x7efd48008040 comp rx=0 tx=0).stop 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 msgr2=0x7efd5415e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd5415e460 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7efd4401c850 tx=0x7efd3c005840 comp rx=0 tx=0).stop 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 shutdown_connections 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd5414f390 0x7efd5415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd54158960 0x7efd5415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efd400678c0 0x7efd40069d80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 --2- 172.21.15.94:0/138980820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd3c0039c0 0x7efd5415e460 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.276+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 >> 172.21.15.94:0/138980820 conn(0x7efd540b1f90 msgr2=0x7efd540b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:23.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.280+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 shutdown_connections 2024-09-11T23:20:23.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.280+0000 7efd592b8640 1 -- 172.21.15.94:0/138980820 wait complete. 2024-09-11T23:20:23.301 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:20:23.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945a2d0640 1 Processor -- start 2024-09-11T23:20:23.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945a2d0640 1 -- start start 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945a2d0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94540cc870 0x7f94540cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945a2d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f94540cdfd0 0x7f945406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945a2d0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94540ce8d0 con 0x7f9454073100 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945a2d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f94540cebb0 con 0x7f94540cdfd0 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945a2d0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f94540cee90 con 0x7f94540cc870 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945886d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f94540cdfd0 0x7f945406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945886d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f94540cdfd0 0x7f945406de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37644/0 (socket says 172.21.15.94:37644) 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945886d640 1 -- 172.21.15.94:0/2990823813 learned_addr learned my addr 172.21.15.94:0/2990823813 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f9453fff640 1 --2- 172.21.15.94:0/2990823813 >> v2:172.21.15.155:3300/0 conn(0x7f94540cc870 0x7f94540cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945886d640 1 -- 172.21.15.94:0/2990823813 >> v2:172.21.15.155:3300/0 conn(0x7f94540cc870 msgr2=0x7f94540cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:23.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945886d640 1 --2- 172.21.15.94:0/2990823813 >> v2:172.21.15.155:3300/0 conn(0x7f94540cc870 0x7f94540cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945886d640 1 -- 172.21.15.94:0/2990823813 >> v1:172.21.15.155:6789/0 conn(0x7f9454073100 legacy=0x7f94540ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:23.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f945886d640 1 -- 172.21.15.94:0/2990823813 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94540cf170 con 0x7f94540cdfd0 2024-09-11T23:20:23.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.424+0000 7f9453fff640 1 --2- 172.21.15.94:0/2990823813 >> v2:172.21.15.155:3300/0 conn(0x7f94540cc870 0x7f94540cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:23.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945886d640 1 --2- 172.21.15.94:0/2990823813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94540cdfd0 0x7f945406de00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9454068970 tx=0x7f944c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d6fcb8b17b2764 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f9452ffd640 1 -- 172.21.15.94:0/2990823813 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c0a5860 con 0x7f94540cdfd0 2024-09-11T23:20:23.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f9452ffd640 1 -- 172.21.15.94:0/2990823813 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944c0a5a00 con 0x7f94540cdfd0 2024-09-11T23:20:23.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f9452ffd640 1 -- 172.21.15.94:0/2990823813 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c0a5dd0 con 0x7f94540cdfd0 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- 172.21.15.94:0/2990823813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94540cdfd0 msgr2=0x7f945406de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 --2- 172.21.15.94:0/2990823813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94540cdfd0 0x7f945406de00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9454068970 tx=0x7f944c01c980 comp rx=0 tx=0).stop 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- 172.21.15.94:0/2990823813 shutdown_connections 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 --2- 172.21.15.94:0/2990823813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94540cdfd0 0x7f945406de00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 --2- 172.21.15.94:0/2990823813 >> v2:172.21.15.155:3300/0 conn(0x7f94540cc870 0x7f94540cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- 172.21.15.94:0/2990823813 >> 172.21.15.94:0/2990823813 conn(0x7f94540b1c80 msgr2=0x7f94540b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- 172.21.15.94:0/2990823813 shutdown_connections 2024-09-11T23:20:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- 172.21.15.94:0/2990823813 wait complete. 2024-09-11T23:20:23.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 Processor -- start 2024-09-11T23:20:23.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- start start 2024-09-11T23:20:23.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9454073100 0x7f9454159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540cc870 0x7f945413d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94540cdfd0 0x7f94540acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9454169190 con 0x7f9454073100 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94540ce670 con 0x7f94540cc870 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f945a2d0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9454169310 con 0x7f94540cdfd0 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f9453fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9454073100 0x7f9454159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f9453fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9454073100 0x7f9454159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37652/0 (socket says 172.21.15.94:37652) 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.428+0000 7f9453fff640 1 -- 172.21.15.94:0/584047469 learned_addr learned my addr 172.21.15.94:0/584047469 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9453fff640 1 -- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94540cdfd0 msgr2=0x7f94540acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9453fff640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94540cdfd0 0x7f94540acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9453fff640 1 -- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540cc870 msgr2=0x7f945413d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f94537fe640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540cc870 0x7f945413d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9453fff640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540cc870 0x7f945413d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9453fff640 1 -- 172.21.15.94:0/584047469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945413c670 con 0x7f9454073100 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f94537fe640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540cc870 0x7f945413d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9453fff640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9454073100 0x7f9454159ee0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f944800c7c0 tx=0x7f944800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9450ff9640 1 -- 172.21.15.94:0/584047469 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448007a30 con 0x7f9454073100 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9450ff9640 1 -- 172.21.15.94:0/584047469 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9448007bd0 con 0x7f9454073100 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945413c950 con 0x7f9454073100 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9450ff9640 1 -- 172.21.15.94:0/584047469 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94480113f0 con 0x7f9454073100 2024-09-11T23:20:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945413d540 con 0x7f9454073100 2024-09-11T23:20:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94540cf970 con 0x7f9454073100 2024-09-11T23:20:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9450ff9640 1 -- 172.21.15.94:0/584047469 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9448011590 con 0x7f9454073100 2024-09-11T23:20:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9450ff9640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f94400678c0 0x7f9440069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f9450ff9640 1 -- 172.21.15.94:0/584047469 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5619+0+0 (secure 0 0 0) 0x7f9448086280 con 0x7f9454073100 2024-09-11T23:20:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f94537fe640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f94400678c0 0x7f9440069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.432+0000 7f94537fe640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f94400678c0 0x7f9440069d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f94540cc390 tx=0x7f9444009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.436+0000 7f9450ff9640 1 -- 172.21.15.94:0/584047469 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9448015020 con 0x7f9454073100 2024-09-11T23:20:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:23.588+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f94540cfc10 con 0x7f9454073100 2024-09-11T23:20:24.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.288+0000 7f9450ff9640 1 -- 172.21.15.94:0/584047469 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) ==== 170+0+0 (secure 0 0 0) 0x7f9448056f00 con 0x7f9454073100 2024-09-11T23:20:24.289 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f94400678c0 msgr2=0x7f9440069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f94400678c0 0x7f9440069d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f94540cc390 tx=0x7f9444009040 comp rx=0 tx=0).stop 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9454073100 msgr2=0x7f9454159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9454073100 0x7f9454159ee0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f944800c7c0 tx=0x7f944800cc80 comp rx=0 tx=0).stop 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 shutdown_connections 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94540cdfd0 0x7f94540acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540cc870 0x7f945413d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f94400678c0 0x7f9440069d80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 --2- 172.21.15.94:0/584047469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9454073100 0x7f9454159ee0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 >> 172.21.15.94:0/584047469 conn(0x7f94540b1c80 msgr2=0x7f94540b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:24.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 shutdown_connections 2024-09-11T23:20:24.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.292+0000 7f945a2d0640 1 -- 172.21.15.94:0/584047469 wait complete. 2024-09-11T23:20:24.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:20:24.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3294ff640 1 Processor -- start 2024-09-11T23:20:24.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3294ff640 1 -- start start 2024-09-11T23:20:24.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3294ff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc32406f010 0x7fc324166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3294ff640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3240b3290 con 0x7fc32415c2a0 2024-09-11T23:20:24.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3294ff640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3240b3570 con 0x7fc32415bec0 2024-09-11T23:20:24.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3294ff640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc3240b3850 con 0x7fc32406f010 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc32415c2a0 0x7fc3240aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42250/0 (socket says 172.21.15.94:42250) 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 -- 172.21.15.94:0/1716153842 learned_addr learned my addr 172.21.15.94:0/1716153842 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3237fe640 1 --2- 172.21.15.94:0/1716153842 >> v2:172.21.15.155:3300/0 conn(0x7fc32406f010 0x7fc324166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580626185 0 0) 0x7fc3240b3290 con 0x7fc32415c2a0 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc30c003530 con 0x7fc32415c2a0 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2152749088 0 0) 0x7fc30c003530 con 0x7fc32415c2a0 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 >> v2:172.21.15.155:3300/0 conn(0x7fc32406f010 msgr2=0x7fc324166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 --2- 172.21.15.94:0/1716153842 >> v2:172.21.15.155:3300/0 conn(0x7fc32406f010 0x7fc324166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 >> v1:172.21.15.155:6789/0 conn(0x7fc32415bec0 legacy=0x7fc3240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3240b3b30 con 0x7fc32415c2a0 2024-09-11T23:20:24.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fc318001680 con 0x7fc32415c2a0 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 >> v1:172.21.15.94:6789/0 conn(0x7fc32415c2a0 legacy=0x7fc3240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc30c0039c0 0x7fc30c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc30c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0051d0 0x7fc30c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240b3850 con 0x7fc30c004810 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c00c070 con 0x7fc30c0051d0 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c00c270 con 0x7fc30c0039c0 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc30c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc322ffd640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc30c0039c0 0x7fc30c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3237fe640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0051d0 0x7fc30c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 -- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc30c0039c0 msgr2=0x7fc30c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc30c0039c0 0x7fc30c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 -- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0051d0 msgr2=0x7fc30c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:24.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0051d0 0x7fc30c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3227fc640 1 -- 172.21.15.94:0/1716153842 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c003530 con 0x7fc30c004810 2024-09-11T23:20:24.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3237fe640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0051d0 0x7fc30c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:24.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.448+0000 7fc3237fe640 1 -- 172.21.15.94:0/1716153842 reap_dead start 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3227fc640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc30c004c90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc31800c190 tx=0x7fc31801f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26461c77f0d64d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318007d00 con 0x7fc30c004810 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc318005b00 con 0x7fc30c004810 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc321ffb640 1 -- 172.21.15.94:0/1716153842 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318007070 con 0x7fc30c004810 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- 172.21.15.94:0/1716153842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 msgr2=0x7fc30c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc30c004c90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc31800c190 tx=0x7fc31801f310 comp rx=0 tx=0).stop 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- 172.21.15.94:0/1716153842 shutdown_connections 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 --2- 172.21.15.94:0/1716153842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc30c004c90 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- 172.21.15.94:0/1716153842 >> 172.21.15.94:0/1716153842 conn(0x7fc3240b1f90 msgr2=0x7fc3240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:24.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- 172.21.15.94:0/1716153842 shutdown_connections 2024-09-11T23:20:24.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- 172.21.15.94:0/1716153842 wait complete. 2024-09-11T23:20:24.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 Processor -- start 2024-09-11T23:20:24.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- start start 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc32414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32415d730 0x7fc32415db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32414f0d0 0x7fc32414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240afc90 con 0x7fc30c004810 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240b40f0 con 0x7fc32414f0d0 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.452+0000 7fc3294ff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc3240ad200 con 0x7fc32415d730 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc32414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc32414e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37672/0 (socket says 172.21.15.94:37672) 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 -- 172.21.15.94:0/878311373 learned_addr learned my addr 172.21.15.94:0/878311373 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc3227fc640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32415d730 0x7fc32415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc3237fe640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32414f0d0 0x7fc32414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 -- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32415d730 msgr2=0x7fc32415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32415d730 0x7fc32415db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 -- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32414f0d0 msgr2=0x7fc32414f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32414f0d0 0x7fc32414f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 -- 172.21.15.94:0/878311373 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32415e1f0 con 0x7fc30c004810 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc322ffd640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc32414e6f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc31400e4e0 tx=0x7fc31400e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc30b7fe640 1 -- 172.21.15.94:0/878311373 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3140052e0 con 0x7fc30c004810 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc30b7fe640 1 -- 172.21.15.94:0/878311373 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc314018070 con 0x7fc30c004810 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc30b7fe640 1 -- 172.21.15.94:0/878311373 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314005480 con 0x7fc30c004810 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32415e4d0 con 0x7fc30c004810 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32415ea90 con 0x7fc30c004810 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3240ad530 con 0x7fc30c004810 2024-09-11T23:20:24.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc30b7fe640 1 -- 172.21.15.94:0/878311373 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc314003840 con 0x7fc30c004810 2024-09-11T23:20:24.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc30b7fe640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3100678f0 0x7fc310069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:24.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc30b7fe640 1 -- 172.21.15.94:0/878311373 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6001+0+0 (secure 0 0 0) 0x7fc314085a10 con 0x7fc30c004810 2024-09-11T23:20:24.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc3227fc640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3100678f0 0x7fc310069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:24.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.456+0000 7fc3227fc640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3100678f0 0x7fc310069db0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc3180ae000 tx=0x7fc318007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:24.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.460+0000 7fc30b7fe640 1 -- 172.21.15.94:0/878311373 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc314056390 con 0x7fc30c004810 2024-09-11T23:20:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:24.644+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc3240b1d70 con 0x7fc30c004810 2024-09-11T23:20:25.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.308+0000 7fc30b7fe640 1 -- 172.21.15.94:0/878311373 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v68) ==== 174+0+0 (secure 0 0 0) 0x7fc314055c90 con 0x7fc30c004810 2024-09-11T23:20:25.311 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 17 and data pool 18 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3100678f0 msgr2=0x7fc310069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3100678f0 0x7fc310069db0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc3180ae000 tx=0x7fc318007040 comp rx=0 tx=0).stop 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 msgr2=0x7fc32414e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc32414e6f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc31400e4e0 tx=0x7fc31400e9a0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 shutdown_connections 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32414f0d0 0x7fc32414f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32415d730 0x7fc32415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3100678f0 0x7fc310069db0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 --2- 172.21.15.94:0/878311373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc30c004810 0x7fc32414e6f0 secure :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc31400e4e0 tx=0x7fc31400e9a0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.316+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 >> 172.21.15.94:0/878311373 conn(0x7fc3240b1f90 msgr2=0x7fc324074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:25.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.320+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 shutdown_connections 2024-09-11T23:20:25.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.320+0000 7fc3294ff640 1 -- 172.21.15.94:0/878311373 wait complete. 2024-09-11T23:20:25.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:25.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.460+0000 7f960dab1640 1 Processor -- start 2024-09-11T23:20:25.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.460+0000 7f960dab1640 1 -- start start 2024-09-11T23:20:25.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f960dab1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96081587a0 0x7f96080b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f960dab1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96080b37d0 0x7f960806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f960dab1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960806ec60 con 0x7f960806e4b0 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f960dab1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f960806f870 con 0x7f96081587a0 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f960dab1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96080b3c10 con 0x7f96080b37d0 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f9606ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96080b37d0 0x7f960806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f96077fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96081587a0 0x7f96080b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f9606ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96080b37d0 0x7f960806df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:49508/0 (socket says 172.21.15.94:49508) 2024-09-11T23:20:25.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f9606ffd640 1 -- 172.21.15.94:0/742377456 learned_addr learned my addr 172.21.15.94:0/742377456 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:25.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f96077fe640 1 -- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96080b37d0 msgr2=0x7f960806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:25.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f96077fe640 1 --2- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96080b37d0 0x7f960806df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f96077fe640 1 -- 172.21.15.94:0/742377456 >> v1:172.21.15.155:6789/0 conn(0x7f960806e4b0 legacy=0x7f9608161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f96077fe640 1 -- 172.21.15.94:0/742377456 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960806ef40 con 0x7f96081587a0 2024-09-11T23:20:25.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.464+0000 7f9606ffd640 1 --2- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96080b37d0 0x7f960806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:25.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 --2- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96081587a0 0x7f96080b3290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097c0 tx=0x7f95f001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1abf5083a43e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:25.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96067fc640 1 -- 172.21.15.94:0/742377456 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00b2070 con 0x7f96081587a0 2024-09-11T23:20:25.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96067fc640 1 -- 172.21.15.94:0/742377456 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f00ad640 con 0x7f96081587a0 2024-09-11T23:20:25.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96067fc640 1 -- 172.21.15.94:0/742377456 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00ada10 con 0x7f96081587a0 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96081587a0 msgr2=0x7f96080b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 --2- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96081587a0 0x7f96080b3290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097c0 tx=0x7f95f001c470 comp rx=0 tx=0).stop 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- 172.21.15.94:0/742377456 shutdown_connections 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 --2- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96080b37d0 0x7f960806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 --2- 172.21.15.94:0/742377456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96081587a0 0x7f96080b3290 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- 172.21.15.94:0/742377456 >> 172.21.15.94:0/742377456 conn(0x7f96080b1f90 msgr2=0x7f96080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- 172.21.15.94:0/742377456 shutdown_connections 2024-09-11T23:20:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- 172.21.15.94:0/742377456 wait complete. 2024-09-11T23:20:25.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 Processor -- start 2024-09-11T23:20:25.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- start start 2024-09-11T23:20:25.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f960806e4b0 0x7f9608145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96080b37d0 0x7f96081573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96081587a0 0x7f9608157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9608158b80 con 0x7f960806e4b0 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9608073170 con 0x7f96080b37d0 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9608159010 con 0x7f96081587a0 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f960806e4b0 0x7f9608145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f960806e4b0 0x7f9608145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37688/0 (socket says 172.21.15.94:37688) 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 -- 172.21.15.94:0/3339957865 learned_addr learned my addr 172.21.15.94:0/3339957865 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f9606ffd640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96080b37d0 0x7f96081573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f9607fff640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96081587a0 0x7f9608157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 -- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96081587a0 msgr2=0x7f9608157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96081587a0 0x7f9608157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 -- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96080b37d0 msgr2=0x7f96081573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96080b37d0 0x7f96081573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 -- 172.21.15.94:0/3339957865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96081592f0 con 0x7f960806e4b0 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f96077fe640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f960806e4b0 0x7f9608145cf0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f95f001a0a0 tx=0x7f95f0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f95fffff640 1 -- 172.21.15.94:0/3339957865 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00b2040 con 0x7f960806e4b0 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f95fffff640 1 -- 172.21.15.94:0/3339957865 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f00ad440 con 0x7f960806e4b0 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96081595d0 con 0x7f960806e4b0 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.468+0000 7f95fffff640 1 -- 172.21.15.94:0/3339957865 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00b6610 con 0x7f960806e4b0 2024-09-11T23:20:25.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.472+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960815a3e0 con 0x7f960806e4b0 2024-09-11T23:20:25.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.472+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960815a0e0 con 0x7f960806e4b0 2024-09-11T23:20:25.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.472+0000 7f95fffff640 1 -- 172.21.15.94:0/3339957865 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f95f00bf030 con 0x7f960806e4b0 2024-09-11T23:20:25.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.472+0000 7f95fffff640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f95e80678f0 0x7f95e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.472+0000 7f95fffff640 1 -- 172.21.15.94:0/3339957865 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f95f011fdc0 con 0x7f960806e4b0 2024-09-11T23:20:25.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.472+0000 7f9606ffd640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f95e80678f0 0x7f95e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.472+0000 7f9606ffd640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f95e80678f0 0x7f95e8069db0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f960815df70 tx=0x7f95f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:25.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.476+0000 7f95fffff640 1 -- 172.21.15.94:0/3339957865 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f95f00c6060 con 0x7f960806e4b0 2024-09-11T23:20:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.640+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9608070080 con 0x7f960806e4b0 2024-09-11T23:20:25.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.640+0000 7f95fffff640 1 -- 172.21.15.94:0/3339957865 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+17049 (secure 0 0 0) 0x7f95f0016090 con 0x7f960806e4b0 2024-09-11T23:20:25.643 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:25.643 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":114,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:20:24.647556+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:23.260045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:23.628059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f95e80678f0 msgr2=0x7f95e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f95e80678f0 0x7f95e8069db0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f960815df70 tx=0x7f95f8008040 comp rx=0 tx=0).stop 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f960806e4b0 msgr2=0x7f9608145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f960806e4b0 0x7f9608145cf0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f95f001a0a0 tx=0x7f95f0019210 comp rx=0 tx=0).stop 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 shutdown_connections 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96081587a0 0x7f9608157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96080b37d0 0x7f96081573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f95e80678f0 0x7f95e8069db0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 --2- 172.21.15.94:0/3339957865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f960806e4b0 0x7f9608145cf0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 >> 172.21.15.94:0/3339957865 conn(0x7f96080b1f90 msgr2=0x7f96080b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 shutdown_connections 2024-09-11T23:20:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.644+0000 7f960dab1640 1 -- 172.21.15.94:0/3339957865 wait complete. 2024-09-11T23:20:25.663 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:25.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af24b5640 1 Processor -- start 2024-09-11T23:20:25.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af24b5640 1 -- start start 2024-09-11T23:20:25.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af24b5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9aec141230 0x7f9aec0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af24b5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af24b5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aec142300 con 0x7f9aec141b50 2024-09-11T23:20:25.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af24b5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9aec072180 con 0x7f9aec141230 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af24b5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec1425e0 con 0x7f9aec071d20 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9ae3fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aebfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9aec141230 0x7f9aec0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af0a52640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9aec141b50 0x7f9aec15fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:51496/0 (socket says 172.21.15.94:51496) 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aebfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9aec141230 0x7f9aec0717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:54430/0 (socket says 172.21.15.94:54430) 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9af0a52640 1 -- 172.21.15.94:0/36079919 learned_addr learned my addr 172.21.15.94:0/36079919 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aeb7fe640 1 -- 172.21.15.94:0/36079919 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901476397 0 0) 0x7f9aec142300 con 0x7f9aec141b50 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aeb7fe640 1 -- 172.21.15.94:0/36079919 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad8003530 con 0x7f9aec141b50 2024-09-11T23:20:25.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aebfff640 1 -- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 msgr2=0x7f9aec141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:25.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aebfff640 1 --2- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aebfff640 1 -- 172.21.15.94:0/36079919 >> v1:172.21.15.155:6789/0 conn(0x7f9aec141b50 legacy=0x7f9aec15fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9aebfff640 1 -- 172.21.15.94:0/36079919 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec0d1160 con 0x7f9aec141230 2024-09-11T23:20:25.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.780+0000 7f9ae3fff640 1 --2- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:25.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9aebfff640 1 --2- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141230 0x7f9aec0717e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0097c0 tx=0x7f9adc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5168677bf55c22a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9aeb7fe640 1 -- 172.21.15.94:0/36079919 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0b0070 con 0x7f9aec141230 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9aeb7fe640 1 -- 172.21.15.94:0/36079919 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc0ab600 con 0x7f9aec141230 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9aeb7fe640 1 -- 172.21.15.94:0/36079919 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0ab9d0 con 0x7f9aec141230 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 -- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141230 msgr2=0x7f9aec0717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 --2- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141230 0x7f9aec0717e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0097c0 tx=0x7f9adc01c4a0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 -- 172.21.15.94:0/36079919 shutdown_connections 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 --2- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 --2- 172.21.15.94:0/36079919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141230 0x7f9aec0717e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 -- 172.21.15.94:0/36079919 >> 172.21.15.94:0/36079919 conn(0x7f9aec06c0c0 msgr2=0x7f9aec06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:25.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 -- 172.21.15.94:0/36079919 shutdown_connections 2024-09-11T23:20:25.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 -- 172.21.15.94:0/36079919 wait complete. 2024-09-11T23:20:25.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 Processor -- start 2024-09-11T23:20:25.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.784+0000 7f9af24b5640 1 -- start start 2024-09-11T23:20:25.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aec141230 0x7f9aec0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141b50 0x7f9aec15b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0d0f20 con 0x7f9aec141230 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0d0da0 con 0x7f9aec141b50 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec0d2970 con 0x7f9aec071d20 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aec141230 0x7f9aec0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aec141230 0x7f9aec0b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37692/0 (socket says 172.21.15.94:37692) 2024-09-11T23:20:25.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 -- 172.21.15.94:0/2287414509 learned_addr learned my addr 172.21.15.94:0/2287414509 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9aebfff640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af0a52640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141b50 0x7f9aec15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 -- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 msgr2=0x7f9aec1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec1432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 -- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141b50 msgr2=0x7f9aec15b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141b50 0x7f9aec15b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 -- 172.21.15.94:0/2287414509 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec143c30 con 0x7f9aec141230 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9aebfff640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec1432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af0a52640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141b50 0x7f9aec15b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae3fff640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aec141230 0x7f9aec0b5cb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400e980 tx=0x7f9ad400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:25.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae97fa640 1 -- 172.21.15.94:0/2287414509 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4017070 con 0x7f9aec141230 2024-09-11T23:20:25.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae97fa640 1 -- 172.21.15.94:0/2287414509 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad400ca00 con 0x7f9aec141230 2024-09-11T23:20:25.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae97fa640 1 -- 172.21.15.94:0/2287414509 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400cdd0 con 0x7f9aec141230 2024-09-11T23:20:25.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aec143f10 con 0x7f9aec141230 2024-09-11T23:20:25.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aec06d660 con 0x7f9aec141230 2024-09-11T23:20:25.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aec141610 con 0x7f9aec141230 2024-09-11T23:20:25.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae97fa640 1 -- 172.21.15.94:0/2287414509 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ad401a070 con 0x7f9aec141230 2024-09-11T23:20:25.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae97fa640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9acc0678c0 0x7f9acc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:25.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9ae97fa640 1 -- 172.21.15.94:0/2287414509 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f9ad40860d0 con 0x7f9aec141230 2024-09-11T23:20:25.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.788+0000 7f9aebfff640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9acc0678c0 0x7f9acc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:25.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.792+0000 7f9aebfff640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9acc0678c0 0x7f9acc069d80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0ad000 tx=0x7f9adc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:25.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.792+0000 7f9ae97fa640 1 -- 172.21.15.94:0/2287414509 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ad4056a80 con 0x7f9aec141230 2024-09-11T23:20:25.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.956+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9aec06da60 con 0x7f9aec141230 2024-09-11T23:20:25.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.956+0000 7f9ae97fa640 1 -- 172.21.15.94:0/2287414509 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+17049 (secure 0 0 0) 0x7f9ad4056380 con 0x7f9aec141230 2024-09-11T23:20:25.959 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:25.959 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":114,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:20:24.647556+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:23.260045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:23.628059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:25.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9acc0678c0 msgr2=0x7f9acc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9acc0678c0 0x7f9acc069d80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0ad000 tx=0x7f9adc008040 comp rx=0 tx=0).stop 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aec141230 msgr2=0x7f9aec0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aec141230 0x7f9aec0b5cb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400e980 tx=0x7f9ad400ee40 comp rx=0 tx=0).stop 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 shutdown_connections 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aec141b50 0x7f9aec15b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9acc0678c0 0x7f9acc069d80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aec141230 0x7f9aec0b5cb0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 --2- 172.21.15.94:0/2287414509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec071d20 0x7f9aec1432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 >> 172.21.15.94:0/2287414509 conn(0x7f9aec06c0c0 msgr2=0x7f9aec0b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 shutdown_connections 2024-09-11T23:20:25.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:25.960+0000 7f9af24b5640 1 -- 172.21.15.94:0/2287414509 wait complete. 2024-09-11T23:20:25.979 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:20:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.100+0000 7f92ef7fb640 1 Processor -- start 2024-09-11T23:20:26.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.100+0000 7f92ef7fb640 1 -- start start 2024-09-11T23:20:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92ef7fb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f92e8070020 0x7f92e815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92ef7fb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f92e815f1d0 0x7f92e80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92ef7fb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e80aede0 con 0x7f92e81520a0 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92ef7fb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f92e8152480 con 0x7f92e815f1d0 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92ef7fb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f92e815fa10 con 0x7f92e8070020 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f92e815f1d0 0x7f92e80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f92e815f1d0 0x7f92e80adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37702/0 (socket says 172.21.15.94:37702) 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 -- 172.21.15.94:0/727183775 learned_addr learned my addr 172.21.15.94:0/727183775 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92ecd96640 1 --2- 172.21.15.94:0/727183775 >> v2:172.21.15.155:3300/0 conn(0x7f92e8070020 0x7f92e815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 -- 172.21.15.94:0/727183775 >> v2:172.21.15.155:3300/0 conn(0x7f92e8070020 msgr2=0x7f92e815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 --2- 172.21.15.94:0/727183775 >> v2:172.21.15.155:3300/0 conn(0x7f92e8070020 0x7f92e815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 -- 172.21.15.94:0/727183775 >> v1:172.21.15.155:6789/0 conn(0x7f92e81520a0 legacy=0x7f92e806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 -- 172.21.15.94:0/727183775 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e8074250 con 0x7f92e815f1d0 2024-09-11T23:20:26.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92edd98640 1 --2- 172.21.15.94:0/727183775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e80adc80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f92e806e510 tx=0x7f92d801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895521d3c2ed5a0c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:26.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92e7fff640 1 -- 172.21.15.94:0/727183775 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80b4070 con 0x7f92e815f1d0 2024-09-11T23:20:26.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92e7fff640 1 -- 172.21.15.94:0/727183775 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d80a7c50 con 0x7f92e815f1d0 2024-09-11T23:20:26.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.104+0000 7f92e7fff640 1 -- 172.21.15.94:0/727183775 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80af440 con 0x7f92e815f1d0 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- 172.21.15.94:0/727183775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 msgr2=0x7f92e80adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/727183775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e80adc80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f92e806e510 tx=0x7f92d801eb80 comp rx=0 tx=0).stop 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- 172.21.15.94:0/727183775 shutdown_connections 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/727183775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e80adc80 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/727183775 >> v2:172.21.15.155:3300/0 conn(0x7f92e8070020 0x7f92e815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- 172.21.15.94:0/727183775 >> 172.21.15.94:0/727183775 conn(0x7f92e80b1f90 msgr2=0x7f92e80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- 172.21.15.94:0/727183775 shutdown_connections 2024-09-11T23:20:26.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- 172.21.15.94:0/727183775 wait complete. 2024-09-11T23:20:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 Processor -- start 2024-09-11T23:20:26.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- start start 2024-09-11T23:20:26.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92e8070020 0x7f92e813e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92e81520a0 0x7f92e815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f92e815f680 con 0x7f92e815f1d0 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92e8073d30 con 0x7f92e81520a0 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92e806e800 con 0x7f92e8070020 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e815bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37718/0 (socket says 172.21.15.94:37718) 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 -- 172.21.15.94:0/2250181325 learned_addr learned my addr 172.21.15.94:0/2250181325 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ed597640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92e8070020 0x7f92e813e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ecd96640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92e81520a0 0x7f92e815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 -- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92e8070020 msgr2=0x7f92e813e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92e8070020 0x7f92e813e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 -- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92e81520a0 msgr2=0x7f92e815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92e81520a0 0x7f92e815b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 -- 172.21.15.94:0/2250181325 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e8152960 con 0x7f92e815f1d0 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ecd96640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92e81520a0 0x7f92e815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92edd98640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e815bac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f92d800b2c0 tx=0x7f92d801b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92e5ffb640 1 -- 172.21.15.94:0/2250181325 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80b4040 con 0x7f92e815f1d0 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92e5ffb640 1 -- 172.21.15.94:0/2250181325 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d80bf070 con 0x7f92e815f1d0 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e8152c40 con 0x7f92e815f1d0 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92e5ffb640 1 -- 172.21.15.94:0/2250181325 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80ba440 con 0x7f92e815f1d0 2024-09-11T23:20:26.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.108+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e8153200 con 0x7f92e815f1d0 2024-09-11T23:20:26.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.112+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e81535e0 con 0x7f92e815f1d0 2024-09-11T23:20:26.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.112+0000 7f92e5ffb640 1 -- 172.21.15.94:0/2250181325 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92d80ba5e0 con 0x7f92e815f1d0 2024-09-11T23:20:26.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.112+0000 7f92e5ffb640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92d40678c0 0x7f92d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.112+0000 7f92e5ffb640 1 -- 172.21.15.94:0/2250181325 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f92d8123220 con 0x7f92e815f1d0 2024-09-11T23:20:26.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.112+0000 7f92ed597640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92d40678c0 0x7f92d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.112+0000 7f92ed597640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92d40678c0 0x7f92d4069d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f92e0004450 tx=0x7f92e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:26.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.116+0000 7f92e5ffb640 1 -- 172.21.15.94:0/2250181325 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f92d80187a0 con 0x7f92e815f1d0 2024-09-11T23:20:26.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:26.316+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f92e8153ef0 con 0x7f92e815f1d0 2024-09-11T23:20:27.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.312+0000 7f92e5ffb640 1 -- 172.21.15.94:0/2250181325 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) ==== 118+0+0 (secure 0 0 0) 0x7f92d80f3c60 con 0x7f92e815f1d0 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92d40678c0 msgr2=0x7f92d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92d40678c0 0x7f92d4069d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f92e0004450 tx=0x7f92e0009040 comp rx=0 tx=0).stop 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 msgr2=0x7f92e815bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e815bac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f92d800b2c0 tx=0x7f92d801b920 comp rx=0 tx=0).stop 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 shutdown_connections 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f92d40678c0 0x7f92d4069d80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e815f1d0 0x7f92e815bac0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92e81520a0 0x7f92e815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 --2- 172.21.15.94:0/2250181325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92e8070020 0x7f92e813e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.316+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 >> 172.21.15.94:0/2250181325 conn(0x7f92e80b1f90 msgr2=0x7f92e806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:27.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.320+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 shutdown_connections 2024-09-11T23:20:27.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.320+0000 7f92ef7fb640 1 -- 172.21.15.94:0/2250181325 wait complete. 2024-09-11T23:20:27.342 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:20:27.342 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:20:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 Processor -- start 2024-09-11T23:20:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 -- start start 2024-09-11T23:20:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f573415bec0 0x7f57340ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f573415c2a0 0x7f57340aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57340af2a0 0x7f573415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f57340b3290 con 0x7f573415c2a0 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f57340b3570 con 0x7f573415bec0 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5738c40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57340b3850 con 0x7f57340af2a0 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f573415c2a0 0x7f57340aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f573415c2a0 0x7f57340aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37734/0 (socket says 172.21.15.94:37734) 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 -- 172.21.15.94:0/3696059857 learned_addr learned my addr 172.21.15.94:0/3696059857 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5732d9d640 1 --2- 172.21.15.94:0/3696059857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57340af2a0 0x7f573415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f573259c640 1 --2- 172.21.15.94:0/3696059857 >> v2:172.21.15.155:3300/0 conn(0x7f573415bec0 0x7f57340ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 -- 172.21.15.94:0/3696059857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57340af2a0 msgr2=0x7f573415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 --2- 172.21.15.94:0/3696059857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57340af2a0 0x7f573415fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 -- 172.21.15.94:0/3696059857 >> v2:172.21.15.155:3300/0 conn(0x7f573415bec0 msgr2=0x7f57340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:27.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 --2- 172.21.15.94:0/3696059857 >> v2:172.21.15.155:3300/0 conn(0x7f573415bec0 0x7f57340ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5729d9b640 1 -- 172.21.15.94:0/3696059857 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57340b3b30 con 0x7f573415c2a0 2024-09-11T23:20:27.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.468+0000 7f5732d9d640 1 --2- 172.21.15.94:0/3696059857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57340af2a0 0x7f573415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:27.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 --2- 172.21.15.94:0/3696059857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415c2a0 0x7f57340aed60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5734071710 tx=0x7f572401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4086655b6d88e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:27.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5731d9b640 1 -- 172.21.15.94:0/3696059857 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240b0070 con 0x7f573415c2a0 2024-09-11T23:20:27.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5731d9b640 1 -- 172.21.15.94:0/3696059857 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57240ab600 con 0x7f573415c2a0 2024-09-11T23:20:27.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5731d9b640 1 -- 172.21.15.94:0/3696059857 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240ab9d0 con 0x7f573415c2a0 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- 172.21.15.94:0/3696059857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415c2a0 msgr2=0x7f57340aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 --2- 172.21.15.94:0/3696059857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415c2a0 0x7f57340aed60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5734071710 tx=0x7f572401c230 comp rx=0 tx=0).stop 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- 172.21.15.94:0/3696059857 shutdown_connections 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 --2- 172.21.15.94:0/3696059857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57340af2a0 0x7f573415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 --2- 172.21.15.94:0/3696059857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415c2a0 0x7f57340aed60 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 --2- 172.21.15.94:0/3696059857 >> v2:172.21.15.155:3300/0 conn(0x7f573415bec0 0x7f57340ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- 172.21.15.94:0/3696059857 >> 172.21.15.94:0/3696059857 conn(0x7f57340b1f90 msgr2=0x7f57340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- 172.21.15.94:0/3696059857 shutdown_connections 2024-09-11T23:20:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- 172.21.15.94:0/3696059857 wait complete. 2024-09-11T23:20:27.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 Processor -- start 2024-09-11T23:20:27.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- start start 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57340af2a0 0x7f573414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415bec0 0x7f5734151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f573415c2a0 0x7f573415d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f57340af6b0 con 0x7f573415bec0 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57340ad740 con 0x7f57340af2a0 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5738c40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f573406e000 con 0x7f573415c2a0 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415bec0 0x7f5734151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:27.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415bec0 0x7f5734151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37748/0 (socket says 172.21.15.94:37748) 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 -- 172.21.15.94:0/1265732866 learned_addr learned my addr 172.21.15.94:0/1265732866 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f573259c640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57340af2a0 0x7f573414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5732d9d640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f573415c2a0 0x7f573415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 -- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f573415c2a0 msgr2=0x7f573415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f573415c2a0 0x7f573415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 -- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57340af2a0 msgr2=0x7f573414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57340af2a0 0x7f573414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 -- 172.21.15.94:0/1265732866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734150010 con 0x7f573415bec0 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f573259c640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57340af2a0 0x7f573414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.472+0000 7f5729d9b640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415bec0 0x7f5734151a10 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f57240ae040 tx=0x7f5724018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f572b7fe640 1 -- 172.21.15.94:0/1265732866 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240ba020 con 0x7f573415bec0 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f572b7fe640 1 -- 172.21.15.94:0/1265732866 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57240b6620 con 0x7f573415bec0 2024-09-11T23:20:27.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573415c8c0 con 0x7f573415bec0 2024-09-11T23:20:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f572b7fe640 1 -- 172.21.15.94:0/1265732866 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240b0040 con 0x7f573415bec0 2024-09-11T23:20:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573415ce80 con 0x7f573415bec0 2024-09-11T23:20:27.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57340ad200 con 0x7f573415bec0 2024-09-11T23:20:27.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f572b7fe640 1 -- 172.21.15.94:0/1265732866 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57240bd020 con 0x7f573415bec0 2024-09-11T23:20:27.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f572b7fe640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57140678c0 0x7f5714069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:27.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f572b7fe640 1 -- 172.21.15.94:0/1265732866 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f5724120050 con 0x7f573415bec0 2024-09-11T23:20:27.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f573259c640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57140678c0 0x7f5714069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:27.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.476+0000 7f573259c640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57140678c0 0x7f5714069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f573415b4e0 tx=0x7f571c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:27.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.480+0000 7f572b7fe640 1 -- 172.21.15.94:0/1265732866 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f57240c4030 con 0x7f573415bec0 2024-09-11T23:20:27.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:27.676+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f573406fcd0 con 0x7f573415bec0 2024-09-11T23:20:28.278 INFO:tasks.ceph.mds.c.smithi094.stderr:2024-09-11T23:20:28.276+0000 7fb03cee8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:20:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.320+0000 7f572b7fe640 1 -- 172.21.15.94:0/1265732866 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) ==== 122+0+0 (secure 0 0 0) 0x7f5724016110 con 0x7f573415bec0 2024-09-11T23:20:28.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57140678c0 msgr2=0x7f5714069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57140678c0 0x7f5714069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f573415b4e0 tx=0x7f571c008040 comp rx=0 tx=0).stop 2024-09-11T23:20:28.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415bec0 msgr2=0x7f5734151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415bec0 0x7f5734151a10 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f57240ae040 tx=0x7f5724018fd0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 shutdown_connections 2024-09-11T23:20:28.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f573415c2a0 0x7f573415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f57140678c0 0x7f5714069d80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f573415bec0 0x7f5734151a10 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 --2- 172.21.15.94:0/1265732866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57340af2a0 0x7f573414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 >> 172.21.15.94:0/1265732866 conn(0x7f57340b1f90 msgr2=0x7f57340cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 shutdown_connections 2024-09-11T23:20:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.324+0000 7f5738c40640 1 -- 172.21.15.94:0/1265732866 wait complete. 2024-09-11T23:20:28.349 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:20:28.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:28.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f754421c640 1 Processor -- start 2024-09-11T23:20:28.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f754421c640 1 -- start start 2024-09-11T23:20:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f754421c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cdb00 0x7f753c0b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f754421c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f753c0cf1e0 0x7f753c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f754421c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c0b3ba0 con 0x7f753c0b3280 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f754421c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f753c0ce140 con 0x7f753c0cf1e0 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f754421c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f753c0ce420 con 0x7f753c0cdb00 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f7541fb8640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f753c0b3280 0x7f753c15d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42256/0 (socket says 172.21.15.94:42256) 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f7541fb8640 1 -- 172.21.15.94:0/993706087 learned_addr learned my addr 172.21.15.94:0/993706087 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f75427b9640 1 --2- 172.21.15.94:0/993706087 >> v2:172.21.15.94:3300/0 conn(0x7f753c0cf1e0 0x7f753c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f75417b7640 1 --2- 172.21.15.94:0/993706087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cdb00 0x7f753c0b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f7540fb6640 1 -- 172.21.15.94:0/993706087 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284009088 0 0) 0x7f753c0b3ba0 con 0x7f753c0b3280 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f7540fb6640 1 -- 172.21.15.94:0/993706087 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7528003530 con 0x7f753c0b3280 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f75427b9640 1 -- 172.21.15.94:0/993706087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cdb00 msgr2=0x7f753c0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f75427b9640 1 --2- 172.21.15.94:0/993706087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cdb00 0x7f753c0b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f75427b9640 1 -- 172.21.15.94:0/993706087 >> v1:172.21.15.94:6789/0 conn(0x7f753c0b3280 legacy=0x7f753c15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f75427b9640 1 -- 172.21.15.94:0/993706087 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c0ce700 con 0x7f753c0cf1e0 2024-09-11T23:20:28.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.472+0000 7f75417b7640 1 --2- 172.21.15.94:0/993706087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cdb00 0x7f753c0b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:28.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75427b9640 1 --2- 172.21.15.94:0/993706087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cf1e0 0x7f753c15d810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7534009d90 tx=0x7f753401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b7636720e552f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:28.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f7540fb6640 1 -- 172.21.15.94:0/993706087 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75340b2070 con 0x7f753c0cf1e0 2024-09-11T23:20:28.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f7540fb6640 1 -- 172.21.15.94:0/993706087 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75340a5890 con 0x7f753c0cf1e0 2024-09-11T23:20:28.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f7540fb6640 1 -- 172.21.15.94:0/993706087 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75340a5c60 con 0x7f753c0cf1e0 2024-09-11T23:20:28.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- 172.21.15.94:0/993706087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cf1e0 msgr2=0x7f753c15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 --2- 172.21.15.94:0/993706087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cf1e0 0x7f753c15d810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7534009d90 tx=0x7f753401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- 172.21.15.94:0/993706087 shutdown_connections 2024-09-11T23:20:28.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 --2- 172.21.15.94:0/993706087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cf1e0 0x7f753c15d810 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 --2- 172.21.15.94:0/993706087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cdb00 0x7f753c0b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- 172.21.15.94:0/993706087 >> 172.21.15.94:0/993706087 conn(0x7f753c0b6870 msgr2=0x7f753c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:28.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- 172.21.15.94:0/993706087 shutdown_connections 2024-09-11T23:20:28.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- 172.21.15.94:0/993706087 wait complete. 2024-09-11T23:20:28.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 Processor -- start 2024-09-11T23:20:28.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- start start 2024-09-11T23:20:28.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753c0b3280 0x7f753c15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cdb00 0x7f753c1f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cf1e0 0x7f753c14d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f753c15e160 con 0x7f753c0cdb00 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f753c15a0f0 con 0x7f753c0b3280 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f754421c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f753c15e2e0 con 0x7f753c0cf1e0 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cdb00 0x7f753c1f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cdb00 0x7f753c1f6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37780/0 (socket says 172.21.15.94:37780) 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 -- 172.21.15.94:0/3175586079 learned_addr learned my addr 172.21.15.94:0/3175586079 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f7541fb8640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753c0b3280 0x7f753c15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 -- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cf1e0 msgr2=0x7f753c14d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75427b9640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cf1e0 0x7f753c14d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cf1e0 0x7f753c14d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 -- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753c0b3280 msgr2=0x7f753c15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753c0b3280 0x7f753c15b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f75417b7640 1 -- 172.21.15.94:0/3175586079 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c15baf0 con 0x7f753c0cdb00 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.476+0000 7f7541fb8640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753c0b3280 0x7f753c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f75417b7640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cdb00 0x7f753c1f6870 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f752c00d800 tx=0x7f752c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f75327fc640 1 -- 172.21.15.94:0/3175586079 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c018020 con 0x7f753c0cdb00 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f75327fc640 1 -- 172.21.15.94:0/3175586079 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c009660 con 0x7f753c0cdb00 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753c0b0df0 con 0x7f753c0cdb00 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f75327fc640 1 -- 172.21.15.94:0/3175586079 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c009a50 con 0x7f753c0cdb00 2024-09-11T23:20:28.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753c15bd90 con 0x7f753c0cdb00 2024-09-11T23:20:28.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753c15d810 con 0x7f753c0cdb00 2024-09-11T23:20:28.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f75327fc640 1 -- 172.21.15.94:0/3175586079 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f752c01b020 con 0x7f753c0cdb00 2024-09-11T23:20:28.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f75327fc640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75200678f0 0x7f7520069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f75327fc640 1 -- 172.21.15.94:0/3175586079 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f752c086270 con 0x7f753c0cdb00 2024-09-11T23:20:28.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f7541fb8640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75200678f0 0x7f7520069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.480+0000 7f7541fb8640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75200678f0 0x7f7520069db0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7538005890 tx=0x7f7538009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:28.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.484+0000 7f75327fc640 1 -- 172.21.15.94:0/3175586079 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f752c022020 con 0x7f753c0cdb00 2024-09-11T23:20:28.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.676+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f753c0cd590 con 0x7f753c0cdb00 2024-09-11T23:20:28.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.676+0000 7f75327fc640 1 -- 172.21.15.94:0/3175586079 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5225 (secure 0 0 0) 0x7f752c056cb0 con 0x7f753c0cdb00 2024-09-11T23:20:28.680 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:28.680 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":72,"btime":"2024-09-11T23:20:28:318414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:24.648300+0000","modified":"2024-09-11T23:20:27.682973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/502410844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":502410844},{"type":"v1","addr":"172.21.15.94:6835","nonce":502410844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":8}]} 2024-09-11T23:20:28.680 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 72 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75200678f0 msgr2=0x7f7520069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75200678f0 0x7f7520069db0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7538005890 tx=0x7f7538009040 comp rx=0 tx=0).stop 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cdb00 msgr2=0x7f753c1f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cdb00 0x7f753c1f6870 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f752c00d800 tx=0x7f752c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 shutdown_connections 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753c0cf1e0 0x7f753c14d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f75200678f0 0x7f7520069db0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f753c0cdb00 0x7f753c1f6870 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 --2- 172.21.15.94:0/3175586079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753c0b3280 0x7f753c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 >> 172.21.15.94:0/3175586079 conn(0x7f753c0b6870 msgr2=0x7f753c1584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 shutdown_connections 2024-09-11T23:20:28.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.680+0000 7f754421c640 1 -- 172.21.15.94:0/3175586079 wait complete. 2024-09-11T23:20:28.698 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:28.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc92f8640 1 Processor -- start 2024-09-11T23:20:28.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc92f8640 1 -- start start 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc92f8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9fc41520a0 0x7f9fc406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc92f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fc406fe50 0x7f9fc415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc92f8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc4070250 con 0x7f9fc415f1d0 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc92f8640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9fc4152480 con 0x7f9fc41520a0 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc92f8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9fc40aede0 con 0x7f9fc406fe50 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc2ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9fc41520a0 0x7f9fc406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc37fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9fc415f1d0 0x7f9fc4071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42272/0 (socket says 172.21.15.94:42272) 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc37fe640 1 -- 172.21.15.94:0/1717374470 learned_addr learned my addr 172.21.15.94:0/1717374470 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fbbfff640 1 --2- 172.21.15.94:0/1717374470 >> v2:172.21.15.155:3300/0 conn(0x7f9fc406fe50 0x7f9fc415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc2ffd640 1 -- 172.21.15.94:0/1717374470 >> v2:172.21.15.155:3300/0 conn(0x7f9fc406fe50 msgr2=0x7f9fc415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc2ffd640 1 --2- 172.21.15.94:0/1717374470 >> v2:172.21.15.155:3300/0 conn(0x7f9fc406fe50 0x7f9fc415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc2ffd640 1 -- 172.21.15.94:0/1717374470 >> v1:172.21.15.94:6789/0 conn(0x7f9fc415f1d0 legacy=0x7f9fc4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc2ffd640 1 -- 172.21.15.94:0/1717374470 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc415fa10 con 0x7f9fc41520a0 2024-09-11T23:20:28.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fc27fc640 1 -- 172.21.15.94:0/1717374470 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822834411 0 0) 0x7f9fc4070250 con 0x7f9fc415f1d0 2024-09-11T23:20:28.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.816+0000 7f9fbbfff640 1 --2- 172.21.15.94:0/1717374470 >> v2:172.21.15.155:3300/0 conn(0x7f9fc406fe50 0x7f9fc415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc2ffd640 1 --2- 172.21.15.94:0/1717374470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc406f910 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f9fc406e510 tx=0x7f9fb401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e9a1fd4f70f5a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc27fc640 1 -- 172.21.15.94:0/1717374470 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40b4070 con 0x7f9fc41520a0 2024-09-11T23:20:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc27fc640 1 -- 172.21.15.94:0/1717374470 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb40a7b20 con 0x7f9fc41520a0 2024-09-11T23:20:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc27fc640 1 -- 172.21.15.94:0/1717374470 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40af440 con 0x7f9fc41520a0 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- 172.21.15.94:0/1717374470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 msgr2=0x7f9fc406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/1717374470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc406f910 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f9fc406e510 tx=0x7f9fb401eb30 comp rx=0 tx=0).stop 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- 172.21.15.94:0/1717374470 shutdown_connections 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/1717374470 >> v2:172.21.15.155:3300/0 conn(0x7f9fc406fe50 0x7f9fc415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/1717374470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc406f910 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- 172.21.15.94:0/1717374470 >> 172.21.15.94:0/1717374470 conn(0x7f9fc40b1f90 msgr2=0x7f9fc40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- 172.21.15.94:0/1717374470 shutdown_connections 2024-09-11T23:20:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- 172.21.15.94:0/1717374470 wait complete. 2024-09-11T23:20:28.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 Processor -- start 2024-09-11T23:20:28.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- start start 2024-09-11T23:20:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc406fe50 0x7f9fc40998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc40b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc415f1d0 0x7f9fc40b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4073d30 con 0x7f9fc41520a0 2024-09-11T23:20:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4073a50 con 0x7f9fc415f1d0 2024-09-11T23:20:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fc415f620 con 0x7f9fc406fe50 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc40b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc40b3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37786/0 (socket says 172.21.15.94:37786) 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 -- 172.21.15.94:0/3006036004 learned_addr learned my addr 172.21.15.94:0/3006036004 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc37fe640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc415f1d0 0x7f9fc40b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 -- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc406fe50 msgr2=0x7f9fc40998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc406fe50 0x7f9fc40998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 -- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc415f1d0 msgr2=0x7f9fc40b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc415f1d0 0x7f9fc40b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 -- 172.21.15.94:0/3006036004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc413c0e0 con 0x7f9fc41520a0 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc37fe640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc415f1d0 0x7f9fc40b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbbfff640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc40b3f10 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c7f0 tx=0x7f9fac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbb7fe640 1 -- 172.21.15.94:0/3006036004 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac015070 con 0x7f9fc41520a0 2024-09-11T23:20:28.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbb7fe640 1 -- 172.21.15.94:0/3006036004 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac007820 con 0x7f9fc41520a0 2024-09-11T23:20:28.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fbb7fe640 1 -- 172.21.15.94:0/3006036004 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac007c10 con 0x7f9fc41520a0 2024-09-11T23:20:28.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc40cf8b0 con 0x7f9fc41520a0 2024-09-11T23:20:28.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.820+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc4099e10 con 0x7f9fc41520a0 2024-09-11T23:20:28.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.824+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc415ec90 con 0x7f9fc41520a0 2024-09-11T23:20:28.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.824+0000 7f9fbb7fe640 1 -- 172.21.15.94:0/3006036004 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9fac018070 con 0x7f9fc41520a0 2024-09-11T23:20:28.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.824+0000 7f9fbb7fe640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9fa40678f0 0x7f9fa4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:28.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.824+0000 7f9fbb7fe640 1 -- 172.21.15.94:0/3006036004 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f9fac086360 con 0x7f9fc41520a0 2024-09-11T23:20:28.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.824+0000 7f9fc2ffd640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9fa40678f0 0x7f9fa4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:28.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.824+0000 7f9fc2ffd640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9fa40678f0 0x7f9fa4069db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40b1000 tx=0x7f9fb4004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:28.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.828+0000 7f9fbb7fe640 1 -- 172.21.15.94:0/3006036004 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9fac056df0 con 0x7f9fc41520a0 2024-09-11T23:20:28.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.988+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fc406e540 con 0x7f9fc41520a0 2024-09-11T23:20:28.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fbb7fe640 1 -- 172.21.15.94:0/3006036004 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17036 (secure 0 0 0) 0x7f9fac0566f0 con 0x7f9fc41520a0 2024-09-11T23:20:28.993 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:28.993 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":115,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:20:26.277253+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:23.260045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:23.628059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:28.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9fa40678f0 msgr2=0x7f9fa4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9fa40678f0 0x7f9fa4069db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40b1000 tx=0x7f9fb4004740 comp rx=0 tx=0).stop 2024-09-11T23:20:28.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 msgr2=0x7f9fc40b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:28.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc40b3f10 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c7f0 tx=0x7f9fac00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 shutdown_connections 2024-09-11T23:20:28.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc415f1d0 0x7f9fc40b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9fa40678f0 0x7f9fa4069db0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fc41520a0 0x7f9fc40b3f10 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 --2- 172.21.15.94:0/3006036004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc406fe50 0x7f9fc40998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:28.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 >> 172.21.15.94:0/3006036004 conn(0x7f9fc40b1f90 msgr2=0x7f9fc406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:28.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 shutdown_connections 2024-09-11T23:20:28.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:28.992+0000 7f9fc92f8640 1 -- 172.21.15.94:0/3006036004 wait complete. 2024-09-11T23:20:29.012 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:20:29.012 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:20:29.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc080ee0640 1 Processor -- start 2024-09-11T23:20:29.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc080ee0640 1 -- start start 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc080ee0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc07c144d60 0x7fc07c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc080ee0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc07c071030 con 0x7fc07c0b52b0 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc080ee0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc07c06fa50 con 0x7fc07c0b4090 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc080ee0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc07c070660 con 0x7fc07c144d60 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc07a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc07c144d60 0x7fc07c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc07ad9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc07c0b52b0 0x7fc07c0ae610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42278/0 (socket says 172.21.15.94:42278) 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc07ad9d640 1 -- 172.21.15.94:0/4278559295 learned_addr learned my addr 172.21.15.94:0/4278559295 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc07a59c640 1 -- 172.21.15.94:0/4278559295 >> v1:172.21.15.155:6789/0 conn(0x7fc07c0b4090 legacy=0x7fc07c0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc07a59c640 1 -- 172.21.15.94:0/4278559295 >> v1:172.21.15.94:6789/0 conn(0x7fc07c0b52b0 legacy=0x7fc07c0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc07a59c640 1 -- 172.21.15.94:0/4278559295 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07c06fd30 con 0x7fc07c144d60 2024-09-11T23:20:29.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.128+0000 7fc07959a640 1 -- 172.21.15.94:0/4278559295 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338422928 0 0) 0x7fc07c071030 con 0x7fc07c0b52b0 2024-09-11T23:20:29.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07a59c640 1 --2- 172.21.15.94:0/4278559295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c070af0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0707e0 tx=0x7fc07401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbaa48c46293d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07959a640 1 -- 172.21.15.94:0/4278559295 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0740b2070 con 0x7fc07c144d60 2024-09-11T23:20:29.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07959a640 1 -- 172.21.15.94:0/4278559295 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0740a5810 con 0x7fc07c144d60 2024-09-11T23:20:29.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07959a640 1 -- 172.21.15.94:0/4278559295 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0740a5be0 con 0x7fc07c144d60 2024-09-11T23:20:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- 172.21.15.94:0/4278559295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 msgr2=0x7fc07c070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 --2- 172.21.15.94:0/4278559295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c070af0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0707e0 tx=0x7fc07401c950 comp rx=0 tx=0).stop 2024-09-11T23:20:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- 172.21.15.94:0/4278559295 shutdown_connections 2024-09-11T23:20:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 --2- 172.21.15.94:0/4278559295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c070af0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- 172.21.15.94:0/4278559295 >> 172.21.15.94:0/4278559295 conn(0x7fc07c09aa00 msgr2=0x7fc07c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- 172.21.15.94:0/4278559295 shutdown_connections 2024-09-11T23:20:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- 172.21.15.94:0/4278559295 wait complete. 2024-09-11T23:20:29.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 Processor -- start 2024-09-11T23:20:29.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- start start 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc07c0b4090 0x7fc07c0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc07c0b52b0 0x7fc07c158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c0af2b0 con 0x7fc07c144d60 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c0af130 con 0x7fc07c0b4090 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc07c06bcc0 con 0x7fc07c0b52b0 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c15b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37802/0 (socket says 172.21.15.94:37802) 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 -- 172.21.15.94:0/3953235556 learned_addr learned my addr 172.21.15.94:0/3953235556 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07a59c640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc07c0b4090 0x7fc07c0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc079d9b640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc07c0b52b0 0x7fc07c158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 -- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc07c0b52b0 msgr2=0x7fc07c158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc07c0b52b0 0x7fc07c158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 -- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc07c0b4090 msgr2=0x7fc07c0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc07c0b4090 0x7fc07c0d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 -- 172.21.15.94:0/3953235556 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07c09ef40 con 0x7fc07c144d60 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc07ad9d640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c15b3d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00c480 tx=0x7fc06c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc072ffd640 1 -- 172.21.15.94:0/3953235556 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c018070 con 0x7fc07c144d60 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc072ffd640 1 -- 172.21.15.94:0/3953235556 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c0074e0 con 0x7fc07c144d60 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.132+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07c0d0820 con 0x7fc07c144d60 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc072ffd640 1 -- 172.21.15.94:0/3953235556 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c004a30 con 0x7fc07c144d60 2024-09-11T23:20:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07c0d0da0 con 0x7fc07c144d60 2024-09-11T23:20:29.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07c0b4ba0 con 0x7fc07c144d60 2024-09-11T23:20:29.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc072ffd640 1 -- 172.21.15.94:0/3953235556 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc06c01b070 con 0x7fc07c144d60 2024-09-11T23:20:29.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc072ffd640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc05c0678c0 0x7fc05c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc072ffd640 1 -- 172.21.15.94:0/3953235556 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fc06c0850b0 con 0x7fc07c144d60 2024-09-11T23:20:29.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc07a59c640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc05c0678c0 0x7fc05c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.136+0000 7fc07a59c640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc05c0678c0 0x7fc05c069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc0740af000 tx=0x7fc0740a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.140+0000 7fc072ffd640 1 -- 172.21.15.94:0/3953235556 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc06c055af0 con 0x7fc07c144d60 2024-09-11T23:20:29.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.300+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc07c0ae170 con 0x7fc05c0678c0 2024-09-11T23:20:29.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.316+0000 7fc072ffd640 1 -- 172.21.15.94:0/3953235556 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252489 (secure 0 0 0) 0x7fc07c0ae170 con 0x7fc05c0678c0 2024-09-11T23:20:29.321 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:29.323 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:20:29.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc05c0678c0 msgr2=0x7fc05c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc05c0678c0 0x7fc05c069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc0740af000 tx=0x7fc0740a7070 comp rx=0 tx=0).stop 2024-09-11T23:20:29.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 msgr2=0x7fc07c15b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c15b3d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00c480 tx=0x7fc06c00c940 comp rx=0 tx=0).stop 2024-09-11T23:20:29.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 shutdown_connections 2024-09-11T23:20:29.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc05c0678c0 0x7fc05c069d80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc07c144d60 0x7fc07c15b3d0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc07c0b52b0 0x7fc07c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 --2- 172.21.15.94:0/3953235556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc07c0b4090 0x7fc07c0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 >> 172.21.15.94:0/3953235556 conn(0x7fc07c09aa00 msgr2=0x7fc07c09e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:29.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 shutdown_connections 2024-09-11T23:20:29.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.320+0000 7fc080ee0640 1 -- 172.21.15.94:0/3953235556 wait complete. 2024-09-11T23:20:29.340 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-09-11T23:20:28.075146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286892,"kb_used_data":12400,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754687828,"statfs":{"total":773094113280,"available":772800335872,"internally_reserved":0,"allocated":12697600,"data_stored":6502836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.790687"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.288461+0000","last_change":"2024-09-11T23:20:25.306115+0000","last_active":"2024-09-11T23:20:26.288461+0000","last_peered":"2024-09-11T23:20:26.288461+0000","last_clean":"2024-09-11T23:20:26.288461+0000","last_became_active":"2024-09-11T23:20:25.305077+0000","last_became_peered":"2024-09-11T23:20:25.305077+0000","last_unstale":"2024-09-11T23:20:26.288461+0000","last_undegraded":"2024-09-11T23:20:26.288461+0000","last_fullsized":"2024-09-11T23:20:26.288461+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:19.670650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592902+0000","last_change":"2024-09-11T23:20:25.322070+0000","last_active":"2024-09-11T23:20:26.592902+0000","last_peered":"2024-09-11T23:20:26.592902+0000","last_clean":"2024-09-11T23:20:26.592902+0000","last_became_active":"2024-09-11T23:20:25.321804+0000","last_became_peered":"2024-09-11T23:20:25.321804+0000","last_unstale":"2024-09-11T23:20:26.592902+0000","last_undegraded":"2024-09-11T23:20:26.592902+0000","last_fullsized":"2024-09-11T23:20:26.592902+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:03.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593751+0000","last_change":"2024-09-11T23:20:25.340079+0000","last_active":"2024-09-11T23:20:26.593751+0000","last_peered":"2024-09-11T23:20:26.593751+0000","last_clean":"2024-09-11T23:20:26.593751+0000","last_became_active":"2024-09-11T23:20:25.339817+0000","last_became_peered":"2024-09-11T23:20:25.339817+0000","last_unstale":"2024-09-11T23:20:26.593751+0000","last_undegraded":"2024-09-11T23:20:26.593751+0000","last_fullsized":"2024-09-11T23:20:26.593751+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:06.001715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593292+0000","last_change":"2024-09-11T23:20:25.334104+0000","last_active":"2024-09-11T23:20:26.593292+0000","last_peered":"2024-09-11T23:20:26.593292+0000","last_clean":"2024-09-11T23:20:26.593292+0000","last_became_active":"2024-09-11T23:20:25.331386+0000","last_became_peered":"2024-09-11T23:20:25.331386+0000","last_unstale":"2024-09-11T23:20:26.593292+0000","last_undegraded":"2024-09-11T23:20:26.593292+0000","last_fullsized":"2024-09-11T23:20:26.593292+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:06.072747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287516+0000","last_change":"2024-09-11T23:20:25.341402+0000","last_active":"2024-09-11T23:20:26.287516+0000","last_peered":"2024-09-11T23:20:26.287516+0000","last_clean":"2024-09-11T23:20:26.287516+0000","last_became_active":"2024-09-11T23:20:25.340783+0000","last_became_peered":"2024-09-11T23:20:25.340783+0000","last_unstale":"2024-09-11T23:20:26.287516+0000","last_undegraded":"2024-09-11T23:20:26.287516+0000","last_fullsized":"2024-09-11T23:20:26.287516+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:58.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326045+0000","last_change":"2024-09-11T23:20:25.321428+0000","last_active":"2024-09-11T23:20:26.326045+0000","last_peered":"2024-09-11T23:20:26.326045+0000","last_clean":"2024-09-11T23:20:26.326045+0000","last_became_active":"2024-09-11T23:20:25.321052+0000","last_became_peered":"2024-09-11T23:20:25.321052+0000","last_unstale":"2024-09-11T23:20:26.326045+0000","last_undegraded":"2024-09-11T23:20:26.326045+0000","last_fullsized":"2024-09-11T23:20:26.326045+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:31.195554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.325958+0000","last_change":"2024-09-11T23:20:25.334312+0000","last_active":"2024-09-11T23:20:26.325958+0000","last_peered":"2024-09-11T23:20:26.325958+0000","last_clean":"2024-09-11T23:20:26.325958+0000","last_became_active":"2024-09-11T23:20:25.334014+0000","last_became_peered":"2024-09-11T23:20:25.334014+0000","last_unstale":"2024-09-11T23:20:26.325958+0000","last_undegraded":"2024-09-11T23:20:26.325958+0000","last_fullsized":"2024-09-11T23:20:26.325958+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:04.733329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592085+0000","last_change":"2024-09-11T23:20:25.347262+0000","last_active":"2024-09-11T23:20:26.592085+0000","last_peered":"2024-09-11T23:20:26.592085+0000","last_clean":"2024-09-11T23:20:26.592085+0000","last_became_active":"2024-09-11T23:20:25.346947+0000","last_became_peered":"2024-09-11T23:20:25.346947+0000","last_unstale":"2024-09-11T23:20:26.592085+0000","last_undegraded":"2024-09-11T23:20:26.592085+0000","last_fullsized":"2024-09-11T23:20:26.592085+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594213+0000","last_change":"2024-09-11T23:20:25.337919+0000","last_active":"2024-09-11T23:20:26.594213+0000","last_peered":"2024-09-11T23:20:26.594213+0000","last_clean":"2024-09-11T23:20:26.594213+0000","last_became_active":"2024-09-11T23:20:25.337305+0000","last_became_peered":"2024-09-11T23:20:25.337305+0000","last_unstale":"2024-09-11T23:20:26.594213+0000","last_undegraded":"2024-09-11T23:20:26.594213+0000","last_fullsized":"2024-09-11T23:20:26.594213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:03.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592089+0000","last_change":"2024-09-11T23:20:25.323725+0000","last_active":"2024-09-11T23:20:26.592089+0000","last_peered":"2024-09-11T23:20:26.592089+0000","last_clean":"2024-09-11T23:20:26.592089+0000","last_became_active":"2024-09-11T23:20:25.323350+0000","last_became_peered":"2024-09-11T23:20:25.323350+0000","last_unstale":"2024-09-11T23:20:26.592089+0000","last_undegraded":"2024-09-11T23:20:26.592089+0000","last_fullsized":"2024-09-11T23:20:26.592089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:03.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.288401+0000","last_change":"2024-09-11T23:20:25.299754+0000","last_active":"2024-09-11T23:20:26.288401+0000","last_peered":"2024-09-11T23:20:26.288401+0000","last_clean":"2024-09-11T23:20:26.288401+0000","last_became_active":"2024-09-11T23:20:25.299041+0000","last_became_peered":"2024-09-11T23:20:25.299041+0000","last_unstale":"2024-09-11T23:20:26.288401+0000","last_undegraded":"2024-09-11T23:20:26.288401+0000","last_fullsized":"2024-09-11T23:20:26.288401+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:30.984388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326308+0000","last_change":"2024-09-11T23:20:25.322532+0000","last_active":"2024-09-11T23:20:26.326308+0000","last_peered":"2024-09-11T23:20:26.326308+0000","last_clean":"2024-09-11T23:20:26.326308+0000","last_became_active":"2024-09-11T23:20:25.322142+0000","last_became_peered":"2024-09-11T23:20:25.322142+0000","last_unstale":"2024-09-11T23:20:26.326308+0000","last_undegraded":"2024-09-11T23:20:26.326308+0000","last_fullsized":"2024-09-11T23:20:26.326308+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:59.264343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591522+0000","last_change":"2024-09-11T23:20:25.318916+0000","last_active":"2024-09-11T23:20:26.591522+0000","last_peered":"2024-09-11T23:20:26.591522+0000","last_clean":"2024-09-11T23:20:26.591522+0000","last_became_active":"2024-09-11T23:20:25.318581+0000","last_became_peered":"2024-09-11T23:20:25.318581+0000","last_unstale":"2024-09-11T23:20:26.591522+0000","last_undegraded":"2024-09-11T23:20:26.591522+0000","last_fullsized":"2024-09-11T23:20:26.591522+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:55.823157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592853+0000","last_change":"2024-09-11T23:20:25.340037+0000","last_active":"2024-09-11T23:20:26.592853+0000","last_peered":"2024-09-11T23:20:26.592853+0000","last_clean":"2024-09-11T23:20:26.592853+0000","last_became_active":"2024-09-11T23:20:25.339767+0000","last_became_peered":"2024-09-11T23:20:25.339767+0000","last_unstale":"2024-09-11T23:20:26.592853+0000","last_undegraded":"2024-09-11T23:20:26.592853+0000","last_fullsized":"2024-09-11T23:20:26.592853+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286765+0000","last_change":"2024-09-11T23:20:25.301631+0000","last_active":"2024-09-11T23:20:26.286765+0000","last_peered":"2024-09-11T23:20:26.286765+0000","last_clean":"2024-09-11T23:20:26.286765+0000","last_became_active":"2024-09-11T23:20:25.300906+0000","last_became_peered":"2024-09-11T23:20:25.300906+0000","last_unstale":"2024-09-11T23:20:26.286765+0000","last_undegraded":"2024-09-11T23:20:26.286765+0000","last_fullsized":"2024-09-11T23:20:26.286765+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:36.538610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.325877+0000","last_change":"2024-09-11T23:20:25.311615+0000","last_active":"2024-09-11T23:20:26.325877+0000","last_peered":"2024-09-11T23:20:26.325877+0000","last_clean":"2024-09-11T23:20:26.325877+0000","last_became_active":"2024-09-11T23:20:25.311154+0000","last_became_peered":"2024-09-11T23:20:25.311154+0000","last_unstale":"2024-09-11T23:20:26.325877+0000","last_undegraded":"2024-09-11T23:20:26.325877+0000","last_fullsized":"2024-09-11T23:20:26.325877+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:49.475263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592585+0000","last_change":"2024-09-11T23:20:25.319609+0000","last_active":"2024-09-11T23:20:26.592585+0000","last_peered":"2024-09-11T23:20:26.592585+0000","last_clean":"2024-09-11T23:20:26.592585+0000","last_became_active":"2024-09-11T23:20:25.319342+0000","last_became_peered":"2024-09-11T23:20:25.319342+0000","last_unstale":"2024-09-11T23:20:26.592585+0000","last_undegraded":"2024-09-11T23:20:26.592585+0000","last_fullsized":"2024-09-11T23:20:26.592585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:35.647557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593363+0000","last_change":"2024-09-11T23:20:25.319222+0000","last_active":"2024-09-11T23:20:26.593363+0000","last_peered":"2024-09-11T23:20:26.593363+0000","last_clean":"2024-09-11T23:20:26.593363+0000","last_became_active":"2024-09-11T23:20:25.316553+0000","last_became_peered":"2024-09-11T23:20:25.316553+0000","last_unstale":"2024-09-11T23:20:26.593363+0000","last_undegraded":"2024-09-11T23:20:26.593363+0000","last_fullsized":"2024-09-11T23:20:26.593363+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:36.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324229+0000","last_change":"2024-09-11T23:20:25.341038+0000","last_active":"2024-09-11T23:20:26.324229+0000","last_peered":"2024-09-11T23:20:26.324229+0000","last_clean":"2024-09-11T23:20:26.324229+0000","last_became_active":"2024-09-11T23:20:25.340252+0000","last_became_peered":"2024-09-11T23:20:25.340252+0000","last_unstale":"2024-09-11T23:20:26.324229+0000","last_undegraded":"2024-09-11T23:20:26.324229+0000","last_fullsized":"2024-09-11T23:20:26.324229+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:30.984388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.282896+0000","last_change":"2024-09-11T23:20:25.308683+0000","last_active":"2024-09-11T23:20:26.282896+0000","last_peered":"2024-09-11T23:20:26.282896+0000","last_clean":"2024-09-11T23:20:26.282896+0000","last_became_active":"2024-09-11T23:20:25.307964+0000","last_became_peered":"2024-09-11T23:20:25.307964+0000","last_unstale":"2024-09-11T23:20:26.282896+0000","last_undegraded":"2024-09-11T23:20:26.282896+0000","last_fullsized":"2024-09-11T23:20:26.282896+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:20.229989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593385+0000","last_change":"2024-09-11T23:20:25.338500+0000","last_active":"2024-09-11T23:20:26.593385+0000","last_peered":"2024-09-11T23:20:26.593385+0000","last_clean":"2024-09-11T23:20:26.593385+0000","last_became_active":"2024-09-11T23:20:25.337803+0000","last_became_peered":"2024-09-11T23:20:25.337803+0000","last_unstale":"2024-09-11T23:20:26.593385+0000","last_undegraded":"2024-09-11T23:20:26.593385+0000","last_fullsized":"2024-09-11T23:20:26.593385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287537+0000","last_change":"2024-09-11T23:20:25.303298+0000","last_active":"2024-09-11T23:20:26.287537+0000","last_peered":"2024-09-11T23:20:26.287537+0000","last_clean":"2024-09-11T23:20:26.287537+0000","last_became_active":"2024-09-11T23:20:25.302526+0000","last_became_peered":"2024-09-11T23:20:25.302526+0000","last_unstale":"2024-09-11T23:20:26.287537+0000","last_undegraded":"2024-09-11T23:20:26.287537+0000","last_fullsized":"2024-09-11T23:20:26.287537+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:39.862640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593201+0000","last_change":"2024-09-11T23:20:25.334273+0000","last_active":"2024-09-11T23:20:26.593201+0000","last_peered":"2024-09-11T23:20:26.593201+0000","last_clean":"2024-09-11T23:20:26.593201+0000","last_became_active":"2024-09-11T23:20:25.330848+0000","last_became_peered":"2024-09-11T23:20:25.330848+0000","last_unstale":"2024-09-11T23:20:26.593201+0000","last_undegraded":"2024-09-11T23:20:26.593201+0000","last_fullsized":"2024-09-11T23:20:26.593201+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:55.823157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.285270+0000","last_change":"2024-09-11T23:20:25.348875+0000","last_active":"2024-09-11T23:20:26.285270+0000","last_peered":"2024-09-11T23:20:26.285270+0000","last_clean":"2024-09-11T23:20:26.285270+0000","last_became_active":"2024-09-11T23:20:25.348294+0000","last_became_peered":"2024-09-11T23:20:25.348294+0000","last_unstale":"2024-09-11T23:20:26.285270+0000","last_undegraded":"2024-09-11T23:20:26.285270+0000","last_fullsized":"2024-09-11T23:20:26.285270+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:19.670650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286608+0000","last_change":"2024-09-11T23:20:25.306762+0000","last_active":"2024-09-11T23:20:26.286608+0000","last_peered":"2024-09-11T23:20:26.286608+0000","last_clean":"2024-09-11T23:20:26.286608+0000","last_became_active":"2024-09-11T23:20:25.304668+0000","last_became_peered":"2024-09-11T23:20:25.304668+0000","last_unstale":"2024-09-11T23:20:26.286608+0000","last_undegraded":"2024-09-11T23:20:26.286608+0000","last_fullsized":"2024-09-11T23:20:26.286608+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283207+0000","last_change":"2024-09-11T23:20:25.310091+0000","last_active":"2024-09-11T23:20:26.283207+0000","last_peered":"2024-09-11T23:20:26.283207+0000","last_clean":"2024-09-11T23:20:26.283207+0000","last_became_active":"2024-09-11T23:20:25.309309+0000","last_became_peered":"2024-09-11T23:20:25.309309+0000","last_unstale":"2024-09-11T23:20:26.283207+0000","last_undegraded":"2024-09-11T23:20:26.283207+0000","last_fullsized":"2024-09-11T23:20:26.283207+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:07.039814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324322+0000","last_change":"2024-09-11T23:20:25.340838+0000","last_active":"2024-09-11T23:20:26.324322+0000","last_peered":"2024-09-11T23:20:26.324322+0000","last_clean":"2024-09-11T23:20:26.324322+0000","last_became_active":"2024-09-11T23:20:25.340266+0000","last_became_peered":"2024-09-11T23:20:25.340266+0000","last_unstale":"2024-09-11T23:20:26.324322+0000","last_undegraded":"2024-09-11T23:20:26.324322+0000","last_fullsized":"2024-09-11T23:20:26.324322+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:19.670650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326306+0000","last_change":"2024-09-11T23:20:25.322913+0000","last_active":"2024-09-11T23:20:26.326306+0000","last_peered":"2024-09-11T23:20:26.326306+0000","last_clean":"2024-09-11T23:20:26.326306+0000","last_became_active":"2024-09-11T23:20:25.322547+0000","last_became_peered":"2024-09-11T23:20:25.322547+0000","last_unstale":"2024-09-11T23:20:26.326306+0000","last_undegraded":"2024-09-11T23:20:26.326306+0000","last_fullsized":"2024-09-11T23:20:26.326306+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:08.845784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283717+0000","last_change":"2024-09-11T23:20:25.297162+0000","last_active":"2024-09-11T23:20:26.283717+0000","last_peered":"2024-09-11T23:20:26.283717+0000","last_clean":"2024-09-11T23:20:26.283717+0000","last_became_active":"2024-09-11T23:20:25.296386+0000","last_became_peered":"2024-09-11T23:20:25.296386+0000","last_unstale":"2024-09-11T23:20:26.283717+0000","last_undegraded":"2024-09-11T23:20:26.283717+0000","last_fullsized":"2024-09-11T23:20:26.283717+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:04.497387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593012+0000","last_change":"2024-09-11T23:20:25.312293+0000","last_active":"2024-09-11T23:20:26.593012+0000","last_peered":"2024-09-11T23:20:26.593012+0000","last_clean":"2024-09-11T23:20:26.593012+0000","last_became_active":"2024-09-11T23:20:25.305123+0000","last_became_peered":"2024-09-11T23:20:25.305123+0000","last_unstale":"2024-09-11T23:20:26.593012+0000","last_undegraded":"2024-09-11T23:20:26.593012+0000","last_fullsized":"2024-09-11T23:20:26.593012+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:35.647557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.285755+0000","last_change":"2024-09-11T23:20:25.304278+0000","last_active":"2024-09-11T23:20:26.285755+0000","last_peered":"2024-09-11T23:20:26.285755+0000","last_clean":"2024-09-11T23:20:26.285755+0000","last_became_active":"2024-09-11T23:20:25.303381+0000","last_became_peered":"2024-09-11T23:20:25.303381+0000","last_unstale":"2024-09-11T23:20:26.285755+0000","last_undegraded":"2024-09-11T23:20:26.285755+0000","last_fullsized":"2024-09-11T23:20:26.285755+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:38.777308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286065+0000","last_change":"2024-09-11T23:20:25.331863+0000","last_active":"2024-09-11T23:20:26.286065+0000","last_peered":"2024-09-11T23:20:26.286065+0000","last_clean":"2024-09-11T23:20:26.286065+0000","last_became_active":"2024-09-11T23:20:25.331287+0000","last_became_peered":"2024-09-11T23:20:25.331287+0000","last_unstale":"2024-09-11T23:20:26.286065+0000","last_undegraded":"2024-09-11T23:20:26.286065+0000","last_fullsized":"2024-09-11T23:20:26.286065+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:51.757400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591766+0000","last_change":"2024-09-11T23:20:25.313643+0000","last_active":"2024-09-11T23:20:26.591766+0000","last_peered":"2024-09-11T23:20:26.591766+0000","last_clean":"2024-09-11T23:20:26.591766+0000","last_became_active":"2024-09-11T23:20:25.313301+0000","last_became_peered":"2024-09-11T23:20:25.313301+0000","last_unstale":"2024-09-11T23:20:26.591766+0000","last_undegraded":"2024-09-11T23:20:26.591766+0000","last_fullsized":"2024-09-11T23:20:26.591766+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"114'4","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324129+0000","last_change":"2024-09-11T23:20:24.336885+0000","last_active":"2024-09-11T23:20:26.324129+0000","last_peered":"2024-09-11T23:20:26.324129+0000","last_clean":"2024-09-11T23:20:26.324129+0000","last_became_active":"2024-09-11T23:20:24.335281+0000","last_became_peered":"2024-09-11T23:20:24.335281+0000","last_unstale":"2024-09-11T23:20:26.324129+0000","last_undegraded":"2024-09-11T23:20:26.324129+0000","last_fullsized":"2024-09-11T23:20:26.324129+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326315+0000","last_change":"2024-09-11T23:20:25.308448+0000","last_active":"2024-09-11T23:20:26.326315+0000","last_peered":"2024-09-11T23:20:26.326315+0000","last_clean":"2024-09-11T23:20:26.326315+0000","last_became_active":"2024-09-11T23:20:25.306542+0000","last_became_peered":"2024-09-11T23:20:25.306542+0000","last_unstale":"2024-09-11T23:20:26.326315+0000","last_undegraded":"2024-09-11T23:20:26.326315+0000","last_fullsized":"2024-09-11T23:20:26.326315+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:04.203132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592381+0000","last_change":"2024-09-11T23:20:24.312843+0000","last_active":"2024-09-11T23:20:26.592381+0000","last_peered":"2024-09-11T23:20:26.592381+0000","last_clean":"2024-09-11T23:20:26.592381+0000","last_became_active":"2024-09-11T23:20:24.312460+0000","last_became_peered":"2024-09-11T23:20:24.312460+0000","last_unstale":"2024-09-11T23:20:26.592381+0000","last_undegraded":"2024-09-11T23:20:26.592381+0000","last_fullsized":"2024-09-11T23:20:26.592381+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286290+0000","last_change":"2024-09-11T23:20:25.309845+0000","last_active":"2024-09-11T23:20:26.286290+0000","last_peered":"2024-09-11T23:20:26.286290+0000","last_clean":"2024-09-11T23:20:26.286290+0000","last_became_active":"2024-09-11T23:20:25.309112+0000","last_became_peered":"2024-09-11T23:20:25.309112+0000","last_unstale":"2024-09-11T23:20:26.286290+0000","last_undegraded":"2024-09-11T23:20:26.286290+0000","last_fullsized":"2024-09-11T23:20:26.286290+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:55.823157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593964+0000","last_change":"2024-09-11T23:20:24.329199+0000","last_active":"2024-09-11T23:20:26.593964+0000","last_peered":"2024-09-11T23:20:26.593964+0000","last_clean":"2024-09-11T23:20:26.593964+0000","last_became_active":"2024-09-11T23:20:24.328429+0000","last_became_peered":"2024-09-11T23:20:24.328429+0000","last_unstale":"2024-09-11T23:20:26.593964+0000","last_undegraded":"2024-09-11T23:20:26.593964+0000","last_fullsized":"2024-09-11T23:20:26.593964+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.171149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594321+0000","last_change":"2024-09-11T23:20:25.346528+0000","last_active":"2024-09-11T23:20:26.594321+0000","last_peered":"2024-09-11T23:20:26.594321+0000","last_clean":"2024-09-11T23:20:26.594321+0000","last_became_active":"2024-09-11T23:20:25.345934+0000","last_became_peered":"2024-09-11T23:20:25.345934+0000","last_unstale":"2024-09-11T23:20:26.594321+0000","last_undegraded":"2024-09-11T23:20:26.594321+0000","last_fullsized":"2024-09-11T23:20:26.594321+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:35.647557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591625+0000","last_change":"2024-09-11T23:20:24.318079+0000","last_active":"2024-09-11T23:20:26.591625+0000","last_peered":"2024-09-11T23:20:26.591625+0000","last_clean":"2024-09-11T23:20:26.591625+0000","last_became_active":"2024-09-11T23:20:24.317685+0000","last_became_peered":"2024-09-11T23:20:24.317685+0000","last_unstale":"2024-09-11T23:20:26.591625+0000","last_undegraded":"2024-09-11T23:20:26.591625+0000","last_fullsized":"2024-09-11T23:20:26.591625+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591215+0000","last_change":"2024-09-11T23:20:25.347038+0000","last_active":"2024-09-11T23:20:26.591215+0000","last_peered":"2024-09-11T23:20:26.591215+0000","last_clean":"2024-09-11T23:20:26.591215+0000","last_became_active":"2024-09-11T23:20:25.346743+0000","last_became_peered":"2024-09-11T23:20:25.346743+0000","last_unstale":"2024-09-11T23:20:26.591215+0000","last_undegraded":"2024-09-11T23:20:26.591215+0000","last_fullsized":"2024-09-11T23:20:26.591215+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:51.757400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287480+0000","last_change":"2024-09-11T23:20:24.321198+0000","last_active":"2024-09-11T23:20:26.287480+0000","last_peered":"2024-09-11T23:20:26.287480+0000","last_clean":"2024-09-11T23:20:26.287480+0000","last_became_active":"2024-09-11T23:20:24.319866+0000","last_became_peered":"2024-09-11T23:20:24.319866+0000","last_unstale":"2024-09-11T23:20:26.287480+0000","last_undegraded":"2024-09-11T23:20:26.287480+0000","last_fullsized":"2024-09-11T23:20:26.287480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:10.900422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286870+0000","last_change":"2024-09-11T23:20:25.323711+0000","last_active":"2024-09-11T23:20:26.286870+0000","last_peered":"2024-09-11T23:20:26.286870+0000","last_clean":"2024-09-11T23:20:26.286870+0000","last_became_active":"2024-09-11T23:20:25.322913+0000","last_became_peered":"2024-09-11T23:20:25.322913+0000","last_unstale":"2024-09-11T23:20:26.286870+0000","last_undegraded":"2024-09-11T23:20:26.286870+0000","last_fullsized":"2024-09-11T23:20:26.286870+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:25.186380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326035+0000","last_change":"2024-09-11T23:20:24.328879+0000","last_active":"2024-09-11T23:20:26.326035+0000","last_peered":"2024-09-11T23:20:26.326035+0000","last_clean":"2024-09-11T23:20:26.326035+0000","last_became_active":"2024-09-11T23:20:24.328466+0000","last_became_peered":"2024-09-11T23:20:24.328466+0000","last_unstale":"2024-09-11T23:20:26.326035+0000","last_undegraded":"2024-09-11T23:20:26.326035+0000","last_fullsized":"2024-09-11T23:20:26.326035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:32:35.192418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593248+0000","last_change":"2024-09-11T23:20:25.313043+0000","last_active":"2024-09-11T23:20:26.593248+0000","last_peered":"2024-09-11T23:20:26.593248+0000","last_clean":"2024-09-11T23:20:26.593248+0000","last_became_active":"2024-09-11T23:20:25.312668+0000","last_became_peered":"2024-09-11T23:20:25.312668+0000","last_unstale":"2024-09-11T23:20:26.593248+0000","last_undegraded":"2024-09-11T23:20:26.593248+0000","last_fullsized":"2024-09-11T23:20:26.593248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:16.851251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286093+0000","last_change":"2024-09-11T23:20:24.335809+0000","last_active":"2024-09-11T23:20:26.286093+0000","last_peered":"2024-09-11T23:20:26.286093+0000","last_clean":"2024-09-11T23:20:26.286093+0000","last_became_active":"2024-09-11T23:20:24.335159+0000","last_became_peered":"2024-09-11T23:20:24.335159+0000","last_unstale":"2024-09-11T23:20:26.286093+0000","last_undegraded":"2024-09-11T23:20:26.286093+0000","last_fullsized":"2024-09-11T23:20:26.286093+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:42.220068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591866+0000","last_change":"2024-09-11T23:20:25.327091+0000","last_active":"2024-09-11T23:20:26.591866+0000","last_peered":"2024-09-11T23:20:26.591866+0000","last_clean":"2024-09-11T23:20:26.591866+0000","last_became_active":"2024-09-11T23:20:25.326537+0000","last_became_peered":"2024-09-11T23:20:25.326537+0000","last_unstale":"2024-09-11T23:20:26.591866+0000","last_undegraded":"2024-09-11T23:20:26.591866+0000","last_fullsized":"2024-09-11T23:20:26.591866+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326095+0000","last_change":"2024-09-11T23:20:24.328226+0000","last_active":"2024-09-11T23:20:26.326095+0000","last_peered":"2024-09-11T23:20:26.326095+0000","last_clean":"2024-09-11T23:20:26.326095+0000","last_became_active":"2024-09-11T23:20:24.324666+0000","last_became_peered":"2024-09-11T23:20:24.324666+0000","last_unstale":"2024-09-11T23:20:26.326095+0000","last_undegraded":"2024-09-11T23:20:26.326095+0000","last_fullsized":"2024-09-11T23:20:26.326095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.138658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.323920+0000","last_change":"2024-09-11T23:20:25.340398+0000","last_active":"2024-09-11T23:20:26.323920+0000","last_peered":"2024-09-11T23:20:26.323920+0000","last_clean":"2024-09-11T23:20:26.323920+0000","last_became_active":"2024-09-11T23:20:25.339724+0000","last_became_peered":"2024-09-11T23:20:25.339724+0000","last_unstale":"2024-09-11T23:20:26.323920+0000","last_undegraded":"2024-09-11T23:20:26.323920+0000","last_fullsized":"2024-09-11T23:20:26.323920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:29.365172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324500+0000","last_change":"2024-09-11T23:20:24.335950+0000","last_active":"2024-09-11T23:20:26.324500+0000","last_peered":"2024-09-11T23:20:26.324500+0000","last_clean":"2024-09-11T23:20:26.324500+0000","last_became_active":"2024-09-11T23:20:24.334265+0000","last_became_peered":"2024-09-11T23:20:24.334265+0000","last_unstale":"2024-09-11T23:20:26.324500+0000","last_undegraded":"2024-09-11T23:20:26.324500+0000","last_fullsized":"2024-09-11T23:20:26.324500+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286835+0000","last_change":"2024-09-11T23:20:25.317145+0000","last_active":"2024-09-11T23:20:26.286835+0000","last_peered":"2024-09-11T23:20:26.286835+0000","last_clean":"2024-09-11T23:20:26.286835+0000","last_became_active":"2024-09-11T23:20:25.316404+0000","last_became_peered":"2024-09-11T23:20:25.316404+0000","last_unstale":"2024-09-11T23:20:26.286835+0000","last_undegraded":"2024-09-11T23:20:26.286835+0000","last_fullsized":"2024-09-11T23:20:26.286835+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286423+0000","last_change":"2024-09-11T23:20:24.316838+0000","last_active":"2024-09-11T23:20:26.286423+0000","last_peered":"2024-09-11T23:20:26.286423+0000","last_clean":"2024-09-11T23:20:26.286423+0000","last_became_active":"2024-09-11T23:20:24.316218+0000","last_became_peered":"2024-09-11T23:20:24.316218+0000","last_unstale":"2024-09-11T23:20:26.286423+0000","last_undegraded":"2024-09-11T23:20:26.286423+0000","last_fullsized":"2024-09-11T23:20:26.286423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:23.130902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593386+0000","last_change":"2024-09-11T23:20:25.340378+0000","last_active":"2024-09-11T23:20:26.593386+0000","last_peered":"2024-09-11T23:20:26.593386+0000","last_clean":"2024-09-11T23:20:26.593386+0000","last_became_active":"2024-09-11T23:20:25.340113+0000","last_became_peered":"2024-09-11T23:20:25.340113+0000","last_unstale":"2024-09-11T23:20:26.593386+0000","last_undegraded":"2024-09-11T23:20:26.593386+0000","last_fullsized":"2024-09-11T23:20:26.593386+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:47.047859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"114'3","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286232+0000","last_change":"2024-09-11T23:20:24.330061+0000","last_active":"2024-09-11T23:20:26.286232+0000","last_peered":"2024-09-11T23:20:26.286232+0000","last_clean":"2024-09-11T23:20:26.286232+0000","last_became_active":"2024-09-11T23:20:24.329016+0000","last_became_peered":"2024-09-11T23:20:24.329016+0000","last_unstale":"2024-09-11T23:20:26.286232+0000","last_undegraded":"2024-09-11T23:20:26.286232+0000","last_fullsized":"2024-09-11T23:20:26.286232+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:28.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286434+0000","last_change":"2024-09-11T23:20:25.303854+0000","last_active":"2024-09-11T23:20:26.286434+0000","last_peered":"2024-09-11T23:20:26.286434+0000","last_clean":"2024-09-11T23:20:26.286434+0000","last_became_active":"2024-09-11T23:20:25.303076+0000","last_became_peered":"2024-09-11T23:20:25.303076+0000","last_unstale":"2024-09-11T23:20:26.286434+0000","last_undegraded":"2024-09-11T23:20:26.286434+0000","last_fullsized":"2024-09-11T23:20:26.286434+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:06.072747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"114'6","reported_seq":20,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592650+0000","last_change":"2024-09-11T23:20:24.317388+0000","last_active":"2024-09-11T23:20:26.592650+0000","last_peered":"2024-09-11T23:20:26.592650+0000","last_clean":"2024-09-11T23:20:26.592650+0000","last_became_active":"2024-09-11T23:20:24.315496+0000","last_became_peered":"2024-09-11T23:20:24.315496+0000","last_unstale":"2024-09-11T23:20:26.592650+0000","last_undegraded":"2024-09-11T23:20:26.592650+0000","last_fullsized":"2024-09-11T23:20:26.592650+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324983+0000","last_change":"2024-09-11T23:20:25.348157+0000","last_active":"2024-09-11T23:20:26.324983+0000","last_peered":"2024-09-11T23:20:26.324983+0000","last_clean":"2024-09-11T23:20:26.324983+0000","last_became_active":"2024-09-11T23:20:25.347452+0000","last_became_peered":"2024-09-11T23:20:25.347452+0000","last_unstale":"2024-09-11T23:20:26.324983+0000","last_undegraded":"2024-09-11T23:20:26.324983+0000","last_fullsized":"2024-09-11T23:20:26.324983+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:17.227664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592857+0000","last_change":"2024-09-11T23:20:24.320638+0000","last_active":"2024-09-11T23:20:26.592857+0000","last_peered":"2024-09-11T23:20:26.592857+0000","last_clean":"2024-09-11T23:20:26.592857+0000","last_became_active":"2024-09-11T23:20:24.320392+0000","last_became_peered":"2024-09-11T23:20:24.320392+0000","last_unstale":"2024-09-11T23:20:26.592857+0000","last_undegraded":"2024-09-11T23:20:26.592857+0000","last_fullsized":"2024-09-11T23:20:26.592857+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591300+0000","last_change":"2024-09-11T23:20:25.338671+0000","last_active":"2024-09-11T23:20:26.591300+0000","last_peered":"2024-09-11T23:20:26.591300+0000","last_clean":"2024-09-11T23:20:26.591300+0000","last_became_active":"2024-09-11T23:20:25.338378+0000","last_became_peered":"2024-09-11T23:20:25.338378+0000","last_unstale":"2024-09-11T23:20:26.591300+0000","last_undegraded":"2024-09-11T23:20:26.591300+0000","last_fullsized":"2024-09-11T23:20:26.591300+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593504+0000","last_change":"2024-09-11T23:20:24.313002+0000","last_active":"2024-09-11T23:20:26.593504+0000","last_peered":"2024-09-11T23:20:26.593504+0000","last_clean":"2024-09-11T23:20:26.593504+0000","last_became_active":"2024-09-11T23:20:24.312668+0000","last_became_peered":"2024-09-11T23:20:24.312668+0000","last_unstale":"2024-09-11T23:20:26.593504+0000","last_undegraded":"2024-09-11T23:20:26.593504+0000","last_fullsized":"2024-09-11T23:20:26.593504+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:35.523378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283543+0000","last_change":"2024-09-11T23:20:25.301773+0000","last_active":"2024-09-11T23:20:26.283543+0000","last_peered":"2024-09-11T23:20:26.283543+0000","last_clean":"2024-09-11T23:20:26.283543+0000","last_became_active":"2024-09-11T23:20:25.300990+0000","last_became_peered":"2024-09-11T23:20:25.300990+0000","last_unstale":"2024-09-11T23:20:26.283543+0000","last_undegraded":"2024-09-11T23:20:26.283543+0000","last_fullsized":"2024-09-11T23:20:26.283543+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:12.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592854+0000","last_change":"2024-09-11T23:20:24.315901+0000","last_active":"2024-09-11T23:20:26.592854+0000","last_peered":"2024-09-11T23:20:26.592854+0000","last_clean":"2024-09-11T23:20:26.592854+0000","last_became_active":"2024-09-11T23:20:24.315123+0000","last_became_peered":"2024-09-11T23:20:24.315123+0000","last_unstale":"2024-09-11T23:20:26.592854+0000","last_undegraded":"2024-09-11T23:20:26.592854+0000","last_fullsized":"2024-09-11T23:20:26.592854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:53.595358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286131+0000","last_change":"2024-09-11T23:20:25.309755+0000","last_active":"2024-09-11T23:20:26.286131+0000","last_peered":"2024-09-11T23:20:26.286131+0000","last_clean":"2024-09-11T23:20:26.286131+0000","last_became_active":"2024-09-11T23:20:25.309032+0000","last_became_peered":"2024-09-11T23:20:25.309032+0000","last_unstale":"2024-09-11T23:20:26.286131+0000","last_undegraded":"2024-09-11T23:20:26.286131+0000","last_fullsized":"2024-09-11T23:20:26.286131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592851+0000","last_change":"2024-09-11T23:20:24.329817+0000","last_active":"2024-09-11T23:20:26.592851+0000","last_peered":"2024-09-11T23:20:26.592851+0000","last_clean":"2024-09-11T23:20:26.592851+0000","last_became_active":"2024-09-11T23:20:24.329513+0000","last_became_peered":"2024-09-11T23:20:24.329513+0000","last_unstale":"2024-09-11T23:20:26.592851+0000","last_undegraded":"2024-09-11T23:20:26.592851+0000","last_fullsized":"2024-09-11T23:20:26.592851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.288141+0000","last_change":"2024-09-11T23:20:25.304672+0000","last_active":"2024-09-11T23:20:26.288141+0000","last_peered":"2024-09-11T23:20:26.288141+0000","last_clean":"2024-09-11T23:20:26.288141+0000","last_became_active":"2024-09-11T23:20:25.303962+0000","last_became_peered":"2024-09-11T23:20:25.303962+0000","last_unstale":"2024-09-11T23:20:26.288141+0000","last_undegraded":"2024-09-11T23:20:26.288141+0000","last_fullsized":"2024-09-11T23:20:26.288141+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:29.365172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283384+0000","last_change":"2024-09-11T23:20:24.315026+0000","last_active":"2024-09-11T23:20:26.283384+0000","last_peered":"2024-09-11T23:20:26.283384+0000","last_clean":"2024-09-11T23:20:26.283384+0000","last_became_active":"2024-09-11T23:20:24.314637+0000","last_became_peered":"2024-09-11T23:20:24.314637+0000","last_unstale":"2024-09-11T23:20:26.283384+0000","last_undegraded":"2024-09-11T23:20:26.283384+0000","last_fullsized":"2024-09-11T23:20:26.283384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:06.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326292+0000","last_change":"2024-09-11T23:20:25.339896+0000","last_active":"2024-09-11T23:20:26.326292+0000","last_peered":"2024-09-11T23:20:26.326292+0000","last_clean":"2024-09-11T23:20:26.326292+0000","last_became_active":"2024-09-11T23:20:25.339621+0000","last_became_peered":"2024-09-11T23:20:25.339621+0000","last_unstale":"2024-09-11T23:20:26.326292+0000","last_undegraded":"2024-09-11T23:20:26.326292+0000","last_fullsized":"2024-09-11T23:20:26.326292+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:09.855814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594044+0000","last_change":"2024-09-11T23:20:24.332075+0000","last_active":"2024-09-11T23:20:26.594044+0000","last_peered":"2024-09-11T23:20:26.594044+0000","last_clean":"2024-09-11T23:20:26.594044+0000","last_became_active":"2024-09-11T23:20:24.331358+0000","last_became_peered":"2024-09-11T23:20:24.331358+0000","last_unstale":"2024-09-11T23:20:26.594044+0000","last_undegraded":"2024-09-11T23:20:26.594044+0000","last_fullsized":"2024-09-11T23:20:26.594044+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:35.523378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286789+0000","last_change":"2024-09-11T23:20:25.320216+0000","last_active":"2024-09-11T23:20:26.286789+0000","last_peered":"2024-09-11T23:20:26.286789+0000","last_clean":"2024-09-11T23:20:26.286789+0000","last_became_active":"2024-09-11T23:20:25.319503+0000","last_became_peered":"2024-09-11T23:20:25.319503+0000","last_unstale":"2024-09-11T23:20:26.286789+0000","last_undegraded":"2024-09-11T23:20:26.286789+0000","last_fullsized":"2024-09-11T23:20:26.286789+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593594+0000","last_change":"2024-09-11T23:20:24.335490+0000","last_active":"2024-09-11T23:20:26.593594+0000","last_peered":"2024-09-11T23:20:26.593594+0000","last_clean":"2024-09-11T23:20:26.593594+0000","last_became_active":"2024-09-11T23:20:24.334640+0000","last_became_peered":"2024-09-11T23:20:24.334640+0000","last_unstale":"2024-09-11T23:20:26.593594+0000","last_undegraded":"2024-09-11T23:20:26.593594+0000","last_fullsized":"2024-09-11T23:20:26.593594+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.325885+0000","last_change":"2024-09-11T23:20:25.339159+0000","last_active":"2024-09-11T23:20:26.325885+0000","last_peered":"2024-09-11T23:20:26.325885+0000","last_clean":"2024-09-11T23:20:26.325885+0000","last_became_active":"2024-09-11T23:20:25.338863+0000","last_became_peered":"2024-09-11T23:20:25.338863+0000","last_unstale":"2024-09-11T23:20:26.325885+0000","last_undegraded":"2024-09-11T23:20:26.325885+0000","last_fullsized":"2024-09-11T23:20:26.325885+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:08.352967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326032+0000","last_change":"2024-09-11T23:20:24.329407+0000","last_active":"2024-09-11T23:20:26.326032+0000","last_peered":"2024-09-11T23:20:26.326032+0000","last_clean":"2024-09-11T23:20:26.326032+0000","last_became_active":"2024-09-11T23:20:24.329085+0000","last_became_peered":"2024-09-11T23:20:24.329085+0000","last_unstale":"2024-09-11T23:20:26.326032+0000","last_undegraded":"2024-09-11T23:20:26.326032+0000","last_fullsized":"2024-09-11T23:20:26.326032+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:21:35.902330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592425+0000","last_change":"2024-09-11T23:20:25.313545+0000","last_active":"2024-09-11T23:20:26.592425+0000","last_peered":"2024-09-11T23:20:26.592425+0000","last_clean":"2024-09-11T23:20:26.592425+0000","last_became_active":"2024-09-11T23:20:25.312767+0000","last_became_peered":"2024-09-11T23:20:25.312767+0000","last_unstale":"2024-09-11T23:20:26.592425+0000","last_undegraded":"2024-09-11T23:20:26.592425+0000","last_fullsized":"2024-09-11T23:20:26.592425+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592909+0000","last_change":"2024-09-11T23:20:24.328751+0000","last_active":"2024-09-11T23:20:26.592909+0000","last_peered":"2024-09-11T23:20:26.592909+0000","last_clean":"2024-09-11T23:20:26.592909+0000","last_became_active":"2024-09-11T23:20:24.327979+0000","last_became_peered":"2024-09-11T23:20:24.327979+0000","last_unstale":"2024-09-11T23:20:26.592909+0000","last_undegraded":"2024-09-11T23:20:26.592909+0000","last_fullsized":"2024-09-11T23:20:26.592909+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593638+0000","last_change":"2024-09-11T23:20:25.329563+0000","last_active":"2024-09-11T23:20:26.593638+0000","last_peered":"2024-09-11T23:20:26.593638+0000","last_clean":"2024-09-11T23:20:26.593638+0000","last_became_active":"2024-09-11T23:20:25.329323+0000","last_became_peered":"2024-09-11T23:20:25.329323+0000","last_unstale":"2024-09-11T23:20:26.593638+0000","last_undegraded":"2024-09-11T23:20:26.593638+0000","last_fullsized":"2024-09-11T23:20:26.593638+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:24.491165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593158+0000","last_change":"2024-09-11T23:20:24.315984+0000","last_active":"2024-09-11T23:20:26.593158+0000","last_peered":"2024-09-11T23:20:26.593158+0000","last_clean":"2024-09-11T23:20:26.593158+0000","last_became_active":"2024-09-11T23:20:24.315560+0000","last_became_peered":"2024-09-11T23:20:24.315560+0000","last_unstale":"2024-09-11T23:20:26.593158+0000","last_undegraded":"2024-09-11T23:20:26.593158+0000","last_fullsized":"2024-09-11T23:20:26.593158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.285692+0000","last_change":"2024-09-11T23:20:25.304857+0000","last_active":"2024-09-11T23:20:26.285692+0000","last_peered":"2024-09-11T23:20:26.285692+0000","last_clean":"2024-09-11T23:20:26.285692+0000","last_became_active":"2024-09-11T23:20:25.302838+0000","last_became_peered":"2024-09-11T23:20:25.302838+0000","last_unstale":"2024-09-11T23:20:26.285692+0000","last_undegraded":"2024-09-11T23:20:26.285692+0000","last_fullsized":"2024-09-11T23:20:26.285692+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:17.227664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592738+0000","last_change":"2024-09-11T23:20:24.327068+0000","last_active":"2024-09-11T23:20:26.592738+0000","last_peered":"2024-09-11T23:20:26.592738+0000","last_clean":"2024-09-11T23:20:26.592738+0000","last_became_active":"2024-09-11T23:20:24.326400+0000","last_became_peered":"2024-09-11T23:20:24.326400+0000","last_unstale":"2024-09-11T23:20:26.592738+0000","last_undegraded":"2024-09-11T23:20:26.592738+0000","last_fullsized":"2024-09-11T23:20:26.592738+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326470+0000","last_change":"2024-09-11T23:20:25.310109+0000","last_active":"2024-09-11T23:20:26.326470+0000","last_peered":"2024-09-11T23:20:26.326470+0000","last_clean":"2024-09-11T23:20:26.326470+0000","last_became_active":"2024-09-11T23:20:25.309368+0000","last_became_peered":"2024-09-11T23:20:25.309368+0000","last_unstale":"2024-09-11T23:20:26.326470+0000","last_undegraded":"2024-09-11T23:20:26.326470+0000","last_fullsized":"2024-09-11T23:20:26.326470+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:10.140672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326460+0000","last_change":"2024-09-11T23:20:24.333009+0000","last_active":"2024-09-11T23:20:26.326460+0000","last_peered":"2024-09-11T23:20:26.326460+0000","last_clean":"2024-09-11T23:20:26.326460+0000","last_became_active":"2024-09-11T23:20:24.332693+0000","last_became_peered":"2024-09-11T23:20:24.332693+0000","last_unstale":"2024-09-11T23:20:26.326460+0000","last_undegraded":"2024-09-11T23:20:26.326460+0000","last_fullsized":"2024-09-11T23:20:26.326460+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:01.570200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591523+0000","last_change":"2024-09-11T23:20:25.347070+0000","last_active":"2024-09-11T23:20:26.591523+0000","last_peered":"2024-09-11T23:20:26.591523+0000","last_clean":"2024-09-11T23:20:26.591523+0000","last_became_active":"2024-09-11T23:20:25.346721+0000","last_became_peered":"2024-09-11T23:20:25.346721+0000","last_unstale":"2024-09-11T23:20:26.591523+0000","last_undegraded":"2024-09-11T23:20:26.591523+0000","last_fullsized":"2024-09-11T23:20:26.591523+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:06.072747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"115'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326491+0000","last_change":"2024-09-11T23:20:24.337900+0000","last_active":"2024-09-11T23:20:26.326491+0000","last_peered":"2024-09-11T23:20:26.326491+0000","last_clean":"2024-09-11T23:20:26.326491+0000","last_became_active":"2024-09-11T23:20:24.337161+0000","last_became_peered":"2024-09-11T23:20:24.337161+0000","last_unstale":"2024-09-11T23:20:26.326491+0000","last_undegraded":"2024-09-11T23:20:26.326491+0000","last_fullsized":"2024-09-11T23:20:26.326491+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594058+0000","last_change":"2024-09-11T23:20:25.345508+0000","last_active":"2024-09-11T23:20:26.594058+0000","last_peered":"2024-09-11T23:20:26.594058+0000","last_clean":"2024-09-11T23:20:26.594058+0000","last_became_active":"2024-09-11T23:20:25.334570+0000","last_became_peered":"2024-09-11T23:20:25.334570+0000","last_unstale":"2024-09-11T23:20:26.594058+0000","last_undegraded":"2024-09-11T23:20:26.594058+0000","last_fullsized":"2024-09-11T23:20:26.594058+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324474+0000","last_change":"2024-09-11T23:20:24.338421+0000","last_active":"2024-09-11T23:20:26.324474+0000","last_peered":"2024-09-11T23:20:26.324474+0000","last_clean":"2024-09-11T23:20:26.324474+0000","last_became_active":"2024-09-11T23:20:24.337643+0000","last_became_peered":"2024-09-11T23:20:24.337643+0000","last_unstale":"2024-09-11T23:20:26.324474+0000","last_undegraded":"2024-09-11T23:20:26.324474+0000","last_fullsized":"2024-09-11T23:20:26.324474+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:53.595358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283586+0000","last_change":"2024-09-11T23:20:25.299309+0000","last_active":"2024-09-11T23:20:26.283586+0000","last_peered":"2024-09-11T23:20:26.283586+0000","last_clean":"2024-09-11T23:20:26.283586+0000","last_became_active":"2024-09-11T23:20:25.297851+0000","last_became_peered":"2024-09-11T23:20:25.297851+0000","last_unstale":"2024-09-11T23:20:26.283586+0000","last_undegraded":"2024-09-11T23:20:26.283586+0000","last_fullsized":"2024-09-11T23:20:26.283586+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:17.479362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326477+0000","last_change":"2024-09-11T23:20:24.332815+0000","last_active":"2024-09-11T23:20:26.326477+0000","last_peered":"2024-09-11T23:20:26.326477+0000","last_clean":"2024-09-11T23:20:26.326477+0000","last_became_active":"2024-09-11T23:20:24.329061+0000","last_became_peered":"2024-09-11T23:20:24.329061+0000","last_unstale":"2024-09-11T23:20:26.326477+0000","last_undegraded":"2024-09-11T23:20:26.326477+0000","last_fullsized":"2024-09-11T23:20:26.326477+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:11.439818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326064+0000","last_change":"2024-09-11T23:20:25.306535+0000","last_active":"2024-09-11T23:20:26.326064+0000","last_peered":"2024-09-11T23:20:26.326064+0000","last_clean":"2024-09-11T23:20:26.326064+0000","last_became_active":"2024-09-11T23:20:25.305770+0000","last_became_peered":"2024-09-11T23:20:25.305770+0000","last_unstale":"2024-09-11T23:20:26.326064+0000","last_undegraded":"2024-09-11T23:20:26.326064+0000","last_fullsized":"2024-09-11T23:20:26.326064+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.434792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287672+0000","last_change":"2024-09-11T23:20:24.320586+0000","last_active":"2024-09-11T23:20:26.287672+0000","last_peered":"2024-09-11T23:20:26.287672+0000","last_clean":"2024-09-11T23:20:26.287672+0000","last_became_active":"2024-09-11T23:20:24.318863+0000","last_became_peered":"2024-09-11T23:20:24.318863+0000","last_unstale":"2024-09-11T23:20:26.287672+0000","last_undegraded":"2024-09-11T23:20:26.287672+0000","last_fullsized":"2024-09-11T23:20:26.287672+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:15.913501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593480+0000","last_change":"2024-09-11T23:20:25.340416+0000","last_active":"2024-09-11T23:20:26.593480+0000","last_peered":"2024-09-11T23:20:26.593480+0000","last_clean":"2024-09-11T23:20:26.593480+0000","last_became_active":"2024-09-11T23:20:25.340059+0000","last_became_peered":"2024-09-11T23:20:25.340059+0000","last_unstale":"2024-09-11T23:20:26.593480+0000","last_undegraded":"2024-09-11T23:20:26.593480+0000","last_fullsized":"2024-09-11T23:20:26.593480+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:09.498560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287454+0000","last_change":"2024-09-11T23:20:24.326408+0000","last_active":"2024-09-11T23:20:26.287454+0000","last_peered":"2024-09-11T23:20:26.287454+0000","last_clean":"2024-09-11T23:20:26.287454+0000","last_became_active":"2024-09-11T23:20:24.325048+0000","last_became_peered":"2024-09-11T23:20:24.325048+0000","last_unstale":"2024-09-11T23:20:26.287454+0000","last_undegraded":"2024-09-11T23:20:26.287454+0000","last_fullsized":"2024-09-11T23:20:26.287454+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:42.220068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592996+0000","last_change":"2024-09-11T23:20:25.344908+0000","last_active":"2024-09-11T23:20:26.592996+0000","last_peered":"2024-09-11T23:20:26.592996+0000","last_clean":"2024-09-11T23:20:26.592996+0000","last_became_active":"2024-09-11T23:20:25.332677+0000","last_became_peered":"2024-09-11T23:20:25.332677+0000","last_unstale":"2024-09-11T23:20:26.592996+0000","last_undegraded":"2024-09-11T23:20:26.592996+0000","last_fullsized":"2024-09-11T23:20:26.592996+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326025+0000","last_change":"2024-09-11T23:20:24.329376+0000","last_active":"2024-09-11T23:20:26.326025+0000","last_peered":"2024-09-11T23:20:26.326025+0000","last_clean":"2024-09-11T23:20:26.326025+0000","last_became_active":"2024-09-11T23:20:24.328840+0000","last_became_peered":"2024-09-11T23:20:24.328840+0000","last_unstale":"2024-09-11T23:20:26.326025+0000","last_undegraded":"2024-09-11T23:20:26.326025+0000","last_fullsized":"2024-09-11T23:20:26.326025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:56.943934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591937+0000","last_change":"2024-09-11T23:20:25.338915+0000","last_active":"2024-09-11T23:20:26.591937+0000","last_peered":"2024-09-11T23:20:26.591937+0000","last_clean":"2024-09-11T23:20:26.591937+0000","last_became_active":"2024-09-11T23:20:25.338405+0000","last_became_peered":"2024-09-11T23:20:25.338405+0000","last_unstale":"2024-09-11T23:20:26.591937+0000","last_undegraded":"2024-09-11T23:20:26.591937+0000","last_fullsized":"2024-09-11T23:20:26.591937+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592755+0000","last_change":"2024-09-11T23:20:24.339006+0000","last_active":"2024-09-11T23:20:26.592755+0000","last_peered":"2024-09-11T23:20:26.592755+0000","last_clean":"2024-09-11T23:20:26.592755+0000","last_became_active":"2024-09-11T23:20:24.338153+0000","last_became_peered":"2024-09-11T23:20:24.338153+0000","last_unstale":"2024-09-11T23:20:26.592755+0000","last_undegraded":"2024-09-11T23:20:26.592755+0000","last_fullsized":"2024-09-11T23:20:26.592755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:53.595358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593565+0000","last_change":"2024-09-11T23:20:25.350849+0000","last_active":"2024-09-11T23:20:26.593565+0000","last_peered":"2024-09-11T23:20:26.593565+0000","last_clean":"2024-09-11T23:20:26.593565+0000","last_became_active":"2024-09-11T23:20:25.346375+0000","last_became_peered":"2024-09-11T23:20:25.346375+0000","last_unstale":"2024-09-11T23:20:26.593565+0000","last_undegraded":"2024-09-11T23:20:26.593565+0000","last_fullsized":"2024-09-11T23:20:26.593565+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"114'8","reported_seq":22,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592402+0000","last_change":"2024-09-11T23:20:24.325822+0000","last_active":"2024-09-11T23:20:26.592402+0000","last_peered":"2024-09-11T23:20:26.592402+0000","last_clean":"2024-09-11T23:20:26.592402+0000","last_became_active":"2024-09-11T23:20:24.325497+0000","last_became_peered":"2024-09-11T23:20:24.325497+0000","last_unstale":"2024-09-11T23:20:26.592402+0000","last_undegraded":"2024-09-11T23:20:26.592402+0000","last_fullsized":"2024-09-11T23:20:26.592402+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.171149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":347,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593046+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:20:26.593046+0000","last_peered":"2024-09-11T23:20:26.593046+0000","last_clean":"2024-09-11T23:20:26.593046+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:20:26.593046+0000","last_undegraded":"2024-09-11T23:20:26.593046+0000","last_fullsized":"2024-09-11T23:20:26.593046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41492,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330348,"statfs":{"total":96636764160,"available":96594276352,"internally_reserved":0,"allocated":2031616,"data_stored":1250785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1437696,"data_stored":666915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40920,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330920,"statfs":{"total":96636764160,"available":96594862080,"internally_reserved":0,"allocated":1441792,"data_stored":666493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40928,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330912,"statfs":{"total":96636764160,"available":96594853888,"internally_reserved":0,"allocated":1445888,"data_stored":667945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28448,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343392,"statfs":{"total":96636764160,"available":96607633408,"internally_reserved":0,"allocated":1449984,"data_stored":667979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1433600,"data_stored":666333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1425408,"data_stored":659663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33176,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338664,"statfs":{"total":96636764160,"available":96602791936,"internally_reserved":0,"allocated":2031616,"data_stored":1256723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:20:29.345 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:20:29.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa793b83640 1 Processor -- start 2024-09-11T23:20:29.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa793b83640 1 -- start start 2024-09-11T23:20:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa793b83640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa78c15e260 0x7fa78c0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa793b83640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa78c1625b0 0x7fa78c0b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa793b83640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c0afbb0 con 0x7fa78c067e30 2024-09-11T23:20:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa793b83640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c0af310 con 0x7fa78c1625b0 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa793b83640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c0af5f0 con 0x7fa78c15e260 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa792120640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa78c1625b0 0x7fa78c0b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa792120640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa78c1625b0 0x7fa78c0b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37818/0 (socket says 172.21.15.94:37818) 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa792120640 1 -- 172.21.15.94:0/2094990375 learned_addr learned my addr 172.21.15.94:0/2094990375 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa79191f640 1 --2- 172.21.15.94:0/2094990375 >> v2:172.21.15.155:3300/0 conn(0x7fa78c15e260 0x7fa78c0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa792120640 1 -- 172.21.15.94:0/2094990375 >> v2:172.21.15.155:3300/0 conn(0x7fa78c15e260 msgr2=0x7fa78c0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa792120640 1 --2- 172.21.15.94:0/2094990375 >> v2:172.21.15.155:3300/0 conn(0x7fa78c15e260 0x7fa78c0afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa792120640 1 -- 172.21.15.94:0/2094990375 >> v1:172.21.15.155:6789/0 conn(0x7fa78c067e30 legacy=0x7fa78c161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.504+0000 7fa792120640 1 -- 172.21.15.94:0/2094990375 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0af8d0 con 0x7fa78c1625b0 2024-09-11T23:20:29.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa792120640 1 --2- 172.21.15.94:0/2094990375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c0b41c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa78c072270 tx=0x7fa78401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd43e439b37e071 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa79091d640 1 -- 172.21.15.94:0/2094990375 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7840a5890 con 0x7fa78c1625b0 2024-09-11T23:20:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa79091d640 1 -- 172.21.15.94:0/2094990375 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7840a5a30 con 0x7fa78c1625b0 2024-09-11T23:20:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa79091d640 1 -- 172.21.15.94:0/2094990375 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7840a5e00 con 0x7fa78c1625b0 2024-09-11T23:20:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- 172.21.15.94:0/2094990375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 msgr2=0x7fa78c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 --2- 172.21.15.94:0/2094990375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c0b41c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa78c072270 tx=0x7fa78401c9b0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- 172.21.15.94:0/2094990375 shutdown_connections 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 --2- 172.21.15.94:0/2094990375 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c0b41c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 --2- 172.21.15.94:0/2094990375 >> v2:172.21.15.155:3300/0 conn(0x7fa78c15e260 0x7fa78c0afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- 172.21.15.94:0/2094990375 >> 172.21.15.94:0/2094990375 conn(0x7fa78c073580 msgr2=0x7fa78c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- 172.21.15.94:0/2094990375 shutdown_connections 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- 172.21.15.94:0/2094990375 wait complete. 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 Processor -- start 2024-09-11T23:20:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- start start 2024-09-11T23:20:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78c067e30 0x7fa78c0d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa78c15e260 0x7fa78c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0b52e0 con 0x7fa78c1625b0 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0b5160 con 0x7fa78c15e260 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa793b83640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa78c0b5460 con 0x7fa78c067e30 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa792120640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa792120640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37830/0 (socket says 172.21.15.94:37830) 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa792120640 1 -- 172.21.15.94:0/4216130280 learned_addr learned my addr 172.21.15.94:0/4216130280 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa79111e640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa78c15e260 0x7fa78c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.508+0000 7fa79191f640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78c067e30 0x7fa78c0d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa792120640 1 -- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78c067e30 msgr2=0x7fa78c0d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa792120640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78c067e30 0x7fa78c0d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa792120640 1 -- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa78c15e260 msgr2=0x7fa78c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa792120640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa78c15e260 0x7fa78c1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa792120640 1 -- 172.21.15.94:0/4216130280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c153430 con 0x7fa78c1625b0 2024-09-11T23:20:29.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa792120640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c152ef0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fa78401a5e0 tx=0x7fa784019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa7827fc640 1 -- 172.21.15.94:0/4216130280 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7840bc020 con 0x7fa78c1625b0 2024-09-11T23:20:29.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa7827fc640 1 -- 172.21.15.94:0/4216130280 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7840b8670 con 0x7fa78c1625b0 2024-09-11T23:20:29.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c0cefb0 con 0x7fa78c1625b0 2024-09-11T23:20:29.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa7827fc640 1 -- 172.21.15.94:0/4216130280 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7840b8a60 con 0x7fa78c1625b0 2024-09-11T23:20:29.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c0cf570 con 0x7fa78c1625b0 2024-09-11T23:20:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c0afff0 con 0x7fa78c1625b0 2024-09-11T23:20:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa7827fc640 1 -- 172.21.15.94:0/4216130280 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7840bf020 con 0x7fa78c1625b0 2024-09-11T23:20:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa7827fc640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa7700678c0 0x7fa770069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa7827fc640 1 -- 172.21.15.94:0/4216130280 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fa784120e50 con 0x7fa78c1625b0 2024-09-11T23:20:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa79191f640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa7700678c0 0x7fa770069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.512+0000 7fa79191f640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa7700678c0 0x7fa770069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa78c15b090 tx=0x7fa788008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.516+0000 7fa7827fc640 1 -- 172.21.15.94:0/4216130280 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa7840c6030 con 0x7fa78c1625b0 2024-09-11T23:20:29.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.680+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa78c0cd140 con 0x7fa7700678c0 2024-09-11T23:20:29.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.696+0000 7fa7827fc640 1 -- 172.21.15.94:0/4216130280 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252489 (secure 0 0 0) 0x7fa78c0cd140 con 0x7fa7700678c0 2024-09-11T23:20:29.701 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:29.703 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:20:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa7700678c0 msgr2=0x7fa770069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa7700678c0 0x7fa770069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa78c15b090 tx=0x7fa788008040 comp rx=0 tx=0).stop 2024-09-11T23:20:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 msgr2=0x7fa78c152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c152ef0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fa78401a5e0 tx=0x7fa784019750 comp rx=0 tx=0).stop 2024-09-11T23:20:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 shutdown_connections 2024-09-11T23:20:29.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fa7700678c0 0x7fa770069d80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa78c1625b0 0x7fa78c152ef0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa78c15e260 0x7fa78c1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 --2- 172.21.15.94:0/4216130280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78c067e30 0x7fa78c0d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 >> 172.21.15.94:0/4216130280 conn(0x7fa78c073580 msgr2=0x7fa78c161310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:29.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 shutdown_connections 2024-09-11T23:20:29.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.704+0000 7fa793b83640 1 -- 172.21.15.94:0/4216130280 wait complete. 2024-09-11T23:20:29.720 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-09-11T23:20:28.075146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286892,"kb_used_data":12400,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754687828,"statfs":{"total":773094113280,"available":772800335872,"internally_reserved":0,"allocated":12697600,"data_stored":6502836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.790687"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.288461+0000","last_change":"2024-09-11T23:20:25.306115+0000","last_active":"2024-09-11T23:20:26.288461+0000","last_peered":"2024-09-11T23:20:26.288461+0000","last_clean":"2024-09-11T23:20:26.288461+0000","last_became_active":"2024-09-11T23:20:25.305077+0000","last_became_peered":"2024-09-11T23:20:25.305077+0000","last_unstale":"2024-09-11T23:20:26.288461+0000","last_undegraded":"2024-09-11T23:20:26.288461+0000","last_fullsized":"2024-09-11T23:20:26.288461+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:19.670650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592902+0000","last_change":"2024-09-11T23:20:25.322070+0000","last_active":"2024-09-11T23:20:26.592902+0000","last_peered":"2024-09-11T23:20:26.592902+0000","last_clean":"2024-09-11T23:20:26.592902+0000","last_became_active":"2024-09-11T23:20:25.321804+0000","last_became_peered":"2024-09-11T23:20:25.321804+0000","last_unstale":"2024-09-11T23:20:26.592902+0000","last_undegraded":"2024-09-11T23:20:26.592902+0000","last_fullsized":"2024-09-11T23:20:26.592902+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:03.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593751+0000","last_change":"2024-09-11T23:20:25.340079+0000","last_active":"2024-09-11T23:20:26.593751+0000","last_peered":"2024-09-11T23:20:26.593751+0000","last_clean":"2024-09-11T23:20:26.593751+0000","last_became_active":"2024-09-11T23:20:25.339817+0000","last_became_peered":"2024-09-11T23:20:25.339817+0000","last_unstale":"2024-09-11T23:20:26.593751+0000","last_undegraded":"2024-09-11T23:20:26.593751+0000","last_fullsized":"2024-09-11T23:20:26.593751+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:06.001715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593292+0000","last_change":"2024-09-11T23:20:25.334104+0000","last_active":"2024-09-11T23:20:26.593292+0000","last_peered":"2024-09-11T23:20:26.593292+0000","last_clean":"2024-09-11T23:20:26.593292+0000","last_became_active":"2024-09-11T23:20:25.331386+0000","last_became_peered":"2024-09-11T23:20:25.331386+0000","last_unstale":"2024-09-11T23:20:26.593292+0000","last_undegraded":"2024-09-11T23:20:26.593292+0000","last_fullsized":"2024-09-11T23:20:26.593292+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:06.072747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287516+0000","last_change":"2024-09-11T23:20:25.341402+0000","last_active":"2024-09-11T23:20:26.287516+0000","last_peered":"2024-09-11T23:20:26.287516+0000","last_clean":"2024-09-11T23:20:26.287516+0000","last_became_active":"2024-09-11T23:20:25.340783+0000","last_became_peered":"2024-09-11T23:20:25.340783+0000","last_unstale":"2024-09-11T23:20:26.287516+0000","last_undegraded":"2024-09-11T23:20:26.287516+0000","last_fullsized":"2024-09-11T23:20:26.287516+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:58.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326045+0000","last_change":"2024-09-11T23:20:25.321428+0000","last_active":"2024-09-11T23:20:26.326045+0000","last_peered":"2024-09-11T23:20:26.326045+0000","last_clean":"2024-09-11T23:20:26.326045+0000","last_became_active":"2024-09-11T23:20:25.321052+0000","last_became_peered":"2024-09-11T23:20:25.321052+0000","last_unstale":"2024-09-11T23:20:26.326045+0000","last_undegraded":"2024-09-11T23:20:26.326045+0000","last_fullsized":"2024-09-11T23:20:26.326045+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:31.195554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.325958+0000","last_change":"2024-09-11T23:20:25.334312+0000","last_active":"2024-09-11T23:20:26.325958+0000","last_peered":"2024-09-11T23:20:26.325958+0000","last_clean":"2024-09-11T23:20:26.325958+0000","last_became_active":"2024-09-11T23:20:25.334014+0000","last_became_peered":"2024-09-11T23:20:25.334014+0000","last_unstale":"2024-09-11T23:20:26.325958+0000","last_undegraded":"2024-09-11T23:20:26.325958+0000","last_fullsized":"2024-09-11T23:20:26.325958+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:04.733329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592085+0000","last_change":"2024-09-11T23:20:25.347262+0000","last_active":"2024-09-11T23:20:26.592085+0000","last_peered":"2024-09-11T23:20:26.592085+0000","last_clean":"2024-09-11T23:20:26.592085+0000","last_became_active":"2024-09-11T23:20:25.346947+0000","last_became_peered":"2024-09-11T23:20:25.346947+0000","last_unstale":"2024-09-11T23:20:26.592085+0000","last_undegraded":"2024-09-11T23:20:26.592085+0000","last_fullsized":"2024-09-11T23:20:26.592085+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594213+0000","last_change":"2024-09-11T23:20:25.337919+0000","last_active":"2024-09-11T23:20:26.594213+0000","last_peered":"2024-09-11T23:20:26.594213+0000","last_clean":"2024-09-11T23:20:26.594213+0000","last_became_active":"2024-09-11T23:20:25.337305+0000","last_became_peered":"2024-09-11T23:20:25.337305+0000","last_unstale":"2024-09-11T23:20:26.594213+0000","last_undegraded":"2024-09-11T23:20:26.594213+0000","last_fullsized":"2024-09-11T23:20:26.594213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:03.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592089+0000","last_change":"2024-09-11T23:20:25.323725+0000","last_active":"2024-09-11T23:20:26.592089+0000","last_peered":"2024-09-11T23:20:26.592089+0000","last_clean":"2024-09-11T23:20:26.592089+0000","last_became_active":"2024-09-11T23:20:25.323350+0000","last_became_peered":"2024-09-11T23:20:25.323350+0000","last_unstale":"2024-09-11T23:20:26.592089+0000","last_undegraded":"2024-09-11T23:20:26.592089+0000","last_fullsized":"2024-09-11T23:20:26.592089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:03.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.288401+0000","last_change":"2024-09-11T23:20:25.299754+0000","last_active":"2024-09-11T23:20:26.288401+0000","last_peered":"2024-09-11T23:20:26.288401+0000","last_clean":"2024-09-11T23:20:26.288401+0000","last_became_active":"2024-09-11T23:20:25.299041+0000","last_became_peered":"2024-09-11T23:20:25.299041+0000","last_unstale":"2024-09-11T23:20:26.288401+0000","last_undegraded":"2024-09-11T23:20:26.288401+0000","last_fullsized":"2024-09-11T23:20:26.288401+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:30.984388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326308+0000","last_change":"2024-09-11T23:20:25.322532+0000","last_active":"2024-09-11T23:20:26.326308+0000","last_peered":"2024-09-11T23:20:26.326308+0000","last_clean":"2024-09-11T23:20:26.326308+0000","last_became_active":"2024-09-11T23:20:25.322142+0000","last_became_peered":"2024-09-11T23:20:25.322142+0000","last_unstale":"2024-09-11T23:20:26.326308+0000","last_undegraded":"2024-09-11T23:20:26.326308+0000","last_fullsized":"2024-09-11T23:20:26.326308+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:59.264343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591522+0000","last_change":"2024-09-11T23:20:25.318916+0000","last_active":"2024-09-11T23:20:26.591522+0000","last_peered":"2024-09-11T23:20:26.591522+0000","last_clean":"2024-09-11T23:20:26.591522+0000","last_became_active":"2024-09-11T23:20:25.318581+0000","last_became_peered":"2024-09-11T23:20:25.318581+0000","last_unstale":"2024-09-11T23:20:26.591522+0000","last_undegraded":"2024-09-11T23:20:26.591522+0000","last_fullsized":"2024-09-11T23:20:26.591522+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:55.823157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592853+0000","last_change":"2024-09-11T23:20:25.340037+0000","last_active":"2024-09-11T23:20:26.592853+0000","last_peered":"2024-09-11T23:20:26.592853+0000","last_clean":"2024-09-11T23:20:26.592853+0000","last_became_active":"2024-09-11T23:20:25.339767+0000","last_became_peered":"2024-09-11T23:20:25.339767+0000","last_unstale":"2024-09-11T23:20:26.592853+0000","last_undegraded":"2024-09-11T23:20:26.592853+0000","last_fullsized":"2024-09-11T23:20:26.592853+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286765+0000","last_change":"2024-09-11T23:20:25.301631+0000","last_active":"2024-09-11T23:20:26.286765+0000","last_peered":"2024-09-11T23:20:26.286765+0000","last_clean":"2024-09-11T23:20:26.286765+0000","last_became_active":"2024-09-11T23:20:25.300906+0000","last_became_peered":"2024-09-11T23:20:25.300906+0000","last_unstale":"2024-09-11T23:20:26.286765+0000","last_undegraded":"2024-09-11T23:20:26.286765+0000","last_fullsized":"2024-09-11T23:20:26.286765+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:36.538610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.325877+0000","last_change":"2024-09-11T23:20:25.311615+0000","last_active":"2024-09-11T23:20:26.325877+0000","last_peered":"2024-09-11T23:20:26.325877+0000","last_clean":"2024-09-11T23:20:26.325877+0000","last_became_active":"2024-09-11T23:20:25.311154+0000","last_became_peered":"2024-09-11T23:20:25.311154+0000","last_unstale":"2024-09-11T23:20:26.325877+0000","last_undegraded":"2024-09-11T23:20:26.325877+0000","last_fullsized":"2024-09-11T23:20:26.325877+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:49.475263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592585+0000","last_change":"2024-09-11T23:20:25.319609+0000","last_active":"2024-09-11T23:20:26.592585+0000","last_peered":"2024-09-11T23:20:26.592585+0000","last_clean":"2024-09-11T23:20:26.592585+0000","last_became_active":"2024-09-11T23:20:25.319342+0000","last_became_peered":"2024-09-11T23:20:25.319342+0000","last_unstale":"2024-09-11T23:20:26.592585+0000","last_undegraded":"2024-09-11T23:20:26.592585+0000","last_fullsized":"2024-09-11T23:20:26.592585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:35.647557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593363+0000","last_change":"2024-09-11T23:20:25.319222+0000","last_active":"2024-09-11T23:20:26.593363+0000","last_peered":"2024-09-11T23:20:26.593363+0000","last_clean":"2024-09-11T23:20:26.593363+0000","last_became_active":"2024-09-11T23:20:25.316553+0000","last_became_peered":"2024-09-11T23:20:25.316553+0000","last_unstale":"2024-09-11T23:20:26.593363+0000","last_undegraded":"2024-09-11T23:20:26.593363+0000","last_fullsized":"2024-09-11T23:20:26.593363+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:36.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324229+0000","last_change":"2024-09-11T23:20:25.341038+0000","last_active":"2024-09-11T23:20:26.324229+0000","last_peered":"2024-09-11T23:20:26.324229+0000","last_clean":"2024-09-11T23:20:26.324229+0000","last_became_active":"2024-09-11T23:20:25.340252+0000","last_became_peered":"2024-09-11T23:20:25.340252+0000","last_unstale":"2024-09-11T23:20:26.324229+0000","last_undegraded":"2024-09-11T23:20:26.324229+0000","last_fullsized":"2024-09-11T23:20:26.324229+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:30.984388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.282896+0000","last_change":"2024-09-11T23:20:25.308683+0000","last_active":"2024-09-11T23:20:26.282896+0000","last_peered":"2024-09-11T23:20:26.282896+0000","last_clean":"2024-09-11T23:20:26.282896+0000","last_became_active":"2024-09-11T23:20:25.307964+0000","last_became_peered":"2024-09-11T23:20:25.307964+0000","last_unstale":"2024-09-11T23:20:26.282896+0000","last_undegraded":"2024-09-11T23:20:26.282896+0000","last_fullsized":"2024-09-11T23:20:26.282896+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:20.229989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593385+0000","last_change":"2024-09-11T23:20:25.338500+0000","last_active":"2024-09-11T23:20:26.593385+0000","last_peered":"2024-09-11T23:20:26.593385+0000","last_clean":"2024-09-11T23:20:26.593385+0000","last_became_active":"2024-09-11T23:20:25.337803+0000","last_became_peered":"2024-09-11T23:20:25.337803+0000","last_unstale":"2024-09-11T23:20:26.593385+0000","last_undegraded":"2024-09-11T23:20:26.593385+0000","last_fullsized":"2024-09-11T23:20:26.593385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287537+0000","last_change":"2024-09-11T23:20:25.303298+0000","last_active":"2024-09-11T23:20:26.287537+0000","last_peered":"2024-09-11T23:20:26.287537+0000","last_clean":"2024-09-11T23:20:26.287537+0000","last_became_active":"2024-09-11T23:20:25.302526+0000","last_became_peered":"2024-09-11T23:20:25.302526+0000","last_unstale":"2024-09-11T23:20:26.287537+0000","last_undegraded":"2024-09-11T23:20:26.287537+0000","last_fullsized":"2024-09-11T23:20:26.287537+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:39.862640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593201+0000","last_change":"2024-09-11T23:20:25.334273+0000","last_active":"2024-09-11T23:20:26.593201+0000","last_peered":"2024-09-11T23:20:26.593201+0000","last_clean":"2024-09-11T23:20:26.593201+0000","last_became_active":"2024-09-11T23:20:25.330848+0000","last_became_peered":"2024-09-11T23:20:25.330848+0000","last_unstale":"2024-09-11T23:20:26.593201+0000","last_undegraded":"2024-09-11T23:20:26.593201+0000","last_fullsized":"2024-09-11T23:20:26.593201+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:55.823157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.285270+0000","last_change":"2024-09-11T23:20:25.348875+0000","last_active":"2024-09-11T23:20:26.285270+0000","last_peered":"2024-09-11T23:20:26.285270+0000","last_clean":"2024-09-11T23:20:26.285270+0000","last_became_active":"2024-09-11T23:20:25.348294+0000","last_became_peered":"2024-09-11T23:20:25.348294+0000","last_unstale":"2024-09-11T23:20:26.285270+0000","last_undegraded":"2024-09-11T23:20:26.285270+0000","last_fullsized":"2024-09-11T23:20:26.285270+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:19.670650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286608+0000","last_change":"2024-09-11T23:20:25.306762+0000","last_active":"2024-09-11T23:20:26.286608+0000","last_peered":"2024-09-11T23:20:26.286608+0000","last_clean":"2024-09-11T23:20:26.286608+0000","last_became_active":"2024-09-11T23:20:25.304668+0000","last_became_peered":"2024-09-11T23:20:25.304668+0000","last_unstale":"2024-09-11T23:20:26.286608+0000","last_undegraded":"2024-09-11T23:20:26.286608+0000","last_fullsized":"2024-09-11T23:20:26.286608+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283207+0000","last_change":"2024-09-11T23:20:25.310091+0000","last_active":"2024-09-11T23:20:26.283207+0000","last_peered":"2024-09-11T23:20:26.283207+0000","last_clean":"2024-09-11T23:20:26.283207+0000","last_became_active":"2024-09-11T23:20:25.309309+0000","last_became_peered":"2024-09-11T23:20:25.309309+0000","last_unstale":"2024-09-11T23:20:26.283207+0000","last_undegraded":"2024-09-11T23:20:26.283207+0000","last_fullsized":"2024-09-11T23:20:26.283207+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:07.039814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324322+0000","last_change":"2024-09-11T23:20:25.340838+0000","last_active":"2024-09-11T23:20:26.324322+0000","last_peered":"2024-09-11T23:20:26.324322+0000","last_clean":"2024-09-11T23:20:26.324322+0000","last_became_active":"2024-09-11T23:20:25.340266+0000","last_became_peered":"2024-09-11T23:20:25.340266+0000","last_unstale":"2024-09-11T23:20:26.324322+0000","last_undegraded":"2024-09-11T23:20:26.324322+0000","last_fullsized":"2024-09-11T23:20:26.324322+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:19.670650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326306+0000","last_change":"2024-09-11T23:20:25.322913+0000","last_active":"2024-09-11T23:20:26.326306+0000","last_peered":"2024-09-11T23:20:26.326306+0000","last_clean":"2024-09-11T23:20:26.326306+0000","last_became_active":"2024-09-11T23:20:25.322547+0000","last_became_peered":"2024-09-11T23:20:25.322547+0000","last_unstale":"2024-09-11T23:20:26.326306+0000","last_undegraded":"2024-09-11T23:20:26.326306+0000","last_fullsized":"2024-09-11T23:20:26.326306+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:08.845784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283717+0000","last_change":"2024-09-11T23:20:25.297162+0000","last_active":"2024-09-11T23:20:26.283717+0000","last_peered":"2024-09-11T23:20:26.283717+0000","last_clean":"2024-09-11T23:20:26.283717+0000","last_became_active":"2024-09-11T23:20:25.296386+0000","last_became_peered":"2024-09-11T23:20:25.296386+0000","last_unstale":"2024-09-11T23:20:26.283717+0000","last_undegraded":"2024-09-11T23:20:26.283717+0000","last_fullsized":"2024-09-11T23:20:26.283717+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:04.497387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593012+0000","last_change":"2024-09-11T23:20:25.312293+0000","last_active":"2024-09-11T23:20:26.593012+0000","last_peered":"2024-09-11T23:20:26.593012+0000","last_clean":"2024-09-11T23:20:26.593012+0000","last_became_active":"2024-09-11T23:20:25.305123+0000","last_became_peered":"2024-09-11T23:20:25.305123+0000","last_unstale":"2024-09-11T23:20:26.593012+0000","last_undegraded":"2024-09-11T23:20:26.593012+0000","last_fullsized":"2024-09-11T23:20:26.593012+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:35.647557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.285755+0000","last_change":"2024-09-11T23:20:25.304278+0000","last_active":"2024-09-11T23:20:26.285755+0000","last_peered":"2024-09-11T23:20:26.285755+0000","last_clean":"2024-09-11T23:20:26.285755+0000","last_became_active":"2024-09-11T23:20:25.303381+0000","last_became_peered":"2024-09-11T23:20:25.303381+0000","last_unstale":"2024-09-11T23:20:26.285755+0000","last_undegraded":"2024-09-11T23:20:26.285755+0000","last_fullsized":"2024-09-11T23:20:26.285755+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:38.777308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286065+0000","last_change":"2024-09-11T23:20:25.331863+0000","last_active":"2024-09-11T23:20:26.286065+0000","last_peered":"2024-09-11T23:20:26.286065+0000","last_clean":"2024-09-11T23:20:26.286065+0000","last_became_active":"2024-09-11T23:20:25.331287+0000","last_became_peered":"2024-09-11T23:20:25.331287+0000","last_unstale":"2024-09-11T23:20:26.286065+0000","last_undegraded":"2024-09-11T23:20:26.286065+0000","last_fullsized":"2024-09-11T23:20:26.286065+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:51.757400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591766+0000","last_change":"2024-09-11T23:20:25.313643+0000","last_active":"2024-09-11T23:20:26.591766+0000","last_peered":"2024-09-11T23:20:26.591766+0000","last_clean":"2024-09-11T23:20:26.591766+0000","last_became_active":"2024-09-11T23:20:25.313301+0000","last_became_peered":"2024-09-11T23:20:25.313301+0000","last_unstale":"2024-09-11T23:20:26.591766+0000","last_undegraded":"2024-09-11T23:20:26.591766+0000","last_fullsized":"2024-09-11T23:20:26.591766+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:34.146853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"114'4","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324129+0000","last_change":"2024-09-11T23:20:24.336885+0000","last_active":"2024-09-11T23:20:26.324129+0000","last_peered":"2024-09-11T23:20:26.324129+0000","last_clean":"2024-09-11T23:20:26.324129+0000","last_became_active":"2024-09-11T23:20:24.335281+0000","last_became_peered":"2024-09-11T23:20:24.335281+0000","last_unstale":"2024-09-11T23:20:26.324129+0000","last_undegraded":"2024-09-11T23:20:26.324129+0000","last_fullsized":"2024-09-11T23:20:26.324129+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326315+0000","last_change":"2024-09-11T23:20:25.308448+0000","last_active":"2024-09-11T23:20:26.326315+0000","last_peered":"2024-09-11T23:20:26.326315+0000","last_clean":"2024-09-11T23:20:26.326315+0000","last_became_active":"2024-09-11T23:20:25.306542+0000","last_became_peered":"2024-09-11T23:20:25.306542+0000","last_unstale":"2024-09-11T23:20:26.326315+0000","last_undegraded":"2024-09-11T23:20:26.326315+0000","last_fullsized":"2024-09-11T23:20:26.326315+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:04.203132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592381+0000","last_change":"2024-09-11T23:20:24.312843+0000","last_active":"2024-09-11T23:20:26.592381+0000","last_peered":"2024-09-11T23:20:26.592381+0000","last_clean":"2024-09-11T23:20:26.592381+0000","last_became_active":"2024-09-11T23:20:24.312460+0000","last_became_peered":"2024-09-11T23:20:24.312460+0000","last_unstale":"2024-09-11T23:20:26.592381+0000","last_undegraded":"2024-09-11T23:20:26.592381+0000","last_fullsized":"2024-09-11T23:20:26.592381+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286290+0000","last_change":"2024-09-11T23:20:25.309845+0000","last_active":"2024-09-11T23:20:26.286290+0000","last_peered":"2024-09-11T23:20:26.286290+0000","last_clean":"2024-09-11T23:20:26.286290+0000","last_became_active":"2024-09-11T23:20:25.309112+0000","last_became_peered":"2024-09-11T23:20:25.309112+0000","last_unstale":"2024-09-11T23:20:26.286290+0000","last_undegraded":"2024-09-11T23:20:26.286290+0000","last_fullsized":"2024-09-11T23:20:26.286290+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:55.823157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593964+0000","last_change":"2024-09-11T23:20:24.329199+0000","last_active":"2024-09-11T23:20:26.593964+0000","last_peered":"2024-09-11T23:20:26.593964+0000","last_clean":"2024-09-11T23:20:26.593964+0000","last_became_active":"2024-09-11T23:20:24.328429+0000","last_became_peered":"2024-09-11T23:20:24.328429+0000","last_unstale":"2024-09-11T23:20:26.593964+0000","last_undegraded":"2024-09-11T23:20:26.593964+0000","last_fullsized":"2024-09-11T23:20:26.593964+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.171149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594321+0000","last_change":"2024-09-11T23:20:25.346528+0000","last_active":"2024-09-11T23:20:26.594321+0000","last_peered":"2024-09-11T23:20:26.594321+0000","last_clean":"2024-09-11T23:20:26.594321+0000","last_became_active":"2024-09-11T23:20:25.345934+0000","last_became_peered":"2024-09-11T23:20:25.345934+0000","last_unstale":"2024-09-11T23:20:26.594321+0000","last_undegraded":"2024-09-11T23:20:26.594321+0000","last_fullsized":"2024-09-11T23:20:26.594321+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:35.647557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591625+0000","last_change":"2024-09-11T23:20:24.318079+0000","last_active":"2024-09-11T23:20:26.591625+0000","last_peered":"2024-09-11T23:20:26.591625+0000","last_clean":"2024-09-11T23:20:26.591625+0000","last_became_active":"2024-09-11T23:20:24.317685+0000","last_became_peered":"2024-09-11T23:20:24.317685+0000","last_unstale":"2024-09-11T23:20:26.591625+0000","last_undegraded":"2024-09-11T23:20:26.591625+0000","last_fullsized":"2024-09-11T23:20:26.591625+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591215+0000","last_change":"2024-09-11T23:20:25.347038+0000","last_active":"2024-09-11T23:20:26.591215+0000","last_peered":"2024-09-11T23:20:26.591215+0000","last_clean":"2024-09-11T23:20:26.591215+0000","last_became_active":"2024-09-11T23:20:25.346743+0000","last_became_peered":"2024-09-11T23:20:25.346743+0000","last_unstale":"2024-09-11T23:20:26.591215+0000","last_undegraded":"2024-09-11T23:20:26.591215+0000","last_fullsized":"2024-09-11T23:20:26.591215+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:51.757400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287480+0000","last_change":"2024-09-11T23:20:24.321198+0000","last_active":"2024-09-11T23:20:26.287480+0000","last_peered":"2024-09-11T23:20:26.287480+0000","last_clean":"2024-09-11T23:20:26.287480+0000","last_became_active":"2024-09-11T23:20:24.319866+0000","last_became_peered":"2024-09-11T23:20:24.319866+0000","last_unstale":"2024-09-11T23:20:26.287480+0000","last_undegraded":"2024-09-11T23:20:26.287480+0000","last_fullsized":"2024-09-11T23:20:26.287480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:10.900422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286870+0000","last_change":"2024-09-11T23:20:25.323711+0000","last_active":"2024-09-11T23:20:26.286870+0000","last_peered":"2024-09-11T23:20:26.286870+0000","last_clean":"2024-09-11T23:20:26.286870+0000","last_became_active":"2024-09-11T23:20:25.322913+0000","last_became_peered":"2024-09-11T23:20:25.322913+0000","last_unstale":"2024-09-11T23:20:26.286870+0000","last_undegraded":"2024-09-11T23:20:26.286870+0000","last_fullsized":"2024-09-11T23:20:26.286870+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:25.186380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326035+0000","last_change":"2024-09-11T23:20:24.328879+0000","last_active":"2024-09-11T23:20:26.326035+0000","last_peered":"2024-09-11T23:20:26.326035+0000","last_clean":"2024-09-11T23:20:26.326035+0000","last_became_active":"2024-09-11T23:20:24.328466+0000","last_became_peered":"2024-09-11T23:20:24.328466+0000","last_unstale":"2024-09-11T23:20:26.326035+0000","last_undegraded":"2024-09-11T23:20:26.326035+0000","last_fullsized":"2024-09-11T23:20:26.326035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:32:35.192418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593248+0000","last_change":"2024-09-11T23:20:25.313043+0000","last_active":"2024-09-11T23:20:26.593248+0000","last_peered":"2024-09-11T23:20:26.593248+0000","last_clean":"2024-09-11T23:20:26.593248+0000","last_became_active":"2024-09-11T23:20:25.312668+0000","last_became_peered":"2024-09-11T23:20:25.312668+0000","last_unstale":"2024-09-11T23:20:26.593248+0000","last_undegraded":"2024-09-11T23:20:26.593248+0000","last_fullsized":"2024-09-11T23:20:26.593248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:16.851251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286093+0000","last_change":"2024-09-11T23:20:24.335809+0000","last_active":"2024-09-11T23:20:26.286093+0000","last_peered":"2024-09-11T23:20:26.286093+0000","last_clean":"2024-09-11T23:20:26.286093+0000","last_became_active":"2024-09-11T23:20:24.335159+0000","last_became_peered":"2024-09-11T23:20:24.335159+0000","last_unstale":"2024-09-11T23:20:26.286093+0000","last_undegraded":"2024-09-11T23:20:26.286093+0000","last_fullsized":"2024-09-11T23:20:26.286093+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:42.220068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591866+0000","last_change":"2024-09-11T23:20:25.327091+0000","last_active":"2024-09-11T23:20:26.591866+0000","last_peered":"2024-09-11T23:20:26.591866+0000","last_clean":"2024-09-11T23:20:26.591866+0000","last_became_active":"2024-09-11T23:20:25.326537+0000","last_became_peered":"2024-09-11T23:20:25.326537+0000","last_unstale":"2024-09-11T23:20:26.591866+0000","last_undegraded":"2024-09-11T23:20:26.591866+0000","last_fullsized":"2024-09-11T23:20:26.591866+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326095+0000","last_change":"2024-09-11T23:20:24.328226+0000","last_active":"2024-09-11T23:20:26.326095+0000","last_peered":"2024-09-11T23:20:26.326095+0000","last_clean":"2024-09-11T23:20:26.326095+0000","last_became_active":"2024-09-11T23:20:24.324666+0000","last_became_peered":"2024-09-11T23:20:24.324666+0000","last_unstale":"2024-09-11T23:20:26.326095+0000","last_undegraded":"2024-09-11T23:20:26.326095+0000","last_fullsized":"2024-09-11T23:20:26.326095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.138658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.323920+0000","last_change":"2024-09-11T23:20:25.340398+0000","last_active":"2024-09-11T23:20:26.323920+0000","last_peered":"2024-09-11T23:20:26.323920+0000","last_clean":"2024-09-11T23:20:26.323920+0000","last_became_active":"2024-09-11T23:20:25.339724+0000","last_became_peered":"2024-09-11T23:20:25.339724+0000","last_unstale":"2024-09-11T23:20:26.323920+0000","last_undegraded":"2024-09-11T23:20:26.323920+0000","last_fullsized":"2024-09-11T23:20:26.323920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:29.365172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324500+0000","last_change":"2024-09-11T23:20:24.335950+0000","last_active":"2024-09-11T23:20:26.324500+0000","last_peered":"2024-09-11T23:20:26.324500+0000","last_clean":"2024-09-11T23:20:26.324500+0000","last_became_active":"2024-09-11T23:20:24.334265+0000","last_became_peered":"2024-09-11T23:20:24.334265+0000","last_unstale":"2024-09-11T23:20:26.324500+0000","last_undegraded":"2024-09-11T23:20:26.324500+0000","last_fullsized":"2024-09-11T23:20:26.324500+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286835+0000","last_change":"2024-09-11T23:20:25.317145+0000","last_active":"2024-09-11T23:20:26.286835+0000","last_peered":"2024-09-11T23:20:26.286835+0000","last_clean":"2024-09-11T23:20:26.286835+0000","last_became_active":"2024-09-11T23:20:25.316404+0000","last_became_peered":"2024-09-11T23:20:25.316404+0000","last_unstale":"2024-09-11T23:20:26.286835+0000","last_undegraded":"2024-09-11T23:20:26.286835+0000","last_fullsized":"2024-09-11T23:20:26.286835+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286423+0000","last_change":"2024-09-11T23:20:24.316838+0000","last_active":"2024-09-11T23:20:26.286423+0000","last_peered":"2024-09-11T23:20:26.286423+0000","last_clean":"2024-09-11T23:20:26.286423+0000","last_became_active":"2024-09-11T23:20:24.316218+0000","last_became_peered":"2024-09-11T23:20:24.316218+0000","last_unstale":"2024-09-11T23:20:26.286423+0000","last_undegraded":"2024-09-11T23:20:26.286423+0000","last_fullsized":"2024-09-11T23:20:26.286423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:23.130902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593386+0000","last_change":"2024-09-11T23:20:25.340378+0000","last_active":"2024-09-11T23:20:26.593386+0000","last_peered":"2024-09-11T23:20:26.593386+0000","last_clean":"2024-09-11T23:20:26.593386+0000","last_became_active":"2024-09-11T23:20:25.340113+0000","last_became_peered":"2024-09-11T23:20:25.340113+0000","last_unstale":"2024-09-11T23:20:26.593386+0000","last_undegraded":"2024-09-11T23:20:26.593386+0000","last_fullsized":"2024-09-11T23:20:26.593386+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:47.047859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"114'3","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286232+0000","last_change":"2024-09-11T23:20:24.330061+0000","last_active":"2024-09-11T23:20:26.286232+0000","last_peered":"2024-09-11T23:20:26.286232+0000","last_clean":"2024-09-11T23:20:26.286232+0000","last_became_active":"2024-09-11T23:20:24.329016+0000","last_became_peered":"2024-09-11T23:20:24.329016+0000","last_unstale":"2024-09-11T23:20:26.286232+0000","last_undegraded":"2024-09-11T23:20:26.286232+0000","last_fullsized":"2024-09-11T23:20:26.286232+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:28.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286434+0000","last_change":"2024-09-11T23:20:25.303854+0000","last_active":"2024-09-11T23:20:26.286434+0000","last_peered":"2024-09-11T23:20:26.286434+0000","last_clean":"2024-09-11T23:20:26.286434+0000","last_became_active":"2024-09-11T23:20:25.303076+0000","last_became_peered":"2024-09-11T23:20:25.303076+0000","last_unstale":"2024-09-11T23:20:26.286434+0000","last_undegraded":"2024-09-11T23:20:26.286434+0000","last_fullsized":"2024-09-11T23:20:26.286434+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:06.072747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"114'6","reported_seq":20,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592650+0000","last_change":"2024-09-11T23:20:24.317388+0000","last_active":"2024-09-11T23:20:26.592650+0000","last_peered":"2024-09-11T23:20:26.592650+0000","last_clean":"2024-09-11T23:20:26.592650+0000","last_became_active":"2024-09-11T23:20:24.315496+0000","last_became_peered":"2024-09-11T23:20:24.315496+0000","last_unstale":"2024-09-11T23:20:26.592650+0000","last_undegraded":"2024-09-11T23:20:26.592650+0000","last_fullsized":"2024-09-11T23:20:26.592650+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324983+0000","last_change":"2024-09-11T23:20:25.348157+0000","last_active":"2024-09-11T23:20:26.324983+0000","last_peered":"2024-09-11T23:20:26.324983+0000","last_clean":"2024-09-11T23:20:26.324983+0000","last_became_active":"2024-09-11T23:20:25.347452+0000","last_became_peered":"2024-09-11T23:20:25.347452+0000","last_unstale":"2024-09-11T23:20:26.324983+0000","last_undegraded":"2024-09-11T23:20:26.324983+0000","last_fullsized":"2024-09-11T23:20:26.324983+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:17.227664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592857+0000","last_change":"2024-09-11T23:20:24.320638+0000","last_active":"2024-09-11T23:20:26.592857+0000","last_peered":"2024-09-11T23:20:26.592857+0000","last_clean":"2024-09-11T23:20:26.592857+0000","last_became_active":"2024-09-11T23:20:24.320392+0000","last_became_peered":"2024-09-11T23:20:24.320392+0000","last_unstale":"2024-09-11T23:20:26.592857+0000","last_undegraded":"2024-09-11T23:20:26.592857+0000","last_fullsized":"2024-09-11T23:20:26.592857+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591300+0000","last_change":"2024-09-11T23:20:25.338671+0000","last_active":"2024-09-11T23:20:26.591300+0000","last_peered":"2024-09-11T23:20:26.591300+0000","last_clean":"2024-09-11T23:20:26.591300+0000","last_became_active":"2024-09-11T23:20:25.338378+0000","last_became_peered":"2024-09-11T23:20:25.338378+0000","last_unstale":"2024-09-11T23:20:26.591300+0000","last_undegraded":"2024-09-11T23:20:26.591300+0000","last_fullsized":"2024-09-11T23:20:26.591300+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593504+0000","last_change":"2024-09-11T23:20:24.313002+0000","last_active":"2024-09-11T23:20:26.593504+0000","last_peered":"2024-09-11T23:20:26.593504+0000","last_clean":"2024-09-11T23:20:26.593504+0000","last_became_active":"2024-09-11T23:20:24.312668+0000","last_became_peered":"2024-09-11T23:20:24.312668+0000","last_unstale":"2024-09-11T23:20:26.593504+0000","last_undegraded":"2024-09-11T23:20:26.593504+0000","last_fullsized":"2024-09-11T23:20:26.593504+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:35.523378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283543+0000","last_change":"2024-09-11T23:20:25.301773+0000","last_active":"2024-09-11T23:20:26.283543+0000","last_peered":"2024-09-11T23:20:26.283543+0000","last_clean":"2024-09-11T23:20:26.283543+0000","last_became_active":"2024-09-11T23:20:25.300990+0000","last_became_peered":"2024-09-11T23:20:25.300990+0000","last_unstale":"2024-09-11T23:20:26.283543+0000","last_undegraded":"2024-09-11T23:20:26.283543+0000","last_fullsized":"2024-09-11T23:20:26.283543+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:12.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592854+0000","last_change":"2024-09-11T23:20:24.315901+0000","last_active":"2024-09-11T23:20:26.592854+0000","last_peered":"2024-09-11T23:20:26.592854+0000","last_clean":"2024-09-11T23:20:26.592854+0000","last_became_active":"2024-09-11T23:20:24.315123+0000","last_became_peered":"2024-09-11T23:20:24.315123+0000","last_unstale":"2024-09-11T23:20:26.592854+0000","last_undegraded":"2024-09-11T23:20:26.592854+0000","last_fullsized":"2024-09-11T23:20:26.592854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:53.595358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286131+0000","last_change":"2024-09-11T23:20:25.309755+0000","last_active":"2024-09-11T23:20:26.286131+0000","last_peered":"2024-09-11T23:20:26.286131+0000","last_clean":"2024-09-11T23:20:26.286131+0000","last_became_active":"2024-09-11T23:20:25.309032+0000","last_became_peered":"2024-09-11T23:20:25.309032+0000","last_unstale":"2024-09-11T23:20:26.286131+0000","last_undegraded":"2024-09-11T23:20:26.286131+0000","last_fullsized":"2024-09-11T23:20:26.286131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592851+0000","last_change":"2024-09-11T23:20:24.329817+0000","last_active":"2024-09-11T23:20:26.592851+0000","last_peered":"2024-09-11T23:20:26.592851+0000","last_clean":"2024-09-11T23:20:26.592851+0000","last_became_active":"2024-09-11T23:20:24.329513+0000","last_became_peered":"2024-09-11T23:20:24.329513+0000","last_unstale":"2024-09-11T23:20:26.592851+0000","last_undegraded":"2024-09-11T23:20:26.592851+0000","last_fullsized":"2024-09-11T23:20:26.592851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.288141+0000","last_change":"2024-09-11T23:20:25.304672+0000","last_active":"2024-09-11T23:20:26.288141+0000","last_peered":"2024-09-11T23:20:26.288141+0000","last_clean":"2024-09-11T23:20:26.288141+0000","last_became_active":"2024-09-11T23:20:25.303962+0000","last_became_peered":"2024-09-11T23:20:25.303962+0000","last_unstale":"2024-09-11T23:20:26.288141+0000","last_undegraded":"2024-09-11T23:20:26.288141+0000","last_fullsized":"2024-09-11T23:20:26.288141+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:29.365172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283384+0000","last_change":"2024-09-11T23:20:24.315026+0000","last_active":"2024-09-11T23:20:26.283384+0000","last_peered":"2024-09-11T23:20:26.283384+0000","last_clean":"2024-09-11T23:20:26.283384+0000","last_became_active":"2024-09-11T23:20:24.314637+0000","last_became_peered":"2024-09-11T23:20:24.314637+0000","last_unstale":"2024-09-11T23:20:26.283384+0000","last_undegraded":"2024-09-11T23:20:26.283384+0000","last_fullsized":"2024-09-11T23:20:26.283384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:06.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326292+0000","last_change":"2024-09-11T23:20:25.339896+0000","last_active":"2024-09-11T23:20:26.326292+0000","last_peered":"2024-09-11T23:20:26.326292+0000","last_clean":"2024-09-11T23:20:26.326292+0000","last_became_active":"2024-09-11T23:20:25.339621+0000","last_became_peered":"2024-09-11T23:20:25.339621+0000","last_unstale":"2024-09-11T23:20:26.326292+0000","last_undegraded":"2024-09-11T23:20:26.326292+0000","last_fullsized":"2024-09-11T23:20:26.326292+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:09.855814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594044+0000","last_change":"2024-09-11T23:20:24.332075+0000","last_active":"2024-09-11T23:20:26.594044+0000","last_peered":"2024-09-11T23:20:26.594044+0000","last_clean":"2024-09-11T23:20:26.594044+0000","last_became_active":"2024-09-11T23:20:24.331358+0000","last_became_peered":"2024-09-11T23:20:24.331358+0000","last_unstale":"2024-09-11T23:20:26.594044+0000","last_undegraded":"2024-09-11T23:20:26.594044+0000","last_fullsized":"2024-09-11T23:20:26.594044+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:35.523378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.286789+0000","last_change":"2024-09-11T23:20:25.320216+0000","last_active":"2024-09-11T23:20:26.286789+0000","last_peered":"2024-09-11T23:20:26.286789+0000","last_clean":"2024-09-11T23:20:26.286789+0000","last_became_active":"2024-09-11T23:20:25.319503+0000","last_became_peered":"2024-09-11T23:20:25.319503+0000","last_unstale":"2024-09-11T23:20:26.286789+0000","last_undegraded":"2024-09-11T23:20:26.286789+0000","last_fullsized":"2024-09-11T23:20:26.286789+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593594+0000","last_change":"2024-09-11T23:20:24.335490+0000","last_active":"2024-09-11T23:20:26.593594+0000","last_peered":"2024-09-11T23:20:26.593594+0000","last_clean":"2024-09-11T23:20:26.593594+0000","last_became_active":"2024-09-11T23:20:24.334640+0000","last_became_peered":"2024-09-11T23:20:24.334640+0000","last_unstale":"2024-09-11T23:20:26.593594+0000","last_undegraded":"2024-09-11T23:20:26.593594+0000","last_fullsized":"2024-09-11T23:20:26.593594+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.325885+0000","last_change":"2024-09-11T23:20:25.339159+0000","last_active":"2024-09-11T23:20:26.325885+0000","last_peered":"2024-09-11T23:20:26.325885+0000","last_clean":"2024-09-11T23:20:26.325885+0000","last_became_active":"2024-09-11T23:20:25.338863+0000","last_became_peered":"2024-09-11T23:20:25.338863+0000","last_unstale":"2024-09-11T23:20:26.325885+0000","last_undegraded":"2024-09-11T23:20:26.325885+0000","last_fullsized":"2024-09-11T23:20:26.325885+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:08.352967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326032+0000","last_change":"2024-09-11T23:20:24.329407+0000","last_active":"2024-09-11T23:20:26.326032+0000","last_peered":"2024-09-11T23:20:26.326032+0000","last_clean":"2024-09-11T23:20:26.326032+0000","last_became_active":"2024-09-11T23:20:24.329085+0000","last_became_peered":"2024-09-11T23:20:24.329085+0000","last_unstale":"2024-09-11T23:20:26.326032+0000","last_undegraded":"2024-09-11T23:20:26.326032+0000","last_fullsized":"2024-09-11T23:20:26.326032+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:21:35.902330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592425+0000","last_change":"2024-09-11T23:20:25.313545+0000","last_active":"2024-09-11T23:20:26.592425+0000","last_peered":"2024-09-11T23:20:26.592425+0000","last_clean":"2024-09-11T23:20:26.592425+0000","last_became_active":"2024-09-11T23:20:25.312767+0000","last_became_peered":"2024-09-11T23:20:25.312767+0000","last_unstale":"2024-09-11T23:20:26.592425+0000","last_undegraded":"2024-09-11T23:20:26.592425+0000","last_fullsized":"2024-09-11T23:20:26.592425+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592909+0000","last_change":"2024-09-11T23:20:24.328751+0000","last_active":"2024-09-11T23:20:26.592909+0000","last_peered":"2024-09-11T23:20:26.592909+0000","last_clean":"2024-09-11T23:20:26.592909+0000","last_became_active":"2024-09-11T23:20:24.327979+0000","last_became_peered":"2024-09-11T23:20:24.327979+0000","last_unstale":"2024-09-11T23:20:26.592909+0000","last_undegraded":"2024-09-11T23:20:26.592909+0000","last_fullsized":"2024-09-11T23:20:26.592909+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:56.196175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593638+0000","last_change":"2024-09-11T23:20:25.329563+0000","last_active":"2024-09-11T23:20:26.593638+0000","last_peered":"2024-09-11T23:20:26.593638+0000","last_clean":"2024-09-11T23:20:26.593638+0000","last_became_active":"2024-09-11T23:20:25.329323+0000","last_became_peered":"2024-09-11T23:20:25.329323+0000","last_unstale":"2024-09-11T23:20:26.593638+0000","last_undegraded":"2024-09-11T23:20:26.593638+0000","last_fullsized":"2024-09-11T23:20:26.593638+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:24.491165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593158+0000","last_change":"2024-09-11T23:20:24.315984+0000","last_active":"2024-09-11T23:20:26.593158+0000","last_peered":"2024-09-11T23:20:26.593158+0000","last_clean":"2024-09-11T23:20:26.593158+0000","last_became_active":"2024-09-11T23:20:24.315560+0000","last_became_peered":"2024-09-11T23:20:24.315560+0000","last_unstale":"2024-09-11T23:20:26.593158+0000","last_undegraded":"2024-09-11T23:20:26.593158+0000","last_fullsized":"2024-09-11T23:20:26.593158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.285692+0000","last_change":"2024-09-11T23:20:25.304857+0000","last_active":"2024-09-11T23:20:26.285692+0000","last_peered":"2024-09-11T23:20:26.285692+0000","last_clean":"2024-09-11T23:20:26.285692+0000","last_became_active":"2024-09-11T23:20:25.302838+0000","last_became_peered":"2024-09-11T23:20:25.302838+0000","last_unstale":"2024-09-11T23:20:26.285692+0000","last_undegraded":"2024-09-11T23:20:26.285692+0000","last_fullsized":"2024-09-11T23:20:26.285692+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:17.227664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592738+0000","last_change":"2024-09-11T23:20:24.327068+0000","last_active":"2024-09-11T23:20:26.592738+0000","last_peered":"2024-09-11T23:20:26.592738+0000","last_clean":"2024-09-11T23:20:26.592738+0000","last_became_active":"2024-09-11T23:20:24.326400+0000","last_became_peered":"2024-09-11T23:20:24.326400+0000","last_unstale":"2024-09-11T23:20:26.592738+0000","last_undegraded":"2024-09-11T23:20:26.592738+0000","last_fullsized":"2024-09-11T23:20:26.592738+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.621305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326470+0000","last_change":"2024-09-11T23:20:25.310109+0000","last_active":"2024-09-11T23:20:26.326470+0000","last_peered":"2024-09-11T23:20:26.326470+0000","last_clean":"2024-09-11T23:20:26.326470+0000","last_became_active":"2024-09-11T23:20:25.309368+0000","last_became_peered":"2024-09-11T23:20:25.309368+0000","last_unstale":"2024-09-11T23:20:26.326470+0000","last_undegraded":"2024-09-11T23:20:26.326470+0000","last_fullsized":"2024-09-11T23:20:26.326470+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:10.140672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326460+0000","last_change":"2024-09-11T23:20:24.333009+0000","last_active":"2024-09-11T23:20:26.326460+0000","last_peered":"2024-09-11T23:20:26.326460+0000","last_clean":"2024-09-11T23:20:26.326460+0000","last_became_active":"2024-09-11T23:20:24.332693+0000","last_became_peered":"2024-09-11T23:20:24.332693+0000","last_unstale":"2024-09-11T23:20:26.326460+0000","last_undegraded":"2024-09-11T23:20:26.326460+0000","last_fullsized":"2024-09-11T23:20:26.326460+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:01.570200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591523+0000","last_change":"2024-09-11T23:20:25.347070+0000","last_active":"2024-09-11T23:20:26.591523+0000","last_peered":"2024-09-11T23:20:26.591523+0000","last_clean":"2024-09-11T23:20:26.591523+0000","last_became_active":"2024-09-11T23:20:25.346721+0000","last_became_peered":"2024-09-11T23:20:25.346721+0000","last_unstale":"2024-09-11T23:20:26.591523+0000","last_undegraded":"2024-09-11T23:20:26.591523+0000","last_fullsized":"2024-09-11T23:20:26.591523+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:06.072747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"115'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326491+0000","last_change":"2024-09-11T23:20:24.337900+0000","last_active":"2024-09-11T23:20:26.326491+0000","last_peered":"2024-09-11T23:20:26.326491+0000","last_clean":"2024-09-11T23:20:26.326491+0000","last_became_active":"2024-09-11T23:20:24.337161+0000","last_became_peered":"2024-09-11T23:20:24.337161+0000","last_unstale":"2024-09-11T23:20:26.326491+0000","last_undegraded":"2024-09-11T23:20:26.326491+0000","last_fullsized":"2024-09-11T23:20:26.326491+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.552237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.594058+0000","last_change":"2024-09-11T23:20:25.345508+0000","last_active":"2024-09-11T23:20:26.594058+0000","last_peered":"2024-09-11T23:20:26.594058+0000","last_clean":"2024-09-11T23:20:26.594058+0000","last_became_active":"2024-09-11T23:20:25.334570+0000","last_became_peered":"2024-09-11T23:20:25.334570+0000","last_unstale":"2024-09-11T23:20:26.594058+0000","last_undegraded":"2024-09-11T23:20:26.594058+0000","last_fullsized":"2024-09-11T23:20:26.594058+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.324474+0000","last_change":"2024-09-11T23:20:24.338421+0000","last_active":"2024-09-11T23:20:26.324474+0000","last_peered":"2024-09-11T23:20:26.324474+0000","last_clean":"2024-09-11T23:20:26.324474+0000","last_became_active":"2024-09-11T23:20:24.337643+0000","last_became_peered":"2024-09-11T23:20:24.337643+0000","last_unstale":"2024-09-11T23:20:26.324474+0000","last_undegraded":"2024-09-11T23:20:26.324474+0000","last_fullsized":"2024-09-11T23:20:26.324474+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:53.595358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.283586+0000","last_change":"2024-09-11T23:20:25.299309+0000","last_active":"2024-09-11T23:20:26.283586+0000","last_peered":"2024-09-11T23:20:26.283586+0000","last_clean":"2024-09-11T23:20:26.283586+0000","last_became_active":"2024-09-11T23:20:25.297851+0000","last_became_peered":"2024-09-11T23:20:25.297851+0000","last_unstale":"2024-09-11T23:20:26.283586+0000","last_undegraded":"2024-09-11T23:20:26.283586+0000","last_fullsized":"2024-09-11T23:20:26.283586+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:17.479362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326477+0000","last_change":"2024-09-11T23:20:24.332815+0000","last_active":"2024-09-11T23:20:26.326477+0000","last_peered":"2024-09-11T23:20:26.326477+0000","last_clean":"2024-09-11T23:20:26.326477+0000","last_became_active":"2024-09-11T23:20:24.329061+0000","last_became_peered":"2024-09-11T23:20:24.329061+0000","last_unstale":"2024-09-11T23:20:26.326477+0000","last_undegraded":"2024-09-11T23:20:26.326477+0000","last_fullsized":"2024-09-11T23:20:26.326477+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:11.439818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326064+0000","last_change":"2024-09-11T23:20:25.306535+0000","last_active":"2024-09-11T23:20:26.326064+0000","last_peered":"2024-09-11T23:20:26.326064+0000","last_clean":"2024-09-11T23:20:26.326064+0000","last_became_active":"2024-09-11T23:20:25.305770+0000","last_became_peered":"2024-09-11T23:20:25.305770+0000","last_unstale":"2024-09-11T23:20:26.326064+0000","last_undegraded":"2024-09-11T23:20:26.326064+0000","last_fullsized":"2024-09-11T23:20:26.326064+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.434792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287672+0000","last_change":"2024-09-11T23:20:24.320586+0000","last_active":"2024-09-11T23:20:26.287672+0000","last_peered":"2024-09-11T23:20:26.287672+0000","last_clean":"2024-09-11T23:20:26.287672+0000","last_became_active":"2024-09-11T23:20:24.318863+0000","last_became_peered":"2024-09-11T23:20:24.318863+0000","last_unstale":"2024-09-11T23:20:26.287672+0000","last_undegraded":"2024-09-11T23:20:26.287672+0000","last_fullsized":"2024-09-11T23:20:26.287672+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:15.913501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593480+0000","last_change":"2024-09-11T23:20:25.340416+0000","last_active":"2024-09-11T23:20:26.593480+0000","last_peered":"2024-09-11T23:20:26.593480+0000","last_clean":"2024-09-11T23:20:26.593480+0000","last_became_active":"2024-09-11T23:20:25.340059+0000","last_became_peered":"2024-09-11T23:20:25.340059+0000","last_unstale":"2024-09-11T23:20:26.593480+0000","last_undegraded":"2024-09-11T23:20:26.593480+0000","last_fullsized":"2024-09-11T23:20:26.593480+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:09.498560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.287454+0000","last_change":"2024-09-11T23:20:24.326408+0000","last_active":"2024-09-11T23:20:26.287454+0000","last_peered":"2024-09-11T23:20:26.287454+0000","last_clean":"2024-09-11T23:20:26.287454+0000","last_became_active":"2024-09-11T23:20:24.325048+0000","last_became_peered":"2024-09-11T23:20:24.325048+0000","last_unstale":"2024-09-11T23:20:26.287454+0000","last_undegraded":"2024-09-11T23:20:26.287454+0000","last_fullsized":"2024-09-11T23:20:26.287454+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:42.220068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592996+0000","last_change":"2024-09-11T23:20:25.344908+0000","last_active":"2024-09-11T23:20:26.592996+0000","last_peered":"2024-09-11T23:20:26.592996+0000","last_clean":"2024-09-11T23:20:26.592996+0000","last_became_active":"2024-09-11T23:20:25.332677+0000","last_became_peered":"2024-09-11T23:20:25.332677+0000","last_unstale":"2024-09-11T23:20:26.592996+0000","last_undegraded":"2024-09-11T23:20:26.592996+0000","last_fullsized":"2024-09-11T23:20:26.592996+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.326025+0000","last_change":"2024-09-11T23:20:24.329376+0000","last_active":"2024-09-11T23:20:26.326025+0000","last_peered":"2024-09-11T23:20:26.326025+0000","last_clean":"2024-09-11T23:20:26.326025+0000","last_became_active":"2024-09-11T23:20:24.328840+0000","last_became_peered":"2024-09-11T23:20:24.328840+0000","last_unstale":"2024-09-11T23:20:26.326025+0000","last_undegraded":"2024-09-11T23:20:26.326025+0000","last_fullsized":"2024-09-11T23:20:26.326025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:56.943934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.591937+0000","last_change":"2024-09-11T23:20:25.338915+0000","last_active":"2024-09-11T23:20:26.591937+0000","last_peered":"2024-09-11T23:20:26.591937+0000","last_clean":"2024-09-11T23:20:26.591937+0000","last_became_active":"2024-09-11T23:20:25.338405+0000","last_became_peered":"2024-09-11T23:20:25.338405+0000","last_unstale":"2024-09-11T23:20:26.591937+0000","last_undegraded":"2024-09-11T23:20:26.591937+0000","last_fullsized":"2024-09-11T23:20:26.591937+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:08.662586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592755+0000","last_change":"2024-09-11T23:20:24.339006+0000","last_active":"2024-09-11T23:20:26.592755+0000","last_peered":"2024-09-11T23:20:26.592755+0000","last_clean":"2024-09-11T23:20:26.592755+0000","last_became_active":"2024-09-11T23:20:24.338153+0000","last_became_peered":"2024-09-11T23:20:24.338153+0000","last_unstale":"2024-09-11T23:20:26.592755+0000","last_undegraded":"2024-09-11T23:20:26.592755+0000","last_fullsized":"2024-09-11T23:20:26.592755+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:53.595358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593565+0000","last_change":"2024-09-11T23:20:25.350849+0000","last_active":"2024-09-11T23:20:26.593565+0000","last_peered":"2024-09-11T23:20:26.593565+0000","last_clean":"2024-09-11T23:20:26.593565+0000","last_became_active":"2024-09-11T23:20:25.346375+0000","last_became_peered":"2024-09-11T23:20:25.346375+0000","last_unstale":"2024-09-11T23:20:26.593565+0000","last_undegraded":"2024-09-11T23:20:26.593565+0000","last_fullsized":"2024-09-11T23:20:26.593565+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:24.281424+0000","last_clean_scrub_stamp":"2024-09-11T23:20:24.281424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.627395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"114'8","reported_seq":22,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.592402+0000","last_change":"2024-09-11T23:20:24.325822+0000","last_active":"2024-09-11T23:20:26.592402+0000","last_peered":"2024-09-11T23:20:26.592402+0000","last_clean":"2024-09-11T23:20:26.592402+0000","last_became_active":"2024-09-11T23:20:24.325497+0000","last_became_peered":"2024-09-11T23:20:24.325497+0000","last_unstale":"2024-09-11T23:20:26.592402+0000","last_undegraded":"2024-09-11T23:20:26.592402+0000","last_fullsized":"2024-09-11T23:20:26.592402+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:23.266192+0000","last_clean_scrub_stamp":"2024-09-11T23:20:23.266192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.171149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":347,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:20:26.593046+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:20:26.593046+0000","last_peered":"2024-09-11T23:20:26.593046+0000","last_clean":"2024-09-11T23:20:26.593046+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:20:26.593046+0000","last_undegraded":"2024-09-11T23:20:26.593046+0000","last_fullsized":"2024-09-11T23:20:26.593046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41492,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330348,"statfs":{"total":96636764160,"available":96594276352,"internally_reserved":0,"allocated":2031616,"data_stored":1250785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1437696,"data_stored":666915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40920,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330920,"statfs":{"total":96636764160,"available":96594862080,"internally_reserved":0,"allocated":1441792,"data_stored":666493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40928,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330912,"statfs":{"total":96636764160,"available":96594853888,"internally_reserved":0,"allocated":1445888,"data_stored":667945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28448,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343392,"statfs":{"total":96636764160,"available":96607633408,"internally_reserved":0,"allocated":1449984,"data_stored":667979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1433600,"data_stored":666333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1425408,"data_stored":659663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33176,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338664,"statfs":{"total":96636764160,"available":96602791936,"internally_reserved":0,"allocated":2031616,"data_stored":1256723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:20:29.724 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:20:29.725 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:20:29.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f74382c6640 1 Processor -- start 2024-09-11T23:20:29.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f74382c6640 1 -- start start 2024-09-11T23:20:29.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f74382c6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f743015e4f0 0x7f74300d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f74382c6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300d4e20 0x7f74300cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f74382c6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74300d0350 con 0x7f7430162070 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f74382c6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f74300cf070 con 0x7f743015e4f0 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f74382c6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74300d1c20 con 0x7f74300d4e20 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f7436863640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7430162070 0x7f74300b7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42282/0 (socket says 172.21.15.94:42282) 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f7436863640 1 -- 172.21.15.94:0/3457745534 learned_addr learned my addr 172.21.15.94:0/3457745534 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f7436062640 1 --2- 172.21.15.94:0/3457745534 >> v2:172.21.15.155:3300/0 conn(0x7f743015e4f0 0x7f74300d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f7435861640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300d4e20 0x7f74300cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790319576 0 0) 0x7f74300d0350 con 0x7f7430162070 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.888+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f741c003530 con 0x7f7430162070 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4234510805 0 0) 0x7f741c003530 con 0x7f7430162070 2024-09-11T23:20:29.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300d4e20 msgr2=0x7f74300cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300d4e20 0x7f74300cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 >> v2:172.21.15.155:3300/0 conn(0x7f743015e4f0 msgr2=0x7f74300d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 --2- 172.21.15.94:0/3457745534 >> v2:172.21.15.155:3300/0 conn(0x7f743015e4f0 0x7f74300d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74300cf330 con 0x7f7430162070 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7428001a00 con 0x7f7430162070 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 >> v1:172.21.15.94:6789/0 conn(0x7f7430162070 legacy=0x7f74300b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0039c0 0x7f741c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300d4e20 0x7f741c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f74300cf070 con 0x7f741c004d50 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74300d1c20 con 0x7f741c0039c0 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f741c00b9d0 con 0x7f74300d4e20 2024-09-11T23:20:29.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7436863640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7436062640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0039c0 0x7f741c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7436863640 1 -- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300d4e20 msgr2=0x7f741c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:29.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7436863640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300d4e20 0x7f741c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7436863640 1 -- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0039c0 msgr2=0x7f741c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:29.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7436863640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0039c0 0x7f741c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.892+0000 7f7436863640 1 -- 172.21.15.94:0/3457745534 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c003530 con 0x7f741c004d50 2024-09-11T23:20:29.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f7436863640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f74280013e0 tx=0x7f742801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61524a44bdcc315f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742800a4e0 con 0x7f741c004d50 2024-09-11T23:20:29.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74280072f0 con 0x7f741c004d50 2024-09-11T23:20:29.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f7435060640 1 -- 172.21.15.94:0/3457745534 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74280076e0 con 0x7f741c004d50 2024-09-11T23:20:29.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f74382c6640 1 -- 172.21.15.94:0/3457745534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 msgr2=0x7f741c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f74382c6640 1 --2- 172.21.15.94:0/3457745534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f741c004d50 0x7f741c0051d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f74280013e0 tx=0x7f742801d3a0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f7436863640 1 -- 172.21.15.94:0/3457745534 reap_dead start 2024-09-11T23:20:29.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f74382c6640 1 -- 172.21.15.94:0/3457745534 shutdown_connections 2024-09-11T23:20:29.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f74382c6640 1 -- 172.21.15.94:0/3457745534 >> 172.21.15.94:0/3457745534 conn(0x7f743008bf90 msgr2=0x7f74300d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:29.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f74382c6640 1 -- 172.21.15.94:0/3457745534 shutdown_connections 2024-09-11T23:20:29.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.896+0000 7f74382c6640 1 -- 172.21.15.94:0/3457745534 wait complete. 2024-09-11T23:20:29.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 Processor -- start 2024-09-11T23:20:29.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 -- start start 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7430159bd0 0x7f7430160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74301612b0 0x7f7430143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7430144500 0x7f7430157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f743015e8d0 con 0x7f7430159bd0 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74300cf8f0 con 0x7f7430144500 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74300d5270 con 0x7f74301612b0 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7430159bd0 0x7f7430160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7430159bd0 0x7f7430160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58018/0 (socket says 172.21.15.94:58018) 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 -- 172.21.15.94:0/2045322250 learned_addr learned my addr 172.21.15.94:0/2045322250 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:29.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436863640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7430144500 0x7f7430157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7435861640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74301612b0 0x7f7430143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 -- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74301612b0 msgr2=0x7f7430143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74301612b0 0x7f7430143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 -- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7430144500 msgr2=0x7f7430157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7430144500 0x7f7430157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 -- 172.21.15.94:0/2045322250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743015fcd0 con 0x7f7430159bd0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436863640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7430144500 0x7f7430157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7436062640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7430159bd0 0x7f7430160d70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f742c011660 tx=0x7f742c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7426ffd640 1 -- 172.21.15.94:0/2045322250 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c00f9c0 con 0x7f7430159bd0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7426ffd640 1 -- 172.21.15.94:0/2045322250 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c00fb60 con 0x7f7430159bd0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743015ffb0 con 0x7f7430159bd0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7426ffd640 1 -- 172.21.15.94:0/2045322250 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c015460 con 0x7f7430159bd0 2024-09-11T23:20:29.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7430160570 con 0x7f7430159bd0 2024-09-11T23:20:29.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74300d15d0 con 0x7f7430159bd0 2024-09-11T23:20:29.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.900+0000 7f7426ffd640 1 -- 172.21.15.94:0/2045322250 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f742c015600 con 0x7f7430159bd0 2024-09-11T23:20:29.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.904+0000 7f7426ffd640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74140678c0 0x7f7414069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:29.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.904+0000 7f7426ffd640 1 -- 172.21.15.94:0/2045322250 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f742c0867b0 con 0x7f7430159bd0 2024-09-11T23:20:29.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.904+0000 7f7435861640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74140678c0 0x7f7414069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:29.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.904+0000 7f7435861640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74140678c0 0x7f7414069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f74200047c0 tx=0x7f7420008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:29.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:29.908+0000 7f7426ffd640 1 -- 172.21.15.94:0/2045322250 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f742c019030 con 0x7f7430159bd0 2024-09-11T23:20:30.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.128+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f743015dee0 con 0x7f7430159bd0 2024-09-11T23:20:30.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f7426ffd640 1 -- 172.21.15.94:0/2045322250 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f742c0571f0 con 0x7f7430159bd0 2024-09-11T23:20:30.134 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-11T23:20:30.134 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBIJOJmOZdbAhAAM0RN5s6yXnzAFvVqlld7JQ== 2024-09-11T23:20:30.134 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2024-09-11T23:20:30.134 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2024-09-11T23:20:30.134 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:20:30.134 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74140678c0 msgr2=0x7f7414069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74140678c0 0x7f7414069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f74200047c0 tx=0x7f7420008040 comp rx=0 tx=0).stop 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7430159bd0 msgr2=0x7f7430160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7430159bd0 0x7f7430160d70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f742c011660 tx=0x7f742c011b20 comp rx=0 tx=0).stop 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 shutdown_connections 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7430144500 0x7f7430157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74301612b0 0x7f7430143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f74140678c0 0x7f7414069d80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 --2- 172.21.15.94:0/2045322250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7430159bd0 0x7f7430160d70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.132+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 >> 172.21.15.94:0/2045322250 conn(0x7f743008bf90 msgr2=0x7f74300d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:30.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.136+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 shutdown_connections 2024-09-11T23:20:30.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.136+0000 7f74382c6640 1 -- 172.21.15.94:0/2045322250 wait complete. 2024-09-11T23:20:30.152 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:30.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.268+0000 7f6d8bf91640 1 Processor -- start 2024-09-11T23:20:30.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.268+0000 7f6d8bf91640 1 -- start start 2024-09-11T23:20:30.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d841520a0 0x7f6d8406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8406fe50 0x7f6d8415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d8415f1d0 0x7f6d84071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6d84152480 con 0x7f6d8415f1d0 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6d84070250 con 0x7f6d841520a0 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d840aede0 con 0x7f6d8406fe50 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d8415f1d0 0x7f6d84071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d8415f1d0 0x7f6d84071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58026/0 (socket says 172.21.15.94:58026) 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2428361718 learned_addr learned my addr 172.21.15.94:0/2428361718 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2428361718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8406fe50 msgr2=0x7f6d8415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d89d2d640 1 --2- 172.21.15.94:0/2428361718 >> v2:172.21.15.155:3300/0 conn(0x7f6d841520a0 0x7f6d8406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8952c640 1 --2- 172.21.15.94:0/2428361718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8406fe50 0x7f6d8415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 --2- 172.21.15.94:0/2428361718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8406fe50 0x7f6d8415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2428361718 >> v2:172.21.15.155:3300/0 conn(0x7f6d841520a0 msgr2=0x7f6d8406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:30.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 --2- 172.21.15.94:0/2428361718 >> v2:172.21.15.155:3300/0 conn(0x7f6d841520a0 0x7f6d8406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2428361718 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8415fa10 con 0x7f6d8415f1d0 2024-09-11T23:20:30.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d89d2d640 1 --2- 172.21.15.94:0/2428361718 >> v2:172.21.15.155:3300/0 conn(0x7f6d841520a0 0x7f6d8406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:30.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8a52e640 1 --2- 172.21.15.94:0/2428361718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d84071f10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6d84071710 tx=0x7f6d7c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7b08c5fb0f41b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:30.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d88d2b640 1 -- 172.21.15.94:0/2428361718 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0a5590 con 0x7f6d8415f1d0 2024-09-11T23:20:30.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d88d2b640 1 -- 172.21.15.94:0/2428361718 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0a5730 con 0x7f6d8415f1d0 2024-09-11T23:20:30.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d88d2b640 1 -- 172.21.15.94:0/2428361718 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0a5b00 con 0x7f6d8415f1d0 2024-09-11T23:20:30.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2428361718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 msgr2=0x7f6d84071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2428361718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d84071f10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6d84071710 tx=0x7f6d7c01c710 comp rx=0 tx=0).stop 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2428361718 shutdown_connections 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2428361718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d84071f10 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2428361718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8406fe50 0x7f6d8415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2428361718 >> v2:172.21.15.155:3300/0 conn(0x7f6d841520a0 0x7f6d8406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2428361718 >> 172.21.15.94:0/2428361718 conn(0x7f6d840b1f90 msgr2=0x7f6d840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2428361718 shutdown_connections 2024-09-11T23:20:30.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.272+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2428361718 wait complete. 2024-09-11T23:20:30.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 Processor -- start 2024-09-11T23:20:30.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 -- start start 2024-09-11T23:20:30.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8406fe50 0x7f6d84099ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d841520a0 0x7f6d84164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d840cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84073d30 con 0x7f6d8415f1d0 2024-09-11T23:20:30.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84073a50 con 0x7f6d8406fe50 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8415f680 con 0x7f6d841520a0 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d840cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d840cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58028/0 (socket says 172.21.15.94:58028) 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2198627855 learned_addr learned my addr 172.21.15.94:0/2198627855 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8952c640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d841520a0 0x7f6d84164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d89d2d640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8406fe50 0x7f6d84099ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d841520a0 msgr2=0x7f6d84164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d841520a0 0x7f6d84164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8406fe50 msgr2=0x7f6d84099ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8406fe50 0x7f6d84099ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 -- 172.21.15.94:0/2198627855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d84164a00 con 0x7f6d8415f1d0 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8952c640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d841520a0 0x7f6d84164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:30.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d89d2d640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8406fe50 0x7f6d84099ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:30.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8a52e640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d840cd3a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0af040 tx=0x7f6d7c0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:30.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d7a7fc640 1 -- 172.21.15.94:0/2198627855 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0b8440 con 0x7f6d8415f1d0 2024-09-11T23:20:30.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d7a7fc640 1 -- 172.21.15.94:0/2198627855 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0b8620 con 0x7f6d8415f1d0 2024-09-11T23:20:30.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d84164ce0 con 0x7f6d8415f1d0 2024-09-11T23:20:30.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d7a7fc640 1 -- 172.21.15.94:0/2198627855 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0b8a10 con 0x7f6d8415f1d0 2024-09-11T23:20:30.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d841652a0 con 0x7f6d8415f1d0 2024-09-11T23:20:30.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.276+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8406f910 con 0x7f6d8415f1d0 2024-09-11T23:20:30.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.280+0000 7f6d7a7fc640 1 -- 172.21.15.94:0/2198627855 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6d7c0c1020 con 0x7f6d8415f1d0 2024-09-11T23:20:30.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.280+0000 7f6d7a7fc640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d680678c0 0x7f6d68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.280+0000 7f6d7a7fc640 1 -- 172.21.15.94:0/2198627855 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f6d7c120560 con 0x7f6d8415f1d0 2024-09-11T23:20:30.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.280+0000 7f6d89d2d640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d680678c0 0x7f6d68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.280+0000 7f6d89d2d640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d680678c0 0x7f6d68069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6d840cf290 tx=0x7f6d80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:30.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.284+0000 7f6d7a7fc640 1 -- 172.21.15.94:0/2198627855 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6d7c0165c0 con 0x7f6d8415f1d0 2024-09-11T23:20:30.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.480+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d8415e3f0 con 0x7f6d8415f1d0 2024-09-11T23:20:30.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d7a7fc640 1 -- 172.21.15.94:0/2198627855 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5225 (secure 0 0 0) 0x7f6d7c0f0f10 con 0x7f6d8415f1d0 2024-09-11T23:20:30.484 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:30.484 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":72,"btime":"2024-09-11T23:20:28:318414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:24.648300+0000","modified":"2024-09-11T23:20:27.682973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/502410844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":502410844},{"type":"v1","addr":"172.21.15.94:6835","nonce":502410844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":8}]} 2024-09-11T23:20:30.485 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 72 2024-09-11T23:20:30.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d680678c0 msgr2=0x7f6d68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d680678c0 0x7f6d68069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6d840cf290 tx=0x7f6d80008040 comp rx=0 tx=0).stop 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 msgr2=0x7f6d840cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d840cd3a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0af040 tx=0x7f6d7c0194b0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 shutdown_connections 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6d680678c0 0x7f6d68069d80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d8415f1d0 0x7f6d840cd3a0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d841520a0 0x7f6d84164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 --2- 172.21.15.94:0/2198627855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8406fe50 0x7f6d84099ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 >> 172.21.15.94:0/2198627855 conn(0x7f6d840b1f90 msgr2=0x7f6d840cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 shutdown_connections 2024-09-11T23:20:30.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:30.484+0000 7f6d8bf91640 1 -- 172.21.15.94:0/2198627855 wait complete. 2024-09-11T23:20:30.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:20:24.648300+0000', 'modified': '2024-09-11T23:20:27.682973+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7137}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7137': {'gid': 7137, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6835/502410844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 502410844}, {'type': 'v1', 'addr': '172.21.15.94:6835', 'nonce': 502410844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7137, 'qdb_cluster': [7137]} 2024-09-11T23:20:30.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:20:30.906 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:20:31.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e3de69640 1 Processor -- start 2024-09-11T23:20:31.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e3de69640 1 -- start start 2024-09-11T23:20:31.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e3de69640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e3815bec0 0x7f2e380ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e3de69640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e3815c2a0 0x7f2e380aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e3de69640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e380b3290 con 0x7f2e380af2a0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e3de69640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2e380b3570 con 0x7f2e3815bec0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e3de69640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e380b3850 con 0x7f2e3815c2a0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e37fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2e380af2a0 0x7f2e3815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42288/0 (socket says 172.21.15.94:42288) 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e37fff640 1 -- 172.21.15.94:0/732341033 learned_addr learned my addr 172.21.15.94:0/732341033 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e2effd640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e3815c2a0 0x7f2e380aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e377fe640 1 --2- 172.21.15.94:0/732341033 >> v2:172.21.15.155:3300/0 conn(0x7f2e3815bec0 0x7f2e380ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604520417 0 0) 0x7f2e380b3290 con 0x7f2e380af2a0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e24003530 con 0x7f2e380af2a0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1120005930 0 0) 0x7f2e24003530 con 0x7f2e380af2a0 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e3815c2a0 msgr2=0x7f2e380aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e36ffd640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e3815c2a0 0x7f2e380aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 >> v2:172.21.15.155:3300/0 conn(0x7f2e3815bec0 msgr2=0x7f2e380ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.036+0000 7f2e36ffd640 1 --2- 172.21.15.94:0/732341033 >> v2:172.21.15.155:3300/0 conn(0x7f2e3815bec0 0x7f2e380ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e380b3b30 con 0x7f2e380af2a0 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f2e30001a00 con 0x7f2e380af2a0 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 >> v1:172.21.15.94:6789/0 conn(0x7f2e380af2a0 legacy=0x7f2e3815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e3815c2a0 0x7f2e240039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e24003f90 0x7f2e24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e24004d50 0x7f2e240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380b3570 con 0x7f2e24004d50 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380b3850 con 0x7f2e24003f90 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2400b9d0 con 0x7f2e3815c2a0 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e24004d50 0x7f2e240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e2effd640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e24003f90 0x7f2e24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 -- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e3815c2a0 msgr2=0x7f2e240039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e3815c2a0 0x7f2e240039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 -- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e24003f90 msgr2=0x7f2e24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e24003f90 0x7f2e24004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 -- 172.21.15.94:0/732341033 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e24003530 con 0x7f2e24004d50 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e24004d50 0x7f2e240051d0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000a7e0 tx=0x7f2e3001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00bf81da3702682 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000a3d0 con 0x7f2e24004d50 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e300ad650 con 0x7f2e24004d50 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e36ffd640 1 -- 172.21.15.94:0/732341033 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300ada40 con 0x7f2e24004d50 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e3de69640 1 -- 172.21.15.94:0/732341033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e24004d50 msgr2=0x7f2e240051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e3de69640 1 --2- 172.21.15.94:0/732341033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e24004d50 0x7f2e240051d0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000a7e0 tx=0x7f2e3001d2c0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e37fff640 1 -- 172.21.15.94:0/732341033 reap_dead start 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e3de69640 1 -- 172.21.15.94:0/732341033 shutdown_connections 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e3de69640 1 -- 172.21.15.94:0/732341033 >> 172.21.15.94:0/732341033 conn(0x7f2e380b1f90 msgr2=0x7f2e380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e3de69640 1 -- 172.21.15.94:0/732341033 shutdown_connections 2024-09-11T23:20:31.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.040+0000 7f2e3de69640 1 -- 172.21.15.94:0/732341033 wait complete. 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 Processor -- start 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 -- start start 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e381f4e70 0x7f2e38154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e38153630 0x7f2e3815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3815f7c0 0x7f2e3815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380af730 con 0x7f2e38153630 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380b40f0 con 0x7f2e3815f7c0 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e380afc90 con 0x7f2e381f4e70 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e38153630 0x7f2e3815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e38153630 0x7f2e3815f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58054/0 (socket says 172.21.15.94:58054) 2024-09-11T23:20:31.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 -- 172.21.15.94:0/2998231985 learned_addr learned my addr 172.21.15.94:0/2998231985 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e37fff640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3815f7c0 0x7f2e3815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e377fe640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e381f4e70 0x7f2e38154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 -- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e381f4e70 msgr2=0x7f2e38154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e381f4e70 0x7f2e38154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 -- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3815f7c0 msgr2=0x7f2e3815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3815f7c0 0x7f2e3815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 -- 172.21.15.94:0/2998231985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e381f5250 con 0x7f2e38153630 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e2effd640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e38153630 0x7f2e3815f280 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2e200108c0 tx=0x7f2e20010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e34ff9640 1 -- 172.21.15.94:0/2998231985 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2000f040 con 0x7f2e38153630 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e34ff9640 1 -- 172.21.15.94:0/2998231985 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2000eb60 con 0x7f2e38153630 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e38153b30 con 0x7f2e38153630 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e34ff9640 1 -- 172.21.15.94:0/2998231985 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2001c400 con 0x7f2e38153630 2024-09-11T23:20:31.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.044+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e381540f0 con 0x7f2e38153630 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e34ff9640 1 -- 172.21.15.94:0/2998231985 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e2001c5a0 con 0x7f2e38153630 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e34ff9640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2e180678c0 0x7f2e18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e34ff9640 1 -- 172.21.15.94:0/2998231985 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f2e200864c0 con 0x7f2e38153630 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e377fe640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2e180678c0 0x7f2e18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 Processor -- start 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- start start 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e377fe640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2e180678c0 0x7f2e18069d80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2e280047c0 tx=0x7f2e28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd5b20 0x55b436dd5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436d8bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436d8c290 0x55b436d8c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b436c73b60 con 0x55b436dd6440 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b436bdac70 con 0x55b436d8c290 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b436b80ed0 con 0x55b436dd5b20 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436d8bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436d8bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58066/0 (socket says 172.21.15.94:58066) 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 -- 172.21.15.94:0/263038056 learned_addr learned my addr 172.21.15.94:0/263038056 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e37fff640 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436d8c290 0x55b436d8c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e377fe640 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd5b20 0x55b436dd5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 -- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd5b20 msgr2=0x55b436dd5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd5b20 0x55b436dd5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 -- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436d8c290 msgr2=0x55b436d8c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436d8c290 0x55b436d8c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 -- 172.21.15.94:0/263038056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b436b92e50 con 0x55b436dd6440 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e37fff640 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436d8c290 0x55b436d8c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2effd640 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436d8bd50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2e20052bd0 tx=0x7f2e20056670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406c3031fbf2da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2d7fa640 1 -- 172.21.15.94:0/263038056 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2005f350 con 0x55b436dd6440 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2d7fa640 1 -- 172.21.15.94:0/263038056 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e20054a70 con 0x55b436dd6440 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e2d7fa640 1 -- 172.21.15.94:0/263038056 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2001d020 con 0x55b436dd6440 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- 172.21.15.94:0/263038056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 msgr2=0x55b436d8bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436d8bd50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2e20052bd0 tx=0x7f2e20056670 comp rx=0 tx=0).stop 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- 172.21.15.94:0/263038056 shutdown_connections 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436d8c290 0x55b436d8c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436d8bd50 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 --2- 172.21.15.94:0/263038056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd5b20 0x55b436dd5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- 172.21.15.94:0/263038056 >> 172.21.15.94:0/263038056 conn(0x55b436d92600 msgr2=0x55b436d8a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- 172.21.15.94:0/263038056 shutdown_connections 2024-09-11T23:20:31.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.048+0000 7f2e40f25000 1 -- 172.21.15.94:0/263038056 wait complete. 2024-09-11T23:20:31.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- start start 2024-09-11T23:20:31.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 Processor -- start 2024-09-11T23:20:31.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436d90e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd6440 0x55b436d96cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436d91390 0x55b436d97230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b436c3cb00 con 0x55b436d91390 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b436bb5360 con 0x55b436dd5b20 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b436bb22d0 con 0x55b436dd6440 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 10 client.0 _ll_register_callbacks cb 0x55b436d77820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436d91390 0x55b436d97230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436d91390 0x55b436d97230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58074/0 (socket says 172.21.15.94:58074) 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 -- 172.21.15.94:0/1164418357 learned_addr learned my addr 172.21.15.94:0/1164418357 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e2effd640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd6440 0x55b436d96cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e377fe640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436d90e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 -- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd6440 msgr2=0x55b436d96cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd6440 0x55b436d96cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 -- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 msgr2=0x55b436d90e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436d90e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 -- 172.21.15.94:0/1164418357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b436b81120 con 0x55b436d91390 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e377fe640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436d90e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e37fff640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436d91390 0x55b436d97230 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000a780 tx=0x7f2e3001a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8323064ed740e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 1 -- 172.21.15.94:0/1164418357 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000a3d0 con 0x55b436d91390 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 1 -- 172.21.15.94:0/1164418357 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f2e300b2040 con 0x55b436d91390 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e20054a70 con 0x55b436d91390 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 1 -- 172.21.15.94:0/1164418357 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f2e300c1050 con 0x55b436d91390 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 10 client.7254 fetch_fsmap learned FSMap version 72 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55b436b7a450 con 0x55b436d91390 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 1 -- 172.21.15.94:0/1164418357 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e20054a70 con 0x55b436d91390 2024-09-11T23:20:31.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 1 -- 172.21.15.94:0/1164418357 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f2e300c4020 con 0x55b436d91390 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 10 client.7254 fetch_fsmap finished waiting for FSMap version 72 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 10 client.7254 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 20 client.7254 populate_metadata read hostname 'smithi094' 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436de4280 0x55b436de6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 4 client.7254 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 --> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b436b74c00 con 0x55b436de4280 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e377fe640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436de4280 0x55b436de6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 10 client.7254 ms_handle_connect on v2:172.21.15.94:6834/502410844 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e377fe640 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436de4280 0x55b436de6670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30d79d6a740c05b server_cookie=b7fee1d69d40d56d in_seq=0 out_seq=0 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 1 -- 172.21.15.94:0/1164418357 <== mds.0 v2:172.21.15.94:6834/502410844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b436b74c00 con 0x55b436de4280 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e167fc640 10 client.7254 handle_command_reply: tid=0 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 client.7254 shutdown 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436d91390 msgr2=0x55b436d97230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.052+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436d91390 0x55b436d97230 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000a780 tx=0x7f2e3001a060 comp rx=0 tx=0).stop 2024-09-11T23:20:31.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 shutdown_connections 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436de4280 0x55b436de6670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436d91390 0x55b436d97230 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436dd6440 0x55b436d96cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e167fc640 0 client.7254 ms_handle_reset on v2:172.21.15.94:6834/502410844 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1164418357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436d90e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 >> 172.21.15.94:0/1164418357 conn(0x55b436d8c290 msgr2=0x55b436d8ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 shutdown_connections 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 1 -- 172.21.15.94:0/1164418357 wait complete. 2024-09-11T23:20:31.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.056+0000 7f2e40f25000 20 client.7254 trim_cache size 0 max 16384 2024-09-11T23:20:31.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 Processor -- start 2024-09-11T23:20:31.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 -- start start 2024-09-11T23:20:31.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 0x55b436dd4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436dd51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436de6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2e381fe8c0 con 0x55b436dd6440 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e381423c0 con 0x55b436dd5b20 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e381fe270 con 0x55b436d91390 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436de6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436de6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58088/0 (socket says 172.21.15.94:58088) 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 -- 172.21.15.94:0/2742689432 learned_addr learned my addr 172.21.15.94:0/2742689432 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 -- 172.21.15.94:0/2742689432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 msgr2=0x55b436dd4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 0x55b436dd4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e2effd640 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436dd51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 -- 172.21.15.94:0/2742689432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 msgr2=0x55b436dd51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436dd51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 -- 172.21.15.94:0/2742689432 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b436b61fd0 con 0x55b436dd6440 2024-09-11T23:20:31.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.072+0000 7f2e37fff640 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436de6670 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f2e3001cd30 tx=0x7f2e30007050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b980b8227d82db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2cff9640 1 -- 172.21.15.94:0/2742689432 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300cb070 con 0x55b436dd6440 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2cff9640 1 -- 172.21.15.94:0/2742689432 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e300a5ca0 con 0x55b436dd6440 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2cff9640 1 -- 172.21.15.94:0/2742689432 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30001f30 con 0x55b436dd6440 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/2742689432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 msgr2=0x55b436de6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436de6670 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f2e3001cd30 tx=0x7f2e30007050 comp rx=0 tx=0).stop 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/2742689432 shutdown_connections 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd6440 0x55b436de6670 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd5b20 0x55b436dd51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- 172.21.15.94:0/2742689432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 0x55b436dd4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/2742689432 >> 172.21.15.94:0/2742689432 conn(0x55b436d8c290 msgr2=0x55b436d90650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/2742689432 shutdown_connections 2024-09-11T23:20:31.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/2742689432 wait complete. 2024-09-11T23:20:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- start start 2024-09-11T23:20:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 Processor -- start 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 0x55b436de9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd5b20 0x55b436e04960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd6440 0x55b436e04ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b436bd9f80 con 0x55b436dd5b20 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b436b92ca0 con 0x55b436dd6440 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b436bdf2a0 con 0x55b436d91390 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 10 client.0 _ll_register_callbacks cb 0x7f2e24003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd5b20 0x55b436e04960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd5b20 0x55b436e04960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58094/0 (socket says 172.21.15.94:58094) 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 -- 172.21.15.94:0/1461269656 learned_addr learned my addr 172.21.15.94:0/1461269656 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e37fff640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd6440 0x55b436e04ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e377fe640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 0x55b436de9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 -- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 msgr2=0x55b436de9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 0x55b436de9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 -- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd6440 msgr2=0x55b436e04ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd6440 0x55b436e04ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 -- 172.21.15.94:0/1461269656 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b436c5d750 con 0x55b436dd5b20 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e37fff640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd6440 0x55b436e04ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e2effd640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd5b20 0x55b436e04960 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f2e20056930 tx=0x7f2e20086050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c500792a304d560 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e167fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e167fc640 1 -- 172.21.15.94:0/1461269656 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20056540 con 0x55b436dd5b20 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e167fc640 1 -- 172.21.15.94:0/1461269656 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f2e200860c0 con 0x55b436dd5b20 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e300a5ca0 con 0x55b436dd5b20 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e167fc640 1 -- 172.21.15.94:0/1461269656 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f2e20078070 con 0x55b436dd5b20 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 10 client.7260 fetch_fsmap learned FSMap version 72 2024-09-11T23:20:31.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55b436b68a30 con 0x55b436dd5b20 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e167fc640 1 -- 172.21.15.94:0/1461269656 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e300a5ca0 con 0x55b436dd5b20 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e167fc640 1 -- 172.21.15.94:0/1461269656 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f2e200569d0 con 0x55b436dd5b20 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 10 client.7260 fetch_fsmap finished waiting for FSMap version 72 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 10 client.7260 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 20 client.7260 populate_metadata read hostname 'smithi094' 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436e053e0 0x55b436e48e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 4 client.7260 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 --> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] -- command(tid 0: {"prefix": "status"}) -- 0x55b436be83a0 con 0x55b436e053e0 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.076+0000 7f2e377fe640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436e053e0 0x55b436e48e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e377fe640 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436e053e0 0x55b436e48e10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a6eb692cb760dc server_cookie=2504f077ba7b5250 in_seq=0 out_seq=0 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e167fc640 10 client.7260 ms_handle_connect on v2:172.21.15.94:6834/502410844 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e167fc640 1 -- 172.21.15.94:0/1461269656 <== mds.0 v2:172.21.15.94:6834/502410844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55b436be83a0 con 0x55b436e053e0 2024-09-11T23:20:31.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e167fc640 10 client.7260 handle_command_reply: tid=0 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 client.7260 shutdown 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd5b20 msgr2=0x55b436e04960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd5b20 0x55b436e04960 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f2e20056930 tx=0x7f2e20086050 comp rx=0 tx=0).stop 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 shutdown_connections 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:6834/502410844,v1:172.21.15.94:6835/502410844] conn(0x55b436e053e0 0x55b436e48e10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b436dd6440 0x55b436e04ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e167fc640 0 client.7260 ms_handle_reset on v2:172.21.15.94:6834/502410844 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b436dd5b20 0x55b436e04960 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 --2- 172.21.15.94:0/1461269656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b436d91390 0x55b436de9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 >> 172.21.15.94:0/1461269656 conn(0x55b436d8c290 msgr2=0x55b436dd3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 shutdown_connections 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 1 -- 172.21.15.94:0/1461269656 wait complete. 2024-09-11T23:20:31.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e40f25000 20 client.7260 trim_cache size 0 max 16384 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6", 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 7137, 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 5.7705739649999996, 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 72, 2024-09-11T23:20:31.087 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 115, 2024-09-11T23:20:31.088 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 115, 2024-09-11T23:20:31.088 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 9.8407011309999994 2024-09-11T23:20:31.088 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:31.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2e180678c0 msgr2=0x7f2e18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2e180678c0 0x7f2e18069d80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2e280047c0 tx=0x7f2e28008040 comp rx=0 tx=0).stop 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e38153630 msgr2=0x7f2e3815f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e38153630 0x7f2e3815f280 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2e200108c0 tx=0x7f2e20010d80 comp rx=0 tx=0).stop 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 shutdown_connections 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3815f7c0 0x7f2e3815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2e180678c0 0x7f2e18069d80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e38153630 0x7f2e3815f280 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 --2- 172.21.15.94:0/2998231985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e381f4e70 0x7f2e38154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 >> 172.21.15.94:0/2998231985 conn(0x7f2e380b1f90 msgr2=0x7f2e380cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 shutdown_connections 2024-09-11T23:20:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.080+0000 7f2e3de69640 1 -- 172.21.15.94:0/2998231985 wait complete. 2024-09-11T23:20:31.097 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:20:31.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a11aa1640 1 Processor -- start 2024-09-11T23:20:31.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a11aa1640 1 -- start start 2024-09-11T23:20:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a11aa1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4a0c1567e0 0x7f4a0c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a11aa1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4a0c160460 0x7f4a0c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a11aa1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0b4620 con 0x7f4a0c0b3c40 2024-09-11T23:20:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a11aa1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c0b4900 con 0x7f4a0c160460 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a11aa1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c0b4be0 con 0x7f4a0c1567e0 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4a0c160460 0x7f4a0c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4a0c160460 0x7f4a0c15d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58104/0 (socket says 172.21.15.94:58104) 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 -- 172.21.15.94:0/2426218318 learned_addr learned my addr 172.21.15.94:0/2426218318 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0b7fe640 1 --2- 172.21.15.94:0/2426218318 >> v2:172.21.15.155:3300/0 conn(0x7f4a0c1567e0 0x7f4a0c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 -- 172.21.15.94:0/2426218318 >> v2:172.21.15.155:3300/0 conn(0x7f4a0c1567e0 msgr2=0x7f4a0c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 --2- 172.21.15.94:0/2426218318 >> v2:172.21.15.155:3300/0 conn(0x7f4a0c1567e0 0x7f4a0c0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 -- 172.21.15.94:0/2426218318 >> v1:172.21.15.155:6789/0 conn(0x7f4a0c0b3c40 legacy=0x7f4a0c15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 -- 172.21.15.94:0/2426218318 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c0b4ec0 con 0x7f4a0c160460 2024-09-11T23:20:31.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0bfff640 1 --2- 172.21.15.94:0/2426218318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c160460 0x7f4a0c15d920 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009870 tx=0x7f49fc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf0b040a7c7b952 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0a7fc640 1 -- 172.21.15.94:0/2426218318 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0ab640 con 0x7f4a0c160460 2024-09-11T23:20:31.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0a7fc640 1 -- 172.21.15.94:0/2426218318 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc0b0070 con 0x7f4a0c160460 2024-09-11T23:20:31.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.208+0000 7f4a0a7fc640 1 -- 172.21.15.94:0/2426218318 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0aba00 con 0x7f4a0c160460 2024-09-11T23:20:31.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- 172.21.15.94:0/2426218318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c160460 msgr2=0x7f4a0c15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/2426218318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c160460 0x7f4a0c15d920 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009870 tx=0x7f49fc01c420 comp rx=0 tx=0).stop 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- 172.21.15.94:0/2426218318 shutdown_connections 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/2426218318 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c160460 0x7f4a0c15d920 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/2426218318 >> v2:172.21.15.155:3300/0 conn(0x7f4a0c1567e0 0x7f4a0c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- 172.21.15.94:0/2426218318 >> 172.21.15.94:0/2426218318 conn(0x7f4a0c073580 msgr2=0x7f4a0c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- 172.21.15.94:0/2426218318 shutdown_connections 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- 172.21.15.94:0/2426218318 wait complete. 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 Processor -- start 2024-09-11T23:20:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- start start 2024-09-11T23:20:31.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0c0b3c40 0x7f4a0c14c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c1567e0 0x7f4a0c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a0c160460 0x7f4a0c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c160b50 con 0x7f4a0c1567e0 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1609d0 con 0x7f4a0c160460 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0c15e270 con 0x7f4a0c0b3c40 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c1567e0 0x7f4a0c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c1567e0 0x7f4a0c15c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58118/0 (socket says 172.21.15.94:58118) 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 -- 172.21.15.94:0/1237429571 learned_addr learned my addr 172.21.15.94:0/1237429571 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0bfff640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a0c160460 0x7f4a0c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0b7fe640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0c0b3c40 0x7f4a0c14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 -- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0c0b3c40 msgr2=0x7f4a0c14c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0c0b3c40 0x7f4a0c14c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 -- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a0c160460 msgr2=0x7f4a0c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a0c160460 0x7f4a0c15c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 -- 172.21.15.94:0/1237429571 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c14c340 con 0x7f4a0c1567e0 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a0affd640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c1567e0 0x7f4a0c15c310 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c480 tx=0x7f4a0000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f49f3fff640 1 -- 172.21.15.94:0/1237429571 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00012830 con 0x7f4a0c1567e0 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f49f3fff640 1 -- 172.21.15.94:0/1237429571 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a00017070 con 0x7f4a0c1567e0 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c152a20 con 0x7f4a0c1567e0 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f49f3fff640 1 -- 172.21.15.94:0/1237429571 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00012c30 con 0x7f4a0c1567e0 2024-09-11T23:20:31.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.212+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c14a780 con 0x7f4a0c1567e0 2024-09-11T23:20:31.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.216+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c0b56c0 con 0x7f4a0c1567e0 2024-09-11T23:20:31.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.216+0000 7f49f3fff640 1 -- 172.21.15.94:0/1237429571 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a0001c460 con 0x7f4a0c1567e0 2024-09-11T23:20:31.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.216+0000 7f49f3fff640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49f80678c0 0x7f49f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:31.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.216+0000 7f49f3fff640 1 -- 172.21.15.94:0/1237429571 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f4a00085c20 con 0x7f4a0c1567e0 2024-09-11T23:20:31.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.216+0000 7f4a0b7fe640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49f80678c0 0x7f49f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:31.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.216+0000 7f4a0b7fe640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49f80678c0 0x7f49f8069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c155030 tx=0x7f4a0400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:31.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.220+0000 7f49f3fff640 1 -- 172.21.15.94:0/1237429571 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a00056660 con 0x7f4a0c1567e0 2024-09-11T23:20:31.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.412+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4a0c070e20 con 0x7f4a0c1567e0 2024-09-11T23:20:31.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.412+0000 7f49f3fff640 1 -- 172.21.15.94:0/1237429571 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) ==== 53+0+73 (secure 0 0 0) 0x7f4a00055f60 con 0x7f4a0c1567e0 2024-09-11T23:20:31.414 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49f80678c0 msgr2=0x7f49f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49f80678c0 0x7f49f8069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c155030 tx=0x7f4a0400b040 comp rx=0 tx=0).stop 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c1567e0 msgr2=0x7f4a0c15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c1567e0 0x7f4a0c15c310 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c480 tx=0x7f4a0000c940 comp rx=0 tx=0).stop 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 shutdown_connections 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a0c160460 0x7f4a0c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49f80678c0 0x7f49f8069d80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a0c1567e0 0x7f4a0c15c310 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 --2- 172.21.15.94:0/1237429571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0c0b3c40 0x7f4a0c14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 >> 172.21.15.94:0/1237429571 conn(0x7f4a0c073580 msgr2=0x7f4a0c14d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 shutdown_connections 2024-09-11T23:20:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31.416+0000 7f4a11aa1640 1 -- 172.21.15.94:0/1237429571 wait complete. 2024-09-11T23:20:31.432 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:20:31.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:20:31.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-09-11T23:20:31.433 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:20:31.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:31.433 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:20:31.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:20:31.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:20:31.433 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:20:31.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:31.433 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-09-11T23:20:31.439 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:20:31.439 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:20:31.439 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:20:31.439 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.439 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-11T23:20:31.440 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42157sec preferred_lft 42157sec 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:2d:4d:e0:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.441 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run.smithi094.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:20:31.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:31.442 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:20:31.492 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-11T23:20:31.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:31.493 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-09-11T23:20:31.542 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-09-11T23:20:31.542 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:20:31.542 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-11T23:20:31.542 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:20:31.543 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-11T23:20:31.543 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:20:31.543 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:20:31.543 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:20:31.543 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:20:31.543 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-11T23:20:31.543 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:20:31.543 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:20:31.543 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-09-11T23:20:31.543 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:20:31.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:20:31.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:20:31.544 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-09-11T23:20:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:20:31.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:20:31.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:31.658 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:20:31.704 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:20:31.704 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:20:31.705 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:20:31.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:31.705 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-09-11T23:20:31.760 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:20:31.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:20:31.761 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:31.808 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:20:31.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:20:31.809 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:31.857 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:20:31.914 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:20:31.961 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:20:31.961 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:20:31.961 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:20:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:20:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:20:31.964 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:20:31.964 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:31.964 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:31.964 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:31.964 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:31.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:31.965 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:20:32.012 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:20:32.012 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:20:32.057 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:20:32.072 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:20:32.121 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:20:32.121 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:20:32.121 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:20:32.122 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:32.123 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:32.124 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:32.124 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:32.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:32.124 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:20:32.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-09-11T23:20:32.136+0000 7f0ff6d41580 -1 init, newargv = 0x555abcdce860 newargc=15 2024-09-11T23:20:32.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[46963]: starting ceph client 2024-09-11T23:20:32.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[46963]: starting fuse 2024-09-11T23:20:33.242 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-09-11T23:20:33.258 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-09-11T23:20:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-09-11T23:20:33.308 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:20:33.309 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-09-11T23:20:33.309 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-09-11T23:20:33.309 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-09-11T23:20:33.309 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:20:33.309 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:20:33.309 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:20:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T23:20:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-09-11T23:20:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:33.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:33.311 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-09-11T23:20:33.357 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-09-11T23:20:33.357 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:20:33.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:20:33.357 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-09-11T23:20:33.357 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-09-11T23:20:33.357 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:20:33.357 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-09-11T23:20:33.357 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:20:33.358 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-09-11T23:20:33.359 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-09-11T23:20:33.359 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-09-11T23:20:33.359 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:20:33.359 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:20:33.359 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-09-11T23:20:33.359 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:20:33.481 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.46963.asok 2024-09-11T23:20:33.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:20:33.492 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46963.asok 2024-09-11T23:20:33.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:33.492 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46963.asok status 2024-09-11T23:20:33.649 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "46963", 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 7272, 2024-09-11T23:20:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 7272 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1494053439 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-09-11T23:20:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1494053439 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.7272 192.168.0.1:0/1494053439", 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/1494053439", 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 72, 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 115, 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-09-11T23:20:33.652 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:33.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:33.663 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-09-11T23:20:33.663 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:33.673 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-09-11T23:20:33.673 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:33.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:33.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:33.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:33.729 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_1) 2024-09-11T23:20:33.792 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:33.792 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:33.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:33.837 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=dir_1/file_a bs=1M conv=fdatasync count=8 seek=0) 2024-09-11T23:20:33.992 INFO:teuthology.orchestra.run.smithi094.stderr:8+0 records in 2024-09-11T23:20:33.992 INFO:teuthology.orchestra.run.smithi094.stderr:8+0 records out 2024-09-11T23:20:33.992 INFO:teuthology.orchestra.run.smithi094.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.103517 s, 81.0 MB/s 2024-09-11T23:20:33.993 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:20:33.994 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:20:33.994 DEBUG:teuthology.orchestra.run.smithi094:> import stat 2024-09-11T23:20:33.994 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:20:33.994 DEBUG:teuthology.orchestra.run.smithi094:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_1/file_a").st_ino) 2024-09-11T23:20:33.994 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:20:34.059 INFO:teuthology.orchestra.run.smithi094.stdout:1099511627777 2024-09-11T23:20:34.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:20:34.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:34.069 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_2) 2024-09-11T23:20:34.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:34.122 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir_1/file_a dir_2/file_b) 2024-09-11T23:20:34.178 DEBUG:teuthology.orchestra.run.smithi094:> stdin-killer -- python3 -c ' 2024-09-11T23:20:34.178 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-09-11T23:20:34.178 DEBUG:teuthology.orchestra.run.smithi094:> import stat 2024-09-11T23:20:34.178 DEBUG:teuthology.orchestra.run.smithi094:> 2024-09-11T23:20:34.178 DEBUG:teuthology.orchestra.run.smithi094:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_2/file_b").st_ino) 2024-09-11T23:20:34.178 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-09-11T23:20:34.287 INFO:teuthology.orchestra.run.smithi094.stdout:1099511627777 2024-09-11T23:20:34.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:20:34.296 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:34.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.460+0000 7fe9c8280640 1 Processor -- start 2024-09-11T23:20:34.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.460+0000 7fe9c8280640 1 -- start start 2024-09-11T23:20:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c8280640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9c01520a0 0x7fe9c006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c8280640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006fe50 0x7fe9c015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c8280640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c0070250 con 0x7fe9c015f1d0 2024-09-11T23:20:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c8280640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c0152480 con 0x7fe9c01520a0 2024-09-11T23:20:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c8280640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c00aede0 con 0x7fe9c006fe50 2024-09-11T23:20:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9c01520a0 0x7fe9c006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9c01520a0 0x7fe9c006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58130/0 (socket says 172.21.15.94:58130) 2024-09-11T23:20:34.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 -- 172.21.15.94:0/3932515431 learned_addr learned my addr 172.21.15.94:0/3932515431 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:34.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c581b640 1 --2- 172.21.15.94:0/3932515431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006fe50 0x7fe9c015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 -- 172.21.15.94:0/3932515431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006fe50 msgr2=0x7fe9c015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:34.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 --2- 172.21.15.94:0/3932515431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006fe50 0x7fe9c015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 -- 172.21.15.94:0/3932515431 >> v1:172.21.15.155:6789/0 conn(0x7fe9c015f1d0 legacy=0x7fe9c0071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:34.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 -- 172.21.15.94:0/3932515431 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c015fa10 con 0x7fe9c01520a0 2024-09-11T23:20:34.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c601c640 1 --2- 172.21.15.94:0/3932515431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c01520a0 0x7fe9c006f910 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800bb10 tx=0x7fe9a801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55179127a853435 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:34.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c501a640 1 -- 172.21.15.94:0/3932515431 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80b4070 con 0x7fe9c01520a0 2024-09-11T23:20:34.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c501a640 1 -- 172.21.15.94:0/3932515431 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a80a7b80 con 0x7fe9c01520a0 2024-09-11T23:20:34.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.464+0000 7fe9c501a640 1 -- 172.21.15.94:0/3932515431 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80af440 con 0x7fe9c01520a0 2024-09-11T23:20:34.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- 172.21.15.94:0/3932515431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c01520a0 msgr2=0x7fe9c006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 --2- 172.21.15.94:0/3932515431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c01520a0 0x7fe9c006f910 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800bb10 tx=0x7fe9a801ebd0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- 172.21.15.94:0/3932515431 shutdown_connections 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 --2- 172.21.15.94:0/3932515431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006fe50 0x7fe9c015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 --2- 172.21.15.94:0/3932515431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c01520a0 0x7fe9c006f910 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- 172.21.15.94:0/3932515431 >> 172.21.15.94:0/3932515431 conn(0x7fe9c00b1f90 msgr2=0x7fe9c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- 172.21.15.94:0/3932515431 shutdown_connections 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- 172.21.15.94:0/3932515431 wait complete. 2024-09-11T23:20:34.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 Processor -- start 2024-09-11T23:20:34.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- start start 2024-09-11T23:20:34.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c006fe50 0x7fe9c014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c01520a0 0x7fe9c0146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c015f1d0 0x7fe9c014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0073d30 con 0x7fe9c015f1d0 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0073a50 con 0x7fe9c006fe50 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c015f680 con 0x7fe9c01520a0 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c015f1d0 0x7fe9c014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c015f1d0 0x7fe9c014b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58134/0 (socket says 172.21.15.94:58134) 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 -- 172.21.15.94:0/2599380981 learned_addr learned my addr 172.21.15.94:0/2599380981 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c581b640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c01520a0 0x7fe9c0146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c601c640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c006fe50 0x7fe9c014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 -- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c01520a0 msgr2=0x7fe9c0146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c01520a0 0x7fe9c0146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 -- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c006fe50 msgr2=0x7fe9c014f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c006fe50 0x7fe9c014f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 -- 172.21.15.94:0/2599380981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c014fc30 con 0x7fe9c015f1d0 2024-09-11T23:20:34.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c601c640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c006fe50 0x7fe9c014f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:34.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c681d640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c015f1d0 0x7fe9c014b270 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000c3f0 tx=0x7fe9b000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:34.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9beffd640 1 -- 172.21.15.94:0/2599380981 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0011790 con 0x7fe9c015f1d0 2024-09-11T23:20:34.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9beffd640 1 -- 172.21.15.94:0/2599380981 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b0017070 con 0x7fe9c015f1d0 2024-09-11T23:20:34.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c014ff10 con 0x7fe9c015f1d0 2024-09-11T23:20:34.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9beffd640 1 -- 172.21.15.94:0/2599380981 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0011b70 con 0x7fe9c015f1d0 2024-09-11T23:20:34.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.468+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c01643b0 con 0x7fe9c015f1d0 2024-09-11T23:20:34.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.472+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c015ec90 con 0x7fe9c015f1d0 2024-09-11T23:20:34.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.472+0000 7fe9beffd640 1 -- 172.21.15.94:0/2599380981 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9b0011d10 con 0x7fe9c015f1d0 2024-09-11T23:20:34.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.472+0000 7fe9beffd640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe9a00678c0 0x7fe9a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.472+0000 7fe9beffd640 1 -- 172.21.15.94:0/2599380981 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fe9b0085c00 con 0x7fe9c015f1d0 2024-09-11T23:20:34.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.472+0000 7fe9c601c640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe9a00678c0 0x7fe9a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.472+0000 7fe9c601c640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe9a00678c0 0x7fe9a0069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80b1000 tx=0x7fe9a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:34.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.476+0000 7fe9beffd640 1 -- 172.21.15.94:0/2599380981 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9b008c080 con 0x7fe9c015f1d0 2024-09-11T23:20:34.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.668+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9c00ccc30 con 0x7fe9c015f1d0 2024-09-11T23:20:34.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.668+0000 7fe9beffd640 1 -- 172.21.15.94:0/2599380981 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5225 (secure 0 0 0) 0x7fe9b0056640 con 0x7fe9c015f1d0 2024-09-11T23:20:34.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:34.670 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":72,"btime":"2024-09-11T23:20:28:318414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:24.648300+0000","modified":"2024-09-11T23:20:27.682973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/502410844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":502410844},{"type":"v1","addr":"172.21.15.94:6835","nonce":502410844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":8}]} 2024-09-11T23:20:34.670 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 72 2024-09-11T23:20:34.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe9a00678c0 msgr2=0x7fe9a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe9a00678c0 0x7fe9a0069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80b1000 tx=0x7fe9a8008040 comp rx=0 tx=0).stop 2024-09-11T23:20:34.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c015f1d0 msgr2=0x7fe9c014b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c015f1d0 0x7fe9c014b270 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000c3f0 tx=0x7fe9b000c8b0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 shutdown_connections 2024-09-11T23:20:34.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe9a00678c0 0x7fe9a0069d80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9c015f1d0 0x7fe9c014b270 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c01520a0 0x7fe9c0146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 --2- 172.21.15.94:0/2599380981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c006fe50 0x7fe9c014f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 >> 172.21.15.94:0/2599380981 conn(0x7fe9c00b1f90 msgr2=0x7fe9c006ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:34.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 shutdown_connections 2024-09-11T23:20:34.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.672+0000 7fe9c8280640 1 -- 172.21.15.94:0/2599380981 wait complete. 2024-09-11T23:20:34.688 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-11T23:20:34.827 INFO:teuthology.orchestra.run.smithi094.stdout:{"message":"","return_code":0} 2024-09-11T23:20:34.827 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T23:20:34.828 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-11T23:20:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 Processor -- start 2024-09-11T23:20:34.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- start start 2024-09-11T23:20:34.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 0x55b5b9799550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b97575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 0x55b5b9757af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b5b9786ce0 con 0x55b5b97a0870 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5b96a81b0 con 0x55b5b97829c0 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5b9786e60 con 0x55b5b97a0c50 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b97575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b97575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58146/0 (socket says 172.21.15.94:58146) 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 -- 172.21.15.94:0/1530903832 learned_addr learned my addr 172.21.15.94:0/1530903832 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 -- 172.21.15.94:0/1530903832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 msgr2=0x55b5b9757af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 --2- 172.21.15.94:0/1530903832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 0x55b5b9757af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 -- 172.21.15.94:0/1530903832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 msgr2=0x55b5b9799550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:34.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 --2- 172.21.15.94:0/1530903832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 0x55b5b9799550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 -- 172.21.15.94:0/1530903832 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b979efa0 con 0x55b5b97a0870 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf4151640 1 --2- 172.21.15.94:0/1530903832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b97575b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b320 tx=0x7fdbe800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dba09406a8466f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf314f640 1 -- 172.21.15.94:0/1530903832 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe800d510 con 0x55b5b97a0870 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf314f640 1 -- 172.21.15.94:0/1530903832 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe8008070 con 0x55b5b97a0870 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf314f640 1 -- 172.21.15.94:0/1530903832 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe800d8b0 con 0x55b5b97a0870 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/1530903832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 msgr2=0x55b5b97575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/1530903832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b97575b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b320 tx=0x7fdbe800b7e0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/1530903832 shutdown_connections 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/1530903832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 0x55b5b9757af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/1530903832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b97575b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/1530903832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 0x55b5b9799550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/1530903832 >> 172.21.15.94:0/1530903832 conn(0x55b5b9756680 msgr2=0x55b5b979fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:34.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/1530903832 shutdown_connections 2024-09-11T23:20:34.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/1530903832 wait complete. 2024-09-11T23:20:34.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 Processor -- start 2024-09-11T23:20:34.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.864+0000 7fdbf6e3f080 1 -- start start 2024-09-11T23:20:34.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 0x55b5b980fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b98125d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 0x55b5b980f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55b5b979f4e0 con 0x55b5b97a0870 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5b979f240 con 0x55b5b97829c0 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5b979f780 con 0x55b5b97a0c50 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b98125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b98125d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58152/0 (socket says 172.21.15.94:58152) 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 -- 172.21.15.94:0/2064064772 learned_addr learned my addr 172.21.15.94:0/2064064772 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4952640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 0x55b5b980fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf5153640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 0x55b5b980f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 -- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 msgr2=0x55b5b980f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b97a0c50 0x55b5b980f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 -- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 msgr2=0x55b5b980fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b97829c0 0x55b5b980fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 -- 172.21.15.94:0/2064064772 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b9812b10 con 0x55b5b97a0870 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4151640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b98125d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x55b5b9798380 tx=0x7fdbe8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf214d640 1 -- 172.21.15.94:0/2064064772 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8020070 con 0x55b5b97a0870 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf214d640 1 -- 172.21.15.94:0/2064064772 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe801c870 con 0x55b5b97a0870 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf214d640 1 -- 172.21.15.94:0/2064064772 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe801cc60 con 0x55b5b97a0870 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5b9810160 con 0x55b5b97a0870 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b98106a0 con 0x55b5b97a0870 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf214d640 1 -- 172.21.15.94:0/2064064772 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbe8023070 con 0x55b5b97a0870 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf214d640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdbe00662d0 0x7fdbe0068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf214d640 1 -- 172.21.15.94:0/2064064772 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fdbe8086c40 con 0x55b5b97a0870 2024-09-11T23:20:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x55b5b9811080 0x55b5b9811490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 --> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] -- osd_op(unknown.0.0:1 18.7 18:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55b5b9784090 con 0x55b5b9811080 2024-09-11T23:20:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf4952640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdbe00662d0 0x7fdbe0068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.868+0000 7fdbf5153640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x55b5b9811080 0x55b5b9811490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf5153640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x55b5b9811080 0x55b5b9811490 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:34.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf5153640 1 -- 172.21.15.94:0/2064064772 <== osd.2 v2:172.21.15.94:6808/2442943552 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (93) out=93b] v0'0 uv3 ondisk = 0) ==== 164+0+93 (crc 0 0 0) 0x7fdbec007560 con 0x55b5b9811080 2024-09-11T23:20:34.875 INFO:teuthology.orchestra.run.smithi094.stdout:Wfile_a 2024-09-11T23:20:34.875 INFO:teuthology.orchestra.run.smithi094.stdout:dir_1 2024-09-11T23:20:34.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf4952640 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdbe00662d0 0x7fdbe0068790 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40ac000 tx=0x7fdbe40033b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:34.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x55b5b9811080 msgr2=0x55b5b9811490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x55b5b9811080 0x55b5b9811490 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdbe00662d0 msgr2=0x7fdbe0068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdbe00662d0 0x7fdbe0068790 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40ac000 tx=0x7fdbe40033b0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 msgr2=0x55b5b98125d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:34.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 --2- 172.21.15.94:0/2064064772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b5b97a0870 0x55b5b98125d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x55b5b9798380 tx=0x7fdbe8000ee0 comp rx=0 tx=0).stop 2024-09-11T23:20:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf5153640 1 -- 172.21.15.94:0/2064064772 reap_dead start 2024-09-11T23:20:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 shutdown_connections 2024-09-11T23:20:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 >> 172.21.15.94:0/2064064772 conn(0x55b5b9756680 msgr2=0x55b5b979fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 shutdown_connections 2024-09-11T23:20:34.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:34.872+0000 7fdbf6e3f080 1 -- 172.21.15.94:0/2064064772 wait complete. 2024-09-11T23:20:34.877 DEBUG:teuthology.orchestra.run.smithi094:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-11T23:20:34.964 INFO:teuthology.orchestra.run.smithi094.stderr:error: stray data at end of buffer, offset 93 2024-09-11T23:20:34.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:20:34.967 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:20:34.967 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:35.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:35.151 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:20:35.151 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:35.152 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:35.152 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:35.158 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:20:35.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ffd846640 1 Processor -- start 2024-09-11T23:20:35.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ffd846640 1 -- start start 2024-09-11T23:20:35.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ffd846640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80d3060 0x7f0ff80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ffd846640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff80d0300 con 0x7f0ff80cf450 2024-09-11T23:20:35.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ffd846640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff80b0f60 con 0x7f0ff8161a60 2024-09-11T23:20:35.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ffd846640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff80cfd40 con 0x7f0ff80d3060 2024-09-11T23:20:35.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff77fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0ff80cf450 0x7f0ff806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42312/0 (socket says 172.21.15.94:42312) 2024-09-11T23:20:35.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff77fe640 1 -- 172.21.15.94:0/1031404428 learned_addr learned my addr 172.21.15.94:0/1031404428 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:35.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff67fc640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80d3060 0x7f0ff80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742094356 0 0) 0x7f0ff00014a0 con 0x7f0ff80cf450 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe0003530 con 0x7f0ff80cf450 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127922533 0 0) 0x7f0fe0003530 con 0x7f0ff80cf450 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80d3060 msgr2=0x7f0ff80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80d3060 0x7f0ff80cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 >> v1:172.21.15.155:6789/0 conn(0x7f0ff8161a60 legacy=0x7f0ff80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff80d0020 con 0x7f0ff80cf450 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f0ff0001bd0 con 0x7f0ff80cf450 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 >> v1:172.21.15.94:6789/0 conn(0x7f0ff80cf450 legacy=0x7f0ff806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80d3060 0x7f0fe00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fe0003f70 0x7f0fe0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0004d50 0x7f0fe00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff80cfd40 con 0x7f0fe0003f70 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe000bb60 con 0x7f0fe0004d50 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.324+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe000bd60 con 0x7f0ff80d3060 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff67fc640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fe0003f70 0x7f0fe0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff77fe640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0004d50 0x7f0fe00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff67fc640 1 -- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80d3060 msgr2=0x7f0fe00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff67fc640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80d3060 0x7f0fe00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff67fc640 1 -- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0004d50 msgr2=0x7f0fe00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff67fc640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0004d50 0x7f0fe00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff67fc640 1 -- 172.21.15.94:0/1031404428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe0003530 con 0x7f0fe0003f70 2024-09-11T23:20:35.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff67fc640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fe0003f70 0x7f0fe0004810 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009ae0 tx=0x7f0fec01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a8268a025781a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:35.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0b2070 con 0x7f0fe0003f70 2024-09-11T23:20:35.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fec0a5650 con 0x7f0fe0003f70 2024-09-11T23:20:35.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff5ffb640 1 -- 172.21.15.94:0/1031404428 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0096b0 con 0x7f0fe0003f70 2024-09-11T23:20:35.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ffd846640 1 -- 172.21.15.94:0/1031404428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fe0003f70 msgr2=0x7f0fe0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ffd846640 1 --2- 172.21.15.94:0/1031404428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fe0003f70 0x7f0fe0004810 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009ae0 tx=0x7f0fec01ca80 comp rx=0 tx=0).stop 2024-09-11T23:20:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ff77fe640 1 -- 172.21.15.94:0/1031404428 reap_dead start 2024-09-11T23:20:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ffd846640 1 -- 172.21.15.94:0/1031404428 shutdown_connections 2024-09-11T23:20:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ffd846640 1 -- 172.21.15.94:0/1031404428 >> 172.21.15.94:0/1031404428 conn(0x7f0ff808bf90 msgr2=0x7f0ff809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ffd846640 1 -- 172.21.15.94:0/1031404428 shutdown_connections 2024-09-11T23:20:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.328+0000 7f0ffd846640 1 -- 172.21.15.94:0/1031404428 wait complete. 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 Processor -- start 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 -- start start 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0003f70 0x7f0ff8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b9f20 0x7f0ff81639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ff80b8100 0x7f0ff80b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff816a0a0 con 0x7f0ff80b8100 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8169f20 con 0x7f0fe0003f70 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff816a220 con 0x7f0ff80b9f20 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ff80b8100 0x7f0ff80b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ff80b8100 0x7f0ff80b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58168/0 (socket says 172.21.15.94:58168) 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 -- 172.21.15.94:0/647460462 learned_addr learned my addr 172.21.15.94:0/647460462 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff67fc640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b9f20 0x7f0ff81639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff6ffd640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0003f70 0x7f0ff8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 -- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b9f20 msgr2=0x7f0ff81639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b9f20 0x7f0ff81639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 -- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0003f70 msgr2=0x7f0ff8159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0003f70 0x7f0ff8159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 -- 172.21.15.94:0/647460462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff80b7340 con 0x7f0ff80b8100 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff6ffd640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0003f70 0x7f0ff8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ff77fe640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ff80b8100 0x7f0ff80b2660 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0ff808dd40 tx=0x7f0ff000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0fdffff640 1 -- 172.21.15.94:0/647460462 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0019070 con 0x7f0ff80b8100 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0fdffff640 1 -- 172.21.15.94:0/647460462 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff0001b70 con 0x7f0ff80b8100 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff80b7620 con 0x7f0ff80b8100 2024-09-11T23:20:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0fdffff640 1 -- 172.21.15.94:0/647460462 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0014480 con 0x7f0ff80b8100 2024-09-11T23:20:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff80b7be0 con 0x7f0ff80b8100 2024-09-11T23:20:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff80b7de0 con 0x7f0ff80b8100 2024-09-11T23:20:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.332+0000 7f0fdffff640 1 -- 172.21.15.94:0/647460462 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ff001c070 con 0x7f0ff80b8100 2024-09-11T23:20:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.336+0000 7f0fdffff640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0fe40678f0 0x7f0fe4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.336+0000 7f0fdffff640 1 -- 172.21.15.94:0/647460462 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f0ff0085e00 con 0x7f0ff80b8100 2024-09-11T23:20:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.336+0000 7f0ff6ffd640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0fe40678f0 0x7f0fe4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.336+0000 7f0ff6ffd640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0fe40678f0 0x7f0fe4069db0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80016c0 tx=0x7f0fe8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:35.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.336+0000 7f0fdffff640 1 -- 172.21.15.94:0/647460462 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ff80b7de0 con 0x7f0ff80b8100 2024-09-11T23:20:35.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ff806d6b0 con 0x7f0ff80b8100 2024-09-11T23:20:35.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0fdffff640 1 -- 172.21.15.94:0/647460462 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) ==== 80+0+0 (secure 0 0 0) 0x7f0ff0023020 con 0x7f0ff80b8100 2024-09-11T23:20:35.513 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-09-11T23:20:35.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0fe40678f0 msgr2=0x7f0fe4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:35.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0fe40678f0 0x7f0fe4069db0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80016c0 tx=0x7f0fe8009040 comp rx=0 tx=0).stop 2024-09-11T23:20:35.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ff80b8100 msgr2=0x7f0ff80b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:35.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ff80b8100 0x7f0ff80b2660 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0ff808dd40 tx=0x7f0ff000e530 comp rx=0 tx=0).stop 2024-09-11T23:20:35.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 shutdown_connections 2024-09-11T23:20:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0fe40678f0 0x7f0fe4069db0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ff80b8100 0x7f0ff80b2660 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b9f20 0x7f0ff81639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 --2- 172.21.15.94:0/647460462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe0003f70 0x7f0ff8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 >> 172.21.15.94:0/647460462 conn(0x7f0ff808bf90 msgr2=0x7f0ff815f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 shutdown_connections 2024-09-11T23:20:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:35.512+0000 7f0ffd846640 1 -- 172.21.15.94:0/647460462 wait complete. 2024-09-11T23:20:35.532 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-09-11T23:20:35.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:35.533 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:20:35.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[46963]: fuse finished with error 0 and tester_r 0 2024-09-11T23:20:35.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:20:35.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:35.545 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:20:35.713 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:35.714 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:35.714 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:35.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:35.721 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:20:35.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:35.722 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:20:35.748 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T23:20:35.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:20:35.749 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:35.749 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:35.749 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:35.776 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:35.776 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:20:35.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:35.777 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:20:35.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:20:35.857 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T23:20:35.857 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:35.857 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:35.857 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:35.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:35.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:20:35.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:35.876 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:20:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T23:20:35.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:20:35.943 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:36.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.088+0000 7f02c76fb640 1 Processor -- start 2024-09-11T23:20:36.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.088+0000 7f02c76fb640 1 -- start start 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c76fb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c006f010 0x7f02c0166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c76fb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c00b3290 con 0x7f02c015bec0 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c76fb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c00b3570 con 0x7f02c015c2a0 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c76fb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02c00b3850 con 0x7f02c006f010 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c5497640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f02c015bec0 0x7f02c00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42314/0 (socket says 172.21.15.94:42314) 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c5497640 1 -- 172.21.15.94:0/420060379 learned_addr learned my addr 172.21.15.94:0/420060379 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c5c98640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c006f010 0x7f02c0166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163795359 0 0) 0x7f02c00b3290 con 0x7f02c015bec0 2024-09-11T23:20:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02ac003530 con 0x7f02c015bec0 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1745130848 0 0) 0x7f02ac003530 con 0x7f02c015bec0 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c006f010 msgr2=0x7f02c0166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c006f010 0x7f02c0166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 >> v1:172.21.15.155:6789/0 conn(0x7f02c015c2a0 legacy=0x7f02c00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c00b3b30 con 0x7f02c015bec0 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f02b0001680 con 0x7f02c015bec0 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 >> v1:172.21.15.94:6789/0 conn(0x7f02c015bec0 legacy=0x7f02c00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c006f010 0x7f02ac0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02ac003f70 0x7f02ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02ac004d50 0x7f02ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00b3850 con 0x7f02ac003f70 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac00bab0 con 0x7f02ac004d50 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac00bcb0 con 0x7f02c006f010 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c4c96640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02ac003f70 0x7f02ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c4c96640 1 -- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c006f010 msgr2=0x7f02ac0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c4c96640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c006f010 0x7f02ac0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c4c96640 1 -- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02ac004d50 msgr2=0x7f02ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c4c96640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02ac004d50 0x7f02ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.092+0000 7f02c4c96640 1 -- 172.21.15.94:0/420060379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac003530 con 0x7f02ac003f70 2024-09-11T23:20:36.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c4c96640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02ac003f70 0x7f02ac004810 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001750 tx=0x7f02bc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ea782e0f49a5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0013a0 con 0x7f02ac003f70 2024-09-11T23:20:36.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc0052f0 con 0x7f02ac003f70 2024-09-11T23:20:36.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02b7fff640 1 -- 172.21.15.94:0/420060379 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc003840 con 0x7f02ac003f70 2024-09-11T23:20:36.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- 172.21.15.94:0/420060379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02ac003f70 msgr2=0x7f02ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 --2- 172.21.15.94:0/420060379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02ac003f70 0x7f02ac004810 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001750 tx=0x7f02bc01c3e0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5c98640 1 -- 172.21.15.94:0/420060379 reap_dead start 2024-09-11T23:20:36.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- 172.21.15.94:0/420060379 shutdown_connections 2024-09-11T23:20:36.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- 172.21.15.94:0/420060379 >> 172.21.15.94:0/420060379 conn(0x7f02c00b1f90 msgr2=0x7f02c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:36.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- 172.21.15.94:0/420060379 shutdown_connections 2024-09-11T23:20:36.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- 172.21.15.94:0/420060379 wait complete. 2024-09-11T23:20:36.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 Processor -- start 2024-09-11T23:20:36.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- start start 2024-09-11T23:20:36.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02c014fbe0 0x7f02c00738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c0073130 0x7f02c00b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c00b08a0 0x7f02c01e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00afc90 con 0x7f02c014fbe0 2024-09-11T23:20:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00b40f0 con 0x7f02c00b08a0 2024-09-11T23:20:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c76fb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02c00af470 con 0x7f02c0073130 2024-09-11T23:20:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5497640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02c014fbe0 0x7f02c00738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5497640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02c014fbe0 0x7f02c00738a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58182/0 (socket says 172.21.15.94:58182) 2024-09-11T23:20:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5497640 1 -- 172.21.15.94:0/1083302695 learned_addr learned my addr 172.21.15.94:0/1083302695 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c4c96640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c0073130 0x7f02c00b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5497640 1 -- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c0073130 msgr2=0x7f02c00b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5497640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c0073130 0x7f02c00b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5497640 1 -- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c00b08a0 msgr2=0x7f02c01e48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5c98640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c00b08a0 0x7f02c01e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.096+0000 7f02c5497640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c00b08a0 0x7f02c01e48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c5497640 1 -- 172.21.15.94:0/1083302695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c0072090 con 0x7f02c014fbe0 2024-09-11T23:20:36.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c4c96640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c0073130 0x7f02c00b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:36.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c5c98640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c00b08a0 0x7f02c01e48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:36.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c5497640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02c014fbe0 0x7f02c00738a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f02b000f3c0 tx=0x7f02b000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02b5ffb640 1 -- 172.21.15.94:0/1083302695 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0007d00 con 0x7f02c014fbe0 2024-09-11T23:20:36.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02b5ffb640 1 -- 172.21.15.94:0/1083302695 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b000a0d0 con 0x7f02c014fbe0 2024-09-11T23:20:36.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c0072370 con 0x7f02c014fbe0 2024-09-11T23:20:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02b5ffb640 1 -- 172.21.15.94:0/1083302695 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b000a4c0 con 0x7f02c014fbe0 2024-09-11T23:20:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c0072930 con 0x7f02c014fbe0 2024-09-11T23:20:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c00b0cb0 con 0x7f02c014fbe0 2024-09-11T23:20:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02b5ffb640 1 -- 172.21.15.94:0/1083302695 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02b0014070 con 0x7f02c014fbe0 2024-09-11T23:20:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02b5ffb640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02a40678f0 0x7f02a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02b5ffb640 1 -- 172.21.15.94:0/1083302695 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f02b0088ab0 con 0x7f02c014fbe0 2024-09-11T23:20:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c4c96640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02a40678f0 0x7f02a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.100+0000 7f02c4c96640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02a40678f0 0x7f02a4069db0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f02c015c6b0 tx=0x7f02bc0011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.104+0000 7f02b5ffb640 1 -- 172.21.15.94:0/1083302695 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f02c00b0cb0 con 0x7f02c014fbe0 2024-09-11T23:20:36.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.300+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02c00aed60 con 0x7f02c014fbe0 2024-09-11T23:20:36.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02b5ffb640 1 -- 172.21.15.94:0/1083302695 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5225 (secure 0 0 0) 0x7f02b0011280 con 0x7f02c014fbe0 2024-09-11T23:20:36.304 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:36.304 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":72,"btime":"2024-09-11T23:20:28:318414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:24.648300+0000","modified":"2024-09-11T23:20:27.682973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/502410844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":502410844},{"type":"v1","addr":"172.21.15.94:6835","nonce":502410844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":8}]} 2024-09-11T23:20:36.304 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 72 2024-09-11T23:20:36.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02a40678f0 msgr2=0x7f02a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02a40678f0 0x7f02a4069db0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f02c015c6b0 tx=0x7f02bc0011a0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02c014fbe0 msgr2=0x7f02c00738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02c014fbe0 0x7f02c00738a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f02b000f3c0 tx=0x7f02b000f880 comp rx=0 tx=0).stop 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 shutdown_connections 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c00b08a0 0x7f02c01e48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02c0073130 0x7f02c00b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f02a40678f0 0x7f02a4069db0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 --2- 172.21.15.94:0/1083302695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02c014fbe0 0x7f02c00738a0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 >> 172.21.15.94:0/1083302695 conn(0x7f02c00b1f90 msgr2=0x7f02c0074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:36.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 shutdown_connections 2024-09-11T23:20:36.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.304+0000 7f02c76fb640 1 -- 172.21.15.94:0/1083302695 wait complete. 2024-09-11T23:20:36.324 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.440+0000 7f076ac3a640 1 Processor -- start 2024-09-11T23:20:36.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.440+0000 7f076ac3a640 1 -- start start 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f076ac3a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f07641520a0 0x7f076406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f076ac3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076415f3a0 0x7f07640adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f076ac3a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0764070250 con 0x7f076406fe50 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f076ac3a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0764152480 con 0x7f07641520a0 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f076ac3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f07640aede0 con 0x7f076415f3a0 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f07641520a0 0x7f076406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f07641520a0 0x7f076406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58186/0 (socket says 172.21.15.94:58186) 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 -- 172.21.15.94:0/1021197766 learned_addr learned my addr 172.21.15.94:0/1021197766 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 -- 172.21.15.94:0/1021197766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076415f3a0 msgr2=0x7f07640adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:36.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 --2- 172.21.15.94:0/1021197766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076415f3a0 0x7f07640adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 -- 172.21.15.94:0/1021197766 >> v1:172.21.15.155:6789/0 conn(0x7f076406fe50 legacy=0x7f076415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:36.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 -- 172.21.15.94:0/1021197766 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076415fa10 con 0x7f07641520a0 2024-09-11T23:20:36.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07689d6640 1 --2- 172.21.15.94:0/1021197766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f076406f910 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cf3d318439540a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07637fe640 1 -- 172.21.15.94:0/1021197766 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540b1070 con 0x7f07641520a0 2024-09-11T23:20:36.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07637fe640 1 -- 172.21.15.94:0/1021197766 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07540ac630 con 0x7f07641520a0 2024-09-11T23:20:36.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f07637fe640 1 -- 172.21.15.94:0/1021197766 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540a8050 con 0x7f07641520a0 2024-09-11T23:20:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f076ac3a640 1 -- 172.21.15.94:0/1021197766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 msgr2=0x7f076406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.444+0000 7f076ac3a640 1 --2- 172.21.15.94:0/1021197766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f076406f910 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c520 comp rx=0 tx=0).stop 2024-09-11T23:20:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- 172.21.15.94:0/1021197766 shutdown_connections 2024-09-11T23:20:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 --2- 172.21.15.94:0/1021197766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076415f3a0 0x7f07640adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 --2- 172.21.15.94:0/1021197766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f076406f910 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- 172.21.15.94:0/1021197766 >> 172.21.15.94:0/1021197766 conn(0x7f07640b1f90 msgr2=0x7f07640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:36.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- 172.21.15.94:0/1021197766 shutdown_connections 2024-09-11T23:20:36.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- 172.21.15.94:0/1021197766 wait complete. 2024-09-11T23:20:36.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 Processor -- start 2024-09-11T23:20:36.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- start start 2024-09-11T23:20:36.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076406fe50 0x7f07641456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f07640cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076415f3a0 0x7f0764146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0764073d30 con 0x7f07641520a0 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0764073a50 con 0x7f076415f3a0 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0764167f10 con 0x7f076406fe50 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f07640cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f07640cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58190/0 (socket says 172.21.15.94:58190) 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 -- 172.21.15.94:0/3584576089 learned_addr learned my addr 172.21.15.94:0/3584576089 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f07689d6640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076406fe50 0x7f07641456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f07691d7640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076415f3a0 0x7f0764146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 -- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076406fe50 msgr2=0x7f07641456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076406fe50 0x7f07641456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 -- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076415f3a0 msgr2=0x7f0764146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076415f3a0 0x7f0764146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 -- 172.21.15.94:0/3584576089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0764149040 con 0x7f07641520a0 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f07691d7640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076415f3a0 0x7f0764146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f0763fff640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f07640cccb0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f075800b410 tx=0x7f075800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f07617fa640 1 -- 172.21.15.94:0/3584576089 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758015020 con 0x7f07641520a0 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f07617fa640 1 -- 172.21.15.94:0/3584576089 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0758011830 con 0x7f07641520a0 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0764146000 con 0x7f07641520a0 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f07617fa640 1 -- 172.21.15.94:0/3584576089 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758011c20 con 0x7f07641520a0 2024-09-11T23:20:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07641476d0 con 0x7f07641520a0 2024-09-11T23:20:36.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.448+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07640b35f0 con 0x7f07641520a0 2024-09-11T23:20:36.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.452+0000 7f07617fa640 1 -- 172.21.15.94:0/3584576089 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0758018020 con 0x7f07641520a0 2024-09-11T23:20:36.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.452+0000 7f07617fa640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07500678c0 0x7f0750069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.452+0000 7f07617fa640 1 -- 172.21.15.94:0/3584576089 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f0758085de0 con 0x7f07641520a0 2024-09-11T23:20:36.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.452+0000 7f07689d6640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07500678c0 0x7f0750069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.452+0000 7f07689d6640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07500678c0 0x7f0750069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f07540ae000 tx=0x7f0754008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.456+0000 7f07617fa640 1 -- 172.21.15.94:0/3584576089 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f075801f020 con 0x7f07641520a0 2024-09-11T23:20:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.652+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f076406e540 con 0x7f07641520a0 2024-09-11T23:20:36.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.652+0000 7f07617fa640 1 -- 172.21.15.94:0/3584576089 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5225 (secure 0 0 0) 0x7f0764146000 con 0x7f07641520a0 2024-09-11T23:20:36.654 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:36.654 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":72,"btime":"2024-09-11T23:20:28:318414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:24.648300+0000","modified":"2024-09-11T23:20:27.682973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/502410844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":502410844},{"type":"v1","addr":"172.21.15.94:6835","nonce":502410844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":8}]} 2024-09-11T23:20:36.654 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 72 2024-09-11T23:20:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07500678c0 msgr2=0x7f0750069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07500678c0 0x7f0750069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f07540ae000 tx=0x7f0754008040 comp rx=0 tx=0).stop 2024-09-11T23:20:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 msgr2=0x7f07640cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f07640cccb0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f075800b410 tx=0x7f075800b8d0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 shutdown_connections 2024-09-11T23:20:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f076415f3a0 0x7f0764146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07500678c0 0x7f0750069d80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07641520a0 0x7f07640cccb0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 --2- 172.21.15.94:0/3584576089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f076406fe50 0x7f07641456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 >> 172.21.15.94:0/3584576089 conn(0x7f07640b1f90 msgr2=0x7f07640b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 shutdown_connections 2024-09-11T23:20:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.656+0000 7f076ac3a640 1 -- 172.21.15.94:0/3584576089 wait complete. 2024-09-11T23:20:36.673 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:36.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.792+0000 7fb11ccc9640 1 Processor -- start 2024-09-11T23:20:36.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.792+0000 7fb11ccc9640 1 -- start start 2024-09-11T23:20:36.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11ccc9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb118161a60 0x7fb1180d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11ccc9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1180d2e90 0x7fb1180cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11ccc9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1180d32b0 con 0x7fb1180cf450 2024-09-11T23:20:36.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11ccc9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb1180d0300 con 0x7fb1180d2e90 2024-09-11T23:20:36.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11ccc9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb11806e6c0 con 0x7fb118161a60 2024-09-11T23:20:36.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1180d2e90 0x7fb1180cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1180d2e90 0x7fb1180cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58198/0 (socket says 172.21.15.94:58198) 2024-09-11T23:20:36.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 -- 172.21.15.94:0/3722908166 learned_addr learned my addr 172.21.15.94:0/3722908166 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:36.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11659c640 1 --2- 172.21.15.94:0/3722908166 >> v2:172.21.15.155:3300/0 conn(0x7fb118161a60 0x7fb1180d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 -- 172.21.15.94:0/3722908166 >> v2:172.21.15.155:3300/0 conn(0x7fb118161a60 msgr2=0x7fb1180d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:36.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 --2- 172.21.15.94:0/3722908166 >> v2:172.21.15.155:3300/0 conn(0x7fb118161a60 0x7fb1180d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 -- 172.21.15.94:0/3722908166 >> v1:172.21.15.155:6789/0 conn(0x7fb1180cf450 legacy=0x7fb1180d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:36.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 -- 172.21.15.94:0/3722908166 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1180b0f60 con 0x7fb1180d2e90 2024-09-11T23:20:36.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb115d9b640 1 --2- 172.21.15.94:0/3722908166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180d2e90 0x7fb1180cef10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fb11808e010 tx=0x7fb10c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f411213b539108 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11559a640 1 -- 172.21.15.94:0/3722908166 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180d1930 con 0x7fb1180d2e90 2024-09-11T23:20:36.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11559a640 1 -- 172.21.15.94:0/3722908166 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c0b0070 con 0x7fb1180d2e90 2024-09-11T23:20:36.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.796+0000 7fb11559a640 1 -- 172.21.15.94:0/3722908166 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0ab840 con 0x7fb1180d2e90 2024-09-11T23:20:36.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- 172.21.15.94:0/3722908166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180d2e90 msgr2=0x7fb1180cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/3722908166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180d2e90 0x7fb1180cef10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fb11808e010 tx=0x7fb10c01c420 comp rx=0 tx=0).stop 2024-09-11T23:20:36.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- 172.21.15.94:0/3722908166 shutdown_connections 2024-09-11T23:20:36.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/3722908166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180d2e90 0x7fb1180cef10 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/3722908166 >> v2:172.21.15.155:3300/0 conn(0x7fb118161a60 0x7fb1180d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- 172.21.15.94:0/3722908166 >> 172.21.15.94:0/3722908166 conn(0x7fb11808bf90 msgr2=0x7fb11809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:36.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- 172.21.15.94:0/3722908166 shutdown_connections 2024-09-11T23:20:36.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- 172.21.15.94:0/3722908166 wait complete. 2024-09-11T23:20:36.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 Processor -- start 2024-09-11T23:20:36.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- start start 2024-09-11T23:20:36.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180cf450 0x7fb11815d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1180d2e90 0x7fb1180c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb118161a60 0x7fb1181f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb1180cf8c0 con 0x7fb1180cf450 2024-09-11T23:20:36.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb11806d190 con 0x7fb1180d2e90 2024-09-11T23:20:36.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1180cfa40 con 0x7fb118161a60 2024-09-11T23:20:36.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180cf450 0x7fb11815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180cf450 0x7fb11815d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58208/0 (socket says 172.21.15.94:58208) 2024-09-11T23:20:36.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb115d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1180d2e90 0x7fb1180c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb116d9d640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb118161a60 0x7fb1181f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 -- 172.21.15.94:0/2016208874 learned_addr learned my addr 172.21.15.94:0/2016208874 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:36.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 -- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb118161a60 msgr2=0x7fb1181f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb118161a60 0x7fb1181f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 -- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1180d2e90 msgr2=0x7fb1180c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1180d2e90 0x7fb1180c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 -- 172.21.15.94:0/2016208874 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11815dbc0 con 0x7fb1180cf450 2024-09-11T23:20:36.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11659c640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180cf450 0x7fb11815d290 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fb10800d620 tx=0x7fb10800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb106ffd640 1 -- 172.21.15.94:0/2016208874 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10800b620 con 0x7fb1180cf450 2024-09-11T23:20:36.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb106ffd640 1 -- 172.21.15.94:0/2016208874 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108019070 con 0x7fb1180cf450 2024-09-11T23:20:36.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb106ffd640 1 -- 172.21.15.94:0/2016208874 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10800ba20 con 0x7fb1180cf450 2024-09-11T23:20:36.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1180c83c0 con 0x7fb1180cf450 2024-09-11T23:20:36.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.800+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1180c8f00 con 0x7fb1180cf450 2024-09-11T23:20:36.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.804+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1180cef10 con 0x7fb1180cf450 2024-09-11T23:20:36.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.804+0000 7fb106ffd640 1 -- 172.21.15.94:0/2016208874 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb10800bbc0 con 0x7fb1180cf450 2024-09-11T23:20:36.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.804+0000 7fb106ffd640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0f80678c0 0x7fb0f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:36.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.804+0000 7fb106ffd640 1 -- 172.21.15.94:0/2016208874 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fb108086160 con 0x7fb1180cf450 2024-09-11T23:20:36.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.804+0000 7fb115d9b640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0f80678c0 0x7fb0f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:36.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.804+0000 7fb115d9b640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0f80678c0 0x7fb0f8069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0af000 tx=0x7fb10c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:36.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.808+0000 7fb106ffd640 1 -- 172.21.15.94:0/2016208874 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb11815dbc0 con 0x7fb1180cf450 2024-09-11T23:20:36.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.960+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb118160c20 con 0x7fb1180cf450 2024-09-11T23:20:36.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.964+0000 7fb106ffd640 1 -- 172.21.15.94:0/2016208874 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17036 (secure 0 0 0) 0x7fb1080564c0 con 0x7fb1180cf450 2024-09-11T23:20:36.966 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:36.966 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":115,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:20:26.277253+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:23.260045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:23.628059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.964+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0f80678c0 msgr2=0x7fb0f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.964+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0f80678c0 0x7fb0f8069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0af000 tx=0x7fb10c0a7000 comp rx=0 tx=0).stop 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.964+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180cf450 msgr2=0x7fb11815d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.964+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180cf450 0x7fb11815d290 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fb10800d620 tx=0x7fb10800dae0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.964+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 shutdown_connections 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.968+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb118161a60 0x7fb1181f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.968+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1180d2e90 0x7fb1180c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.968+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fb0f80678c0 0x7fb0f8069d80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.968+0000 7fb11ccc9640 1 --2- 172.21.15.94:0/2016208874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1180cf450 0x7fb11815d290 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:36.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.968+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 >> 172.21.15.94:0/2016208874 conn(0x7fb11808bf90 msgr2=0x7fb11806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:36.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.968+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 shutdown_connections 2024-09-11T23:20:36.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:36.968+0000 7fb11ccc9640 1 -- 172.21.15.94:0/2016208874 wait complete. 2024-09-11T23:20:36.985 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:20:36.985 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:37.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.088+0000 7f0d6fd29640 1 Processor -- start 2024-09-11T23:20:37.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.088+0000 7f0d6fd29640 1 -- start start 2024-09-11T23:20:37.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6fd29640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d68140f70 0x7f0d68071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6fd29640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68071c70 0x7f0d68141350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6fd29640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d68141890 0x7f0d68141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6fd29640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0d68072660 con 0x7f0d68140f70 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6fd29640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0d680d15e0 con 0x7f0d68141890 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6fd29640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d680720b0 con 0x7f0d68071c70 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d68140f70 0x7f0d68071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0d68140f70 0x7f0d68071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58224/0 (socket says 172.21.15.94:58224) 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 -- 172.21.15.94:0/617977772 learned_addr learned my addr 172.21.15.94:0/617977772 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 -- 172.21.15.94:0/617977772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68071c70 msgr2=0x7f0d68141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 --2- 172.21.15.94:0/617977772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68071c70 0x7f0d68141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 -- 172.21.15.94:0/617977772 >> v2:172.21.15.155:3300/0 conn(0x7f0d68141890 msgr2=0x7f0d68141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6e2c6640 1 --2- 172.21.15.94:0/617977772 >> v2:172.21.15.155:3300/0 conn(0x7f0d68141890 0x7f0d68141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 --2- 172.21.15.94:0/617977772 >> v2:172.21.15.155:3300/0 conn(0x7f0d68141890 0x7f0d68141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 -- 172.21.15.94:0/617977772 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d68072380 con 0x7f0d68140f70 2024-09-11T23:20:37.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6dac5640 1 --2- 172.21.15.94:0/617977772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68140f70 0x7f0d68071730 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f0d68145da0 tx=0x7f0d6001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d6ee185ff8bd48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6cac3640 1 -- 172.21.15.94:0/617977772 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600a5840 con 0x7f0d68140f70 2024-09-11T23:20:37.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6cac3640 1 -- 172.21.15.94:0/617977772 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d600a59e0 con 0x7f0d68140f70 2024-09-11T23:20:37.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.092+0000 7f0d6cac3640 1 -- 172.21.15.94:0/617977772 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600a5db0 con 0x7f0d68140f70 2024-09-11T23:20:37.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/617977772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68140f70 msgr2=0x7f0d68071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/617977772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68140f70 0x7f0d68071730 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f0d68145da0 tx=0x7f0d6001c9c0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/617977772 shutdown_connections 2024-09-11T23:20:37.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/617977772 >> v2:172.21.15.155:3300/0 conn(0x7f0d68141890 0x7f0d68141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/617977772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68071c70 0x7f0d68141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/617977772 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68140f70 0x7f0d68071730 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/617977772 >> 172.21.15.94:0/617977772 conn(0x7f0d680b3e70 msgr2=0x7f0d680b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:37.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/617977772 shutdown_connections 2024-09-11T23:20:37.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/617977772 wait complete. 2024-09-11T23:20:37.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 Processor -- start 2024-09-11T23:20:37.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- start start 2024-09-11T23:20:37.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68071c70 0x7f0d68143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68140f70 0x7f0d681454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d68141890 0x7f0d680d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0d68160790 con 0x7f0d68071c70 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d68160610 con 0x7f0d68141890 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d68160910 con 0x7f0d68140f70 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68071c70 0x7f0d68143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68071c70 0x7f0d68143b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58226/0 (socket says 172.21.15.94:58226) 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 -- 172.21.15.94:0/450478160 learned_addr learned my addr 172.21.15.94:0/450478160 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 -- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68140f70 msgr2=0x7f0d681454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68140f70 0x7f0d681454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 -- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d68141890 msgr2=0x7f0d680d1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6e2c6640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d68141890 0x7f0d680d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d68141890 0x7f0d680d1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 -- 172.21.15.94:0/450478160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d68142a90 con 0x7f0d68071c70 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6dac5640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68071c70 0x7f0d68143b30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0d600af040 tx=0x7f0d60019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d5e7fc640 1 -- 172.21.15.94:0/450478160 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600bc020 con 0x7f0d68071c70 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d5e7fc640 1 -- 172.21.15.94:0/450478160 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d600b88a0 con 0x7f0d68071c70 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d5e7fc640 1 -- 172.21.15.94:0/450478160 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600b8c90 con 0x7f0d68071c70 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d68142d70 con 0x7f0d68071c70 2024-09-11T23:20:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d68143330 con 0x7f0d68071c70 2024-09-11T23:20:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.096+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d68068930 con 0x7f0d68071c70 2024-09-11T23:20:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.100+0000 7f0d5e7fc640 1 -- 172.21.15.94:0/450478160 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d600bf020 con 0x7f0d68071c70 2024-09-11T23:20:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.100+0000 7f0d5e7fc640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d4c0678c0 0x7f0d4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.100+0000 7f0d5e7fc640 1 -- 172.21.15.94:0/450478160 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f0d601210e0 con 0x7f0d68071c70 2024-09-11T23:20:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.100+0000 7f0d6d2c4640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d4c0678c0 0x7f0d4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.100+0000 7f0d6d2c4640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d4c0678c0 0x7f0d4c069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0d68160dd0 tx=0x7f0d64006ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.104+0000 7f0d5e7fc640 1 -- 172.21.15.94:0/450478160 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d600c6030 con 0x7f0d68071c70 2024-09-11T23:20:37.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.284+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d68141350 con 0x7f0d68071c70 2024-09-11T23:20:37.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d5e7fc640 1 -- 172.21.15.94:0/450478160 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5225 (secure 0 0 0) 0x7f0d600165e0 con 0x7f0d68071c70 2024-09-11T23:20:37.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:37.288 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":72,"btime":"2024-09-11T23:20:28:318414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:24.648300+0000","modified":"2024-09-11T23:20:27.682973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/502410844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":502410844},{"type":"v1","addr":"172.21.15.94:6835","nonce":502410844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":8}]} 2024-09-11T23:20:37.288 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 72 2024-09-11T23:20:37.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d4c0678c0 msgr2=0x7f0d4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d4c0678c0 0x7f0d4c069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0d68160dd0 tx=0x7f0d64006ca0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68071c70 msgr2=0x7f0d68143b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68071c70 0x7f0d68143b30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0d600af040 tx=0x7f0d60019760 comp rx=0 tx=0).stop 2024-09-11T23:20:37.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 shutdown_connections 2024-09-11T23:20:37.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d68141890 0x7f0d680d1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d68140f70 0x7f0d681454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0d4c0678c0 0x7f0d4c069d80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 --2- 172.21.15.94:0/450478160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d68071c70 0x7f0d68143b30 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 >> 172.21.15.94:0/450478160 conn(0x7f0d680b3e70 msgr2=0x7f0d6815e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:37.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 shutdown_connections 2024-09-11T23:20:37.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.288+0000 7f0d6fd29640 1 -- 172.21.15.94:0/450478160 wait complete. 2024-09-11T23:20:37.306 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:37.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.424+0000 7f96c2665640 1 Processor -- start 2024-09-11T23:20:37.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.424+0000 7f96c2665640 1 -- start start 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c2665640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96bc15c2a0 0x7f96bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c2665640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f96bc0af2a0 0x7f96bc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c2665640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96bc0b3290 con 0x7f96bc15bec0 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c2665640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc0b3570 con 0x7f96bc0af2a0 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c2665640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc0b3850 con 0x7f96bc15c2a0 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f96bc0af2a0 0x7f96bc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f96bc0af2a0 0x7f96bc06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58232/0 (socket says 172.21.15.94:58232) 2024-09-11T23:20:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 -- 172.21.15.94:0/1103279846 learned_addr learned my addr 172.21.15.94:0/1103279846 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:37.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96bb7fe640 1 --2- 172.21.15.94:0/1103279846 >> v2:172.21.15.155:3300/0 conn(0x7f96bc15c2a0 0x7f96bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 -- 172.21.15.94:0/1103279846 >> v2:172.21.15.155:3300/0 conn(0x7f96bc15c2a0 msgr2=0x7f96bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:37.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 --2- 172.21.15.94:0/1103279846 >> v2:172.21.15.155:3300/0 conn(0x7f96bc15c2a0 0x7f96bc0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 -- 172.21.15.94:0/1103279846 >> v1:172.21.15.155:6789/0 conn(0x7f96bc15bec0 legacy=0x7f96bc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 -- 172.21.15.94:0/1103279846 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc0b3b30 con 0x7f96bc0af2a0 2024-09-11T23:20:37.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96c0c02640 1 --2- 172.21.15.94:0/1103279846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc06e000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0ae510 tx=0x7f96ac01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7400324da1cdf222 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.428+0000 7f96baffd640 1 -- 172.21.15.94:0/1103279846 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0a5880 con 0x7f96bc0af2a0 2024-09-11T23:20:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96baffd640 1 -- 172.21.15.94:0/1103279846 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac0a5a20 con 0x7f96bc0af2a0 2024-09-11T23:20:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96baffd640 1 -- 172.21.15.94:0/1103279846 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0a5df0 con 0x7f96bc0af2a0 2024-09-11T23:20:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- 172.21.15.94:0/1103279846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 msgr2=0x7f96bc06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 --2- 172.21.15.94:0/1103279846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc06e000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0ae510 tx=0x7f96ac01c9c0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- 172.21.15.94:0/1103279846 shutdown_connections 2024-09-11T23:20:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 --2- 172.21.15.94:0/1103279846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc06e000 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 --2- 172.21.15.94:0/1103279846 >> v2:172.21.15.155:3300/0 conn(0x7f96bc15c2a0 0x7f96bc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- 172.21.15.94:0/1103279846 >> 172.21.15.94:0/1103279846 conn(0x7f96bc0b1f90 msgr2=0x7f96bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- 172.21.15.94:0/1103279846 shutdown_connections 2024-09-11T23:20:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- 172.21.15.94:0/1103279846 wait complete. 2024-09-11T23:20:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 Processor -- start 2024-09-11T23:20:37.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- start start 2024-09-11T23:20:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc15bec0 0x7f96bc157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc15c2a0 0x7f96bc157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc06ed50 con 0x7f96bc0af2a0 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc0af710 con 0x7f96bc15bec0 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96bc06eed0 con 0x7f96bc15c2a0 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc15ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58240/0 (socket says 172.21.15.94:58240) 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 -- 172.21.15.94:0/3667190703 learned_addr learned my addr 172.21.15.94:0/3667190703 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c0c02640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc15c2a0 0x7f96bc157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bb7fe640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc15bec0 0x7f96bc157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 -- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc15c2a0 msgr2=0x7f96bc157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc15c2a0 0x7f96bc157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 -- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc15bec0 msgr2=0x7f96bc157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc15bec0 0x7f96bc157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 -- 172.21.15.94:0/3667190703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc15ca10 con 0x7f96bc0af2a0 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96bbfff640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc15ad20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f96b400c450 tx=0x7f96b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96b8ff9640 1 -- 172.21.15.94:0/3667190703 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4016020 con 0x7f96bc0af2a0 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96b8ff9640 1 -- 172.21.15.94:0/3667190703 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b40052d0 con 0x7f96bc0af2a0 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96bc155f40 con 0x7f96bc0af2a0 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96b8ff9640 1 -- 172.21.15.94:0/3667190703 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4007260 con 0x7f96bc0af2a0 2024-09-11T23:20:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.432+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96bc156500 con 0x7f96bc0af2a0 2024-09-11T23:20:37.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.436+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96bc06f260 con 0x7f96bc0af2a0 2024-09-11T23:20:37.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.436+0000 7f96b8ff9640 1 -- 172.21.15.94:0/3667190703 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96b4007400 con 0x7f96bc0af2a0 2024-09-11T23:20:37.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.436+0000 7f96b8ff9640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f969c0678c0 0x7f969c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.436+0000 7f96b8ff9640 1 -- 172.21.15.94:0/3667190703 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f96b4085750 con 0x7f96bc0af2a0 2024-09-11T23:20:37.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.436+0000 7f96bb7fe640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f969c0678c0 0x7f969c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.436+0000 7f96bb7fe640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f969c0678c0 0x7f969c069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f96bc15b680 tx=0x7f96a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.440+0000 7f96b8ff9640 1 -- 172.21.15.94:0/3667190703 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96b4020020 con 0x7f96bc0af2a0 2024-09-11T23:20:37.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.620+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96bc06fcd0 con 0x7f96bc0af2a0 2024-09-11T23:20:37.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96b8ff9640 1 -- 172.21.15.94:0/3667190703 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5225 (secure 0 0 0) 0x7f96b4005480 con 0x7f96bc0af2a0 2024-09-11T23:20:37.624 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:37.624 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":72,"btime":"2024-09-11T23:20:28:318414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:24.648300+0000","modified":"2024-09-11T23:20:27.682973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6835/502410844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":502410844},{"type":"v1","addr":"172.21.15.94:6835","nonce":502410844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":8}]} 2024-09-11T23:20:37.624 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 72 2024-09-11T23:20:37.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f969c0678c0 msgr2=0x7f969c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f969c0678c0 0x7f969c069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f96bc15b680 tx=0x7f96a4008040 comp rx=0 tx=0).stop 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 msgr2=0x7f96bc15ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc15ad20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f96b400c450 tx=0x7f96b400c910 comp rx=0 tx=0).stop 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 shutdown_connections 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc15c2a0 0x7f96bc157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc15bec0 0x7f96bc157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f969c0678c0 0x7f969c069d80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 --2- 172.21.15.94:0/3667190703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96bc0af2a0 0x7f96bc15ad20 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 >> 172.21.15.94:0/3667190703 conn(0x7f96bc0b1f90 msgr2=0x7f96bc1599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 shutdown_connections 2024-09-11T23:20:37.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.624+0000 7f96c2665640 1 -- 172.21.15.94:0/3667190703 wait complete. 2024-09-11T23:20:37.643 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:37.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 Processor -- start 2024-09-11T23:20:37.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 -- start start 2024-09-11T23:20:37.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65701457a0 0x7f65700d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65700cf800 0x7f65700b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65700b4340 0x7f657015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f65700b4790 con 0x7f65701457a0 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f65700d27a0 con 0x7f65700cf800 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f6575d8c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65700d2a80 con 0x7f65700b4340 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65701457a0 0x7f65700d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f65701457a0 0x7f65700d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58254/0 (socket says 172.21.15.94:58254) 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 -- 172.21.15.94:0/592482267 learned_addr learned my addr 172.21.15.94:0/592482267 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656effd640 1 --2- 172.21.15.94:0/592482267 >> v2:172.21.15.155:3300/0 conn(0x7f65700cf800 0x7f65700b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656ffff640 1 --2- 172.21.15.94:0/592482267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65700b4340 0x7f657015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 -- 172.21.15.94:0/592482267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65700b4340 msgr2=0x7f657015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 --2- 172.21.15.94:0/592482267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65700b4340 0x7f657015ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 -- 172.21.15.94:0/592482267 >> v2:172.21.15.155:3300/0 conn(0x7f65700cf800 msgr2=0x7f65700b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:37.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 --2- 172.21.15.94:0/592482267 >> v2:172.21.15.155:3300/0 conn(0x7f65700cf800 0x7f65700b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.756+0000 7f656f7fe640 1 -- 172.21.15.94:0/592482267 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65700d2d60 con 0x7f65701457a0 2024-09-11T23:20:37.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656f7fe640 1 --2- 172.21.15.94:0/592482267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701457a0 0x7f65700d1ea0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f65700cfc70 tx=0x7f656001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf42f5752d2e8ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656e7fc640 1 -- 172.21.15.94:0/592482267 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65600b0070 con 0x7f65701457a0 2024-09-11T23:20:37.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656e7fc640 1 -- 172.21.15.94:0/592482267 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65600ab600 con 0x7f65701457a0 2024-09-11T23:20:37.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656e7fc640 1 -- 172.21.15.94:0/592482267 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65600ab9d0 con 0x7f65701457a0 2024-09-11T23:20:37.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- 172.21.15.94:0/592482267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701457a0 msgr2=0x7f65700d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 --2- 172.21.15.94:0/592482267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701457a0 0x7f65700d1ea0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f65700cfc70 tx=0x7f656001c1d0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- 172.21.15.94:0/592482267 shutdown_connections 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 --2- 172.21.15.94:0/592482267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65700b4340 0x7f657015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 --2- 172.21.15.94:0/592482267 >> v2:172.21.15.155:3300/0 conn(0x7f65700cf800 0x7f65700b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 --2- 172.21.15.94:0/592482267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65701457a0 0x7f65700d1ea0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- 172.21.15.94:0/592482267 >> 172.21.15.94:0/592482267 conn(0x7f657006bcc0 msgr2=0x7f657006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- 172.21.15.94:0/592482267 shutdown_connections 2024-09-11T23:20:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- 172.21.15.94:0/592482267 wait complete. 2024-09-11T23:20:37.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 Processor -- start 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- start start 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65700b4340 0x7f657014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700cf800 0x7f65700b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65701457a0 0x7f65700b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65700d0890 con 0x7f65700cf800 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65700d0710 con 0x7f65700b4340 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f6575d8c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65700d0a10 con 0x7f65701457a0 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700cf800 0x7f65700b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700cf800 0x7f65700b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58262/0 (socket says 172.21.15.94:58262) 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 -- 172.21.15.94:0/1064665228 learned_addr learned my addr 172.21.15.94:0/1064665228 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656f7fe640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65700b4340 0x7f657014cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656ffff640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65701457a0 0x7f65700b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 -- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65701457a0 msgr2=0x7f65700b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65701457a0 0x7f65700b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 -- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65700b4340 msgr2=0x7f657014cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65700b4340 0x7f657014cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656effd640 1 -- 172.21.15.94:0/1064665228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657014d080 con 0x7f65700cf800 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.760+0000 7f656ffff640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65701457a0 0x7f65700b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f656effd640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700cf800 0x7f65700b5380 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f656400d800 tx=0x7f656400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6557fff640 1 -- 172.21.15.94:0/1064665228 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400b6c0 con 0x7f65700cf800 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6557fff640 1 -- 172.21.15.94:0/1064665228 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6564019070 con 0x7f65700cf800 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6557fff640 1 -- 172.21.15.94:0/1064665228 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400ba60 con 0x7f65700cf800 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657015ba50 con 0x7f65700cf800 2024-09-11T23:20:37.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65700c7d80 con 0x7f65700cf800 2024-09-11T23:20:37.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65700b3e00 con 0x7f65700cf800 2024-09-11T23:20:37.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6557fff640 1 -- 172.21.15.94:0/1064665228 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f656400bc00 con 0x7f65700cf800 2024-09-11T23:20:37.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6557fff640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f655c0678f0 0x7f655c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:37.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f6557fff640 1 -- 172.21.15.94:0/1064665228 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f6564086260 con 0x7f65700cf800 2024-09-11T23:20:37.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f656f7fe640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f655c0678f0 0x7f655c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:37.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.764+0000 7f656f7fe640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f655c0678f0 0x7f655c069db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f65600ad000 tx=0x7f6560008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:37.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.768+0000 7f6557fff640 1 -- 172.21.15.94:0/1064665228 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6564056c10 con 0x7f65700cf800 2024-09-11T23:20:37.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.924+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6570166de0 con 0x7f65700cf800 2024-09-11T23:20:37.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.924+0000 7f6557fff640 1 -- 172.21.15.94:0/1064665228 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17036 (secure 0 0 0) 0x7f6564056510 con 0x7f65700cf800 2024-09-11T23:20:37.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:37.927 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":115,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:20:26.277253+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:23.260045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:23.628059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:37.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f655c0678f0 msgr2=0x7f655c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f655c0678f0 0x7f655c069db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f65600ad000 tx=0x7f6560008040 comp rx=0 tx=0).stop 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700cf800 msgr2=0x7f65700b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700cf800 0x7f65700b5380 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f656400d800 tx=0x7f656400dcc0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 shutdown_connections 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65701457a0 0x7f65700b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f655c0678f0 0x7f655c069db0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65700cf800 0x7f65700b5380 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 --2- 172.21.15.94:0/1064665228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65700b4340 0x7f657014cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 >> 172.21.15.94:0/1064665228 conn(0x7f657006bcc0 msgr2=0x7f65700b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 shutdown_connections 2024-09-11T23:20:37.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:37.928+0000 7f6575d8c640 1 -- 172.21.15.94:0/1064665228 wait complete. 2024-09-11T23:20:37.945 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:20:38.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f080642c640 1 Processor -- start 2024-09-11T23:20:38.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f080642c640 1 -- start start 2024-09-11T23:20:38.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f080642c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f08001587a0 0x7f08000b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f080642c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 0x7f0800072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f080642c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080006ec60 con 0x7f08000b37d0 2024-09-11T23:20:38.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f080642c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f08000b3c40 con 0x7f08001587a0 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f080642c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f080006f870 con 0x7f080006e680 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07ff7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f08000b37d0 0x7f080006df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42324/0 (socket says 172.21.15.94:42324) 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07ff7fe640 1 -- 172.21.15.94:0/3568938053 learned_addr learned my addr 172.21.15.94:0/3568938053 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07fffff640 1 --2- 172.21.15.94:0/3568938053 >> v2:172.21.15.155:3300/0 conn(0x7f08001587a0 0x7f08000b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421576345 0 0) 0x7f080006ec60 con 0x7f08000b37d0 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e8003530 con 0x7f08000b37d0 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f08049c9640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 0x7f0800072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2509830899 0 0) 0x7f07e8003530 con 0x7f08000b37d0 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 msgr2=0x7f0800072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 0x7f0800072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 >> v2:172.21.15.155:3300/0 conn(0x7f08001587a0 msgr2=0x7f08000b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 --2- 172.21.15.94:0/3568938053 >> v2:172.21.15.155:3300/0 conn(0x7f08001587a0 0x7f08000b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080006ef40 con 0x7f08000b37d0 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f07f4001680 con 0x7f08000b37d0 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 >> v1:172.21.15.94:6789/0 conn(0x7f08000b37d0 legacy=0x7f080006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e80039c0 0x7f07e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07e8004810 0x7f07e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 0x7f07e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f08000b3c40 con 0x7f07e8004810 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f080006f870 con 0x7f07e80039c0 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f07e800ba00 con 0x7f080006e680 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07ff7fe640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07e8004810 0x7f07e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f08049c9640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 0x7f07e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07fffff640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e80039c0 0x7f07e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07ff7fe640 1 -- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 msgr2=0x7f07e80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.060+0000 7f07ff7fe640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080006e680 0x7f07e80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f07ff7fe640 1 -- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e80039c0 msgr2=0x7f07e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f07ff7fe640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e80039c0 0x7f07e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f07ff7fe640 1 -- 172.21.15.94:0/3568938053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e8003530 con 0x7f07e8004810 2024-09-11T23:20:38.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f07ff7fe640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07e8004810 0x7f07e8004c90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c240 tx=0x7f07f401f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65b331b418713a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4007d40 con 0x7f07e8004810 2024-09-11T23:20:38.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4005b00 con 0x7f07e8004810 2024-09-11T23:20:38.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f07feffd640 1 -- 172.21.15.94:0/3568938053 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4007070 con 0x7f07e8004810 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f080642c640 1 -- 172.21.15.94:0/3568938053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07e8004810 msgr2=0x7f07e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f080642c640 1 --2- 172.21.15.94:0/3568938053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07e8004810 0x7f07e8004c90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c240 tx=0x7f07f401f410 comp rx=0 tx=0).stop 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f08049c9640 1 -- 172.21.15.94:0/3568938053 reap_dead start 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f080642c640 1 -- 172.21.15.94:0/3568938053 shutdown_connections 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f080642c640 1 -- 172.21.15.94:0/3568938053 >> 172.21.15.94:0/3568938053 conn(0x7f08000b1f90 msgr2=0x7f08000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f080642c640 1 -- 172.21.15.94:0/3568938053 shutdown_connections 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.064+0000 7f080642c640 1 -- 172.21.15.94:0/3568938053 wait complete. 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 Processor -- start 2024-09-11T23:20:38.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 -- start start 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080009c1b0 0x7f08001f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0800155950 0x7f08001473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f080009c590 0x7f08001478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0800158b80 con 0x7f080009c590 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f080006f500 con 0x7f0800155950 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f080009a380 con 0x7f080009c1b0 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f080009c590 0x7f08001478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f080009c590 0x7f08001478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58288/0 (socket says 172.21.15.94:58288) 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 -- 172.21.15.94:0/781503028 learned_addr learned my addr 172.21.15.94:0/781503028 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:38.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 -- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080009c1b0 msgr2=0x7f08001f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080009c1b0 0x7f08001f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 -- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0800155950 msgr2=0x7f08001473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0800155950 0x7f08001473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 -- 172.21.15.94:0/781503028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08001f54b0 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f08049c9640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f080009c590 0x7f08001478f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f080006da30 tx=0x7f07f8009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f07fcff9640 1 -- 172.21.15.94:0/781503028 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8007cf0 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f07fcff9640 1 -- 172.21.15.94:0/781503028 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8019070 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08001f5790 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f07fcff9640 1 -- 172.21.15.94:0/781503028 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8014650 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080009a620 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f080009a820 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.068+0000 7f07fcff9640 1 -- 172.21.15.94:0/781503028 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07f80147f0 con 0x7f080009c590 2024-09-11T23:20:38.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.072+0000 7f07fcff9640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07ec0678f0 0x7f07ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.072+0000 7f07fcff9640 1 -- 172.21.15.94:0/781503028 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f07f8086270 con 0x7f080009c590 2024-09-11T23:20:38.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.072+0000 7f07fffff640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07ec0678f0 0x7f07ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.072+0000 7f07fffff640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07ec0678f0 0x7f07ec069db0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f07f00099b0 tx=0x7f07f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.076+0000 7f07fcff9640 1 -- 172.21.15.94:0/781503028 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f080009a820 con 0x7f080009c590 2024-09-11T23:20:38.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.260+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f08000b3290 con 0x7f080009c590 2024-09-11T23:20:38.261 INFO:tasks.ceph.mon.a.smithi094.stderr:2024-09-11T23:20:38.260+0000 7f5d18822640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:20:38.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.260+0000 7f07fcff9640 1 -- 172.21.15.94:0/781503028 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) ==== 161+0+0 (secure 0 0 0) 0x7f07f8056c20 con 0x7f080009c590 2024-09-11T23:20:38.263 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:20:38.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.264+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07ec0678f0 msgr2=0x7f07ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.264+0000 7f080642c640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07ec0678f0 0x7f07ec069db0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f07f00099b0 tx=0x7f07f0008040 comp rx=0 tx=0).stop 2024-09-11T23:20:38.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.264+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f080009c590 msgr2=0x7f08001478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.264+0000 7f080642c640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f080009c590 0x7f08001478f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f080006da30 tx=0x7f07f8009d40 comp rx=0 tx=0).stop 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 shutdown_connections 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f07ec0678f0 0x7f07ec069db0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f080009c590 0x7f08001478f0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0800155950 0x7f08001473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 --2- 172.21.15.94:0/781503028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f080009c1b0 0x7f08001f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 >> 172.21.15.94:0/781503028 conn(0x7f08000b1f90 msgr2=0x7f08000af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 shutdown_connections 2024-09-11T23:20:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.268+0000 7f080642c640 1 -- 172.21.15.94:0/781503028 wait complete. 2024-09-11T23:20:38.275 INFO:tasks.ceph.mds.c.smithi094.stderr: -4082> 2024-09-11T23:20:28.276+0000 7fb03cee8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:20:38.285 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:20:38.317 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-09-11T23:20:38.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f3161eff640 1 Processor -- start 2024-09-11T23:20:38.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f3161eff640 1 -- start start 2024-09-11T23:20:38.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f3161eff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f315c144d60 0x7f315c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f3161eff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f315c0b52b0 0x7f315c0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f3161eff640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c071030 con 0x7f315c0b4090 2024-09-11T23:20:38.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f3161eff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f315c070660 con 0x7f315c0b52b0 2024-09-11T23:20:38.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f3161eff640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f315c06fa50 con 0x7f315c144d60 2024-09-11T23:20:38.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315affd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f315c0b4090 0x7f315c0b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42332/0 (socket says 172.21.15.94:42332) 2024-09-11T23:20:38.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315affd640 1 -- 172.21.15.94:0/3260550069 learned_addr learned my addr 172.21.15.94:0/3260550069 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:38.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315bfff640 1 --2- 172.21.15.94:0/3260550069 >> v2:172.21.15.94:3300/0 conn(0x7f315c0b52b0 0x7f315c0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315a7fc640 1 -- 172.21.15.94:0/3260550069 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153800261 0 0) 0x7f315c071030 con 0x7f315c0b4090 2024-09-11T23:20:38.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315a7fc640 1 -- 172.21.15.94:0/3260550069 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3144003530 con 0x7f315c0b4090 2024-09-11T23:20:38.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315bfff640 1 -- 172.21.15.94:0/3260550069 >> v2:172.21.15.155:3300/0 conn(0x7f315c144d60 msgr2=0x7f315c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315bfff640 1 --2- 172.21.15.94:0/3260550069 >> v2:172.21.15.155:3300/0 conn(0x7f315c144d60 0x7f315c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315bfff640 1 -- 172.21.15.94:0/3260550069 >> v1:172.21.15.94:6789/0 conn(0x7f315c0b4090 legacy=0x7f315c0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.400+0000 7f315bfff640 1 -- 172.21.15.94:0/3260550069 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c06fd30 con 0x7f315c0b52b0 2024-09-11T23:20:38.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315bfff640 1 --2- 172.21.15.94:0/3260550069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c0b4500 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f315c0718a0 tx=0x7f315401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28b841a40f1695 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315a7fc640 1 -- 172.21.15.94:0/3260550069 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315400b2d0 con 0x7f315c0b52b0 2024-09-11T23:20:38.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315a7fc640 1 -- 172.21.15.94:0/3260550069 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31540a78f0 con 0x7f315c0b52b0 2024-09-11T23:20:38.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315a7fc640 1 -- 172.21.15.94:0/3260550069 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31540a7cc0 con 0x7f315c0b52b0 2024-09-11T23:20:38.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- 172.21.15.94:0/3260550069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 msgr2=0x7f315c0b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 --2- 172.21.15.94:0/3260550069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c0b4500 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f315c0718a0 tx=0x7f315401eb30 comp rx=0 tx=0).stop 2024-09-11T23:20:38.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- 172.21.15.94:0/3260550069 shutdown_connections 2024-09-11T23:20:38.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 --2- 172.21.15.94:0/3260550069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c0b4500 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 --2- 172.21.15.94:0/3260550069 >> v2:172.21.15.155:3300/0 conn(0x7f315c144d60 0x7f315c070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- 172.21.15.94:0/3260550069 >> 172.21.15.94:0/3260550069 conn(0x7f315c09aa00 msgr2=0x7f315c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:38.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- 172.21.15.94:0/3260550069 shutdown_connections 2024-09-11T23:20:38.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- 172.21.15.94:0/3260550069 wait complete. 2024-09-11T23:20:38.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 Processor -- start 2024-09-11T23:20:38.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- start start 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b4090 0x7f315c15a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c13db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c144d60 0x7f315c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0aefa0 con 0x7f315c0b52b0 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0aee20 con 0x7f315c0b4090 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f3161eff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0af120 con 0x7f315c144d60 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c13db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c13db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58310/0 (socket says 172.21.15.94:58310) 2024-09-11T23:20:38.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315affd640 1 -- 172.21.15.94:0/3000811049 learned_addr learned my addr 172.21.15.94:0/3000811049 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.404+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b4090 0x7f315c15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315affd640 1 -- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c144d60 msgr2=0x7f315c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315affd640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c144d60 0x7f315c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315affd640 1 -- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b4090 msgr2=0x7f315c15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315affd640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b4090 0x7f315c15a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315affd640 1 -- 172.21.15.94:0/3000811049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c13e6d0 con 0x7f315c0b52b0 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b4090 0x7f315c15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315affd640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c13db40 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f315000c450 tx=0x7f315000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3143fff640 1 -- 172.21.15.94:0/3000811049 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150017070 con 0x7f315c0b52b0 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3143fff640 1 -- 172.21.15.94:0/3000811049 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3150005cf0 con 0x7f315c0b52b0 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c13e9b0 con 0x7f315c0b52b0 2024-09-11T23:20:38.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3143fff640 1 -- 172.21.15.94:0/3000811049 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150007290 con 0x7f315c0b52b0 2024-09-11T23:20:38.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c09ec70 con 0x7f315c0b52b0 2024-09-11T23:20:38.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c0b4500 con 0x7f315c0b52b0 2024-09-11T23:20:38.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3143fff640 1 -- 172.21.15.94:0/3000811049 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f315001a070 con 0x7f315c0b52b0 2024-09-11T23:20:38.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3143fff640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31480678c0 0x7f3148069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f3143fff640 1 -- 172.21.15.94:0/3000811049 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6187+0+0 (secure 0 0 0) 0x7f31500851f0 con 0x7f315c0b52b0 2024-09-11T23:20:38.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31480678c0 0x7f3148069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.408+0000 7f315b7fe640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31480678c0 0x7f3148069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f315c141120 tx=0x7f314c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.412+0000 7f3143fff640 1 -- 172.21.15.94:0/3000811049 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3150055b50 con 0x7f315c0b52b0 2024-09-11T23:20:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:38.608+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f315c06f1f0 con 0x7f315c0b52b0 2024-09-11T23:20:39.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.264+0000 7f3143fff640 1 -- 172.21.15.94:0/3000811049 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f3150055450 con 0x7f315c0b52b0 2024-09-11T23:20:39.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31480678c0 msgr2=0x7f3148069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31480678c0 0x7f3148069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f315c141120 tx=0x7f314c008040 comp rx=0 tx=0).stop 2024-09-11T23:20:39.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 msgr2=0x7f315c13db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c13db40 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f315000c450 tx=0x7f315000c910 comp rx=0 tx=0).stop 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 shutdown_connections 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f315c144d60 0x7f315c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f31480678c0 0x7f3148069d80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f315c0b52b0 0x7f315c13db40 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 --2- 172.21.15.94:0/3000811049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f315c0b4090 0x7f315c15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 >> 172.21.15.94:0/3000811049 conn(0x7f315c09aa00 msgr2=0x7f315c1399c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 shutdown_connections 2024-09-11T23:20:39.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.268+0000 7f3161eff640 1 -- 172.21.15.94:0/3000811049 wait complete. 2024-09-11T23:20:39.290 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:20:39.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631b5d2640 1 Processor -- start 2024-09-11T23:20:39.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631b5d2640 1 -- start start 2024-09-11T23:20:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631b5d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6314161a60 0x7f63140d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631b5d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63140cf620 0x7f631406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631b5d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63140d32b0 con 0x7f63140d2e90 2024-09-11T23:20:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631b5d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f63140d0300 con 0x7f6314161a60 2024-09-11T23:20:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631b5d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63140cfab0 con 0x7f63140cf620 2024-09-11T23:20:39.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f6319b6f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63140cf620 0x7f631406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631936e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6314161a60 0x7f63140d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f6319b6f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63140cf620 0x7f631406d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:37496/0 (socket says 172.21.15.94:37496) 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f6318b6d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f63140d2e90 0x7f63140cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.94:55006/0 (socket says 172.21.15.94:55006) 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f6319b6f640 1 -- 172.21.15.94:0/821477836 learned_addr learned my addr 172.21.15.94:0/821477836 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631936e640 1 -- 172.21.15.94:0/821477836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63140cf620 msgr2=0x7f631406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631936e640 1 --2- 172.21.15.94:0/821477836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63140cf620 0x7f631406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631936e640 1 -- 172.21.15.94:0/821477836 >> v1:172.21.15.155:6789/0 conn(0x7f63140d2e90 legacy=0x7f63140cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.464+0000 7f631936e640 1 -- 172.21.15.94:0/821477836 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63140b0f60 con 0x7f6314161a60 2024-09-11T23:20:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631936e640 1 --2- 172.21.15.94:0/821477836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6314161a60 0x7f63140d2950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f63100097c0 tx=0x7f631001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=503fc8e7d64023fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f630bfff640 1 -- 172.21.15.94:0/821477836 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100b1070 con 0x7f6314161a60 2024-09-11T23:20:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f630bfff640 1 -- 172.21.15.94:0/821477836 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63100a8050 con 0x7f6314161a60 2024-09-11T23:20:39.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f630bfff640 1 -- 172.21.15.94:0/821477836 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100ac860 con 0x7f6314161a60 2024-09-11T23:20:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 -- 172.21.15.94:0/821477836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6314161a60 msgr2=0x7f63140d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 --2- 172.21.15.94:0/821477836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6314161a60 0x7f63140d2950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f63100097c0 tx=0x7f631001c3e0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 -- 172.21.15.94:0/821477836 shutdown_connections 2024-09-11T23:20:39.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 --2- 172.21.15.94:0/821477836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63140cf620 0x7f631406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 --2- 172.21.15.94:0/821477836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6314161a60 0x7f63140d2950 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 -- 172.21.15.94:0/821477836 >> 172.21.15.94:0/821477836 conn(0x7f631408bf90 msgr2=0x7f631409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 -- 172.21.15.94:0/821477836 shutdown_connections 2024-09-11T23:20:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 -- 172.21.15.94:0/821477836 wait complete. 2024-09-11T23:20:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 Processor -- start 2024-09-11T23:20:39.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.468+0000 7f631b5d2640 1 -- start start 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63140cf620 0x7f63140b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63140d2e90 0x7f63140b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6314161a60 0x7f6314158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f631406e400 con 0x7f63140d2e90 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f631406d190 con 0x7f63140cf620 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f631406e580 con 0x7f6314161a60 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63140d2e90 0x7f63140b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63140d2e90 0x7f63140b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58314/0 (socket says 172.21.15.94:58314) 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 -- 172.21.15.94:0/618697551 learned_addr learned my addr 172.21.15.94:0/618697551 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:39.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631936e640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63140cf620 0x7f63140b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6319b6f640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6314161a60 0x7f6314158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 -- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6314161a60 msgr2=0x7f6314158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6314161a60 0x7f6314158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 -- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63140cf620 msgr2=0x7f63140b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63140cf620 0x7f63140b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 -- 172.21.15.94:0/618697551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63141612a0 con 0x7f63140d2e90 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6318b6d640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63140d2e90 0x7f63140b3340 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f630400c370 tx=0x7f630400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6309ffb640 1 -- 172.21.15.94:0/618697551 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040074e0 con 0x7f63140d2e90 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6309ffb640 1 -- 172.21.15.94:0/618697551 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6304007680 con 0x7f63140d2e90 2024-09-11T23:20:39.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6309ffb640 1 -- 172.21.15.94:0/618697551 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304004a30 con 0x7f63140d2e90 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63140cb570 con 0x7f63140d2e90 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63140cbb30 con 0x7f63140d2e90 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f631406d6b0 con 0x7f63140d2e90 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.472+0000 7f6309ffb640 1 -- 172.21.15.94:0/618697551 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f630401a020 con 0x7f63140d2e90 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.476+0000 7f6309ffb640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62f80678c0 0x7f62f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.476+0000 7f6309ffb640 1 -- 172.21.15.94:0/618697551 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6187+0+0 (secure 0 0 0) 0x7f6304085590 con 0x7f63140d2e90 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.476+0000 7f631936e640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62f80678c0 0x7f62f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.476+0000 7f631936e640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62f80678c0 0x7f62f8069d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f63100ae000 tx=0x7f6310008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:39.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.480+0000 7f6309ffb640 1 -- 172.21.15.94:0/618697551 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6304055f80 con 0x7f63140d2e90 2024-09-11T23:20:39.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:39.644+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f631406bcc0 con 0x7f63140d2e90 2024-09-11T23:20:40.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.380+0000 7f6309ffb640 1 -- 172.21.15.94:0/618697551 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) ==== 181+0+0 (secure 0 0 0) 0x7f6304055880 con 0x7f63140d2e90 2024-09-11T23:20:40.381 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62f80678c0 msgr2=0x7f62f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62f80678c0 0x7f62f8069d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f63100ae000 tx=0x7f6310008040 comp rx=0 tx=0).stop 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63140d2e90 msgr2=0x7f63140b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63140d2e90 0x7f63140b3340 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f630400c370 tx=0x7f630400c830 comp rx=0 tx=0).stop 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 shutdown_connections 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6314161a60 0x7f6314158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f62f80678c0 0x7f62f8069d80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63140d2e90 0x7f63140b3340 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 --2- 172.21.15.94:0/618697551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63140cf620 0x7f63140b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 >> 172.21.15.94:0/618697551 conn(0x7f631408bf90 msgr2=0x7f63140b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:40.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 shutdown_connections 2024-09-11T23:20:40.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.384+0000 7f631b5d2640 1 -- 172.21.15.94:0/618697551 wait complete. 2024-09-11T23:20:40.407 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:20:40.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1e614640 1 Processor -- start 2024-09-11T23:20:40.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1e614640 1 -- start start 2024-09-11T23:20:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1e614640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a18073e60 0x7f5a1806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1e614640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1806ee50 con 0x7f5a180b3d50 2024-09-11T23:20:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1e614640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1806f130 con 0x7f5a1806fef0 2024-09-11T23:20:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1e614640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1806f410 con 0x7f5a18073e60 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1cbb1640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5a180b3d50 0x7f5a180b4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41882/0 (socket says 172.21.15.94:41882) 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.528+0000 7f5a1cbb1640 1 -- 172.21.15.94:0/1121019076 learned_addr learned my addr 172.21.15.94:0/1121019076 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a17fff640 1 --2- 172.21.15.94:0/1121019076 >> v2:172.21.15.155:3300/0 conn(0x7f5a18073e60 0x7f5a1806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821195585 0 0) 0x7f5a1806ee50 con 0x7f5a180b3d50 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04003530 con 0x7f5a180b3d50 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268836220 0 0) 0x7f5a04003530 con 0x7f5a180b3d50 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 >> v2:172.21.15.155:3300/0 conn(0x7f5a18073e60 msgr2=0x7f5a1806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 --2- 172.21.15.94:0/1121019076 >> v2:172.21.15.155:3300/0 conn(0x7f5a18073e60 0x7f5a1806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 >> v1:172.21.15.155:6789/0 conn(0x7f5a1806fef0 legacy=0x7f5a1815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1806f6f0 con 0x7f5a180b3d50 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f5a10001a00 con 0x7f5a180b3d50 2024-09-11T23:20:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 >> v1:172.21.15.94:6789/0 conn(0x7f5a180b3d50 legacy=0x7f5a180b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a040039c0 0x7f5a04003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a040051d0 0x7f5a0400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1806f410 con 0x7f5a04004810 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0400d280 con 0x7f5a040039c0 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0400d480 con 0x7f5a040051d0 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a0f7fe640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a17fff640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a040039c0 0x7f5a04003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a1cbb1640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a040051d0 0x7f5a0400cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a0f7fe640 1 -- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a040051d0 msgr2=0x7f5a0400cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a0f7fe640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a040051d0 0x7f5a0400cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a0f7fe640 1 -- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a040039c0 msgr2=0x7f5a04003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a0f7fe640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a040039c0 0x7f5a04003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a0f7fe640 1 -- 172.21.15.94:0/1121019076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a04003530 con 0x7f5a04004810 2024-09-11T23:20:40.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a17fff640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a040039c0 0x7f5a04003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:40.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a1cbb1640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a040051d0 0x7f5a0400cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:40.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a1cbb1640 1 -- 172.21.15.94:0/1121019076 reap_dead start 2024-09-11T23:20:40.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a0f7fe640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a04004c90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5a00001750 tx=0x7f5a0001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfca4adf34e0b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:40.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a000013a0 con 0x7f5a04004810 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a000052f0 con 0x7f5a04004810 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.532+0000 7f5a177fe640 1 -- 172.21.15.94:0/1121019076 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00003840 con 0x7f5a04004810 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- 172.21.15.94:0/1121019076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 msgr2=0x7f5a04004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a04004c90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5a00001750 tx=0x7f5a0001c3c0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- 172.21.15.94:0/1121019076 shutdown_connections 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 --2- 172.21.15.94:0/1121019076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a04004c90 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- 172.21.15.94:0/1121019076 >> 172.21.15.94:0/1121019076 conn(0x7f5a180b1f90 msgr2=0x7f5a180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- 172.21.15.94:0/1121019076 shutdown_connections 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- 172.21.15.94:0/1121019076 wait complete. 2024-09-11T23:20:40.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 Processor -- start 2024-09-11T23:20:40.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- start start 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a180b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18150400 0x7f5a180b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1809a380 0x7f5a181ea890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1806e900 con 0x7f5a04004810 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1806e780 con 0x7f5a18150400 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1806ea80 con 0x7f5a1809a380 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a180b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a180b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53638/0 (socket says 172.21.15.94:53638) 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 -- 172.21.15.94:0/2903726723 learned_addr learned my addr 172.21.15.94:0/2903726723 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a0f7fe640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18150400 0x7f5a180b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1cbb1640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1809a380 0x7f5a181ea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 -- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1809a380 msgr2=0x7f5a181ea890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1809a380 0x7f5a181ea890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 -- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18150400 msgr2=0x7f5a180b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18150400 0x7f5a180b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 -- 172.21.15.94:0/2903726723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a18151600 con 0x7f5a04004810 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1cbb1640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1809a380 0x7f5a181ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a17fff640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a180b0f10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f5a080109b0 tx=0x7f5a08010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a157fa640 1 -- 172.21.15.94:0/2903726723 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800f040 con 0x7f5a04004810 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a157fa640 1 -- 172.21.15.94:0/2903726723 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0800ebc0 con 0x7f5a04004810 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a181518e0 con 0x7f5a04004810 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a157fa640 1 -- 172.21.15.94:0/2903726723 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0801c400 con 0x7f5a04004810 2024-09-11T23:20:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.536+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a18151ea0 con 0x7f5a04004810 2024-09-11T23:20:40.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.540+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1815e400 con 0x7f5a04004810 2024-09-11T23:20:40.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.540+0000 7f5a157fa640 1 -- 172.21.15.94:0/2903726723 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a080253f0 con 0x7f5a04004810 2024-09-11T23:20:40.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.540+0000 7f5a157fa640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f59f80678f0 0x7f59f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.540+0000 7f5a157fa640 1 -- 172.21.15.94:0/2903726723 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5749+0+0 (secure 0 0 0) 0x7f5a08086340 con 0x7f5a04004810 2024-09-11T23:20:40.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.540+0000 7f5a0f7fe640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f59f80678f0 0x7f59f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.540+0000 7f5a0f7fe640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f59f80678f0 0x7f59f8069db0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5a180d12d0 tx=0x7f5a000011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:40.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.544+0000 7f5a157fa640 1 -- 172.21.15.94:0/2903726723 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a08018030 con 0x7f5a04004810 2024-09-11T23:20:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:40.708+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5a18072bb0 con 0x7f5a04004810 2024-09-11T23:20:41.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.388+0000 7f5a157fa640 1 -- 172.21.15.94:0/2903726723 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) ==== 169+0+0 (secure 0 0 0) 0x7f5a08056ee0 con 0x7f5a04004810 2024-09-11T23:20:41.389 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-09-11T23:20:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f59f80678f0 msgr2=0x7f59f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f59f80678f0 0x7f59f8069db0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5a180d12d0 tx=0x7f5a000011a0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 msgr2=0x7f5a180b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a180b0f10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f5a080109b0 tx=0x7f5a08010e70 comp rx=0 tx=0).stop 2024-09-11T23:20:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 shutdown_connections 2024-09-11T23:20:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1809a380 0x7f5a181ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18150400 0x7f5a180b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f59f80678f0 0x7f59f8069db0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 --2- 172.21.15.94:0/2903726723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a04004810 0x7f5a180b0f10 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 >> 172.21.15.94:0/2903726723 conn(0x7f5a180b1f90 msgr2=0x7f5a18159440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:41.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 shutdown_connections 2024-09-11T23:20:41.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.392+0000 7f5a1e614640 1 -- 172.21.15.94:0/2903726723 wait complete. 2024-09-11T23:20:41.417 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:20:41.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.544+0000 7f2fa53c2640 1 Processor -- start 2024-09-11T23:20:41.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.544+0000 7f2fa53c2640 1 -- start start 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa015bec0 0x7f2fa00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2fa015c2a0 0x7f2fa00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2fa00af2a0 0x7f2fa015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa00b3290 con 0x7f2fa00af2a0 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa00b3570 con 0x7f2fa015c2a0 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa00b3850 con 0x7f2fa015bec0 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2fa00af2a0 0x7f2fa015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2fa00af2a0 0x7f2fa015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53648/0 (socket says 172.21.15.94:53648) 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/2445370018 learned_addr learned my addr 172.21.15.94:0/2445370018 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9e7fc640 1 --2- 172.21.15.94:0/2445370018 >> v2:172.21.15.155:3300/0 conn(0x7f2fa015c2a0 0x7f2fa00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9effd640 1 --2- 172.21.15.94:0/2445370018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa015bec0 0x7f2fa00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/2445370018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa015bec0 msgr2=0x7f2fa00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:41.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 --2- 172.21.15.94:0/2445370018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa015bec0 0x7f2fa00ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/2445370018 >> v2:172.21.15.155:3300/0 conn(0x7f2fa015c2a0 msgr2=0x7f2fa00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:41.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 --2- 172.21.15.94:0/2445370018 >> v2:172.21.15.155:3300/0 conn(0x7f2fa015c2a0 0x7f2fa00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/2445370018 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa00b3b30 con 0x7f2fa00af2a0 2024-09-11T23:20:41.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9f7fe640 1 --2- 172.21.15.94:0/2445370018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa00af2a0 0x7f2fa015fc60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006de20 tx=0x7f2f9801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abe2ab50ad45aff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:41.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9dffb640 1 -- 172.21.15.94:0/2445370018 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f980a5580 con 0x7f2fa00af2a0 2024-09-11T23:20:41.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9dffb640 1 -- 172.21.15.94:0/2445370018 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f980a5720 con 0x7f2fa00af2a0 2024-09-11T23:20:41.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2f9dffb640 1 -- 172.21.15.94:0/2445370018 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f980a5af0 con 0x7f2fa00af2a0 2024-09-11T23:20:41.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- 172.21.15.94:0/2445370018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa00af2a0 msgr2=0x7f2fa015fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/2445370018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa00af2a0 0x7f2fa015fc60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006de20 tx=0x7f2f9801c700 comp rx=0 tx=0).stop 2024-09-11T23:20:41.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- 172.21.15.94:0/2445370018 shutdown_connections 2024-09-11T23:20:41.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/2445370018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa00af2a0 0x7f2fa015fc60 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/2445370018 >> v2:172.21.15.155:3300/0 conn(0x7f2fa015c2a0 0x7f2fa00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/2445370018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa015bec0 0x7f2fa00ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- 172.21.15.94:0/2445370018 >> 172.21.15.94:0/2445370018 conn(0x7f2fa00b1f90 msgr2=0x7f2fa00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:41.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- 172.21.15.94:0/2445370018 shutdown_connections 2024-09-11T23:20:41.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.548+0000 7f2fa53c2640 1 -- 172.21.15.94:0/2445370018 wait complete. 2024-09-11T23:20:41.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 Processor -- start 2024-09-11T23:20:41.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 -- start start 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa00af2a0 0x7f2fa0153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa015bec0 0x7f2fa0073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa015c2a0 0x7f2fa0152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa00ad740 con 0x7f2fa015c2a0 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa00afc90 con 0x7f2fa015bec0 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa006e000 con 0x7f2fa00af2a0 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa015c2a0 0x7f2fa0152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa015c2a0 0x7f2fa0152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53652/0 (socket says 172.21.15.94:53652) 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/6194145 learned_addr learned my addr 172.21.15.94:0/6194145 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:41.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9effd640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa00af2a0 0x7f2fa0153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9e7fc640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa015bec0 0x7f2fa0073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa00af2a0 msgr2=0x7f2fa0153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa00af2a0 0x7f2fa0153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa015bec0 msgr2=0x7f2fa0073400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa015bec0 0x7f2fa0073400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 -- 172.21.15.94:0/6194145 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa015f910 con 0x7f2fa015c2a0 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f9f7fe640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa015c2a0 0x7f2fa0152b70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2f9801adb0 tx=0x7f2f980194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f977fe640 1 -- 172.21.15.94:0/6194145 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f980bc020 con 0x7f2fa015c2a0 2024-09-11T23:20:41.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f977fe640 1 -- 172.21.15.94:0/6194145 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f980b8690 con 0x7f2fa015c2a0 2024-09-11T23:20:41.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa015fbf0 con 0x7f2fa015c2a0 2024-09-11T23:20:41.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2f977fe640 1 -- 172.21.15.94:0/6194145 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98009510 con 0x7f2fa015c2a0 2024-09-11T23:20:41.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa0072c00 con 0x7f2fa015c2a0 2024-09-11T23:20:41.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.552+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa00ad200 con 0x7f2fa015c2a0 2024-09-11T23:20:41.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.556+0000 7f2f977fe640 1 -- 172.21.15.94:0/6194145 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f980bf020 con 0x7f2fa015c2a0 2024-09-11T23:20:41.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.556+0000 7f2f977fe640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f800678c0 0x7f2f80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.556+0000 7f2f977fe640 1 -- 172.21.15.94:0/6194145 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f2f98120d80 con 0x7f2fa015c2a0 2024-09-11T23:20:41.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.556+0000 7f2f9effd640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f800678c0 0x7f2f80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.556+0000 7f2f9effd640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f800678c0 0x7f2f80069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0157430 tx=0x7f2f88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:41.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.560+0000 7f2f977fe640 1 -- 172.21.15.94:0/6194145 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f980c6030 con 0x7f2fa015c2a0 2024-09-11T23:20:41.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.720+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2fa006fcd0 con 0x7f2fa015c2a0 2024-09-11T23:20:41.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.724+0000 7f2f977fe640 1 -- 172.21.15.94:0/6194145 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f2f980165e0 con 0x7f2fa015c2a0 2024-09-11T23:20:41.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f800678c0 msgr2=0x7f2f80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f800678c0 0x7f2f80069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0157430 tx=0x7f2f88008040 comp rx=0 tx=0).stop 2024-09-11T23:20:41.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa015c2a0 msgr2=0x7f2fa0152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa015c2a0 0x7f2fa0152b70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2f9801adb0 tx=0x7f2f980194a0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 shutdown_connections 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2f800678c0 0x7f2f80069d80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fa015c2a0 0x7f2fa0152b70 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa015bec0 0x7f2fa0073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 --2- 172.21.15.94:0/6194145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa00af2a0 0x7f2fa0153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 >> 172.21.15.94:0/6194145 conn(0x7f2fa00b1f90 msgr2=0x7f2fa0154670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 shutdown_connections 2024-09-11T23:20:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.728+0000 7f2fa53c2640 1 -- 172.21.15.94:0/6194145 wait complete. 2024-09-11T23:20:41.747 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration' 2024-09-11T23:20:41.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4844165640 1 Processor -- start 2024-09-11T23:20:41.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4844165640 1 -- start start 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4844165640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f483c06f010 0x7f483c166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4844165640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c0b3290 con 0x7f483c15bec0 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4844165640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c0b3570 con 0x7f483c15c2a0 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4844165640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f483c0b3850 con 0x7f483c06f010 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4842702640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f483c06f010 0x7f483c166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4841f01640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f483c15bec0 0x7f483c0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41898/0 (socket says 172.21.15.94:41898) 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4841f01640 1 -- 172.21.15.94:0/2574241321 learned_addr learned my addr 172.21.15.94:0/2574241321 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4842702640 1 -- 172.21.15.94:0/2574241321 >> v1:172.21.15.155:6789/0 conn(0x7f483c15c2a0 legacy=0x7f483c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4842702640 1 -- 172.21.15.94:0/2574241321 >> v1:172.21.15.94:6789/0 conn(0x7f483c15bec0 legacy=0x7f483c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4840eff640 1 -- 172.21.15.94:0/2574241321 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455578687 0 0) 0x7f483c0b3290 con 0x7f483c15bec0 2024-09-11T23:20:41.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.860+0000 7f4842702640 1 -- 172.21.15.94:0/2574241321 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c0b3b30 con 0x7f483c06f010 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4842702640 1 --2- 172.21.15.94:0/2574241321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c06f010 0x7f483c166ff0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4834009d90 tx=0x7f483401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfafa4a76a0ab471 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4840eff640 1 -- 172.21.15.94:0/2574241321 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48340b2070 con 0x7f483c06f010 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4840eff640 1 -- 172.21.15.94:0/2574241321 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48340a58d0 con 0x7f483c06f010 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4840eff640 1 -- 172.21.15.94:0/2574241321 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48340a5ca0 con 0x7f483c06f010 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- 172.21.15.94:0/2574241321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c06f010 msgr2=0x7f483c166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 --2- 172.21.15.94:0/2574241321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c06f010 0x7f483c166ff0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4834009d90 tx=0x7f483401c900 comp rx=0 tx=0).stop 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- 172.21.15.94:0/2574241321 shutdown_connections 2024-09-11T23:20:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 --2- 172.21.15.94:0/2574241321 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c06f010 0x7f483c166ff0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- 172.21.15.94:0/2574241321 >> 172.21.15.94:0/2574241321 conn(0x7f483c0b1f90 msgr2=0x7f483c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- 172.21.15.94:0/2574241321 shutdown_connections 2024-09-11T23:20:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- 172.21.15.94:0/2574241321 wait complete. 2024-09-11T23:20:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 Processor -- start 2024-09-11T23:20:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- start start 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f483c06f010 0x7f483c14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c15bec0 0x7f483c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c15c2a0 0x7f483c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f483c169ed0 con 0x7f483c15bec0 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f483c169d50 con 0x7f483c15c2a0 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4844165640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f483c16a050 con 0x7f483c06f010 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c15bec0 0x7f483c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c15bec0 0x7f483c155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53674/0 (socket says 172.21.15.94:53674) 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 -- 172.21.15.94:0/538507962 learned_addr learned my addr 172.21.15.94:0/538507962 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 -- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f483c06f010 msgr2=0x7f483c14cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841f01640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f483c06f010 0x7f483c14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4842702640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c15c2a0 0x7f483c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f483c06f010 0x7f483c14cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 -- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c15c2a0 msgr2=0x7f483c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c15c2a0 0x7f483c156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 -- 172.21.15.94:0/538507962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c15c780 con 0x7f483c15bec0 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841f01640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f483c06f010 0x7f483c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.864+0000 7f4841700640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c15bec0 0x7f483c155f40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f482c00b3e0 tx=0x7f482c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f48327fc640 1 -- 172.21.15.94:0/538507962 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c015020 con 0x7f483c15bec0 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f48327fc640 1 -- 172.21.15.94:0/538507962 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482c011830 con 0x7f483c15bec0 2024-09-11T23:20:41.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483c15ca60 con 0x7f483c15bec0 2024-09-11T23:20:41.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f48327fc640 1 -- 172.21.15.94:0/538507962 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c011c60 con 0x7f483c15bec0 2024-09-11T23:20:41.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483c15d020 con 0x7f483c15bec0 2024-09-11T23:20:41.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483c0ad200 con 0x7f483c15bec0 2024-09-11T23:20:41.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f48327fc640 1 -- 172.21.15.94:0/538507962 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f482c018020 con 0x7f483c15bec0 2024-09-11T23:20:41.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f48327fc640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48200678c0 0x7f4820069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:41.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f48327fc640 1 -- 172.21.15.94:0/538507962 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f482c085730 con 0x7f483c15bec0 2024-09-11T23:20:41.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f4841f01640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48200678c0 0x7f4820069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:41.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.868+0000 7f4841f01640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48200678c0 0x7f4820069d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4838000f70 tx=0x7f4838009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:41.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:41.872+0000 7f48327fc640 1 -- 172.21.15.94:0/538507962 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f482c01f030 con 0x7f483c15bec0 2024-09-11T23:20:42.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.088+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]} v 0) -- 0x7f483c0d0bf0 con 0x7f483c15bec0 2024-09-11T23:20:42.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.388+0000 7f48327fc640 1 -- 172.21.15.94:0/538507962 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]}]=0 v304) ==== 142+0+0 (secure 0 0 0) 0x7f482c0172c0 con 0x7f483c15bec0 2024-09-11T23:20:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48200678c0 msgr2=0x7f4820069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48200678c0 0x7f4820069d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4838000f70 tx=0x7f4838009040 comp rx=0 tx=0).stop 2024-09-11T23:20:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c15bec0 msgr2=0x7f483c155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c15bec0 0x7f483c155f40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f482c00b3e0 tx=0x7f482c00b8a0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 shutdown_connections 2024-09-11T23:20:42.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c15c2a0 0x7f483c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f48200678c0 0x7f4820069d80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f483c15bec0 0x7f483c155f40 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 --2- 172.21.15.94:0/538507962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f483c06f010 0x7f483c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 >> 172.21.15.94:0/538507962 conn(0x7f483c0b1f90 msgr2=0x7f483c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:42.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 shutdown_connections 2024-09-11T23:20:42.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:42.392+0000 7f4844165640 1 -- 172.21.15.94:0/538507962 wait complete. 2024-09-11T23:20:42.416 INFO:tasks.cephfs_test_runner:That removal of primary dentry of hardlinked inode results ... ERROR 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner: 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner:ERROR: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner:That removal of primary dentry of hardlinked inode results 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_strays.py", line 398, in test_hardlink_reintegration 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner: pre_unlink_bt = self.fs.read_backtrace(ino) 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-11T23:20:42.417 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner: 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T23:20:42.418 INFO:tasks.cephfs_test_runner:Ran 7 tests in 287.322s 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner:ERROR: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner:That removal of primary dentry of hardlinked inode results 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_strays.py", line 398, in test_hardlink_reintegration 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: pre_unlink_bt = self.fs.read_backtrace(ino) 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-11T23:20:42.419 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-11T23:20:42.420 INFO:tasks.cephfs_test_runner: 2024-09-11T23:20:42.420 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:20:42.594 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=348c670a77fe444381ba2c9c637291dd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-11T23:20:42.595 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-11T23:20:42.604 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T23:20:42.617 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T23:20:42.617 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:42.618 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:42.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:42.643 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-11T23:20:42.643 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:42.689 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:42.689 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:42.689 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:42.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:42.695 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-11T23:20:42.696 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:42.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17834 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:42.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:42.743 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-11T23:20:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:20:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:20:42.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:42.791 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:20:42.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:42.848 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:20:42.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:42.930 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-11T23:20:43.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:43.135 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-09-11T23:20:43.142 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:20:43.142 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:20:43.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:43.142 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:20:43.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:43.197 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:20:43.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:20:43.273 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-09-11T23:20:43.437 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T23:20:43.446 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:20:43.447 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:20:43.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.572+0000 7f6e20456640 1 Processor -- start 2024-09-11T23:20:43.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.572+0000 7f6e20456640 1 -- start start 2024-09-11T23:20:43.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.572+0000 7f6e20456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180ce9d0 0x7f6e180cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.572+0000 7f6e20456640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e180cf920 0x7f6e180d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.572+0000 7f6e20456640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e1806d9c0 con 0x7f6e1815e5f0 2024-09-11T23:20:43.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.572+0000 7f6e20456640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6e1806d7a0 con 0x7f6e180cf920 2024-09-11T23:20:43.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.572+0000 7f6e20456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1806dca0 con 0x7f6e180ce9d0 2024-09-11T23:20:43.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d9f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180ce9d0 0x7f6e180cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1e9f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e180cf920 0x7f6e180d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1e9f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e180cf920 0x7f6e180d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.94:36356/0 (socket says 172.21.15.94:36356) 2024-09-11T23:20:43.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1e9f3640 1 -- 172.21.15.94:0/3854126410 learned_addr learned my addr 172.21.15.94:0/3854126410 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:43.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d9f1640 1 -- 172.21.15.94:0/3854126410 >> v2:172.21.15.155:3300/0 conn(0x7f6e180cf920 msgr2=0x7f6e180d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:43.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d9f1640 1 --2- 172.21.15.94:0/3854126410 >> v2:172.21.15.155:3300/0 conn(0x7f6e180cf920 0x7f6e180d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d9f1640 1 -- 172.21.15.94:0/3854126410 >> v1:172.21.15.155:6789/0 conn(0x7f6e1815e5f0 legacy=0x7f6e1806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d9f1640 1 -- 172.21.15.94:0/3854126410 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1806df80 con 0x7f6e180ce9d0 2024-09-11T23:20:43.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d9f1640 1 --2- 172.21.15.94:0/3854126410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180ce9d0 0x7f6e180cf3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e080097c0 tx=0x7f6e0801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1369a6d4acead67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d1f0640 1 -- 172.21.15.94:0/3854126410 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080b1070 con 0x7f6e180ce9d0 2024-09-11T23:20:43.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d1f0640 1 -- 172.21.15.94:0/3854126410 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e080ac410 con 0x7f6e180ce9d0 2024-09-11T23:20:43.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.576+0000 7f6e1d1f0640 1 -- 172.21.15.94:0/3854126410 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080ac7e0 con 0x7f6e180ce9d0 2024-09-11T23:20:43.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3854126410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180ce9d0 msgr2=0x7f6e180cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 --2- 172.21.15.94:0/3854126410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180ce9d0 0x7f6e180cf3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e080097c0 tx=0x7f6e0801c4a0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3854126410 shutdown_connections 2024-09-11T23:20:43.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 --2- 172.21.15.94:0/3854126410 >> v2:172.21.15.155:3300/0 conn(0x7f6e180cf920 0x7f6e180d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 --2- 172.21.15.94:0/3854126410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180ce9d0 0x7f6e180cf3e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3854126410 >> 172.21.15.94:0/3854126410 conn(0x7f6e18074030 msgr2=0x7f6e1809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:43.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3854126410 shutdown_connections 2024-09-11T23:20:43.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3854126410 wait complete. 2024-09-11T23:20:43.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 Processor -- start 2024-09-11T23:20:43.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- start start 2024-09-11T23:20:43.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180cf920 0x7f6e180cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e180cdd70 0x7f6e18151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e181604a0 0x7f6e18153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6e180d3c40 con 0x7f6e181604a0 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e180d3ac0 con 0x7f6e180cdd70 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6e180cfd30 con 0x7f6e180cf920 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e181604a0 0x7f6e18153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e181604a0 0x7f6e18153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53682/0 (socket says 172.21.15.94:53682) 2024-09-11T23:20:43.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 -- 172.21.15.94:0/3310605385 learned_addr learned my addr 172.21.15.94:0/3310605385 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:43.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1d9f1640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e180cdd70 0x7f6e18151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e1f2640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180cf920 0x7f6e180cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 -- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180cf920 msgr2=0x7f6e180cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180cf920 0x7f6e180cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 -- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e180cdd70 msgr2=0x7f6e18151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e180cdd70 0x7f6e18151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 -- 172.21.15.94:0/3310605385 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e180cd6a0 con 0x7f6e181604a0 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e1f2640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180cf920 0x7f6e180cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e1e9f3640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e181604a0 0x7f6e18153390 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009ce0 tx=0x7f6e1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e0effd640 1 -- 172.21.15.94:0/3310605385 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000cd20 con 0x7f6e181604a0 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e0effd640 1 -- 172.21.15.94:0/3310605385 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e100039a0 con 0x7f6e181604a0 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1815f9c0 con 0x7f6e181604a0 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e0effd640 1 -- 172.21.15.94:0/3310605385 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10003d70 con 0x7f6e181604a0 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e180ce1d0 con 0x7f6e181604a0 2024-09-11T23:20:43.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.580+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e181581f0 con 0x7f6e181604a0 2024-09-11T23:20:43.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.584+0000 7f6e0effd640 1 -- 172.21.15.94:0/3310605385 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e10012050 con 0x7f6e181604a0 2024-09-11T23:20:43.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.584+0000 7f6e0effd640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6dfc0678c0 0x7f6dfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.584+0000 7f6e0effd640 1 -- 172.21.15.94:0/3310605385 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f6e10086d20 con 0x7f6e181604a0 2024-09-11T23:20:43.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.584+0000 7f6e1e1f2640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6dfc0678c0 0x7f6dfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.584+0000 7f6e1e1f2640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6dfc0678c0 0x7f6dfc069d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6e14001710 tx=0x7f6e14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.588+0000 7f6e0effd640 1 -- 172.21.15.94:0/3310605385 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6e10010040 con 0x7f6e181604a0 2024-09-11T23:20:43.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.736+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e18161390 con 0x7f6dfc0678c0 2024-09-11T23:20:43.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.736+0000 7f6e0effd640 1 -- 172.21.15.94:0/3310605385 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7f6e18161390 con 0x7f6dfc0678c0 2024-09-11T23:20:43.739 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:43.739 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:20:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6dfc0678c0 msgr2=0x7f6dfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6dfc0678c0 0x7f6dfc069d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6e14001710 tx=0x7f6e14009040 comp rx=0 tx=0).stop 2024-09-11T23:20:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e181604a0 msgr2=0x7f6e18153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e181604a0 0x7f6e18153390 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009ce0 tx=0x7f6e1000c490 comp rx=0 tx=0).stop 2024-09-11T23:20:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 shutdown_connections 2024-09-11T23:20:43.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f6dfc0678c0 0x7f6dfc069d80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6e181604a0 0x7f6e18153390 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e180cdd70 0x7f6e18151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 --2- 172.21.15.94:0/3310605385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e180cf920 0x7f6e180cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 >> 172.21.15.94:0/3310605385 conn(0x7f6e180ce9d0 msgr2=0x7f6e180b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 shutdown_connections 2024-09-11T23:20:43.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.740+0000 7f6e20456640 1 -- 172.21.15.94:0/3310605385 wait complete. 2024-09-11T23:20:43.757 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-11T23:20:42.080186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":295316,"kb_used_data":20840,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754679404,"statfs":{"total":773094113280,"available":772791709696,"internally_reserved":0,"allocated":21340160,"data_stored":15035494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002108"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":351,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T23:20:41.213408+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:20:41.213408+0000","last_peered":"2024-09-11T23:20:41.213408+0000","last_clean":"2024-09-11T23:20:41.213408+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:20:41.213408+0000","last_undegraded":"2024-09-11T23:20:41.213408+0000","last_fullsized":"2024-09-11T23:20:41.213408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2056192,"data_stored":1269569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":693872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":5656576,"data_stored":4873505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36712,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":5656576,"data_stored":4873505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2056192,"data_stored":1269569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:20:43.758 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:20:43.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.880+0000 7f1e7fef9640 1 Processor -- start 2024-09-11T23:20:43.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.880+0000 7f1e7fef9640 1 -- start start 2024-09-11T23:20:43.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7fef9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1e781520a0 0x7f1e7806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7fef9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1e7806fe50 0x7f1e7815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7fef9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7815f1d0 0x7f1e78071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7fef9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1e78152480 con 0x7f1e7806fe50 2024-09-11T23:20:43.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7fef9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1e78070250 con 0x7f1e781520a0 2024-09-11T23:20:43.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7fef9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1e780aede0 con 0x7f1e7815f1d0 2024-09-11T23:20:43.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1e7806fe50 0x7f1e7815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1e7806fe50 0x7f1e7815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53696/0 (socket says 172.21.15.94:53696) 2024-09-11T23:20:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 -- 172.21.15.94:0/3437557607 learned_addr learned my addr 172.21.15.94:0/3437557607 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7e496640 1 --2- 172.21.15.94:0/3437557607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7815f1d0 0x7f1e78071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7dc95640 1 --2- 172.21.15.94:0/3437557607 >> v2:172.21.15.155:3300/0 conn(0x7f1e781520a0 0x7f1e7806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 -- 172.21.15.94:0/3437557607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7815f1d0 msgr2=0x7f1e78071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 --2- 172.21.15.94:0/3437557607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7815f1d0 0x7f1e78071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 -- 172.21.15.94:0/3437557607 >> v2:172.21.15.155:3300/0 conn(0x7f1e781520a0 msgr2=0x7f1e7806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:43.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 --2- 172.21.15.94:0/3437557607 >> v2:172.21.15.155:3300/0 conn(0x7f1e781520a0 0x7f1e7806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 -- 172.21.15.94:0/3437557607 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7815fa10 con 0x7f1e7806fe50 2024-09-11T23:20:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7d494640 1 --2- 172.21.15.94:0/3437557607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e7806fe50 0x7f1e7815ec90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1e78071710 tx=0x7f1e6801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01fa0b55864baf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7cc93640 1 -- 172.21.15.94:0/3437557607 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e680b0070 con 0x7f1e7806fe50 2024-09-11T23:20:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7cc93640 1 -- 172.21.15.94:0/3437557607 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e680ab600 con 0x7f1e7806fe50 2024-09-11T23:20:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.884+0000 7f1e7cc93640 1 -- 172.21.15.94:0/3437557607 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e680ab9d0 con 0x7f1e7806fe50 2024-09-11T23:20:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- 172.21.15.94:0/3437557607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e7806fe50 msgr2=0x7f1e7815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/3437557607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e7806fe50 0x7f1e7815ec90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1e78071710 tx=0x7f1e6801c240 comp rx=0 tx=0).stop 2024-09-11T23:20:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- 172.21.15.94:0/3437557607 shutdown_connections 2024-09-11T23:20:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/3437557607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7815f1d0 0x7f1e78071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/3437557607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e7806fe50 0x7f1e7815ec90 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/3437557607 >> v2:172.21.15.155:3300/0 conn(0x7f1e781520a0 0x7f1e7806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- 172.21.15.94:0/3437557607 >> 172.21.15.94:0/3437557607 conn(0x7f1e780b1f90 msgr2=0x7f1e780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- 172.21.15.94:0/3437557607 shutdown_connections 2024-09-11T23:20:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- 172.21.15.94:0/3437557607 wait complete. 2024-09-11T23:20:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 Processor -- start 2024-09-11T23:20:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- start start 2024-09-11T23:20:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7806fe50 0x7f1e780cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e781520a0 0x7f1e7814a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7815f1d0 0x7f1e7815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78073d30 con 0x7f1e781520a0 2024-09-11T23:20:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78073a50 con 0x7f1e7815f1d0 2024-09-11T23:20:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1e7815f5e0 con 0x7f1e7806fe50 2024-09-11T23:20:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e781520a0 0x7f1e7814a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e781520a0 0x7f1e7814a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53706/0 (socket says 172.21.15.94:53706) 2024-09-11T23:20:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 -- 172.21.15.94:0/4154106211 learned_addr learned my addr 172.21.15.94:0/4154106211 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7e496640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7815f1d0 0x7f1e7815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7dc95640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7806fe50 0x7f1e780cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 -- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7806fe50 msgr2=0x7f1e780cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7806fe50 0x7f1e780cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 -- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7815f1d0 msgr2=0x7f1e7815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7815f1d0 0x7f1e7815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 -- 172.21.15.94:0/4154106211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7814ae10 con 0x7f1e781520a0 2024-09-11T23:20:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7d494640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e781520a0 0x7f1e7814a370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1e6801a8f0 tx=0x7f1e68018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e6e7fc640 1 -- 172.21.15.94:0/4154106211 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e680b0040 con 0x7f1e781520a0 2024-09-11T23:20:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e6e7fc640 1 -- 172.21.15.94:0/4154106211 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e680b4620 con 0x7f1e781520a0 2024-09-11T23:20:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7815b960 con 0x7f1e781520a0 2024-09-11T23:20:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e6e7fc640 1 -- 172.21.15.94:0/4154106211 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e680b4a10 con 0x7f1e781520a0 2024-09-11T23:20:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.888+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e780cd520 con 0x7f1e781520a0 2024-09-11T23:20:43.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.892+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e7815ec90 con 0x7f1e781520a0 2024-09-11T23:20:43.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.892+0000 7f1e6e7fc640 1 -- 172.21.15.94:0/4154106211 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e680ab4c0 con 0x7f1e781520a0 2024-09-11T23:20:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.892+0000 7f1e6e7fc640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1e5c0678c0 0x7f1e5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.892+0000 7f1e6e7fc640 1 -- 172.21.15.94:0/4154106211 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f1e6811f760 con 0x7f1e781520a0 2024-09-11T23:20:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.892+0000 7f1e7dc95640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1e5c0678c0 0x7f1e5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.892+0000 7f1e7dc95640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1e5c0678c0 0x7f1e5c069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1e78165ed0 tx=0x7f1e74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:43.896+0000 7f1e6e7fc640 1 -- 172.21.15.94:0/4154106211 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e680160f0 con 0x7f1e781520a0 2024-09-11T23:20:44.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.052+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e7806e540 con 0x7f1e5c0678c0 2024-09-11T23:20:44.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.056+0000 7f1e6e7fc640 1 -- 172.21.15.94:0/4154106211 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7f1e7806e540 con 0x7f1e5c0678c0 2024-09-11T23:20:44.058 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:44.058 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:20:44.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.056+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1e5c0678c0 msgr2=0x7f1e5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.056+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1e5c0678c0 0x7f1e5c069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1e78165ed0 tx=0x7f1e74008040 comp rx=0 tx=0).stop 2024-09-11T23:20:44.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.056+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e781520a0 msgr2=0x7f1e7814a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e781520a0 0x7f1e7814a370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1e6801a8f0 tx=0x7f1e68018fe0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 shutdown_connections 2024-09-11T23:20:44.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7815f1d0 0x7f1e7815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f1e5c0678c0 0x7f1e5c069d80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e781520a0 0x7f1e7814a370 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 --2- 172.21.15.94:0/4154106211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e7806fe50 0x7f1e780cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 >> 172.21.15.94:0/4154106211 conn(0x7f1e780b1f90 msgr2=0x7f1e780b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:44.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 shutdown_connections 2024-09-11T23:20:44.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.060+0000 7f1e7fef9640 1 -- 172.21.15.94:0/4154106211 wait complete. 2024-09-11T23:20:44.077 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-11T23:20:42.080186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":295316,"kb_used_data":20840,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754679404,"statfs":{"total":773094113280,"available":772791709696,"internally_reserved":0,"allocated":21340160,"data_stored":15035494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002108"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":351,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T23:20:41.213408+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:20:41.213408+0000","last_peered":"2024-09-11T23:20:41.213408+0000","last_clean":"2024-09-11T23:20:41.213408+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:20:41.213408+0000","last_undegraded":"2024-09-11T23:20:41.213408+0000","last_fullsized":"2024-09-11T23:20:41.213408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2056192,"data_stored":1269569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":693872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":5656576,"data_stored":4873505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36712,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":5656576,"data_stored":4873505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2056192,"data_stored":1269569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:20:44.078 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:20:44.078 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:20:44.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f296090c640 1 Processor -- start 2024-09-11T23:20:44.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f296090c640 1 -- start start 2024-09-11T23:20:44.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f296090c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 0x7f295c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f296090c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0aede0 con 0x7f295c1520a0 2024-09-11T23:20:44.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f296090c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c15fa10 con 0x7f295c15f1d0 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f296090c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f295c152480 con 0x7f295c070020 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f295c1520a0 0x7f295c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41900/0 (socket says 172.21.15.94:41900) 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 -- 172.21.15.94:0/1398452203 learned_addr learned my addr 172.21.15.94:0/1398452203 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f2959d9b640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 0x7f295c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307720376 0 0) 0x7f295c0aede0 con 0x7f295c1520a0 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2944003530 con 0x7f295c1520a0 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2173307321 0 0) 0x7f2944003530 con 0x7f295c1520a0 2024-09-11T23:20:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 msgr2=0x7f295c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 0x7f295c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 >> v1:172.21.15.155:6789/0 conn(0x7f295c15f1d0 legacy=0x7f295c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c074250 con 0x7f295c1520a0 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f294c001680 con 0x7f295c1520a0 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 >> v1:172.21.15.94:6789/0 conn(0x7f295c1520a0 legacy=0x7f295c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f2944003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 0x7f2944004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2944004d50 0x7f29440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f294400ba80 con 0x7f29440039f0 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f294400bc00 con 0x7f2944004d50 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f294400be00 con 0x7f295c070020 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f2944003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295ad9d640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2944004d50 0x7f29440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f2959d9b640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 0x7f2944004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 -- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 msgr2=0x7f2944004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c070020 0x7f2944004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 -- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2944004d50 msgr2=0x7f29440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2944004d50 0x7f29440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.196+0000 7f295a59c640 1 -- 172.21.15.94:0/1398452203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2944003530 con 0x7f29440039f0 2024-09-11T23:20:44.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295a59c640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f2944003e10 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c210 tx=0x7f294c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae47dcc226bfd609 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c007d20 con 0x7f29440039f0 2024-09-11T23:20:44.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c0a9070 con 0x7f29440039f0 2024-09-11T23:20:44.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295959a640 1 -- 172.21.15.94:0/1398452203 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c0aeba0 con 0x7f29440039f0 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- 172.21.15.94:0/1398452203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 msgr2=0x7f2944003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 --2- 172.21.15.94:0/1398452203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f2944003e10 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c210 tx=0x7f294c01cc30 comp rx=0 tx=0).stop 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295ad9d640 1 -- 172.21.15.94:0/1398452203 reap_dead start 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- 172.21.15.94:0/1398452203 shutdown_connections 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- 172.21.15.94:0/1398452203 >> 172.21.15.94:0/1398452203 conn(0x7f295c0b1f90 msgr2=0x7f295c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- 172.21.15.94:0/1398452203 shutdown_connections 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- 172.21.15.94:0/1398452203 wait complete. 2024-09-11T23:20:44.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 Processor -- start 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- start start 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f295c1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c0cf580 0x7f295c0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f295c0cfa00 0x7f295c0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f295c15f5e0 con 0x7f29440039f0 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f295c073d30 con 0x7f295c0cfa00 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f296090c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f295c15f760 con 0x7f295c0cf580 2024-09-11T23:20:44.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f295c1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f295c1f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53726/0 (socket says 172.21.15.94:53726) 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295a59c640 1 -- 172.21.15.94:0/237319425 learned_addr learned my addr 172.21.15.94:0/237319425 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f2959d9b640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c0cf580 0x7f295c0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.200+0000 7f295ad9d640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f295c0cfa00 0x7f295c0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f295a59c640 1 -- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c0cf580 msgr2=0x7f295c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f295a59c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c0cf580 0x7f295c0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f295a59c640 1 -- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f295c0cfa00 msgr2=0x7f295c0cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f295a59c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f295c0cfa00 0x7f295c0cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f295a59c640 1 -- 172.21.15.94:0/237319425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c15c180 con 0x7f29440039f0 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f295a59c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f295c1f4370 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f294c001980 tx=0x7f2944005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f294affd640 1 -- 172.21.15.94:0/237319425 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c005d40 con 0x7f29440039f0 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f294affd640 1 -- 172.21.15.94:0/237319425 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c0a5820 con 0x7f29440039f0 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c15c460 con 0x7f29440039f0 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f294affd640 1 -- 172.21.15.94:0/237319425 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c0a5bd0 con 0x7f29440039f0 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c15ca20 con 0x7f29440039f0 2024-09-11T23:20:44.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295c06e0b0 con 0x7f29440039f0 2024-09-11T23:20:44.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f294affd640 1 -- 172.21.15.94:0/237319425 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f294c0047f0 con 0x7f29440039f0 2024-09-11T23:20:44.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f294affd640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f293c0678c0 0x7f293c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f294affd640 1 -- 172.21.15.94:0/237319425 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f294c11f110 con 0x7f29440039f0 2024-09-11T23:20:44.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f2959d9b640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f293c0678c0 0x7f293c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.204+0000 7f2959d9b640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f293c0678c0 0x7f293c069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f295c151890 tx=0x7f2950008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.208+0000 7f294affd640 1 -- 172.21.15.94:0/237319425 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f294c016970 con 0x7f29440039f0 2024-09-11T23:20:44.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.356+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f295c06f910 con 0x7f293c0678c0 2024-09-11T23:20:44.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.356+0000 7f294affd640 1 -- 172.21.15.94:0/237319425 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13517 (secure 0 0 0) 0x7f295c06f910 con 0x7f293c0678c0 2024-09-11T23:20:44.359 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:44.359 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:20:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f293c0678c0 msgr2=0x7f293c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f293c0678c0 0x7f293c069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f295c151890 tx=0x7f2950008040 comp rx=0 tx=0).stop 2024-09-11T23:20:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 msgr2=0x7f295c1f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f295c1f4370 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f294c001980 tx=0x7f2944005840 comp rx=0 tx=0).stop 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 shutdown_connections 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f295c0cfa00 0x7f295c0cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f295c0cf580 0x7f295c0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f293c0678c0 0x7f293c069d80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 --2- 172.21.15.94:0/237319425 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29440039f0 0x7f295c1f4370 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 >> 172.21.15.94:0/237319425 conn(0x7f295c0b1f90 msgr2=0x7f295c151970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 shutdown_connections 2024-09-11T23:20:44.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.360+0000 7f296090c640 1 -- 172.21.15.94:0/237319425 wait complete. 2024-09-11T23:20:44.375 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-11T23:20:44.080725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":295316,"kb_used_data":20840,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754679404,"statfs":{"total":773094113280,"available":772791709696,"internally_reserved":0,"allocated":21340160,"data_stored":15035494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8410438,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-83,"num_write_kb":-8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002041"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":351,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T23:20:41.213408+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:20:41.213408+0000","last_peered":"2024-09-11T23:20:41.213408+0000","last_clean":"2024-09-11T23:20:41.213408+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:20:41.213408+0000","last_undegraded":"2024-09-11T23:20:41.213408+0000","last_fullsized":"2024-09-11T23:20:41.213408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2056192,"data_stored":1269569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":693872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":5656576,"data_stored":4873505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36712,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":5656576,"data_stored":4873505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2056192,"data_stored":1269569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:20:44.377 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.480+0000 7fe9afabd640 1 Processor -- start 2024-09-11T23:20:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.480+0000 7fe9afabd640 1 -- start start 2024-09-11T23:20:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9afabd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a81520a0 0x7fe9a806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9afabd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9a806fe50 0x7fe9a815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9afabd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a8070250 con 0x7fe9a815f1d0 2024-09-11T23:20:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9afabd640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a8152480 con 0x7fe9a806fe50 2024-09-11T23:20:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9afabd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a80aede0 con 0x7fe9a81520a0 2024-09-11T23:20:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad058640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9a806fe50 0x7fe9a815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ae05a640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe9a815f1d0 0x7fe9a8071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41910/0 (socket says 172.21.15.94:41910) 2024-09-11T23:20:44.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ae05a640 1 -- 172.21.15.94:0/2779051720 learned_addr learned my addr 172.21.15.94:0/2779051720 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:44.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad859640 1 --2- 172.21.15.94:0/2779051720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a81520a0 0x7fe9a806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad058640 1 -- 172.21.15.94:0/2779051720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a81520a0 msgr2=0x7fe9a806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad058640 1 --2- 172.21.15.94:0/2779051720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a81520a0 0x7fe9a806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad058640 1 -- 172.21.15.94:0/2779051720 >> v1:172.21.15.94:6789/0 conn(0x7fe9a815f1d0 legacy=0x7fe9a8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad058640 1 -- 172.21.15.94:0/2779051720 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a815fa10 con 0x7fe9a806fe50 2024-09-11T23:20:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ac857640 1 -- 172.21.15.94:0/2779051720 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465638330 0 0) 0x7fe9a8070250 con 0x7fe9a815f1d0 2024-09-11T23:20:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad859640 1 --2- 172.21.15.94:0/2779051720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a81520a0 0x7fe9a806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ad058640 1 --2- 172.21.15.94:0/2779051720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a806fe50 0x7fe9a815ec90 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fe9980097c0 tx=0x7fe99801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1d8486a55ce7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ac857640 1 -- 172.21.15.94:0/2779051720 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9980b1070 con 0x7fe9a806fe50 2024-09-11T23:20:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ac857640 1 -- 172.21.15.94:0/2779051720 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9980ac600 con 0x7fe9a806fe50 2024-09-11T23:20:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.484+0000 7fe9ac857640 1 -- 172.21.15.94:0/2779051720 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9980ac9d0 con 0x7fe9a806fe50 2024-09-11T23:20:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2779051720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a806fe50 msgr2=0x7fe9a815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2779051720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a806fe50 0x7fe9a815ec90 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fe9980097c0 tx=0x7fe99801c480 comp rx=0 tx=0).stop 2024-09-11T23:20:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2779051720 shutdown_connections 2024-09-11T23:20:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2779051720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a806fe50 0x7fe9a815ec90 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2779051720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a81520a0 0x7fe9a806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2779051720 >> 172.21.15.94:0/2779051720 conn(0x7fe9a80b1f90 msgr2=0x7fe9a80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2779051720 shutdown_connections 2024-09-11T23:20:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2779051720 wait complete. 2024-09-11T23:20:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 Processor -- start 2024-09-11T23:20:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- start start 2024-09-11T23:20:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a806fe50 0x7fe9a814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9a81520a0 0x7fe9a8099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a815f1d0 0x7fe9a8148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8073d30 con 0x7fe9a815f1d0 2024-09-11T23:20:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8073a50 con 0x7fe9a81520a0 2024-09-11T23:20:44.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a815f640 con 0x7fe9a806fe50 2024-09-11T23:20:44.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a815f1d0 0x7fe9a8148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a815f1d0 0x7fe9a8148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53746/0 (socket says 172.21.15.94:53746) 2024-09-11T23:20:44.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 -- 172.21.15.94:0/2143240255 learned_addr learned my addr 172.21.15.94:0/2143240255 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:44.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ad859640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a806fe50 0x7fe9a814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ad058640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9a81520a0 0x7fe9a8099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 -- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a806fe50 msgr2=0x7fe9a814ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a806fe50 0x7fe9a814ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 -- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9a81520a0 msgr2=0x7fe9a8099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9a81520a0 0x7fe9a8099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 -- 172.21.15.94:0/2143240255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a814c1c0 con 0x7fe9a815f1d0 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ad859640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a806fe50 0x7fe9a814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ad058640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9a81520a0 0x7fe9a8099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9ae05a640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a815f1d0 0x7fe9a8148660 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000eb00 tx=0x7fe9a00021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe99e7fc640 1 -- 172.21.15.94:0/2143240255 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0004d80 con 0x7fe9a815f1d0 2024-09-11T23:20:44.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe99e7fc640 1 -- 172.21.15.94:0/2143240255 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a0016020 con 0x7fe9a815f1d0 2024-09-11T23:20:44.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a814c4a0 con 0x7fe9a815f1d0 2024-09-11T23:20:44.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe99e7fc640 1 -- 172.21.15.94:0/2143240255 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000cc70 con 0x7fe9a815f1d0 2024-09-11T23:20:44.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a814ca60 con 0x7fe9a815f1d0 2024-09-11T23:20:44.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.488+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a815ec90 con 0x7fe9a815f1d0 2024-09-11T23:20:44.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.492+0000 7fe99e7fc640 1 -- 172.21.15.94:0/2143240255 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9a00070d0 con 0x7fe9a815f1d0 2024-09-11T23:20:44.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.492+0000 7fe99e7fc640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe98c0678c0 0x7fe98c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.492+0000 7fe99e7fc640 1 -- 172.21.15.94:0/2143240255 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fe9a00883a0 con 0x7fe9a815f1d0 2024-09-11T23:20:44.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.492+0000 7fe9ad859640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe98c0678c0 0x7fe98c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.492+0000 7fe9ad859640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe98c0678c0 0x7fe98c069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4008930 tx=0x7fe9a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.496+0000 7fe99e7fc640 1 -- 172.21.15.94:0/2143240255 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9a0020020 con 0x7fe9a815f1d0 2024-09-11T23:20:44.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.656+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9a806e540 con 0x7fe9a815f1d0 2024-09-11T23:20:44.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.656+0000 7fe99e7fc640 1 -- 172.21.15.94:0/2143240255 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+13337 (secure 0 0 0) 0x7fe9a00590e0 con 0x7fe9a815f1d0 2024-09-11T23:20:44.658 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:44.659 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":118,"fsid":"eb53c07b-f490-45cc-a3dc-5c7cbe8d95e6","created":"2024-09-11T23:14:49.310671+0000","modified":"2024-09-11T23:20:41.383403+0000","last_up_change":"2024-09-11T23:15:01.550020+0000","last_in_change":"2024-09-11T23:14:51.967732+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:15:02.040073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72d0091b-4437-4a06-8dcc-98096e07761e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6817","nonce":3940152591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6819","nonce":3940152591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6823","nonce":3940152591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3940152591},{"type":"v1","addr":"172.21.15.94:6821","nonce":3940152591}]},"public_addr":"172.21.15.94:6817/3940152591","cluster_addr":"172.21.15.94:6819/3940152591","heartbeat_back_addr":"172.21.15.94:6823/3940152591","heartbeat_front_addr":"172.21.15.94:6821/3940152591","state":["exists","up"]},{"osd":1,"uuid":"54556a89-7209-459d-8060-70cbfc67cbc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6825","nonce":2486087269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6827","nonce":2486087269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6831","nonce":2486087269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2486087269},{"type":"v1","addr":"172.21.15.94:6829","nonce":2486087269}]},"public_addr":"172.21.15.94:6825/2486087269","cluster_addr":"172.21.15.94:6827/2486087269","heartbeat_back_addr":"172.21.15.94:6831/2486087269","heartbeat_front_addr":"172.21.15.94:6829/2486087269","state":["exists","up"]},{"osd":2,"uuid":"50e261e3-5cd2-400f-bcda-9adda215413d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6809","nonce":2442943552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6811","nonce":2442943552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6815","nonce":2442943552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2442943552},{"type":"v1","addr":"172.21.15.94:6813","nonce":2442943552}]},"public_addr":"172.21.15.94:6809/2442943552","cluster_addr":"172.21.15.94:6811/2442943552","heartbeat_back_addr":"172.21.15.94:6815/2442943552","heartbeat_front_addr":"172.21.15.94:6813/2442943552","state":["exists","up"]},{"osd":3,"uuid":"46dbd42d-19c6-4f0b-8d22-70e71a32c9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6801","nonce":2578660853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6803","nonce":2578660853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6807","nonce":2578660853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":2578660853},{"type":"v1","addr":"172.21.15.94:6805","nonce":2578660853}]},"public_addr":"172.21.15.94:6801/2578660853","cluster_addr":"172.21.15.94:6803/2578660853","heartbeat_back_addr":"172.21.15.94:6807/2578660853","heartbeat_front_addr":"172.21.15.94:6805/2578660853","state":["exists","up"]},{"osd":4,"uuid":"7eb655e3-c114-4a23-9b90-818729bc19f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6819","nonce":3159607984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6823","nonce":3159607984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6830","nonce":3159607984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3159607984},{"type":"v1","addr":"172.21.15.155:6826","nonce":3159607984}]},"public_addr":"172.21.15.155:6819/3159607984","cluster_addr":"172.21.15.155:6823/3159607984","heartbeat_back_addr":"172.21.15.155:6830/3159607984","heartbeat_front_addr":"172.21.15.155:6826/3159607984","state":["exists","up"]},{"osd":5,"uuid":"caa06254-1451-40cc-9657-e16d78ffbfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6801","nonce":1079669988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6803","nonce":1079669988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6807","nonce":1079669988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1079669988},{"type":"v1","addr":"172.21.15.155:6805","nonce":1079669988}]},"public_addr":"172.21.15.155:6801/1079669988","cluster_addr":"172.21.15.155:6803/1079669988","heartbeat_back_addr":"172.21.15.155:6807/1079669988","heartbeat_front_addr":"172.21.15.155:6805/1079669988","state":["exists","up"]},{"osd":6,"uuid":"87ee6c3d-c409-4458-9243-16c4ad202641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6809","nonce":1080635284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6811","nonce":1080635284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6815","nonce":1080635284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1080635284},{"type":"v1","addr":"172.21.15.155:6813","nonce":1080635284}]},"public_addr":"172.21.15.155:6809/1080635284","cluster_addr":"172.21.15.155:6811/1080635284","heartbeat_back_addr":"172.21.15.155:6815/1080635284","heartbeat_front_addr":"172.21.15.155:6813/1080635284","state":["exists","up"]},{"osd":7,"uuid":"a69a4c99-90b4-40be-a860-49154adf0e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6818","nonce":4208392943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6822","nonce":4208392943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6831","nonce":4208392943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":4208392943},{"type":"v1","addr":"172.21.15.155:6827","nonce":4208392943}]},"public_addr":"172.21.15.155:6818/4208392943","cluster_addr":"172.21.15.155:6822/4208392943","heartbeat_back_addr":"172.21.15.155:6831/4208392943","heartbeat_front_addr":"172.21.15.155:6827/4208392943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.552169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.693758+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.457485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.254831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.401401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.612765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.432560+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:58.445810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.94:6835/502410844":"2024-09-12T23:20:38.263936+0000","172.21.15.94:6834/502410844":"2024-09-12T23:20:38.263936+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:44.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe98c0678c0 msgr2=0x7fe98c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe98c0678c0 0x7fe98c069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4008930 tx=0x7fe9a4008040 comp rx=0 tx=0).stop 2024-09-11T23:20:44.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a815f1d0 msgr2=0x7fe9a8148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a815f1d0 0x7fe9a8148660 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000eb00 tx=0x7fe9a00021e0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 shutdown_connections 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fe98c0678c0 0x7fe98c069d80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9a815f1d0 0x7fe9a8148660 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9a81520a0 0x7fe9a8099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 --2- 172.21.15.94:0/2143240255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9a806fe50 0x7fe9a814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 >> 172.21.15.94:0/2143240255 conn(0x7fe9a80b1f90 msgr2=0x7fe9a814efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:44.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 shutdown_connections 2024-09-11T23:20:44.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:44.660+0000 7fe9afabd640 1 -- 172.21.15.94:0/2143240255 wait complete. 2024-09-11T23:20:44.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:44.861 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:45.677 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T23:20:45.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:45.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.808+0000 7f69f109b640 1 Processor -- start 2024-09-11T23:20:45.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.808+0000 7f69f109b640 1 -- start start 2024-09-11T23:20:45.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.808+0000 7f69f109b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f69ec0b5cf0 0x7f69ec15e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.808+0000 7f69f109b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f69ec15f8d0 0x7f69ec15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.808+0000 7f69f109b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ec15f180 con 0x7f69ec15ecb0 2024-09-11T23:20:45.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.808+0000 7f69f109b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f69ec15f460 con 0x7f69ec0b5cf0 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.808+0000 7f69f109b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f69ec06d440 con 0x7f69ec15f8d0 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ead9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f69ec0b5cf0 0x7f69ec15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69e259c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f69ec15ecb0 0x7f69ec06dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41922/0 (socket says 172.21.15.94:41922) 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69e259c640 1 -- 172.21.15.94:0/1826531859 learned_addr learned my addr 172.21.15.94:0/1826531859 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69eb59e640 1 --2- 172.21.15.94:0/1826531859 >> v2:172.21.15.155:3300/0 conn(0x7f69ec15f8d0 0x7f69ec15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ead9d640 1 -- 172.21.15.94:0/1826531859 >> v2:172.21.15.155:3300/0 conn(0x7f69ec15f8d0 msgr2=0x7f69ec15fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ead9d640 1 --2- 172.21.15.94:0/1826531859 >> v2:172.21.15.155:3300/0 conn(0x7f69ec15f8d0 0x7f69ec15fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ead9d640 1 -- 172.21.15.94:0/1826531859 >> v1:172.21.15.94:6789/0 conn(0x7f69ec15ecb0 legacy=0x7f69ec06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ead9d640 1 -- 172.21.15.94:0/1826531859 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec06e350 con 0x7f69ec0b5cf0 2024-09-11T23:20:45.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ea59c640 1 -- 172.21.15.94:0/1826531859 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854203543 0 0) 0x7f69ec15f180 con 0x7f69ec15ecb0 2024-09-11T23:20:45.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69eb59e640 1 --2- 172.21.15.94:0/1826531859 >> v2:172.21.15.155:3300/0 conn(0x7f69ec15f8d0 0x7f69ec15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:45.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ead9d640 1 --2- 172.21.15.94:0/1826531859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec0b5cf0 0x7f69ec15e770 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0b6c60 tx=0x7f69dc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2a0814c44be659 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ea59c640 1 -- 172.21.15.94:0/1826531859 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0b0070 con 0x7f69ec0b5cf0 2024-09-11T23:20:45.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ea59c640 1 -- 172.21.15.94:0/1826531859 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc0ab600 con 0x7f69ec0b5cf0 2024-09-11T23:20:45.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69ea59c640 1 -- 172.21.15.94:0/1826531859 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0ab9d0 con 0x7f69ec0b5cf0 2024-09-11T23:20:45.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69f109b640 1 -- 172.21.15.94:0/1826531859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec0b5cf0 msgr2=0x7f69ec15e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.812+0000 7f69f109b640 1 --2- 172.21.15.94:0/1826531859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec0b5cf0 0x7f69ec15e770 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0b6c60 tx=0x7f69dc01c3f0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- 172.21.15.94:0/1826531859 shutdown_connections 2024-09-11T23:20:45.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 --2- 172.21.15.94:0/1826531859 >> v2:172.21.15.155:3300/0 conn(0x7f69ec15f8d0 0x7f69ec15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 --2- 172.21.15.94:0/1826531859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec0b5cf0 0x7f69ec15e770 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- 172.21.15.94:0/1826531859 >> 172.21.15.94:0/1826531859 conn(0x7f69ec06c0c0 msgr2=0x7f69ec06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- 172.21.15.94:0/1826531859 shutdown_connections 2024-09-11T23:20:45.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- 172.21.15.94:0/1826531859 wait complete. 2024-09-11T23:20:45.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 Processor -- start 2024-09-11T23:20:45.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- start start 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69ec0b5cf0 0x7f69ec165f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec15ecb0 0x7f69ec163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69ec15f8d0 0x7f69ec163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec16b130 con 0x7f69ec15ecb0 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec072900 con 0x7f69ec15f8d0 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f69ec16b2b0 con 0x7f69ec0b5cf0 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec15ecb0 0x7f69ec163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec15ecb0 0x7f69ec163790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53774/0 (socket says 172.21.15.94:53774) 2024-09-11T23:20:45.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 -- 172.21.15.94:0/68669149 learned_addr learned my addr 172.21.15.94:0/68669149 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:45.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69ead9d640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69ec0b5cf0 0x7f69ec165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69eb59e640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69ec15f8d0 0x7f69ec163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 -- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69ec0b5cf0 msgr2=0x7f69ec165f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69ec0b5cf0 0x7f69ec165f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 -- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69ec15f8d0 msgr2=0x7f69ec163cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69ec15f8d0 0x7f69ec163cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 -- 172.21.15.94:0/68669149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec155370 con 0x7f69ec15ecb0 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69eb59e640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69ec15f8d0 0x7f69ec163cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e259c640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec15ecb0 0x7f69ec163790 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c4e0 tx=0x7f69d400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4018070 con 0x7f69ec15ecb0 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d4007500 con 0x7f69ec15ecb0 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec155650 con 0x7f69ec15ecb0 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4004a30 con 0x7f69ec15ecb0 2024-09-11T23:20:45.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec155c10 con 0x7f69ec15ecb0 2024-09-11T23:20:45.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.816+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69ec163340 con 0x7f69ec15ecb0 2024-09-11T23:20:45.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69d401b070 con 0x7f69ec15ecb0 2024-09-11T23:20:45.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69e3fff640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69cc0678c0 0x7f69cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f69d4084f20 con 0x7f69ec15ecb0 2024-09-11T23:20:45.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69e3fff640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7f69cc06dd60 0x7f69cc0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 --> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69d401ee50 con 0x7f69cc06dd60 2024-09-11T23:20:45.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f69d4087540 con 0x7f69ec15ecb0 2024-09-11T23:20:45.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69eb59e640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7f69cc06dd60 0x7f69cc0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69ead9d640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69cc0678c0 0x7f69cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69eb59e640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7f69cc06dd60 0x7f69cc0701a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69ead9d640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69cc0678c0 0x7f69cc069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0ad000 tx=0x7f69dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.820+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== osd.0 v2:172.21.15.94:6816/3940152591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69d401ee50 con 0x7f69cc06dd60 2024-09-11T23:20:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 --> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f69ec15e770 con 0x7f69cc06dd60 2024-09-11T23:20:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69e3fff640 1 -- 172.21.15.94:0/68669149 <== osd.0 v2:172.21.15.94:6816/3940152591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f69ec15e770 con 0x7f69cc06dd60 2024-09-11T23:20:45.835 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:45.835 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:45.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7f69cc06dd60 msgr2=0x7f69cc0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:6816/3940152591,v1:172.21.15.94:6817/3940152591] conn(0x7f69cc06dd60 0x7f69cc0701a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69cc0678c0 msgr2=0x7f69cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f69cc0678c0 0x7f69cc069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0ad000 tx=0x7f69dc0a6000 comp rx=0 tx=0).stop 2024-09-11T23:20:45.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec15ecb0 msgr2=0x7f69ec163790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 --2- 172.21.15.94:0/68669149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec15ecb0 0x7f69ec163790 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c4e0 tx=0x7f69d400c9a0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69eb59e640 1 -- 172.21.15.94:0/68669149 reap_dead start 2024-09-11T23:20:45.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 shutdown_connections 2024-09-11T23:20:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 >> 172.21.15.94:0/68669149 conn(0x7f69ec06c0c0 msgr2=0x7f69ec168360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.832+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 shutdown_connections 2024-09-11T23:20:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.836+0000 7f69f109b640 1 -- 172.21.15.94:0/68669149 wait complete. 2024-09-11T23:20:45.851 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T23:20:45.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7c15e640 1 Processor -- start 2024-09-11T23:20:45.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7c15e640 1 -- start start 2024-09-11T23:20:45.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7c15e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415e010 0x7fdb7406de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7c15e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdb7415f400 0x7fdb740b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7c15e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7406e360 con 0x7fdb74162a80 2024-09-11T23:20:45.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7c15e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdb740b5e20 con 0x7fdb7415f400 2024-09-11T23:20:45.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7c15e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb740b6100 con 0x7fdb7415e010 2024-09-11T23:20:45.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb79efa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415e010 0x7fdb7406de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb79efa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415e010 0x7fdb7406de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:50250/0 (socket says 172.21.15.94:50250) 2024-09-11T23:20:45.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb79efa640 1 -- 172.21.15.94:0/663185617 learned_addr learned my addr 172.21.15.94:0/663185617 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:45.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb7a6fb640 1 --2- 172.21.15.94:0/663185617 >> v2:172.21.15.155:3300/0 conn(0x7fdb7415f400 0x7fdb740b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb79efa640 1 -- 172.21.15.94:0/663185617 >> v2:172.21.15.155:3300/0 conn(0x7fdb7415f400 msgr2=0x7fdb740b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:45.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb79efa640 1 --2- 172.21.15.94:0/663185617 >> v2:172.21.15.155:3300/0 conn(0x7fdb7415f400 0x7fdb740b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb79efa640 1 -- 172.21.15.94:0/663185617 >> v1:172.21.15.155:6789/0 conn(0x7fdb74162a80 legacy=0x7fdb740b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.964+0000 7fdb79efa640 1 -- 172.21.15.94:0/663185617 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7406d340 con 0x7fdb7415e010 2024-09-11T23:20:45.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb79efa640 1 --2- 172.21.15.94:0/663185617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415e010 0x7fdb7406de20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009e50 tx=0x7fdb6c01c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c1874a602c5053b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb78ef8640 1 -- 172.21.15.94:0/663185617 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0a5660 con 0x7fdb7415e010 2024-09-11T23:20:45.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb78ef8640 1 -- 172.21.15.94:0/663185617 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0a5800 con 0x7fdb7415e010 2024-09-11T23:20:45.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb78ef8640 1 -- 172.21.15.94:0/663185617 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0a5bd0 con 0x7fdb7415e010 2024-09-11T23:20:45.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 -- 172.21.15.94:0/663185617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415e010 msgr2=0x7fdb7406de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/663185617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415e010 0x7fdb7406de20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009e50 tx=0x7fdb6c01c9a0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 -- 172.21.15.94:0/663185617 shutdown_connections 2024-09-11T23:20:45.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/663185617 >> v2:172.21.15.155:3300/0 conn(0x7fdb7415f400 0x7fdb740b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/663185617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415e010 0x7fdb7406de20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 -- 172.21.15.94:0/663185617 >> 172.21.15.94:0/663185617 conn(0x7fdb7406c0c0 msgr2=0x7fdb7406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 -- 172.21.15.94:0/663185617 shutdown_connections 2024-09-11T23:20:45.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.968+0000 7fdb7c15e640 1 -- 172.21.15.94:0/663185617 wait complete. 2024-09-11T23:20:45.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 Processor -- start 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 -- start start 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb7415e010 0x7fdb74156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415f400 0x7fdb7414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb74162a80 0x7fdb741550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdb741605b0 con 0x7fdb7415e010 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74160430 con 0x7fdb74162a80 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb740b4c80 con 0x7fdb7415f400 2024-09-11T23:20:45.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb7415e010 0x7fdb74156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb7415e010 0x7fdb74156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53786/0 (socket says 172.21.15.94:53786) 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 -- 172.21.15.94:0/2260852715 learned_addr learned my addr 172.21.15.94:0/2260852715 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7a6fb640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb74162a80 0x7fdb741550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb796f9640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415f400 0x7fdb7414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 -- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415f400 msgr2=0x7fdb7414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415f400 0x7fdb7414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 -- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb74162a80 msgr2=0x7fdb741550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb74162a80 0x7fdb741550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 -- 172.21.15.94:0/2260852715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb741538e0 con 0x7fdb7415e010 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb79efa640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb7415e010 0x7fdb74156dd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c01a5d0 tx=0x7fdb6c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb6a7fc640 1 -- 172.21.15.94:0/2260852715 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0bc020 con 0x7fdb7415e010 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb6a7fc640 1 -- 172.21.15.94:0/2260852715 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0b88c0 con 0x7fdb7415e010 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb741562f0 con 0x7fdb7415e010 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb6a7fc640 1 -- 172.21.15.94:0/2260852715 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0a5660 con 0x7fdb7415e010 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb741568b0 con 0x7fdb7415e010 2024-09-11T23:20:45.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.972+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7406de20 con 0x7fdb7415e010 2024-09-11T23:20:45.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.976+0000 7fdb6a7fc640 1 -- 172.21.15.94:0/2260852715 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb6c0bf020 con 0x7fdb7415e010 2024-09-11T23:20:45.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.976+0000 7fdb6a7fc640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb580678c0 0x7fdb58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.976+0000 7fdb6a7fc640 1 -- 172.21.15.94:0/2260852715 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fdb6c121070 con 0x7fdb7415e010 2024-09-11T23:20:45.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.976+0000 7fdb796f9640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb580678c0 0x7fdb58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.976+0000 7fdb796f9640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb580678c0 0x7fdb58069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb74155ec0 tx=0x7fdb64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:45.980+0000 7fdb6a7fc640 1 -- 172.21.15.94:0/2260852715 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdb6c016620 con 0x7fdb7415e010 2024-09-11T23:20:46.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.140+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdb7406c540 con 0x7fdb580678c0 2024-09-11T23:20:46.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.140+0000 7fdb6a7fc640 1 -- 172.21.15.94:0/2260852715 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdb7406c540 con 0x7fdb580678c0 2024-09-11T23:20:46.143 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T23:20:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb580678c0 msgr2=0x7fdb58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb580678c0 0x7fdb58069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb74155ec0 tx=0x7fdb64009040 comp rx=0 tx=0).stop 2024-09-11T23:20:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb7415e010 msgr2=0x7fdb74156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb7415e010 0x7fdb74156dd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c01a5d0 tx=0x7fdb6c019740 comp rx=0 tx=0).stop 2024-09-11T23:20:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 shutdown_connections 2024-09-11T23:20:46.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb74162a80 0x7fdb741550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb7415f400 0x7fdb7414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fdb580678c0 0x7fdb58069d80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 --2- 172.21.15.94:0/2260852715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb7415e010 0x7fdb74156dd0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 >> 172.21.15.94:0/2260852715 conn(0x7fdb7406c0c0 msgr2=0x7fdb740b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 shutdown_connections 2024-09-11T23:20:46.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.144+0000 7fdb7c15e640 1 -- 172.21.15.94:0/2260852715 wait complete. 2024-09-11T23:20:46.162 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T23:20:46.162 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:46.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8b0a1640 1 Processor -- start 2024-09-11T23:20:46.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8b0a1640 1 -- start start 2024-09-11T23:20:46.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8b0a1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 0x7f2c840ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8b0a1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2c840af470 0x7f2c8406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8b0a1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c840b3290 con 0x7f2c8415c2a0 2024-09-11T23:20:46.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8b0a1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2c840b3570 con 0x7f2c840af470 2024-09-11T23:20:46.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8b0a1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2c840b3850 con 0x7f2c8415bec0 2024-09-11T23:20:46.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c83fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2c8415c2a0 0x7f2c840aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41928/0 (socket says 172.21.15.94:41928) 2024-09-11T23:20:46.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c83fff640 1 -- 172.21.15.94:0/1257260329 learned_addr learned my addr 172.21.15.94:0/1257260329 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:46.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8963e640 1 --2- 172.21.15.94:0/1257260329 >> v2:172.21.15.155:3300/0 conn(0x7f2c840af470 0x7f2c8406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 0x7f2c840ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924146837 0 0) 0x7f2c840b3290 con 0x7f2c8415c2a0 2024-09-11T23:20:46.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c6c003530 con 0x7f2c8415c2a0 2024-09-11T23:20:46.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 12115378 0 0) 0x7f2c6c003530 con 0x7f2c8415c2a0 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 msgr2=0x7f2c840ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 0x7f2c840ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 >> v2:172.21.15.155:3300/0 conn(0x7f2c840af470 msgr2=0x7f2c8406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 --2- 172.21.15.94:0/1257260329 >> v2:172.21.15.155:3300/0 conn(0x7f2c840af470 0x7f2c8406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c840b3b30 con 0x7f2c8415c2a0 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f2c78001680 con 0x7f2c8415c2a0 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 >> v1:172.21.15.94:6789/0 conn(0x7f2c8415c2a0 legacy=0x7f2c840aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c6c0039c0 0x7f2c6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 0x7f2c6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c004d50 0x7f2c6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2c840b3570 con 0x7f2c6c0039c0 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c840b3850 con 0x7f2c6c004d50 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c00b9d0 con 0x7f2c8415bec0 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c6c0039c0 0x7f2c6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c83fff640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 0x7f2c6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c8963e640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c004d50 0x7f2c6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c88e3d640 1 -- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 msgr2=0x7f2c6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 0x7f2c6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c88e3d640 1 -- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c004d50 msgr2=0x7f2c6c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c004d50 0x7f2c6c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c88e3d640 1 -- 172.21.15.94:0/1257260329 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c003530 con 0x7f2c6c0039c0 2024-09-11T23:20:46.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.288+0000 7f2c83fff640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c8415bec0 0x7f2c6c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:46.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c6c0039c0 0x7f2c6c003de0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009ae0 tx=0x7f2c7401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6471752217bdf11a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c740b2070 con 0x7f2c6c0039c0 2024-09-11T23:20:46.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c740a5610 con 0x7f2c6c0039c0 2024-09-11T23:20:46.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c837fe640 1 -- 172.21.15.94:0/1257260329 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c740096b0 con 0x7f2c6c0039c0 2024-09-11T23:20:46.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1257260329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c6c0039c0 msgr2=0x7f2c6c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c8b0a1640 1 --2- 172.21.15.94:0/1257260329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c6c0039c0 0x7f2c6c003de0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009ae0 tx=0x7f2c7401ca40 comp rx=0 tx=0).stop 2024-09-11T23:20:46.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c8963e640 1 -- 172.21.15.94:0/1257260329 reap_dead start 2024-09-11T23:20:46.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1257260329 shutdown_connections 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1257260329 >> 172.21.15.94:0/1257260329 conn(0x7f2c840b1f90 msgr2=0x7f2c840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1257260329 shutdown_connections 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.292+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1257260329 wait complete. 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 Processor -- start 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 -- start start 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c0039c0 0x7f2c8414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c840ce870 0x7f2c841f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c8414c260 0x7f2c8414c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2c840ad790 con 0x7f2c840ce870 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c840ad610 con 0x7f2c8414c260 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8406ed50 con 0x7f2c6c0039c0 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c840ce870 0x7f2c841f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c840ce870 0x7f2c841f6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53800/0 (socket says 172.21.15.94:53800) 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 -- 172.21.15.94:0/1477127779 learned_addr learned my addr 172.21.15.94:0/1477127779 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8963e640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c8414c260 0x7f2c8414c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c0039c0 0x7f2c8414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 -- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c0039c0 msgr2=0x7f2c8414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c0039c0 0x7f2c8414abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 -- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c8414c260 msgr2=0x7f2c8414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c8414c260 0x7f2c8414c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 -- 172.21.15.94:0/1477127779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c84157830 con 0x7f2c840ce870 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8963e640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c8414c260 0x7f2c8414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c83fff640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c840ce870 0x7f2c841f6fd0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007fd0 tx=0x7f2c7800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78019070 con 0x7f2c840ce870 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c780074e0 con 0x7f2c840ce870 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c84072160 con 0x7f2c840ce870 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78004a30 con 0x7f2c840ce870 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c840cecf0 con 0x7f2c840ce870 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c8406f100 con 0x7f2c840ce870 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c7801c070 con 0x7f2c840ce870 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2c700678f0 0x7f2c70069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f2c78085d20 con 0x7f2c840ce870 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f2c7006dd90 0x7f2c700701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 --> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c78011e50 con 0x7f2c7006dd90 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f2c780861b0 con 0x7f2c840ce870 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c8963e640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f2c7006dd90 0x7f2c700701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.296+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2c700678f0 0x7f2c70069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.300+0000 7f2c8963e640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f2c7006dd90 0x7f2c700701d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.300+0000 7f2c88e3d640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2c700678f0 0x7f2c70069db0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2c740af000 tx=0x7f2c740046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.300+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== osd.1 v2:172.21.15.94:6824/2486087269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c78011e50 con 0x7f2c7006dd90 2024-09-11T23:20:46.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 --> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2c8406fcd0 con 0x7f2c7006dd90 2024-09-11T23:20:46.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c817fa640 1 -- 172.21.15.94:0/1477127779 <== osd.1 v2:172.21.15.94:6824/2486087269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2c8406fcd0 con 0x7f2c7006dd90 2024-09-11T23:20:46.313 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:46.313 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:46.314 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:46.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f2c7006dd90 msgr2=0x7f2c700701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:6824/2486087269,v1:172.21.15.94:6825/2486087269] conn(0x7f2c7006dd90 0x7f2c700701d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2c700678f0 msgr2=0x7f2c70069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2c700678f0 0x7f2c70069db0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2c740af000 tx=0x7f2c740046d0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c840ce870 msgr2=0x7f2c841f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 --2- 172.21.15.94:0/1477127779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c840ce870 0x7f2c841f6fd0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007fd0 tx=0x7f2c7800dd40 comp rx=0 tx=0).stop 2024-09-11T23:20:46.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8963e640 1 -- 172.21.15.94:0/1477127779 reap_dead start 2024-09-11T23:20:46.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 shutdown_connections 2024-09-11T23:20:46.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 >> 172.21.15.94:0/1477127779 conn(0x7f2c840b1f90 msgr2=0x7f2c840aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 shutdown_connections 2024-09-11T23:20:46.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.312+0000 7f2c8b0a1640 1 -- 172.21.15.94:0/1477127779 wait complete. 2024-09-11T23:20:46.328 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T23:20:46.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cbae21640 1 Processor -- start 2024-09-11T23:20:46.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cbae21640 1 -- start start 2024-09-11T23:20:46.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cbae21640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9cb409ac60 0x7f9cb409ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cbae21640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb40afd80 con 0x7f9cb40af730 2024-09-11T23:20:46.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cbae21640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb40b0060 con 0x7f9cb409b040 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cbae21640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb40afb60 con 0x7f9cb409ac60 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cb8bbd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9cb409ac60 0x7f9cb409ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cb93be640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9cb40af730 0x7f9cb415d010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41938/0 (socket says 172.21.15.94:41938) 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cb93be640 1 -- 172.21.15.94:0/731342458 learned_addr learned my addr 172.21.15.94:0/731342458 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cb8bbd640 1 -- 172.21.15.94:0/731342458 >> v1:172.21.15.155:6789/0 conn(0x7f9cb409b040 legacy=0x7f9cb40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cb8bbd640 1 -- 172.21.15.94:0/731342458 >> v1:172.21.15.94:6789/0 conn(0x7f9cb40af730 legacy=0x7f9cb415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cb8bbd640 1 -- 172.21.15.94:0/731342458 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb40b0340 con 0x7f9cb409ac60 2024-09-11T23:20:46.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.444+0000 7f9cb37fe640 1 -- 172.21.15.94:0/731342458 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073762888 0 0) 0x7f9cb40afd80 con 0x7f9cb40af730 2024-09-11T23:20:46.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cb8bbd640 1 --2- 172.21.15.94:0/731342458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb409ba00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0097c0 tx=0x7f9cac01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d70dd2343ed5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cb37fe640 1 -- 172.21.15.94:0/731342458 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0b0070 con 0x7f9cb409ac60 2024-09-11T23:20:46.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cb37fe640 1 -- 172.21.15.94:0/731342458 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cac0ab600 con 0x7f9cb409ac60 2024-09-11T23:20:46.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cb37fe640 1 -- 172.21.15.94:0/731342458 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0ab9d0 con 0x7f9cb409ac60 2024-09-11T23:20:46.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 -- 172.21.15.94:0/731342458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 msgr2=0x7f9cb409ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 --2- 172.21.15.94:0/731342458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb409ba00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0097c0 tx=0x7f9cac01c3d0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 -- 172.21.15.94:0/731342458 shutdown_connections 2024-09-11T23:20:46.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 --2- 172.21.15.94:0/731342458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb409ba00 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 -- 172.21.15.94:0/731342458 >> 172.21.15.94:0/731342458 conn(0x7f9cb40b78d0 msgr2=0x7f9cb40b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 -- 172.21.15.94:0/731342458 shutdown_connections 2024-09-11T23:20:46.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 -- 172.21.15.94:0/731342458 wait complete. 2024-09-11T23:20:46.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 Processor -- start 2024-09-11T23:20:46.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.448+0000 7f9cbae21640 1 -- start start 2024-09-11T23:20:46.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb409b040 0x7f9cb4148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cb40af730 0x7f9cb4147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb40b2540 con 0x7f9cb409ac60 2024-09-11T23:20:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb40b23c0 con 0x7f9cb409b040 2024-09-11T23:20:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb4169d80 con 0x7f9cb40af730 2024-09-11T23:20:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb414bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53826/0 (socket says 172.21.15.94:53826) 2024-09-11T23:20:46.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 -- 172.21.15.94:0/4242786115 learned_addr learned my addr 172.21.15.94:0/4242786115 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:46.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 -- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cb40af730 msgr2=0x7f9cb4147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb3fff640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb409b040 0x7f9cb4148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cb40af730 0x7f9cb4147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 -- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb409b040 msgr2=0x7f9cb4148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb409b040 0x7f9cb4148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 -- 172.21.15.94:0/4242786115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb4149670 con 0x7f9cb409ac60 2024-09-11T23:20:46.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb8bbd640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb414bc90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0ae040 tx=0x7f9cac01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb17fa640 1 -- 172.21.15.94:0/4242786115 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0bb070 con 0x7f9cb409ac60 2024-09-11T23:20:46.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb17fa640 1 -- 172.21.15.94:0/4242786115 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cac004020 con 0x7f9cb409ac60 2024-09-11T23:20:46.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb4149910 con 0x7f9cb409ac60 2024-09-11T23:20:46.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb17fa640 1 -- 172.21.15.94:0/4242786115 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0b0040 con 0x7f9cb409ac60 2024-09-11T23:20:46.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb406cf00 con 0x7f9cb409ac60 2024-09-11T23:20:46.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb415f1a0 con 0x7f9cb409ac60 2024-09-11T23:20:46.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb17fa640 1 -- 172.21.15.94:0/4242786115 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cac003620 con 0x7f9cb409ac60 2024-09-11T23:20:46.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb17fa640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c940678c0 0x7f9c94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb17fa640 1 -- 172.21.15.94:0/4242786115 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f9cac120110 con 0x7f9cb409ac60 2024-09-11T23:20:46.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.452+0000 7f9cb3fff640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c940678c0 0x7f9c94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.456+0000 7f9cb3fff640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c940678c0 0x7f9c94069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9cb415b6f0 tx=0x7f9c9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.456+0000 7f9cb17fa640 1 -- 172.21.15.94:0/4242786115 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9cac016050 con 0x7f9cb409ac60 2024-09-11T23:20:46.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.612+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9cb415eec0 con 0x7f9c940678c0 2024-09-11T23:20:46.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cb17fa640 1 -- 172.21.15.94:0/4242786115 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9cb415eec0 con 0x7f9c940678c0 2024-09-11T23:20:46.616 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T23:20:46.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c940678c0 msgr2=0x7f9c94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c940678c0 0x7f9c94069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9cb415b6f0 tx=0x7f9c9c009040 comp rx=0 tx=0).stop 2024-09-11T23:20:46.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 msgr2=0x7f9cb414bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb414bc90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0ae040 tx=0x7f9cac01ac10 comp rx=0 tx=0).stop 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 shutdown_connections 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cb40af730 0x7f9cb4147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb409b040 0x7f9cb4148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f9c940678c0 0x7f9c94069d80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 --2- 172.21.15.94:0/4242786115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9cb409ac60 0x7f9cb414bc90 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 >> 172.21.15.94:0/4242786115 conn(0x7f9cb40b78d0 msgr2=0x7f9cb415aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 shutdown_connections 2024-09-11T23:20:46.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.616+0000 7f9cbae21640 1 -- 172.21.15.94:0/4242786115 wait complete. 2024-09-11T23:20:46.633 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T23:20:46.633 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:46.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10bdfcb640 1 Processor -- start 2024-09-11T23:20:46.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10bdfcb640 1 -- start start 2024-09-11T23:20:46.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10bdfcb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 0x7f10b806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10bdfcb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b815fc10 con 0x7f10b815eee0 2024-09-11T23:20:46.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10bdfcb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b8160c90 con 0x7f10b815d290 2024-09-11T23:20:46.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10bdfcb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10b815da40 con 0x7f10b815f830 2024-09-11T23:20:46.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b7fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f10b815eee0 0x7f10b8160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41944/0 (socket says 172.21.15.94:41944) 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b7fff640 1 -- 172.21.15.94:0/3223827923 learned_addr learned my addr 172.21.15.94:0/3223827923 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b77fe640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 0x7f10b806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083136008 0 0) 0x7f10b815fc10 con 0x7f10b815eee0 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10a0003530 con 0x7f10b815eee0 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3494455259 0 0) 0x7f10a0003530 con 0x7f10b815eee0 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 msgr2=0x7f10b806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 0x7f10b806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 >> v1:172.21.15.155:6789/0 conn(0x7f10b815d290 legacy=0x7f10b815fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b815d800 con 0x7f10b815eee0 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f10a8001680 con 0x7f10b815eee0 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 >> v1:172.21.15.94:6789/0 conn(0x7f10b815eee0 legacy=0x7f10b8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a00039f0 0x7f10a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a0004810 0x7f10a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 0x7f10a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f10b815da40 con 0x7f10a00039f0 2024-09-11T23:20:46.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10a000ba80 con 0x7f10a0004810 2024-09-11T23:20:46.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10a000bc80 con 0x7f10b815f830 2024-09-11T23:20:46.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b77fe640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a00039f0 0x7f10a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b7fff640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 0x7f10a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b6ffd640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a0004810 0x7f10a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b77fe640 1 -- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 msgr2=0x7f10a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b77fe640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815f830 0x7f10a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b77fe640 1 -- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a0004810 msgr2=0x7f10a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b77fe640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a0004810 0x7f10a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.744+0000 7f10b77fe640 1 -- 172.21.15.94:0/3223827923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0003530 con 0x7f10a00039f0 2024-09-11T23:20:46.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10b77fe640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a00039f0 0x7f10a0003e10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009f90 tx=0x7f10b001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ad569a756ed25f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00b2070 con 0x7f10a00039f0 2024-09-11T23:20:46.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b00a5be0 con 0x7f10a00039f0 2024-09-11T23:20:46.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10b67fc640 1 -- 172.21.15.94:0/3223827923 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0009c10 con 0x7f10a00039f0 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 -- 172.21.15.94:0/3223827923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a00039f0 msgr2=0x7f10a0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 --2- 172.21.15.94:0/3223827923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a00039f0 0x7f10a0003e10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009f90 tx=0x7f10b001cbf0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10b7fff640 1 -- 172.21.15.94:0/3223827923 reap_dead start 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 -- 172.21.15.94:0/3223827923 shutdown_connections 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 -- 172.21.15.94:0/3223827923 >> 172.21.15.94:0/3223827923 conn(0x7f10b80b6800 msgr2=0x7f10b80b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 -- 172.21.15.94:0/3223827923 shutdown_connections 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 -- 172.21.15.94:0/3223827923 wait complete. 2024-09-11T23:20:46.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 Processor -- start 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.748+0000 7f10bdfcb640 1 -- start start 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10a00039f0 0x7f10b81565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10b81531f0 0x7f10b814db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80700d0 0x7f10b8070550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80735e0 con 0x7f10b81531f0 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8073460 con 0x7f10b80700d0 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10b8168210 con 0x7f10a00039f0 2024-09-11T23:20:46.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10b81531f0 0x7f10b814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10b81531f0 0x7f10b814db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53840/0 (socket says 172.21.15.94:53840) 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 -- 172.21.15.94:0/939177247 learned_addr learned my addr 172.21.15.94:0/939177247 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b77fe640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10a00039f0 0x7f10b81565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b7fff640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80700d0 0x7f10b8070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 -- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10a00039f0 msgr2=0x7f10b81565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10a00039f0 0x7f10b81565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 -- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80700d0 msgr2=0x7f10b8070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80700d0 0x7f10b8070550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 -- 172.21.15.94:0/939177247 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b8153650 con 0x7f10b81531f0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b6ffd640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10b81531f0 0x7f10b814db70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00e490 tx=0x7f10ac00e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac019070 con 0x7f10b81531f0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ac0052e0 con 0x7f10b81531f0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b81538d0 con 0x7f10b81531f0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac003820 con 0x7f10b81531f0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b8153e90 con 0x7f10b81531f0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10b815fe70 con 0x7f10b81531f0 2024-09-11T23:20:46.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10ac01c070 con 0x7f10b81531f0 2024-09-11T23:20:46.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10a40678f0 0x7f10a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f10ac085cb0 con 0x7f10b81531f0 2024-09-11T23:20:46.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f10a406dd90 0x7f10a40701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 --> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10a40708a0 con 0x7f10a406dd90 2024-09-11T23:20:46.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f10ac086140 con 0x7f10b81531f0 2024-09-11T23:20:46.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b7fff640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f10a406dd90 0x7f10a40701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.752+0000 7f10b77fe640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10a40678f0 0x7f10a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.756+0000 7f10b7fff640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f10a406dd90 0x7f10a40701d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.756+0000 7f10b77fe640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10a40678f0 0x7f10a4069db0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f10b00af000 tx=0x7f10b00a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.756+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== osd.2 v2:172.21.15.94:6808/2442943552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10a40708a0 con 0x7f10a406dd90 2024-09-11T23:20:46.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 --> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f10b806e7c0 con 0x7f10a406dd90 2024-09-11T23:20:46.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f109ffff640 1 -- 172.21.15.94:0/939177247 <== osd.2 v2:172.21.15.94:6808/2442943552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f10b806e7c0 con 0x7f10a406dd90 2024-09-11T23:20:46.770 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:46.770 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:46.770 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:46.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f10a406dd90 msgr2=0x7f10a40701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:6808/2442943552,v1:172.21.15.94:6809/2442943552] conn(0x7f10a406dd90 0x7f10a40701d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10a40678f0 msgr2=0x7f10a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f10a40678f0 0x7f10a4069db0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f10b00af000 tx=0x7f10b00a7040 comp rx=0 tx=0).stop 2024-09-11T23:20:46.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10b81531f0 msgr2=0x7f10b814db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 --2- 172.21.15.94:0/939177247 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10b81531f0 0x7f10b814db70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00e490 tx=0x7f10ac00e950 comp rx=0 tx=0).stop 2024-09-11T23:20:46.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10b7fff640 1 -- 172.21.15.94:0/939177247 reap_dead start 2024-09-11T23:20:46.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 shutdown_connections 2024-09-11T23:20:46.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 >> 172.21.15.94:0/939177247 conn(0x7f10b80b6800 msgr2=0x7f10b80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 shutdown_connections 2024-09-11T23:20:46.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.768+0000 7f10bdfcb640 1 -- 172.21.15.94:0/939177247 wait complete. 2024-09-11T23:20:46.783 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T23:20:46.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154afad640 1 Processor -- start 2024-09-11T23:20:46.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154afad640 1 -- start start 2024-09-11T23:20:46.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154afad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f154415bec0 0x7f15440ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154afad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415c2a0 0x7f15440aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154afad640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15440b3290 con 0x7f15440af2a0 2024-09-11T23:20:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154afad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f15440b3570 con 0x7f154415bec0 2024-09-11T23:20:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154afad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f15440b3850 con 0x7f154415c2a0 2024-09-11T23:20:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154954a640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f15440af2a0 0x7f154415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41950/0 (socket says 172.21.15.94:41950) 2024-09-11T23:20:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f154954a640 1 -- 172.21.15.94:0/3737649003 learned_addr learned my addr 172.21.15.94:0/3737649003 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1548d49640 1 --2- 172.21.15.94:0/3737649003 >> v2:172.21.15.155:3300/0 conn(0x7f154415bec0 0x7f15440ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1543fff640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415c2a0 0x7f15440aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3070534823 0 0) 0x7f15440b3290 con 0x7f15440af2a0 2024-09-11T23:20:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f152c003530 con 0x7f15440af2a0 2024-09-11T23:20:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 340961623 0 0) 0x7f152c003530 con 0x7f15440af2a0 2024-09-11T23:20:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415c2a0 msgr2=0x7f15440aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415c2a0 0x7f15440aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 >> v2:172.21.15.155:3300/0 conn(0x7f154415bec0 msgr2=0x7f15440ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 --2- 172.21.15.94:0/3737649003 >> v2:172.21.15.155:3300/0 conn(0x7f154415bec0 0x7f15440ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15440b3b30 con 0x7f15440af2a0 2024-09-11T23:20:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f153c001a00 con 0x7f15440af2a0 2024-09-11T23:20:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 >> v1:172.21.15.94:6789/0 conn(0x7f15440af2a0 legacy=0x7f154415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c0039c0 0x7f152c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152c004810 0x7f152c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415c2a0 0x7f152c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f15440b3570 con 0x7f152c004810 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15440b3850 con 0x7f152c0039c0 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f152c00b9d0 con 0x7f154415c2a0 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1543fff640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152c004810 0x7f152c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1548d49640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c0039c0 0x7f152c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1543fff640 1 -- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415c2a0 msgr2=0x7f152c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1543fff640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415c2a0 0x7f152c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1543fff640 1 -- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c0039c0 msgr2=0x7f152c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1543fff640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c0039c0 0x7f152c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.896+0000 7f1543fff640 1 -- 172.21.15.94:0/3737649003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c003530 con 0x7f152c004810 2024-09-11T23:20:46.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f1543fff640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152c004810 0x7f152c004c90 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1538009ae0 tx=0x7f153801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9e107ef22221be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380b2070 con 0x7f152c004810 2024-09-11T23:20:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15380a55c0 con 0x7f152c004810 2024-09-11T23:20:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f15437fe640 1 -- 172.21.15.94:0/3737649003 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380096b0 con 0x7f152c004810 2024-09-11T23:20:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 -- 172.21.15.94:0/3737649003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152c004810 msgr2=0x7f152c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 --2- 172.21.15.94:0/3737649003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152c004810 0x7f152c004c90 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1538009ae0 tx=0x7f153801cab0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154954a640 1 -- 172.21.15.94:0/3737649003 reap_dead start 2024-09-11T23:20:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 -- 172.21.15.94:0/3737649003 shutdown_connections 2024-09-11T23:20:46.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 -- 172.21.15.94:0/3737649003 >> 172.21.15.94:0/3737649003 conn(0x7f15440b1f90 msgr2=0x7f15440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 -- 172.21.15.94:0/3737649003 shutdown_connections 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 -- 172.21.15.94:0/3737649003 wait complete. 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 Processor -- start 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.900+0000 7f154afad640 1 -- start start 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c004810 0x7f154415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15441512a0 0x7f15441f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415eea0 0x7f1544155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f15440af730 con 0x7f15441512a0 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15440b40f0 con 0x7f152c004810 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f15440afc90 con 0x7f154415eea0 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15441512a0 0x7f15441f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15441512a0 0x7f15441f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53862/0 (socket says 172.21.15.94:53862) 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 -- 172.21.15.94:0/4073655686 learned_addr learned my addr 172.21.15.94:0/4073655686 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1548d49640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c004810 0x7f154415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154954a640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415eea0 0x7f1544155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 -- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415eea0 msgr2=0x7f1544155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415eea0 0x7f1544155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 -- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c004810 msgr2=0x7f154415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c004810 0x7f154415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 -- 172.21.15.94:0/4073655686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1544073f20 con 0x7f15441512a0 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1543fff640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15441512a0 0x7f15441f8460 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f15380b0040 tx=0x7f152c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f15417fa640 1 -- 172.21.15.94:0/4073655686 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380bd020 con 0x7f15441512a0 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f15417fa640 1 -- 172.21.15.94:0/4073655686 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15380a5d10 con 0x7f15441512a0 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f15417fa640 1 -- 172.21.15.94:0/4073655686 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380b2040 con 0x7f15441512a0 2024-09-11T23:20:46.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154415cd80 con 0x7f15441512a0 2024-09-11T23:20:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15441f7c60 con 0x7f15441512a0 2024-09-11T23:20:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15440aed60 con 0x7f15441512a0 2024-09-11T23:20:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f15417fa640 1 -- 172.21.15.94:0/4073655686 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15380c0070 con 0x7f15441512a0 2024-09-11T23:20:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f15417fa640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f15300678c0 0x7f1530069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f15417fa640 1 -- 172.21.15.94:0/4073655686 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f153811f300 con 0x7f15441512a0 2024-09-11T23:20:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.904+0000 7f1548d49640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f15300678c0 0x7f1530069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.908+0000 7f1548d49640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f15300678c0 0x7f1530069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1534009ab0 tx=0x7f1534008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:46.908+0000 7f15417fa640 1 -- 172.21.15.94:0/4073655686 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f15380167c0 con 0x7f15441512a0 2024-09-11T23:20:47.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.068+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f154406fcd0 con 0x7f15300678c0 2024-09-11T23:20:47.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.068+0000 7f15417fa640 1 -- 172.21.15.94:0/4073655686 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f154406fcd0 con 0x7f15300678c0 2024-09-11T23:20:47.070 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T23:20:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f15300678c0 msgr2=0x7f1530069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f15300678c0 0x7f1530069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1534009ab0 tx=0x7f1534008040 comp rx=0 tx=0).stop 2024-09-11T23:20:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15441512a0 msgr2=0x7f15441f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15441512a0 0x7f15441f8460 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f15380b0040 tx=0x7f152c005840 comp rx=0 tx=0).stop 2024-09-11T23:20:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 shutdown_connections 2024-09-11T23:20:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154415eea0 0x7f1544155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f15300678c0 0x7f1530069d80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15441512a0 0x7f15441f8460 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 --2- 172.21.15.94:0/4073655686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c004810 0x7f154415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 >> 172.21.15.94:0/4073655686 conn(0x7f15440b1f90 msgr2=0x7f15440b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 shutdown_connections 2024-09-11T23:20:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.072+0000 7f154afad640 1 -- 172.21.15.94:0/4073655686 wait complete. 2024-09-11T23:20:47.087 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T23:20:47.087 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:47.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239c895640 1 Processor -- start 2024-09-11T23:20:47.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239c895640 1 -- start start 2024-09-11T23:20:47.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239c895640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 0x7f239815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239c895640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23980aee70 0x7f2398154d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239c895640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23980af300 con 0x7f23980adeb0 2024-09-11T23:20:47.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239c895640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f23980af5e0 con 0x7f23980aee70 2024-09-11T23:20:47.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239c895640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f23980af8c0 con 0x7f23980adad0 2024-09-11T23:20:47.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f2396d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f23980adeb0 0x7f23980cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41956/0 (socket says 172.21.15.94:41956) 2024-09-11T23:20:47.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f2396d9d640 1 -- 172.21.15.94:0/4093744879 learned_addr learned my addr 172.21.15.94:0/4093744879 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f2395d9b640 1 --2- 172.21.15.94:0/4093744879 >> v2:172.21.15.155:3300/0 conn(0x7f23980aee70 0x7f2398154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239659c640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 0x7f239815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587119105 0 0) 0x7f23980af300 con 0x7f23980adeb0 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2380003530 con 0x7f23980adeb0 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3823005489 0 0) 0x7f2380003530 con 0x7f23980adeb0 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 msgr2=0x7f239815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 0x7f239815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 >> v2:172.21.15.155:3300/0 conn(0x7f23980aee70 msgr2=0x7f2398154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 --2- 172.21.15.94:0/4093744879 >> v2:172.21.15.155:3300/0 conn(0x7f23980aee70 0x7f2398154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23980afba0 con 0x7f23980adeb0 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f2390001a00 con 0x7f23980adeb0 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 >> v1:172.21.15.94:6789/0 conn(0x7f23980adeb0 legacy=0x7f23980cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800039c0 0x7f2380003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 0x7f2380004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2380004d50 0x7f23800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f23980af5e0 con 0x7f23800039c0 2024-09-11T23:20:47.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23980af8c0 con 0x7f2380004d50 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f238000b9d0 con 0x7f23980adad0 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239659c640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800039c0 0x7f2380003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f2395d9b640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 0x7f2380004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f2396d9d640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2380004d50 0x7f23800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239659c640 1 -- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 msgr2=0x7f2380004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239659c640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23980adad0 0x7f2380004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239659c640 1 -- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2380004d50 msgr2=0x7f23800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239659c640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2380004d50 0x7f23800051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f239659c640 1 -- 172.21.15.94:0/4093744879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2380003530 con 0x7f23800039c0 2024-09-11T23:20:47.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.212+0000 7f2396d9d640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2380004d50 0x7f23800051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239659c640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800039c0 0x7f2380003de0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2388009ac0 tx=0x7f238801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c8a7f9c7f73833 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388009690 con 0x7f23800039c0 2024-09-11T23:20:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23880a6430 con 0x7f23800039c0 2024-09-11T23:20:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239559a640 1 -- 172.21.15.94:0/4093744879 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880a6800 con 0x7f23800039c0 2024-09-11T23:20:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 -- 172.21.15.94:0/4093744879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800039c0 msgr2=0x7f2380003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 --2- 172.21.15.94:0/4093744879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800039c0 0x7f2380003de0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2388009ac0 tx=0x7f238801ca50 comp rx=0 tx=0).stop 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f2396d9d640 1 -- 172.21.15.94:0/4093744879 reap_dead start 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 -- 172.21.15.94:0/4093744879 shutdown_connections 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 -- 172.21.15.94:0/4093744879 >> 172.21.15.94:0/4093744879 conn(0x7f23980736d0 msgr2=0x7f239806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 -- 172.21.15.94:0/4093744879 shutdown_connections 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 -- 172.21.15.94:0/4093744879 wait complete. 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 Processor -- start 2024-09-11T23:20:47.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.216+0000 7f239c895640 1 -- start start 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2398149110 0x7f2398158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2398149810 0x7f2398161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2398161f80 0x7f23981faf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f23980b0520 con 0x7f2398161f80 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23980b03a0 con 0x7f2398149810 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2398155280 con 0x7f2398149110 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2398161f80 0x7f23981faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2398161f80 0x7f23981faf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53870/0 (socket says 172.21.15.94:53870) 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 -- 172.21.15.94:0/4229262391 learned_addr learned my addr 172.21.15.94:0/4229262391 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2395d9b640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2398149810 0x7f2398161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239659c640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2398149110 0x7f2398158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 -- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2398149110 msgr2=0x7f2398158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2398149110 0x7f2398158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 -- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2398149810 msgr2=0x7f2398161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2398149810 0x7f2398161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 -- 172.21.15.94:0/4229262391 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2398158a90 con 0x7f2398161f80 2024-09-11T23:20:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2396d9d640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2398161f80 0x7f23981faf90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f2390000f90 tx=0x7f239000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390019070 con 0x7f2398161f80 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239000bd30 con 0x7f2398161f80 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2398160560 con 0x7f2398161f80 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390012610 con 0x7f2398161f80 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2398160b20 con 0x7f2398161f80 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2398160300 con 0x7f2398161f80 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23900127b0 con 0x7f2398161f80 2024-09-11T23:20:47.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f23780678c0 0x7f2378069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f2390086290 con 0x7f2398161f80 2024-09-11T23:20:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f237806dd60 0x7f23780701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 --> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2378070870 con 0x7f237806dd60 2024-09-11T23:20:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f2390086720 con 0x7f2398161f80 2024-09-11T23:20:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f2395d9b640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f237806dd60 0x7f23780701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.220+0000 7f239659c640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f23780678c0 0x7f2378069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.224+0000 7f2395d9b640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f237806dd60 0x7f23780701a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.224+0000 7f239659c640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f23780678c0 0x7f2378069d80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f23880ad000 tx=0x7f23880b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.224+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== osd.3 v2:172.21.15.94:6800/2578660853 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2378070870 con 0x7f237806dd60 2024-09-11T23:20:47.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 --> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2398163fe0 con 0x7f237806dd60 2024-09-11T23:20:47.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f2386ffd640 1 -- 172.21.15.94:0/4229262391 <== osd.3 v2:172.21.15.94:6800/2578660853 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2398163fe0 con 0x7f237806dd60 2024-09-11T23:20:47.237 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:47.237 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:47.238 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:47.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f237806dd60 msgr2=0x7f23780701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:6800/2578660853,v1:172.21.15.94:6801/2578660853] conn(0x7f237806dd60 0x7f23780701a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f23780678c0 msgr2=0x7f2378069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f23780678c0 0x7f2378069d80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f23880ad000 tx=0x7f23880b2040 comp rx=0 tx=0).stop 2024-09-11T23:20:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2398161f80 msgr2=0x7f23981faf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 --2- 172.21.15.94:0/4229262391 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2398161f80 0x7f23981faf90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f2390000f90 tx=0x7f239000b4a0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f2396d9d640 1 -- 172.21.15.94:0/4229262391 reap_dead start 2024-09-11T23:20:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 shutdown_connections 2024-09-11T23:20:47.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 >> 172.21.15.94:0/4229262391 conn(0x7f23980736d0 msgr2=0x7f239806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 shutdown_connections 2024-09-11T23:20:47.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.236+0000 7f239c895640 1 -- 172.21.15.94:0/4229262391 wait complete. 2024-09-11T23:20:47.252 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T23:20:47.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0e886640 1 Processor -- start 2024-09-11T23:20:47.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0e886640 1 -- start start 2024-09-11T23:20:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0e886640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e08070020 0x7f0e0815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0e886640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e080adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0e886640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e080aede0 con 0x7f0e081520a0 2024-09-11T23:20:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0e886640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0e08152480 con 0x7f0e08070020 2024-09-11T23:20:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0e886640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0815fa10 con 0x7f0e0815f1d0 2024-09-11T23:20:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e077fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e08070020 0x7f0e0815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e077fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e08070020 0x7f0e0815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53874/0 (socket says 172.21.15.94:53874) 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e077fe640 1 -- 172.21.15.94:0/4265859992 learned_addr learned my addr 172.21.15.94:0/4265859992 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0ce23640 1 --2- 172.21.15.94:0/4265859992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e080adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e077fe640 1 -- 172.21.15.94:0/4265859992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 msgr2=0x7f0e080adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e077fe640 1 --2- 172.21.15.94:0/4265859992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e080adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e077fe640 1 -- 172.21.15.94:0/4265859992 >> v1:172.21.15.155:6789/0 conn(0x7f0e081520a0 legacy=0x7f0e0806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e077fe640 1 -- 172.21.15.94:0/4265859992 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e08074250 con 0x7f0e08070020 2024-09-11T23:20:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.356+0000 7f0e0ce23640 1 --2- 172.21.15.94:0/4265859992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e080adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:47.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e077fe640 1 --2- 172.21.15.94:0/4265859992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e0815ec90 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009870 tx=0x7f0dfc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c7265ae0346ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e06ffd640 1 -- 172.21.15.94:0/4265859992 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0a95f0 con 0x7f0e08070020 2024-09-11T23:20:47.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e06ffd640 1 -- 172.21.15.94:0/4265859992 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0a9790 con 0x7f0e08070020 2024-09-11T23:20:47.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e06ffd640 1 -- 172.21.15.94:0/4265859992 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0a9b60 con 0x7f0e08070020 2024-09-11T23:20:47.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- 172.21.15.94:0/4265859992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 msgr2=0x7f0e0815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 --2- 172.21.15.94:0/4265859992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e0815ec90 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009870 tx=0x7f0dfc01c530 comp rx=0 tx=0).stop 2024-09-11T23:20:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- 172.21.15.94:0/4265859992 shutdown_connections 2024-09-11T23:20:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 --2- 172.21.15.94:0/4265859992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e080adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 --2- 172.21.15.94:0/4265859992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e0815ec90 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- 172.21.15.94:0/4265859992 >> 172.21.15.94:0/4265859992 conn(0x7f0e080b1f90 msgr2=0x7f0e080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- 172.21.15.94:0/4265859992 shutdown_connections 2024-09-11T23:20:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- 172.21.15.94:0/4265859992 wait complete. 2024-09-11T23:20:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 Processor -- start 2024-09-11T23:20:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- start start 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e080ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e081520a0 0x7f0e0814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e0814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0815f5e0 con 0x7f0e08070020 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08073d30 con 0x7f0e081520a0 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0815f760 con 0x7f0e0815f1d0 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e080ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e080ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53880/0 (socket says 172.21.15.94:53880) 2024-09-11T23:20:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 -- 172.21.15.94:0/1346038454 learned_addr learned my addr 172.21.15.94:0/1346038454 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 -- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 msgr2=0x7f0e0814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e077fe640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e081520a0 0x7f0e0814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e0814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 -- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e081520a0 msgr2=0x7f0e0814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e081520a0 0x7f0e0814d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 -- 172.21.15.94:0/1346038454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e08151d90 con 0x7f0e08070020 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e077fe640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e081520a0 0x7f0e0814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e07fff640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e080ce1a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0df800c3a0 tx=0x7f0df800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e04ff9640 1 -- 172.21.15.94:0/1346038454 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df80052d0 con 0x7f0e08070020 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e04ff9640 1 -- 172.21.15.94:0/1346038454 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df8005470 con 0x7f0e08070020 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e080cd9a0 con 0x7f0e08070020 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e04ff9640 1 -- 172.21.15.94:0/1346038454 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8007260 con 0x7f0e08070020 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.360+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e080b2d00 con 0x7f0e08070020 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.364+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0815ec90 con 0x7f0e08070020 2024-09-11T23:20:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.364+0000 7f0e04ff9640 1 -- 172.21.15.94:0/1346038454 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0df8007400 con 0x7f0e08070020 2024-09-11T23:20:47.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.364+0000 7f0e04ff9640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0df40678c0 0x7f0df4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.364+0000 7f0e04ff9640 1 -- 172.21.15.94:0/1346038454 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f0df8084fc0 con 0x7f0e08070020 2024-09-11T23:20:47.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.364+0000 7f0e077fe640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0df40678c0 0x7f0df4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.364+0000 7f0e077fe640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0df40678c0 0x7f0df4069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0ae000 tx=0x7f0dfc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.368+0000 7f0e04ff9640 1 -- 172.21.15.94:0/1346038454 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0df8055c70 con 0x7f0e08070020 2024-09-11T23:20:47.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.524+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f0e08151b40 con 0x7f0df40678c0 2024-09-11T23:20:47.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.524+0000 7f0e04ff9640 1 -- 172.21.15.94:0/1346038454 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0e08151b40 con 0x7f0df40678c0 2024-09-11T23:20:47.527 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T23:20:47.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0df40678c0 msgr2=0x7f0df4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0df40678c0 0x7f0df4069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0ae000 tx=0x7f0dfc0a7000 comp rx=0 tx=0).stop 2024-09-11T23:20:47.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 msgr2=0x7f0e080ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e080ce1a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0df800c3a0 tx=0x7f0df800c860 comp rx=0 tx=0).stop 2024-09-11T23:20:47.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 shutdown_connections 2024-09-11T23:20:47.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e0815f1d0 0x7f0e0814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e081520a0 0x7f0e0814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f0df40678c0 0x7f0df4069d80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 --2- 172.21.15.94:0/1346038454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e08070020 0x7f0e080ce1a0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 >> 172.21.15.94:0/1346038454 conn(0x7f0e080b1f90 msgr2=0x7f0e0815d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 shutdown_connections 2024-09-11T23:20:47.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.528+0000 7f0e0e886640 1 -- 172.21.15.94:0/1346038454 wait complete. 2024-09-11T23:20:47.545 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T23:20:47.545 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:47.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb0d69a640 1 Processor -- start 2024-09-11T23:20:47.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb0d69a640 1 -- start start 2024-09-11T23:20:47.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb0d69a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbb0815bc80 0x7fbb080b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb0d69a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb080d0b80 con 0x7fbb080b51b0 2024-09-11T23:20:47.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb0d69a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb080d0e60 con 0x7fbb080b3330 2024-09-11T23:20:47.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb0d69a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbb080b46d0 con 0x7fbb0815bc80 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb067fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbb080b51b0 0x7fbb0815b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41972/0 (socket says 172.21.15.94:41972) 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb067fc640 1 -- 172.21.15.94:0/4174646046 learned_addr learned my addr 172.21.15.94:0/4174646046 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340691647 0 0) 0x7fbb080d0b80 con 0x7fbb080b51b0 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf4003530 con 0x7fbb080b51b0 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb077fe640 1 --2- 172.21.15.94:0/4174646046 >> v2:172.21.15.155:3300/0 conn(0x7fbb0815bc80 0x7fbb080b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2033375653 0 0) 0x7fbaf4003530 con 0x7fbb080b51b0 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 >> v2:172.21.15.155:3300/0 conn(0x7fbb0815bc80 msgr2=0x7fbb080b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 --2- 172.21.15.94:0/4174646046 >> v2:172.21.15.155:3300/0 conn(0x7fbb0815bc80 0x7fbb080b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 >> v1:172.21.15.155:6789/0 conn(0x7fbb080b3330 legacy=0x7fbb080b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb080b49b0 con 0x7fbb080b51b0 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7fbaf00016a0 con 0x7fbb080b51b0 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 >> v1:172.21.15.94:6789/0 conn(0x7fbb080b51b0 legacy=0x7fbb0815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbaf40039c0 0x7fbaf4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaf4004810 0x7fbaf4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaf40051d0 0x7fbaf400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbb080b46d0 con 0x7fbaf40039c0 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf400c100 con 0x7fbaf40051d0 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf400c300 con 0x7fbaf4004810 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb06ffd640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbaf40039c0 0x7fbaf4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb077fe640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaf40051d0 0x7fbaf400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb06ffd640 1 -- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaf4004810 msgr2=0x7fbaf4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb06ffd640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaf4004810 0x7fbaf4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb06ffd640 1 -- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaf40051d0 msgr2=0x7fbaf400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb06ffd640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaf40051d0 0x7fbaf400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb06ffd640 1 -- 172.21.15.94:0/4174646046 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4003530 con 0x7fbaf40039c0 2024-09-11T23:20:47.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb077fe640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaf40051d0 0x7fbaf400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:47.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.664+0000 7fbb077fe640 1 -- 172.21.15.94:0/4174646046 reap_dead start 2024-09-11T23:20:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb06ffd640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbaf40039c0 0x7fbaf4003dc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fbb00007fd0 tx=0x7fbb0001c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ca19838d7b5a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb000b0070 con 0x7fbaf40039c0 2024-09-11T23:20:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb000ab620 con 0x7fbaf40039c0 2024-09-11T23:20:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb05ffb640 1 -- 172.21.15.94:0/4174646046 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb000040b0 con 0x7fbaf40039c0 2024-09-11T23:20:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- 172.21.15.94:0/4174646046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbaf40039c0 msgr2=0x7fbaf4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbaf40039c0 0x7fbaf4003dc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fbb00007fd0 tx=0x7fbb0001c660 comp rx=0 tx=0).stop 2024-09-11T23:20:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- 172.21.15.94:0/4174646046 shutdown_connections 2024-09-11T23:20:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 --2- 172.21.15.94:0/4174646046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbaf40039c0 0x7fbaf4003dc0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- 172.21.15.94:0/4174646046 >> 172.21.15.94:0/4174646046 conn(0x7fbb080b6870 msgr2=0x7fbb080b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- 172.21.15.94:0/4174646046 shutdown_connections 2024-09-11T23:20:47.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- 172.21.15.94:0/4174646046 wait complete. 2024-09-11T23:20:47.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 Processor -- start 2024-09-11T23:20:47.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- start start 2024-09-11T23:20:47.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaf40039c0 0x7fbb0815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb08142ad0 0x7fbb0815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806ee20 0x7fbb0806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbb080d05f0 con 0x7fbb08142ad0 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb08144f10 con 0x7fbb0806ee20 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb0d69a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb080d0770 con 0x7fbaf40039c0 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb067fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb08142ad0 0x7fbb0815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb067fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb08142ad0 0x7fbb0815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53894/0 (socket says 172.21.15.94:53894) 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb067fc640 1 -- 172.21.15.94:0/516718706 learned_addr learned my addr 172.21.15.94:0/516718706 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:47.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.668+0000 7fbb06ffd640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaf40039c0 0x7fbb0815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb077fe640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806ee20 0x7fbb0806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb067fc640 1 -- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaf40039c0 msgr2=0x7fbb0815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb067fc640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaf40039c0 0x7fbb0815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb067fc640 1 -- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806ee20 msgr2=0x7fbb0806f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb067fc640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806ee20 0x7fbb0806f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb067fc640 1 -- 172.21.15.94:0/516718706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0815c670 con 0x7fbb08142ad0 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb067fc640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb08142ad0 0x7fbb0815aa50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c870 tx=0x7fbaf000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0018070 con 0x7fbb08142ad0 2024-09-11T23:20:47.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf00074e0 con 0x7fbb08142ad0 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0815c950 con 0x7fbb08142ad0 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0004a30 con 0x7fbb08142ad0 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0815cf10 con 0x7fbb08142ad0 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb080b3710 con 0x7fbb08142ad0 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbaf001b070 con 0x7fbb08142ad0 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbae80678c0 0x7fbae8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fbaf00856f0 con 0x7fbb08142ad0 2024-09-11T23:20:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7fbae806dd60 0x7fbae80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 --> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbae8070870 con 0x7fbae806dd60 2024-09-11T23:20:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7fbaf0085b80 con 0x7fbb08142ad0 2024-09-11T23:20:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb06ffd640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbae80678c0 0x7fbae8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb077fe640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7fbae806dd60 0x7fbae80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb077fe640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7fbae806dd60 0x7fbae80701a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.672+0000 7fbb06ffd640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbae80678c0 0x7fbae8069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbb000ad000 tx=0x7fbb00003af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.676+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== osd.4 v2:172.21.15.155:6817/3159607984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbae8070870 con 0x7fbae806dd60 2024-09-11T23:20:47.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 --> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb080b6cf0 con 0x7fbae806dd60 2024-09-11T23:20:47.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbaff7fe640 1 -- 172.21.15.94:0/516718706 <== osd.4 v2:172.21.15.155:6817/3159607984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb080b6cf0 con 0x7fbae806dd60 2024-09-11T23:20:47.690 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:47.691 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:47.691 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:47.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7fbae806dd60 msgr2=0x7fbae80701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6817/3159607984,v1:172.21.15.155:6819/3159607984] conn(0x7fbae806dd60 0x7fbae80701a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbae80678c0 msgr2=0x7fbae8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fbae80678c0 0x7fbae8069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbb000ad000 tx=0x7fbb00003af0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb08142ad0 msgr2=0x7fbb0815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 --2- 172.21.15.94:0/516718706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb08142ad0 0x7fbb0815aa50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c870 tx=0x7fbaf000cd30 comp rx=0 tx=0).stop 2024-09-11T23:20:47.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb077fe640 1 -- 172.21.15.94:0/516718706 reap_dead start 2024-09-11T23:20:47.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 shutdown_connections 2024-09-11T23:20:47.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 >> 172.21.15.94:0/516718706 conn(0x7fbb080b6870 msgr2=0x7fbb0806d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 shutdown_connections 2024-09-11T23:20:47.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.688+0000 7fbb0d69a640 1 -- 172.21.15.94:0/516718706 wait complete. 2024-09-11T23:20:47.705 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T23:20:47.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73cba9640 1 Processor -- start 2024-09-11T23:20:47.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73cba9640 1 -- start start 2024-09-11T23:20:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73cba9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73815c2a0 0x7ff7380aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73cba9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7380b3290 con 0x7ff7380af2a0 2024-09-11T23:20:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73cba9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7380b3570 con 0x7ff73815bec0 2024-09-11T23:20:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73cba9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380b3850 con 0x7ff73815c2a0 2024-09-11T23:20:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff736d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff7380af2a0 0x7ff73806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41980/0 (socket says 172.21.15.94:41980) 2024-09-11T23:20:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff736d9d640 1 -- 172.21.15.94:0/720141853 learned_addr learned my addr 172.21.15.94:0/720141853 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff735d9b640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73815c2a0 0x7ff7380aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240184494 0 0) 0x7ff7380b3290 con 0x7ff7380af2a0 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.804+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff720003530 con 0x7ff7380af2a0 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2400575609 0 0) 0x7ff720003530 con 0x7ff7380af2a0 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73815c2a0 msgr2=0x7ff7380aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73815c2a0 0x7ff7380aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 >> v1:172.21.15.155:6789/0 conn(0x7ff73815bec0 legacy=0x7ff7380ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380b3b30 con 0x7ff7380af2a0 2024-09-11T23:20:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7ff730001a00 con 0x7ff7380af2a0 2024-09-11T23:20:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 >> v1:172.21.15.94:6789/0 conn(0x7ff7380af2a0 legacy=0x7ff73806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7200039f0 0x7ff720003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff720004810 0x7ff720004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73815c2a0 0x7ff7200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380b3850 con 0x7ff720004810 2024-09-11T23:20:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff72000ba80 con 0x7ff7200039f0 2024-09-11T23:20:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff72000bc80 con 0x7ff73815c2a0 2024-09-11T23:20:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff735d9b640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff720004810 0x7ff720004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73659c640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7200039f0 0x7ff720003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff735d9b640 1 -- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73815c2a0 msgr2=0x7ff7200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff735d9b640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff73815c2a0 0x7ff7200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff735d9b640 1 -- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7200039f0 msgr2=0x7ff720003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff735d9b640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7200039f0 0x7ff720003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff735d9b640 1 -- 172.21.15.94:0/720141853 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff720003530 con 0x7ff720004810 2024-09-11T23:20:47.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff735d9b640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff720004810 0x7ff720004c90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009a90 tx=0x7ff72c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272236d651f4074c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0b2070 con 0x7ff720004810 2024-09-11T23:20:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72c0a5640 con 0x7ff720004810 2024-09-11T23:20:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73559a640 1 -- 172.21.15.94:0/720141853 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c009690 con 0x7ff720004810 2024-09-11T23:20:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73cba9640 1 -- 172.21.15.94:0/720141853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff720004810 msgr2=0x7ff720004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73cba9640 1 --2- 172.21.15.94:0/720141853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff720004810 0x7ff720004c90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009a90 tx=0x7ff72c01ca50 comp rx=0 tx=0).stop 2024-09-11T23:20:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff736d9d640 1 -- 172.21.15.94:0/720141853 reap_dead start 2024-09-11T23:20:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73cba9640 1 -- 172.21.15.94:0/720141853 shutdown_connections 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73cba9640 1 -- 172.21.15.94:0/720141853 >> 172.21.15.94:0/720141853 conn(0x7ff7380b1f90 msgr2=0x7ff7380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73cba9640 1 -- 172.21.15.94:0/720141853 shutdown_connections 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.808+0000 7ff73cba9640 1 -- 172.21.15.94:0/720141853 wait complete. 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 Processor -- start 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 -- start start 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff720004810 0x7ff738143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff73815dc60 0x7ff73815f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7381f1f70 0x7ff7380cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380af730 con 0x7ff73815dc60 2024-09-11T23:20:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380b40f0 con 0x7ff720004810 2024-09-11T23:20:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380afc90 con 0x7ff7381f1f70 2024-09-11T23:20:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff73815dc60 0x7ff73815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff73815dc60 0x7ff73815f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53924/0 (socket says 172.21.15.94:53924) 2024-09-11T23:20:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 -- 172.21.15.94:0/753729428 learned_addr learned my addr 172.21.15.94:0/753729428 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73659c640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff720004810 0x7ff738143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff736d9d640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7381f1f70 0x7ff7380cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 -- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7381f1f70 msgr2=0x7ff7380cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7381f1f70 0x7ff7380cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 -- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff720004810 msgr2=0x7ff738143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff720004810 0x7ff738143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 -- 172.21.15.94:0/753729428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73815c8d0 con 0x7ff73815dc60 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73659c640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff720004810 0x7ff738143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff735d9b640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff73815dc60 0x7ff73815f520 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff72c01c880 tx=0x7ff720005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff726ffd640 1 -- 172.21.15.94:0/753729428 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0be070 con 0x7ff73815dc60 2024-09-11T23:20:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff726ffd640 1 -- 172.21.15.94:0/753729428 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72c0a5e50 con 0x7ff73815dc60 2024-09-11T23:20:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff726ffd640 1 -- 172.21.15.94:0/753729428 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0b2040 con 0x7ff73815dc60 2024-09-11T23:20:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7381e6050 con 0x7ff73815dc60 2024-09-11T23:20:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7381e6610 con 0x7ff73815dc60 2024-09-11T23:20:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7380aed60 con 0x7ff73815dc60 2024-09-11T23:20:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff726ffd640 1 -- 172.21.15.94:0/753729428 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff72c0b5070 con 0x7ff73815dc60 2024-09-11T23:20:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.812+0000 7ff726ffd640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7180678c0 0x7ff718069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.816+0000 7ff726ffd640 1 -- 172.21.15.94:0/753729428 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7ff72c11f230 con 0x7ff73815dc60 2024-09-11T23:20:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.816+0000 7ff73659c640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7180678c0 0x7ff718069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.816+0000 7ff73659c640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7180678c0 0x7ff718069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff7280016e0 tx=0x7ff728009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.820+0000 7ff726ffd640 1 -- 172.21.15.94:0/753729428 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff72c016760 con 0x7ff73815dc60 2024-09-11T23:20:47.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.968+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff73815c680 con 0x7ff7180678c0 2024-09-11T23:20:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.968+0000 7ff726ffd640 1 -- 172.21.15.94:0/753729428 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff73815c680 con 0x7ff7180678c0 2024-09-11T23:20:47.971 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T23:20:47.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7180678c0 msgr2=0x7ff718069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7180678c0 0x7ff718069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff7280016e0 tx=0x7ff728009040 comp rx=0 tx=0).stop 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff73815dc60 msgr2=0x7ff73815f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff73815dc60 0x7ff73815f520 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff72c01c880 tx=0x7ff720005840 comp rx=0 tx=0).stop 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 shutdown_connections 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7381f1f70 0x7ff7380cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7ff7180678c0 0x7ff718069d80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff73815dc60 0x7ff73815f520 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 --2- 172.21.15.94:0/753729428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff720004810 0x7ff738143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 >> 172.21.15.94:0/753729428 conn(0x7ff7380b1f90 msgr2=0x7ff738159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 shutdown_connections 2024-09-11T23:20:47.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:47.972+0000 7ff73cba9640 1 -- 172.21.15.94:0/753729428 wait complete. 2024-09-11T23:20:47.988 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T23:20:47.989 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:48.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877be46640 1 Processor -- start 2024-09-11T23:20:48.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877be46640 1 -- start start 2024-09-11T23:20:48.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877be46640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 0x7f877415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877be46640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87740aede0 con 0x7f877415f1d0 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877be46640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877415fa10 con 0x7f87741520a0 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877be46640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8774152480 con 0x7f8774070020 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877a3e3640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f877415f1d0 0x7f87740adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41990/0 (socket says 172.21.15.94:41990) 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.104+0000 7f877a3e3640 1 -- 172.21.15.94:0/2793620836 learned_addr learned my addr 172.21.15.94:0/2793620836 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 0x7f877415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283592162 0 0) 0x7f87740aede0 con 0x7f877415f1d0 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8760003530 con 0x7f877415f1d0 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2174108237 0 0) 0x7f8760003530 con 0x7f877415f1d0 2024-09-11T23:20:48.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 msgr2=0x7f877415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 0x7f877415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 >> v1:172.21.15.155:6789/0 conn(0x7f87741520a0 legacy=0x7f877406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8774074250 con 0x7f877415f1d0 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f876c001a00 con 0x7f877415f1d0 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 >> v1:172.21.15.94:6789/0 conn(0x7f877415f1d0 legacy=0x7f87740adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 0x7f87600039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8760003f30 0x7f8760004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760004d50 0x7f87600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f876000ba00 con 0x7f8760003f30 2024-09-11T23:20:48.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f876000bbb0 con 0x7f8760004d50 2024-09-11T23:20:48.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f876000bdb0 con 0x7f8774070020 2024-09-11T23:20:48.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8760003f30 0x7f8760004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8779be2640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 0x7f87600039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877a3e3640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760004d50 0x7f87600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 -- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 msgr2=0x7f87600039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8774070020 0x7f87600039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 -- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760004d50 msgr2=0x7f87600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760004d50 0x7f87600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 -- 172.21.15.94:0/2793620836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8760003530 con 0x7f8760003f30 2024-09-11T23:20:48.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f87793e1640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8760003f30 0x7f8760004810 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f8764009ab0 tx=0x7f876401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21644927f86d0177 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640b2070 con 0x7f8760003f30 2024-09-11T23:20:48.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87640a5580 con 0x7f8760003f30 2024-09-11T23:20:48.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f8778be0640 1 -- 172.21.15.94:0/2793620836 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640096b0 con 0x7f8760003f30 2024-09-11T23:20:48.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877be46640 1 -- 172.21.15.94:0/2793620836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8760003f30 msgr2=0x7f8760004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877be46640 1 --2- 172.21.15.94:0/2793620836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8760003f30 0x7f8760004810 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f8764009ab0 tx=0x7f876401c990 comp rx=0 tx=0).stop 2024-09-11T23:20:48.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877a3e3640 1 -- 172.21.15.94:0/2793620836 reap_dead start 2024-09-11T23:20:48.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877be46640 1 -- 172.21.15.94:0/2793620836 shutdown_connections 2024-09-11T23:20:48.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877be46640 1 -- 172.21.15.94:0/2793620836 >> 172.21.15.94:0/2793620836 conn(0x7f87740b1f90 msgr2=0x7f87740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877be46640 1 -- 172.21.15.94:0/2793620836 shutdown_connections 2024-09-11T23:20:48.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.108+0000 7f877be46640 1 -- 172.21.15.94:0/2793620836 wait complete. 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 Processor -- start 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 -- start start 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760003f30 0x7f87740cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f877409df10 0x7f877409b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877414ecd0 0x7f8774154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8774073a50 con 0x7f877409df10 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8774073770 con 0x7f8760003f30 2024-09-11T23:20:48.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8774073d30 con 0x7f877414ecd0 2024-09-11T23:20:48.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f877409df10 0x7f877409b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f877409df10 0x7f877409b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53948/0 (socket says 172.21.15.94:53948) 2024-09-11T23:20:48.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 -- 172.21.15.94:0/2932018345 learned_addr learned my addr 172.21.15.94:0/2932018345 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:48.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877a3e3640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877414ecd0 0x7f8774154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f8779be2640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760003f30 0x7f87740cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 -- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877414ecd0 msgr2=0x7f8774154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877414ecd0 0x7f8774154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 -- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760003f30 msgr2=0x7f87740cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8760003f30 0x7f87740cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 -- 172.21.15.94:0/2932018345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87741526d0 con 0x7f877409df10 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f87793e1640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f877409df10 0x7f877409b040 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8764009ab0 tx=0x7f8760005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640b2040 con 0x7f877409df10 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87640a5d30 con 0x7f877409df10 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87741529b0 con 0x7f877409df10 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640ad640 con 0x7f877409df10 2024-09-11T23:20:48.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8774152f70 con 0x7f877409df10 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8774152480 con 0x7f877409df10 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.112+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87640ad7e0 con 0x7f877409df10 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f876a7fc640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87580678f0 0x7f8758069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f8764120be0 con 0x7f877409df10 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f876a7fc640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f875806dd90 0x7f87580701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 --> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f876400e020 con 0x7f875806dd90 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f8764121070 con 0x7f877409df10 2024-09-11T23:20:48.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f8779be2640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87580678f0 0x7f8758069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f877a3e3640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f875806dd90 0x7f87580701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f8779be2640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87580678f0 0x7f8758069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8770007ad0 tx=0x7f8770007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f877a3e3640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f875806dd90 0x7f87580701d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.116+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== osd.5 v2:172.21.15.155:6800/1079669988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f876400e020 con 0x7f875806dd90 2024-09-11T23:20:48.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 --> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f877415f680 con 0x7f875806dd90 2024-09-11T23:20:48.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f876a7fc640 1 -- 172.21.15.94:0/2932018345 <== osd.5 v2:172.21.15.155:6800/1079669988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f877415f680 con 0x7f875806dd90 2024-09-11T23:20:48.133 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:48.133 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:48.133 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:48.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f875806dd90 msgr2=0x7f87580701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6800/1079669988,v1:172.21.15.155:6801/1079669988] conn(0x7f875806dd90 0x7f87580701d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87580678f0 msgr2=0x7f8758069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f87580678f0 0x7f8758069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8770007ad0 tx=0x7f8770007a60 comp rx=0 tx=0).stop 2024-09-11T23:20:48.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f877409df10 msgr2=0x7f877409b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 --2- 172.21.15.94:0/2932018345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f877409df10 0x7f877409b040 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8764009ab0 tx=0x7f8760005840 comp rx=0 tx=0).stop 2024-09-11T23:20:48.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877a3e3640 1 -- 172.21.15.94:0/2932018345 reap_dead start 2024-09-11T23:20:48.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 shutdown_connections 2024-09-11T23:20:48.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 >> 172.21.15.94:0/2932018345 conn(0x7f87740b1f90 msgr2=0x7f87740ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 shutdown_connections 2024-09-11T23:20:48.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.132+0000 7f877be46640 1 -- 172.21.15.94:0/2932018345 wait complete. 2024-09-11T23:20:48.148 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T23:20:48.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afc565640 1 Processor -- start 2024-09-11T23:20:48.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afc565640 1 -- start start 2024-09-11T23:20:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afc565640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2af41587a0 0x7f2af40b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afc565640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2af40b37d0 0x7f2af406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afc565640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af406ec60 con 0x7f2af406e4b0 2024-09-11T23:20:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afc565640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2af40b3c40 con 0x7f2af41587a0 2024-09-11T23:20:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afc565640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2af406f870 con 0x7f2af40b37d0 2024-09-11T23:20:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afa301640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2af41587a0 0x7f2af40b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afab02640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2af406e4b0 0x7f2af4161e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42000/0 (socket says 172.21.15.94:42000) 2024-09-11T23:20:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afab02640 1 -- 172.21.15.94:0/4043117595 learned_addr learned my addr 172.21.15.94:0/4043117595 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2af9b00640 1 --2- 172.21.15.94:0/4043117595 >> v2:172.21.15.155:3300/0 conn(0x7f2af40b37d0 0x7f2af406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afa301640 1 -- 172.21.15.94:0/4043117595 >> v2:172.21.15.155:3300/0 conn(0x7f2af40b37d0 msgr2=0x7f2af406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afa301640 1 --2- 172.21.15.94:0/4043117595 >> v2:172.21.15.155:3300/0 conn(0x7f2af40b37d0 0x7f2af406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afa301640 1 -- 172.21.15.94:0/4043117595 >> v1:172.21.15.94:6789/0 conn(0x7f2af406e4b0 legacy=0x7f2af4161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2afa301640 1 -- 172.21.15.94:0/4043117595 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af406ef40 con 0x7f2af41587a0 2024-09-11T23:20:48.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.252+0000 7f2af92ff640 1 -- 172.21.15.94:0/4043117595 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841107966 0 0) 0x7f2af406ec60 con 0x7f2af406e4b0 2024-09-11T23:20:48.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afa301640 1 --2- 172.21.15.94:0/4043117595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af41587a0 0x7f2af40b3290 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f2af4161d90 tx=0x7f2af001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34b090db958e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2af92ff640 1 -- 172.21.15.94:0/4043117595 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af00b0070 con 0x7f2af41587a0 2024-09-11T23:20:48.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2af92ff640 1 -- 172.21.15.94:0/4043117595 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af00ab600 con 0x7f2af41587a0 2024-09-11T23:20:48.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2af92ff640 1 -- 172.21.15.94:0/4043117595 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af00ab9d0 con 0x7f2af41587a0 2024-09-11T23:20:48.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 -- 172.21.15.94:0/4043117595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af41587a0 msgr2=0x7f2af40b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 --2- 172.21.15.94:0/4043117595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af41587a0 0x7f2af40b3290 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f2af4161d90 tx=0x7f2af001c450 comp rx=0 tx=0).stop 2024-09-11T23:20:48.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 -- 172.21.15.94:0/4043117595 shutdown_connections 2024-09-11T23:20:48.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 --2- 172.21.15.94:0/4043117595 >> v2:172.21.15.155:3300/0 conn(0x7f2af40b37d0 0x7f2af406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 --2- 172.21.15.94:0/4043117595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af41587a0 0x7f2af40b3290 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 -- 172.21.15.94:0/4043117595 >> 172.21.15.94:0/4043117595 conn(0x7f2af40b1f90 msgr2=0x7f2af40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 -- 172.21.15.94:0/4043117595 shutdown_connections 2024-09-11T23:20:48.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.256+0000 7f2afc565640 1 -- 172.21.15.94:0/4043117595 wait complete. 2024-09-11T23:20:48.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 Processor -- start 2024-09-11T23:20:48.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 -- start start 2024-09-11T23:20:48.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af406e4b0 0x7f2af4146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af40b37d0 0x7f2af414ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af41587a0 0x7f2af414d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2af4158b80 con 0x7f2af40b37d0 2024-09-11T23:20:48.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2af4073170 con 0x7f2af406e4b0 2024-09-11T23:20:48.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2af4147120 con 0x7f2af41587a0 2024-09-11T23:20:48.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af40b37d0 0x7f2af414ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af40b37d0 0x7f2af414ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53958/0 (socket says 172.21.15.94:53958) 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 -- 172.21.15.94:0/2045902761 learned_addr learned my addr 172.21.15.94:0/2045902761 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afa301640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af406e4b0 0x7f2af4146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 -- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af41587a0 msgr2=0x7f2af414d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af41587a0 0x7f2af414d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 -- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af406e4b0 msgr2=0x7f2af4146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af406e4b0 0x7f2af4146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 -- 172.21.15.94:0/2045902761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af414eb50 con 0x7f2af40b37d0 2024-09-11T23:20:48.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2af9b00640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af40b37d0 0x7f2af414ce80 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400d800 tx=0x7f2ae400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2aeaffd640 1 -- 172.21.15.94:0/2045902761 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400b6c0 con 0x7f2af40b37d0 2024-09-11T23:20:48.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2aeaffd640 1 -- 172.21.15.94:0/2045902761 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae4019070 con 0x7f2af40b37d0 2024-09-11T23:20:48.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af414ee30 con 0x7f2af40b37d0 2024-09-11T23:20:48.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2aeaffd640 1 -- 172.21.15.94:0/2045902761 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400ba60 con 0x7f2af40b37d0 2024-09-11T23:20:48.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af414dfe0 con 0x7f2af40b37d0 2024-09-11T23:20:48.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af414f000 con 0x7f2af40b37d0 2024-09-11T23:20:48.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2aeaffd640 1 -- 172.21.15.94:0/2045902761 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ae400bc00 con 0x7f2af40b37d0 2024-09-11T23:20:48.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2aeaffd640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ad80678c0 0x7f2ad8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.260+0000 7f2aeaffd640 1 -- 172.21.15.94:0/2045902761 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f2ae4086010 con 0x7f2af40b37d0 2024-09-11T23:20:48.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.264+0000 7f2afa301640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ad80678c0 0x7f2ad8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.264+0000 7f2afa301640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ad80678c0 0x7f2ad8069d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2af00ad000 tx=0x7f2af00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.268+0000 7f2aeaffd640 1 -- 172.21.15.94:0/2045902761 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ae4056cc0 con 0x7f2af40b37d0 2024-09-11T23:20:48.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.416+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f2af4070080 con 0x7f2ad80678c0 2024-09-11T23:20:48.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.416+0000 7f2aeaffd640 1 -- 172.21.15.94:0/2045902761 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2af4070080 con 0x7f2ad80678c0 2024-09-11T23:20:48.419 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T23:20:48.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ad80678c0 msgr2=0x7f2ad8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ad80678c0 0x7f2ad8069d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2af00ad000 tx=0x7f2af00a6000 comp rx=0 tx=0).stop 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af40b37d0 msgr2=0x7f2af414ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af40b37d0 0x7f2af414ce80 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400d800 tx=0x7f2ae400dcc0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 shutdown_connections 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af41587a0 0x7f2af414d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f2ad80678c0 0x7f2ad8069d80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2af40b37d0 0x7f2af414ce80 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 --2- 172.21.15.94:0/2045902761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af406e4b0 0x7f2af4146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 >> 172.21.15.94:0/2045902761 conn(0x7f2af40b1f90 msgr2=0x7f2af40b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 shutdown_connections 2024-09-11T23:20:48.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.420+0000 7f2afc565640 1 -- 172.21.15.94:0/2045902761 wait complete. 2024-09-11T23:20:48.436 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T23:20:48.437 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:48.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f492a93b640 1 Processor -- start 2024-09-11T23:20:48.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f492a93b640 1 -- start start 2024-09-11T23:20:48.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f492a93b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4924070020 0x7f492415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f492a93b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f492415f1d0 0x7f49240adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f492a93b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49240aede0 con 0x7f49241520a0 2024-09-11T23:20:48.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f492a93b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4924152480 con 0x7f492415f1d0 2024-09-11T23:20:48.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f492a93b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f492415fa10 con 0x7f4924070020 2024-09-11T23:20:48.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f4928ed8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f492415f1d0 0x7f49240adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f4928ed8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f492415f1d0 0x7f49240adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53960/0 (socket says 172.21.15.94:53960) 2024-09-11T23:20:48.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.548+0000 7f4928ed8640 1 -- 172.21.15.94:0/1745822050 learned_addr learned my addr 172.21.15.94:0/1745822050 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:48.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f49237fe640 1 --2- 172.21.15.94:0/1745822050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4924070020 0x7f492415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4928ed8640 1 -- 172.21.15.94:0/1745822050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4924070020 msgr2=0x7f492415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4928ed8640 1 --2- 172.21.15.94:0/1745822050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4924070020 0x7f492415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4928ed8640 1 -- 172.21.15.94:0/1745822050 >> v1:172.21.15.155:6789/0 conn(0x7f49241520a0 legacy=0x7f492406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4928ed8640 1 -- 172.21.15.94:0/1745822050 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4924074250 con 0x7f492415f1d0 2024-09-11T23:20:48.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4928ed8640 1 --2- 172.21.15.94:0/1745822050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f492415f1d0 0x7f49240adc80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f491c009e80 tx=0x7f491c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc025147885ec32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4922ffd640 1 -- 172.21.15.94:0/1745822050 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a5820 con 0x7f492415f1d0 2024-09-11T23:20:48.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4922ffd640 1 -- 172.21.15.94:0/1745822050 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491c0a59c0 con 0x7f492415f1d0 2024-09-11T23:20:48.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f4922ffd640 1 -- 172.21.15.94:0/1745822050 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a5d90 con 0x7f492415f1d0 2024-09-11T23:20:48.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 -- 172.21.15.94:0/1745822050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f492415f1d0 msgr2=0x7f49240adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 --2- 172.21.15.94:0/1745822050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f492415f1d0 0x7f49240adc80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f491c009e80 tx=0x7f491c01c9a0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 -- 172.21.15.94:0/1745822050 shutdown_connections 2024-09-11T23:20:48.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 --2- 172.21.15.94:0/1745822050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f492415f1d0 0x7f49240adc80 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 --2- 172.21.15.94:0/1745822050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4924070020 0x7f492415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 -- 172.21.15.94:0/1745822050 >> 172.21.15.94:0/1745822050 conn(0x7f49240b1f90 msgr2=0x7f49240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 -- 172.21.15.94:0/1745822050 shutdown_connections 2024-09-11T23:20:48.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.552+0000 7f492a93b640 1 -- 172.21.15.94:0/1745822050 wait complete. 2024-09-11T23:20:48.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 Processor -- start 2024-09-11T23:20:48.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 -- start start 2024-09-11T23:20:48.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4924070020 0x7f492415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49241520a0 0x7f4924146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f492415f1d0 0x7f4924148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f492415f680 con 0x7f49241520a0 2024-09-11T23:20:48.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4924073d30 con 0x7f4924070020 2024-09-11T23:20:48.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4924167f10 con 0x7f492415f1d0 2024-09-11T23:20:48.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49241520a0 0x7f4924146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49241520a0 0x7f4924146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53966/0 (socket says 172.21.15.94:53966) 2024-09-11T23:20:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 -- 172.21.15.94:0/3468976733 learned_addr learned my addr 172.21.15.94:0/3468976733 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4928ed8640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f492415f1d0 0x7f4924148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4923fff640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4924070020 0x7f492415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 -- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f492415f1d0 msgr2=0x7f4924148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f492415f1d0 0x7f4924148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 -- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4924070020 msgr2=0x7f492415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4924070020 0x7f492415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 -- 172.21.15.94:0/3468976733 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49241482c0 con 0x7f49241520a0 2024-09-11T23:20:48.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4923fff640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4924070020 0x7f492415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:48.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4928ed8640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f492415f1d0 0x7f4924148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:48.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f49237fe640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49241520a0 0x7f4924146690 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f491800d600 tx=0x7f491800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918004240 con 0x7f49241520a0 2024-09-11T23:20:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49180043e0 con 0x7f49241520a0 2024-09-11T23:20:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49241485a0 con 0x7f49241520a0 2024-09-11T23:20:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918003840 con 0x7f49241520a0 2024-09-11T23:20:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4924146bd0 con 0x7f49241520a0 2024-09-11T23:20:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f492415ec90 con 0x7f49241520a0 2024-09-11T23:20:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49180039e0 con 0x7f49241520a0 2024-09-11T23:20:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49100678c0 0x7f4910069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f4918086840 con 0x7f49241520a0 2024-09-11T23:20:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7f491006dd60 0x7f49100701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 --> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f491800af30 con 0x7f491006dd60 2024-09-11T23:20:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f4918086cd0 con 0x7f49241520a0 2024-09-11T23:20:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.556+0000 7f4923fff640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49100678c0 0x7f4910069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.560+0000 7f4928ed8640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7f491006dd60 0x7f49100701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.560+0000 7f4923fff640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49100678c0 0x7f4910069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4914003e40 tx=0x7f4914009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.560+0000 7f4928ed8640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7f491006dd60 0x7f49100701a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.560+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== osd.6 v2:172.21.15.155:6808/1080635284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f491800af30 con 0x7f491006dd60 2024-09-11T23:20:48.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.572+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 --> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f492406e540 con 0x7f491006dd60 2024-09-11T23:20:48.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.572+0000 7f4920ff9640 1 -- 172.21.15.94:0/3468976733 <== osd.6 v2:172.21.15.155:6808/1080635284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f492406e540 con 0x7f491006dd60 2024-09-11T23:20:48.576 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:48.576 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:48.576 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:48.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7f491006dd60 msgr2=0x7f49100701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6808/1080635284,v1:172.21.15.155:6809/1080635284] conn(0x7f491006dd60 0x7f49100701a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49100678c0 msgr2=0x7f4910069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f49100678c0 0x7f4910069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4914003e40 tx=0x7f4914009040 comp rx=0 tx=0).stop 2024-09-11T23:20:48.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49241520a0 msgr2=0x7f4924146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 --2- 172.21.15.94:0/3468976733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49241520a0 0x7f4924146690 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f491800d600 tx=0x7f491800dac0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f4928ed8640 1 -- 172.21.15.94:0/3468976733 reap_dead start 2024-09-11T23:20:48.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 shutdown_connections 2024-09-11T23:20:48.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 >> 172.21.15.94:0/3468976733 conn(0x7f49240b1f90 msgr2=0x7f492406ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 shutdown_connections 2024-09-11T23:20:48.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.576+0000 7f492a93b640 1 -- 172.21.15.94:0/3468976733 wait complete. 2024-09-11T23:20:48.590 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T23:20:48.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac854d640 1 Processor -- start 2024-09-11T23:20:48.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac854d640 1 -- start start 2024-09-11T23:20:48.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac854d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac015c2a0 0x7f4ac00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac854d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac00b3290 con 0x7f4ac015bec0 2024-09-11T23:20:48.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac854d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac00b3570 con 0x7f4ac00af2a0 2024-09-11T23:20:48.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac854d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00b3850 con 0x7f4ac015c2a0 2024-09-11T23:20:48.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac62e9640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4ac015bec0 0x7f4ac00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42014/0 (socket says 172.21.15.94:42014) 2024-09-11T23:20:48.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac62e9640 1 -- 172.21.15.94:0/2447485256 learned_addr learned my addr 172.21.15.94:0/2447485256 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:48.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac015c2a0 0x7f4ac00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668602832 0 0) 0x7f4ac00b3290 con 0x7f4ac015bec0 2024-09-11T23:20:48.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aac003530 con 0x7f4ac015bec0 2024-09-11T23:20:48.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1577360577 0 0) 0x7f4aac003530 con 0x7f4ac015bec0 2024-09-11T23:20:48.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac015c2a0 msgr2=0x7f4ac00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac015c2a0 0x7f4ac00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 >> v1:172.21.15.155:6789/0 conn(0x7f4ac00af2a0 legacy=0x7f4ac006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00b3b30 con 0x7f4ac015bec0 2024-09-11T23:20:48.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f4ab0001680 con 0x7f4ac015bec0 2024-09-11T23:20:48.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 >> v1:172.21.15.94:6789/0 conn(0x7f4ac015bec0 legacy=0x7f4ac00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac015c2a0 0x7f4aac0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aac003f70 0x7f4aac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4aac004d50 0x7f4aac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00b3850 con 0x7f4aac003f70 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac00bab0 con 0x7f4aac004d50 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac00bcb0 con 0x7f4ac015c2a0 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aac003f70 0x7f4aac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac5ae8640 1 -- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac015c2a0 msgr2=0x7f4aac0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac015c2a0 0x7f4aac0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac6aea640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4aac004d50 0x7f4aac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac5ae8640 1 -- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4aac004d50 msgr2=0x7f4aac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4aac004d50 0x7f4aac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac5ae8640 1 -- 172.21.15.94:0/2447485256 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac003530 con 0x7f4aac003f70 2024-09-11T23:20:48.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.696+0000 7f4ac6aea640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4aac004d50 0x7f4aac0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:48.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aac003f70 0x7f4aac004810 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009ae0 tx=0x7f4abc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4ae4000c539d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0b2070 con 0x7f4aac003f70 2024-09-11T23:20:48.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc0a56a0 con 0x7f4aac003f70 2024-09-11T23:20:48.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac52e7640 1 -- 172.21.15.94:0/2447485256 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0096b0 con 0x7f4aac003f70 2024-09-11T23:20:48.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- 172.21.15.94:0/2447485256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aac003f70 msgr2=0x7f4aac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 --2- 172.21.15.94:0/2447485256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aac003f70 0x7f4aac004810 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009ae0 tx=0x7f4abc01cab0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac6aea640 1 -- 172.21.15.94:0/2447485256 reap_dead start 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- 172.21.15.94:0/2447485256 shutdown_connections 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- 172.21.15.94:0/2447485256 >> 172.21.15.94:0/2447485256 conn(0x7f4ac00b1f90 msgr2=0x7f4ac00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- 172.21.15.94:0/2447485256 shutdown_connections 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- 172.21.15.94:0/2447485256 wait complete. 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 Processor -- start 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- start start 2024-09-11T23:20:48.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac0156a40 0x7f4ac00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ac00b0e90 0x7f4ac01f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ac01f65f0 0x7f4ac015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00af730 con 0x7f4ac00b0e90 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00b40f0 con 0x7f4ac01f65f0 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac854d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00afc90 con 0x7f4ac0156a40 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac5ae8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ac00b0e90 0x7f4ac01f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac5ae8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ac00b0e90 0x7f4ac01f60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:53990/0 (socket says 172.21.15.94:53990) 2024-09-11T23:20:48.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.700+0000 7f4ac5ae8640 1 -- 172.21.15.94:0/3970694851 learned_addr learned my addr 172.21.15.94:0/3970694851 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac6aea640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ac01f65f0 0x7f4ac015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac62e9640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac0156a40 0x7f4ac00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac5ae8640 1 -- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac0156a40 msgr2=0x7f4ac00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac0156a40 0x7f4ac00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac5ae8640 1 -- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ac01f65f0 msgr2=0x7f4ac015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ac01f65f0 0x7f4ac015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac5ae8640 1 -- 172.21.15.94:0/3970694851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac01f6e00 con 0x7f4ac00b0e90 2024-09-11T23:20:48.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac6aea640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ac01f65f0 0x7f4ac015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac62e9640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac0156a40 0x7f4ac00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac5ae8640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ac00b0e90 0x7f4ac01f60b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0b0040 tx=0x7f4abc019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ab6ffd640 1 -- 172.21.15.94:0/3970694851 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0ba070 con 0x7f4ac00b0e90 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ab6ffd640 1 -- 172.21.15.94:0/3970694851 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc004020 con 0x7f4ac00b0e90 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac01f2a80 con 0x7f4ac00b0e90 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ab6ffd640 1 -- 172.21.15.94:0/3970694851 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0b2040 con 0x7f4ac00b0e90 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac01f3040 con 0x7f4ac00b0e90 2024-09-11T23:20:48.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac00b1310 con 0x7f4ac00b0e90 2024-09-11T23:20:48.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ab6ffd640 1 -- 172.21.15.94:0/3970694851 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4abc0bd070 con 0x7f4ac00b0e90 2024-09-11T23:20:48.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ab6ffd640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4aa40678f0 0x7f4aa4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ab6ffd640 1 -- 172.21.15.94:0/3970694851 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f4abc11f000 con 0x7f4ac00b0e90 2024-09-11T23:20:48.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac62e9640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4aa40678f0 0x7f4aa4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.704+0000 7f4ac62e9640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4aa40678f0 0x7f4aa4069db0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0004850 tx=0x7f4ab000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.708+0000 7f4ab6ffd640 1 -- 172.21.15.94:0/3970694851 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4abc0167c0 con 0x7f4ac00b0e90 2024-09-11T23:20:48.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f4ac00aed60 con 0x7f4aa40678f0 2024-09-11T23:20:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ab6ffd640 1 -- 172.21.15.94:0/3970694851 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4ac00aed60 con 0x7f4aa40678f0 2024-09-11T23:20:48.861 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T23:20:48.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4aa40678f0 msgr2=0x7f4aa4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4aa40678f0 0x7f4aa4069db0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0004850 tx=0x7f4ab000c040 comp rx=0 tx=0).stop 2024-09-11T23:20:48.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ac00b0e90 msgr2=0x7f4ac01f60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ac00b0e90 0x7f4ac01f60b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0b0040 tx=0x7f4abc019850 comp rx=0 tx=0).stop 2024-09-11T23:20:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 shutdown_connections 2024-09-11T23:20:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ac01f65f0 0x7f4ac015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f4aa40678f0 0x7f4aa4069db0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ac00b0e90 0x7f4ac01f60b0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 --2- 172.21.15.94:0/3970694851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ac0156a40 0x7f4ac00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 >> 172.21.15.94:0/3970694851 conn(0x7f4ac00b1f90 msgr2=0x7f4ac00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 shutdown_connections 2024-09-11T23:20:48.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:48.860+0000 7f4ac854d640 1 -- 172.21.15.94:0/3970694851 wait complete. 2024-09-11T23:20:48.878 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T23:20:48.878 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:20:49.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba338f640 1 Processor -- start 2024-09-11T23:20:49.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba338f640 1 -- start start 2024-09-11T23:20:49.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba338f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b9c15e3e0 0x7f7b9c15f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba338f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 0x7f7b9c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba338f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9c0b04a0 con 0x7f7b9c0b3300 2024-09-11T23:20:49.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba338f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7b9c0b0770 con 0x7f7b9c15e3e0 2024-09-11T23:20:49.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba338f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9c0b0a50 con 0x7f7b9c072dd0 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba192c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7b9c0b3300 0x7f7b9c161e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42022/0 (socket says 172.21.15.94:42022) 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.000+0000 7f7ba192c640 1 -- 172.21.15.94:0/1448804551 learned_addr learned my addr 172.21.15.94:0/1448804551 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba112b640 1 --2- 172.21.15.94:0/1448804551 >> v2:172.21.15.155:3300/0 conn(0x7f7b9c15e3e0 0x7f7b9c15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba092a640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 0x7f7b9c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512926726 0 0) 0x7f7b9c0b04a0 con 0x7f7b9c0b3300 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b88003530 con 0x7f7b9c0b3300 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 397132781 0 0) 0x7f7b88003530 con 0x7f7b9c0b3300 2024-09-11T23:20:49.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 msgr2=0x7f7b9c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 0x7f7b9c0aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 >> v2:172.21.15.155:3300/0 conn(0x7f7b9c15e3e0 msgr2=0x7f7b9c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 --2- 172.21.15.94:0/1448804551 >> v2:172.21.15.155:3300/0 conn(0x7f7b9c15e3e0 0x7f7b9c15f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c15eb10 con 0x7f7b9c0b3300 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7f7b94001680 con 0x7f7b9c0b3300 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 >> v1:172.21.15.94:6789/0 conn(0x7f7b9c0b3300 legacy=0x7f7b9c161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 0x7f7b880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b88003f40 0x7f7b88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b88004d50 0x7f7b880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c0b0770 con 0x7f7b88004d50 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c0b0a50 con 0x7f7b88003f40 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8800ba20 con 0x7f7b9c072dd0 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b88004d50 0x7f7b880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba112b640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 0x7f7b880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba092a640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b88003f40 0x7f7b88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 -- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 msgr2=0x7f7b880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c072dd0 0x7f7b880039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 -- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b88003f40 msgr2=0x7f7b88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b88003f40 0x7f7b88004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 -- 172.21.15.94:0/1448804551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b88003530 con 0x7f7b88004d50 2024-09-11T23:20:49.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba092a640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b88003f40 0x7f7b88004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:49.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b88004d50 0x7f7b880051d0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400c210 tx=0x7f7b9401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551bf6e1e96c613a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94007d80 con 0x7f7b88004d50 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b94005b00 con 0x7f7b88004d50 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7b93fff640 1 -- 172.21.15.94:0/1448804551 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94007070 con 0x7f7b88004d50 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba338f640 1 -- 172.21.15.94:0/1448804551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b88004d50 msgr2=0x7f7b880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba338f640 1 --2- 172.21.15.94:0/1448804551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b88004d50 0x7f7b880051d0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400c210 tx=0x7f7b9401f3f0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.004+0000 7f7ba192c640 1 -- 172.21.15.94:0/1448804551 reap_dead start 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- 172.21.15.94:0/1448804551 shutdown_connections 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- 172.21.15.94:0/1448804551 >> 172.21.15.94:0/1448804551 conn(0x7f7b9c0b6870 msgr2=0x7f7b9c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- 172.21.15.94:0/1448804551 shutdown_connections 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- 172.21.15.94:0/1448804551 wait complete. 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 Processor -- start 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- start start 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c14aab0 0x7f7b9c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b9c1f4d40 0x7f7b9c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b9c0b6010 0x7f7b9c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c0aff60 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c15e7c0 con 0x7f7b9c0b6010 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9c0b00e0 con 0x7f7b9c14aab0 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b9c1f4d40 0x7f7b9c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b9c1f4d40 0x7f7b9c0b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54006/0 (socket says 172.21.15.94:54006) 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 -- 172.21.15.94:0/2099188765 learned_addr learned my addr 172.21.15.94:0/2099188765 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba112b640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c14aab0 0x7f7b9c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba192c640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b9c0b6010 0x7f7b9c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 -- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c14aab0 msgr2=0x7f7b9c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b9c14aab0 0x7f7b9c15c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 -- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b9c0b6010 msgr2=0x7f7b9c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b9c0b6010 0x7f7b9c15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 -- 172.21.15.94:0/2099188765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c15cd10 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba092a640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b9c1f4d40 0x7f7b9c0b5ad0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0108c0 tx=0x7f7b8c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00f040 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c004220 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9c154830 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00e900 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9c154df0 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.008+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b9c0b0430 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b8c00eaa0 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7b91ffb640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7b800678c0 0x7f7b80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f7b8c086390 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7b91ffb640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f7b8006dd60 0x7f7b800701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 --> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b8c010040 con 0x7f7b8006dd60 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f7b8c086820 con 0x7f7b9c1f4d40 2024-09-11T23:20:49.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7ba112b640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7b800678c0 0x7f7b80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7ba192c640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f7b8006dd60 0x7f7b800701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7ba112b640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7b800678c0 0x7f7b80069d80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b98007520 tx=0x7f7b9800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7ba192c640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f7b8006dd60 0x7f7b800701a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.012+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== osd.7 v2:172.21.15.155:6816/4208392943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b8c010040 con 0x7f7b8006dd60 2024-09-11T23:20:49.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 --> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7b9c15a620 con 0x7f7b8006dd60 2024-09-11T23:20:49.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7b91ffb640 1 -- 172.21.15.94:0/2099188765 <== osd.7 v2:172.21.15.155:6816/4208392943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7b9c15a620 con 0x7f7b8006dd60 2024-09-11T23:20:49.029 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-11T23:20:49.029 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:20:49.030 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-11T23:20:49.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f7b8006dd60 msgr2=0x7f7b800701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6816/4208392943,v1:172.21.15.155:6818/4208392943] conn(0x7f7b8006dd60 0x7f7b800701a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7b800678c0 msgr2=0x7f7b80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f7b800678c0 0x7f7b80069d80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b98007520 tx=0x7f7b9800b040 comp rx=0 tx=0).stop 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b9c1f4d40 msgr2=0x7f7b9c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 --2- 172.21.15.94:0/2099188765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b9c1f4d40 0x7f7b9c0b5ad0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0108c0 tx=0x7f7b8c010d80 comp rx=0 tx=0).stop 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba192c640 1 -- 172.21.15.94:0/2099188765 reap_dead start 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 shutdown_connections 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 >> 172.21.15.94:0/2099188765 conn(0x7f7b9c0b6870 msgr2=0x7f7b9c0b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 shutdown_connections 2024-09-11T23:20:49.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.028+0000 7f7ba338f640 1 -- 172.21.15.94:0/2099188765 wait complete. 2024-09-11T23:20:49.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T23:20:49.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efeea4e9640 1 Processor -- start 2024-09-11T23:20:49.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efeea4e9640 1 -- start start 2024-09-11T23:20:49.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efeea4e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 0x7efee406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efeea4e9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4070250 con 0x7efee415f3a0 2024-09-11T23:20:49.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efeea4e9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee40aede0 con 0x7efee406fe50 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efeea4e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efee4152480 con 0x7efee41520a0 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee8a86640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7efee415f3a0 0x7efee40adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42036/0 (socket says 172.21.15.94:42036) 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee8a86640 1 -- 172.21.15.94:0/2165425358 learned_addr learned my addr 172.21.15.94:0/2165425358 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee3fff640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 0x7efee406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972521811 0 0) 0x7efee4070250 con 0x7efee415f3a0 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc003530 con 0x7efee415f3a0 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3801452928 0 0) 0x7efecc003530 con 0x7efee415f3a0 2024-09-11T23:20:49.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 msgr2=0x7efee406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 0x7efee406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 >> v1:172.21.15.155:6789/0 conn(0x7efee406fe50 legacy=0x7efee415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee415fa10 con 0x7efee415f3a0 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2534677856 0 0) 0x7efedc001a00 con 0x7efee415f3a0 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 >> v1:172.21.15.94:6789/0 conn(0x7efee415f3a0 legacy=0x7efee40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 0x7efecc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efecc003f70 0x7efecc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc004d50 0x7efecc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efecc00ba80 con 0x7efecc003f70 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efecc00bc30 con 0x7efecc004d50 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efecc00be30 con 0x7efee41520a0 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee37fe640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efecc003f70 0x7efecc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee3fff640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 0x7efecc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee8a86640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc004d50 0x7efecc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee37fe640 1 -- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 msgr2=0x7efecc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee37fe640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efee41520a0 0x7efecc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee37fe640 1 -- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc004d50 msgr2=0x7efecc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee37fe640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc004d50 0x7efecc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.160+0000 7efee37fe640 1 -- 172.21.15.94:0/2165425358 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc003530 con 0x7efecc003f70 2024-09-11T23:20:49.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efee37fe640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efecc003f70 0x7efecc004810 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7efed4001360 tx=0x7efed401e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60777ceb07780820 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed40b2070 con 0x7efecc003f70 2024-09-11T23:20:49.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed40052f0 con 0x7efecc003f70 2024-09-11T23:20:49.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efee2ffd640 1 -- 172.21.15.94:0/2165425358 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed40013a0 con 0x7efecc003f70 2024-09-11T23:20:49.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 -- 172.21.15.94:0/2165425358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efecc003f70 msgr2=0x7efecc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 --2- 172.21.15.94:0/2165425358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efecc003f70 0x7efecc004810 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7efed4001360 tx=0x7efed401e610 comp rx=0 tx=0).stop 2024-09-11T23:20:49.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efee8a86640 1 -- 172.21.15.94:0/2165425358 reap_dead start 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 -- 172.21.15.94:0/2165425358 shutdown_connections 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 -- 172.21.15.94:0/2165425358 >> 172.21.15.94:0/2165425358 conn(0x7efee40b1f90 msgr2=0x7efee40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 -- 172.21.15.94:0/2165425358 shutdown_connections 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 -- 172.21.15.94:0/2165425358 wait complete. 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 Processor -- start 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.164+0000 7efeea4e9640 1 -- start start 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc003f70 0x7efee415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efee414f3d0 0x7efee4149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efee40b3810 0x7efee40b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efee4073770 con 0x7efee40b3810 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efee4073490 con 0x7efee414f3d0 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efee4073a50 con 0x7efecc003f70 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efee40b3810 0x7efee40b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efee40b3810 0x7efee40b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54034/0 (socket says 172.21.15.94:54034) 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 -- 172.21.15.94:0/19814042 learned_addr learned my addr 172.21.15.94:0/19814042 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee3fff640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc003f70 0x7efee415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee37fe640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efee414f3d0 0x7efee4149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 -- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc003f70 msgr2=0x7efee415d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc003f70 0x7efee415d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 -- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efee414f3d0 msgr2=0x7efee4149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efee414f3d0 0x7efee4149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 -- 172.21.15.94:0/19814042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee415dc70 con 0x7efee40b3810 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee37fe640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efee414f3d0 0x7efee4149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee8a86640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efee40b3810 0x7efee40b3cc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7efee4071790 tx=0x7efedc011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee0ff9640 1 -- 172.21.15.94:0/19814042 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc010040 con 0x7efee40b3810 2024-09-11T23:20:49.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee0ff9640 1 -- 172.21.15.94:0/19814042 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc01a070 con 0x7efee40b3810 2024-09-11T23:20:49.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee40ccd50 con 0x7efee40b3810 2024-09-11T23:20:49.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee0ff9640 1 -- 172.21.15.94:0/19814042 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc00fb60 con 0x7efee40b3810 2024-09-11T23:20:49.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee40cd310 con 0x7efee40b3810 2024-09-11T23:20:49.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee4073d30 con 0x7efee40b3810 2024-09-11T23:20:49.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee0ff9640 1 -- 172.21.15.94:0/19814042 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efedc00fd00 con 0x7efee40b3810 2024-09-11T23:20:49.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee0ff9640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efed00678c0 0x7efed0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee0ff9640 1 -- 172.21.15.94:0/19814042 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7efedc088ae0 con 0x7efee40b3810 2024-09-11T23:20:49.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.168+0000 7efee3fff640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efed00678c0 0x7efed0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.172+0000 7efee3fff640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efed00678c0 0x7efed0069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efee415c700 tx=0x7efed8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.172+0000 7efee0ff9640 1 -- 172.21.15.94:0/19814042 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efedc059790 con 0x7efee40b3810 2024-09-11T23:20:49.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.340+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7efee406e540 con 0x7efed00678c0 2024-09-11T23:20:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.340+0000 7efee0ff9640 1 -- 172.21.15.94:0/19814042 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efee406e540 con 0x7efed00678c0 2024-09-11T23:20:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T23:20:49.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efed00678c0 msgr2=0x7efed0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efed00678c0 0x7efed0069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efee415c700 tx=0x7efed8008040 comp rx=0 tx=0).stop 2024-09-11T23:20:49.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efee40b3810 msgr2=0x7efee40b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efee40b3810 0x7efee40b3cc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7efee4071790 tx=0x7efedc011ca0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 shutdown_connections 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7efed00678c0 0x7efed0069d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efee40b3810 0x7efee40b3cc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efee414f3d0 0x7efee4149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 --2- 172.21.15.94:0/19814042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc003f70 0x7efee415d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 >> 172.21.15.94:0/19814042 conn(0x7efee40b1f90 msgr2=0x7efee406ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 shutdown_connections 2024-09-11T23:20:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.344+0000 7efeea4e9640 1 -- 172.21.15.94:0/19814042 wait complete. 2024-09-11T23:20:49.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:20:49.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37afad640 1 Processor -- start 2024-09-11T23:20:49.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37afad640 1 -- start start 2024-09-11T23:20:49.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37afad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc37415bec0 0x7fc3740ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37afad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740af470 0x7fc37406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37afad640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3740b3290 con 0x7fc37415c2a0 2024-09-11T23:20:49.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37afad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc3740b3570 con 0x7fc37415bec0 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37afad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc3740b3850 con 0x7fc3740af470 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37954a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740af470 0x7fc37406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37954a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740af470 0x7fc37406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.94:50612/0 (socket says 172.21.15.94:50612) 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37954a640 1 -- 172.21.15.94:0/1284986683 learned_addr learned my addr 172.21.15.94:0/1284986683 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc378d49640 1 --2- 172.21.15.94:0/1284986683 >> v2:172.21.15.155:3300/0 conn(0x7fc37415bec0 0x7fc3740ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37954a640 1 -- 172.21.15.94:0/1284986683 >> v2:172.21.15.155:3300/0 conn(0x7fc37415bec0 msgr2=0x7fc3740ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37954a640 1 --2- 172.21.15.94:0/1284986683 >> v2:172.21.15.155:3300/0 conn(0x7fc37415bec0 0x7fc3740ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37954a640 1 -- 172.21.15.94:0/1284986683 >> v1:172.21.15.155:6789/0 conn(0x7fc37415c2a0 legacy=0x7fc3740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.480+0000 7fc37954a640 1 -- 172.21.15.94:0/1284986683 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3740b3b30 con 0x7fc3740af470 2024-09-11T23:20:49.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37954a640 1 --2- 172.21.15.94:0/1284986683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740af470 0x7fc37406e000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009e50 tx=0x7fc36c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e91f33b65aa1f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc3737fe640 1 -- 172.21.15.94:0/1284986683 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0a5830 con 0x7fc3740af470 2024-09-11T23:20:49.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc3737fe640 1 -- 172.21.15.94:0/1284986683 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c0a59d0 con 0x7fc3740af470 2024-09-11T23:20:49.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc3737fe640 1 -- 172.21.15.94:0/1284986683 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0a5da0 con 0x7fc3740af470 2024-09-11T23:20:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 -- 172.21.15.94:0/1284986683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740af470 msgr2=0x7fc37406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 --2- 172.21.15.94:0/1284986683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740af470 0x7fc37406e000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009e50 tx=0x7fc36c01c970 comp rx=0 tx=0).stop 2024-09-11T23:20:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 -- 172.21.15.94:0/1284986683 shutdown_connections 2024-09-11T23:20:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 --2- 172.21.15.94:0/1284986683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740af470 0x7fc37406e000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 --2- 172.21.15.94:0/1284986683 >> v2:172.21.15.155:3300/0 conn(0x7fc37415bec0 0x7fc3740ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 -- 172.21.15.94:0/1284986683 >> 172.21.15.94:0/1284986683 conn(0x7fc3740b1f90 msgr2=0x7fc3740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 -- 172.21.15.94:0/1284986683 shutdown_connections 2024-09-11T23:20:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 -- 172.21.15.94:0/1284986683 wait complete. 2024-09-11T23:20:49.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 Processor -- start 2024-09-11T23:20:49.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 -- start start 2024-09-11T23:20:49.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.484+0000 7fc37afad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740af470 0x7fc374157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415bec0 0x7fc37414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc37415c2a0 0x7fc374163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc37406ed50 con 0x7fc37415c2a0 2024-09-11T23:20:49.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3740ad740 con 0x7fc3740af470 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc37406eed0 con 0x7fc37415bec0 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc37415c2a0 0x7fc374163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc37415c2a0 0x7fc374163fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54044/0 (socket says 172.21.15.94:54044) 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 -- 172.21.15.94:0/1901949947 learned_addr learned my addr 172.21.15.94:0/1901949947 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc373fff640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415bec0 0x7fc37414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc378d49640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740af470 0x7fc374157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 -- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415bec0 msgr2=0x7fc37414bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415bec0 0x7fc37414bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 -- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740af470 msgr2=0x7fc374157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740af470 0x7fc374157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 -- 172.21.15.94:0/1901949947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc374158190 con 0x7fc37415c2a0 2024-09-11T23:20:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc373fff640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415bec0 0x7fc37414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37954a640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc37415c2a0 0x7fc374163fe0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc36c01a5a0 tx=0x7fc36c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc3717fa640 1 -- 172.21.15.94:0/1901949947 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0bc020 con 0x7fc37415c2a0 2024-09-11T23:20:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc3717fa640 1 -- 172.21.15.94:0/1901949947 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c0b8670 con 0x7fc37415c2a0 2024-09-11T23:20:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37415ec60 con 0x7fc37415c2a0 2024-09-11T23:20:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc3717fa640 1 -- 172.21.15.94:0/1901949947 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0b8a40 con 0x7fc37415c2a0 2024-09-11T23:20:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37415f220 con 0x7fc37415c2a0 2024-09-11T23:20:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37406e000 con 0x7fc37415c2a0 2024-09-11T23:20:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc3717fa640 1 -- 172.21.15.94:0/1901949947 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc36c0bf020 con 0x7fc37415c2a0 2024-09-11T23:20:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc3717fa640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3600678c0 0x7fc360069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc3717fa640 1 -- 172.21.15.94:0/1901949947 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fc36c120b50 con 0x7fc37415c2a0 2024-09-11T23:20:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc378d49640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3600678c0 0x7fc360069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.488+0000 7fc378d49640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3600678c0 0x7fc360069d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc368009af0 tx=0x7fc368008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.492+0000 7fc3717fa640 1 -- 172.21.15.94:0/1901949947 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc36c0c6030 con 0x7fc37415c2a0 2024-09-11T23:20:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.652+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc37406fcd0 con 0x7fc3600678c0 2024-09-11T23:20:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc3717fa640 1 -- 172.21.15.94:0/1901949947 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13443 (secure 0 0 0) 0x7fc37406fcd0 con 0x7fc3600678c0 2024-09-11T23:20:49.656 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:20:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:20:49.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3600678c0 msgr2=0x7fc360069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3600678c0 0x7fc360069d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc368009af0 tx=0x7fc368008040 comp rx=0 tx=0).stop 2024-09-11T23:20:49.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc37415c2a0 msgr2=0x7fc374163fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc37415c2a0 0x7fc374163fe0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc36c01a5a0 tx=0x7fc36c019710 comp rx=0 tx=0).stop 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 shutdown_connections 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fc3600678c0 0x7fc360069d80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc37415c2a0 0x7fc374163fe0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415bec0 0x7fc37414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 --2- 172.21.15.94:0/1901949947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740af470 0x7fc374157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 >> 172.21.15.94:0/1901949947 conn(0x7fc3740b1f90 msgr2=0x7fc374074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 shutdown_connections 2024-09-11T23:20:49.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:20:49.656+0000 7fc37afad640 1 -- 172.21.15.94:0/1901949947 wait complete. 2024-09-11T23:20:49.675 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-11T23:20:48.081752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":287196,"kb_used_data":12712,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754687524,"statfs":{"total":773094113280,"available":772800024576,"internally_reserved":0,"allocated":13017088,"data_stored":6662000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8410438,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-83,"num_write_kb":-8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002133"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":353,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T23:20:44.109244+0000","last_change":"2024-09-11T23:15:03.583521+0000","last_active":"2024-09-11T23:20:44.109244+0000","last_peered":"2024-09-11T23:20:44.109244+0000","last_clean":"2024-09-11T23:20:44.109244+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:20:44.109244+0000","last_undegraded":"2024-09-11T23:20:44.109244+0000","last_fullsized":"2024-09-11T23:20:44.109244+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:15:02.553189+0000","last_clean_scrub_stamp":"2024-09-11T23:15:02.553189+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:48.063835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41532,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330308,"statfs":{"total":96636764160,"available":96594235392,"internally_reserved":0,"allocated":2072576,"data_stored":1275526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28476,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343364,"statfs":{"total":96636764160,"available":96607604736,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32636,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2072576,"data_stored":1275526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:20:49.677 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T23:15:02.553189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=23, tm_min=15, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=23, tm_min=20, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T23:20:49.678 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T23:21:09.680 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:09.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac4558640 1 Processor -- start 2024-09-11T23:21:09.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac4558640 1 -- start start 2024-09-11T23:21:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac4558640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faabc15e5f0 0x7faabc06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac4558640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faabc06d9c0 con 0x7faabc0ce9d0 2024-09-11T23:21:09.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac4558640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faabc06dca0 con 0x7faabc0cfaf0 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac4558640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7faabc06df80 con 0x7faabc15e5f0 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac22f4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faabc15e5f0 0x7faabc06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac1af3640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7faabc0ce9d0 0x7faabc0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41302/0 (socket says 172.21.15.94:41302) 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac1af3640 1 -- 172.21.15.94:0/2357484853 learned_addr learned my addr 172.21.15.94:0/2357484853 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac22f4640 1 -- 172.21.15.94:0/2357484853 >> v1:172.21.15.155:6789/0 conn(0x7faabc0cfaf0 legacy=0x7faabc0d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac22f4640 1 -- 172.21.15.94:0/2357484853 >> v1:172.21.15.94:6789/0 conn(0x7faabc0ce9d0 legacy=0x7faabc0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac12f2640 1 -- 172.21.15.94:0/2357484853 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174255374 0 0) 0x7faabc06d9c0 con 0x7faabc0ce9d0 2024-09-11T23:21:09.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.811+0000 7faac22f4640 1 -- 172.21.15.94:0/2357484853 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc06e260 con 0x7faabc15e5f0 2024-09-11T23:21:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac22f4640 1 --2- 172.21.15.94:0/2357484853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc15e5f0 0x7faabc06d090 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7faab80097c0 tx=0x7faab801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35eaf894d34df6d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac12f2640 1 -- 172.21.15.94:0/2357484853 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80b1070 con 0x7faabc15e5f0 2024-09-11T23:21:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac12f2640 1 -- 172.21.15.94:0/2357484853 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab80ac410 con 0x7faabc15e5f0 2024-09-11T23:21:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac12f2640 1 -- 172.21.15.94:0/2357484853 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80ac7e0 con 0x7faabc15e5f0 2024-09-11T23:21:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- 172.21.15.94:0/2357484853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc15e5f0 msgr2=0x7faabc06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 --2- 172.21.15.94:0/2357484853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc15e5f0 0x7faabc06d090 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7faab80097c0 tx=0x7faab801c4a0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- 172.21.15.94:0/2357484853 shutdown_connections 2024-09-11T23:21:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 --2- 172.21.15.94:0/2357484853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc15e5f0 0x7faabc06d090 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- 172.21.15.94:0/2357484853 >> 172.21.15.94:0/2357484853 conn(0x7faabc074030 msgr2=0x7faabc09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- 172.21.15.94:0/2357484853 shutdown_connections 2024-09-11T23:21:09.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- 172.21.15.94:0/2357484853 wait complete. 2024-09-11T23:21:09.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 Processor -- start 2024-09-11T23:21:09.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- start start 2024-09-11T23:21:09.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc0cfaf0 0x7faabc152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faabc1559e0 0x7faabc0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faabc0cbd90 0x7faabc0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faabc16bfb0 con 0x7faabc0cfaf0 2024-09-11T23:21:09.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0d3cd0 con 0x7faabc0cbd90 2024-09-11T23:21:09.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac4558640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faabc16c130 con 0x7faabc1559e0 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac22f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc0cfaf0 0x7faabc152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac22f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc0cfaf0 0x7faabc152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:55386/0 (socket says 172.21.15.94:55386) 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.815+0000 7faac22f4640 1 -- 172.21.15.94:0/735515379 learned_addr learned my addr 172.21.15.94:0/735515379 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac22f4640 1 -- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faabc1559e0 msgr2=0x7faabc0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac22f4640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faabc1559e0 0x7faabc0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac22f4640 1 -- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faabc0cbd90 msgr2=0x7faabc0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac2af5640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faabc0cbd90 0x7faabc0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac22f4640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faabc0cbd90 0x7faabc0cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac22f4640 1 -- 172.21.15.94:0/735515379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc153280 con 0x7faabc0cfaf0 2024-09-11T23:21:09.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac2af5640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faabc0cbd90 0x7faabc0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:09.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac22f4640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc0cfaf0 0x7faabc152d40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7faab80190b0 tx=0x7faab8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:09.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faab2ffd640 1 -- 172.21.15.94:0/735515379 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80b9020 con 0x7faabc0cfaf0 2024-09-11T23:21:09.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faab2ffd640 1 -- 172.21.15.94:0/735515379 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab80b5410 con 0x7faabc0cfaf0 2024-09-11T23:21:09.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faab2ffd640 1 -- 172.21.15.94:0/735515379 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80b1040 con 0x7faabc0cfaf0 2024-09-11T23:21:09.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc15ce10 con 0x7faabc0cfaf0 2024-09-11T23:21:09.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc1538d0 con 0x7faabc0cfaf0 2024-09-11T23:21:09.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc06d9c0 con 0x7faabc0cfaf0 2024-09-11T23:21:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faab2ffd640 1 -- 172.21.15.94:0/735515379 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faab80bc020 con 0x7faabc0cfaf0 2024-09-11T23:21:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faab2ffd640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faaa00678f0 0x7faaa0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faab2ffd640 1 -- 172.21.15.94:0/735515379 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7faab811eed0 con 0x7faabc0cfaf0 2024-09-11T23:21:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac1af3640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faaa00678f0 0x7faaa0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.819+0000 7faac1af3640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faaa00678f0 0x7faaa0069db0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faaac000c10 tx=0x7faaac007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:09.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.823+0000 7faab2ffd640 1 -- 172.21.15.94:0/735515379 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faab80c4020 con 0x7faabc0cfaf0 2024-09-11T23:21:09.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.983+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 --> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faabc0d17c0 con 0x7faaa00678f0 2024-09-11T23:21:09.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faab2ffd640 1 -- 172.21.15.94:0/735515379 <== mgr.4100 v2:172.21.15.155:6832/2054672037 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7faabc0d17c0 con 0x7faaa00678f0 2024-09-11T23:21:09.988 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:21:09.989 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-11T23:21:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faaa00678f0 msgr2=0x7faaa0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faaa00678f0 0x7faaa0069db0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faaac000c10 tx=0x7faaac007910 comp rx=0 tx=0).stop 2024-09-11T23:21:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc0cfaf0 msgr2=0x7faabc152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc0cfaf0 0x7faabc152d40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7faab80190b0 tx=0x7faab8019240 comp rx=0 tx=0).stop 2024-09-11T23:21:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 shutdown_connections 2024-09-11T23:21:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faabc0cbd90 0x7faabc0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faabc1559e0 0x7faabc0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7faaa00678f0 0x7faaa0069db0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 --2- 172.21.15.94:0/735515379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faabc0cfaf0 0x7faabc152d40 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 >> 172.21.15.94:0/735515379 conn(0x7faabc0ce9d0 msgr2=0x7faabc0b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 shutdown_connections 2024-09-11T23:21:09.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:09.987+0000 7faac4558640 1 -- 172.21.15.94:0/735515379 wait complete. 2024-09-11T23:21:10.007 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-11T23:21:08.086877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":287188,"kb_used_data":12712,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754687532,"statfs":{"total":773094113280,"available":772800032768,"internally_reserved":0,"allocated":13017088,"data_stored":6662000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003035"},"pg_stats":[{"pgid":"1.0","version":"118'119","reported_seq":365,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T23:20:49.434794+0000","last_change":"2024-09-11T23:20:49.434794+0000","last_active":"2024-09-11T23:20:49.434794+0000","last_peered":"2024-09-11T23:20:49.434794+0000","last_clean":"2024-09-11T23:20:49.434794+0000","last_became_active":"2024-09-11T23:15:03.581397+0000","last_became_peered":"2024-09-11T23:15:03.581397+0000","last_unstale":"2024-09-11T23:20:49.434794+0000","last_undegraded":"2024-09-11T23:20:49.434794+0000","last_fullsized":"2024-09-11T23:20:49.434794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'119","last_scrub_stamp":"2024-09-11T23:20:49.434551+0000","last_deep_scrub":"118'119","last_deep_scrub_stamp":"2024-09-11T23:20:49.434551+0000","last_clean_scrub_stamp":"2024-09-11T23:20:49.434551+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:04.845542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41528,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330312,"statfs":{"total":96636764160,"available":96594239488,"internally_reserved":0,"allocated":2072576,"data_stored":1275526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40956,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330884,"statfs":{"total":96636764160,"available":96594825216,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28472,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28476,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343364,"statfs":{"total":96636764160,"available":96607604736,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32636,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1478656,"data_stored":685158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2072576,"data_stored":1275526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:10.008 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T23:21:10.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd1873b7640 1 Processor -- start 2024-09-11T23:21:10.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd1873b7640 1 -- start start 2024-09-11T23:21:10.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd1873b7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd1800d3060 0x7fd1800cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd1873b7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1800cf450 0x7fd18006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd1873b7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1800d0300 con 0x7fd180161a60 2024-09-11T23:21:10.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd1873b7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd1800b0f60 con 0x7fd1800d3060 2024-09-11T23:21:10.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd1873b7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd1800cfd40 con 0x7fd1800cf450 2024-09-11T23:21:10.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd184952640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd1800d3060 0x7fd1800cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd185153640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd180161a60 0x7fd1800d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44054/0 (socket says 172.21.15.94:44054) 2024-09-11T23:21:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd184952640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd1800d3060 0x7fd1800cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52558/0 (socket says 172.21.15.94:52558) 2024-09-11T23:21:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd185153640 1 -- 172.21.15.94:0/2824108048 learned_addr learned my addr 172.21.15.94:0/2824108048 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-11T23:21:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd185954640 1 --2- 172.21.15.94:0/2824108048 >> v2:172.21.15.155:3300/0 conn(0x7fd1800cf450 0x7fd18006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd184952640 1 -- 172.21.15.94:0/2824108048 >> v2:172.21.15.155:3300/0 conn(0x7fd1800cf450 msgr2=0x7fd18006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd184952640 1 --2- 172.21.15.94:0/2824108048 >> v2:172.21.15.155:3300/0 conn(0x7fd1800cf450 0x7fd18006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd184952640 1 -- 172.21.15.94:0/2824108048 >> v1:172.21.15.94:6789/0 conn(0x7fd180161a60 legacy=0x7fd1800d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.123+0000 7fd184952640 1 -- 172.21.15.94:0/2824108048 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1800d0020 con 0x7fd1800d3060 2024-09-11T23:21:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd184952640 1 --2- 172.21.15.94:0/2824108048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1800d3060 0x7fd1800cef10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fd1800ce950 tx=0x7fd17c01c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38323938f1cd726b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd173fff640 1 -- 172.21.15.94:0/2824108048 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0b0070 con 0x7fd1800d3060 2024-09-11T23:21:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd173fff640 1 -- 172.21.15.94:0/2824108048 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c0ab600 con 0x7fd1800d3060 2024-09-11T23:21:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd173fff640 1 -- 172.21.15.94:0/2824108048 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0a4e60 con 0x7fd1800d3060 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- 172.21.15.94:0/2824108048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1800d3060 msgr2=0x7fd1800cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2824108048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1800d3060 0x7fd1800cef10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fd1800ce950 tx=0x7fd17c01c250 comp rx=0 tx=0).stop 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- 172.21.15.94:0/2824108048 shutdown_connections 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2824108048 >> v2:172.21.15.155:3300/0 conn(0x7fd1800cf450 0x7fd18006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2824108048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1800d3060 0x7fd1800cef10 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- 172.21.15.94:0/2824108048 >> 172.21.15.94:0/2824108048 conn(0x7fd18008bf90 msgr2=0x7fd18009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- 172.21.15.94:0/2824108048 shutdown_connections 2024-09-11T23:21:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- 172.21.15.94:0/2824108048 wait complete. 2024-09-11T23:21:10.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 Processor -- start 2024-09-11T23:21:10.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- start start 2024-09-11T23:21:10.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1800cf450 0x7fd1800ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1800d3060 0x7fd180152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd180161a60 0x7fd180158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd18016af20 con 0x7fd180161a60 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd18006e650 con 0x7fd1800d3060 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd1873b7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd18016b0a0 con 0x7fd1800cf450 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd185954640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd180161a60 0x7fd180158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd185954640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd180161a60 0x7fd180158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52566/0 (socket says 172.21.15.94:52566) 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.127+0000 7fd185954640 1 -- 172.21.15.94:0/2123849370 learned_addr learned my addr 172.21.15.94:0/2123849370 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd184952640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1800d3060 0x7fd180152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185153640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1800cf450 0x7fd1800ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185954640 1 -- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1800cf450 msgr2=0x7fd1800ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185954640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1800cf450 0x7fd1800ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185954640 1 -- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1800d3060 msgr2=0x7fd180152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185954640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1800d3060 0x7fd180152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185954640 1 -- 172.21.15.94:0/2123849370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd180159670 con 0x7fd180161a60 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd184952640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1800d3060 0x7fd180152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:10.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185153640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1800cf450 0x7fd1800ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:10.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185954640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd180161a60 0x7fd180158710 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fd178007e90 tx=0x7fd17800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178014420 con 0x7fd180161a60 2024-09-11T23:21:10.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178019070 con 0x7fd180161a60 2024-09-11T23:21:10.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1800c8020 con 0x7fd180161a60 2024-09-11T23:21:10.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178014800 con 0x7fd180161a60 2024-09-11T23:21:10.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1800c85e0 con 0x7fd180161a60 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1800c87e0 con 0x7fd180161a60 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1780149a0 con 0x7fd180161a60 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd171ffb640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1640678c0 0x7fd164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fd1780863a0 con 0x7fd180161a60 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185153640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1640678c0 0x7fd164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.131+0000 7fd185153640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1640678c0 0x7fd164069d80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd174000f70 tx=0x7fd174009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.135+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1800c87e0 con 0x7fd180161a60 2024-09-11T23:21:10.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.295+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd18006d6b0 con 0x7fd180161a60 2024-09-11T23:21:10.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.299+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v32)=0 v32) ==== 123+0+0 (secure 0 0 0) 0x7fd178011260 con 0x7fd180161a60 2024-09-11T23:21:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd171ffb640 1 -- 172.21.15.94:0/2123849370 <== mon.0 v2:172.21.15.94:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd178056950 con 0x7fd180161a60 2024-09-11T23:21:10.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1640678c0 msgr2=0x7fd164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1640678c0 0x7fd164069d80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd174000f70 tx=0x7fd174009040 comp rx=0 tx=0).stop 2024-09-11T23:21:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd180161a60 msgr2=0x7fd180158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd180161a60 0x7fd180158710 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fd178007e90 tx=0x7fd17800e4b0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 shutdown_connections 2024-09-11T23:21:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7fd1640678c0 0x7fd164069d80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd180161a60 0x7fd180158710 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1800d3060 0x7fd180152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 --2- 172.21.15.94:0/2123849370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1800cf450 0x7fd1800ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 >> 172.21.15.94:0/2123849370 conn(0x7fd18008bf90 msgr2=0x7fd1800d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 shutdown_connections 2024-09-11T23:21:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.303+0000 7fd1873b7640 1 -- 172.21.15.94:0/2123849370 wait complete. 2024-09-11T23:21:10.322 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:21:10.322 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:10.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.427+0000 7f06a13ea640 1 Processor -- start 2024-09-11T23:21:10.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.427+0000 7f06a13ea640 1 -- start start 2024-09-11T23:21:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f06a13ea640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f069c15bec0 0x7f069c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f06a13ea640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f069c15c2a0 0x7f069c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f06a13ea640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069c0b3290 con 0x7f069c0af2a0 2024-09-11T23:21:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f06a13ea640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f069c0b3570 con 0x7f069c15c2a0 2024-09-11T23:21:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f06a13ea640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f069c0b3850 con 0x7f069c15bec0 2024-09-11T23:21:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f069c15c2a0 0x7f069c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f069c15c2a0 0x7f069c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52576/0 (socket says 172.21.15.94:52576) 2024-09-11T23:21:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 -- 172.21.15.94:0/2565265673 learned_addr learned my addr 172.21.15.94:0/2565265673 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:21:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069affd640 1 --2- 172.21.15.94:0/2565265673 >> v2:172.21.15.155:3300/0 conn(0x7f069c15bec0 0x7f069c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 -- 172.21.15.94:0/2565265673 >> v2:172.21.15.155:3300/0 conn(0x7f069c15bec0 msgr2=0x7f069c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 --2- 172.21.15.94:0/2565265673 >> v2:172.21.15.155:3300/0 conn(0x7f069c15bec0 0x7f069c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 -- 172.21.15.94:0/2565265673 >> v1:172.21.15.94:6789/0 conn(0x7f069c0af2a0 legacy=0x7f069c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 -- 172.21.15.94:0/2565265673 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c0b3b30 con 0x7f069c15c2a0 2024-09-11T23:21:10.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f069a7fc640 1 --2- 172.21.15.94:0/2565265673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15c2a0 0x7f069c0aed60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f069c071710 tx=0x7f069001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa908ce146155ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f0699ffb640 1 -- 172.21.15.94:0/2565265673 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06900b0070 con 0x7f069c15c2a0 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f0699ffb640 1 -- 172.21.15.94:0/2565265673 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0690004230 con 0x7f069c15c2a0 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.431+0000 7f0699ffb640 1 -- 172.21.15.94:0/2565265673 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690003620 con 0x7f069c15c2a0 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- 172.21.15.94:0/2565265673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15c2a0 msgr2=0x7f069c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 --2- 172.21.15.94:0/2565265673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15c2a0 0x7f069c0aed60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f069c071710 tx=0x7f069001c3b0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- 172.21.15.94:0/2565265673 shutdown_connections 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 --2- 172.21.15.94:0/2565265673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15c2a0 0x7f069c0aed60 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 --2- 172.21.15.94:0/2565265673 >> v2:172.21.15.155:3300/0 conn(0x7f069c15bec0 0x7f069c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- 172.21.15.94:0/2565265673 >> 172.21.15.94:0/2565265673 conn(0x7f069c0b1f90 msgr2=0x7f069c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- 172.21.15.94:0/2565265673 shutdown_connections 2024-09-11T23:21:10.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- 172.21.15.94:0/2565265673 wait complete. 2024-09-11T23:21:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 Processor -- start 2024-09-11T23:21:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- start start 2024-09-11T23:21:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f069c0af2a0 0x7f069c152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15bec0 0x7f069c09a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f069c15c2a0 0x7f069c1e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f069c0afc90 con 0x7f069c15bec0 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f069c0b40f0 con 0x7f069c15c2a0 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f069c0af710 con 0x7f069c0af2a0 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15bec0 0x7f069c09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15bec0 0x7f069c09a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52590/0 (socket says 172.21.15.94:52590) 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 -- 172.21.15.94:0/3880439668 learned_addr learned my addr 172.21.15.94:0/3880439668 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069b7fe640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f069c15c2a0 0x7f069c1e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069affd640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f069c0af2a0 0x7f069c152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 -- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f069c0af2a0 msgr2=0x7f069c152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f069c0af2a0 0x7f069c152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 -- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f069c15c2a0 msgr2=0x7f069c1e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f069c15c2a0 0x7f069c1e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 -- 172.21.15.94:0/3880439668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c075510 con 0x7f069c15bec0 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f069a7fc640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15bec0 0x7f069c09a280 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0690019fe0 tx=0x7f0690019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06837fe640 1 -- 172.21.15.94:0/3880439668 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06900bd070 con 0x7f069c15bec0 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06837fe640 1 -- 172.21.15.94:0/3880439668 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f06900b1040 con 0x7f069c15bec0 2024-09-11T23:21:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069c09bfb0 con 0x7f069c15bec0 2024-09-11T23:21:10.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06837fe640 1 -- 172.21.15.94:0/3880439668 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06900b0050 con 0x7f069c15bec0 2024-09-11T23:21:10.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.435+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069c09c570 con 0x7f069c15bec0 2024-09-11T23:21:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.439+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069c0aed60 con 0x7f069c15bec0 2024-09-11T23:21:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.439+0000 7f06837fe640 1 -- 172.21.15.94:0/3880439668 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06900c0070 con 0x7f069c15bec0 2024-09-11T23:21:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.439+0000 7f06837fe640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06880678c0 0x7f0688069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.439+0000 7f06837fe640 1 -- 172.21.15.94:0/3880439668 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f069011fce0 con 0x7f069c15bec0 2024-09-11T23:21:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.439+0000 7f069affd640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06880678c0 0x7f0688069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.439+0000 7f069affd640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06880678c0 0x7f0688069d80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f068c00b9d0 tx=0x7f068c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.443+0000 7f06837fe640 1 -- 172.21.15.94:0/3880439668 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0690016030 con 0x7f069c15bec0 2024-09-11T23:21:10.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.623+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f069c06fcd0 con 0x7f069c15bec0 2024-09-11T23:21:10.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.623+0000 7f06837fe640 1 -- 172.21.15.94:0/3880439668 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+3914 (secure 0 0 0) 0x7f06900f0860 con 0x7f069c15bec0 2024-09-11T23:21:10.626 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-11T23:21:10.627 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":74,"btime":"2024-09-11T23:20:39:265953+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/979738962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":979738962},{"type":"v1","addr":"172.21.15.155:6837","nonce":979738962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5854,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1439790249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1439790249},{"type":"v1","addr":"172.21.15.155:6835","nonce":1439790249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3305118905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3305118905},{"type":"v1","addr":"172.21.15.94:6833","nonce":3305118905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1314771461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1314771461},{"type":"v1","addr":"172.21.15.94:6835","nonce":1314771461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[]} 2024-09-11T23:21:10.627 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 74 2024-09-11T23:21:10.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06880678c0 msgr2=0x7f0688069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06880678c0 0x7f0688069d80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f068c00b9d0 tx=0x7f068c008040 comp rx=0 tx=0).stop 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15bec0 msgr2=0x7f069c09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15bec0 0x7f069c09a280 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0690019fe0 tx=0x7f0690019150 comp rx=0 tx=0).stop 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 shutdown_connections 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f069c15c2a0 0x7f069c1e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:6832/2054672037,v1:172.21.15.155:6833/2054672037] conn(0x7f06880678c0 0x7f0688069d80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f069c15bec0 0x7f069c09a280 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 --2- 172.21.15.94:0/3880439668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f069c0af2a0 0x7f069c152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 >> 172.21.15.94:0/3880439668 conn(0x7f069c0b1f90 msgr2=0x7f069c15b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 shutdown_connections 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-11T23:21:10.627+0000 7f06a13ea640 1 -- 172.21.15.94:0/3880439668 wait complete. 2024-09-11T23:21:10.644 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-11T23:21:10.644 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T23:21:10.645 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:21:10.645 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:10.655 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:21:10.655 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:21:10.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:10.710 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:21:10.710 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:21:10.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:10.729 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:21:10.730 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:21:10.730 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:10.785 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:21:10.786 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T23:21:10.786 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T23:21:10.786 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:10.866 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T23:21:10.866 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T23:21:10.866 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:10.962 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T23:21:10.963 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T23:21:10.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:12.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-11T23:21:14.989 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:14.992 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:17.065 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T23:21:17.065 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T23:21:17.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.130 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T23:21:17.131 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T23:21:17.131 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.201 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T23:21:17.201 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T23:21:17.201 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.290 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T23:21:17.291 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T23:21:17.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.354 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T23:21:17.354 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T23:21:17.355 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.428 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T23:21:17.429 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T23:21:17.429 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T23:21:17.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.457 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T23:21:17.457 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T23:21:17.457 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.487 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T23:21:17.487 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T23:21:17.487 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T23:21:17.488 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.514 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T23:21:17.514 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T23:21:17.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.549 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T23:21:17.549 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T23:21:17.549 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:17.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-11T23:21:17.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-11T23:21:17.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-11T23:21:17.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-11T23:21:17.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-11T23:21:17.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-11T23:21:17.608 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T23:21:17.608 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T23:21:17.608 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-11T23:21:17.626 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:21:17.626 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T23:21:17.931 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:21:17.932 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T23:21:18.135 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:21:18.135 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T23:21:18.282 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:21:18.283 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T23:21:18.434 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:21:18.435 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T23:21:18.696 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:21:18.696 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T23:21:18.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:21:18.965 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T23:21:19.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:21:19.133 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T23:21:19.299 INFO:tasks.ceph:Archiving mon data... 2024-09-11T23:21:19.300 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/data/mon.a.tgz 2024-09-11T23:21:19.301 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-11T23:21:19.306 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.pWJtQrNBmM 2024-09-11T23:21:19.307 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pWJtQrNBmM 2024-09-11T23:21:19.471 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.pWJtQrNBmM 2024-09-11T23:21:19.536 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.pWJtQrNBmM is 542KB 2024-09-11T23:21:19.598 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.pWJtQrNBmM 2024-09-11T23:21:19.603 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/data/mon.b.tgz 2024-09-11T23:21:19.604 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-11T23:21:19.609 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.G6IMr4OSrk 2024-09-11T23:21:19.610 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.G6IMr4OSrk 2024-09-11T23:21:19.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.G6IMr4OSrk 2024-09-11T23:21:19.876 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.G6IMr4OSrk is 693KB 2024-09-11T23:21:19.939 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.G6IMr4OSrk 2024-09-11T23:21:19.945 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/data/mon.c.tgz 2024-09-11T23:21:19.945 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-11T23:21:19.993 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.0dAOjOrndN 2024-09-11T23:21:19.994 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0dAOjOrndN 2024-09-11T23:21:20.201 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.0dAOjOrndN 2024-09-11T23:21:20.265 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.0dAOjOrndN is 693KB 2024-09-11T23:21:20.327 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.0dAOjOrndN 2024-09-11T23:21:20.332 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T23:21:20.333 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T23:21:20.335 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T23:21:20.397 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T23:21:20.437 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T23:21:20.438 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T23:21:20.439 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/remote/smithi094/crash 2024-09-11T23:21:20.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T23:21:20.453 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/remote/smithi155/crash 2024-09-11T23:21:20.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T23:21:20.493 INFO:tasks.ceph:Shutting down logrotate 2024-09-11T23:21:20.494 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:20.502 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:20.588 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:20.601 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:20.614 INFO:tasks.ceph:Compressing logs... 2024-09-11T23:21:20.615 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:21:20.645 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:21:20.675 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41989.log 2024-09-11T23:21:20.676 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-09-11T23:21:20.676 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-09-11T23:21:20.676 INFO:teuthology.orchestra.run.smithi094.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41989.log.gz 2024-09-11T23:21:20.678 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34770.log 2024-09-11T23:21:20.678 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-09-11T23:21:20.678 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35974.log 2024-09-11T23:21:20.679 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35584.log: /var/log/ceph/ceph-client.admin.34770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2024-09-11T23:21:20.679 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46530.log 2024-09-11T23:21:20.679 INFO:teuthology.orchestra.run.smithi094.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34770.log.gz 2024-09-11T23:21:20.679 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-09-11T23:21:20.679 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35974.log.gz 2024-09-11T23:21:20.679 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-09-11T23:21:20.690 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28971.log 2024-09-11T23:21:20.691 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T23:21:20.691 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28971.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T23:21:20.691 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28971.log.gz 2024-09-11T23:21:20.691 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29115.log 2024-09-11T23:21:20.691 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29019.log 2024-09-11T23:21:20.691 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T23:21:20.692 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29115.log: /var/log/ceph/ceph-client.admin.29019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29043.log 2024-09-11T23:21:20.692 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29115.log.gz 2024-09-11T23:21:20.692 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29019.log.gz 2024-09-11T23:21:20.692 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T23:21:20.692 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T23:21:20.692 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29043.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29091.log 2024-09-11T23:21:20.692 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29043.log.gz 2024-09-11T23:21:20.693 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose --/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.28995.log 2024-09-11T23:21:20.693 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29091.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T23:21:20.693 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29091.log.gz/var/log/ceph/ceph-client.admin.28995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34969.log 2024-09-11T23:21:20.693 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-11T23:21:20.693 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28995.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.1.34850.log 2024-09-11T23:21:20.693 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-11T23:21:20.693 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.3.34969.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T23:21:20.694 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34850.log: 88.3% -- replaced with /var/log/ceph/ceph-client.3.34969.log.gz 2024-09-11T23:21:20.694 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-11T23:21:20.694 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.1.34850.log.gz 2024-09-11T23:21:20.694 INFO:teuthology.orchestra.run.smithi155.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T23:21:20.694 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-11T23:21:20.694 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T23:21:20.697 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T23:21:20.697 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28947.log 2024-09-11T23:21:20.707 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T23:21:20.708 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28947.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28947.log.gz 2024-09-11T23:21:20.720 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29067.log 2024-09-11T23:21:20.725 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.4.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-11T23:21:20.740 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29067.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29067.log.gz 2024-09-11T23:21:20.742 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46530.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2024-09-11T23:21:20.743 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39570.log 2024-09-11T23:21:20.743 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46530.log.gz 2024-09-11T23:21:20.743 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42275.log 2024-09-11T23:21:20.743 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-09-11T23:21:20.743 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.39570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40513.log 2024-09-11T23:21:20.743 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42875.log 2024-09-11T23:21:20.743 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42275.log.gz 2024-09-11T23:21:20.744 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43609.log 2024-09-11T23:21:20.744 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40513.log.gz 2024-09-11T23:21:20.744 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43817.log 2024-09-11T23:21:20.744 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42875.log: /var/log/ceph/ceph-client.admin.43609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-09-11T23:21:20.744 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42875.log.gz 2024-09-11T23:21:20.744 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43609.log.gz 2024-09-11T23:21:20.744 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41285.log 2024-09-11T23:21:20.745 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43817.log.gz 2024-09-11T23:21:20.745 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47868.log 2024-09-11T23:21:20.745 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-09-11T23:21:20.745 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41363.log 2024-09-11T23:21:20.745 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42119.log 2024-09-11T23:21:20.745 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41285.log.gz 2024-09-11T23:21:20.745 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47868.log.gz 2024-09-11T23:21:20.746 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-09-11T23:21:20.746 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41363.log.gz 2024-09-11T23:21:20.746 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43375.log 2024-09-11T23:21:20.746 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40721.log 2024-09-11T23:21:20.746 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42119.log.gz 2024-09-11T23:21:20.746 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43375.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-09-11T23:21:20.746 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37436.log 2024-09-11T23:21:20.747 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43375.log.gz 2024-09-11T23:21:20.747 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38477.log 2024-09-11T23:21:20.747 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2024-09-11T23:21:20.747 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40721.log.gz 2024-09-11T23:21:20.747 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38477.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37436.log.gz 2024-09-11T23:21:20.747 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37515.log 2024-09-11T23:21:20.747 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38477.log.gz 2024-09-11T23:21:20.748 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35581.log 2024-09-11T23:21:20.748 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.37515.log: --verbose -- /var/log/ceph/ceph-client.2.36489.log 2024-09-11T23:21:20.748 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2024-09-11T23:21:20.748 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35581.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37515.log.gz 2024-09-11T23:21:20.748 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T23:21:20.748 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35581.log.gz 2024-09-11T23:21:20.748 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.2.36489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44339.log 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41854.log 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44339.log: gzip 89.7% -5 -- replaced with /var/log/ceph/ceph-client.2.36489.log.gz --verbose 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.42927.log 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44339.log.gz 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43401.log 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42927.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41854.log.gz 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2024-09-11T23:21:20.749 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42927.log.gz 2024-09-11T23:21:20.750 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2024-09-11T23:21:20.750 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37137.log 2024-09-11T23:21:20.750 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45171.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43401.log.gz 2024-09-11T23:21:20.750 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42623.log 2024-09-11T23:21:20.750 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2024-09-11T23:21:20.750 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2024-09-11T23:21:20.750 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2024-09-11T23:21:20.751 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37137.log: /var/log/ceph/ceph-client.admin.42623.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37137.log.gz 2024-09-11T23:21:20.751 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38740.log 2024-09-11T23:21:20.751 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42623.log.gz 2024-09-11T23:21:20.751 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39800.log 2024-09-11T23:21:20.751 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45536.log: /var/log/ceph/ceph-client.admin.38740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2024-09-11T23:21:20.751 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2024-09-11T23:21:20.751 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38740.log.gz 2024-09-11T23:21:20.752 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40288.log 2024-09-11T23:21:20.752 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39800.log.gz 2024-09-11T23:21:20.752 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42249.log 2024-09-11T23:21:20.752 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40288.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2024-09-11T23:21:20.752 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46857.log 2024-09-11T23:21:20.752 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40288.log.gz 2024-09-11T23:21:20.752 INFO:teuthology.orchestra.run.smithi094.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35788.log 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46857.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42249.log.gz 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38511.log 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37621.log 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35788.log.gz 2024-09-11T23:21:20.753 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38922.log 2024-09-11T23:21:20.754 INFO:teuthology.orchestra.run.smithi094.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46857.log.gz 2024-09-11T23:21:20.754 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38511.log: /var/log/ceph/ceph-client.admin.37621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-09-11T23:21:20.754 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38511.log.gz 2024-09-11T23:21:20.754 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38922.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37621.log.gz 2024-09-11T23:21:20.754 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2024-09-11T23:21:20.754 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38922.log.gz 2024-09-11T23:21:20.754 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45289.log 2024-09-11T23:21:20.755 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-09-11T23:21:20.755 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T23:21:20.755 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2024-09-11T23:21:20.755 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35794.log 2024-09-11T23:21:20.755 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45289.log.gz 2024-09-11T23:21:20.755 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39053.log 2024-09-11T23:21:20.755 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.35794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44079.log 2024-09-11T23:21:20.756 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35794.log.gz 2024-09-11T23:21:20.756 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42953.log 2024-09-11T23:21:20.756 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44079.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39053.log.gz 2024-09-11T23:21:20.756 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41168.log 2024-09-11T23:21:20.756 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44079.log.gz 2024-09-11T23:21:20.756 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40747.log 2024-09-11T23:21:20.756 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42953.log: /var/log/ceph/ceph-client.0.41168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40131.log 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42953.log.gz 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37820.log 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40747.log.gz 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40131.log.gz 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41226.log 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43505.log 2024-09-11T23:21:20.757 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37820.log.gz 2024-09-11T23:21:20.758 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43531.log: /var/log/ceph/ceph-client.admin.41226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42145.log 2024-09-11T23:21:20.758 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2024-09-11T23:21:20.758 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41226.log.gz 2024-09-11T23:21:20.758 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-09-11T23:21:20.758 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43505.log: /var/log/ceph/ceph-client.admin.42145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44574.log 2024-09-11T23:21:20.758 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43505.log.gz 2024-09-11T23:21:20.758 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42145.log.gz 2024-09-11T23:21:20.759 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44027.log 2024-09-11T23:21:20.759 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-09-11T23:21:20.759 INFO:teuthology.orchestra.run.smithi094.stderr: 87.3%/var/log/ceph/ceph-client.admin.44574.log: -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-09-11T23:21:20.759 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44743.log 2024-09-11T23:21:20.759 INFO:teuthology.orchestra.run.smithi094.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44574.log.gz 2024-09-11T23:21:20.759 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44027.log.gz 2024-09-11T23:21:20.759 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36623.log 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42041.log 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44743.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46701.log 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44743.log.gz 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36623.log.gz 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38246.log 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42041.log: /var/log/ceph/ceph-client.admin.46701.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42041.log.gz 2024-09-11T23:21:20.760 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46009.log 2024-09-11T23:21:20.761 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38054.log 2024-09-11T23:21:20.761 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46701.log.gz 2024-09-11T23:21:20.761 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38246.log: /var/log/ceph/ceph-client.admin.46009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40370.log 2024-09-11T23:21:20.761 INFO:teuthology.orchestra.run.smithi094.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.38246.log.gz 2024-09-11T23:21:20.761 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38054.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2024-09-11T23:21:20.761 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2024-09-11T23:21:20.761 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47352.log 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40370.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38054.log.gz 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40935.log 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40370.log.gz 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41020.log 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40935.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37649.log 2024-09-11T23:21:20.762 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40935.log.gz 2024-09-11T23:21:20.763 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37111.log 2024-09-11T23:21:20.763 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37649.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41020.log.gz 2024-09-11T23:21:20.763 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46265.log 2024-09-11T23:21:20.763 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37649.log.gz 2024-09-11T23:21:20.763 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37111.log: /var/log/ceph/ceph-client.admin.35034.log 2024-09-11T23:21:20.763 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38792.log 2024-09-11T23:21:20.763 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37111.log.gz 2024-09-11T23:21:20.764 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46265.log.gz 2024-09-11T23:21:20.764 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40617.log 2024-09-11T23:21:20.764 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35034.log.gz 2024-09-11T23:21:20.764 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-09-11T23:21:20.764 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40617.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38792.log.gz 2024-09-11T23:21:20.764 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28919.log 2024-09-11T23:21:20.764 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40617.log.gz 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37463.log 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47177.log: /var/log/ceph/ceph-client.admin.28919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28919.log.gz 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39281.log 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37463.log.gz 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr: 93.6%/var/log/ceph/ceph-client.admin.41906.log: -- replaced with /var/log/ceph/ceph-client.0.39570.log.gz 2024-09-11T23:21:20.765 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38303.log 2024-09-11T23:21:20.766 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2024-09-11T23:21:20.766 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39105.log 2024-09-11T23:21:20.766 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39281.log: /var/log/ceph/ceph-client.admin.38303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37712.log 2024-09-11T23:21:20.766 INFO:teuthology.orchestra.run.smithi094.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38303.log.gz 2024-09-11T23:21:20.766 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39281.log.gz 2024-09-11T23:21:20.766 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47229.log 2024-09-11T23:21:20.766 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44365.log 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37712.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39105.log.gz 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47229.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37712.log.gz 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46753.log 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47229.log.gz 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45133.log 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44365.log: /var/log/ceph/ceph-client.admin.46753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43168.log 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46753.log.gz 2024-09-11T23:21:20.767 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44365.log.gz 2024-09-11T23:21:20.768 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47255.log 2024-09-11T23:21:20.768 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35766.log/var/log/ceph/ceph-client.admin.43168.log: 2024-09-11T23:21:20.768 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45133.log.gz 2024-09-11T23:21:20.768 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43168.log.gz 2024-09-11T23:21:20.768 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-09-11T23:21:20.768 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45179.log 2024-09-11T23:21:20.768 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35766.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47255.log.gz 2024-09-11T23:21:20.769 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47151.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35766.log.gz 2024-09-11T23:21:20.769 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34319.log 2024-09-11T23:21:20.769 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-09-11T23:21:20.769 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42770.log 2024-09-11T23:21:20.769 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45179.log: /var/log/ceph/ceph-client.admin.34319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45879.log 2024-09-11T23:21:20.769 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45179.log.gz -- replaced with /var/log/ceph/ceph-client.admin.34319.log.gz 2024-09-11T23:21:20.769 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.770 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42770.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T23:21:20.770 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42770.log.gz 2024-09-11T23:21:20.770 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-09-11T23:21:20.770 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.45879.log.gz --verbose 2024-09-11T23:21:20.770 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.34493.log 2024-09-11T23:21:20.770 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.43689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45931.log 2024-09-11T23:21:20.770 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35367.log 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42459.log 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45931.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34493.log.gz 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36565.log 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45931.log.gz 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.42459.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35367.log.gz 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35786.log 2024-09-11T23:21:20.771 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43635.log 2024-09-11T23:21:20.772 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36565.log: /var/log/ceph/ceph-client.admin.35786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-09-11T23:21:20.772 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36565.log.gz 2024-09-11T23:21:20.772 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7%/var/log/ceph/ceph-client.admin.43635.log: -- replaced with /var/log/ceph/ceph-client.admin.35786.log.gzgzip 2024-09-11T23:21:20.772 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38870.log 2024-09-11T23:21:20.772 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43635.log.gz 2024-09-11T23:21:20.772 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.47712.log: --verbose -- /var/log/ceph/ceph-client.admin.46108.log 2024-09-11T23:21:20.772 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38818.log/var/log/ceph/ceph-client.admin.38870.log: 2024-09-11T23:21:20.773 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-09-11T23:21:20.773 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37768.log 2024-09-11T23:21:20.773 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38870.log.gz 2024-09-11T23:21:20.773 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46108.log.gz 2024-09-11T23:21:20.773 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38818.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T23:21:20.773 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38818.log.gz 2024-09-11T23:21:20.773 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39748.log 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37768.log.gz 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37410.log 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47998.log 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6%/var/log/ceph/ceph-client.admin.37410.log: -- replaced with /var/log/ceph/ceph-client.admin.39748.log.gz 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43661.log 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37410.log.gz 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45807.log 2024-09-11T23:21:20.774 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47998.log: /var/log/ceph/ceph-client.admin.43661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34718.log 2024-09-11T23:21:20.775 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43661.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2024-09-11T23:21:20.775 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45807.log: 2024-09-11T23:21:20.775 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45807.log.gz 2024-09-11T23:21:20.775 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41620.log 2024-09-11T23:21:20.775 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47059.log 2024-09-11T23:21:20.775 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41620.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-09-11T23:21:20.775 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34718.log.gz 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41620.log.gz 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47059.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47059.log.gz 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37950.log 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44851.log 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37950.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36052.log 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2024-09-11T23:21:20.776 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37950.log.gz 2024-09-11T23:21:20.777 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44851.log: /var/log/ceph/ceph-client.admin.36052.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44851.log.gz 2024-09-11T23:21:20.777 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36052.log.gz 2024-09-11T23:21:20.777 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47404.log 2024-09-11T23:21:20.777 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2024-09-11T23:21:20.777 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2%/var/log/ceph/ceph-client.admin.47404.log: -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2024-09-11T23:21:20.777 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-09-11T23:21:20.777 INFO:teuthology.orchestra.run.smithi094.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2024-09-11T23:21:20.778 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36675.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gz 2024-09-11T23:21:20.778 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42979.log 2024-09-11T23:21:20.778 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41594.log 2024-09-11T23:21:20.778 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42979.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47528.log 2024-09-11T23:21:20.778 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2024-09-11T23:21:20.778 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42979.log.gz 2024-09-11T23:21:20.778 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41594.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41594.log.gz 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28803.log 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34465.log 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.28803.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47528.log.gz 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46449.log 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39308.log 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.28803.log.gz 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34465.log: /var/log/ceph/ceph-client.admin.46449.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34465.log.gz 2024-09-11T23:21:20.779 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46449.log.gz 2024-09-11T23:21:20.780 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41566.log 2024-09-11T23:21:20.780 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40196.log 2024-09-11T23:21:20.780 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41566.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39308.log.gz 2024-09-11T23:21:20.780 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2024-09-11T23:21:20.780 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-09-11T23:21:20.780 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41566.log.gz 2024-09-11T23:21:20.780 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40196.log: /var/log/ceph/ceph-client.admin.47686.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36078.log 2024-09-11T23:21:20.781 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40196.log.gz 2024-09-11T23:21:20.781 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2024-09-11T23:21:20.781 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42571.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-09-11T23:21:20.781 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46727.log 2024-09-11T23:21:20.781 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44825.log 2024-09-11T23:21:20.781 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46727.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2024-09-11T23:21:20.781 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36078.log.gz 2024-09-11T23:21:20.782 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46727.log.gz 2024-09-11T23:21:20.782 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44825.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.42459.log.gz 2024-09-11T23:21:20.782 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44825.log.gz 2024-09-11T23:21:20.782 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-09-11T23:21:20.790 INFO:teuthology.orchestra.run.smithi155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T23:21:20.830 INFO:teuthology.orchestra.run.smithi155.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-11T23:21:20.850 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34437.log 2024-09-11T23:21:20.850 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46291.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2024-09-11T23:21:20.850 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36813.log 2024-09-11T23:21:20.850 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34437.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-09-11T23:21:20.850 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34640.log 2024-09-11T23:21:20.850 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34437.log.gz 2024-09-11T23:21:20.851 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37976.log 2024-09-11T23:21:20.851 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34640.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36813.log.gz 2024-09-11T23:21:20.851 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47660.log 2024-09-11T23:21:20.851 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37976.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34640.log.gz 2024-09-11T23:21:20.851 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34614.log 2024-09-11T23:21:20.851 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37976.log.gz 2024-09-11T23:21:20.851 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34614.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47660.log.gz 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37872.log 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41963.log 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34614.log.gz 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37872.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36955.log 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35368.log 2024-09-11T23:21:20.852 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37872.log.gz/var/log/ceph/ceph-client.admin.41963.log: 2024-09-11T23:21:20.853 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40825.log 2024-09-11T23:21:20.853 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41963.log.gz 2024-09-11T23:21:20.853 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36955.log.gz 2024-09-11T23:21:20.853 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39949.log 2024-09-11T23:21:20.853 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35368.log: /var/log/ceph/ceph-client.admin.40825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46558.log 2024-09-11T23:21:20.853 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40825.log.gz 2024-09-11T23:21:20.854 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39949.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.35368.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2024-09-11T23:21:20.854 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.854 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39949.log.gz 2024-09-11T23:21:20.854 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46558.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46558.log.gz 2024-09-11T23:21:20.854 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44105.log 2024-09-11T23:21:20.854 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44157.log 2024-09-11T23:21:20.854 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz/var/log/ceph/ceph-client.admin.44105.log: 2024-09-11T23:21:20.855 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43994.log 2024-09-11T23:21:20.855 INFO:teuthology.orchestra.run.smithi094.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44105.log.gz 2024-09-11T23:21:20.855 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37846.log 2024-09-11T23:21:20.855 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43994.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2024-09-11T23:21:20.855 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44157.log.gz 2024-09-11T23:21:20.855 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37846.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43994.log.gz 2024-09-11T23:21:20.855 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35793.log 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37846.log.gz 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43557.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35792.log 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35324.log 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35793.log.gz 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46475.log 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35324.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35792.log.gz 2024-09-11T23:21:20.856 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-09-11T23:21:20.857 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46475.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35116.log 2024-09-11T23:21:20.857 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35324.log.gz 2024-09-11T23:21:20.857 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46213.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46475.log.gz 2024-09-11T23:21:20.857 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37085.log 2024-09-11T23:21:20.857 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40669.log 2024-09-11T23:21:20.857 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-09-11T23:21:20.857 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35116.log: /var/log/ceph/ceph-client.admin.37085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43319.log 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40669.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35116.log.gz 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.44548.log -- replaced with /var/log/ceph/ceph-client.admin.37085.log.gz 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43319.log: 93.2% -- replaced with /var/log/ceph/ceph-client.0.41168.log.gz 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40669.log.gz 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37033.log 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43319.log.gz 2024-09-11T23:21:20.858 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34666.log 2024-09-11T23:21:20.859 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44548.log: /var/log/ceph/ceph-client.admin.37033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47203.log 2024-09-11T23:21:20.859 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2024-09-11T23:21:20.859 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37033.log.gz 2024-09-11T23:21:20.859 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2024-09-11T23:21:20.859 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2024-09-11T23:21:20.859 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47203.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34666.log.gz 2024-09-11T23:21:20.859 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39079.log 2024-09-11T23:21:20.860 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47203.log.gz 2024-09-11T23:21:20.860 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44955.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2024-09-11T23:21:20.860 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46501.log 2024-09-11T23:21:20.860 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-09-11T23:21:20.860 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46501.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39079.log.gz 2024-09-11T23:21:20.860 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37261.log 2024-09-11T23:21:20.860 INFO:teuthology.orchestra.run.smithi094.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2024-09-11T23:21:20.861 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38393.log: gzip -5 89.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46501.log.gz /var/log/ceph/ceph-osd.3.log 2024-09-11T23:21:20.861 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.861 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-09-11T23:21:20.861 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46063.log 2024-09-11T23:21:20.861 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37261.log.gz 2024-09-11T23:21:20.861 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38667.log 2024-09-11T23:21:20.861 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38667.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42301.log 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46063.log.gz 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44235.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38667.log.gz 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47125.log 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42301.log: /var/log/ceph/ceph-client.admin.47125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2024-09-11T23:21:20.862 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42301.log.gz 2024-09-11T23:21:20.863 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43031.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47125.log.gz 2024-09-11T23:21:20.863 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35377.log 2024-09-11T23:21:20.863 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36156.log 2024-09-11T23:21:20.863 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43083.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2024-09-11T23:21:20.863 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47430.log 2024-09-11T23:21:20.863 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2024-09-11T23:21:20.864 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35377.log.gz 2024-09-11T23:21:20.864 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39624.log 2024-09-11T23:21:20.864 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38693.log 2024-09-11T23:21:20.864 INFO:teuthology.orchestra.run.smithi094.stderr: 87.5% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36156.log.gz 2024-09-11T23:21:20.864 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2024-09-11T23:21:20.864 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-09-11T23:21:20.864 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38693.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44799.log 2024-09-11T23:21:20.865 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39624.log.gz 2024-09-11T23:21:20.865 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46593.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38693.log.gz 2024-09-11T23:21:20.865 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41935.log 2024-09-11T23:21:20.865 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2024-09-11T23:21:20.865 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47738.log 2024-09-11T23:21:20.865 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44799.log: /var/log/ceph/ceph-client.admin.41935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-09-11T23:21:20.865 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47738.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41935.log.gz 2024-09-11T23:21:20.866 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-09-11T23:21:20.866 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44799.log.gz 2024-09-11T23:21:20.866 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-09-11T23:21:20.866 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47738.log.gz 2024-09-11T23:21:20.866 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5%/var/log/ceph/ceph-client.admin.47091.log: -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-09-11T23:21:20.866 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45385.log 2024-09-11T23:21:20.866 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47502.log 2024-09-11T23:21:20.867 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2024-09-11T23:21:20.867 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42541.log: /var/log/ceph/ceph-client.admin.45385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44929.log 2024-09-11T23:21:20.867 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-09-11T23:21:20.867 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45385.log.gz /var/log/ceph/ceph-client.admin.38563.log 2024-09-11T23:21:20.867 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.867 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47502.log: /var/log/ceph/ceph-client.admin.44929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36870.log 2024-09-11T23:21:20.867 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38563.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44929.log.gz 2024-09-11T23:21:20.868 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35585.log 2024-09-11T23:21:20.868 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47502.log.gz 2024-09-11T23:21:20.868 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36870.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-09-11T23:21:20.868 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2024-09-11T23:21:20.868 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36870.log.gz 2024-09-11T23:21:20.868 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37898.log 2024-09-11T23:21:20.868 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35585.log: /var/log/ceph/ceph-client.admin.41757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45845.log 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9%/var/log/ceph/ceph-client.admin.37898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37541.log 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35585.log.gz 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45845.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37898.log.gz 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45845.log.gz 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39464.log 2024-09-11T23:21:20.869 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37541.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40457.log 2024-09-11T23:21:20.870 INFO:teuthology.orchestra.run.smithi094.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37541.log.gz 2024-09-11T23:21:20.870 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41789.log 2024-09-11T23:21:20.870 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39464.log: /var/log/ceph/ceph-client.admin.40457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37686.log 2024-09-11T23:21:20.870 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41789.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40457.log.gz 2024-09-11T23:21:20.870 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41789.log.gz 2024-09-11T23:21:20.870 INFO:teuthology.orchestra.run.smithi094.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39464.log.gz 2024-09-11T23:21:20.870 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2024-09-11T23:21:20.871 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41112.log 2024-09-11T23:21:20.871 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6%/var/log/ceph/ceph-client.admin.34588.log: -- replaced with /var/log/ceph/ceph-client.admin.37686.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35376.log 2024-09-11T23:21:20.871 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.871 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2024-09-11T23:21:20.871 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41112.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41112.log.gz 2024-09-11T23:21:20.871 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35790.log 2024-09-11T23:21:20.871 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47032.log 2024-09-11T23:21:20.872 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35790.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35376.log.gz 2024-09-11T23:21:20.872 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34820.log 2024-09-11T23:21:20.872 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38333.log 2024-09-11T23:21:20.872 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35790.log.gz 2024-09-11T23:21:20.872 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47032.log: /var/log/ceph/ceph-client.admin.34820.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47032.log.gz 2024-09-11T23:21:20.872 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34820.log.gz 2024-09-11T23:21:20.872 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45566.log 2024-09-11T23:21:20.873 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2024-09-11T23:21:20.873 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7%/var/log/ceph/ceph-client.admin.45566.log: -- replaced with /var/log/ceph/ceph-client.admin.38333.log.gz 2024-09-11T23:21:20.873 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35298.log 2024-09-11T23:21:20.873 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45566.log.gz 2024-09-11T23:21:20.873 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44903.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2024-09-11T23:21:20.873 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-09-11T23:21:20.873 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41724.log 2024-09-11T23:21:20.874 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40027.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35298.log.gz 2024-09-11T23:21:20.874 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40961.log 2024-09-11T23:21:20.874 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39007.log 2024-09-11T23:21:20.874 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-09-11T23:21:20.874 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41724.log: /var/log/ceph/ceph-client.admin.40961.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41724.log.gz 2024-09-11T23:21:20.874 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40961.log.gz 2024-09-11T23:21:20.874 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38896.log 2024-09-11T23:21:20.875 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38420.log 2024-09-11T23:21:20.875 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8%/var/log/ceph/ceph-client.admin.38896.log: -- replaced with /var/log/ceph/ceph-client.admin.39007.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2024-09-11T23:21:20.875 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.875 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38896.log.gz 2024-09-11T23:21:20.875 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38420.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38420.log.gz 2024-09-11T23:21:20.875 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41514.log 2024-09-11T23:21:20.875 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39722.log 2024-09-11T23:21:20.876 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4%/var/log/ceph/ceph-client.admin.41514.log: -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38104.log 2024-09-11T23:21:20.876 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.876 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41514.log.gz 2024-09-11T23:21:20.876 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39722.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39722.log.gz 2024-09-11T23:21:20.876 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2024-09-11T23:21:20.876 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-09-11T23:21:20.876 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9%/var/log/ceph/ceph-client.admin.44717.log: -- replaced with /var/log/ceph/ceph-client.admin.38104.log.gzgzip 2024-09-11T23:21:20.877 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45905.log 2024-09-11T23:21:20.877 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2024-09-11T23:21:20.877 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44877.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-09-11T23:21:20.877 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2024-09-11T23:21:20.877 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37189.log 2024-09-11T23:21:20.877 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45905.log: /var/log/ceph/ceph-client.admin.47972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39438.log 2024-09-11T23:21:20.877 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2024-09-11T23:21:20.878 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37189.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2024-09-11T23:21:20.878 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37189.log.gz 2024-09-11T23:21:20.878 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42848.log 2024-09-11T23:21:20.878 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2024-09-11T23:21:20.878 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39438.log.gz 2024-09-11T23:21:20.878 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40773.log 2024-09-11T23:21:20.879 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39225.log 2024-09-11T23:21:20.879 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42848.log.gz 2024-09-11T23:21:20.879 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43741.log: /var/log/ceph/ceph-client.admin.40773.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2024-09-11T23:21:20.879 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37738.log 2024-09-11T23:21:20.879 INFO:teuthology.orchestra.run.smithi094.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40773.log.gz 2024-09-11T23:21:20.879 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35246.log 2024-09-11T23:21:20.879 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39225.log: /var/log/ceph/ceph-client.admin.37738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41052.log 2024-09-11T23:21:20.880 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2024-09-11T23:21:20.880 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1%/var/log/ceph/ceph-client.admin.35246.log: -- replaced with /var/log/ceph/ceph-client.admin.37738.log.gz 2024-09-11T23:21:20.880 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35246.log.gz 2024-09-11T23:21:20.880 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40643.log 2024-09-11T23:21:20.880 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2024-09-11T23:21:20.880 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40643.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41052.log.gz 2024-09-11T23:21:20.880 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47608.log 2024-09-11T23:21:20.881 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2024-09-11T23:21:20.881 INFO:teuthology.orchestra.run.smithi094.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40643.log.gz 2024-09-11T23:21:20.881 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46675.log: /var/log/ceph/ceph-client.admin.47608.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2024-09-11T23:21:20.881 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47608.log.gz 2024-09-11T23:21:20.881 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47281.log 2024-09-11T23:21:20.881 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37567.log 2024-09-11T23:21:20.881 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42684.log: /var/log/ceph/ceph-client.admin.47281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43873.log 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37567.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47281.log.gz 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37567.log.gz 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35576.log 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35576.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35576.log.gz/var/log/ceph/ceph-client.admin.42093.log: 2024-09-11T23:21:20.882 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-09-11T23:21:20.883 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36649.log 2024-09-11T23:21:20.883 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2024-09-11T23:21:20.883 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36649.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36649.log.gz 2024-09-11T23:21:20.883 INFO:teuthology.orchestra.run.smithi094.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T23:21:20.883 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46963.log 2024-09-11T23:21:20.883 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40164.log 2024-09-11T23:21:20.883 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45417.log: /var/log/ceph/ceph-client.0.46963.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2024-09-11T23:21:20.884 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47790.log 2024-09-11T23:21:20.884 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40164.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40164.log.gz 2024-09-11T23:21:20.884 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35791.log 2024-09-11T23:21:20.884 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47790.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47790.log.gz 2024-09-11T23:21:20.884 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2024-09-11T23:21:20.884 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35791.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35791.log.gz 2024-09-11T23:21:20.884 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35579.log 2024-09-11T23:21:20.885 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47554.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2024-09-11T23:21:20.885 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38766.log 2024-09-11T23:21:20.885 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35579.log: 94.1% -- replaced with /var/log/ceph/ceph-client.0.46963.log.gz 2024-09-11T23:21:20.885 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35579.log.gz 2024-09-11T23:21:20.885 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41441.log 2024-09-11T23:21:20.885 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2024-09-11T23:21:20.885 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38766.log: /var/log/ceph/ceph-client.admin.41441.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38766.log.gz 2024-09-11T23:21:20.886 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41441.log.gz 2024-09-11T23:21:20.886 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-09-11T23:21:20.886 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42067.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2024-09-11T23:21:20.886 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2024-09-11T23:21:20.886 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46619.log 2024-09-11T23:21:20.886 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43293.log: /var/log/ceph/ceph-client.admin.41337.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-09-11T23:21:20.886 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% 95.5% -- replaced with /var/log/ceph/ceph-client.0.43873.log.gz 2024-09-11T23:21:20.887 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35378.log 2024-09-11T23:21:20.887 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.887 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45747.log 2024-09-11T23:21:20.887 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46619.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40487.log 2024-09-11T23:21:20.887 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.887 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35378.log: /var/log/ceph/ceph-client.admin.45747.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35378.log.gz 2024-09-11T23:21:20.887 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45747.log.gz 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36026.log 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40053.log 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36026.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40487.log.gz 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44656.log 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36026.log.gz -5 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40053.log: /var/log/ceph/ceph-client.admin.44656.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44656.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2024-09-11T23:21:20.888 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:20.889 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39852.log 2024-09-11T23:21:20.889 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37924.log 2024-09-11T23:21:20.889 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39852.log: /var/log/ceph/ceph-client.admin.37319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38217.log 2024-09-11T23:21:20.889 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37924.log: 88.1% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-09-11T23:21:20.889 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39852.log.gz 2024-09-11T23:21:20.889 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37924.log.gz 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42171.log 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45983.log 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38217.log: /var/log/ceph/ceph-client.admin.42171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39412.log 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45983.log: 89.0% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38217.log.gz 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42171.log.gz 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45983.log.gz 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37593.log 2024-09-11T23:21:20.890 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36000.log 2024-09-11T23:21:20.891 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39412.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37593.log: /var/log/ceph/ceph-client.admin.41646.log 2024-09-11T23:21:20.891 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36000.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39412.log.gz 2024-09-11T23:21:20.891 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37593.log.gz 2024-09-11T23:21:20.891 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36000.log.gz 2024-09-11T23:21:20.891 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2024-09-11T23:21:20.891 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36217.log 2024-09-11T23:21:20.891 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41646.log: /var/log/ceph/ceph-client.admin.46134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34530.log 2024-09-11T23:21:20.892 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36217.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41646.log.gz 2024-09-11T23:21:20.892 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2024-09-11T23:21:20.892 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37794.log 2024-09-11T23:21:20.892 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36217.log.gz 2024-09-11T23:21:20.892 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43936.log 2024-09-11T23:21:20.892 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42015.log 2024-09-11T23:21:20.892 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37794.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34530.log.gz 87.3% 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43936.log: -- replaced with /var/log/ceph/ceph-client.admin.37794.log.gz 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43936.log.gz 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40079.log 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44183.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42015.log.gz 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40405.log 2024-09-11T23:21:20.893 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-09-11T23:21:20.894 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40079.log: /var/log/ceph/ceph-client.admin.35090.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40079.log.gz 2024-09-11T23:21:20.894 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2024-09-11T23:21:20.894 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35194.log 2024-09-11T23:21:20.894 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37489.log 2024-09-11T23:21:20.894 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40405.log: /var/log/ceph/ceph-client.admin.35194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2024-09-11T23:21:20.894 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40405.log.gz 2024-09-11T23:21:20.894 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35194.log.gz 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42513.log 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37489.log.gz 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39360.log 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41880.log: /var/log/ceph/ceph-client.admin.42513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35583.log 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39360.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42513.log.gz 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39360.log.gz 2024-09-11T23:21:20.895 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40342.log 2024-09-11T23:21:20.896 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34560.log 2024-09-11T23:21:20.896 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35583.log: /var/log/ceph/ceph-client.admin.40342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44053.log 2024-09-11T23:21:20.896 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34560.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35583.log.gz 2024-09-11T23:21:20.896 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40342.log.gz 2024-09-11T23:21:20.896 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45061.log 2024-09-11T23:21:20.896 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34560.log.gz 2024-09-11T23:21:20.896 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41311.log 2024-09-11T23:21:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44053.log: /var/log/ceph/ceph-client.0.45061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44600.log 2024-09-11T23:21:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41311.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44053.log.gz 2024-09-11T23:21:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-09-11T23:21:20.897 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41311.log.gz 2024-09-11T23:21:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44600.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44600.log.gz 2024-09-11T23:21:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43200.log 2024-09-11T23:21:20.897 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43266.log: /var/log/ceph/ceph-client.admin.43200.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35064.log 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43200.log.gz 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38589.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36130.log 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35064.log: /var/log/ceph/ceph-client.admin.36130.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35064.log.gz 2024-09-11T23:21:20.898 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36130.log.gz 2024-09-11T23:21:20.899 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44450.log 2024-09-11T23:21:20.899 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44131.log 2024-09-11T23:21:20.899 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38615.log: /var/log/ceph/ceph-client.admin.44450.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2024-09-11T23:21:20.899 INFO:teuthology.orchestra.run.smithi094.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44450.log.gz 2024-09-11T23:21:20.899 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47816.log 2024-09-11T23:21:20.899 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44131.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44131.log.gz 2024-09-11T23:21:20.899 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36898.log 2024-09-11T23:21:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36786.log 2024-09-11T23:21:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47816.log: /var/log/ceph/ceph-client.admin.36898.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47816.log.gz 2024-09-11T23:21:20.900 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36898.log.gz 2024-09-11T23:21:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36344.log 2024-09-11T23:21:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45957.log 2024-09-11T23:21:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36786.log: /var/log/ceph/ceph-client.0.36344.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36786.log.gz 2024-09-11T23:21:20.900 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T23:21:20.901 INFO:teuthology.orchestra.run.smithi094.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.0.36344.log.gz 2024-09-11T23:21:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45957.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45957.log.gz 2024-09-11T23:21:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-11T23:21:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46317.log 2024-09-11T23:21:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.c.log: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T23:21:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35007.log 2024-09-11T23:21:20.901 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46317.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46317.log.gz 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47764.log 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35007.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35007.log.gz 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39386.log 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47764.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47764.log.gz 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39662.log 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39386.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39386.log.gz 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2024-09-11T23:21:20.902 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39662.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39662.log.gz 2024-09-11T23:21:20.903 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34411.log 2024-09-11T23:21:20.904 INFO:teuthology.orchestra.run.smithi155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T23:21:20.906 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45172.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2024-09-11T23:21:20.906 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-11T23:21:20.906 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34411.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34411.log.gz 2024-09-11T23:21:20.906 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43767.log 2024-09-11T23:21:20.906 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42796.log 2024-09-11T23:21:20.906 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43767.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43767.log.gz 2024-09-11T23:21:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2024-09-11T23:21:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42796.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42796.log.gz 2024-09-11T23:21:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42649.log 2024-09-11T23:21:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43427.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2024-09-11T23:21:20.907 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39826.log 2024-09-11T23:21:20.908 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42649.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42649.log.gz 2024-09-11T23:21:20.915 INFO:teuthology.orchestra.run.smithi155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T23:21:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35586.log 2024-09-11T23:21:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39826.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39826.log.gz 2024-09-11T23:21:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39133.log 2024-09-11T23:21:20.924 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35586.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35586.log.gz 2024-09-11T23:21:20.931 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48025.log 2024-09-11T23:21:20.932 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39133.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39133.log.gz 2024-09-11T23:21:20.940 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-09-11T23:21:20.940 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48025.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48025.log.gz 2024-09-11T23:21:20.947 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47894.log 2024-09-11T23:21:20.948 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-09-11T23:21:20.955 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39923.log 2024-09-11T23:21:20.956 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47894.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47894.log.gz 2024-09-11T23:21:20.963 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42744.log 2024-09-11T23:21:20.964 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39923.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39923.log.gz 2024-09-11T23:21:20.971 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-09-11T23:21:20.972 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42744.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42744.log.gz 2024-09-11T23:21:20.979 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38002.log 2024-09-11T23:21:20.980 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34226.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-09-11T23:21:20.987 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41082.log 2024-09-11T23:21:20.988 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38002.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38002.log.gz 2024-09-11T23:21:20.999 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35142.log 2024-09-11T23:21:21.000 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41082.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41082.log.gz 2024-09-11T23:21:21.007 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40993.log 2024-09-11T23:21:21.008 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35142.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35142.log.gz 2024-09-11T23:21:21.016 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35568.log 2024-09-11T23:21:21.016 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40993.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40993.log.gz 2024-09-11T23:21:21.023 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40262.log 2024-09-11T23:21:21.024 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35568.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35568.log.gz 2024-09-11T23:21:21.031 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39696.log 2024-09-11T23:21:21.032 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40262.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40262.log.gz 2024-09-11T23:21:21.039 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43347.log 2024-09-11T23:21:21.040 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39696.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39696.log.gz 2024-09-11T23:21:21.052 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36104.log 2024-09-11T23:21:21.052 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43347.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43347.log.gz 2024-09-11T23:21:21.059 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36539.log 2024-09-11T23:21:21.060 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36104.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36104.log.gz 2024-09-11T23:21:21.067 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2024-09-11T23:21:21.068 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36539.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36539.log.gz 2024-09-11T23:21:21.075 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39251.log 2024-09-11T23:21:21.076 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46805.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2024-09-11T23:21:21.083 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44628.log 2024-09-11T23:21:21.084 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39251.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39251.log.gz 2024-09-11T23:21:21.091 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36701.log 2024-09-11T23:21:21.092 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44628.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44628.log.gz 2024-09-11T23:21:21.099 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38844.log 2024-09-11T23:21:21.100 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36701.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36701.log.gz 2024-09-11T23:21:21.111 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37384.log 2024-09-11T23:21:21.112 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38844.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38844.log.gz 2024-09-11T23:21:21.119 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37059.log 2024-09-11T23:21:21.120 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37384.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37384.log.gz 2024-09-11T23:21:21.127 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40881.log 2024-09-11T23:21:21.128 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37059.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37059.log.gz 2024-09-11T23:21:21.135 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37163.log 2024-09-11T23:21:21.152 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.40881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35220.log 2024-09-11T23:21:21.152 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37163.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37163.log.gz 2024-09-11T23:21:21.159 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43962.log 2024-09-11T23:21:21.160 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35220.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35220.log.gz 2024-09-11T23:21:21.169 INFO:teuthology.orchestra.run.smithi094.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.40881.log.gz 2024-09-11T23:21:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45506.log 2024-09-11T23:21:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43962.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43962.log.gz 2024-09-11T23:21:21.199 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35168.log 2024-09-11T23:21:21.200 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45506.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45506.log.gz 2024-09-11T23:21:21.211 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37234.log 2024-09-11T23:21:21.212 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35168.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35168.log.gz 2024-09-11T23:21:21.223 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2024-09-11T23:21:21.224 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37234.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37234.log.gz 2024-09-11T23:21:21.240 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2024-09-11T23:21:21.241 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34948.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2024-09-11T23:21:21.247 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43135.log 2024-09-11T23:21:21.248 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45359.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2024-09-11T23:21:21.255 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36925.log 2024-09-11T23:21:21.256 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43135.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43135.log.gz 2024-09-11T23:21:21.263 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39514.log 2024-09-11T23:21:21.264 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36925.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36925.log.gz 2024-09-11T23:21:21.271 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38363.log 2024-09-11T23:21:21.272 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39514.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39514.log.gz 2024-09-11T23:21:21.279 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45717.log 2024-09-11T23:21:21.280 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38363.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38363.log.gz 2024-09-11T23:21:21.287 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40431.log 2024-09-11T23:21:21.288 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45717.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45717.log.gz 2024-09-11T23:21:21.304 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44313.log 2024-09-11T23:21:21.305 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40431.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40431.log.gz 2024-09-11T23:21:21.312 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38028.log 2024-09-11T23:21:21.312 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44313.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44313.log.gz 2024-09-11T23:21:21.319 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44417.log 2024-09-11T23:21:21.320 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38028.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38028.log.gz 2024-09-11T23:21:21.326 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40591.log 2024-09-11T23:21:21.327 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44417.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44417.log.gz 2024-09-11T23:21:21.335 INFO:teuthology.orchestra.run.smithi094.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T23:21:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39975.log 2024-09-11T23:21:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40591.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40591.log.gz 2024-09-11T23:21:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39774.log 2024-09-11T23:21:21.338 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39975.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39975.log.gz 2024-09-11T23:21:21.338 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47634.log 2024-09-11T23:21:21.338 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39774.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39774.log.gz 2024-09-11T23:21:21.339 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44391.log 2024-09-11T23:21:21.340 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47634.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47634.log.gz 2024-09-11T23:21:21.340 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47920.log 2024-09-11T23:21:21.344 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44391.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44391.log.gz 2024-09-11T23:21:21.344 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2024-09-11T23:21:21.347 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47920.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47920.log.gz 2024-09-11T23:21:21.347 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36981.log 2024-09-11T23:21:21.347 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34692.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz 2024-09-11T23:21:21.347 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43005.log 2024-09-11T23:21:21.347 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36981.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36981.log.gz 2024-09-11T23:21:21.348 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36394.log 2024-09-11T23:21:21.348 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43005.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43005.log.gz 2024-09-11T23:21:21.348 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2024-09-11T23:21:21.348 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36394.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36394.log.gz 2024-09-11T23:21:21.348 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38537.log 2024-09-11T23:21:21.349 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46645.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2024-09-11T23:21:21.350 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38955.log 2024-09-11T23:21:21.350 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38537.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38537.log.gz 2024-09-11T23:21:21.350 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35372.log 2024-09-11T23:21:21.351 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38955.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38955.log.gz 2024-09-11T23:21:21.351 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47582.log 2024-09-11T23:21:21.351 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35372.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35372.log.gz 2024-09-11T23:21:21.352 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43109.log 2024-09-11T23:21:21.352 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47582.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47582.log.gz 2024-09-11T23:21:21.353 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36727.log 2024-09-11T23:21:21.354 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43109.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43109.log.gz 2024-09-11T23:21:21.354 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42353.log 2024-09-11T23:21:21.355 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36727.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36727.log.gz 2024-09-11T23:21:21.355 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39161.log 2024-09-11T23:21:21.356 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42353.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42353.log.gz 2024-09-11T23:21:21.357 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44691.log 2024-09-11T23:21:21.358 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39161.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39161.log.gz 2024-09-11T23:21:21.358 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39334.log 2024-09-11T23:21:21.359 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44691.log.gz 2024-09-11T23:21:21.359 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40565.log 2024-09-11T23:21:21.360 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39334.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39334.log.gz 2024-09-11T23:21:21.361 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29013.log 2024-09-11T23:21:21.361 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40565.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40565.log.gz 2024-09-11T23:21:21.362 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42327.log 2024-09-11T23:21:21.363 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.29013.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29013.log.gz 2024-09-11T23:21:21.363 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40001.log 2024-09-11T23:21:21.364 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42327.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42327.log.gz 2024-09-11T23:21:21.364 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41672.log 2024-09-11T23:21:21.365 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40001.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40001.log.gz 2024-09-11T23:21:21.365 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47842.log 2024-09-11T23:21:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41672.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41672.log.gz 2024-09-11T23:21:21.367 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2024-09-11T23:21:21.367 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47842.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47842.log.gz 2024-09-11T23:21:21.368 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47378.log 2024-09-11T23:21:21.369 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44261.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2024-09-11T23:21:21.369 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36753.log 2024-09-11T23:21:21.370 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47378.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47378.log.gz 2024-09-11T23:21:21.370 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41389.log 2024-09-11T23:21:21.371 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36753.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36753.log.gz 2024-09-11T23:21:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42822.log 2024-09-11T23:21:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41389.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41389.log.gz 2024-09-11T23:21:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38273.log 2024-09-11T23:21:21.374 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42822.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42822.log.gz 2024-09-11T23:21:21.374 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2024-09-11T23:21:21.375 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38273.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38273.log.gz 2024-09-11T23:21:21.375 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36597.log 2024-09-11T23:21:21.376 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.44482.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2024-09-11T23:21:21.376 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47307.log 2024-09-11T23:21:21.377 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36597.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36597.log.gz 2024-09-11T23:21:21.378 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37007.log 2024-09-11T23:21:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47307.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47307.log.gz 2024-09-11T23:21:21.379 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40539.log 2024-09-11T23:21:21.380 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37007.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37007.log.gz 2024-09-11T23:21:21.380 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46831.log 2024-09-11T23:21:21.381 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40539.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40539.log.gz 2024-09-11T23:21:21.382 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38445.log 2024-09-11T23:21:21.382 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46831.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46831.log.gz 2024-09-11T23:21:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-09-11T23:21:21.383 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38445.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38445.log.gz 2024-09-11T23:21:21.384 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46037.log 2024-09-11T23:21:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42597.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-09-11T23:21:21.385 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34286.log 2024-09-11T23:21:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46037.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46037.log.gz 2024-09-11T23:21:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42403.log 2024-09-11T23:21:21.387 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34286.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34286.log.gz 2024-09-11T23:21:21.388 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38641.log 2024-09-11T23:21:21.388 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42403.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42403.log.gz 2024-09-11T23:21:21.389 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2024-09-11T23:21:21.390 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38641.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38641.log.gz 2024-09-11T23:21:21.390 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37287.log 2024-09-11T23:21:21.391 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40695.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2024-09-11T23:21:21.391 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39878.log 2024-09-11T23:21:21.392 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37287.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37287.log.gz 2024-09-11T23:21:21.392 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35373.log 2024-09-11T23:21:21.393 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39878.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39878.log.gz 2024-09-11T23:21:21.394 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41259.log 2024-09-11T23:21:21.395 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35373.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35373.log.gz 2024-09-11T23:21:21.395 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45687.log 2024-09-11T23:21:21.396 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41259.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41259.log.gz 2024-09-11T23:21:21.396 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47946.log 2024-09-11T23:21:21.397 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45687.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45687.log.gz 2024-09-11T23:21:21.397 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35375.log 2024-09-11T23:21:21.398 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47946.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47946.log.gz 2024-09-11T23:21:21.399 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38160.log 2024-09-11T23:21:21.399 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35375.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35375.log.gz 2024-09-11T23:21:21.400 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-09-11T23:21:21.419 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.38160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2024-09-11T23:21:21.420 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42718.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-09-11T23:21:21.440 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48075.log 2024-09-11T23:21:21.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45443.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2024-09-11T23:21:21.448 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36844.log 2024-09-11T23:21:21.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48075.log.gz 2024-09-11T23:21:21.455 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48049.log 2024-09-11T23:21:21.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36844.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36844.log.gz 2024-09-11T23:21:21.463 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41488.log 2024-09-11T23:21:21.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48049.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48049.log.gz 2024-09-11T23:21:21.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41415.log 2024-09-11T23:21:21.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41488.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41488.log.gz 2024-09-11T23:21:21.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35272.log 2024-09-11T23:21:21.480 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41415.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41415.log.gz 2024-09-11T23:21:21.487 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39196.log 2024-09-11T23:21:21.488 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35272.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35272.log.gz 2024-09-11T23:21:21.495 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41698.log 2024-09-11T23:21:21.496 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39196.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39196.log.gz 2024-09-11T23:21:21.503 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2024-09-11T23:21:21.504 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41698.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41698.log.gz 2024-09-11T23:21:21.515 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46907.log 2024-09-11T23:21:21.516 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46352.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2024-09-11T23:21:21.523 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40314.log 2024-09-11T23:21:21.524 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46907.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46907.log.gz 2024-09-11T23:21:21.531 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46187.log 2024-09-11T23:21:21.532 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40314.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40314.log.gz 2024-09-11T23:21:21.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-09-11T23:21:21.540 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46187.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46187.log.gz 2024-09-11T23:21:21.548 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23978.log 2024-09-11T23:21:21.548 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42223.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-09-11T23:21:21.556 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.tmp-client.admin.23978.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23978.log.gz 2024-09-11T23:21:22.273 INFO:teuthology.orchestra.run.smithi094.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.0.38160.log.gz 2024-09-11T23:21:22.471 INFO:teuthology.orchestra.run.smithi155.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T23:21:22.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-11T23:21:22.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-11T23:21:22.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-11T23:21:22.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-11T23:21:22.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-11T23:21:22.623 INFO:teuthology.orchestra.run.smithi155.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T23:21:22.627 INFO:teuthology.orchestra.run.smithi155.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T23:21:22.749 INFO:teuthology.orchestra.run.smithi155.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T23:21:22.751 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-11T23:21:22.752 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m2.091s 2024-09-11T23:21:22.752 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m8.156s 2024-09-11T23:21:22.752 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.307s 2024-09-11T23:21:23.395 INFO:teuthology.orchestra.run.smithi094.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T23:21:23.481 INFO:teuthology.orchestra.run.smithi094.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T23:21:23.481 INFO:teuthology.orchestra.run.smithi094.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.45061.log.gz 2024-09-11T23:21:23.661 INFO:teuthology.orchestra.run.smithi094.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T23:21:23.745 INFO:teuthology.orchestra.run.smithi094.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T23:21:23.870 INFO:teuthology.orchestra.run.smithi094.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-11T23:21:28.666 INFO:teuthology.orchestra.run.smithi094.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-11T23:21:28.667 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-11T23:21:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m8.020s 2024-09-11T23:21:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:user 0m26.073s 2024-09-11T23:21:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m0.861s 2024-09-11T23:21:28.668 INFO:tasks.ceph:Archiving logs... 2024-09-11T23:21:28.669 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/remote/smithi094/log 2024-09-11T23:21:28.670 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:21:31.598 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/remote/smithi155/log 2024-09-11T23:21:31.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:21:32.668 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T23:21:32.677 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T23:21:32.678 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:21:32.681 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:21:32.776 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T23:21:32.785 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T23:21:32.785 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:21:32.788 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:21:32.797 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T23:21:32.798 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-09-11T23:21:32.798 INFO:teuthology.orchestra.run.smithi094.stdout:+hv01.front.sepi 67.205.162.81 3 u 59 64 377 0.077 -4.117 1.438 2024-09-11T23:21:32.798 INFO:teuthology.orchestra.run.smithi094.stdout:*hv02.front.sepi 96.245.170.99 3 u 1 64 377 0.072 +0.016 0.865 2024-09-11T23:21:32.798 INFO:teuthology.orchestra.run.smithi094.stdout:+hv03.front.sepi 74.6.168.72 3 u 62 64 377 0.085 +1.020 1.289 2024-09-11T23:21:32.798 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-11T23:21:32.799 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T23:21:32.799 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-09-11T23:21:32.799 INFO:teuthology.orchestra.run.smithi155.stdout:+hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.089 -2.483 1.706 2024-09-11T23:21:32.800 INFO:teuthology.orchestra.run.smithi155.stdout:*hv02.front.sepi 96.245.170.99 3 u 2 64 377 0.069 -1.973 1.764 2024-09-11T23:21:32.800 INFO:teuthology.orchestra.run.smithi155.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.083 +1.182 2.141 2024-09-11T23:21:32.800 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-11T23:21:32.801 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T23:21:32.809 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T23:21:32.810 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T23:21:32.818 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T23:21:32.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T23:21:32.834 INFO:teuthology.task.internal:Duration was 1051.746270 seconds 2024-09-11T23:21:32.835 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T23:21:32.843 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T23:21:32.843 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:21:32.846 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:21:32.882 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T23:21:32.882 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-09-11T23:21:32.882 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:21:32.937 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-09-11T23:21:32.937 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:21:32.948 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T23:21:32.948 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:21:32.985 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:21:33.019 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T23:21:33.019 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:21:33.056 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:21:33.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T23:21:33.140 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T23:21:33.140 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:21:33.151 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:21:33.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T23:21:33.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:21:33.197 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:21:33.206 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-09-11T23:21:33.215 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-09-11T23:21:33.227 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:21:33.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:21:33.267 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:21:33.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:21:33.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T23:21:33.282 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T23:21:33.283 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/remote/smithi094 2024-09-11T23:21:33.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:21:33.333 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901460/remote/smithi155 2024-09-11T23:21:33.333 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:21:33.354 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T23:21:33.355 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:21:33.372 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:21:33.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T23:21:33.414 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T23:21:33.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T23:21:33.424 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T23:21:33.424 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:21:33.426 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:21:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:21 /home/ubuntu/cephtest 2024-09-11T23:21:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:21 /home/ubuntu/cephtest 2024-09-11T23:21:33.451 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T23:21:33.461 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T23:21:33.483 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/strays} duration: 1051.7462697029114 failure_reason: 'Test failure: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=348c670a77fe444381ba2c9c637291dd status: fail success: false 2024-09-11T23:21:33.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:21:33.573 INFO:teuthology.run:FAIL